2024-09-14T10:34:53.656 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:34:53.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:34:54.033 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127 branch: main description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904127' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzHHTz7xU16xLixLXpO8R7JG+GIoai8AI2Ox8QIDwrN94CNtx+0sHg9+D68zQuKMBG+8d8WzmlTgy3fdXjLccw= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIn7ww6KpJvheHBNCtp8NOmzSlB3iyMs1+h2225WaVZxOwcS0OqY5aFK7QakSmGQgtx9C/JDLZMUBgA0owEOeDU= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:34:54.033 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:34:54.034 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:34:54.034 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:34:54.035 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:34:54.058 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:34:54.058 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:34:54.058 INFO:teuthology.packaging:ref: None 2024-09-14T10:34:54.058 INFO:teuthology.packaging:tag: None 2024-09-14T10:34:54.058 INFO:teuthology.packaging:branch: main 2024-09-14T10:34:54.058 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:34:54.058 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-14T10:34:54.296 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:34:54.298 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:34:54.304 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:34:54.304 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:34:54.311 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:34:54.331 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:34:54.338 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:34:54.361 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:29:12.878084', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPKPRyplnyABIcAhmrqc8dUvpy204Zo+LLyqH/XiNNhq'} 2024-09-14T10:34:54.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:29:12.876637', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK//FcwOG0wMBwRQxYCAItxaukjKxHnNQlaKkHaYhDw6'} 2024-09-14T10:34:54.385 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:34:54.391 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:34:54.391 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:34:54.391 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:34:54.445 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7bc7de8040>, signals=[15]) 2024-09-14T10:34:54.445 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:34:54.451 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:34:54.451 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T10:34:54.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:34:54.531 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T10:34:54.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:34:54.609 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:34:54.616 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-14T10:34:54.620 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-14T10:34:54.621 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-14T10:34:54.670 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:34:54.670 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2024-09-14T10:34:54.670 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2024-09-14T10:34:54.670 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:34:54.670 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2024-09-14T10:34:54.671 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2024-09-14T10:34:54.671 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2024-09-14T10:34:54.671 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:34:54.671 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:34:54.671 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:34:54.671 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:34:54.671 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:34:54.671 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-14T10:34:54.691 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-09-14T10:34:54.697 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-09-14T10:34:54.697 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-09-14T10:34:54.745 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:34:54.745 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu" 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04" 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:34:54.746 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:34:54.746 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-09-14T10:34:54.766 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:34:54.775 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:34:54.781 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:34:54.781 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:34:54.783 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:34:54.793 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:34:54.798 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:34:54.798 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:34:54.832 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:34:55.126 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:34:55.183 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:34:55.201 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:34:55.201 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:34:55.202 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:34:55.202 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:34:55.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:34:55.207 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-14T10:34:55.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:34:55.208 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-14T10:34:55.254 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-56-generic 2024-09-14T10:34:55.254 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.15.0-56-generic 2024-09-14T10:34:55.254 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2024-09-14T10:34:55.255 INFO:teuthology.orchestra.run.smithi148.stdout:5.15.0-56-generic 2024-09-14T10:34:55.255 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.15.0-56-generic 2024-09-14T10:34:55.256 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get clean 2024-09-14T10:34:55.387 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-14T10:34:55.388 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2024-09-14T10:34:55.521 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:34:55.521 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:34:55.530 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:34:55.530 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:34:55.530 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:34:55.531 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:34:55.602 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:34:55.605 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:34:55.767 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:34:55.834 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:34:55.839 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:34:55.843 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:34:55.871 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:34:55.873 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:34:55.873 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:34:55.874 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:34:55.892 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:34:55.895 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:34:55.895 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:34:55.899 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:34:55.905 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:34:55.906 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:34:55.912 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:34:55.913 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:34:55.913 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:34:55.924 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:34:55.924 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:34:55.931 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:34:55.935 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:34:55.936 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:34:55.936 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:34:55.950 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:34:55.957 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:34:55.960 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:34:55.960 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:34:55.965 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:34:55.968 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:34:55.972 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:34:55.973 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:34:55.974 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:34:55.974 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:34:55.974 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:34:55.975 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:34:55.976 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:34:55.977 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:34:55.977 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:34:55.986 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:34:55.986 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:34:55.986 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:34:55.987 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:34:56.001 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:34:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:34:56.003 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:34:56.003 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:34:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:34:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:34:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:34:56.006 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:34:56.006 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:34:56.008 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:34:56.010 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:34:56.010 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:34:56.013 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:34:56.017 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:34:56.043 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:34:56.043 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:34:56.043 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:34:56.043 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:34:56.044 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:34:56.053 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:34:56.053 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:34:56.053 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:34:56.053 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:34:56.060 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:34:56.072 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:34:56.074 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:34:56.074 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:34:56.074 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:34:56.076 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:34:56.079 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:34:56.079 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:34:56.080 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:34:56.092 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:34:56.093 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:34:56.093 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:34:56.093 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:34:56.094 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:34:56.096 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:35:02.243 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 16.0 MB in 2s (7,138 kB/s) 2024-09-14T10:35:02.245 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 16.0 MB in 2s (7,430 kB/s) 2024-09-14T10:35:03.572 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-14T10:35:03.589 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:35:03.642 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-14T10:35:03.690 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-09-14T10:35:03.709 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:35:03.762 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-09-14T10:35:03.828 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-14T10:35:03.829 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-14T10:35:03.949 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-09-14T10:35:03.950 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-09-14T10:35:03.995 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:35:03.995 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:35:03.995 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:35:03.996 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:35:03.996 INFO:teuthology.orchestra.run.smithi150.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:35:03.996 INFO:teuthology.orchestra.run.smithi150.stdout: python2.7-minimal 2024-09-14T10:35:03.996 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:35:03.997 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-14T10:35:03.997 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:35:03.997 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:35:03.997 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:35:03.998 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-14T10:35:03.999 INFO:teuthology.orchestra.run.smithi150.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:35:03.999 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2024-09-14T10:35:03.999 INFO:teuthology.orchestra.run.smithi150.stdout: thermald 2024-09-14T10:35:04.052 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-14T10:35:04.052 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:35:04.052 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:35:04.053 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:35:04.054 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2024-09-14T10:35:04.054 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:35:04.105 INFO:teuthology.orchestra.run.smithi150.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:35:04.105 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 113 MB of archives. 2024-09-14T10:35:04.105 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:35:04.105 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:35:04.116 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:35:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:35:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:35:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:35:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:35:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: python2.7-minimal 2024-09-14T10:35:04.117 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:35:04.118 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-09-14T10:35:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:35:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:35:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:35:04.120 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-09-14T10:35:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:35:04.120 INFO:teuthology.orchestra.run.smithi148.stdout:Recommended packages: 2024-09-14T10:35:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: thermald 2024-09-14T10:35:04.163 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-09-14T10:35:04.163 INFO:teuthology.orchestra.run.smithi148.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:35:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:35:04.164 INFO:teuthology.orchestra.run.smithi148.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:35:04.165 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages will be upgraded: 2024-09-14T10:35:04.166 INFO:teuthology.orchestra.run.smithi148.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:35:04.215 INFO:teuthology.orchestra.run.smithi148.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:35:04.215 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 113 MB of archives. 2024-09-14T10:35:04.215 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:35:04.216 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:35:04.525 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:35:04.615 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:35:04.627 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:35:04.731 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:35:05.429 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:35:05.429 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:35:05.430 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:35:05.497 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:35:05.497 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:35:05.497 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:35:05.557 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:35:05.578 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:35:05.621 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:35:05.720 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:35:05.974 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 113 MB in 2s (74.7 MB/s) 2024-09-14T10:35:06.121 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 113 MB in 2s (73.2 MB/s) 2024-09-14T10:35:06.125 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:35:06.333 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:35:08.181 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:35:08.185 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:35:08.248 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:08.849 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:35:08.853 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:35:08.987 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:10.307 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:35:10.328 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:35:10.406 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:10.861 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:35:10.881 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:35:10.919 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:11.115 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:35:11.137 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:35:11.223 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:11.702 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:35:11.722 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:35:11.785 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:17.795 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:35:17.897 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:35:18.197 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:35:18.325 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:35:18.636 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:35:18.647 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:35:18.686 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:35:19.016 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:35:19.152 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:35:19.509 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:35:19.630 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:35:19.942 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:35:19.964 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:35:20.008 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:35:24.016 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:35:24.053 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:35:24.091 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:25.673 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:35:25.710 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:35:25.748 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:26.720 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:35:26.845 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:35:27.178 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:35:27.308 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:27.434 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:35:27.562 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:28.449 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:35:28.595 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:35:28.924 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:35:28.924 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:35:28.924 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:35:28.924 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:35:28.941 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:35:29.065 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:29.081 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:29.206 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:35:29.333 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:30.507 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:35:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:35:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:35:30.695 INFO:teuthology.orchestra.run.smithi148.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:35:31.772 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:32.334 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:35:32.460 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:35:32.586 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:32.647 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:35:32.647 INFO:teuthology.orchestra.run.smithi150.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:35:33.205 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:34.606 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:35:34.707 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:35:34.825 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:35:34.915 INFO:teuthology.orchestra.run.smithi148.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:35:34.915 INFO:teuthology.orchestra.run.smithi148.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:35:47.278 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:35:47.279 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:35:47.287 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:35:47.318 INFO:teuthology.orchestra.run.smithi150.stdout:Generating grub configuration file ... 2024-09-14T10:35:47.599 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:35:47.625 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:35:47.929 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:35:47.935 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:35:48.003 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:35:48.008 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:35:48.167 INFO:teuthology.orchestra.run.smithi150.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:35:48.167 INFO:teuthology.orchestra.run.smithi150.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:35:48.167 INFO:teuthology.orchestra.run.smithi150.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:35:48.213 INFO:teuthology.orchestra.run.smithi150.stdout:done 2024-09-14T10:35:48.676 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2024-09-14T10:35:48.737 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 21 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.121.121 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:35:48.738 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2024-09-14T10:35:48.739 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2024-09-14T10:35:48.739 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:35:48.739 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2024-09-14T10:35:48.739 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:35:48.739 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:35:48.739 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:35:48.739 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T10:35:48.740 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:35:48.740 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2024-09-14T10:35:48.797 INFO:teuthology.orchestra.run.smithi148.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:35:48.798 INFO:teuthology.orchestra.run.smithi148.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:35:48.819 INFO:teuthology.orchestra.run.smithi148.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:35:48.844 INFO:teuthology.orchestra.run.smithi148.stdout:Generating grub configuration file ... 2024-09-14T10:35:48.888 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-14T10:35:49.004 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:35:49.004 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:35:49.014 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:35:49.031 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:35:49.125 INFO:teuthology.orchestra.run.smithi148.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:35:49.143 INFO:teuthology.orchestra.run.smithi148.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:35:49.443 INFO:teuthology.orchestra.run.smithi148.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:35:49.449 INFO:teuthology.orchestra.run.smithi148.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:35:49.519 INFO:teuthology.orchestra.run.smithi148.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:35:49.524 INFO:teuthology.orchestra.run.smithi148.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:35:49.728 INFO:teuthology.orchestra.run.smithi148.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:35:49.728 INFO:teuthology.orchestra.run.smithi148.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:35:49.728 INFO:teuthology.orchestra.run.smithi148.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:35:49.761 INFO:teuthology.orchestra.run.smithi148.stdout:done 2024-09-14T10:35:50.249 DEBUG:teuthology.orchestra.run.smithi148:> dpkg -s linux-image-generic 2024-09-14T10:35:50.275 INFO:teuthology.orchestra.run.smithi148.stdout:Package: linux-image-generic 2024-09-14T10:35:50.275 INFO:teuthology.orchestra.run.smithi148.stdout:Status: install ok installed 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Priority: optional 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Section: kernel 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Installed-Size: 21 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: amd64 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Source: linux-meta 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Version: 5.15.0.121.121 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Recommends: thermald 2024-09-14T10:35:50.276 INFO:teuthology.orchestra.run.smithi148.stdout:Description: Generic Linux kernel image 2024-09-14T10:35:50.277 INFO:teuthology.orchestra.run.smithi148.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:35:50.277 INFO:teuthology.orchestra.run.smithi148.stdout: available. 2024-09-14T10:35:50.277 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:35:50.277 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:35:50.277 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:35:50.277 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:35:50.277 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:35:50.277 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get clean 2024-09-14T10:35:50.433 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2024-09-14T10:35:50.467 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-14T10:35:50.485 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:35:50.548 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-14T10:35:50.675 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:35:50.675 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:35:50.748 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:35:50.766 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-14T10:35:50.767 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-14T10:35:50.829 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:35:50.958 INFO:teuthology.orchestra.run.smithi150.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:35:50.958 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:35:50.958 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:35:50.958 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:35:50.959 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:35:50.959 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:35:50.959 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:35:50.959 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:35:51.002 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:35:51.004 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 21 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.121.121 2024-09-14T10:35:51.020 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:35:51.021 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:35:51.021 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2024-09-14T10:35:51.021 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2024-09-14T10:35:51.021 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:35:51.021 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2024-09-14T10:35:51.021 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-14T10:35:51.065 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.3AWIbWt8rs 2024-09-14T10:35:51.065 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3AWIbWt8rs 2024-09-14T10:35:51.121 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.3AWIbWt8rs 2024-09-14T10:35:51.236 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.3AWIbWt8rs is 10KB 2024-09-14T10:35:51.252 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.3AWIbWt8rs 2024-09-14T10:35:51.258 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:35:51.313 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:35:51.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:35:51.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:35:51.382 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:35:51.382 DEBUG:teuthology.orchestra.run.smithi150:> sudo update-grub 2024-09-14T10:35:52.178 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-09-14T10:35:52.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:35:52.250 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-09-14T10:35:52.435 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-09-14T10:35:52.435 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-09-14T10:35:52.553 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:35:52.554 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:35:52.557 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-09-14T10:35:52.602 INFO:teuthology.orchestra.run.smithi148.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:35:52.602 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:35:52.602 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:35:52.602 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:35:52.602 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:35:52.603 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:35:52.603 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:35:52.603 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:35:52.640 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:35:52.642 DEBUG:teuthology.orchestra.run.smithi148:> dpkg -s linux-image-generic 2024-09-14T10:35:52.696 INFO:teuthology.orchestra.run.smithi148.stdout:Package: linux-image-generic 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Status: install ok installed 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Priority: optional 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Section: kernel 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Installed-Size: 21 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: amd64 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Source: linux-meta 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Version: 5.15.0.121.121 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Recommends: thermald 2024-09-14T10:35:52.697 INFO:teuthology.orchestra.run.smithi148.stdout:Description: Generic Linux kernel image 2024-09-14T10:35:52.698 INFO:teuthology.orchestra.run.smithi148.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:35:52.698 INFO:teuthology.orchestra.run.smithi148.stdout: available. 2024-09-14T10:35:52.698 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-14T10:35:52.738 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:35:52.741 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.qQICjYzyFg 2024-09-14T10:35:52.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub/grub.cfg /tmp/tmp.qQICjYzyFg 2024-09-14T10:35:52.744 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:35:52.798 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.qQICjYzyFg 2024-09-14T10:35:52.916 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.qQICjYzyFg is 10KB 2024-09-14T10:35:52.928 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.qQICjYzyFg 2024-09-14T10:35:52.933 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:35:52.977 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:35:52.983 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:35:52.990 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:35:52.990 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:35:52.990 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:35:53.024 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:35:53.030 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:35:53.056 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:35:53.056 DEBUG:teuthology.orchestra.run.smithi148:> sudo update-grub 2024-09-14T10:35:53.148 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:35:53.149 INFO:teuthology.orchestra.run.smithi150.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:35:53.149 INFO:teuthology.orchestra.run.smithi150.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:35:53.161 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-09-14T10:35:53.177 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-09-14T10:35:54.381 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:35:54.382 INFO:teuthology.orchestra.run.smithi148.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:35:54.385 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-14T10:35:54.621 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:35:54.628 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:35:54.863 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:35:54.868 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:35:54.909 INFO:teuthology.orchestra.run.smithi148.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:35:54.913 INFO:teuthology.orchestra.run.smithi148.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:35:55.030 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:35:55.030 INFO:teuthology.orchestra.run.smithi148.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:35:55.030 INFO:teuthology.orchestra.run.smithi148.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:35:55.055 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-14T10:35:55.056 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-14T10:36:23.202 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T10:36:23.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-14T10:36:23.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:36:25.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:36:25.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T10:36:25.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:36:57.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-14T10:36:59.585 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-14T10:37:06.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-14T10:37:06.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:08.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T10:37:08.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:11.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-14T10:37:23.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T10:37:23.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:26.717 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-14T10:37:41.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T10:37:41.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:42.666 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-14T10:37:43.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T10:37:43.479 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-14T10:37:43.479 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-14T10:37:43.483 INFO:teuthology.orchestra.run.smithi148.stdout:5.15.0-121-generic 2024-09-14T10:37:43.484 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T10:37:43.484 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:37:43.484 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T10:37:44.485 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:37:44.486 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:37:44.773 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-09-14T10:37:44.803 DEBUG:teuthology.parallel:result is None 2024-09-14T10:38:06.801 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:38:18.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-14T10:38:18.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:38:19.190 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-14T10:38:19.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-14T10:38:19.742 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-14T10:38:19.742 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-14T10:38:19.788 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-121-generic 2024-09-14T10:38:19.789 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T10:38:19.789 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:38:19.789 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T10:38:20.789 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T10:38:20.790 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:38:20.896 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2024-09-14T10:38:20.921 DEBUG:teuthology.parallel:result is None 2024-09-14T10:38:20.922 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:38:20.929 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:38:20.929 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:38:20.932 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:38:20.938 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:38:20.944 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:38:20.950 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:38:20.950 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:38:20.982 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:38:21.003 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:38:21.008 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:38:21.009 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:38:21.038 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:38:21.059 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:38:21.059 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:38:21.068 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:38:21.069 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:38:21.071 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:38:21.077 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:38:21.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:38:21.118 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:38:21.131 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:38:21.140 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:38:21.140 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:38:21.174 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:38:21.180 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:38:21.225 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:38:21.273 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:38:21.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:38:21.332 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:38:21.338 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:38:21.384 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:38:21.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:38:21.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-14T10:38:21.449 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-09-14T10:38:21.516 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:38:21.524 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:38:21.524 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:38:21.534 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:38:21.547 DEBUG:teuthology.task.selinux:Excluding smithi148: OS 'ubuntu' does not support SELinux 2024-09-14T10:38:21.547 DEBUG:teuthology.task.selinux:Excluding smithi150: OS 'ubuntu' does not support SELinux 2024-09-14T10:38:21.547 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:38:21.547 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-14T10:38:21.548 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:38:21.548 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:38:21.665 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:38:21.677 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:38:21.678 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi148.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T10:45:49.336 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2024-09-14T10:45:49.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T10:45:49.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:45:49.430 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-14T10:45:49.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-14T10:45:49.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-14T10:45:49.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:45:49.589 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-14T10:45:49.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-14T10:45:49.665 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T10:45:49.676 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T10:45:49.676 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:45:49.677 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:45:49.679 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:45:49.679 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:45:49.703 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T10:45:49.704 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Command line: ntpd -gq 2024-09-14T10:45:49.704 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: ---------------------------------------------------- 2024-09-14T10:45:49.704 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T10:45:49.704 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T10:45:49.704 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: corporation. Support and training for ntp-4 are 2024-09-14T10:45:49.704 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: available at https://www.nwtime.org/support 2024-09-14T10:45:49.704 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: ---------------------------------------------------- 2024-09-14T10:45:49.705 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: proto: precision = 0.061 usec (-24) 2024-09-14T10:45:49.705 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: basedate set to 2022-02-04 2024-09-14T10:45:49.705 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: gps base set to 2022-02-06 (week 2196) 2024-09-14T10:45:49.706 INFO:teuthology.orchestra.run.smithi148.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T10:45:49.706 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T10:45:49.706 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T10:45:49.706 INFO:teuthology.orchestra.run.smithi148.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T10:45:49.707 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T10:45:49.707 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T10:45:49.707 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T10:45:49.708 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Listen normally on 3 enp3s0f1 172.21.15.148:123 2024-09-14T10:45:49.708 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Listen normally on 4 lo [::1]:123 2024-09-14T10:45:49.708 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7257%5]:123 2024-09-14T10:45:49.708 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:49 ntpd[18461]: Listening on routing socket on fd #22 for interface updates 2024-09-14T10:45:49.738 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T10:45:49.738 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Command line: ntpd -gq 2024-09-14T10:45:49.738 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: ---------------------------------------------------- 2024-09-14T10:45:49.739 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T10:45:49.739 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T10:45:49.739 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: corporation. Support and training for ntp-4 are 2024-09-14T10:45:49.739 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: available at https://www.nwtime.org/support 2024-09-14T10:45:49.739 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: ---------------------------------------------------- 2024-09-14T10:45:49.739 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: proto: precision = 0.059 usec (-24) 2024-09-14T10:45:49.740 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: basedate set to 2022-02-04 2024-09-14T10:45:49.740 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: gps base set to 2022-02-06 (week 2196) 2024-09-14T10:45:49.741 INFO:teuthology.orchestra.run.smithi150.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T10:45:49.742 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T10:45:49.742 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T10:45:49.742 INFO:teuthology.orchestra.run.smithi150.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T10:45:49.743 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T10:45:49.743 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T10:45:49.743 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T10:45:49.743 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Listen normally on 3 enp3s0f1 172.21.15.150:123 2024-09-14T10:45:49.743 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Listen normally on 4 lo [::1]:123 2024-09-14T10:45:49.743 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e35%5]:123 2024-09-14T10:45:49.743 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:49 ntpd[18500]: Listening on routing socket on fd #22 for interface updates 2024-09-14T10:45:50.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:50.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:50 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:50.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:50 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:50 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:50 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:50.738 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:50 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:50.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:50 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:50.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:50 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:50.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:50 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:50.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:50 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:50.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:50 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:51 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:51.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:51 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:51.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:51 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:51.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:51 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:51.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:51 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:51.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:51 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:51.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:51 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:52.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:52.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:52 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:52.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:52.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:52 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:52.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:52.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:52 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:52.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:52 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:52.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:52 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:52.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:52 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:52.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:52 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:52.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:52 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:52.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:52 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:52.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:52 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:52.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:52 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:53.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:53.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:53.708 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:53.709 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:53 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:53.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:53 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:53.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:53 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:53.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:53 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:53.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:53 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:53.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:53 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:53.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:53 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:54.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:54 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:54.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:54 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:54.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:54 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:54.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:54 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:54.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:54 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:54.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:54 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:54.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:54.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:54.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:54.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:54 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:55.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:55.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:55 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:55.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:55 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:55.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:55 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:55.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:55 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:55.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:55 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:55.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:55 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:55.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:55 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:56.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:56 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:56.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:56 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:56.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:56 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:56.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:56 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:56.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:56 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:56.704 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:56 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:56.705 INFO:teuthology.orchestra.run.smithi148.stdout:14 Sep 10:45:56 ntpd[18461]: ntpd: time slew +0.001743 s 2024-09-14T10:45:56.705 INFO:teuthology.orchestra.run.smithi148.stdout:ntpd: time slew +0.001743s 2024-09-14T10:45:56.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:56 ntpd[18461]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T10:45:56.705 INFO:teuthology.orchestra.run.smithi148.stderr:14 Sep 10:45:56 ntpd[18461]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T10:45:56.739 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T10:45:56.740 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T10:45:56.741 INFO:teuthology.orchestra.run.smithi150.stdout:14 Sep 10:45:56 ntpd[18500]: ntpd: time slew -0.008374 s 2024-09-14T10:45:56.741 INFO:teuthology.orchestra.run.smithi150.stdout:ntpd: time slew -0.008374s 2024-09-14T10:45:56.741 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T10:45:56.741 INFO:teuthology.orchestra.run.smithi150.stderr:14 Sep 10:45:56 ntpd[18500]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T10:45:56.749 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T10:45:56.749 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2024-09-14T10:45:56.749 INFO:teuthology.orchestra.run.smithi148.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:45:56.749 INFO:teuthology.orchestra.run.smithi148.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:45:56.750 INFO:teuthology.orchestra.run.smithi148.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:45:56.750 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:45:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T10:45:56.788 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2024-09-14T10:45:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:45:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:45:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:45:56.788 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T10:45:56.789 INFO:teuthology.run_tasks:Running task install... 2024-09-14T10:45:56.797 DEBUG:teuthology.task.install:project ceph 2024-09-14T10:45:56.797 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T10:45:56.797 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T10:45:56.798 INFO:teuthology.task.install:Using flavor: default 2024-09-14T10:45:56.803 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T10:45:56.803 INFO:teuthology.task.install:extra packages: [] 2024-09-14T10:45:56.803 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-key list | grep Ceph 2024-09-14T10:45:56.804 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-key list | grep Ceph 2024-09-14T10:45:56.860 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T10:45:56.888 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T10:45:56.888 INFO:teuthology.orchestra.run.smithi148.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T10:45:56.888 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T10:45:56.889 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-14T10:45:56.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:45:56.894 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T10:45:56.924 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T10:45:56.925 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T10:45:56.925 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T10:45:56.925 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-14T10:45:56.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:45:57.062 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T10:45:57.062 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:45:57.063 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T10:45:57.064 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:45:57.174 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:45:57.174 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T10:45:57.179 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:45:57.179 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T10:45:57.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-14T10:45:57.193 DEBUG:teuthology.orchestra.run.smithi148:> sudo apt-get update 2024-09-14T10:45:57.359 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:45:57.361 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:45:57.361 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:45:57.369 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:45:57.386 INFO:teuthology.orchestra.run.smithi148.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:45:57.411 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T10:45:57.413 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T10:45:57.432 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T10:45:57.434 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T10:45:57.454 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T10:45:57.455 INFO:teuthology.orchestra.run.smithi148.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T10:45:57.475 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T10:45:57.476 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T10:45:57.481 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:45:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T10:45:57.505 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T10:45:57.561 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:45:57.643 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:45:57.705 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 29.3 kB in 0s (88.0 kB/s) 2024-09-14T10:45:57.780 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 29.3 kB in 0s (71.7 kB/s) 2024-09-14T10:45:58.691 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-09-14T10:45:58.708 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T10:45:58.760 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-09-14T10:45:58.828 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-14T10:45:58.843 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T10:45:58.896 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-14T10:45:58.947 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-09-14T10:45:58.948 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-09-14T10:45:59.081 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-14T10:45:59.082 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-14T10:45:59.134 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:45:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:45:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:45:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:45:59.134 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:45:59.135 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:45:59.135 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:45:59.136 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-09-14T10:45:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T10:45:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T10:45:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T10:45:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T10:45:59.136 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T10:45:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T10:45:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T10:45:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T10:45:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T10:45:59.137 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T10:45:59.138 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet zip 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T10:45:59.139 INFO:teuthology.orchestra.run.smithi148.stdout:Recommended packages: 2024-09-14T10:45:59.140 INFO:teuthology.orchestra.run.smithi148.stdout: btrfs-tools 2024-09-14T10:45:59.243 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-09-14T10:45:59.243 INFO:teuthology.orchestra.run.smithi148.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T10:45:59.243 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T10:45:59.243 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T10:45:59.243 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T10:45:59.243 INFO:teuthology.orchestra.run.smithi148.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T10:45:59.243 INFO:teuthology.orchestra.run.smithi148.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T10:45:59.244 INFO:teuthology.orchestra.run.smithi148.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T10:45:59.245 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T10:45:59.246 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T10:45:59.246 INFO:teuthology.orchestra.run.smithi148.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T10:45:59.246 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T10:45:59.246 INFO:teuthology.orchestra.run.smithi148.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T10:45:59.246 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T10:45:59.246 INFO:teuthology.orchestra.run.smithi148.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T10:45:59.265 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:45:59.265 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:45:59.265 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:45:59.265 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:45:59.266 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:45:59.266 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:45:59.266 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T10:45:59.268 INFO:teuthology.orchestra.run.smithi150.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T10:45:59.269 INFO:teuthology.orchestra.run.smithi150.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T10:45:59.270 INFO:teuthology.orchestra.run.smithi150.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T10:45:59.270 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T10:45:59.270 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T10:45:59.270 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet zip 2024-09-14T10:45:59.270 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-14T10:45:59.270 INFO:teuthology.orchestra.run.smithi150.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T10:45:59.270 INFO:teuthology.orchestra.run.smithi150.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T10:45:59.271 INFO:teuthology.orchestra.run.smithi150.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T10:45:59.271 INFO:teuthology.orchestra.run.smithi150.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T10:45:59.271 INFO:teuthology.orchestra.run.smithi150.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T10:45:59.271 INFO:teuthology.orchestra.run.smithi150.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T10:45:59.271 INFO:teuthology.orchestra.run.smithi150.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T10:45:59.271 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2024-09-14T10:45:59.271 INFO:teuthology.orchestra.run.smithi150.stdout: btrfs-tools 2024-09-14T10:45:59.374 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-14T10:45:59.374 INFO:teuthology.orchestra.run.smithi150.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T10:45:59.374 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T10:45:59.374 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T10:45:59.374 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T10:45:59.374 INFO:teuthology.orchestra.run.smithi150.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T10:45:59.374 INFO:teuthology.orchestra.run.smithi150.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T10:45:59.375 INFO:teuthology.orchestra.run.smithi150.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T10:45:59.376 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T10:45:59.377 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T10:45:59.377 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T10:45:59.377 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T10:45:59.377 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T10:45:59.377 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T10:45:59.377 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T10:45:59.377 INFO:teuthology.orchestra.run.smithi150.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T10:45:59.385 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T10:45:59.385 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 251 MB of archives. 2024-09-14T10:45:59.385 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T10:45:59.386 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T10:45:59.432 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T10:45:59.519 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T10:45:59.519 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 251 MB of archives. 2024-09-14T10:45:59.519 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T10:45:59.519 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T10:45:59.566 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T10:45:59.572 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T10:45:59.629 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T10:45:59.641 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T10:45:59.654 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T10:45:59.654 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T10:45:59.657 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T10:45:59.659 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T10:45:59.664 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T10:45:59.835 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T10:45:59.837 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T10:45:59.844 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T10:45:59.852 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T10:45:59.855 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T10:45:59.865 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T10:45:59.946 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T10:45:59.985 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T10:45:59.998 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T10:46:00.057 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T10:46:00.079 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T10:46:00.108 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T10:46:00.153 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T10:46:00.153 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T10:46:00.159 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T10:46:00.161 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T10:46:00.168 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T10:46:00.174 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T10:46:00.185 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T10:46:00.215 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T10:46:00.224 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T10:46:00.226 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T10:46:00.227 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T10:46:00.228 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T10:46:00.245 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T10:46:00.250 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T10:46:00.256 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T10:46:00.307 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T10:46:00.319 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T10:46:00.336 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T10:46:00.337 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T10:46:00.341 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T10:46:00.345 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T10:46:00.348 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T10:46:00.349 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T10:46:00.350 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T10:46:00.351 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T10:46:00.353 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T10:46:00.353 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T10:46:00.357 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T10:46:00.359 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T10:46:00.360 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T10:46:00.362 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T10:46:00.381 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T10:46:00.385 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T10:46:00.389 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T10:46:00.420 INFO:teuthology.orchestra.run.smithi148.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T10:46:00.436 INFO:teuthology.orchestra.run.smithi148.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T10:46:00.436 INFO:teuthology.orchestra.run.smithi148.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T10:46:00.437 INFO:teuthology.orchestra.run.smithi148.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T10:46:00.438 INFO:teuthology.orchestra.run.smithi148.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T10:46:00.443 INFO:teuthology.orchestra.run.smithi148.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T10:46:00.444 INFO:teuthology.orchestra.run.smithi148.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T10:46:00.471 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T10:46:00.472 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T10:46:00.476 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T10:46:00.480 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T10:46:00.483 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T10:46:00.484 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T10:46:00.485 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T10:46:00.487 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T10:46:00.525 INFO:teuthology.orchestra.run.smithi148.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T10:46:00.526 INFO:teuthology.orchestra.run.smithi148.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T10:46:00.552 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T10:46:00.553 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T10:46:00.580 INFO:teuthology.orchestra.run.smithi148.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T10:46:00.580 INFO:teuthology.orchestra.run.smithi148.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T10:46:00.583 INFO:teuthology.orchestra.run.smithi148.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T10:46:00.584 INFO:teuthology.orchestra.run.smithi148.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T10:46:00.586 INFO:teuthology.orchestra.run.smithi148.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T10:46:00.588 INFO:teuthology.orchestra.run.smithi148.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T10:46:00.589 INFO:teuthology.orchestra.run.smithi148.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T10:46:00.590 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T10:46:00.593 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T10:46:00.600 INFO:teuthology.orchestra.run.smithi148.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T10:46:00.602 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T10:46:00.634 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T10:46:00.635 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T10:46:00.635 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T10:46:00.636 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T10:46:00.641 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T10:46:00.642 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T10:46:00.643 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T10:46:00.643 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T10:46:00.653 INFO:teuthology.orchestra.run.smithi148.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T10:46:00.656 INFO:teuthology.orchestra.run.smithi148.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T10:46:00.657 INFO:teuthology.orchestra.run.smithi148.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T10:46:00.665 INFO:teuthology.orchestra.run.smithi148.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T10:46:00.666 INFO:teuthology.orchestra.run.smithi148.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T10:46:00.667 INFO:teuthology.orchestra.run.smithi148.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T10:46:00.670 INFO:teuthology.orchestra.run.smithi148.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T10:46:00.701 INFO:teuthology.orchestra.run.smithi148.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T10:46:00.716 INFO:teuthology.orchestra.run.smithi150.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T10:46:00.716 INFO:teuthology.orchestra.run.smithi150.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T10:46:00.746 INFO:teuthology.orchestra.run.smithi148.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T10:46:00.748 INFO:teuthology.orchestra.run.smithi148.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T10:46:00.750 INFO:teuthology.orchestra.run.smithi148.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T10:46:00.752 INFO:teuthology.orchestra.run.smithi148.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T10:46:00.757 INFO:teuthology.orchestra.run.smithi148.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T10:46:00.758 INFO:teuthology.orchestra.run.smithi148.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T10:46:00.797 INFO:teuthology.orchestra.run.smithi150.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T10:46:00.799 INFO:teuthology.orchestra.run.smithi150.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T10:46:00.800 INFO:teuthology.orchestra.run.smithi150.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T10:46:00.801 INFO:teuthology.orchestra.run.smithi150.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T10:46:00.812 INFO:teuthology.orchestra.run.smithi150.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T10:46:00.812 INFO:teuthology.orchestra.run.smithi150.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T10:46:00.813 INFO:teuthology.orchestra.run.smithi150.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T10:46:00.814 INFO:teuthology.orchestra.run.smithi150.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T10:46:00.827 INFO:teuthology.orchestra.run.smithi148.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T10:46:00.832 INFO:teuthology.orchestra.run.smithi148.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T10:46:00.856 INFO:teuthology.orchestra.run.smithi148.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T10:46:00.878 INFO:teuthology.orchestra.run.smithi150.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T10:46:00.882 INFO:teuthology.orchestra.run.smithi150.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T10:46:00.899 INFO:teuthology.orchestra.run.smithi150.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T10:46:00.901 INFO:teuthology.orchestra.run.smithi150.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T10:46:00.903 INFO:teuthology.orchestra.run.smithi150.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T10:46:00.907 INFO:teuthology.orchestra.run.smithi150.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T10:46:00.908 INFO:teuthology.orchestra.run.smithi150.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T10:46:00.960 INFO:teuthology.orchestra.run.smithi150.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T10:46:00.964 INFO:teuthology.orchestra.run.smithi150.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T10:46:00.997 INFO:teuthology.orchestra.run.smithi148.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T10:46:00.999 INFO:teuthology.orchestra.run.smithi148.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T10:46:01.002 INFO:teuthology.orchestra.run.smithi148.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T10:46:01.003 INFO:teuthology.orchestra.run.smithi148.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T10:46:01.005 INFO:teuthology.orchestra.run.smithi148.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T10:46:01.042 INFO:teuthology.orchestra.run.smithi148.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T10:46:01.045 INFO:teuthology.orchestra.run.smithi148.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T10:46:01.045 INFO:teuthology.orchestra.run.smithi148.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T10:46:01.102 INFO:teuthology.orchestra.run.smithi148.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T10:46:01.103 INFO:teuthology.orchestra.run.smithi148.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T10:46:01.127 INFO:teuthology.orchestra.run.smithi150.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T10:46:01.129 INFO:teuthology.orchestra.run.smithi150.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T10:46:01.132 INFO:teuthology.orchestra.run.smithi150.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T10:46:01.132 INFO:teuthology.orchestra.run.smithi150.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T10:46:01.134 INFO:teuthology.orchestra.run.smithi150.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T10:46:01.164 INFO:teuthology.orchestra.run.smithi148.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T10:46:01.165 INFO:teuthology.orchestra.run.smithi148.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T10:46:01.166 INFO:teuthology.orchestra.run.smithi148.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T10:46:01.167 INFO:teuthology.orchestra.run.smithi148.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T10:46:01.167 INFO:teuthology.orchestra.run.smithi148.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T10:46:01.168 INFO:teuthology.orchestra.run.smithi148.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T10:46:01.171 INFO:teuthology.orchestra.run.smithi150.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T10:46:01.174 INFO:teuthology.orchestra.run.smithi150.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T10:46:01.174 INFO:teuthology.orchestra.run.smithi150.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T10:46:01.175 INFO:teuthology.orchestra.run.smithi148.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T10:46:01.233 INFO:teuthology.orchestra.run.smithi150.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T10:46:01.233 INFO:teuthology.orchestra.run.smithi150.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T10:46:01.245 INFO:teuthology.orchestra.run.smithi148.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T10:46:01.249 INFO:teuthology.orchestra.run.smithi148.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T10:46:01.250 INFO:teuthology.orchestra.run.smithi148.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T10:46:01.293 INFO:teuthology.orchestra.run.smithi150.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T10:46:01.294 INFO:teuthology.orchestra.run.smithi150.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T10:46:01.295 INFO:teuthology.orchestra.run.smithi150.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T10:46:01.296 INFO:teuthology.orchestra.run.smithi150.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T10:46:01.297 INFO:teuthology.orchestra.run.smithi150.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T10:46:01.298 INFO:teuthology.orchestra.run.smithi150.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T10:46:01.305 INFO:teuthology.orchestra.run.smithi150.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T10:46:01.327 INFO:teuthology.orchestra.run.smithi148.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T10:46:01.333 INFO:teuthology.orchestra.run.smithi148.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T10:46:01.335 INFO:teuthology.orchestra.run.smithi148.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T10:46:01.337 INFO:teuthology.orchestra.run.smithi148.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T10:46:01.348 INFO:teuthology.orchestra.run.smithi148.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T10:46:01.349 INFO:teuthology.orchestra.run.smithi148.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T10:46:01.356 INFO:teuthology.orchestra.run.smithi148.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T10:46:01.374 INFO:teuthology.orchestra.run.smithi150.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T10:46:01.378 INFO:teuthology.orchestra.run.smithi150.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T10:46:01.379 INFO:teuthology.orchestra.run.smithi150.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T10:46:01.408 INFO:teuthology.orchestra.run.smithi148.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T10:46:01.410 INFO:teuthology.orchestra.run.smithi148.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T10:46:01.410 INFO:teuthology.orchestra.run.smithi148.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T10:46:01.456 INFO:teuthology.orchestra.run.smithi150.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T10:46:01.462 INFO:teuthology.orchestra.run.smithi150.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T10:46:01.464 INFO:teuthology.orchestra.run.smithi150.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T10:46:01.466 INFO:teuthology.orchestra.run.smithi150.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T10:46:01.477 INFO:teuthology.orchestra.run.smithi150.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T10:46:01.478 INFO:teuthology.orchestra.run.smithi150.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T10:46:01.486 INFO:teuthology.orchestra.run.smithi150.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T10:46:01.490 INFO:teuthology.orchestra.run.smithi148.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T10:46:01.491 INFO:teuthology.orchestra.run.smithi148.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T10:46:01.509 INFO:teuthology.orchestra.run.smithi148.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T10:46:01.509 INFO:teuthology.orchestra.run.smithi148.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T10:46:01.510 INFO:teuthology.orchestra.run.smithi148.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T10:46:01.537 INFO:teuthology.orchestra.run.smithi150.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T10:46:01.539 INFO:teuthology.orchestra.run.smithi150.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T10:46:01.539 INFO:teuthology.orchestra.run.smithi150.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T10:46:01.576 INFO:teuthology.orchestra.run.smithi148.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T10:46:01.578 INFO:teuthology.orchestra.run.smithi148.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T10:46:01.578 INFO:teuthology.orchestra.run.smithi148.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T10:46:01.579 INFO:teuthology.orchestra.run.smithi148.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T10:46:01.596 INFO:teuthology.orchestra.run.smithi148.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T10:46:01.619 INFO:teuthology.orchestra.run.smithi150.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T10:46:01.621 INFO:teuthology.orchestra.run.smithi150.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T10:46:01.637 INFO:teuthology.orchestra.run.smithi148.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T10:46:01.637 INFO:teuthology.orchestra.run.smithi150.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T10:46:01.638 INFO:teuthology.orchestra.run.smithi150.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T10:46:01.639 INFO:teuthology.orchestra.run.smithi150.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T10:46:01.644 INFO:teuthology.orchestra.run.smithi150.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T10:46:01.646 INFO:teuthology.orchestra.run.smithi150.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T10:46:01.646 INFO:teuthology.orchestra.run.smithi148.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T10:46:01.648 INFO:teuthology.orchestra.run.smithi148.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T10:46:01.845 INFO:teuthology.orchestra.run.smithi150.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T10:46:01.942 INFO:teuthology.orchestra.run.smithi150.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T10:46:01.946 INFO:teuthology.orchestra.run.smithi150.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T10:46:01.948 INFO:teuthology.orchestra.run.smithi150.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T10:46:02.006 INFO:teuthology.orchestra.run.smithi150.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T10:46:02.258 INFO:teuthology.orchestra.run.smithi150.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T10:46:03.286 INFO:teuthology.orchestra.run.smithi150.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T10:46:03.287 INFO:teuthology.orchestra.run.smithi150.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T10:46:03.304 INFO:teuthology.orchestra.run.smithi150.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T10:46:03.346 INFO:teuthology.orchestra.run.smithi150.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T10:46:03.357 INFO:teuthology.orchestra.run.smithi150.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T10:46:03.360 INFO:teuthology.orchestra.run.smithi150.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T10:46:03.582 INFO:teuthology.orchestra.run.smithi148.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T10:46:03.757 INFO:teuthology.orchestra.run.smithi148.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T10:46:03.757 INFO:teuthology.orchestra.run.smithi148.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T10:46:05.536 INFO:teuthology.orchestra.run.smithi148.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T10:46:05.538 INFO:teuthology.orchestra.run.smithi148.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T10:46:05.539 INFO:teuthology.orchestra.run.smithi148.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T10:46:05.732 INFO:teuthology.orchestra.run.smithi150.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T10:46:05.847 INFO:teuthology.orchestra.run.smithi150.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T10:46:05.847 INFO:teuthology.orchestra.run.smithi150.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T10:46:05.854 INFO:teuthology.orchestra.run.smithi148.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T10:46:06.425 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 251 MB in 7s (38.0 MB/s) 2024-09-14T10:46:06.586 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T10:46:06.686 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T10:46:06.692 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T10:46:06.776 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T10:46:07.020 INFO:teuthology.orchestra.run.smithi150.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T10:46:07.023 INFO:teuthology.orchestra.run.smithi150.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T10:46:07.024 INFO:teuthology.orchestra.run.smithi150.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T10:46:07.138 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T10:46:07.164 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T10:46:07.196 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T10:46:07.328 INFO:teuthology.orchestra.run.smithi150.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T10:46:07.516 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T10:46:07.542 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T10:46:07.582 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T10:46:07.903 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 251 MB in 8s (31.6 MB/s) 2024-09-14T10:46:07.944 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T10:46:07.970 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:46:08.019 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:46:08.051 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T10:46:08.149 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T10:46:08.154 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T10:46:08.241 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T10:46:08.430 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T10:46:08.457 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:46:08.497 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:46:08.554 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T10:46:08.580 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T10:46:08.620 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T10:46:08.825 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T10:46:08.851 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:46:08.891 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:46:08.948 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T10:46:08.975 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T10:46:09.014 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T10:46:09.178 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T10:46:09.204 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T10:46:09.236 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T10:46:09.443 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T10:46:09.470 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:46:09.517 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:46:09.539 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librados2. 2024-09-14T10:46:09.565 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:09.606 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:09.879 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T10:46:09.906 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:46:09.946 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:46:10.083 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libnbd0. 2024-09-14T10:46:10.110 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T10:46:10.150 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T10:46:10.257 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T10:46:10.284 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T10:46:10.349 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:46:10.419 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librbd1. 2024-09-14T10:46:10.445 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:10.486 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:10.676 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T10:46:10.703 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T10:46:10.743 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T10:46:10.872 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T10:46:10.898 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:10.939 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:11.021 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librados2. 2024-09-14T10:46:11.048 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:11.079 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:11.199 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rados. 2024-09-14T10:46:11.226 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:11.266 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:11.557 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libnbd0. 2024-09-14T10:46:11.568 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T10:46:11.584 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T10:46:11.595 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:11.624 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T10:46:11.635 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:11.912 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T10:46:11.926 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librbd1. 2024-09-14T10:46:11.927 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:11.953 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:11.971 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:11.993 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:12.282 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T10:46:12.308 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:12.349 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:12.621 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T10:46:12.648 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:12.676 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T10:46:12.679 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:12.704 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T10:46:12.743 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T10:46:12.932 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rados. 2024-09-14T10:46:12.958 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:12.998 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:13.287 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T10:46:13.314 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T10:46:13.334 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T10:46:13.345 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T10:46:13.361 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:13.400 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:13.607 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T10:46:13.633 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:13.653 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T10:46:13.669 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:13.673 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:13.712 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:14.014 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T10:46:14.018 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T10:46:14.030 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:14.044 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T10:46:14.064 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:14.084 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T10:46:14.345 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T10:46:14.359 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T10:46:14.362 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T10:46:14.385 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T10:46:14.403 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T10:46:14.417 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T10:46:14.706 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T10:46:14.728 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T10:46:14.732 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T10:46:14.755 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T10:46:14.764 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T10:46:14.795 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T10:46:15.056 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T10:46:15.067 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua5.1. 2024-09-14T10:46:15.082 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:15.094 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T10:46:15.122 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T10:46:15.437 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-any. 2024-09-14T10:46:15.463 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T10:46:15.466 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T10:46:15.493 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T10:46:15.503 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T10:46:15.533 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T10:46:15.765 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package zip. 2024-09-14T10:46:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T10:46:15.794 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T10:46:15.810 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T10:46:15.823 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T10:46:15.844 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T10:46:16.093 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package unzip. 2024-09-14T10:46:16.119 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T10:46:16.155 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T10:46:16.159 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T10:46:16.171 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T10:46:16.216 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T10:46:16.546 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package luarocks. 2024-09-14T10:46:16.550 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua5.1. 2024-09-14T10:46:16.572 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T10:46:16.577 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T10:46:16.612 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T10:46:16.616 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T10:46:16.903 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-any. 2024-09-14T10:46:16.930 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T10:46:16.961 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T10:46:16.995 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package librgw2. 2024-09-14T10:46:17.022 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:17.062 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:17.197 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package zip. 2024-09-14T10:46:17.213 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T10:46:17.255 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T10:46:17.600 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package unzip. 2024-09-14T10:46:17.622 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T10:46:17.626 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T10:46:17.637 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:17.667 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T10:46:17.672 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:18.000 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T10:46:18.027 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T10:46:18.037 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package luarocks. 2024-09-14T10:46:18.064 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T10:46:18.067 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T10:46:18.104 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T10:46:18.378 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T10:46:18.405 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:18.428 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librgw2. 2024-09-14T10:46:18.443 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:18.445 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:18.486 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:18.824 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-common. 2024-09-14T10:46:18.850 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:18.881 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:19.089 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T10:46:19.104 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:19.147 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:19.475 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T10:46:19.502 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T10:46:19.542 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T10:46:19.811 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T10:46:19.826 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:19.861 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:20.270 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-base. 2024-09-14T10:46:20.273 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-common. 2024-09-14T10:46:20.297 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:20.300 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:20.339 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:20.346 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:20.899 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T10:46:20.926 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T10:46:20.965 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T10:46:21.268 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T10:46:21.295 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T10:46:21.335 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T10:46:21.629 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T10:46:21.645 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T10:46:21.679 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T10:46:21.736 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-base. 2024-09-14T10:46:21.762 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:21.803 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:21.949 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T10:46:21.976 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T10:46:22.016 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T10:46:22.318 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T10:46:22.345 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T10:46:22.348 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T10:46:22.375 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T10:46:22.385 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T10:46:22.415 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T10:46:22.687 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T10:46:22.714 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T10:46:22.754 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T10:46:22.909 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T10:46:22.936 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T10:46:22.976 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T10:46:23.024 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-portend. 2024-09-14T10:46:23.050 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T10:46:23.082 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T10:46:23.296 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T10:46:23.322 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T10:46:23.362 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T10:46:23.410 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T10:46:23.437 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T10:46:23.476 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T10:46:23.640 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T10:46:23.655 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T10:46:23.690 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T10:46:23.779 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T10:46:23.809 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T10:46:23.846 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T10:46:23.951 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T10:46:23.977 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T10:46:24.018 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T10:46:24.158 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T10:46:24.173 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T10:46:24.207 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T10:46:24.321 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T10:46:24.347 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T10:46:24.387 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T10:46:24.477 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T10:46:24.504 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T10:46:24.544 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T10:46:24.715 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-portend. 2024-09-14T10:46:24.741 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T10:46:24.782 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T10:46:24.846 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T10:46:24.862 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T10:46:24.905 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T10:46:25.043 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T10:46:25.069 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T10:46:25.101 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T10:46:25.216 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-mako. 2024-09-14T10:46:25.244 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T10:46:25.282 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T10:46:25.412 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T10:46:25.439 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T10:46:25.479 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T10:46:25.586 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T10:46:25.612 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T10:46:25.652 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T10:46:25.841 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T10:46:25.868 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T10:46:25.880 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T10:46:25.906 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T10:46:25.907 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T10:46:25.946 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T10:46:26.219 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T10:46:26.245 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T10:46:26.249 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webob. 2024-09-14T10:46:26.276 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T10:46:26.285 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T10:46:26.316 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T10:46:26.538 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T10:46:26.565 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T10:46:26.596 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T10:46:26.660 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T10:46:26.687 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T10:46:26.730 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T10:46:26.866 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-mako. 2024-09-14T10:46:26.892 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T10:46:26.932 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T10:46:27.038 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T10:46:27.065 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T10:46:27.105 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T10:46:27.244 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T10:46:27.270 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T10:46:27.310 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T10:46:27.366 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-paste. 2024-09-14T10:46:27.381 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T10:46:27.424 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T10:46:27.630 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T10:46:27.656 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T10:46:27.697 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T10:46:27.752 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T10:46:27.768 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T10:46:27.810 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T10:46:28.016 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webob. 2024-09-14T10:46:28.042 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T10:46:28.080 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T10:46:28.082 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T10:46:28.107 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T10:46:28.138 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T10:46:28.416 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T10:46:28.419 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T10:46:28.443 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T10:46:28.445 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T10:46:28.489 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T10:46:28.641 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T10:46:28.797 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T10:46:28.823 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T10:46:28.855 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T10:46:28.935 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T10:46:28.962 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T10:46:29.002 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T10:46:29.125 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-paste. 2024-09-14T10:46:29.151 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T10:46:29.191 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T10:46:29.357 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T10:46:29.383 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T10:46:29.423 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T10:46:29.536 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T10:46:29.551 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T10:46:29.594 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T10:46:29.743 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-idna. 2024-09-14T10:46:29.770 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T10:46:29.809 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T10:46:29.872 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T10:46:29.898 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T10:46:29.930 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T10:46:30.087 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T10:46:30.103 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T10:46:30.137 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T10:46:30.200 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T10:46:30.226 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T10:46:30.266 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T10:46:30.432 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests. 2024-09-14T10:46:30.458 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T10:46:30.490 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T10:46:30.577 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T10:46:30.604 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T10:46:30.644 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T10:46:30.801 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T10:46:30.829 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T10:46:30.868 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T10:46:31.024 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T10:46:31.051 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T10:46:31.090 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T10:46:31.179 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T10:46:31.195 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:31.229 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:31.418 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-idna. 2024-09-14T10:46:31.445 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T10:46:31.485 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T10:46:31.609 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T10:46:31.636 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:31.675 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:31.771 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T10:46:31.798 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T10:46:31.846 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T10:46:31.945 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T10:46:31.972 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T10:46:32.004 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T10:46:32.141 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests. 2024-09-14T10:46:32.167 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T10:46:32.199 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T10:46:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T10:46:32.294 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T10:46:32.339 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T10:46:32.469 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T10:46:32.495 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T10:46:32.535 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T10:46:33.501 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T10:46:33.528 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:33.567 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:33.913 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T10:46:33.929 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:33.962 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T10:46:33.963 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:33.989 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:34.028 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:34.318 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T10:46:34.345 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:34.385 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:34.568 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T10:46:34.595 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:34.634 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:34.646 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T10:46:34.672 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T10:46:34.712 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T10:46:34.982 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T10:46:35.008 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T10:46:35.048 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T10:46:35.410 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T10:46:35.436 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:35.476 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:35.662 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph. 2024-09-14T10:46:35.678 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:35.720 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:35.871 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T10:46:35.897 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:35.937 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:36.014 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T10:46:36.041 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:36.072 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:36.426 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T10:46:36.453 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:36.491 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T10:46:36.492 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:36.518 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:36.557 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:36.895 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package cephadm. 2024-09-14T10:46:36.922 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:36.961 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:37.273 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T10:46:37.299 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T10:46:37.339 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T10:46:37.619 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph. 2024-09-14T10:46:37.645 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:37.658 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T10:46:37.677 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:37.686 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T10:46:37.725 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T10:46:37.955 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T10:46:37.981 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:38.021 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:38.408 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T10:46:38.434 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:38.499 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:38.747 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-babel. 2024-09-14T10:46:38.774 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T10:46:38.813 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T10:46:38.911 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephadm. 2024-09-14T10:46:38.937 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:38.994 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:39.116 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T10:46:39.143 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T10:46:39.182 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T10:46:39.305 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T10:46:39.331 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T10:46:39.371 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T10:46:39.511 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T10:46:39.537 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:39.577 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:39.691 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T10:46:39.706 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T10:46:39.749 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T10:46:39.914 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T10:46:39.941 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T10:46:39.980 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T10:46:40.241 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-routes. 2024-09-14T10:46:40.257 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T10:46:40.291 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T10:46:40.628 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T10:46:40.655 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:40.686 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:40.712 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-babel. 2024-09-14T10:46:40.728 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T10:46:40.762 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T10:46:41.024 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T10:46:41.036 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T10:46:41.065 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T10:46:41.359 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T10:46:41.375 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:41.409 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:41.729 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T10:46:41.756 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T10:46:41.787 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T10:46:42.084 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-routes. 2024-09-14T10:46:42.110 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T10:46:42.150 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T10:46:42.487 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T10:46:42.514 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:42.570 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:43.432 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T10:46:43.449 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T10:46:43.482 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T10:46:44.161 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T10:46:44.188 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T10:46:44.219 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T10:46:44.589 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T10:46:44.617 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T10:46:44.655 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T10:46:44.941 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T10:46:44.969 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T10:46:45.085 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T10:46:45.550 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T10:46:45.580 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T10:46:45.633 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T10:46:45.786 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T10:46:45.814 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:45.852 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:46.095 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T10:46:46.122 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T10:46:46.178 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T10:46:46.506 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T10:46:46.533 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T10:46:46.573 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T10:46:46.814 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T10:46:46.841 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T10:46:46.880 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T10:46:46.884 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T10:46:46.911 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T10:46:47.036 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T10:46:47.150 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T10:46:47.166 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T10:46:47.200 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T10:46:47.503 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T10:46:47.531 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T10:46:47.569 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T10:46:47.670 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T10:46:47.699 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:47.728 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:47.839 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T10:46:47.867 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T10:46:47.906 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T10:46:48.226 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T10:46:48.254 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T10:46:48.301 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T10:46:48.621 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T10:46:48.649 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T10:46:48.673 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T10:46:48.687 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T10:46:48.700 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T10:46:48.739 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T10:46:48.990 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T10:46:49.008 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T10:46:49.043 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T10:46:49.048 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T10:46:49.070 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T10:46:49.109 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T10:46:49.335 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T10:46:49.363 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T10:46:49.393 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T10:46:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T10:46:49.473 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T10:46:49.512 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T10:46:49.832 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T10:46:49.860 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T10:46:49.898 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T10:46:50.057 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T10:46:50.074 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:50.115 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:50.219 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T10:46:50.247 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T10:46:50.285 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T10:46:50.410 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T10:46:50.438 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T10:46:50.501 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T10:46:50.605 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T10:46:50.633 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T10:46:50.672 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T10:46:50.829 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T10:46:50.857 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T10:46:50.896 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T10:46:50.942 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T10:46:50.958 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T10:46:50.991 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T10:46:51.157 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package jq. 2024-09-14T10:46:51.185 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T10:46:51.223 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T10:46:51.295 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T10:46:51.322 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T10:46:51.361 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T10:46:51.468 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package socat. 2024-09-14T10:46:51.495 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T10:46:51.534 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T10:46:51.796 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T10:46:51.812 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T10:46:51.846 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T10:46:51.975 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T10:46:52.003 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:52.041 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:52.183 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-test. 2024-09-14T10:46:52.211 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:52.249 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:52.294 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T10:46:52.322 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T10:46:52.352 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T10:46:52.647 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T10:46:52.675 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T10:46:52.705 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T10:46:52.941 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package jq. 2024-09-14T10:46:52.970 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T10:46:53.007 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T10:46:53.260 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package socat. 2024-09-14T10:46:53.277 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T10:46:53.352 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T10:46:53.639 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T10:46:53.667 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T10:46:53.705 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T10:46:54.059 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-test. 2024-09-14T10:46:54.076 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:54.209 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:54.904 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T10:46:54.932 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:54.970 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:55.291 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T10:46:55.319 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:55.358 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:55.678 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T10:46:55.705 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T10:46:55.743 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T10:46:56.073 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T10:46:56.101 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T10:46:56.139 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T10:46:56.485 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T10:46:56.513 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T10:46:56.543 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T10:46:56.646 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T10:46:56.663 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T10:46:56.696 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:56.932 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package pkg-config. 2024-09-14T10:46:56.960 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T10:46:56.998 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T10:46:57.059 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T10:46:57.087 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:46:57.125 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:46:57.259 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T10:46:57.275 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T10:46:57.318 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T10:46:57.445 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T10:46:57.473 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T10:46:57.511 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T10:46:57.746 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T10:46:57.774 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T10:46:57.812 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T10:46:57.832 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T10:46:57.860 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T10:46:57.899 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T10:46:58.115 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T10:46:58.143 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T10:46:58.190 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T10:46:58.245 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T10:46:58.272 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T10:46:58.311 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T10:46:58.510 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T10:46:58.538 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T10:46:58.585 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T10:46:58.741 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package pkg-config. 2024-09-14T10:46:58.769 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T10:46:58.816 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T10:46:58.888 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T10:46:58.916 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T10:46:58.946 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T10:46:59.061 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T10:46:59.089 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T10:46:59.127 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T10:46:59.299 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-py. 2024-09-14T10:46:59.327 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T10:46:59.373 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T10:46:59.547 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T10:46:59.575 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T10:46:59.613 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T10:46:59.685 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T10:46:59.701 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T10:46:59.743 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T10:46:59.891 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T10:46:59.919 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T10:46:59.957 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T10:47:00.206 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T10:47:00.234 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T10:47:00.236 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T10:47:00.264 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T10:47:00.272 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T10:47:00.294 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T10:47:00.575 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-toml. 2024-09-14T10:47:00.603 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T10:47:00.613 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T10:47:00.641 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T10:47:00.642 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T10:47:00.680 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T10:47:00.944 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T10:47:00.972 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T10:47:00.983 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-py. 2024-09-14T10:47:01.011 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T10:47:01.011 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T10:47:01.049 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T10:47:01.356 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T10:47:01.370 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T10:47:01.384 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T10:47:01.398 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T10:47:01.422 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T10:47:01.436 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T10:47:01.691 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T10:47:01.720 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T10:47:01.758 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T10:47:01.882 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T10:47:01.910 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T10:47:01.948 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T10:47:02.268 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-toml. 2024-09-14T10:47:02.296 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T10:47:02.334 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T10:47:02.512 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package radosgw. 2024-09-14T10:47:02.541 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:47:02.578 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:02.620 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T10:47:02.649 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T10:47:02.687 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T10:47:03.024 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T10:47:03.052 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T10:47:03.090 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T10:47:03.369 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T10:47:03.397 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T10:47:03.423 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T10:47:03.434 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T10:47:03.451 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:47:03.490 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:03.794 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T10:47:04.028 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T10:47:04.154 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T10:47:04.180 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package radosgw. 2024-09-14T10:47:04.209 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:47:04.246 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:04.414 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T10:47:04.774 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T10:47:05.116 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T10:47:05.133 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T10:47:05.174 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:05.200 INFO:teuthology.orchestra.run.smithi148.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T10:47:05.264 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:05.479 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T10:47:05.729 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T10:47:05.781 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user cephadm....done 2024-09-14T10:47:05.855 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T10:47:05.937 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T10:47:06.122 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T10:47:06.205 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T10:47:06.456 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T10:47:06.508 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T10:47:06.582 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T10:47:06.833 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T10:47:06.978 INFO:teuthology.orchestra.run.smithi150.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T10:47:07.057 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:07.092 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T10:47:07.227 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T10:47:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T10:47:07.606 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user cephadm....done 2024-09-14T10:47:07.771 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T10:47:07.939 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T10:47:08.039 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T10:47:08.190 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T10:47:08.291 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T10:47:08.425 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T10:47:08.441 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T10:47:08.659 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T10:47:08.684 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T10:47:08.927 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T10:47:08.927 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T10:47:09.053 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T10:47:09.186 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T10:47:09.363 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T10:47:09.437 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:09.708 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T10:47:09.780 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T10:47:09.939 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T10:47:09.958 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T10:47:10.040 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T10:47:10.166 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T10:47:10.234 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T10:47:10.292 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T10:47:10.544 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T10:47:10.781 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T10:47:10.924 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T10:47:10.950 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T10:47:11.013 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T10:47:11.053 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T10:47:11.131 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T10:47:11.363 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T10:47:11.491 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T10:47:11.609 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T10:47:11.622 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:11.868 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T10:47:11.873 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T10:47:11.999 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T10:47:12.125 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T10:47:12.127 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T10:47:12.235 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T10:47:12.336 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T10:47:12.445 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T10:47:12.571 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T10:47:12.587 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T10:47:12.981 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T10:47:13.018 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T10:47:13.082 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T10:47:13.207 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T10:47:13.256 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T10:47:13.508 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T10:47:13.575 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T10:47:13.634 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T10:47:13.701 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T10:47:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T10:47:13.961 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T10:47:14.086 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T10:47:14.220 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T10:47:14.479 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T10:47:14.513 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T10:47:14.639 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T10:47:14.730 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T10:47:15.115 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T10:47:15.324 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T10:47:15.399 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T10:47:15.584 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T10:47:15.693 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T10:47:15.742 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T10:47:15.794 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T10:47:15.985 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T10:47:16.104 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T10:47:16.111 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:16.429 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T10:47:16.472 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T10:47:16.723 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T10:47:16.764 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T10:47:17.099 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T10:47:17.392 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T10:47:17.735 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T10:47:17.886 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T10:47:17.978 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T10:47:18.087 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:18.146 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:47:18.281 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T10:47:18.380 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T10:47:18.540 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T10:47:18.658 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T10:47:18.706 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T10:47:18.783 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T10:47:19.087 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T10:47:19.346 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T10:47:19.597 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:47:19.749 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T10:47:19.870 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T10:47:20.042 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T10:47:20.089 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:47:20.215 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T10:47:20.284 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T10:47:20.482 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T10:47:20.544 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T10:47:20.608 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T10:47:20.718 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T10:47:20.794 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T10:47:21.019 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T10:47:21.055 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T10:47:21.270 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T10:47:21.314 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T10:47:21.456 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T10:47:21.521 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:47:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T10:47:21.732 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T10:47:21.858 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T10:47:21.940 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T10:47:22.143 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T10:47:22.225 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T10:47:22.444 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T10:47:22.476 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T10:47:22.703 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T10:47:22.727 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T10:47:22.830 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T10:47:22.947 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T10:47:22.970 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T10:47:23.037 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T10:47:23.221 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T10:47:23.299 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T10:47:23.346 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T10:47:23.425 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T10:47:23.623 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T10:47:23.749 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T10:47:23.809 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T10:47:24.042 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T10:47:24.086 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T10:47:24.220 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T10:47:24.343 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T10:47:24.480 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:47:24.594 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T10:47:24.597 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T10:47:24.720 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T10:47:24.846 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T10:47:24.898 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T10:47:24.934 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T10:47:25.181 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T10:47:25.199 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T10:47:25.307 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T10:47:25.700 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T10:47:25.743 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T10:47:25.868 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T10:47:25.959 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T10:47:26.060 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T10:47:26.144 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T10:47:26.506 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T10:47:26.553 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T10:47:26.654 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T10:47:26.757 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T10:47:26.955 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T10:47:27.134 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T10:47:27.256 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T10:47:27.427 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T10:47:27.532 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T10:47:27.658 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T10:47:27.771 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T10:47:27.881 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:27.926 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T10:47:27.990 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:28.116 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T10:47:28.279 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T10:47:28.452 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:28.548 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T10:47:28.578 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:28.704 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T10:47:28.940 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T10:47:28.964 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:29.065 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:29.216 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:29.235 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T10:47:29.429 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T10:47:29.429 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T10:47:29.555 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T10:47:29.672 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:29.798 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:29.924 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T10:47:29.951 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:30.077 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:30.203 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:30.261 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:30.337 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T10:47:30.378 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:30.479 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T10:47:30.739 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:30.865 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:30.992 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:31.201 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T10:47:31.202 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T10:47:31.532 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:31.658 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:31.727 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:31.784 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:31.910 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:31.920 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:32.036 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:32.054 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:32.198 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T10:47:32.563 INFO:teuthology.orchestra.run.smithi148.stdout:Adding group ceph....done 2024-09-14T10:47:32.939 INFO:teuthology.orchestra.run.smithi148.stdout:Adding system user ceph....done 2024-09-14T10:47:33.108 INFO:teuthology.orchestra.run.smithi148.stdout:Setting system user ceph properties....done 2024-09-14T10:47:33.122 INFO:teuthology.orchestra.run.smithi148.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T10:47:33.260 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T10:47:33.513 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:33.594 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T10:47:33.708 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:33.834 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:33.960 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:34.086 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:34.105 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:34.223 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:34.587 INFO:teuthology.orchestra.run.smithi150.stdout:Adding group ceph....done 2024-09-14T10:47:34.684 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:47:34.684 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:47:34.947 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user ceph....done 2024-09-14T10:47:35.116 INFO:teuthology.orchestra.run.smithi150.stdout:Setting system user ceph properties....done 2024-09-14T10:47:35.127 INFO:teuthology.orchestra.run.smithi150.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T10:47:35.166 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:35.265 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T10:47:35.526 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T10:47:35.614 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T10:47:36.035 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:36.096 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:36.222 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:36.252 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T10:47:36.252 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T10:47:36.763 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:36.819 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:47:36.819 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T10:47:37.282 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:37.537 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:37.592 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T10:47:37.893 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T10:47:37.893 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T10:47:38.050 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:38.271 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T10:47:38.271 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T10:47:38.374 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:38.500 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:38.634 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:38.727 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:38.829 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T10:47:38.829 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T10:47:38.941 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T10:47:38.941 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T10:47:39.319 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:39.395 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:39.462 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:39.588 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:39.643 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T10:47:39.643 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T10:47:39.739 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:40.108 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T10:47:40.113 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:40.218 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T10:47:40.231 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:40.370 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T10:47:40.382 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:40.575 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T10:47:40.575 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T10:47:41.049 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:41.187 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T10:47:41.192 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:41.318 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:41.472 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T10:47:41.850 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T10:47:41.853 DEBUG:teuthology.orchestra.run.smithi148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-14T10:47:41.966 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-09-14T10:47:42.178 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-09-14T10:47:42.178 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-09-14T10:47:42.186 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T10:47:42.295 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T10:47:42.375 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:47:42.376 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:47:42.376 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:47:42.376 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:47:42.376 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:47:42.376 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:47:42.376 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T10:47:42.378 INFO:teuthology.orchestra.run.smithi148.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T10:47:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-14T10:47:42.379 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-09-14T10:47:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-14T10:47:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-14T10:47:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-14T10:47:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-14T10:47:42.379 INFO:teuthology.orchestra.run.smithi148.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T10:47:42.419 INFO:teuthology.orchestra.run.smithi148.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T10:47:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T10:47:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T10:47:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-14T10:47:42.420 INFO:teuthology.orchestra.run.smithi148.stdout: s3cmd 2024-09-14T10:47:42.447 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T10:47:42.472 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T10:47:42.472 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 10.4 MB of archives. 2024-09-14T10:47:42.472 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-14T10:47:42.472 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-14T10:47:42.490 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-14T10:47:42.490 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-14T10:47:42.494 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-14T10:47:42.528 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-14T10:47:42.544 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-14T10:47:42.544 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-14T10:47:42.578 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-14T10:47:42.601 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-14T10:47:42.602 INFO:teuthology.orchestra.run.smithi148.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-14T10:47:42.603 INFO:teuthology.orchestra.run.smithi148.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-14T10:47:42.651 INFO:teuthology.orchestra.run.smithi148.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-14T10:47:42.651 INFO:teuthology.orchestra.run.smithi148.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-14T10:47:42.668 INFO:teuthology.orchestra.run.smithi148.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-14T10:47:42.668 INFO:teuthology.orchestra.run.smithi148.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-14T10:47:42.669 INFO:teuthology.orchestra.run.smithi148.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-14T10:47:42.670 INFO:teuthology.orchestra.run.smithi148.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-14T10:47:42.670 INFO:teuthology.orchestra.run.smithi148.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-14T10:47:42.673 INFO:teuthology.orchestra.run.smithi148.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-14T10:47:42.674 INFO:teuthology.orchestra.run.smithi148.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-14T10:47:42.679 INFO:teuthology.orchestra.run.smithi148.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-14T10:47:42.681 INFO:teuthology.orchestra.run.smithi148.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-14T10:47:42.687 INFO:teuthology.orchestra.run.smithi148.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-14T10:47:42.688 INFO:teuthology.orchestra.run.smithi148.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-14T10:47:42.699 INFO:teuthology.orchestra.run.smithi148.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-14T10:47:42.700 INFO:teuthology.orchestra.run.smithi148.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-14T10:47:42.700 INFO:teuthology.orchestra.run.smithi148.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-14T10:47:42.702 INFO:teuthology.orchestra.run.smithi148.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-14T10:47:42.705 INFO:teuthology.orchestra.run.smithi148.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-14T10:47:42.707 INFO:teuthology.orchestra.run.smithi148.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-14T10:47:42.722 INFO:teuthology.orchestra.run.smithi148.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-14T10:47:42.722 INFO:teuthology.orchestra.run.smithi148.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-14T10:47:42.739 INFO:teuthology.orchestra.run.smithi148.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-14T10:47:42.739 INFO:teuthology.orchestra.run.smithi148.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-14T10:47:42.739 INFO:teuthology.orchestra.run.smithi148.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-14T10:47:43.116 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 10.4 MB in 0s (33.2 MB/s) 2024-09-14T10:47:43.189 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T10:47:43.200 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-14T10:47:43.253 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-14T10:47:43.258 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-14T10:47:43.299 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-14T10:47:43.560 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-14T10:47:43.588 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-14T10:47:43.627 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T10:47:43.860 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T10:47:43.862 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-14T10:47:43.871 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-14T10:47:43.900 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-14T10:47:43.930 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T10:47:43.963 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-14T10:47:44.166 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-14T10:47:44.184 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-14T10:47:44.185 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-14T10:47:44.194 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-14T10:47:44.232 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-14T10:47:44.384 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:47:44.384 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:47:44.384 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:47:44.384 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:47:44.385 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:47:44.385 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:47:44.385 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:47:44.386 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-14T10:47:44.386 INFO:teuthology.orchestra.run.smithi150.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T10:47:44.386 INFO:teuthology.orchestra.run.smithi150.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T10:47:44.386 INFO:teuthology.orchestra.run.smithi150.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T10:47:44.386 INFO:teuthology.orchestra.run.smithi150.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T10:47:44.386 INFO:teuthology.orchestra.run.smithi150.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T10:47:44.386 INFO:teuthology.orchestra.run.smithi150.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T10:47:44.387 INFO:teuthology.orchestra.run.smithi150.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T10:47:44.387 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T10:47:44.387 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T10:47:44.387 INFO:teuthology.orchestra.run.smithi150.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T10:47:44.387 INFO:teuthology.orchestra.run.smithi150.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-14T10:47:44.388 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-14T10:47:44.388 INFO:teuthology.orchestra.run.smithi150.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-14T10:47:44.388 INFO:teuthology.orchestra.run.smithi150.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-14T10:47:44.388 INFO:teuthology.orchestra.run.smithi150.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-14T10:47:44.388 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-14T10:47:44.388 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-14T10:47:44.427 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-14T10:47:44.427 INFO:teuthology.orchestra.run.smithi150.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T10:47:44.427 INFO:teuthology.orchestra.run.smithi150.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T10:47:44.427 INFO:teuthology.orchestra.run.smithi150.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T10:47:44.427 INFO:teuthology.orchestra.run.smithi150.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T10:47:44.427 INFO:teuthology.orchestra.run.smithi150.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T10:47:44.428 INFO:teuthology.orchestra.run.smithi150.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T10:47:44.428 INFO:teuthology.orchestra.run.smithi150.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T10:47:44.428 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T10:47:44.428 INFO:teuthology.orchestra.run.smithi150.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T10:47:44.428 INFO:teuthology.orchestra.run.smithi150.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T10:47:44.429 INFO:teuthology.orchestra.run.smithi150.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-14T10:47:44.429 INFO:teuthology.orchestra.run.smithi150.stdout: s3cmd 2024-09-14T10:47:44.510 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-14T10:47:44.538 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-14T10:47:44.577 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-14T10:47:44.610 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T10:47:44.610 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 10.4 MB of archives. 2024-09-14T10:47:44.610 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-14T10:47:44.610 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-14T10:47:44.692 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-14T10:47:44.692 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-14T10:47:44.709 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-14T10:47:44.829 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-14T10:47:44.857 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-14T10:47:44.873 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-14T10:47:44.896 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-14T10:47:44.944 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-14T10:47:44.952 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-14T10:47:45.087 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-14T10:47:45.140 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-14T10:47:45.156 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-14T10:47:45.181 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-14T10:47:45.181 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-14T10:47:45.183 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-14T10:47:45.189 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-14T10:47:45.328 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-14T10:47:45.329 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-14T10:47:45.368 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-14T10:47:45.369 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-14T10:47:45.370 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-14T10:47:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-14T10:47:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-14T10:47:45.378 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-14T10:47:45.380 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-14T10:47:45.425 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-14T10:47:45.428 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-14T10:47:45.476 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-14T10:47:45.477 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-14T10:47:45.477 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-14T10:47:45.480 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-14T10:47:45.481 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-14T10:47:45.492 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-14T10:47:45.507 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-14T10:47:45.508 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-14T10:47:45.515 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-14T10:47:45.519 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-14T10:47:45.550 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-14T10:47:45.588 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-14T10:47:45.589 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-14T10:47:45.621 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-14T10:47:45.621 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-14T10:47:45.621 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-14T10:47:45.844 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-14T10:47:45.860 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-14T10:47:45.902 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T10:47:46.071 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 10.4 MB in 1s (8,740 kB/s) 2024-09-14T10:47:46.161 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-14T10:47:46.243 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-14T10:47:46.249 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-14T10:47:46.265 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjsr305-java. 2024-09-14T10:47:46.289 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-14T10:47:46.301 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-14T10:47:46.323 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-14T10:47:46.529 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-14T10:47:46.545 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-14T10:47:46.551 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libguava-java. 2024-09-14T10:47:46.579 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-14T10:47:46.579 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T10:47:46.617 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-14T10:47:46.904 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-14T10:47:46.932 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-14T10:47:47.015 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T10:47:47.037 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-14T10:47:47.053 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-14T10:47:47.095 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-14T10:47:47.293 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-14T10:47:47.309 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-14T10:47:47.347 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libguice-java. 2024-09-14T10:47:47.351 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-14T10:47:47.364 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-14T10:47:47.405 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-14T10:47:47.612 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-14T10:47:47.628 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-14T10:47:47.662 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-14T10:47:47.751 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-14T10:47:47.767 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-14T10:47:47.809 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-14T10:47:47.898 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-14T10:47:47.914 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-14T10:47:47.956 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-14T10:47:48.070 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-14T10:47:48.099 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-14T10:47:48.137 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-14T10:47:48.208 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-14T10:47:48.224 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-14T10:47:48.266 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-14T10:47:48.414 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libjansi-java. 2024-09-14T10:47:48.431 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-14T10:47:48.472 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-14T10:47:48.519 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-14T10:47:48.547 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-14T10:47:48.585 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-14T10:47:48.750 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-14T10:47:48.779 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-14T10:47:48.816 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-14T10:47:48.863 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-14T10:47:48.891 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-14T10:47:48.921 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T10:47:49.052 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-14T10:47:49.068 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-14T10:47:49.102 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-14T10:47:49.157 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjsr305-java. 2024-09-14T10:47:49.174 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-14T10:47:49.215 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-14T10:47:49.380 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-14T10:47:49.408 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-14T10:47:49.435 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libguava-java. 2024-09-14T10:47:49.446 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T10:47:49.451 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-14T10:47:49.485 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-14T10:47:49.699 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-14T10:47:49.727 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-14T10:47:49.765 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T10:47:49.912 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-14T10:47:49.929 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-14T10:47:49.971 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-14T10:47:50.077 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-14T10:47:50.094 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-14T10:47:50.136 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T10:47:50.223 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libguice-java. 2024-09-14T10:47:50.252 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-14T10:47:50.290 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-14T10:47:50.355 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-14T10:47:50.371 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-14T10:47:50.413 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-14T10:47:50.666 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-14T10:47:50.682 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-14T10:47:50.717 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T10:47:50.752 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-14T10:47:50.781 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-14T10:47:50.819 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-14T10:47:50.935 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-14T10:47:50.963 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-14T10:47:50.993 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T10:47:51.038 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-14T10:47:51.067 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-14T10:47:51.104 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-14T10:47:51.331 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-14T10:47:51.357 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjansi-java. 2024-09-14T10:47:51.359 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-14T10:47:51.386 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-14T10:47:51.397 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-14T10:47:51.423 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-14T10:47:51.667 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-14T10:47:51.676 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-14T10:47:51.695 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-14T10:47:51.705 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-14T10:47:51.733 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T10:47:51.743 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-14T10:47:51.977 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libslf4j-java. 2024-09-14T10:47:51.993 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-14T10:47:52.012 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-14T10:47:52.035 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-14T10:47:52.040 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-14T10:47:52.087 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-14T10:47:52.331 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-14T10:47:52.347 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-14T10:47:52.389 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-14T10:47:52.404 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-14T10:47:52.418 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-14T10:47:52.456 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T10:47:52.675 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-14T10:47:52.703 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-14T10:47:52.709 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-14T10:47:52.737 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-14T10:47:52.742 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-14T10:47:52.775 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T10:47:53.019 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-14T10:47:53.036 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-14T10:47:53.078 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-14T10:47:53.079 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-14T10:47:53.096 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-14T10:47:53.137 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T10:47:53.373 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-14T10:47:53.389 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-14T10:47:53.423 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-14T10:47:53.465 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-14T10:47:53.482 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-14T10:47:53.524 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-14T10:47:53.676 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-14T10:47:53.704 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-14T10:47:53.743 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T10:47:53.751 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-14T10:47:53.779 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-14T10:47:53.817 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T10:47:53.995 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-14T10:47:54.011 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-14T10:47:54.053 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T10:47:54.279 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package maven. 2024-09-14T10:47:54.307 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-14T10:47:54.323 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-14T10:47:54.345 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking maven (3.6.3-5) ... 2024-09-14T10:47:54.349 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-14T10:47:54.389 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-14T10:47:54.633 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-14T10:47:54.650 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-14T10:47:54.673 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package python3-magic. 2024-09-14T10:47:54.691 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T10:47:54.702 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-14T10:47:54.740 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-14T10:47:54.927 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libslf4j-java. 2024-09-14T10:47:54.944 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-14T10:47:54.985 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-14T10:47:54.992 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package s3cmd. 2024-09-14T10:47:55.009 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-14T10:47:55.042 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-14T10:47:55.273 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-14T10:47:55.290 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-14T10:47:55.331 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-14T10:47:55.389 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-14T10:47:55.515 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-14T10:47:55.609 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-14T10:47:55.625 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-14T10:47:55.641 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T10:47:55.659 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-14T10:47:55.767 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-14T10:47:55.893 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-14T10:47:55.928 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-14T10:47:55.956 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-14T10:47:55.994 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-14T10:47:56.035 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-14T10:47:56.153 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T10:47:56.375 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-14T10:47:56.403 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-14T10:47:56.432 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-14T10:47:56.440 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-14T10:47:56.693 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-14T10:47:56.722 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-14T10:47:56.760 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T10:47:56.864 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T10:47:56.990 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T10:47:57.116 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-14T10:47:57.204 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package maven. 2024-09-14T10:47:57.232 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-14T10:47:57.242 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T10:47:57.262 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking maven (3.6.3-5) ... 2024-09-14T10:47:57.368 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-14T10:47:57.494 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T10:47:57.566 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-magic. 2024-09-14T10:47:57.594 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-14T10:47:57.612 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T10:47:57.632 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-14T10:47:57.713 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-14T10:47:57.960 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package s3cmd. 2024-09-14T10:47:57.964 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-14T10:47:57.988 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-14T10:47:58.026 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-14T10:47:58.090 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-14T10:47:58.216 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T10:47:58.342 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-14T10:47:58.381 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-14T10:47:58.468 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-14T10:47:58.507 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-14T10:47:58.594 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-14T10:47:58.633 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T10:47:58.703 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-14T10:47:58.776 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-14T10:47:58.902 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-14T10:47:58.988 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-14T10:47:59.028 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-14T10:47:59.115 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T10:47:59.137 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T10:47:59.238 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-14T10:47:59.240 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libguava-java (29.0-6) ... 2024-09-14T10:47:59.347 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T10:47:59.366 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-14T10:47:59.473 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T10:47:59.493 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-14T10:47:59.599 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-14T10:47:59.618 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-14T10:47:59.725 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T10:47:59.744 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-14T10:47:59.868 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-14T10:47:59.887 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-14T10:47:59.988 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-14T10:47:59.994 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T10:48:00.120 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T10:48:00.131 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T10:48:00.221 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-14T10:48:00.257 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-14T10:48:00.383 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up maven (3.6.3-5) ... 2024-09-14T10:48:00.481 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-14T10:48:00.607 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-14T10:48:00.641 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-14T10:48:00.712 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T10:48:00.732 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T10:48:00.850 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-14T10:48:00.968 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-14T10:48:01.077 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-14T10:48:01.203 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-14T10:48:01.496 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-14T10:48:01.597 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T10:48:01.723 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libguava-java (29.0-6) ... 2024-09-14T10:48:01.849 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-14T10:48:01.975 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-14T10:48:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T10:48:02.047 DEBUG:teuthology.parallel:result is None 2024-09-14T10:48:02.101 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-14T10:48:02.227 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-14T10:48:02.353 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-14T10:48:02.479 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-14T10:48:02.589 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T10:48:02.698 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-14T10:48:02.824 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up maven (3.6.3-5) ... 2024-09-14T10:48:03.081 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-14T10:48:03.145 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T10:48:04.445 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T10:48:04.452 DEBUG:teuthology.parallel:result is None 2024-09-14T10:48:04.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:48:04.594 DEBUG:teuthology.orchestra.run.smithi148:> dpkg-query -W -f '${Version}' ceph 2024-09-14T10:48:04.614 INFO:teuthology.orchestra.run.smithi148.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T10:48:04.615 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:48:04.615 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T10:48:04.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:48:04.761 DEBUG:teuthology.orchestra.run.smithi150:> dpkg-query -W -f '${Version}' ceph 2024-09-14T10:48:04.780 INFO:teuthology.orchestra.run.smithi150.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T10:48:04.780 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:48:04.780 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T10:48:04.782 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T10:48:04.783 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:04.783 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:48:04.797 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:04.798 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:48:04.836 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T10:48:04.836 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:04.836 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:48:04.851 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:48:04.903 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:04.904 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:48:04.917 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:48:04.971 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T10:48:04.971 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:04.971 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:48:04.984 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:48:05.043 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:05.043 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:48:05.056 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:48:05.111 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T10:48:05.111 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:05.111 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:48:05.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:48:05.183 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:05.183 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:48:05.197 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:48:05.252 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T10:48:05.336 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T10:48:05.336 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-09-14T10:48:05.339 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-09-14T10:48:05.352 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T10:48:05.352 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:48:05.393 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:48:05.411 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T10:48:05.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:48:05.445 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:48:05.479 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T10:48:05.479 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T10:48:05.480 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904127', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDzHHTz7xU16xLixLXpO8R7JG+GIoai8AI2Ox8QIDwrN94CNtx+0sHg9+D68zQuKMBG+8d8WzmlTgy3fdXjLccw=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIn7ww6KpJvheHBNCtp8NOmzSlB3iyMs1+h2225WaVZxOwcS0OqY5aFK7QakSmGQgtx9C/JDLZMUBgA0owEOeDU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T10:48:05.480 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:48:05.501 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:48:05.516 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:48:05.549 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:48:05.572 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:05.572 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:48:05.608 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:48:05.608 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-14T10:48:05.656 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:48:05.656 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:48:05.657 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-14T10:48:05.657 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:48:05.657 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-14 10:42:21.469888456 +0000 2024-09-14T10:48:05.657 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-14 10:42:21.225890635 +0000 2024-09-14T10:48:05.657 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-14 10:42:21.225890635 +0000 2024-09-14T10:48:05.657 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-09-14T10:48:05.657 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:48:05.710 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-14T10:48:05.711 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-14T10:48:05.711 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000395313 s, 1.3 MB/s 2024-09-14T10:48:05.712 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:48:05.761 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-14T10:48:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:48:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:48:05.808 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-14T10:48:05.808 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:48:05.808 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-14 10:42:21.969883989 +0000 2024-09-14T10:48:05.809 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-14 10:42:21.733886097 +0000 2024-09-14T10:48:05.809 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-14 10:42:21.733886097 +0000 2024-09-14T10:48:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-09-14T10:48:05.809 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:48:05.863 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-14T10:48:05.863 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-14T10:48:05.863 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000433494 s, 1.2 MB/s 2024-09-14T10:48:05.864 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:48:05.913 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-14T10:48:05.960 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:48:05.960 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:48:05.960 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-09-14T10:48:05.960 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:48:05.960 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-14 10:42:22.461879596 +0000 2024-09-14T10:48:05.960 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-14 10:42:22.185882061 +0000 2024-09-14T10:48:05.960 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-14 10:42:22.185882061 +0000 2024-09-14T10:48:05.961 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-09-14T10:48:05.961 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:48:06.015 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-14T10:48:06.015 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-14T10:48:06.015 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000325198 s, 1.6 MB/s 2024-09-14T10:48:06.016 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:48:06.066 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-14T10:48:06.112 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:48:06.112 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:48:06.112 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-14T10:48:06.112 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:48:06.112 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-14 10:42:22.961875128 +0000 2024-09-14T10:48:06.112 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-14 10:42:22.685877594 +0000 2024-09-14T10:48:06.112 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-14 10:42:22.685877594 +0000 2024-09-14T10:48:06.112 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-09-14T10:48:06.113 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:48:06.166 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-14T10:48:06.167 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-14T10:48:06.167 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000382937 s, 1.3 MB/s 2024-09-14T10:48:06.168 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:48:06.217 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:06.217 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:06.217 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:48:06.223 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:48:06.223 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-09-14T10:48:06.272 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:48:06.272 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:48:06.272 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 866 Links: 1 2024-09-14T10:48:06.273 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:48:06.273 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-14 10:42:20.143571061 +0000 2024-09-14T10:48:06.273 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-14 10:42:19.911573133 +0000 2024-09-14T10:48:06.273 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-14 10:42:19.911573133 +0000 2024-09-14T10:48:06.273 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-14T10:48:06.273 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:48:06.327 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-14T10:48:06.327 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-14T10:48:06.327 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000457881 s, 1.1 MB/s 2024-09-14T10:48:06.328 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:48:06.377 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-09-14T10:48:06.424 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:48:06.424 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:48:06.424 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-14T10:48:06.424 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:48:06.424 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-14 10:42:20.607566917 +0000 2024-09-14T10:48:06.424 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-14 10:42:20.351569203 +0000 2024-09-14T10:48:06.424 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-14 10:42:20.351569203 +0000 2024-09-14T10:48:06.424 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-14T10:48:06.424 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:48:06.478 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-14T10:48:06.479 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-14T10:48:06.479 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000416388 s, 1.2 MB/s 2024-09-14T10:48:06.480 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:48:06.529 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-09-14T10:48:06.577 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:48:06.577 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:48:06.577 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-09-14T10:48:06.577 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:48:06.577 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-14 10:42:21.091562594 +0000 2024-09-14T10:48:06.578 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-14 10:42:20.835564880 +0000 2024-09-14T10:48:06.578 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-14 10:42:20.835564880 +0000 2024-09-14T10:48:06.578 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-14T10:48:06.578 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:48:06.630 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-14T10:48:06.631 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-14T10:48:06.631 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000378695 s, 1.4 MB/s 2024-09-14T10:48:06.632 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:48:06.681 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-09-14T10:48:06.728 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:48:06.728 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:48:06.728 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-14T10:48:06.728 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:48:06.728 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-14 10:42:21.591558127 +0000 2024-09-14T10:48:06.728 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-14 10:42:21.315560593 +0000 2024-09-14T10:48:06.729 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-14 10:42:21.315560593 +0000 2024-09-14T10:48:06.729 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-14T10:48:06.729 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:48:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-14T10:48:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-14T10:48:06.783 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000401127 s, 1.3 MB/s 2024-09-14T10:48:06.785 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:48:06.833 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:06.833 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:48:06.833 INFO:tasks.ceph:Generating config... 2024-09-14T10:48:06.834 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T10:48:06.834 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T10:48:06.834 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T10:48:06.834 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T10:48:06.834 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T10:48:06.835 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T10:48:06.835 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T10:48:06.836 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T10:48:06.836 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-14T10:48:06.836 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T10:48:06.836 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T10:48:06.836 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T10:48:06.836 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T10:48:06.836 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T10:48:06.836 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T10:48:06.836 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T10:48:06.836 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-14T10:48:06.836 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T10:48:06.837 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T10:48:06.837 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T10:48:06.837 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T10:48:06.837 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T10:48:06.837 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T10:48:06.837 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T10:48:06.837 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T10:48:06.838 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T10:48:06.838 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T10:48:06.839 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T10:48:06.872 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T10:48:06.889 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T10:48:06.966 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:48:07.021 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.148'), ('mon.c', '[v2:172.21.15.148:3301,v1:172.21.15.148:6790]'), ('mon.b', '172.21.15.150')] 2024-09-14T10:48:07.021 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790],172.21.15.150', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T10:48:07.022 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:07.022 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:48:07.068 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.148 --addv c '[v2:172.21.15.148:3301,v1:172.21.15.148:6790]' --add b 172.21.15.150 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:07.153 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:48:07.154 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: generated fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:setting min_mon_release = quincy 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 0 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-09-14T10:48:07.167829+0000 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:min_mon_release 17 (quincy) 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:election_strategy: 1 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T10:48:07.155 INFO:teuthology.orchestra.run.smithi148.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T10:48:07.156 INFO:teuthology.orchestra.run.smithi148.stdout:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T10:48:07.156 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T10:48:07.157 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:48:07.204 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 34b25a2a-02e0-45bd-900d-fa93b60a7234... 2024-09-14T10:48:07.205 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:48:07.249 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-09-14T10:48:07.278 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-09-14T10:48:07.279 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.280 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790],172.21.15.150" 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: mon client directed command retry = 5 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject socket failures = 5000 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: osd heartbeat grace = 40 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-09-14T10:48:07.281 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-09-14T10:48:07.282 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:48:07.283 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-09-14T10:48:07.284 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.284 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-09-14T10:48:07.284 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-09-14T10:48:07.284 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2024-09-14T10:48:07.284 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2024-09-14T10:48:07.284 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2024-09-14T10:48:07.284 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-09-14T10:48:07.284 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: debug objclass = 20 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:48:07.285 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: osd fast shutdown = False 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: osd shutdown pgref assert = True 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.286 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:48:07.287 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd crush smoke test = False 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-09-14T10:48:07.288 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = True 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: debug rgw = 20 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: debug rgw notification = 20 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw bucket counters cache = True 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt require ssl = False 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T10:48:07.289 INFO:teuthology.orchestra.run.smithi148.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout: rgw s3 auth use sts = True 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout: rgw torrent flag = True 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout: rgw user counters cache = True 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout: setgroup = ceph 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout: setuser = ceph 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2024-09-14T10:48:07.290 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-09-14T10:48:07.292 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-09-14T10:48:07.293 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-09-14T10:48:07.294 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.148,[v2:172.21.15.148:3301,v1:172.21.15.148:6790],172.21.15.150" 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: mon client directed command retry = 5 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: ms inject socket failures = 5000 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: osd heartbeat grace = 40 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-09-14T10:48:07.295 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug trim objects = true 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.296 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-09-14T10:48:07.297 INFO:teuthology.orchestra.run.smithi150.stdout: bdev async discard = True 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: bdev enable discard = True 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore allocator = bitmap 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 1/20 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 1/20 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: debug objclass = 20 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 4/10 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2024-09-14T10:48:07.298 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: osd fast shutdown = False 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: osd shutdown pgref assert = True 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-09-14T10:48:07.299 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:48:07.300 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd crush smoke test = False 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-09-14T10:48:07.301 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = True 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: debug rgw = 20 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: debug rgw notification = 20 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw bucket counters cache = True 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw crypt require ssl = False 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:48:07.302 INFO:teuthology.orchestra.run.smithi150.stdout: rgw s3 auth use sts = True 2024-09-14T10:48:07.303 INFO:teuthology.orchestra.run.smithi150.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:48:07.303 INFO:teuthology.orchestra.run.smithi150.stdout: rgw torrent flag = True 2024-09-14T10:48:07.303 INFO:teuthology.orchestra.run.smithi150.stdout: rgw user counters cache = True 2024-09-14T10:48:07.303 INFO:teuthology.orchestra.run.smithi150.stdout: setgroup = ceph 2024-09-14T10:48:07.303 INFO:teuthology.orchestra.run.smithi150.stdout: setuser = ceph 2024-09-14T10:48:07.303 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-09-14T10:48:07.303 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2024-09-14T10:48:07.303 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2024-09-14T10:48:07.303 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T10:48:07.303 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T10:48:07.383 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T10:48:07.383 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:07.383 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T10:48:07.389 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:07.389 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T10:48:07.436 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T10:48:07.436 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:07.436 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:48:07.437 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:48:07.499 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:07.499 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:07.548 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T10:48:07.548 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:07.548 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:48:07.549 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:48:07.572 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:07.572 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:07.620 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T10:48:07.620 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T10:48:07.621 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:48:07.663 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:48:07.666 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:48:07.708 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:48:07.715 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T10:48:07.715 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T10:48:07.715 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T10:48:07.753 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T10:48:07.763 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T10:48:07.795 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T10:48:07.805 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T10:48:07.805 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:48:07.805 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T10:48:07.818 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:07.818 INFO:tasks.ceph:role: osd.0 2024-09-14T10:48:07.818 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T10:48:07.819 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:48:07.879 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:48:07.880 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:48:08.368 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-14T10:48:08.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-14T10:48:08.370 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T10:48:08.523 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T10:48:08.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:08.535 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:48:08.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T10:48:08.592 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:08.592 INFO:tasks.ceph:role: osd.1 2024-09-14T10:48:08.592 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T10:48:08.592 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:48:08.656 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:48:08.657 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:48:09.102 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-14T10:48:09.104 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-14T10:48:09.104 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T10:48:09.190 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T10:48:09.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:09.241 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:48:09.241 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T10:48:09.296 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:09.296 INFO:tasks.ceph:role: osd.2 2024-09-14T10:48:09.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T10:48:09.296 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:48:09.359 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:48:09.360 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:48:09.823 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-14T10:48:09.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-14T10:48:09.825 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T10:48:09.964 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T10:48:09.975 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:48:09.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:09.976 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T10:48:10.032 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:10.032 INFO:tasks.ceph:role: osd.3 2024-09-14T10:48:10.032 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T10:48:10.032 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:48:10.095 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:48:10.095 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:48:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:48:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:48:10.096 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:48:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:48:10.096 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:48:10.096 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:48:10.096 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:48:10.096 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:48:10.559 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-14T10:48:10.561 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-14T10:48:10.561 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T10:48:10.692 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T10:48:10.703 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:48:10.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:10.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:10.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:10.838+0000 7f7a9dcc27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T10:48:10.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:10.838+0000 7f7a9dcc27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T10:48:10.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:10.838+0000 7f7a9dcc27c0 -1 bdev(0x55f42f375800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T10:48:10.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:10.838+0000 7f7a9dcc27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T10:48:13.977 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T10:48:13.990 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:14.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:14.078+0000 7f2e129137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T10:48:14.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:14.078+0000 7f2e129137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T10:48:14.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:14.078+0000 7f2e129137c0 -1 bdev(0x5606faee3800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T10:48:14.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:14.078+0000 7f2e129137c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T10:48:17.208 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T10:48:17.264 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:17.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:17.354+0000 7f4147b777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T10:48:17.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:17.358+0000 7f4147b777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T10:48:17.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:17.358+0000 7f4147b777c0 -1 bdev(0x55936efdf800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T10:48:17.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:17.358+0000 7f4147b777c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T10:48:20.516 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T10:48:20.572 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:20.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:20.662+0000 7fce51b3f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T10:48:20.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:20.666+0000 7fce51b3f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T10:48:20.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:20.666+0000 7fce51b3f7c0 -1 bdev(0x560894f3d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T10:48:20.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:48:20.666+0000 7fce51b3f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T10:48:23.790 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T10:48:23.845 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T10:48:23.860 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:23.860 INFO:tasks.ceph:role: osd.4 2024-09-14T10:48:23.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T10:48:23.860 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:48:23.923 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:48:23.923 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:48:23.924 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:48:23.924 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:48:23.924 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:48:23.924 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:48:23.924 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:48:23.924 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:48:23.924 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:48:23.924 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:48:24.401 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-14T10:48:24.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-14T10:48:24.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T10:48:24.530 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T10:48:24.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:24.543 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:48:24.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T10:48:24.599 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:24.599 INFO:tasks.ceph:role: osd.5 2024-09-14T10:48:24.599 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T10:48:24.600 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:48:24.666 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:48:24.666 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:48:24.666 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:48:24.666 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:48:24.666 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:48:24.666 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:48:24.666 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:48:24.667 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:48:24.667 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:48:24.667 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:48:25.100 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-14T10:48:25.103 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-14T10:48:25.103 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T10:48:25.169 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T10:48:25.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:25.222 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:48:25.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T10:48:25.276 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:25.276 INFO:tasks.ceph:role: osd.6 2024-09-14T10:48:25.276 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T10:48:25.276 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:48:25.340 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:48:25.792 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-14T10:48:25.794 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-14T10:48:25.795 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T10:48:25.885 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T10:48:25.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:25.938 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:48:25.938 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T10:48:25.991 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:48:25.991 INFO:tasks.ceph:role: osd.7 2024-09-14T10:48:25.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T10:48:25.991 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:48:26.054 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:48:26.055 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:48:26.563 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-14T10:48:26.566 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-14T10:48:26.566 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T10:48:26.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T10:48:26.737 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T10:48:26.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:26.739 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:26.855 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:26.850+0000 7f996768d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T10:48:26.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:26.858+0000 7f996768d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T10:48:26.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:26.858+0000 7f996768d7c0 -1 bdev(0x55f5c50b5800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T10:48:26.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:26.858+0000 7f996768d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T10:48:30.011 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T10:48:30.025 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:30.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:30.102+0000 7ff2c6e8a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T10:48:30.106 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:30.102+0000 7ff2c6e8a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T10:48:30.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:30.102+0000 7ff2c6e8a7c0 -1 bdev(0x55674161f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T10:48:30.107 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:30.102+0000 7ff2c6e8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T10:48:33.239 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T10:48:33.294 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:33.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:33.374+0000 7f2ae06c57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T10:48:33.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:33.374+0000 7f2ae06c57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T10:48:33.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:33.374+0000 7f2ae06c57c0 -1 bdev(0x55e670815800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T10:48:33.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:33.374+0000 7f2ae06c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T10:48:36.511 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T10:48:36.568 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:36.650 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:36.646+0000 7f02aa4bb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T10:48:36.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:36.646+0000 7f02aa4bb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T10:48:36.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:36.646+0000 7f02aa4bb7c0 -1 bdev(0x557e474d5800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T10:48:36.651 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-14T10:48:36.646+0000 7f02aa4bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T10:48:39.822 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T10:48:39.876 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T10:48:39.876 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:39.876 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T10:48:39.891 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:39.891 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T10:48:39.947 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:39.947 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T10:48:40.004 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:40.004 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T10:48:40.058 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:40.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T10:48:40.111 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:40.112 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T10:48:40.125 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:40.125 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T10:48:40.179 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:40.179 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T10:48:40.234 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:40.234 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T10:48:40.286 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:40.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T10:48:40.338 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:40.338 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T10:48:40.345 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:40.345 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T10:48:40.383 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T10:48:40.384 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:48:40.388 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:48:40.429 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDnaeVmq2BXKBAAcj2Z6zLJOZCKJDDBqBRM0g== 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDqaeVmCYE9MhAAzYnCU++SBX6YwuXpvlxaIg== 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDuaeVmBMkEBRAA4FGyDSkLFQ1vWt7boVlBXQ== 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDxaeVmRYCHFRAA2sonmQSSnI8Xe/+6JkyzyA== 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQD0aeVmpCDjJxAAKvhH+TiX1iUJ8UzyflCtsg== 2024-09-14T10:48:40.430 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDnaeVmPcZAKhAAm+TAYSGLiAfe1jek4SfHaQ== 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQD6aeVmD7gGMxAA9cqXygf6CvLYc4ygzs3qZg== 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQD+aeVmT9ZeBhAA3w2dZuo4D2ZpUfooejw9xw== 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQABauVm1DN3FhAAChEDzkN3JUHN8fidSIBFZw== 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQAEauVmovTRJhAAnxxPaCWEbO2W+/fJc/bUpg== 2024-09-14T10:48:40.431 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2024-09-14T10:48:40.432 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDnaeVmF6uzLRAAtt8eNEbpfxBMj6rcmzGjYg== 2024-09-14T10:48:40.432 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2024-09-14T10:48:40.432 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDnaeVmwPtxLxAAjYM7nLFeZV7PJ7+HbcJpMQ== 2024-09-14T10:48:40.437 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2024-09-14T10:48:40.437 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDnaeVmq2BXKBAAcj2Z6zLJOZCKJDDBqBRM0g== 2024-09-14T10:48:40.437 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-09-14T10:48:40.437 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDqaeVmCYE9MhAAzYnCU++SBX6YwuXpvlxaIg== 2024-09-14T10:48:40.437 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-09-14T10:48:40.437 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDuaeVmBMkEBRAA4FGyDSkLFQ1vWt7boVlBXQ== 2024-09-14T10:48:40.437 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDxaeVmRYCHFRAA2sonmQSSnI8Xe/+6JkyzyA== 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD0aeVmpCDjJxAAKvhH+TiX1iUJ8UzyflCtsg== 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDnaeVmPcZAKhAAm+TAYSGLiAfe1jek4SfHaQ== 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD6aeVmD7gGMxAA9cqXygf6CvLYc4ygzs3qZg== 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQD+aeVmT9ZeBhAA3w2dZuo4D2ZpUfooejw9xw== 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2024-09-14T10:48:40.438 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQABauVm1DN3FhAAChEDzkN3JUHN8fidSIBFZw== 2024-09-14T10:48:40.439 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2024-09-14T10:48:40.439 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAEauVmovTRJhAAnxxPaCWEbO2W+/fJc/bUpg== 2024-09-14T10:48:40.439 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-14T10:48:40.439 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDnaeVmF6uzLRAAtt8eNEbpfxBMj6rcmzGjYg== 2024-09-14T10:48:40.439 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2024-09-14T10:48:40.439 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDnaeVmwPtxLxAAjYM7nLFeZV7PJ7+HbcJpMQ== 2024-09-14T10:48:40.440 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:48:40.477 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:48:40.531 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.565 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.617 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.648 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.699 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.733 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.784 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.816 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.871 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:48:40.900 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:48:40.961 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:40.984 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:41.028 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:41.068 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:41.109 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:41.154 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:41.194 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:41.237 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:48:41.277 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:48:41.322 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:48:41.368 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:48:41.412 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:48:41.458 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T10:48:41.459 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T10:48:41.517 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:48:41.612 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T10:48:41.625 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T10:48:41.678 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:48:41.767 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T10:48:41.779 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T10:48:41.793 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:48:41.893 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T10:48:41.905 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:41.907 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:48:41.953 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T10:48:41.953 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T10:48:41.953 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T10:48:41.957 INFO:tasks.ceph.mon.a:Started 2024-09-14T10:48:41.957 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T10:48:41.957 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T10:48:41.959 INFO:tasks.ceph.mon.c:Started 2024-09-14T10:48:41.960 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T10:48:41.960 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T10:48:41.996 INFO:tasks.ceph.mon.b:Started 2024-09-14T10:48:41.997 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T10:48:41.997 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T10:48:41.997 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T10:48:41.999 INFO:tasks.ceph.mgr.y:Started 2024-09-14T10:48:41.999 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T10:48:41.999 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T10:48:42.001 INFO:tasks.ceph.mgr.x:Started 2024-09-14T10:48:42.002 DEBUG:tasks.ceph:set 0 configs 2024-09-14T10:48:42.002 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T10:48:42.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T10:48:47.496 INFO:teuthology.orchestra.run.smithi148.stderr:adjusted tunables profile to default 2024-09-14T10:48:47.516 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T10:48:47.516 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T10:48:47.517 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:47.517 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T10:48:47.528 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:47.528 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T10:48:47.582 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:47.582 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T10:48:47.634 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:48:47.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T10:48:47.690 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:47.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T10:48:47.703 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:47.704 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T10:48:47.759 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:47.759 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T10:48:47.814 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-14T10:48:47.815 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T10:48:47.870 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new b2e82c10-45a6-432d-9f50-b1019e527333 0 2024-09-14T10:48:48.115 INFO:teuthology.orchestra.run.smithi150.stdout:0 2024-09-14T10:48:48.132 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 823ea616-df7b-45c8-885a-bb308020de7a 1 2024-09-14T10:48:48.335 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-14T10:48:48.352 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new cfdae3bb-c366-4e4e-809d-e907920b04b7 2 2024-09-14T10:48:48.551 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-14T10:48:48.567 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new ba89a661-d99e-48db-8dc4-80da196a3025 3 2024-09-14T10:48:48.762 INFO:teuthology.orchestra.run.smithi150.stdout:3 2024-09-14T10:48:48.779 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new c6d32910-7bab-474e-b2c4-eda6efab998d 4 2024-09-14T10:48:48.985 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-14T10:48:49.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 8b53f305-5f46-458f-b2cb-763e13c6cf59 5 2024-09-14T10:48:49.204 INFO:teuthology.orchestra.run.smithi150.stdout:5 2024-09-14T10:48:49.221 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 60979f89-421a-48c9-bef8-c0af9c69de4f 6 2024-09-14T10:48:49.426 INFO:teuthology.orchestra.run.smithi150.stdout:6 2024-09-14T10:48:49.444 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new cb6d0e67-b1ae-41ba-857d-51218c6d9f34 7 2024-09-14T10:48:49.652 INFO:teuthology.orchestra.run.smithi150.stdout:7 2024-09-14T10:48:49.670 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T10:48:49.670 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T10:48:49.672 INFO:tasks.ceph.osd.0:Started 2024-09-14T10:48:49.673 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T10:48:49.673 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T10:48:49.675 INFO:tasks.ceph.osd.1:Started 2024-09-14T10:48:49.675 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T10:48:49.675 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T10:48:49.677 INFO:tasks.ceph.osd.2:Started 2024-09-14T10:48:49.677 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T10:48:49.677 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T10:48:49.679 INFO:tasks.ceph.osd.3:Started 2024-09-14T10:48:49.679 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T10:48:49.679 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T10:48:49.681 INFO:tasks.ceph.osd.4:Started 2024-09-14T10:48:49.682 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T10:48:49.682 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T10:48:49.684 INFO:tasks.ceph.osd.5:Started 2024-09-14T10:48:49.684 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T10:48:49.684 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T10:48:49.686 INFO:tasks.ceph.osd.6:Started 2024-09-14T10:48:49.686 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T10:48:49.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T10:48:49.688 INFO:tasks.ceph.osd.7:Started 2024-09-14T10:48:49.689 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:48:49.895 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:48:49.895 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":10,"fsid":"34b25a2a-02e0-45bd-900d-fa93b60a7234","created":"2024-09-14T10:48:47.319876+0000","modified":"2024-09-14T10:48:49.663733+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:48:49.663733+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b2e82c10-45a6-432d-9f50-b1019e527333","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"823ea616-df7b-45c8-885a-bb308020de7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfdae3bb-c366-4e4e-809d-e907920b04b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba89a661-d99e-48db-8dc4-80da196a3025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c6d32910-7bab-474e-b2c4-eda6efab998d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8b53f305-5f46-458f-b2cb-763e13c6cf59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"60979f89-421a-48c9-bef8-c0af9c69de4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb6d0e67-b1ae-41ba-857d-51218c6d9f34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:48:49.911 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T10:48:49.911 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T10:48:50.291 INFO:tasks.ceph.mgr.y.smithi148.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T10:48:50.291 INFO:tasks.ceph.mgr.y.smithi148.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T10:48:50.291 INFO:tasks.ceph.mgr.y.smithi148.stderr: from numpy import show_config as show_numpy_config 2024-09-14T10:48:50.369 INFO:tasks.ceph.mgr.x.smithi150.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T10:48:50.369 INFO:tasks.ceph.mgr.x.smithi150.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T10:48:50.369 INFO:tasks.ceph.mgr.x.smithi150.stderr: from numpy import show_config as show_numpy_config 2024-09-14T10:48:50.716 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:48:50.896 INFO:teuthology.misc.health.smithi148.stdout: 2024-09-14T10:48:50.896 INFO:teuthology.misc.health.smithi148.stdout:{"epoch":10,"fsid":"34b25a2a-02e0-45bd-900d-fa93b60a7234","created":"2024-09-14T10:48:47.319876+0000","modified":"2024-09-14T10:48:49.663733+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:48:49.663733+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b2e82c10-45a6-432d-9f50-b1019e527333","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"823ea616-df7b-45c8-885a-bb308020de7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfdae3bb-c366-4e4e-809d-e907920b04b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba89a661-d99e-48db-8dc4-80da196a3025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c6d32910-7bab-474e-b2c4-eda6efab998d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8b53f305-5f46-458f-b2cb-763e13c6cf59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"60979f89-421a-48c9-bef8-c0af9c69de4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb6d0e67-b1ae-41ba-857d-51218c6d9f34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:48:50.911 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T10:48:51.132 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-14T10:48:51.129+0000 7f342d5b37c0 -1 Falling back to public interface 2024-09-14T10:48:51.312 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-14T10:48:51.309+0000 7f1bddf407c0 -1 Falling back to public interface 2024-09-14T10:48:51.349 INFO:tasks.ceph.osd.3.smithi148.stderr:2024-09-14T10:48:51.358+0000 7fb3406ed7c0 -1 Falling back to public interface 2024-09-14T10:48:51.368 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-14T10:48:51.365+0000 7f8fa5fa97c0 -1 Falling back to public interface 2024-09-14T10:48:51.369 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-14T10:48:51.365+0000 7fcb758b67c0 -1 Falling back to public interface 2024-09-14T10:48:51.653 INFO:tasks.ceph.osd.0.smithi148.stderr:2024-09-14T10:48:51.662+0000 7f09274ef7c0 -1 Falling back to public interface 2024-09-14T10:48:51.657 INFO:tasks.ceph.osd.2.smithi148.stderr:2024-09-14T10:48:51.666+0000 7f3ba8e657c0 -1 Falling back to public interface 2024-09-14T10:48:51.841 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-14T10:48:51.850+0000 7fccca8ef7c0 -1 Falling back to public interface 2024-09-14T10:48:53.212 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-09-14T10:48:53.222+0000 7fe34b518640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T10:48:53.212 INFO:tasks.ceph.mgr.y.smithi148.stderr:2024-09-14T10:48:53.222+0000 7fe34b518640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T10:48:55.193 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-14T10:48:55.189+0000 7f342d5b37c0 -1 osd.7 0 log_to_monitors true 2024-09-14T10:48:55.302 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-14T10:48:55.297+0000 7f1bddf407c0 -1 osd.5 0 log_to_monitors true 2024-09-14T10:48:55.429 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-14T10:48:55.425+0000 7f8fa5fa97c0 -1 osd.6 0 log_to_monitors true 2024-09-14T10:48:55.473 INFO:tasks.ceph.osd.3.smithi148.stderr:2024-09-14T10:48:55.482+0000 7fb3406ed7c0 -1 osd.3 0 log_to_monitors true 2024-09-14T10:48:55.670 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-14T10:48:55.661+0000 7fcb758b67c0 -1 osd.4 0 log_to_monitors true 2024-09-14T10:48:55.754 INFO:tasks.ceph.osd.2.smithi148.stderr:2024-09-14T10:48:55.762+0000 7f3ba8e657c0 -1 osd.2 0 log_to_monitors true 2024-09-14T10:48:55.891 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-14T10:48:55.902+0000 7fccca8ef7c0 -1 osd.1 0 log_to_monitors true 2024-09-14T10:48:56.217 INFO:tasks.ceph.osd.0.smithi148.stderr:2024-09-14T10:48:56.226+0000 7f09274ef7c0 -1 osd.0 0 log_to_monitors true 2024-09-14T10:48:57.221 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-14T10:48:57.217+0000 7f342955c640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T10:48:57.258 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-14T10:48:57.253+0000 7f342138e640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:48:57.719 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:48:58.075 INFO:teuthology.misc.health.smithi148.stdout: 2024-09-14T10:48:58.075 INFO:teuthology.misc.health.smithi148.stdout:{"epoch":13,"fsid":"34b25a2a-02e0-45bd-900d-fa93b60a7234","created":"2024-09-14T10:48:47.319876+0000","modified":"2024-09-14T10:48:57.234467+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:48:49.663733+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b2e82c10-45a6-432d-9f50-b1019e527333","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"823ea616-df7b-45c8-885a-bb308020de7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cfdae3bb-c366-4e4e-809d-e907920b04b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ba89a661-d99e-48db-8dc4-80da196a3025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c6d32910-7bab-474e-b2c4-eda6efab998d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8b53f305-5f46-458f-b2cb-763e13c6cf59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"60979f89-421a-48c9-bef8-c0af9c69de4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb6d0e67-b1ae-41ba-857d-51218c6d9f34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:48:58.093 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T10:48:58.940 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-14T10:48:58.937+0000 7f1bda6fb640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T10:48:58.957 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-14T10:48:58.953+0000 7f8fa2764640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T10:48:58.963 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-14T10:48:58.961+0000 7f1bd1d1b640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:48:58.977 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-14T10:48:58.973+0000 7fcb72071640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T10:48:58.979 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-14T10:48:58.977+0000 7f8f99d84640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:48:58.999 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-14T10:48:58.997+0000 7fcb69691640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:48:59.035 INFO:tasks.ceph.osd.3.smithi148.stderr:2024-09-14T10:48:59.042+0000 7fb33c696640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T10:48:59.063 INFO:tasks.ceph.osd.3.smithi148.stderr:2024-09-14T10:48:59.074+0000 7fb3344c8640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:48:59.092 INFO:tasks.ceph.osd.2.smithi148.stderr:2024-09-14T10:48:59.102+0000 7f3ba4e0e640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T10:48:59.120 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-14T10:48:59.130+0000 7fccc70aa640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T10:48:59.128 INFO:tasks.ceph.osd.2.smithi148.stderr:2024-09-14T10:48:59.138+0000 7f3b9cc40640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:48:59.148 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-14T10:48:59.158+0000 7fccbe6ca640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:48:59.484 INFO:tasks.ceph.osd.0.smithi148.stderr:2024-09-14T10:48:59.494+0000 7f0923498640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T10:48:59.503 INFO:tasks.ceph.osd.0.smithi148.stderr:2024-09-14T10:48:59.514+0000 7f091b2ca640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:49:04.900 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:49:05.204 INFO:teuthology.misc.health.smithi148.stdout: 2024-09-14T10:49:05.205 INFO:teuthology.misc.health.smithi148.stdout:{"epoch":18,"fsid":"34b25a2a-02e0-45bd-900d-fa93b60a7234","created":"2024-09-14T10:48:47.319876+0000","modified":"2024-09-14T10:49:02.988814+0000","last_up_change":"2024-09-14T10:48:59.975400+0000","last_in_change":"2024-09-14T10:48:49.663733+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:49:00.253091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b2e82c10-45a6-432d-9f50-b1019e527333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6809","nonce":1063069618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6811","nonce":1063069618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6815","nonce":1063069618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6813","nonce":1063069618}]},"public_addr":"172.21.15.148:6809/1063069618","cluster_addr":"172.21.15.148:6811/1063069618","heartbeat_back_addr":"172.21.15.148:6815/1063069618","heartbeat_front_addr":"172.21.15.148:6813/1063069618","state":["exists","up"]},{"osd":1,"uuid":"823ea616-df7b-45c8-885a-bb308020de7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6825","nonce":1289265320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6827","nonce":1289265320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6831","nonce":1289265320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6829","nonce":1289265320}]},"public_addr":"172.21.15.148:6825/1289265320","cluster_addr":"172.21.15.148:6827/1289265320","heartbeat_back_addr":"172.21.15.148:6831/1289265320","heartbeat_front_addr":"172.21.15.148:6829/1289265320","state":["exists","up"]},{"osd":2,"uuid":"cfdae3bb-c366-4e4e-809d-e907920b04b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6817","nonce":2601521059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6819","nonce":2601521059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6823","nonce":2601521059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6821","nonce":2601521059}]},"public_addr":"172.21.15.148:6817/2601521059","cluster_addr":"172.21.15.148:6819/2601521059","heartbeat_back_addr":"172.21.15.148:6823/2601521059","heartbeat_front_addr":"172.21.15.148:6821/2601521059","state":["exists","up"]},{"osd":3,"uuid":"ba89a661-d99e-48db-8dc4-80da196a3025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6801","nonce":2615370688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6803","nonce":2615370688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6807","nonce":2615370688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6805","nonce":2615370688}]},"public_addr":"172.21.15.148:6801/2615370688","cluster_addr":"172.21.15.148:6803/2615370688","heartbeat_back_addr":"172.21.15.148:6807/2615370688","heartbeat_front_addr":"172.21.15.148:6805/2615370688","state":["exists","up"]},{"osd":4,"uuid":"c6d32910-7bab-474e-b2c4-eda6efab998d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6818","nonce":485011589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6821","nonce":485011589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6828","nonce":485011589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6824","nonce":485011589}]},"public_addr":"172.21.15.150:6818/485011589","cluster_addr":"172.21.15.150:6821/485011589","heartbeat_back_addr":"172.21.15.150:6828/485011589","heartbeat_front_addr":"172.21.15.150:6824/485011589","state":["exists","up"]},{"osd":5,"uuid":"8b53f305-5f46-458f-b2cb-763e13c6cf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6809","nonce":3664436114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6811","nonce":3664436114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6815","nonce":3664436114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6813","nonce":3664436114}]},"public_addr":"172.21.15.150:6809/3664436114","cluster_addr":"172.21.15.150:6811/3664436114","heartbeat_back_addr":"172.21.15.150:6815/3664436114","heartbeat_front_addr":"172.21.15.150:6813/3664436114","state":["exists","up"]},{"osd":6,"uuid":"60979f89-421a-48c9-bef8-c0af9c69de4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6820","nonce":2245691891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6825","nonce":2245691891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6831","nonce":2245691891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6827","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6829","nonce":2245691891}]},"public_addr":"172.21.15.150:6820/2245691891","cluster_addr":"172.21.15.150:6825/2245691891","heartbeat_back_addr":"172.21.15.150:6831/2245691891","heartbeat_front_addr":"172.21.15.150:6829/2245691891","state":["exists","up"]},{"osd":7,"uuid":"cb6d0e67-b1ae-41ba-857d-51218c6d9f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6801","nonce":2640697978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6803","nonce":2640697978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6807","nonce":2640697978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6805","nonce":2640697978}]},"public_addr":"172.21.15.150:6801/2640697978","cluster_addr":"172.21.15.150:6803/2640697978","heartbeat_back_addr":"172.21.15.150:6807/2640697978","heartbeat_front_addr":"172.21.15.150:6805/2640697978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:57.228068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.926531+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.755911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.529954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.630254+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.291404+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.434473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.211132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:49:05.222 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T10:49:05.222 INFO:tasks.ceph:Creating RBD pool 2024-09-14T10:49:05.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T10:49:06.003 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'rbd' created 2024-09-14T10:49:06.026 DEBUG:teuthology.orchestra.run.smithi148:> rbd --cluster ceph pool init rbd 2024-09-14T10:49:06.066 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:06.066 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:09.064 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T10:49:09.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T10:49:09.066 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T10:49:09.421 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:49:09.439 INFO:teuthology.orchestra.run.smithi148.stdout:[{"version":9,"timestamp":"2024-09-14T10:48:59.499554+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"6240.120589"}]}] 2024-09-14T10:49:09.439 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T10:49:09.439 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T10:49:09.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T10:49:09.439 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T10:49:09.774 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:49:09.791 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1759264388},{"type":"v1","addr":"172.21.15.148:6833","nonce":1759264388}]},"active_addr":"172.21.15.148:6833/1759264388","active_change":"2024-09-14T10:48:52.203515+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":2254866277}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3742793355}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":331280536}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1370654993}]}]} 2024-09-14T10:49:09.795 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T10:49:09.795 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T10:49:09.795 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:49:10.088 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:49:10.088 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"34b25a2a-02e0-45bd-900d-fa93b60a7234","created":"2024-09-14T10:48:47.319876+0000","modified":"2024-09-14T10:49:09.039270+0000","last_up_change":"2024-09-14T10:48:59.975400+0000","last_in_change":"2024-09-14T10:48:49.663733+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:49:00.253091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:49:05.544895+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b2e82c10-45a6-432d-9f50-b1019e527333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6809","nonce":1063069618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6811","nonce":1063069618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6815","nonce":1063069618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6813","nonce":1063069618}]},"public_addr":"172.21.15.148:6809/1063069618","cluster_addr":"172.21.15.148:6811/1063069618","heartbeat_back_addr":"172.21.15.148:6815/1063069618","heartbeat_front_addr":"172.21.15.148:6813/1063069618","state":["exists","up"]},{"osd":1,"uuid":"823ea616-df7b-45c8-885a-bb308020de7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6825","nonce":1289265320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6827","nonce":1289265320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6831","nonce":1289265320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6829","nonce":1289265320}]},"public_addr":"172.21.15.148:6825/1289265320","cluster_addr":"172.21.15.148:6827/1289265320","heartbeat_back_addr":"172.21.15.148:6831/1289265320","heartbeat_front_addr":"172.21.15.148:6829/1289265320","state":["exists","up"]},{"osd":2,"uuid":"cfdae3bb-c366-4e4e-809d-e907920b04b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6817","nonce":2601521059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6819","nonce":2601521059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6823","nonce":2601521059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6821","nonce":2601521059}]},"public_addr":"172.21.15.148:6817/2601521059","cluster_addr":"172.21.15.148:6819/2601521059","heartbeat_back_addr":"172.21.15.148:6823/2601521059","heartbeat_front_addr":"172.21.15.148:6821/2601521059","state":["exists","up"]},{"osd":3,"uuid":"ba89a661-d99e-48db-8dc4-80da196a3025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6801","nonce":2615370688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6803","nonce":2615370688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6807","nonce":2615370688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6805","nonce":2615370688}]},"public_addr":"172.21.15.148:6801/2615370688","cluster_addr":"172.21.15.148:6803/2615370688","heartbeat_back_addr":"172.21.15.148:6807/2615370688","heartbeat_front_addr":"172.21.15.148:6805/2615370688","state":["exists","up"]},{"osd":4,"uuid":"c6d32910-7bab-474e-b2c4-eda6efab998d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6818","nonce":485011589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6821","nonce":485011589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6828","nonce":485011589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6824","nonce":485011589}]},"public_addr":"172.21.15.150:6818/485011589","cluster_addr":"172.21.15.150:6821/485011589","heartbeat_back_addr":"172.21.15.150:6828/485011589","heartbeat_front_addr":"172.21.15.150:6824/485011589","state":["exists","up"]},{"osd":5,"uuid":"8b53f305-5f46-458f-b2cb-763e13c6cf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6809","nonce":3664436114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6811","nonce":3664436114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6815","nonce":3664436114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6813","nonce":3664436114}]},"public_addr":"172.21.15.150:6809/3664436114","cluster_addr":"172.21.15.150:6811/3664436114","heartbeat_back_addr":"172.21.15.150:6815/3664436114","heartbeat_front_addr":"172.21.15.150:6813/3664436114","state":["exists","up"]},{"osd":6,"uuid":"60979f89-421a-48c9-bef8-c0af9c69de4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6820","nonce":2245691891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6825","nonce":2245691891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6831","nonce":2245691891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6827","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6829","nonce":2245691891}]},"public_addr":"172.21.15.150:6820/2245691891","cluster_addr":"172.21.15.150:6825/2245691891","heartbeat_back_addr":"172.21.15.150:6831/2245691891","heartbeat_front_addr":"172.21.15.150:6829/2245691891","state":["exists","up"]},{"osd":7,"uuid":"cb6d0e67-b1ae-41ba-857d-51218c6d9f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6801","nonce":2640697978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6803","nonce":2640697978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6807","nonce":2640697978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6805","nonce":2640697978}]},"public_addr":"172.21.15.150:6801/2640697978","cluster_addr":"172.21.15.150:6803/2640697978","heartbeat_back_addr":"172.21.15.150:6807/2640697978","heartbeat_front_addr":"172.21.15.150:6805/2640697978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:57.228068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.926531+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.755911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.529954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.630254+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.291404+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.434473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.211132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:49:10.107 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T10:49:10.107 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:49:10.410 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:49:10.410 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"fsid":"34b25a2a-02e0-45bd-900d-fa93b60a7234","created":"2024-09-14T10:48:47.319876+0000","modified":"2024-09-14T10:49:09.039270+0000","last_up_change":"2024-09-14T10:48:59.975400+0000","last_in_change":"2024-09-14T10:48:49.663733+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:49:00.253091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:49:05.544895+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b2e82c10-45a6-432d-9f50-b1019e527333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6809","nonce":1063069618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6811","nonce":1063069618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6815","nonce":1063069618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6813","nonce":1063069618}]},"public_addr":"172.21.15.148:6809/1063069618","cluster_addr":"172.21.15.148:6811/1063069618","heartbeat_back_addr":"172.21.15.148:6815/1063069618","heartbeat_front_addr":"172.21.15.148:6813/1063069618","state":["exists","up"]},{"osd":1,"uuid":"823ea616-df7b-45c8-885a-bb308020de7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6825","nonce":1289265320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6827","nonce":1289265320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6831","nonce":1289265320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6829","nonce":1289265320}]},"public_addr":"172.21.15.148:6825/1289265320","cluster_addr":"172.21.15.148:6827/1289265320","heartbeat_back_addr":"172.21.15.148:6831/1289265320","heartbeat_front_addr":"172.21.15.148:6829/1289265320","state":["exists","up"]},{"osd":2,"uuid":"cfdae3bb-c366-4e4e-809d-e907920b04b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6817","nonce":2601521059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6819","nonce":2601521059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6823","nonce":2601521059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6821","nonce":2601521059}]},"public_addr":"172.21.15.148:6817/2601521059","cluster_addr":"172.21.15.148:6819/2601521059","heartbeat_back_addr":"172.21.15.148:6823/2601521059","heartbeat_front_addr":"172.21.15.148:6821/2601521059","state":["exists","up"]},{"osd":3,"uuid":"ba89a661-d99e-48db-8dc4-80da196a3025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6801","nonce":2615370688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6803","nonce":2615370688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6807","nonce":2615370688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6805","nonce":2615370688}]},"public_addr":"172.21.15.148:6801/2615370688","cluster_addr":"172.21.15.148:6803/2615370688","heartbeat_back_addr":"172.21.15.148:6807/2615370688","heartbeat_front_addr":"172.21.15.148:6805/2615370688","state":["exists","up"]},{"osd":4,"uuid":"c6d32910-7bab-474e-b2c4-eda6efab998d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6818","nonce":485011589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6821","nonce":485011589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6828","nonce":485011589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6824","nonce":485011589}]},"public_addr":"172.21.15.150:6818/485011589","cluster_addr":"172.21.15.150:6821/485011589","heartbeat_back_addr":"172.21.15.150:6828/485011589","heartbeat_front_addr":"172.21.15.150:6824/485011589","state":["exists","up"]},{"osd":5,"uuid":"8b53f305-5f46-458f-b2cb-763e13c6cf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6809","nonce":3664436114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6811","nonce":3664436114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6815","nonce":3664436114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6813","nonce":3664436114}]},"public_addr":"172.21.15.150:6809/3664436114","cluster_addr":"172.21.15.150:6811/3664436114","heartbeat_back_addr":"172.21.15.150:6815/3664436114","heartbeat_front_addr":"172.21.15.150:6813/3664436114","state":["exists","up"]},{"osd":6,"uuid":"60979f89-421a-48c9-bef8-c0af9c69de4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6820","nonce":2245691891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6825","nonce":2245691891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6831","nonce":2245691891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6827","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6829","nonce":2245691891}]},"public_addr":"172.21.15.150:6820/2245691891","cluster_addr":"172.21.15.150:6825/2245691891","heartbeat_back_addr":"172.21.15.150:6831/2245691891","heartbeat_front_addr":"172.21.15.150:6829/2245691891","state":["exists","up"]},{"osd":7,"uuid":"cb6d0e67-b1ae-41ba-857d-51218c6d9f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6801","nonce":2640697978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6803","nonce":2640697978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6807","nonce":2640697978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6805","nonce":2640697978}]},"public_addr":"172.21.15.150:6801/2640697978","cluster_addr":"172.21.15.150:6803/2640697978","heartbeat_back_addr":"172.21.15.150:6807/2640697978","heartbeat_front_addr":"172.21.15.150:6805/2640697978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:57.228068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.926531+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.755911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.529954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.630254+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.291404+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.434473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.211132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:49:10.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T10:49:10.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T10:49:10.430 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T10:49:10.430 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T10:49:10.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T10:49:10.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T10:49:10.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T10:49:10.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T10:49:10.683 INFO:teuthology.orchestra.run.smithi148.stdout:60129542151 2024-09-14T10:49:10.684 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:49:10.698 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:10.698 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:49:10.701 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:10.701 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:49:10.703 INFO:teuthology.orchestra.run.smithi148.stdout:64424509447 2024-09-14T10:49:10.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:49:10.709 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:10.710 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:49:10.711 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:10.711 INFO:teuthology.orchestra.run.smithi148.stdout:64424509446 2024-09-14T10:49:10.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:49:10.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:49:10.720 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:10.720 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:49:11.222 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:11.230 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:11.230 INFO:teuthology.orchestra.run.smithi148.stdout:60129542150 2024-09-14T10:49:11.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-14T10:49:11.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-09-14T10:49:11.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-14T10:49:11.264 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:11.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.4 2024-09-14T10:49:11.283 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:11.285 INFO:teuthology.orchestra.run.smithi148.stdout:64424509444 2024-09-14T10:49:11.292 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:11.304 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:11.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-14T10:49:11.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-14T10:49:11.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-14T10:49:11.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-14T10:49:12.254 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:49:12.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:49:12.263 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:49:12.283 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:49:12.309 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:49:12.309 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:49:12.320 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:49:12.325 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:49:12.778 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:12.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-14T10:49:12.841 INFO:teuthology.orchestra.run.smithi148.stdout:64424509444 2024-09-14T10:49:12.842 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:12.846 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:12.847 INFO:teuthology.orchestra.run.smithi148.stdout:60129542150 2024-09-14T10:49:12.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-14T10:49:12.877 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:12.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.5 2024-09-14T10:49:12.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.4 2024-09-14T10:49:12.884 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:12.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-09-14T10:49:12.896 INFO:teuthology.orchestra.run.smithi148.stdout:64424509443 2024-09-14T10:49:12.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-14T10:49:12.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-14T10:49:12.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-14T10:49:13.806 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:49:13.868 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:49:13.879 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:49:13.880 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:49:13.886 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:49:13.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:49:13.905 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:49:13.915 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:49:14.346 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:14.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-14T10:49:14.372 DEBUG:teuthology.parallel:result is None 2024-09-14T10:49:14.388 INFO:teuthology.orchestra.run.smithi148.stdout:64424509446 2024-09-14T10:49:14.409 INFO:teuthology.orchestra.run.smithi148.stdout:64424509447 2024-09-14T10:49:14.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-14T10:49:14.414 DEBUG:teuthology.parallel:result is None 2024-09-14T10:49:14.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-09-14T10:49:14.427 DEBUG:teuthology.parallel:result is None 2024-09-14T10:49:14.450 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:14.455 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:14.462 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:14.472 INFO:teuthology.orchestra.run.smithi148.stdout:60129542151 2024-09-14T10:49:14.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-14T10:49:14.473 DEBUG:teuthology.parallel:result is None 2024-09-14T10:49:14.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-09-14T10:49:14.478 DEBUG:teuthology.parallel:result is None 2024-09-14T10:49:14.485 INFO:teuthology.orchestra.run.smithi148.stdout:64424509445 2024-09-14T10:49:14.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.5 2024-09-14T10:49:14.487 DEBUG:teuthology.parallel:result is None 2024-09-14T10:49:14.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-14T10:49:14.493 DEBUG:teuthology.parallel:result is None 2024-09-14T10:49:14.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-14T10:49:14.505 DEBUG:teuthology.parallel:result is None 2024-09-14T10:49:14.506 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:49:14.506 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:49:14.825 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:49:14.826 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T10:49:14.842 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T10:49:14.216366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227480,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747240,"statfs":{"total":773094113280,"available":772861173760,"internally_reserved":0,"allocated":2965504,"data_stored":1781654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.198352"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.054207+0000","last_change":"2024-09-14T10:49:09.054207+0000","last_active":"2024-09-14T10:49:09.054207+0000","last_peered":"2024-09-14T10:49:09.054207+0000","last_clean":"2024-09-14T10:49:09.054207+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T10:49:09.054207+0000","last_undegraded":"2024-09-14T10:49:09.054207+0000","last_fullsized":"2024-09-14T10:49:09.054207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.696418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.044027+0000","last_change":"2024-09-14T10:49:09.044027+0000","last_active":"2024-09-14T10:49:09.044027+0000","last_peered":"2024-09-14T10:49:09.044027+0000","last_clean":"2024-09-14T10:49:09.044027+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T10:49:09.044027+0000","last_undegraded":"2024-09-14T10:49:09.044027+0000","last_fullsized":"2024-09-14T10:49:09.044027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:42.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.053478+0000","last_change":"2024-09-14T10:49:09.053478+0000","last_active":"2024-09-14T10:49:09.053478+0000","last_peered":"2024-09-14T10:49:09.053478+0000","last_clean":"2024-09-14T10:49:09.053478+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T10:49:09.053478+0000","last_undegraded":"2024-09-14T10:49:09.053478+0000","last_fullsized":"2024-09-14T10:49:09.053478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.160900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.318418+0000","last_change":"2024-09-14T10:49:09.318418+0000","last_active":"2024-09-14T10:49:09.318418+0000","last_peered":"2024-09-14T10:49:09.318418+0000","last_clean":"2024-09-14T10:49:09.318418+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T10:49:09.318418+0000","last_undegraded":"2024-09-14T10:49:09.318418+0000","last_fullsized":"2024-09-14T10:49:09.318418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:16.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.058857+0000","last_change":"2024-09-14T10:49:09.053071+0000","last_active":"2024-09-14T10:49:09.058857+0000","last_peered":"2024-09-14T10:49:09.058857+0000","last_clean":"2024-09-14T10:49:09.058857+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T10:49:09.058857+0000","last_undegraded":"2024-09-14T10:49:09.058857+0000","last_fullsized":"2024-09-14T10:49:09.058857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:51.730662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.482109+0000","last_change":"2024-09-14T10:49:09.482540+0000","last_active":"2024-09-14T10:49:09.482109+0000","last_peered":"2024-09-14T10:49:09.482109+0000","last_clean":"2024-09-14T10:49:09.482109+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T10:49:09.482109+0000","last_undegraded":"2024-09-14T10:49:09.482109+0000","last_fullsized":"2024-09-14T10:49:09.482109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:28.426232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.052857+0000","last_change":"2024-09-14T10:49:09.052857+0000","last_active":"2024-09-14T10:49:09.052857+0000","last_peered":"2024-09-14T10:49:09.052857+0000","last_clean":"2024-09-14T10:49:09.052857+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T10:49:09.052857+0000","last_undegraded":"2024-09-14T10:49:09.052857+0000","last_fullsized":"2024-09-14T10:49:09.052857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.713061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.053703+0000","last_change":"2024-09-14T10:49:09.053703+0000","last_active":"2024-09-14T10:49:09.053703+0000","last_peered":"2024-09-14T10:49:09.053703+0000","last_clean":"2024-09-14T10:49:09.053703+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T10:49:09.053703+0000","last_undegraded":"2024-09-14T10:49:09.053703+0000","last_fullsized":"2024-09-14T10:49:09.053703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:01.458375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.493148+0000","last_change":"2024-09-14T10:49:02.305650+0000","last_active":"2024-09-14T10:49:09.493148+0000","last_peered":"2024-09-14T10:49:09.493148+0000","last_clean":"2024-09-14T10:49:09.493148+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T10:49:09.493148+0000","last_undegraded":"2024-09-14T10:49:09.493148+0000","last_fullsized":"2024-09-14T10:49:09.493148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_clean_scrub_stamp":"2024-09-14T10:49:00.978700+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:28.964363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":665478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":665478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:49:14.844 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:49:15.124 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:49:15.124 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T10:49:15.141 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T10:49:14.216366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227480,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747240,"statfs":{"total":773094113280,"available":772861173760,"internally_reserved":0,"allocated":2965504,"data_stored":1781654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.198352"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.054207+0000","last_change":"2024-09-14T10:49:09.054207+0000","last_active":"2024-09-14T10:49:09.054207+0000","last_peered":"2024-09-14T10:49:09.054207+0000","last_clean":"2024-09-14T10:49:09.054207+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T10:49:09.054207+0000","last_undegraded":"2024-09-14T10:49:09.054207+0000","last_fullsized":"2024-09-14T10:49:09.054207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.696418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.044027+0000","last_change":"2024-09-14T10:49:09.044027+0000","last_active":"2024-09-14T10:49:09.044027+0000","last_peered":"2024-09-14T10:49:09.044027+0000","last_clean":"2024-09-14T10:49:09.044027+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T10:49:09.044027+0000","last_undegraded":"2024-09-14T10:49:09.044027+0000","last_fullsized":"2024-09-14T10:49:09.044027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:42.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.053478+0000","last_change":"2024-09-14T10:49:09.053478+0000","last_active":"2024-09-14T10:49:09.053478+0000","last_peered":"2024-09-14T10:49:09.053478+0000","last_clean":"2024-09-14T10:49:09.053478+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T10:49:09.053478+0000","last_undegraded":"2024-09-14T10:49:09.053478+0000","last_fullsized":"2024-09-14T10:49:09.053478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.160900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.318418+0000","last_change":"2024-09-14T10:49:09.318418+0000","last_active":"2024-09-14T10:49:09.318418+0000","last_peered":"2024-09-14T10:49:09.318418+0000","last_clean":"2024-09-14T10:49:09.318418+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T10:49:09.318418+0000","last_undegraded":"2024-09-14T10:49:09.318418+0000","last_fullsized":"2024-09-14T10:49:09.318418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:16.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.058857+0000","last_change":"2024-09-14T10:49:09.053071+0000","last_active":"2024-09-14T10:49:09.058857+0000","last_peered":"2024-09-14T10:49:09.058857+0000","last_clean":"2024-09-14T10:49:09.058857+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T10:49:09.058857+0000","last_undegraded":"2024-09-14T10:49:09.058857+0000","last_fullsized":"2024-09-14T10:49:09.058857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:51.730662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.482109+0000","last_change":"2024-09-14T10:49:09.482540+0000","last_active":"2024-09-14T10:49:09.482109+0000","last_peered":"2024-09-14T10:49:09.482109+0000","last_clean":"2024-09-14T10:49:09.482109+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T10:49:09.482109+0000","last_undegraded":"2024-09-14T10:49:09.482109+0000","last_fullsized":"2024-09-14T10:49:09.482109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:28.426232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.052857+0000","last_change":"2024-09-14T10:49:09.052857+0000","last_active":"2024-09-14T10:49:09.052857+0000","last_peered":"2024-09-14T10:49:09.052857+0000","last_clean":"2024-09-14T10:49:09.052857+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T10:49:09.052857+0000","last_undegraded":"2024-09-14T10:49:09.052857+0000","last_fullsized":"2024-09-14T10:49:09.052857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.713061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.053703+0000","last_change":"2024-09-14T10:49:09.053703+0000","last_active":"2024-09-14T10:49:09.053703+0000","last_peered":"2024-09-14T10:49:09.053703+0000","last_clean":"2024-09-14T10:49:09.053703+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T10:49:09.053703+0000","last_undegraded":"2024-09-14T10:49:09.053703+0000","last_fullsized":"2024-09-14T10:49:09.053703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:01.458375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:49:09.493148+0000","last_change":"2024-09-14T10:49:02.305650+0000","last_active":"2024-09-14T10:49:09.493148+0000","last_peered":"2024-09-14T10:49:09.493148+0000","last_clean":"2024-09-14T10:49:09.493148+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T10:49:09.493148+0000","last_undegraded":"2024-09-14T10:49:09.493148+0000","last_fullsized":"2024-09-14T10:49:09.493148+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_clean_scrub_stamp":"2024-09-14T10:49:00.978700+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:28.964363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":665478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":665478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":75110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:49:15.142 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:49:15.142 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T10:49:15.142 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T10:49:15.142 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T10:49:15.458 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:49:15.459 INFO:teuthology.orchestra.run.smithi148.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T10:49:15.476 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T10:49:15.476 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T10:49:15.489 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-14T10:49:15.489 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T10:49:15.494 DEBUG:teuthology.orchestra.run.smithi148:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-14T10:49:16.032 INFO:teuthology.orchestra.run.smithi148.stderr:..+.............+.........+.........+...........+.+..+...+.........+.+...+............+..+.+...............+.....+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*................+...+......+.+............+............+.....+.............+........+...+.+...+...........+........................+.............+........+.........+.+..+....+...........+............+.+...........+.+.........+.....+...+.+.....+.+......+..+...+.........+.+..............+...+..........+......+......+...........+.......+...+........+.+.........+...........+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T10:49:16.945 INFO:teuthology.orchestra.run.smithi148.stderr:....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.....+......+...............+....+..+....+...+.....+......+....+.....+............+.+........+....+...........+.+......+...............+..+.......+...........+....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+....+..+............+.+......+....................+......+....+.....+.+.....+...+....+...........+........................+......+.+...+...........+.+.....+..........+.........+.....+.+........+......+......+....+.........+.....+.......+..................+......+......+...+.....+......+.+......+...+.....+.......+..+......+....+...+...+..+.............+.........+........+....+.......................+.......+...........+...............+....+.....+......+.......+..............................+........+...+.........+............+......+...+......+.........+..........+............+..............+.........+.+......+.....+....+........+.+..............+.+..............+...+...............+...............+.........+....+..+...+.......+.....+.......+..+........................+....+..+...+............+......+.......+...+..+..................+....+........+.+...........+...................+.....+......+.............+...............+....................+.............+..+...............................+.................+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T10:49:16.960 INFO:teuthology.orchestra.run.smithi148.stderr:----- 2024-09-14T10:49:16.968 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-14T10:49:17.035 DEBUG:teuthology.orchestra.run.smithi148:> sudo update-ca-certificates 2024-09-14T10:49:17.094 INFO:teuthology.orchestra.run.smithi148.stdout:Updating certificates in /etc/ssl/certs... 2024-09-14T10:49:17.733 INFO:teuthology.orchestra.run.smithi148.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-14T10:49:17.753 INFO:teuthology.orchestra.run.smithi148.stdout:1 added, 0 removed; done. 2024-09-14T10:49:17.755 INFO:teuthology.orchestra.run.smithi148.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-14T10:49:17.759 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T10:49:19.384 INFO:teuthology.orchestra.run.smithi148.stdout:Adding debian:root.pem 2024-09-14T10:49:19.399 INFO:teuthology.orchestra.run.smithi148.stdout:done. 2024-09-14T10:49:19.399 INFO:teuthology.orchestra.run.smithi148.stdout:done. 2024-09-14T10:49:19.403 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T10:49:19.450 DEBUG:teuthology.orchestra.run.smithi148:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi148.front.sepia.ceph.com 2024-09-14T10:49:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:..+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.....+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+.+.....+.+.....+...+.......+...+..+.+............+..+...+...+.......+......+......+...+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T10:49:19.614 INFO:teuthology.orchestra.run.smithi148.stderr:......+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+...+.........+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.+.....+....+.....+.....................+...+....+..+......+..................+.+...+......+..+..........+..+.+......+.....+.............+...+.....+..........+........+....+..+.+..+...............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T10:49:19.617 INFO:teuthology.orchestra.run.smithi148.stderr:----- 2024-09-14T10:49:19.620 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:49:19.620 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:49:19.666 DEBUG:teuthology.orchestra.run.smithi148:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:49:19.717 INFO:teuthology.orchestra.run.smithi148.stderr:Certificate request self-signature ok 2024-09-14T10:49:19.717 INFO:teuthology.orchestra.run.smithi148.stderr:subject=CN = smithi148.front.sepia.ceph.com 2024-09-14T10:49:19.729 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:49:19.778 DEBUG:teuthology.orchestra.run.smithi148:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T10:49:19.830 INFO:teuthology.orchestra.run.smithi148.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-14T10:49:19.830 DEBUG:teuthology.orchestra.run.smithi148:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T10:49:19.880 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T10:49:19.894 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-14T10:49:19.894 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T10:49:19.894 INFO:tasks.rgw:Creating data pools 2024-09-14T10:49:19.894 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T10:49:19.895 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-14T10:49:20.302 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T10:49:22.299 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T10:49:22.338 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T10:49:23.302 INFO:teuthology.orchestra.run.smithi148.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T10:49:23.353 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T10:49:24.330 INFO:teuthology.orchestra.run.smithi148.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T10:49:24.368 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T10:49:25.350 INFO:teuthology.orchestra.run.smithi148.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T10:49:25.393 DEBUG:tasks.rgw:Pools created 2024-09-14T10:49:25.393 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T10:49:25.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:49:25.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:49:25.394 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:49:25.443 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:25.443 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:27.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.653+0000 7f7521c50640 0 -- 172.21.15.148:0/3519605756 >> [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] conn(0x7f73f40717b0 msgr2=0x7f73f4073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:49:27.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.657+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.657+0000 7f752144f640 0 -- 172.21.15.148:0/4287899920 >> [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] conn(0x7f73e80718a0 msgr2=0x7f73e8073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:49:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 realm 2024-09-14T10:49:27.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:27.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:27.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:49:27.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.661+0000 7f75239499c0 20 searching for the correct realm 2024-09-14T10:49:27.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:27.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:49:27.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:27.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:27.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:27.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:49:27.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:27.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:27.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.681+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 20 zone default found 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 4 Realm: () 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 20 zonegroup default 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:27.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:27.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:27.685+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:29.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:29.396+0000 7f75239499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:29.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:29.396+0000 7f75239499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:29.396+0000 7f75239499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:29.396+0000 7f75239499c0 20 started sync module instance, tier type = 2024-09-14T10:49:29.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:29.396+0000 7f75239499c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:49:31.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.452+0000 7f75239499c0 20 add_watcher() i=0 2024-09-14T10:49:31.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.452+0000 7f75239499c0 20 add_watcher() i=1 2024-09-14T10:49:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.452+0000 7f75239499c0 20 add_watcher() i=2 2024-09-14T10:49:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.452+0000 7f75239499c0 20 add_watcher() i=3 2024-09-14T10:49:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.452+0000 7f75239499c0 20 add_watcher() i=4 2024-09-14T10:49:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.452+0000 7f75239499c0 20 add_watcher() i=5 2024-09-14T10:49:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.452+0000 7f75239499c0 20 add_watcher() i=6 2024-09-14T10:49:31.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 add_watcher() i=7 2024-09-14T10:49:31.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:31.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T10:49:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T10:49:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T10:49:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T10:49:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T10:49:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T10:49:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.456+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T10:49:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T10:49:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T10:49:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T10:49:31.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T10:49:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T10:49:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T10:49:31.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T10:49:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T10:49:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T10:49:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T10:49:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T10:49:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T10:49:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T10:49:31.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.460+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T10:49:31.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T10:49:31.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T10:49:31.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T10:49:31.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T10:49:31.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T10:49:31.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T10:49:31.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T10:49:31.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T10:49:31.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T10:49:31.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T10:49:31.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T10:49:31.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.464+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T10:49:31.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T10:49:31.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T10:49:31.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T10:49:31.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T10:49:31.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T10:49:31.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T10:49:31.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T10:49:31.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T10:49:31.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T10:49:31.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T10:49:31.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T10:49:31.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T10:49:31.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T10:49:31.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.468+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T10:49:31.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T10:49:31.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T10:49:31.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T10:49:31.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T10:49:31.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T10:49:31.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T10:49:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T10:49:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T10:49:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T10:49:31.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T10:49:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T10:49:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.472+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T10:49:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T10:49:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T10:49:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T10:49:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T10:49:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T10:49:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T10:49:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T10:49:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T10:49:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T10:49:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T10:49:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T10:49:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T10:49:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T10:49:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.476+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T10:49:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T10:49:31.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T10:49:31.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T10:49:31.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T10:49:31.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T10:49:31.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T10:49:31.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T10:49:31.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T10:49:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T10:49:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T10:49:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T10:49:31.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T10:49:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T10:49:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.480+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T10:49:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T10:49:31.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T10:49:31.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T10:49:31.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T10:49:31.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T10:49:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T10:49:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T10:49:31.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T10:49:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T10:49:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T10:49:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T10:49:31.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T10:49:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T10:49:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.484+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T10:49:31.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T10:49:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T10:49:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T10:49:31.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T10:49:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T10:49:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T10:49:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T10:49:31.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T10:49:31.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T10:49:31.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T10:49:31.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T10:49:31.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.488+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T10:49:31.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T10:49:31.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T10:49:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T10:49:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T10:49:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T10:49:31.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T10:49:31.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T10:49:31.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T10:49:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T10:49:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T10:49:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T10:49:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T10:49:31.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T10:49:31.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.492+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T10:49:31.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T10:49:31.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T10:49:31.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T10:49:31.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T10:49:31.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T10:49:31.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T10:49:31.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T10:49:31.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T10:49:31.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.496+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T10:49:31.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T10:49:31.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T10:49:31.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T10:49:31.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T10:49:31.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T10:49:31.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.500+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T10:49:31.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T10:49:31.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T10:49:31.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T10:49:31.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T10:49:31.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.504+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T10:49:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T10:49:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T10:49:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T10:49:31.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T10:49:31.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T10:49:31.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T10:49:31.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T10:49:31.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T10:49:31.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T10:49:31.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T10:49:31.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T10:49:31.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.508+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T10:49:31.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T10:49:31.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T10:49:31.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T10:49:31.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T10:49:31.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T10:49:31.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T10:49:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T10:49:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T10:49:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T10:49:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T10:49:31.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T10:49:31.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T10:49:31.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T10:49:31.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.512+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T10:49:31.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T10:49:31.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T10:49:31.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T10:49:31.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T10:49:31.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T10:49:31.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T10:49:31.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T10:49:31.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T10:49:31.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T10:49:31.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T10:49:31.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T10:49:31.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T10:49:31.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T10:49:31.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.516+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T10:49:31.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T10:49:31.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T10:49:31.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T10:49:31.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T10:49:31.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T10:49:31.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T10:49:31.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T10:49:31.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T10:49:31.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T10:49:31.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T10:49:31.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T10:49:31.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.520+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T10:49:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T10:49:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T10:49:31.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T10:49:31.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T10:49:31.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T10:49:31.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T10:49:31.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T10:49:31.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T10:49:31.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T10:49:31.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T10:49:31.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T10:49:31.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.524+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T10:49:31.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T10:49:31.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T10:49:31.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T10:49:31.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T10:49:31.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T10:49:31.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T10:49:31.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T10:49:31.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T10:49:31.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T10:49:31.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.528+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T10:49:31.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T10:49:31.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T10:49:31.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T10:49:31.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T10:49:31.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T10:49:31.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T10:49:31.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T10:49:31.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T10:49:31.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T10:49:31.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.532+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T10:49:31.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T10:49:31.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T10:49:31.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T10:49:31.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T10:49:31.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T10:49:31.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T10:49:31.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T10:49:31.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T10:49:31.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.536+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T10:49:31.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.540+0000 7f75239499c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:49:31.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.548+0000 7f73d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:31.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.548+0000 7f75239499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:31.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:31.548+0000 7f75239499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:34.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.435+0000 7f75239499c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T10:49:34.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.435+0000 7f75239499c0 5 note: GC not initialized 2024-09-14T10:49:34.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.451+0000 7f73d27e4640 20 reqs_thread_entry: start 2024-09-14T10:49:34.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.451+0000 7f75239499c0 20 init_complete bucket index max shards: 11 2024-09-14T10:49:34.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.451+0000 7f75239499c0 20 Filter name: none 2024-09-14T10:49:34.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.451+0000 7f7333fff640 20 reqs_thread_entry: start 2024-09-14T10:49:34.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.507+0000 7f73d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.511+0000 7f75239499c0 20 remove_watcher() i=0 2024-09-14T10:49:34.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.511+0000 7f75239499c0 2 removed watcher, disabling cache 2024-09-14T10:49:34.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.515+0000 7f75239499c0 20 remove_watcher() i=1 2024-09-14T10:49:34.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.519+0000 7f75239499c0 20 remove_watcher() i=2 2024-09-14T10:49:34.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.519+0000 7f75239499c0 20 remove_watcher() i=3 2024-09-14T10:49:34.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.523+0000 7f75239499c0 20 remove_watcher() i=4 2024-09-14T10:49:34.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.523+0000 7f75239499c0 20 remove_watcher() i=5 2024-09-14T10:49:34.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.527+0000 7f75239499c0 20 remove_watcher() i=6 2024-09-14T10:49:34.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.531+0000 7f75239499c0 20 remove_watcher() i=7 2024-09-14T10:49:34.547 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-14T10:49:34.547 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:49:34.548 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:49:34.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:49:34.548 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T10:49:34.590 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:34.590 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:34.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.623+0000 7f9045da79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:34.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.623+0000 7f9045da79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:34.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.631+0000 7f8ea9ffb640 20 reqs_thread_entry: start 2024-09-14T10:49:34.645 INFO:teuthology.orchestra.run.smithi148.stdout:{"id":"de8d1d51-bce5-4d5d-ab2e-644cf6365286","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:49:34.646 DEBUG:tasks.util.rgw: json result: {'id': 'de8d1d51-bce5-4d5d-ab2e-644cf6365286', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:49:34.646 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:49:34.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:49:34.646 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:49:34.721 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:34.721 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:34.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.763+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:34.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 realm 2024-09-14T10:49:34.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:34.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:34.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:34.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:34.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.767+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.771+0000 7fa4c82df9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:49:34.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.771+0000 7fa4c82df9c0 20 searching for the correct realm 2024-09-14T10:49:34.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.779+0000 7fa4c65e6640 0 -- 172.21.15.148:0/2338805397 >> [v2:172.21.15.150:6800/2640697978,v1:172.21.15.150:6801/2640697978] conn(0x7fa4c00c5040 msgr2=0x7fa4c011e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:34.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.995+0000 7fa4c65e6640 0 -- 172.21.15.148:0/2338805397 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55ae6e547cd0 msgr2=0x55ae6e54a190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:34.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:34.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:49:34.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:34.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:34.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:34.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:49:34.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:34.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:34.999+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:34.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:49:34.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 zone default found 2024-09-14T10:49:34.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 4 Realm: () 2024-09-14T10:49:34.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:49:34.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:49:34.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:34.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 zonegroup default 2024-09-14T10:49:34.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:34.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:34.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:34.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:35.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 started sync module instance, tier type = 2024-09-14T10:49:35.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.003+0000 7fa4c82df9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:49:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.027+0000 7fa4c82df9c0 20 add_watcher() i=0 2024-09-14T10:49:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.027+0000 7fa4c82df9c0 20 add_watcher() i=1 2024-09-14T10:49:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.027+0000 7fa4c82df9c0 20 add_watcher() i=2 2024-09-14T10:49:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.027+0000 7fa4c82df9c0 20 add_watcher() i=3 2024-09-14T10:49:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.027+0000 7fa4c82df9c0 20 add_watcher() i=4 2024-09-14T10:49:35.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.027+0000 7fa4c82df9c0 20 add_watcher() i=5 2024-09-14T10:49:35.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.027+0000 7fa4c82df9c0 20 add_watcher() i=6 2024-09-14T10:49:35.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.031+0000 7fa4c82df9c0 20 add_watcher() i=7 2024-09-14T10:49:35.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.031+0000 7fa4c82df9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:35.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.035+0000 7fa3777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:35.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.035+0000 7fa4c82df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:35.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.035+0000 7fa4c82df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:35.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.035+0000 7fa4c82df9c0 5 note: GC not initialized 2024-09-14T10:49:35.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.035+0000 7fa3767fc640 20 reqs_thread_entry: start 2024-09-14T10:49:35.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.035+0000 7fa4c82df9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:49:35.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.035+0000 7fa4c82df9c0 20 Filter name: none 2024-09-14T10:49:35.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.035+0000 7fa2e7fff640 20 reqs_thread_entry: start 2024-09-14T10:49:35.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.059+0000 7fa3777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:35.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.063+0000 7fa4c82df9c0 20 remove_watcher() i=0 2024-09-14T10:49:35.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.063+0000 7fa4c82df9c0 2 removed watcher, disabling cache 2024-09-14T10:49:35.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.063+0000 7fa4c82df9c0 20 remove_watcher() i=1 2024-09-14T10:49:35.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.067+0000 7fa4c82df9c0 20 remove_watcher() i=2 2024-09-14T10:49:35.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.067+0000 7fa4c82df9c0 20 remove_watcher() i=3 2024-09-14T10:49:35.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.071+0000 7fa4c82df9c0 20 remove_watcher() i=4 2024-09-14T10:49:35.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.071+0000 7fa4c82df9c0 20 remove_watcher() i=5 2024-09-14T10:49:35.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.075+0000 7fa4c82df9c0 20 remove_watcher() i=6 2024-09-14T10:49:35.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.079+0000 7fa4c82df9c0 20 remove_watcher() i=7 2024-09-14T10:49:35.090 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-14T10:49:35.090 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:49:35.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:49:35.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:49:35.091 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-14T10:49:35.175 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:35.176 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:35.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.211+0000 7f4f205439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:35.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.211+0000 7f4f205439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:35.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.215+0000 7f4de0fe1640 20 reqs_thread_entry: start 2024-09-14T10:49:35.229 INFO:teuthology.orchestra.run.smithi148.stdout:{"id":"de8d1d51-bce5-4d5d-ab2e-644cf6365286","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:49:35.229 DEBUG:tasks.util.rgw: json result: {'id': 'de8d1d51-bce5-4d5d-ab2e-644cf6365286', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:49:35.230 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-14T10:49:35.230 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p /tmp/rgw_datacache 2024-09-14T10:49:35.278 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-14T10:49:35.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:49:35.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:49:35.334 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:49:35.411 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:35.412 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:35.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.455+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.459+0000 7f7c0e1499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:35.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.459+0000 7f7c0e1499c0 20 realm 2024-09-14T10:49:35.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.459+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.459+0000 7f7c0e1499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:35.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.459+0000 7f7c0e1499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:49:35.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.459+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.459+0000 7f7c0e1499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:35.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.459+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.463+0000 7f7c0e1499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:35.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.463+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.463+0000 7f7c0e1499c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:49:35.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.463+0000 7f7c0e1499c0 20 searching for the correct realm 2024-09-14T10:49:35.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.467+0000 7f7c0b44e640 0 -- 172.21.15.148:0/1523868890 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x559f44d275d0 msgr2=0x559f44d299c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:35.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.475+0000 7f7c0bc4f640 0 -- 172.21.15.148:0/1523868890 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f7c04052f20 msgr2=0x7f7c0405d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:49:35.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:49:35.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:49:35.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:49:35.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:49:35.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:49:35.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:49:35.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:35.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:49:35.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:49:35.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 zone default found 2024-09-14T10:49:35.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 4 Realm: () 2024-09-14T10:49:35.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:49:35.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:49:35.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:49:35.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 zonegroup default 2024-09-14T10:49:35.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.483+0000 7f7c0e1499c0 20 rados->read ofs=0 len=0 2024-09-14T10:49:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.487+0000 7f7c0e1499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:49:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.487+0000 7f7c0e1499c0 20 started sync module instance, tier type = 2024-09-14T10:49:35.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.487+0000 7f7c0e1499c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:49:35.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 20 add_watcher() i=0 2024-09-14T10:49:35.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 20 add_watcher() i=1 2024-09-14T10:49:35.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 20 add_watcher() i=2 2024-09-14T10:49:35.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 20 add_watcher() i=3 2024-09-14T10:49:35.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 20 add_watcher() i=4 2024-09-14T10:49:35.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 20 add_watcher() i=5 2024-09-14T10:49:35.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 20 add_watcher() i=6 2024-09-14T10:49:35.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 20 add_watcher() i=7 2024-09-14T10:49:35.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.507+0000 7f7c0e1499c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:49:35.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.511+0000 7f7ac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:35.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.511+0000 7f7c0e1499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:35.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.511+0000 7f7c0e1499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:35.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.511+0000 7f7c0e1499c0 5 note: GC not initialized 2024-09-14T10:49:35.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.511+0000 7f7ac0fe1640 20 reqs_thread_entry: start 2024-09-14T10:49:35.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.511+0000 7f7c0e1499c0 20 init_complete bucket index max shards: 11 2024-09-14T10:49:35.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.511+0000 7f7c0e1499c0 20 Filter name: none 2024-09-14T10:49:35.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.511+0000 7f7a3a7fc640 20 reqs_thread_entry: start 2024-09-14T10:49:35.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.531+0000 7f7ac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:49:35.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.535+0000 7f7c0e1499c0 20 remove_watcher() i=0 2024-09-14T10:49:35.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.535+0000 7f7c0e1499c0 2 removed watcher, disabling cache 2024-09-14T10:49:35.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.539+0000 7f7c0e1499c0 20 remove_watcher() i=1 2024-09-14T10:49:35.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.539+0000 7f7c0e1499c0 20 remove_watcher() i=2 2024-09-14T10:49:35.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.543+0000 7f7c0e1499c0 20 remove_watcher() i=3 2024-09-14T10:49:35.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.547+0000 7f7c0e1499c0 20 remove_watcher() i=4 2024-09-14T10:49:35.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.547+0000 7f7c0e1499c0 20 remove_watcher() i=5 2024-09-14T10:49:35.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.551+0000 7f7c0e1499c0 20 remove_watcher() i=6 2024-09-14T10:49:35.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.555+0000 7f7c0e1499c0 20 remove_watcher() i=7 2024-09-14T10:49:35.563 INFO:teuthology.orchestra.run.smithi148.stdout:[] 2024-09-14T10:49:35.564 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:49:35.564 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T10:49:35.564 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:49:35.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:49:35.564 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T10:49:35.647 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:35.647 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:35.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.683+0000 7f0f635669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:35.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.683+0000 7f0f635669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:35.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.687+0000 7f0d97fff640 20 reqs_thread_entry: start 2024-09-14T10:49:35.699 INFO:teuthology.orchestra.run.smithi148.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T10:49:35.700 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T10:49:35.700 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:49:35.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:49:35.700 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T10:49:35.778 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:35.779 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:35.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.811+0000 7f867db1b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:35.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.811+0000 7f867db1b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:35.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.815+0000 7f84c1ffb640 20 reqs_thread_entry: start 2024-09-14T10:49:35.830 INFO:teuthology.orchestra.run.smithi148.stdout:{"id":"de8d1d51-bce5-4d5d-ab2e-644cf6365286","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:49:35.831 DEBUG:tasks.util.rgw: json result: {'id': 'de8d1d51-bce5-4d5d-ab2e-644cf6365286', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:49:35.831 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T10:49:35.831 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:49:35.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:49:35.832 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T10:49:35.908 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:35.909 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:35.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.939+0000 7f506020f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:35.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.939+0000 7f506020f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:35.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:35.943+0000 7f4e93fff640 20 reqs_thread_entry: start 2024-09-14T10:49:35.960 INFO:teuthology.orchestra.run.smithi148.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T10:49:35.960 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T10:49:35.960 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:49:35.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:49:35.961 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T10:49:36.044 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:49:36.044 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:49:36.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:36.075+0000 7f8d019cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:49:36.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:36.075+0000 7f8d019cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:49:36.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T10:49:36.079+0000 7f8b55ffb640 20 reqs_thread_entry: start 2024-09-14T10:49:36.097 INFO:teuthology.orchestra.run.smithi148.stdout:{"id":"de8d1d51-bce5-4d5d-ab2e-644cf6365286","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:49:36.098 DEBUG:tasks.util.rgw: json result: {'id': 'de8d1d51-bce5-4d5d-ab2e-644cf6365286', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:49:36.098 INFO:tasks.rgw:Starting rgw... 2024-09-14T10:49:36.098 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-14T10:49:36.098 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T10:49:36.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo echo -n https://smithi148.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T10:49:36.151 INFO:teuthology.orchestra.run.smithi148.stdout:https://smithi148.front.sepia.ceph.com:443 2024-09-14T10:49:36.152 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T10:49:36.202 DEBUG:teuthology.orchestra.run.smithi148:> sudo keytool -import -alias smithi148.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-14T10:49:36.519 INFO:teuthology.orchestra.run.smithi148.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-14T10:49:36.809 INFO:teuthology.orchestra.run.smithi148.stderr:Certificate was added to keystore 2024-09-14T10:49:36.840 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-14T10:49:36.841 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T10:49:36.841 DEBUG:teuthology.orchestra.run.smithi148:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T10:49:36.844 INFO:tasks.rgw.client.0:Started 2024-09-14T10:49:36.844 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi148.front.sepia.ceph.com:443/ 2024-09-14T10:49:36.844 DEBUG:teuthology.orchestra.run.smithi148:> curl https://smithi148.front.sepia.ceph.com:443/ 2024-09-14T10:49:36.871 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:49:36.871 INFO:teuthology.orchestra.run.smithi148.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:49:36.871 INFO:teuthology.orchestra.run.smithi148.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:49:36.871 INFO:teuthology.orchestra.run.smithi148.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:49:36.871 INFO:teuthology.orchestra.run.smithi148.stderr:curl: (7) Failed to connect to smithi148.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T10:49:37.872 DEBUG:teuthology.orchestra.run.smithi148:> curl https://smithi148.front.sepia.ceph.com:443/ 2024-09-14T10:49:37.883 INFO:teuthology.orchestra.run.smithi148.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:49:37.883 INFO:teuthology.orchestra.run.smithi148.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:49:37.884 INFO:teuthology.orchestra.run.smithi148.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:49:37.884 INFO:teuthology.orchestra.run.smithi148.stderr:curl: (7) Failed to connect to smithi148.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T10:49:37.884 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:49:39.886 DEBUG:teuthology.orchestra.run.smithi148:> curl https://smithi148.front.sepia.ceph.com:443/ 2024-09-14T10:49:39.897 INFO:teuthology.orchestra.run.smithi148.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:49:39.897 INFO:teuthology.orchestra.run.smithi148.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:49:39.897 INFO:teuthology.orchestra.run.smithi148.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:49:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:curl: (7) Failed to connect to smithi148.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T10:49:39.897 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:49:43.899 DEBUG:teuthology.orchestra.run.smithi148:> curl https://smithi148.front.sepia.ceph.com:443/ 2024-09-14T10:49:43.910 INFO:teuthology.orchestra.run.smithi148.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:49:43.910 INFO:teuthology.orchestra.run.smithi148.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:49:43.910 INFO:teuthology.orchestra.run.smithi148.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:49:43.911 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:49:43.911 INFO:teuthology.orchestra.run.smithi148.stderr:curl: (7) Failed to connect to smithi148.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T10:49:51.912 DEBUG:teuthology.orchestra.run.smithi148:> curl https://smithi148.front.sepia.ceph.com:443/ 2024-09-14T10:49:51.923 INFO:teuthology.orchestra.run.smithi148.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:49:51.923 INFO:teuthology.orchestra.run.smithi148.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:49:51.924 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:49:51.925 INFO:teuthology.orchestra.run.smithi148.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:49:51.925 INFO:teuthology.orchestra.run.smithi148.stderr:curl: (7) Failed to connect to smithi148.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T10:50:01.892 INFO:tasks.rgw.client.0.smithi148.stdout:2024-09-14T10:50:01.543+0000 8edcf80 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-14T10:50:07.925 DEBUG:teuthology.orchestra.run.smithi148:> curl https://smithi148.front.sepia.ceph.com:443/ 2024-09-14T10:50:07.937 INFO:teuthology.orchestra.run.smithi148.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:50:07.937 INFO:teuthology.orchestra.run.smithi148.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:50:09.096 INFO:teuthology.orchestra.run.smithi148.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 187 0 187 0 0 161 0 --:--:-- 0:00:01 --:--:-- 161 2024-09-14T10:50:09.100 INFO:teuthology.orchestra.run.smithi148.stdout:anonymous 2024-09-14T10:50:09.101 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T10:50:09.114 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T10:50:09.115 DEBUG:teuthology.orchestra.run.smithi148:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T10:50:12.032 DEBUG:teuthology.orchestra.run.smithi148:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T10:50:12.685 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting tox==3.15.0 2024-09-14T10:50:12.781 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T10:50:12.847 INFO:teuthology.orchestra.run.smithi148.stdout: ---------------------------------------- 82.1/82.1 KB 1.2 MB/s eta 0:00:00 2024-09-14T10:50:12.962 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T10:50:12.978 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T10:50:13.105 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting packaging>=14 2024-09-14T10:50:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T10:50:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: ---------------------------------------- 54.0/54.0 KB 1.0 MB/s eta 0:00:00 2024-09-14T10:50:13.433 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T10:50:13.447 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T10:50:13.954 INFO:teuthology.orchestra.run.smithi148.stdout: ---------------------------------------- 6.0/6.0 MB 12.0 MB/s eta 0:00:00 2024-09-14T10:50:14.120 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T10:50:14.134 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T10:50:14.222 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting six<2,>=1.14.0 2024-09-14T10:50:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:50:14.351 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting py<2,>=1.4.17 2024-09-14T10:50:14.366 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T10:50:14.403 INFO:teuthology.orchestra.run.smithi148.stdout: ---------------------------------------- 98.7/98.7 KB 2.7 MB/s eta 0:00:00 2024-09-14T10:50:14.471 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting toml>=0.9.4 2024-09-14T10:50:14.487 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T10:50:14.667 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T10:50:14.684 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T10:50:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: --------------------------------------- 468.9/468.9 KB 9.3 MB/s eta 0:00:00 2024-09-14T10:50:14.847 INFO:teuthology.orchestra.run.smithi148.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T10:50:14.861 INFO:teuthology.orchestra.run.smithi148.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T10:50:15.046 INFO:teuthology.orchestra.run.smithi148.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-14T10:50:16.239 INFO:teuthology.orchestra.run.smithi148.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T10:50:16.328 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:50:16.352 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:50:16.353 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:50:16.353 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:50:16.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:50:16.359 INFO:teuthology.orchestra.run.smithi148.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:50:16.359 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:50:16.406 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:50:16.406 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:50:16.453 INFO:tasks.workunit:timeout=3h 2024-09-14T10:50:16.453 INFO:tasks.workunit:cleanup=True 2024-09-14T10:50:16.454 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:50:16.504 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:51:12.575 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:51:12.576 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:51:12.576 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:51:12.576 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:51:12.576 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:51:12.576 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:51:12.576 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:51:12.576 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:51:12.576 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:51:12.577 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:51:12.579 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:51:12.627 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:51:12.630 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:51:12.630 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:51:13.409 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:51:13.503 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:51:13.553 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:51:13.555 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:51:13.555 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:51:13.602 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:51:13.606 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:51:13.606 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:51:13.653 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-14T10:51:13.654 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-14T10:51:13.654 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T10:51:13.711 INFO:tasks.workunit.client.0.smithi148.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T10:51:13.712 INFO:tasks.workunit.client.0.smithi148.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:51:13.712 INFO:tasks.workunit.client.0.smithi148.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ deactivate nondestructive 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ hash -r 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ unset VIRTUAL_ENV 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T10:51:16.553 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ export VIRTUAL_ENV 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ export PATH 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -z '' ']' 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ PS1='(rgw) ' 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ export PS1 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T10:51:16.554 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:51:16.555 INFO:tasks.workunit.client.0.smithi148.stderr:++ hash -r 2024-09-14T10:51:16.555 INFO:tasks.workunit.client.0.smithi148.stderr:+ pip install pip --upgrade 2024-09-14T10:51:16.905 INFO:tasks.workunit.client.0.smithi148.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T10:51:17.127 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting pip 2024-09-14T10:51:17.237 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T10:51:17.518 INFO:tasks.workunit.client.0.smithi148.stdout: ---------------------------------------- 1.8/1.8 MB 6.5 MB/s eta 0:00:00 2024-09-14T10:51:17.592 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: pip 2024-09-14T10:51:17.592 INFO:tasks.workunit.client.0.smithi148.stdout: Attempting uninstall: pip 2024-09-14T10:51:17.592 INFO:tasks.workunit.client.0.smithi148.stdout: Found existing installation: pip 22.0.2 2024-09-14T10:51:17.864 INFO:tasks.workunit.client.0.smithi148.stdout: Uninstalling pip-22.0.2: 2024-09-14T10:51:17.870 INFO:tasks.workunit.client.0.smithi148.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T10:51:18.610 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed pip-24.2 2024-09-14T10:51:18.669 INFO:tasks.workunit.client.0.smithi148.stderr:+ pip install configobj 2024-09-14T10:51:19.251 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting configobj 2024-09-14T10:51:19.303 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-14T10:51:19.417 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting six (from configobj) 2024-09-14T10:51:19.433 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T10:51:19.505 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-14T10:51:19.598 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:51:19.680 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: six, configobj 2024-09-14T10:51:19.845 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-14T10:51:20.254 INFO:tasks.workunit.client.0.smithi148.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-14T10:51:20.293 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-14T10:51:20.293 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-14T10:51:20.294 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:20.294 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-14T10:51:20.294 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:51:20.295 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-14T10:51:20.340 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:20.340 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 39566/valgrind.bin \ntcp6 0 0 :::443 :::* LISTEN 39566/valgrind.bin \n' 2024-09-14T10:51:20.340 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:radosgw port: 443 2024-09-14T10:51:20.340 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-14T10:51:20.340 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-14T10:51:20.373 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:20.373 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b'' 2024-09-14T10:51:20.373 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-14T10:51:20.580 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:20.580 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-14T10:51:20.505450Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-14T10:51:20.505433Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-14T10:51:20.580 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:Creating s3cmd config... 2024-09-14T10:51:20.580 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:proto for s3cmd config is https 2024-09-14T10:51:20.580 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:s3cmd config written 2024-09-14T10:51:20.580 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-14T10:51:21.736 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:21.736 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-14T10:51:21.736 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-14T10:51:26.159 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:26.160 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 4.0 seconds, 1783.71 KB/s) [1 of 1]\n" 2024-09-14T10:51:26.160 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-14T10:51:27.889 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:27.890 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 1.5 seconds, 4.78 MB/s)\n" 2024-09-14T10:51:27.890 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-14T10:51:28.057 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:28.057 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340376,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "snappy",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194500\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194500,\n "len": 3145876\n }\n ]\n },\n "etag": "1da2e8bfd65d39da64ef86cbe87b4871",\n "tag": "de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12683333929818772469",\n "manifest": {\n "objs": [],\n "obj_size": 7340376,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".1fDUfW3ZPGhGa50OOAUmbKGGa7gPydn_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4190208,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1",\n "bucket_id": "de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4190208,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1",\n "bucket_id": "de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".1fDUfW3ZPGhGa50OOAUmbKGGa7gPydn_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4190208,\n "ofs": 7340376,\n "stripe_size": 3150168,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1",\n "bucket_id": "de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".1fDUfW3ZPGhGa50OOAUmbKGGa7gPydn_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-14T10:51:25.956405Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12683333929818772469",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726311080/ctime:1726311080/gid:1271/gname:ubuntu/md5:1da2e8bfd65d39da64ef86cbe87b4871/mode:33204/mtime:1726311080/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-14T10:51:28.058 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:Cached object name is: .1fDUfW3ZPGhGa50OOAUmbKGGa7gPydn_ 2024-09-14T10:51:28.058 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-14T10:51:28.060 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:command succeeded 2024-09-14T10:51:28.060 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:b'0\n' 2024-09-14T10:51:28.060 INFO:tasks.workunit.client.0.smithi148.stderr:DEBUG:root:Check cache dir content: 0 2024-09-14T10:51:28.060 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-14T10:51:28.060 INFO:tasks.workunit.client.0.smithi148.stderr:INFO:root:Completed Datacache tests 2024-09-14T10:51:28.066 INFO:tasks.workunit.client.0.smithi148.stderr:+ deactivate 2024-09-14T10:51:28.066 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T10:51:28.066 INFO:tasks.workunit.client.0.smithi148.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T10:51:28.066 INFO:tasks.workunit.client.0.smithi148.stderr:+ export PATH 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ hash -r 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset VIRTUAL_ENV 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset -f deactivate 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi148.stderr:+ echo OK. 2024-09-14T10:51:28.068 INFO:tasks.workunit.client.0.smithi148.stdout:OK. 2024-09-14T10:51:28.069 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:51:28.069 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:51:28.125 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-14T10:51:28.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T10:51:28.467 DEBUG:teuthology.parallel:result is None 2024-09-14T10:51:28.467 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:51:28.479 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:51:28.479 DEBUG:teuthology.orchestra.run.smithi148:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:51:28.617 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:51:28.618 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:51:28.629 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:51:28.629 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:51:28.629 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:51:28.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:51:28.635 INFO:teuthology.orchestra.run.smithi148.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:51:28.635 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:51:28.680 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:51:28.681 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:51:28.729 INFO:tasks.workunit:timeout=3h 2024-09-14T10:51:28.729 INFO:tasks.workunit:cleanup=True 2024-09-14T10:51:28.729 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:51:28.778 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:52:22.765 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:52:22.765 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:22.765 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:52:22.765 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:52:22.765 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:52:22.765 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:22.765 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:52:22.765 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:22.766 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:52:22.768 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:52:22.815 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:52:22.818 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:52:22.818 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:52:22.872 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:52:22.931 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:52:22.973 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:52:22.974 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:52:22.975 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:52:23.017 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:52:23.021 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:52:23.021 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:52:23.069 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T10:52:23.070 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T10:52:23.070 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:52:23.122 INFO:tasks.workunit.client.0.smithi148.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:52:23.124 INFO:tasks.workunit.client.0.smithi148.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:52:23.124 INFO:tasks.workunit.client.0.smithi148.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:52:26.010 INFO:tasks.workunit.client.0.smithi148.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T10:52:26.010 INFO:tasks.workunit.client.0.smithi148.stderr:++ deactivate nondestructive 2024-09-14T10:52:26.010 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T10:52:26.010 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T10:52:26.010 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:52:26.010 INFO:tasks.workunit.client.0.smithi148.stderr:++ hash -r 2024-09-14T10:52:26.010 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T10:52:26.010 INFO:tasks.workunit.client.0.smithi148.stderr:++ unset VIRTUAL_ENV 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ export VIRTUAL_ENV 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ export PATH 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -z '' ']' 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ PS1='(rgw) ' 2024-09-14T10:52:26.011 INFO:tasks.workunit.client.0.smithi148.stderr:++ export PS1 2024-09-14T10:52:26.012 INFO:tasks.workunit.client.0.smithi148.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T10:52:26.012 INFO:tasks.workunit.client.0.smithi148.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T10:52:26.012 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:52:26.012 INFO:tasks.workunit.client.0.smithi148.stderr:++ hash -r 2024-09-14T10:52:26.012 INFO:tasks.workunit.client.0.smithi148.stderr:+ pip install pip --upgrade 2024-09-14T10:52:26.403 INFO:tasks.workunit.client.0.smithi148.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T10:52:26.595 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting pip 2024-09-14T10:52:26.601 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T10:52:26.634 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: pip 2024-09-14T10:52:26.635 INFO:tasks.workunit.client.0.smithi148.stdout: Attempting uninstall: pip 2024-09-14T10:52:26.635 INFO:tasks.workunit.client.0.smithi148.stdout: Found existing installation: pip 22.0.2 2024-09-14T10:52:26.903 INFO:tasks.workunit.client.0.smithi148.stdout: Uninstalling pip-22.0.2: 2024-09-14T10:52:26.909 INFO:tasks.workunit.client.0.smithi148.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T10:52:27.653 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed pip-24.2 2024-09-14T10:52:27.711 INFO:tasks.workunit.client.0.smithi148.stderr:+ pip install boto3 2024-09-14T10:52:28.725 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting boto3 2024-09-14T10:52:28.782 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T10:52:29.434 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T10:52:29.448 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T10:52:29.583 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T10:52:29.598 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T10:52:29.746 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T10:52:29.763 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T10:52:29.924 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:52:29.940 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T10:52:30.116 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:52:30.130 INFO:tasks.workunit.client.0.smithi148.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T10:52:30.427 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:52:30.429 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T10:52:30.445 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T10:52:30.537 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T10:52:30.772 INFO:tasks.workunit.client.0.smithi148.stdout: ---------------------------------------- 12.5/12.5 MB 56.2 MB/s eta 0:00:00 2024-09-14T10:52:30.789 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T10:52:30.855 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T10:52:30.925 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T10:52:30.997 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T10:52:31.052 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:52:31.176 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T10:52:32.363 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T10:52:32.577 INFO:tasks.workunit.client.0.smithi148.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T10:52:32.734 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T10:52:32.773 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:32.773 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:32.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.815+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:32.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:32.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 realm 2024-09-14T10:52:32.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:32.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:32.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:32.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:32.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:32.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:32.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:32.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:32.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:32.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.819+0000 7f6dc0d239c0 20 searching for the correct realm 2024-09-14T10:52:32.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:32.827+0000 7f6dbe028640 0 -- 172.21.15.148:0/3183699075 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f6db8029040 msgr2=0x7f6db801faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:33.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.035+0000 7f6dbf02a640 0 -- 172.21.15.148:0/3183699075 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x562a6a999030 msgr2=0x562a6a99b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:33.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.047+0000 7f6dc0d239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:33.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.047+0000 7f6dc0d239c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:33.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.047+0000 7f6dc0d239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:33.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.047+0000 7f6dc0d239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:33.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.047+0000 7f6dc0d239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:33.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.047+0000 7f6dc0d239c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:33.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.047+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:33.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:33.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:33.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:33.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:33.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:33.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 zone default found 2024-09-14T10:52:33.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 4 Realm: () 2024-09-14T10:52:33.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:33.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:33.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:33.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 zonegroup default 2024-09-14T10:52:33.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:33.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:33.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:33.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:33.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.051+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:33.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.055+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:33.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.055+0000 7f6dc0d239c0 20 started sync module instance, tier type = 2024-09-14T10:52:33.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.055+0000 7f6dc0d239c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:33.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 20 add_watcher() i=0 2024-09-14T10:52:33.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 20 add_watcher() i=1 2024-09-14T10:52:33.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 20 add_watcher() i=2 2024-09-14T10:52:33.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 20 add_watcher() i=3 2024-09-14T10:52:33.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 20 add_watcher() i=4 2024-09-14T10:52:33.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 20 add_watcher() i=5 2024-09-14T10:52:33.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 20 add_watcher() i=6 2024-09-14T10:52:33.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 20 add_watcher() i=7 2024-09-14T10:52:33.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.079+0000 7f6dc0d239c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:33.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.083+0000 7f6c757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:33.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:33.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:33.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 5 note: GC not initialized 2024-09-14T10:52:33.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6beffff640 20 reqs_thread_entry: start 2024-09-14T10:52:33.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:33.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 20 Filter name: none 2024-09-14T10:52:33.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6bedffb640 20 reqs_thread_entry: start 2024-09-14T10:52:33.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T10:52:33.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:33.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:33.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T10:52:33.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:52:33.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T10:52:33.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:33.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:33.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T10:52:33.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:52:33.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:52:33.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.087+0000 7f6dc0d239c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:52:33.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.091+0000 7f6dc0d239c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:52:33.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.091+0000 7f6dc0d239c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:52:33.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.091+0000 7f6dc0d239c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T10:52:33.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.091+0000 7f6ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691841 cookie 94740177132000 notifier 4734 bl.length()=593 2024-09-14T10:52:33.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.091+0000 7f6ca27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:52:33.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.091+0000 7f6ca27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:52:33.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.095+0000 7f6dc0d239c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:52:33.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.095+0000 7f6dc0d239c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:52:33.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.095+0000 7f6dc0d239c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T10:52:33.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.099+0000 7f6ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94740177071888 notifier 4734 bl.length()=186 2024-09-14T10:52:33.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.099+0000 7f6ca27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:52:33.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.099+0000 7f6ca27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:52:33.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.103+0000 7f6c757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:33.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.107+0000 7f6dc0d239c0 20 remove_watcher() i=0 2024-09-14T10:52:33.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.107+0000 7f6dc0d239c0 2 removed watcher, disabling cache 2024-09-14T10:52:33.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.107+0000 7f6dc0d239c0 20 remove_watcher() i=1 2024-09-14T10:52:33.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.111+0000 7f6dc0d239c0 20 remove_watcher() i=2 2024-09-14T10:52:33.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.115+0000 7f6dc0d239c0 20 remove_watcher() i=3 2024-09-14T10:52:33.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.115+0000 7f6dc0d239c0 20 remove_watcher() i=4 2024-09-14T10:52:33.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.119+0000 7f6dc0d239c0 20 remove_watcher() i=5 2024-09-14T10:52:33.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.123+0000 7f6dc0d239c0 20 remove_watcher() i=6 2024-09-14T10:52:33.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:33.123+0000 7f6dc0d239c0 20 remove_watcher() i=7 2024-09-14T10:52:33.385 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:33.385 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:33.488 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:33.489 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:33.611 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:33.611 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:33.743 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:33.743 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:33.939 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:33.939 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:34.014 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:34.014 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:34.121 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:34.121 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:34.182 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:34.182 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:34.330 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:34.330 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:34.645 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:34.646 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:34.745 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:34.746 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:34.969 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:34.969 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:35.042 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:35.043 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:35.264 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:35.264 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:35.337 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:35.337 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:35.508 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:35.509 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:35.575 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T10:52:35.575 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:35.576 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:52:35.611 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:35.611 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:35.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.655+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:35.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 realm 2024-09-14T10:52:35.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:35.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:35.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:35.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:35.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.659+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.663+0000 7f03b74da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:35.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.663+0000 7f03b74da9c0 20 searching for the correct realm 2024-09-14T10:52:35.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.667+0000 7f03b47df640 0 -- 172.21.15.148:0/111162856 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f03ac026410 msgr2=0x7f03ac026890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:35.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.879+0000 7f03b57e1640 0 -- 172.21.15.148:0/111162856 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55d55c62b1a0 msgr2=0x55d55c62d5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:35.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:35.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:35.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:35.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:35.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:35.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:35.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:35.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:35.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:35.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 zone default found 2024-09-14T10:52:35.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 4 Realm: () 2024-09-14T10:52:35.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:35.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:35.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:35.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 zonegroup default 2024-09-14T10:52:35.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:35.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.891+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.895+0000 7f03b74da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:35.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.895+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.895+0000 7f03b74da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:35.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.895+0000 7f03b74da9c0 20 started sync module instance, tier type = 2024-09-14T10:52:35.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.895+0000 7f03b74da9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.919+0000 7f03b74da9c0 20 add_watcher() i=0 2024-09-14T10:52:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.919+0000 7f03b74da9c0 20 add_watcher() i=1 2024-09-14T10:52:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.919+0000 7f03b74da9c0 20 add_watcher() i=2 2024-09-14T10:52:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.919+0000 7f03b74da9c0 20 add_watcher() i=3 2024-09-14T10:52:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.919+0000 7f03b74da9c0 20 add_watcher() i=4 2024-09-14T10:52:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.919+0000 7f03b74da9c0 20 add_watcher() i=5 2024-09-14T10:52:35.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.919+0000 7f03b74da9c0 20 add_watcher() i=6 2024-09-14T10:52:35.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.923+0000 7f03b74da9c0 20 add_watcher() i=7 2024-09-14T10:52:35.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.923+0000 7f03b74da9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:35.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f026afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:35.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f03b74da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:35.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f03b74da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:35.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f03b74da9c0 5 note: GC not initialized 2024-09-14T10:52:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f0269fe3640 20 reqs_thread_entry: start 2024-09-14T10:52:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f03b74da9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f03b74da9c0 20 Filter name: none 2024-09-14T10:52:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f01db7fe640 20 reqs_thread_entry: start 2024-09-14T10:52:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f03b74da9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.927+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:35.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:35.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:35.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:35.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:35.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.931+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:35.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.935+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:35.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.935+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:35.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.935+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:35.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.935+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:35.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.939+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:35.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.939+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.939+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:35.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.943+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:35.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.943+0000 7f03b74da9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:35.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.955+0000 7f026afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:35.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.959+0000 7f03b74da9c0 20 remove_watcher() i=0 2024-09-14T10:52:35.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.959+0000 7f03b74da9c0 2 removed watcher, disabling cache 2024-09-14T10:52:35.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.963+0000 7f03b74da9c0 20 remove_watcher() i=1 2024-09-14T10:52:35.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.963+0000 7f03b74da9c0 20 remove_watcher() i=2 2024-09-14T10:52:35.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.967+0000 7f03b74da9c0 20 remove_watcher() i=3 2024-09-14T10:52:35.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.967+0000 7f03b74da9c0 20 remove_watcher() i=4 2024-09-14T10:52:35.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.971+0000 7f03b74da9c0 20 remove_watcher() i=5 2024-09-14T10:52:35.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.975+0000 7f03b74da9c0 20 remove_watcher() i=6 2024-09-14T10:52:35.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:35.975+0000 7f03b74da9c0 20 remove_watcher() i=7 2024-09-14T10:52:35.992 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:52:36.022 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:36.022 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:36.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.067+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.067+0000 7fb3fc8269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 realm 2024-09-14T10:52:36.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:36.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:36.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:36.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.071+0000 7fb3fc8269c0 20 searching for the correct realm 2024-09-14T10:52:36.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.075+0000 7fb3fa32c640 0 -- 172.21.15.148:0/2226138722 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fb3ec026040 msgr2=0x7fb3ec063600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:36.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.079+0000 7fb3fa32c640 0 -- 172.21.15.148:0/2226138722 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fb3f4068480 msgr2=0x7fb3f4063400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:36.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.295+0000 7fb3fc8269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:36.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.295+0000 7fb3fc8269c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:36.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.295+0000 7fb3fc8269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:36.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.295+0000 7fb3fc8269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:36.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.295+0000 7fb3fc8269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:36.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.295+0000 7fb3fc8269c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:36.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.295+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:36.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:36.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 zone default found 2024-09-14T10:52:36.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 4 Realm: () 2024-09-14T10:52:36.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:36.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:36.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:36.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 zonegroup default 2024-09-14T10:52:36.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.299+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.303+0000 7fb3fc8269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.303+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.303+0000 7fb3fc8269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.303+0000 7fb3fc8269c0 20 started sync module instance, tier type = 2024-09-14T10:52:36.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.303+0000 7fb3fc8269c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:36.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.331+0000 7fb3fc8269c0 20 add_watcher() i=0 2024-09-14T10:52:36.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.331+0000 7fb3fc8269c0 20 add_watcher() i=1 2024-09-14T10:52:36.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.331+0000 7fb3fc8269c0 20 add_watcher() i=2 2024-09-14T10:52:36.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.331+0000 7fb3fc8269c0 20 add_watcher() i=3 2024-09-14T10:52:36.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.331+0000 7fb3fc8269c0 20 add_watcher() i=4 2024-09-14T10:52:36.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.331+0000 7fb3fc8269c0 20 add_watcher() i=5 2024-09-14T10:52:36.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.331+0000 7fb3fc8269c0 20 add_watcher() i=6 2024-09-14T10:52:36.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.335+0000 7fb3fc8269c0 20 add_watcher() i=7 2024-09-14T10:52:36.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.335+0000 7fb3fc8269c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:36.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb2b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:36.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb3fc8269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:36.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb3fc8269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:36.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb3fc8269c0 5 note: GC not initialized 2024-09-14T10:52:36.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb22b7fe640 20 reqs_thread_entry: start 2024-09-14T10:52:36.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb3fc8269c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:36.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb3fc8269c0 20 Filter name: none 2024-09-14T10:52:36.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb2297fa640 20 reqs_thread_entry: start 2024-09-14T10:52:36.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.339+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:36.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:36.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:36.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:36.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:36.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.343+0000 7fb3fc8269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:36.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.347+0000 7fb2b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:36.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.355+0000 7fb3fc8269c0 20 remove_watcher() i=0 2024-09-14T10:52:36.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.355+0000 7fb3fc8269c0 2 removed watcher, disabling cache 2024-09-14T10:52:36.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.355+0000 7fb3fc8269c0 20 remove_watcher() i=1 2024-09-14T10:52:36.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.359+0000 7fb3fc8269c0 20 remove_watcher() i=2 2024-09-14T10:52:36.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.359+0000 7fb3fc8269c0 20 remove_watcher() i=3 2024-09-14T10:52:36.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.363+0000 7fb3fc8269c0 20 remove_watcher() i=4 2024-09-14T10:52:36.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.367+0000 7fb3fc8269c0 20 remove_watcher() i=5 2024-09-14T10:52:36.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.367+0000 7fb3fc8269c0 20 remove_watcher() i=6 2024-09-14T10:52:36.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.371+0000 7fb3fc8269c0 20 remove_watcher() i=7 2024-09-14T10:52:36.390 INFO:tasks.workunit.client.0.smithi148.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 111, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T10:52:36.390 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T10:52:36.390 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:36.391 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:52:36.423 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:36.423 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:36.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.467+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 realm 2024-09-14T10:52:36.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:36.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:36.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:36.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.471+0000 7fb24a72a9c0 20 searching for the correct realm 2024-09-14T10:52:36.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.479+0000 7fb248230640 0 -- 172.21.15.148:0/3595974836 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fb238008050 msgr2=0x7fb23805d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:36.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.483+0000 7fb248230640 0 -- 172.21.15.148:0/3595974836 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fb240034040 msgr2=0x7fb240036440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:36.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:36.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:36.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:36.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:36.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:36.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:36.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:36.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 zone default found 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 4 Realm: () 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 zonegroup default 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.491+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.495+0000 7fb24a72a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.495+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.495+0000 7fb24a72a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.495+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.495+0000 7fb24a72a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:36.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.495+0000 7fb24a72a9c0 20 started sync module instance, tier type = 2024-09-14T10:52:36.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.495+0000 7fb24a72a9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:36.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.515+0000 7fb24a72a9c0 20 add_watcher() i=0 2024-09-14T10:52:36.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.515+0000 7fb24a72a9c0 20 add_watcher() i=1 2024-09-14T10:52:36.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.515+0000 7fb24a72a9c0 20 add_watcher() i=2 2024-09-14T10:52:36.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.515+0000 7fb24a72a9c0 20 add_watcher() i=3 2024-09-14T10:52:36.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.515+0000 7fb24a72a9c0 20 add_watcher() i=4 2024-09-14T10:52:36.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.515+0000 7fb24a72a9c0 20 add_watcher() i=5 2024-09-14T10:52:36.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.515+0000 7fb24a72a9c0 20 add_watcher() i=6 2024-09-14T10:52:36.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.519+0000 7fb24a72a9c0 20 add_watcher() i=7 2024-09-14T10:52:36.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.519+0000 7fb24a72a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:36.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.519+0000 7fb0fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 5 note: GC not initialized 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb0fdfdb640 20 reqs_thread_entry: start 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 Filter name: none 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb06f7fe640 20 reqs_thread_entry: start 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:36.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:36.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:36.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:36.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:36.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:36.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:36.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:36.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:36.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:36.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:36.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:36.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:52:36.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.523+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:36.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:52:36.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:36.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:52:36.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:36.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:52:36.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:36.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:52:36.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:36.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:52:36.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.527+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:36.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.531+0000 7fb24a72a9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:52:36.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.531+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:36.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.531+0000 7fb24a72a9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:52:36.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.531+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:36.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.531+0000 7fb24a72a9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:52:36.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.531+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:36.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.535+0000 7fb24a72a9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:52:36.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.535+0000 7fb24a72a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:36.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.535+0000 7fb24a72a9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:52:36.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.535+0000 7fb24a72a9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:52:36.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.535+0000 7fb0fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:36.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.539+0000 7fb24a72a9c0 20 remove_watcher() i=0 2024-09-14T10:52:36.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.539+0000 7fb24a72a9c0 2 removed watcher, disabling cache 2024-09-14T10:52:36.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.543+0000 7fb24a72a9c0 20 remove_watcher() i=1 2024-09-14T10:52:36.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.543+0000 7fb24a72a9c0 20 remove_watcher() i=2 2024-09-14T10:52:36.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.547+0000 7fb24a72a9c0 20 remove_watcher() i=3 2024-09-14T10:52:36.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.551+0000 7fb24a72a9c0 20 remove_watcher() i=4 2024-09-14T10:52:36.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.551+0000 7fb24a72a9c0 20 remove_watcher() i=5 2024-09-14T10:52:36.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.555+0000 7fb24a72a9c0 20 remove_watcher() i=6 2024-09-14T10:52:36.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:36.559+0000 7fb24a72a9c0 20 remove_watcher() i=7 2024-09-14T10:52:36.573 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:52:37.022 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:52:38.481 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:38.482 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:38.677 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:52:38.678 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:52:38.713 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:38.713 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:38.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.759+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:38.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.963+0000 7f704a04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:38.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.963+0000 7f704a04a9c0 20 realm 2024-09-14T10:52:38.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.963+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:38.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.963+0000 7f704a04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:38.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.963+0000 7f704a04a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:38.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.963+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:38.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.963+0000 7f704a04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:38.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.963+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:38.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.967+0000 7f704a04a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:38.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.967+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:38.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.967+0000 7f704a04a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:38.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.967+0000 7f704a04a9c0 20 searching for the correct realm 2024-09-14T10:52:38.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.975+0000 7f7048351640 0 -- 172.21.15.148:0/428705490 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x558e32520980 msgr2=0x558e32522e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:38.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:38.983+0000 7f7047b50640 0 -- 172.21.15.148:0/428705490 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f704006ca60 msgr2=0x7f704006c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:39.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:39.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:39.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.199+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 zone default found 2024-09-14T10:52:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 4 Realm: () 2024-09-14T10:52:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:39.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 zonegroup default 2024-09-14T10:52:39.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:39.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:39.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:39.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 started sync module instance, tier type = 2024-09-14T10:52:39.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.203+0000 7f704a04a9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.231+0000 7f704a04a9c0 20 add_watcher() i=0 2024-09-14T10:52:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.231+0000 7f704a04a9c0 20 add_watcher() i=1 2024-09-14T10:52:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.231+0000 7f704a04a9c0 20 add_watcher() i=2 2024-09-14T10:52:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.231+0000 7f704a04a9c0 20 add_watcher() i=3 2024-09-14T10:52:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.231+0000 7f704a04a9c0 20 add_watcher() i=4 2024-09-14T10:52:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.231+0000 7f704a04a9c0 20 add_watcher() i=5 2024-09-14T10:52:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.231+0000 7f704a04a9c0 20 add_watcher() i=6 2024-09-14T10:52:39.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.235+0000 7f704a04a9c0 20 add_watcher() i=7 2024-09-14T10:52:39.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.235+0000 7f704a04a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:39.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.239+0000 7f6efdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:39.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.239+0000 7f704a04a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:39.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.239+0000 7f704a04a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:39.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.239+0000 7f704a04a9c0 5 note: GC not initialized 2024-09-14T10:52:39.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.239+0000 7f6efcfe1640 20 reqs_thread_entry: start 2024-09-14T10:52:39.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.239+0000 7f704a04a9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:39.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.239+0000 7f704a04a9c0 20 Filter name: none 2024-09-14T10:52:39.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f6e767fc640 20 reqs_thread_entry: start 2024-09-14T10:52:39.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:39.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:39.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:39.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:39.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 INFO: main: starting shard=0 2024-09-14T10:52:39.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:39.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 INFO: main: starting shard=1 2024-09-14T10:52:39.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.243+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:39.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 INFO: main: starting shard=2 2024-09-14T10:52:39.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:39.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 INFO: main: starting shard=3 2024-09-14T10:52:39.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:39.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 INFO: main: starting shard=4 2024-09-14T10:52:39.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:39.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 INFO: main: starting shard=5 2024-09-14T10:52:39.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.247+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:39.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 INFO: main: starting shard=6 2024-09-14T10:52:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 INFO: main: starting shard=7 2024-09-14T10:52:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:39.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 INFO: main: starting shard=8 2024-09-14T10:52:39.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:39.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.251+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:52:39.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.255+0000 7f704a04a9c0 20 INFO: main: starting shard=9 2024-09-14T10:52:39.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.255+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:39.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.255+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.255+0000 7f704a04a9c0 20 INFO: main: starting shard=10 2024-09-14T10:52:39.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.255+0000 7f704a04a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:39.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.255+0000 7f704a04a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:39.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.255+0000 7f704a04a9c0 20 INFO: main: done 2024-09-14T10:52:39.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.255+0000 7f6efdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:39.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.263+0000 7f704a04a9c0 20 remove_watcher() i=0 2024-09-14T10:52:39.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.263+0000 7f704a04a9c0 2 removed watcher, disabling cache 2024-09-14T10:52:39.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.263+0000 7f704a04a9c0 20 remove_watcher() i=1 2024-09-14T10:52:39.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.267+0000 7f704a04a9c0 20 remove_watcher() i=2 2024-09-14T10:52:39.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.267+0000 7f704a04a9c0 20 remove_watcher() i=3 2024-09-14T10:52:39.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.271+0000 7f704a04a9c0 20 remove_watcher() i=4 2024-09-14T10:52:39.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.271+0000 7f704a04a9c0 20 remove_watcher() i=5 2024-09-14T10:52:39.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.275+0000 7f704a04a9c0 20 remove_watcher() i=6 2024-09-14T10:52:39.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.279+0000 7f704a04a9c0 20 remove_watcher() i=7 2024-09-14T10:52:39.299 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:39.300 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:39.335 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:39.336 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:39.385 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:39.385 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:39.557 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:52:39.558 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:52:39.593 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:39.594 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:39.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.639+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:39.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 realm 2024-09-14T10:52:39.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:39.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:39.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:39.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:39.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.643+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:39.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.647+0000 7fb6c638d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:39.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.647+0000 7fb6c638d9c0 20 searching for the correct realm 2024-09-14T10:52:39.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.647+0000 7fb6c3e93640 0 -- 172.21.15.148:0/4174439251 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fb6b401f060 msgr2=0x7fb6b405bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:39.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:39.859+0000 7fb6c3e93640 0 -- 172.21.15.148:0/4174439251 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fb6ac003be0 msgr2=0x7fb6bc068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:40.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:40.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:40.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:40.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:40.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:40.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:40.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:40.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.075+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:40.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 zone default found 2024-09-14T10:52:40.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 4 Realm: () 2024-09-14T10:52:40.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:40.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:40.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:40.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 zonegroup default 2024-09-14T10:52:40.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 started sync module instance, tier type = 2024-09-14T10:52:40.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.079+0000 7fb6c638d9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:40.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.107+0000 7fb6c638d9c0 20 add_watcher() i=0 2024-09-14T10:52:40.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.107+0000 7fb6c638d9c0 20 add_watcher() i=1 2024-09-14T10:52:40.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.107+0000 7fb6c638d9c0 20 add_watcher() i=2 2024-09-14T10:52:40.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.107+0000 7fb6c638d9c0 20 add_watcher() i=3 2024-09-14T10:52:40.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.107+0000 7fb6c638d9c0 20 add_watcher() i=4 2024-09-14T10:52:40.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.107+0000 7fb6c638d9c0 20 add_watcher() i=5 2024-09-14T10:52:40.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.107+0000 7fb6c638d9c0 20 add_watcher() i=6 2024-09-14T10:52:40.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.111+0000 7fb6c638d9c0 20 add_watcher() i=7 2024-09-14T10:52:40.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.111+0000 7fb6c638d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:40.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.115+0000 7fb579fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:40.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.115+0000 7fb6c638d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:40.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.115+0000 7fb6c638d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:40.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.115+0000 7fb6c638d9c0 5 note: GC not initialized 2024-09-14T10:52:40.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.115+0000 7fb578fe1640 20 reqs_thread_entry: start 2024-09-14T10:52:40.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:40.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 Filter name: none 2024-09-14T10:52:40.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb4f27fc640 20 reqs_thread_entry: start 2024-09-14T10:52:40.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:40.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:40.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:40.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:40.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 INFO: main: starting shard=0 2024-09-14T10:52:40.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:40.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 INFO: main: starting shard=1 2024-09-14T10:52:40.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.119+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:40.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 INFO: main: starting shard=2 2024-09-14T10:52:40.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:40.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 INFO: main: starting shard=3 2024-09-14T10:52:40.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:40.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 INFO: main: starting shard=4 2024-09-14T10:52:40.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:40.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 INFO: main: starting shard=5 2024-09-14T10:52:40.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.123+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:40.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:52:40.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 INFO: main: starting shard=6 2024-09-14T10:52:40.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:40.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 INFO: main: starting shard=7 2024-09-14T10:52:40.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:40.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 INFO: main: starting shard=8 2024-09-14T10:52:40.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.127+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:40.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb6c638d9c0 20 INFO: main: starting shard=9 2024-09-14T10:52:40.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:40.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb6c638d9c0 20 INFO: main: starting shard=10 2024-09-14T10:52:40.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb6c638d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:40.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb6c638d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb6c638d9c0 20 INFO: main: done 2024-09-14T10:52:40.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.131+0000 7fb579fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:40.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.139+0000 7fb6c638d9c0 20 remove_watcher() i=0 2024-09-14T10:52:40.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.139+0000 7fb6c638d9c0 2 removed watcher, disabling cache 2024-09-14T10:52:40.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.139+0000 7fb6c638d9c0 20 remove_watcher() i=1 2024-09-14T10:52:40.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.143+0000 7fb6c638d9c0 20 remove_watcher() i=2 2024-09-14T10:52:40.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.143+0000 7fb6c638d9c0 20 remove_watcher() i=3 2024-09-14T10:52:40.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.147+0000 7fb6c638d9c0 20 remove_watcher() i=4 2024-09-14T10:52:40.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.151+0000 7fb6c638d9c0 20 remove_watcher() i=5 2024-09-14T10:52:40.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.151+0000 7fb6c638d9c0 20 remove_watcher() i=6 2024-09-14T10:52:40.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.155+0000 7fb6c638d9c0 20 remove_watcher() i=7 2024-09-14T10:52:40.176 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:40.176 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:40.215 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:40.215 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:40.276 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:40.277 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:40.453 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:52:40.454 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:52:40.489 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:40.489 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:40.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.535+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.535+0000 7f06c7fd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.535+0000 7f06c7fd99c0 20 realm 2024-09-14T10:52:40.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.535+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:40.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:40.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.539+0000 7f06c7fd99c0 20 searching for the correct realm 2024-09-14T10:52:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.547+0000 7f06c52de640 0 -- 172.21.15.148:0/1928864430 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5606b1a5bab0 msgr2=0x5606b1a5dea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:52:40.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.551+0000 7f06c5adf640 0 -- 172.21.15.148:0/1928864430 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f06c00bec40 msgr2=0x7f06c00b3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 zone default found 2024-09-14T10:52:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 4 Realm: () 2024-09-14T10:52:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 zonegroup default 2024-09-14T10:52:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.559+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.563+0000 7f06c7fd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.563+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.563+0000 7f06c7fd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.563+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.563+0000 7f06c7fd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.563+0000 7f06c7fd99c0 20 started sync module instance, tier type = 2024-09-14T10:52:40.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.563+0000 7f06c7fd99c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:40.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.583+0000 7f06c7fd99c0 20 add_watcher() i=0 2024-09-14T10:52:40.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.583+0000 7f06c7fd99c0 20 add_watcher() i=1 2024-09-14T10:52:40.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.583+0000 7f06c7fd99c0 20 add_watcher() i=2 2024-09-14T10:52:40.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.583+0000 7f06c7fd99c0 20 add_watcher() i=3 2024-09-14T10:52:40.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.583+0000 7f06c7fd99c0 20 add_watcher() i=4 2024-09-14T10:52:40.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.583+0000 7f06c7fd99c0 20 add_watcher() i=5 2024-09-14T10:52:40.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.583+0000 7f06c7fd99c0 20 add_watcher() i=6 2024-09-14T10:52:40.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.587+0000 7f06c7fd99c0 20 add_watcher() i=7 2024-09-14T10:52:40.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.587+0000 7f06c7fd99c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:40.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f05777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:40.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:40.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 5 note: GC not initialized 2024-09-14T10:52:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f05767fc640 20 reqs_thread_entry: start 2024-09-14T10:52:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 Filter name: none 2024-09-14T10:52:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f04e7fff640 20 reqs_thread_entry: start 2024-09-14T10:52:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:40.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:40.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:40.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 INFO: main: starting shard=0 2024-09-14T10:52:40.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:40.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 INFO: main: starting shard=1 2024-09-14T10:52:40.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.591+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:40.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:52:40.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 INFO: main: starting shard=2 2024-09-14T10:52:40.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 INFO: main: starting shard=3 2024-09-14T10:52:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 INFO: main: starting shard=4 2024-09-14T10:52:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.595+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:40.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 INFO: main: starting shard=5 2024-09-14T10:52:40.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:40.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 INFO: main: starting shard=6 2024-09-14T10:52:40.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:40.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 INFO: main: starting shard=7 2024-09-14T10:52:40.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:40.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 INFO: main: starting shard=8 2024-09-14T10:52:40.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.599+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:40.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.603+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.603+0000 7f06c7fd99c0 20 INFO: main: starting shard=9 2024-09-14T10:52:40.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.603+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:40.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.603+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.603+0000 7f06c7fd99c0 20 INFO: main: starting shard=10 2024-09-14T10:52:40.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.603+0000 7f06c7fd99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:40.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.603+0000 7f06c7fd99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.603+0000 7f06c7fd99c0 20 INFO: main: done 2024-09-14T10:52:40.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.607+0000 7f05777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:40.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.611+0000 7f06c7fd99c0 20 remove_watcher() i=0 2024-09-14T10:52:40.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.611+0000 7f06c7fd99c0 2 removed watcher, disabling cache 2024-09-14T10:52:40.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.615+0000 7f06c7fd99c0 20 remove_watcher() i=1 2024-09-14T10:52:40.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.619+0000 7f06c7fd99c0 20 remove_watcher() i=2 2024-09-14T10:52:40.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.619+0000 7f06c7fd99c0 20 remove_watcher() i=3 2024-09-14T10:52:40.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.623+0000 7f06c7fd99c0 20 remove_watcher() i=4 2024-09-14T10:52:40.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.623+0000 7f06c7fd99c0 20 remove_watcher() i=5 2024-09-14T10:52:40.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.627+0000 7f06c7fd99c0 20 remove_watcher() i=6 2024-09-14T10:52:40.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.631+0000 7f06c7fd99c0 20 remove_watcher() i=7 2024-09-14T10:52:40.644 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:40.644 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:40.670 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:40.670 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:40.769 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:52:40.769 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:52:40.803 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:40.803 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:40.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 20 realm 2024-09-14T10:52:40.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:40.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.847+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.851+0000 7f57b20d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:40.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.851+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.851+0000 7f57b20d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:40.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.851+0000 7f57b20d09c0 20 searching for the correct realm 2024-09-14T10:52:40.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.855+0000 7f57af3d5640 0 -- 172.21.15.148:0/3459801904 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x561a06adc8b0 msgr2=0x561a06adeca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:52:40.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.863+0000 7f57afbd6640 0 -- 172.21.15.148:0/3459801904 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f57a8038040 msgr2=0x7f57a8038420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:40.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:40.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:40.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:40.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:40.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:40.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:40.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 zone default found 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 4 Realm: () 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 zonegroup default 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:40.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 started sync module instance, tier type = 2024-09-14T10:52:40.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.871+0000 7f57b20d09c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:40.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.891+0000 7f57b20d09c0 20 add_watcher() i=0 2024-09-14T10:52:40.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.891+0000 7f57b20d09c0 20 add_watcher() i=1 2024-09-14T10:52:40.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.891+0000 7f57b20d09c0 20 add_watcher() i=2 2024-09-14T10:52:40.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.891+0000 7f57b20d09c0 20 add_watcher() i=3 2024-09-14T10:52:40.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.891+0000 7f57b20d09c0 20 add_watcher() i=4 2024-09-14T10:52:40.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.891+0000 7f57b20d09c0 20 add_watcher() i=5 2024-09-14T10:52:40.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.891+0000 7f57b20d09c0 20 add_watcher() i=6 2024-09-14T10:52:40.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.895+0000 7f57b20d09c0 20 add_watcher() i=7 2024-09-14T10:52:40.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.895+0000 7f57b20d09c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:40.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f5665fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:40.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f57b20d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:40.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f57b20d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:40.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f57b20d09c0 5 note: GC not initialized 2024-09-14T10:52:40.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f5664fe1640 20 reqs_thread_entry: start 2024-09-14T10:52:40.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f57b20d09c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:40.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f57b20d09c0 20 Filter name: none 2024-09-14T10:52:40.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f55de7fc640 20 reqs_thread_entry: start 2024-09-14T10:52:40.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f57b20d09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:40.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.899+0000 7f57b20d09c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:40.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:40.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:40.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:40.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 INFO: main: starting shard=0 2024-09-14T10:52:40.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:40.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 INFO: main: starting shard=1 2024-09-14T10:52:40.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:40.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 INFO: main: starting shard=2 2024-09-14T10:52:40.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:40.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 INFO: main: starting shard=3 2024-09-14T10:52:40.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.903+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:40.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 INFO: main: starting shard=4 2024-09-14T10:52:40.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:40.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 INFO: main: starting shard=5 2024-09-14T10:52:40.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:40.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 INFO: main: starting shard=6 2024-09-14T10:52:40.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:40.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 INFO: main: starting shard=7 2024-09-14T10:52:40.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.907+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:40.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 INFO: main: starting shard=8 2024-09-14T10:52:40.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:40.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 INFO: main: starting shard=9 2024-09-14T10:52:40.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:40.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:40.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 INFO: main: starting shard=10 2024-09-14T10:52:40.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.911+0000 7f57b20d09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:40.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.915+0000 7f57b20d09c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:52:40.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.915+0000 7f57b20d09c0 20 INFO: main: done 2024-09-14T10:52:40.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.915+0000 7f5665fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:40.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.919+0000 7f57b20d09c0 20 remove_watcher() i=0 2024-09-14T10:52:40.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.919+0000 7f57b20d09c0 2 removed watcher, disabling cache 2024-09-14T10:52:40.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.923+0000 7f57b20d09c0 20 remove_watcher() i=1 2024-09-14T10:52:40.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.923+0000 7f57b20d09c0 20 remove_watcher() i=2 2024-09-14T10:52:40.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.927+0000 7f57b20d09c0 20 remove_watcher() i=3 2024-09-14T10:52:40.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.927+0000 7f57b20d09c0 20 remove_watcher() i=4 2024-09-14T10:52:40.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.931+0000 7f57b20d09c0 20 remove_watcher() i=5 2024-09-14T10:52:40.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.931+0000 7f57b20d09c0 20 remove_watcher() i=6 2024-09-14T10:52:40.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:40.935+0000 7f57b20d09c0 20 remove_watcher() i=7 2024-09-14T10:52:40.953 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:40.953 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:40.985 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:52:41.430 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:52:41.853 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T10:52:41.853 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:41.853 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:52:41.882 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:41.882 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:41.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.919+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:41.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 realm 2024-09-14T10:52:41.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:41.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:41.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:41.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:41.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:41.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.923+0000 7fbbb3ed79c0 20 searching for the correct realm 2024-09-14T10:52:41.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.931+0000 7fbbb11dc640 0 -- 172.21.15.148:0/1773712281 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55e2075d9fb0 msgr2=0x55e2075dc450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:41.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.935+0000 7fbbb19dd640 0 -- 172.21.15.148:0/1773712281 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55e2075de220 msgr2=0x55e2075e0650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:41.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:41.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:41.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:41.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:41.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:41.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:41.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 zone default found 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 4 Realm: () 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:41.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 zonegroup default 2024-09-14T10:52:41.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:41.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:41.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.943+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.947+0000 7fbbb3ed79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:41.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.947+0000 7fbbb3ed79c0 20 started sync module instance, tier type = 2024-09-14T10:52:41.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.947+0000 7fbbb3ed79c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:41.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.971+0000 7fbbb3ed79c0 20 add_watcher() i=0 2024-09-14T10:52:41.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.971+0000 7fbbb3ed79c0 20 add_watcher() i=1 2024-09-14T10:52:41.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.971+0000 7fbbb3ed79c0 20 add_watcher() i=2 2024-09-14T10:52:41.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.971+0000 7fbbb3ed79c0 20 add_watcher() i=3 2024-09-14T10:52:41.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.971+0000 7fbbb3ed79c0 20 add_watcher() i=4 2024-09-14T10:52:41.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.971+0000 7fbbb3ed79c0 20 add_watcher() i=5 2024-09-14T10:52:41.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.971+0000 7fbbb3ed79c0 20 add_watcher() i=6 2024-09-14T10:52:41.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 20 add_watcher() i=7 2024-09-14T10:52:41.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:41.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fba637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 5 note: GC not initialized 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fba627fc640 20 reqs_thread_entry: start 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 20 Filter name: none 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fb9d3fff640 20 reqs_thread_entry: start 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:41.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.975+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:41.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:41.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:41.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:41.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:41.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:41.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:41.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:41.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:41.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:41.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:41.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:41.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:52:41.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:41.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:41.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:52:41.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.979+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:41.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:52:41.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:41.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:52:41.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:41.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:41.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:52:41.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:41.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:52:41.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.983+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:41.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.987+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:41.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.987+0000 7fbbb3ed79c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:52:41.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.987+0000 7fbbb3ed79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:41.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.987+0000 7fbbb3ed79c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T10:52:41.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.987+0000 7fbbb3ed79c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T10:52:41.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.987+0000 7fbbb3ed79c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T10:52:41.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.987+0000 7fbbb3ed79c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T10:52:41.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.987+0000 7fbbb3ed79c0 1 NOTICE: finished all shards (4 entries found) 2024-09-14T10:52:41.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.991+0000 7fba637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:41.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.991+0000 7fbbb3ed79c0 20 remove_watcher() i=0 2024-09-14T10:52:41.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.991+0000 7fbbb3ed79c0 2 removed watcher, disabling cache 2024-09-14T10:52:41.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.995+0000 7fbbb3ed79c0 20 remove_watcher() i=1 2024-09-14T10:52:41.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.995+0000 7fbbb3ed79c0 20 remove_watcher() i=2 2024-09-14T10:52:41.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.999+0000 7fbbb3ed79c0 20 remove_watcher() i=3 2024-09-14T10:52:41.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:41.999+0000 7fbbb3ed79c0 20 remove_watcher() i=4 2024-09-14T10:52:42.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.003+0000 7fbbb3ed79c0 20 remove_watcher() i=5 2024-09-14T10:52:42.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.007+0000 7fbbb3ed79c0 20 remove_watcher() i=6 2024-09-14T10:52:42.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.007+0000 7fbbb3ed79c0 20 remove_watcher() i=7 2024-09-14T10:52:42.018 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: unlinked entries are not listable 2024-09-14T10:52:42.019 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:42.020 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:42.020 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:42.195 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T10:52:42.195 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:42.198 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:42.199 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:42.318 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:42.318 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:42.421 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T10:52:42.421 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:42.421 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:52:42.461 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:42.462 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:42.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.507+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:42.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 realm 2024-09-14T10:52:42.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:42.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:42.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:42.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:42.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:42.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.511+0000 7f45d8a2c9c0 20 searching for the correct realm 2024-09-14T10:52:42.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.515+0000 7f45d5d31640 0 -- 172.21.15.148:0/2789871854 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f45d001f070 msgr2=0x7f45d002c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:52:42.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.727+0000 7f45d6d33640 0 -- 172.21.15.148:0/2789871854 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55a710698870 msgr2=0x55a71069acc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:42.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:42.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:42.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:42.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:42.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:42.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:42.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:42.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:42.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:42.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 zone default found 2024-09-14T10:52:42.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 4 Realm: () 2024-09-14T10:52:42.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:42.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:42.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:42.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 zonegroup default 2024-09-14T10:52:42.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.739+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.743+0000 7f45d8a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:42.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.743+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.743+0000 7f45d8a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:42.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.743+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.743+0000 7f45d8a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:42.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.743+0000 7f45d8a2c9c0 20 started sync module instance, tier type = 2024-09-14T10:52:42.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.743+0000 7f45d8a2c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:42.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.767+0000 7f45d8a2c9c0 20 add_watcher() i=0 2024-09-14T10:52:42.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.767+0000 7f45d8a2c9c0 20 add_watcher() i=1 2024-09-14T10:52:42.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.767+0000 7f45d8a2c9c0 20 add_watcher() i=2 2024-09-14T10:52:42.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.767+0000 7f45d8a2c9c0 20 add_watcher() i=3 2024-09-14T10:52:42.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.767+0000 7f45d8a2c9c0 20 add_watcher() i=4 2024-09-14T10:52:42.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.767+0000 7f45d8a2c9c0 20 add_watcher() i=5 2024-09-14T10:52:42.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.767+0000 7f45d8a2c9c0 20 add_watcher() i=6 2024-09-14T10:52:42.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.771+0000 7f45d8a2c9c0 20 add_watcher() i=7 2024-09-14T10:52:42.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.771+0000 7f45d8a2c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:42.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.775+0000 7f448d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:42.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.775+0000 7f45d8a2c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:42.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.775+0000 7f45d8a2c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:42.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.775+0000 7f45d8a2c9c0 5 note: GC not initialized 2024-09-14T10:52:42.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f44877fe640 20 reqs_thread_entry: start 2024-09-14T10:52:42.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:42.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 20 Filter name: none 2024-09-14T10:52:42.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f44857fa640 20 reqs_thread_entry: start 2024-09-14T10:52:42.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:42.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:42.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:42.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:42.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:42.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:42.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:42.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:42.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:42.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:42.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:42.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:42.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.779+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:42.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.783+0000 7f45d8a2c9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:52:42.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.783+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:42.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.783+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:42.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.783+0000 7f45d8a2c9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:52:42.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.783+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:42.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.783+0000 7f45d8a2c9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:52:42.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.783+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:42.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.787+0000 7f45d8a2c9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:52:42.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.787+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:42.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.787+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:42.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.791+0000 7f45d8a2c9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:52:42.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.791+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:42.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.791+0000 7f45d8a2c9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:52:42.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.791+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:42.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.791+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:42.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.791+0000 7f45d8a2c9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:52:42.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.791+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:42.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.795+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:42.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.795+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7104279c0 obj=check-bucket:e state=0x55a7106d6808 s->prefetch_data=0 2024-09-14T10:52:42.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.795+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:42.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.795+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a710439630 obj=check-bucket:d state=0x55a7106d1df8 s->prefetch_data=0 2024-09-14T10:52:42.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.795+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:42.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.795+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7106d9020 obj=check-bucket:c state=0x55a7106d3c48 s->prefetch_data=0 2024-09-14T10:52:42.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.795+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:42.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7106d4900 obj=check-bucket:f state=0x55a7106d2bf8 s->prefetch_data=0 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state: setting s->obj_tag to u91kndrd6ywiv2v7nbyg31x49gye789n 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state_impl: setting s->olh_tag to o82u6v775uwkcf9mlg1w4vbsevugulp0 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o82u6v775uwkcf9mlg1w4vbsevugulp0 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state: setting s->obj_tag to 78aa46begcjbdc4iikqcyrh9dej3o4hb 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state_impl: setting s->olh_tag to e1mguu4vmr390voo90ihrftqdcahxo3f 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=e1mguu4vmr390voo90ihrftqdcahxo3f 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state: setting s->obj_tag to 1gyuoleyb4b9bmrnygce5ux6vhyzjd8a 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state_impl: setting s->olh_tag to pja79533vjjx3c2enkgr1skz9p4tqv3u 2024-09-14T10:52:42.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pja79533vjjx3c2enkgr1skz9p4tqv3u 2024-09-14T10:52:42.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state: setting s->obj_tag to 0ygsjrqielqyn9wnc228zk79zer2cqr8 2024-09-14T10:52:42.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 get_obj_state_impl: setting s->olh_tag to cv05vkt4c4jn0bidogkw9wg4wvcm3ds4 2024-09-14T10:52:42.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cv05vkt4c4jn0bidogkw9wg4wvcm3ds4 2024-09-14T10:52:42.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.799+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:42.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.803+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:42.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.803+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:42.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:42.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 olh_log_entry: epoch=3 op=3 key=d[uACg.-XJdZXFSzZcZnH5z3ywwtP2lFs] 2024-09-14T10:52:42.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a710439630 obj=check-bucket:_:uACg.-XJdZXFSzZcZnH5z3ywwtP2lFs_d state=0x55a71077ae68 s->prefetch_data=0 2024-09-14T10:52:42.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:42.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:42.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 10 manifest: total_size = 11 2024-09-14T10:52:42.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4884794985559594838 2024-09-14T10:52:42.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a710439630 obj=check-bucket:_:uACg.-XJdZXFSzZcZnH5z3ywwtP2lFs_d state=0x55a71077ae68 s->prefetch_data=0 2024-09-14T10:52:42.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a71077ae68 2024-09-14T10:52:42.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:42.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 olh_log_entry: epoch=3 op=3 key=c[cL-8d1VaNfytP0M-f7xOgbFJb5QfHTw] 2024-09-14T10:52:42.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7106d9020 obj=check-bucket:_:cL-8d1VaNfytP0M-f7xOgbFJb5QfHTw_c state=0x55a7107860f8 s->prefetch_data=0 2024-09-14T10:52:42.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 10 manifest: total_size = 12 2024-09-14T10:52:42.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17654371264403356668 2024-09-14T10:52:42.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7106d9020 obj=check-bucket:_:cL-8d1VaNfytP0M-f7xOgbFJb5QfHTw_c state=0x55a7107860f8 s->prefetch_data=0 2024-09-14T10:52:42.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a7107860f8 2024-09-14T10:52:42.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.807+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:42.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:42.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T10:52:42.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 20 olh_log_entry: epoch=2 op=3 key=f[pmCgHKfr48PYDp9EDXjyZckwKeW87jE] 2024-09-14T10:52:42.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7106d4900 obj=check-bucket:_:pmCgHKfr48PYDp9EDXjyZckwKeW87jE_f state=0x55a71078fbb8 s->prefetch_data=0 2024-09-14T10:52:42.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 10 manifest: total_size = 9 2024-09-14T10:52:42.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12829623599878999126 2024-09-14T10:52:42.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7106d4900 obj=check-bucket:_:pmCgHKfr48PYDp9EDXjyZckwKeW87jE_f state=0x55a71078fbb8 s->prefetch_data=0 2024-09-14T10:52:42.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a71078fbb8 2024-09-14T10:52:42.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.811+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:42.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:42.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T10:52:42.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 olh_log_entry: epoch=2 op=3 key=e[GRljltEozIzUh.u96LRhZX0ilDaST4v] 2024-09-14T10:52:42.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7104279c0 obj=check-bucket:_:GRljltEozIzUh.u96LRhZX0ilDaST4v_e state=0x55a7107959f8 s->prefetch_data=0 2024-09-14T10:52:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:52:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T10:52:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 0 deleting objects inline since gc isn't initialized 2024-09-14T10:52:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2__shadow:cL-8d1VaNfytP0M-f7xOgbFJb5QfHTw_.NkvfT_IOXz6WOQhpUPSRtWYOCtCj1Nt_0 2024-09-14T10:52:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 10 manifest: total_size = 12 2024-09-14T10:52:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1542987367074265977 2024-09-14T10:52:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7104279c0 obj=check-bucket:_:GRljltEozIzUh.u96LRhZX0ilDaST4v_e state=0x55a7107959f8 s->prefetch_data=0 2024-09-14T10:52:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a7107959f8 2024-09-14T10:52:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:52:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T10:52:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 0 deleting objects inline since gc isn't initialized 2024-09-14T10:52:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.815+0000 7f45d8a2c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2__shadow:uACg.-XJdZXFSzZcZnH5z3ywwtP2lFs_.QQ-8I3BXIpvZHdByyn1h5k5zCk8ccxT_0 2024-09-14T10:52:42.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.823+0000 7f44b97fa640 20 handle_completion(): completion ok for obj=d[uACg.-XJdZXFSzZcZnH5z3ywwtP2lFs] 2024-09-14T10:52:42.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.823+0000 7f45d8a2c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:52:42.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.823+0000 7f44b97fa640 20 handle_completion(): completion ok for obj=c[cL-8d1VaNfytP0M-f7xOgbFJb5QfHTw] 2024-09-14T10:52:42.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.823+0000 7f45d8a2c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:52:42.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.823+0000 7f45d8a2c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:52:42.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.823+0000 7f45d8a2c9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T10:52:42.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.823+0000 7f45d8a2c9c0 0 deleting objects inline since gc isn't initialized 2024-09-14T10:52:42.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.823+0000 7f45d8a2c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2__shadow:pmCgHKfr48PYDp9EDXjyZckwKeW87jE_.TvG8yxTOJF6ATPe5LbApLrVdoAj23tq_0 2024-09-14T10:52:42.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.827+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:42.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.827+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:42.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f44b9ffb640 20 handle_completion(): completion ok for obj=f[pmCgHKfr48PYDp9EDXjyZckwKeW87jE] 2024-09-14T10:52:42.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:42.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:42.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:52:42.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T10:52:42.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 0 deleting objects inline since gc isn't initialized 2024-09-14T10:52:42.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2__shadow:GRljltEozIzUh.u96LRhZX0ilDaST4v_.M3VCxHw8MQi2dFUlbFu_Czw8MyebdB7_0 2024-09-14T10:52:42.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:52:42.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:42.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.831+0000 7f45d8a2c9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:52:42.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.835+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:42.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.835+0000 7f45d8a2c9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:52:42.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.839+0000 7f45d8a2c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:52:42.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.839+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7106d4900 obj=check-bucket:f state=0x55a7106d2bf8 s->prefetch_data=0 2024-09-14T10:52:42.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.839+0000 7f45d8a2c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cv05vkt4c4jn0bidogkw9wg4wvcm3ds4 2024-09-14T10:52:42.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.839+0000 7f44b9ffb640 20 handle_completion(): completion ok for obj=e[GRljltEozIzUh.u96LRhZX0ilDaST4v] 2024-09-14T10:52:42.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.847+0000 7f45d8a2c9c0 20 get_obj_state: octx=0x55a7104279c0 obj=check-bucket:e state=0x55a7106d6808 s->prefetch_data=0 2024-09-14T10:52:42.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.847+0000 7f45d8a2c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o82u6v775uwkcf9mlg1w4vbsevugulp0 2024-09-14T10:52:42.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.855+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:42.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.859+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:42.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.859+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:42.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.859+0000 7f45d8a2c9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T10:52:42.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.863+0000 7f45d8a2c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:42.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.863+0000 7f45d8a2c9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T10:52:42.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.863+0000 7f45d8a2c9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T10:52:42.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.863+0000 7f448d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:42.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.871+0000 7f45d8a2c9c0 20 remove_watcher() i=0 2024-09-14T10:52:42.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.871+0000 7f45d8a2c9c0 2 removed watcher, disabling cache 2024-09-14T10:52:42.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.871+0000 7f45d8a2c9c0 20 remove_watcher() i=1 2024-09-14T10:52:42.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.875+0000 7f45d8a2c9c0 20 remove_watcher() i=2 2024-09-14T10:52:42.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.875+0000 7f45d8a2c9c0 20 remove_watcher() i=3 2024-09-14T10:52:42.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.879+0000 7f45d8a2c9c0 20 remove_watcher() i=4 2024-09-14T10:52:42.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.879+0000 7f45d8a2c9c0 20 remove_watcher() i=5 2024-09-14T10:52:42.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.883+0000 7f45d8a2c9c0 20 remove_watcher() i=6 2024-09-14T10:52:42.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:42.887+0000 7f45d8a2c9c0 20 remove_watcher() i=7 2024-09-14T10:52:42.906 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:42.906 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:42.933 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:42.933 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:42.969 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:42.969 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:43.023 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:43.023 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:43.082 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T10:52:43.082 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:43.084 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:43.085 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:43.224 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:43.224 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:43.288 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:43.288 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:43.360 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:43.360 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:43.434 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:43.434 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:43.502 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T10:52:43.502 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:43.502 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:52:43.539 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:43.539 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:43.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.583+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:43.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 realm 2024-09-14T10:52:43.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:43.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:43.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:43.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:43.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:43.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.587+0000 7f9c638219c0 20 searching for the correct realm 2024-09-14T10:52:43.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.595+0000 7f9c60b26640 0 -- 172.21.15.148:0/1126149149 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f9c54008050 msgr2=0x7f9c540940c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.599+0000 7f9c60b26640 0 -- 172.21.15.148:0/1126149149 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x561388c68420 msgr2=0x561388c6a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:43.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:43.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.607+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 zone default found 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 4 Realm: () 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 zonegroup default 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:43.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:43.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:43.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 started sync module instance, tier type = 2024-09-14T10:52:43.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.611+0000 7f9c638219c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:43.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.631+0000 7f9c638219c0 20 add_watcher() i=0 2024-09-14T10:52:43.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.631+0000 7f9c638219c0 20 add_watcher() i=1 2024-09-14T10:52:43.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.631+0000 7f9c638219c0 20 add_watcher() i=2 2024-09-14T10:52:43.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.631+0000 7f9c638219c0 20 add_watcher() i=3 2024-09-14T10:52:43.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.631+0000 7f9c638219c0 20 add_watcher() i=4 2024-09-14T10:52:43.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.631+0000 7f9c638219c0 20 add_watcher() i=5 2024-09-14T10:52:43.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.631+0000 7f9c638219c0 20 add_watcher() i=6 2024-09-14T10:52:43.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.635+0000 7f9c638219c0 20 add_watcher() i=7 2024-09-14T10:52:43.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.635+0000 7f9c638219c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:43.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9b177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 5 note: GC not initialized 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9b167e4640 20 reqs_thread_entry: start 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 20 Filter name: none 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9a87fff640 20 reqs_thread_entry: start 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:43.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:43.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:43.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:43.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:43.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:43.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:43.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:43.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:43.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:43.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.639+0000 7f9c638219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:43.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.643+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:43.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.643+0000 7f9c638219c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:52:43.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.643+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:43.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.643+0000 7f9c638219c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:52:43.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.643+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:43.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.643+0000 7f9c638219c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:52:43.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.643+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:43.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.647+0000 7f9c638219c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:52:43.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.647+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:43.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.647+0000 7f9c638219c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:52:43.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.647+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:43.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.647+0000 7f9c638219c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:52:43.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.647+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:43.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.647+0000 7f9c638219c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:52:43.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.647+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:43.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.651+0000 7f9c638219c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:52:43.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.651+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:43.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.651+0000 7f9c638219c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:52:43.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.651+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:43.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.651+0000 7f9c638219c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:52:43.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.651+0000 7f9c638219c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:43.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.651+0000 7f9c638219c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:52:43.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.651+0000 7f9c638219c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:52:43.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.655+0000 7f9b177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:43.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.659+0000 7f9c638219c0 20 remove_watcher() i=0 2024-09-14T10:52:43.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.659+0000 7f9c638219c0 2 removed watcher, disabling cache 2024-09-14T10:52:43.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.659+0000 7f9c638219c0 20 remove_watcher() i=1 2024-09-14T10:52:43.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.663+0000 7f9c638219c0 20 remove_watcher() i=2 2024-09-14T10:52:43.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.663+0000 7f9c638219c0 20 remove_watcher() i=3 2024-09-14T10:52:43.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.667+0000 7f9c638219c0 20 remove_watcher() i=4 2024-09-14T10:52:43.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.667+0000 7f9c638219c0 20 remove_watcher() i=5 2024-09-14T10:52:43.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.671+0000 7f9c638219c0 20 remove_watcher() i=6 2024-09-14T10:52:43.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:43.675+0000 7f9c638219c0 20 remove_watcher() i=7 2024-09-14T10:52:43.689 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:43.690 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:44.028 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:44.029 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:44.178 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:52:44.212 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:44.212 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:44.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.259+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.259+0000 7f822b1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.259+0000 7f822b1b59c0 20 realm 2024-09-14T10:52:44.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.259+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:44.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:44.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.263+0000 7f822b1b59c0 20 searching for the correct realm 2024-09-14T10:52:44.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.267+0000 7f82284ba640 0 -- 172.21.15.148:0/3376852432 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f82200cf040 msgr2=0x7f82200de420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:44.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.275+0000 7f8228cbb640 0 -- 172.21.15.148:0/3376852432 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f82200cf420 msgr2=0x7f82200cf860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:44.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:44.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:44.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:44.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:44.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:44.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:44.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:44.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 zone default found 2024-09-14T10:52:44.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 4 Realm: () 2024-09-14T10:52:44.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:44.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:44.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:44.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 zonegroup default 2024-09-14T10:52:44.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.283+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.287+0000 7f822b1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.287+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.287+0000 7f822b1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.287+0000 7f822b1b59c0 20 started sync module instance, tier type = 2024-09-14T10:52:44.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.287+0000 7f822b1b59c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:44.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.303+0000 7f822b1b59c0 20 add_watcher() i=0 2024-09-14T10:52:44.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.303+0000 7f822b1b59c0 20 add_watcher() i=1 2024-09-14T10:52:44.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.303+0000 7f822b1b59c0 20 add_watcher() i=2 2024-09-14T10:52:44.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.303+0000 7f822b1b59c0 20 add_watcher() i=3 2024-09-14T10:52:44.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.303+0000 7f822b1b59c0 20 add_watcher() i=4 2024-09-14T10:52:44.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.303+0000 7f822b1b59c0 20 add_watcher() i=5 2024-09-14T10:52:44.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.307+0000 7f822b1b59c0 20 add_watcher() i=6 2024-09-14T10:52:44.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.307+0000 7f822b1b59c0 20 add_watcher() i=7 2024-09-14T10:52:44.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.307+0000 7f822b1b59c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:44.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f80defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:44.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f822b1b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:44.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f822b1b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:44.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f822b1b59c0 5 note: GC not initialized 2024-09-14T10:52:44.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f80ddfe3640 20 reqs_thread_entry: start 2024-09-14T10:52:44.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f822b1b59c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:44.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f822b1b59c0 20 Filter name: none 2024-09-14T10:52:44.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f804f7fe640 20 reqs_thread_entry: start 2024-09-14T10:52:44.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f822b1b59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:44.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.311+0000 7f822b1b59c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:44.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:44.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:44.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: starting shard=0 2024-09-14T10:52:44.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:44.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: starting shard=1 2024-09-14T10:52:44.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:44.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: starting shard=2 2024-09-14T10:52:44.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:44.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: starting shard=3 2024-09-14T10:52:44.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:44.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 INFO: main: starting shard=4 2024-09-14T10:52:44.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.315+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:44.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 INFO: main: starting shard=5 2024-09-14T10:52:44.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:44.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 INFO: main: starting shard=6 2024-09-14T10:52:44.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:44.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 INFO: main: starting shard=7 2024-09-14T10:52:44.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:44.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 INFO: main: starting shard=8 2024-09-14T10:52:44.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.319+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:44.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.323+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T10:52:44.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.323+0000 7f822b1b59c0 20 INFO: main: starting shard=9 2024-09-14T10:52:44.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.323+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:44.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.323+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.323+0000 7f822b1b59c0 20 INFO: main: starting shard=10 2024-09-14T10:52:44.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.323+0000 7f822b1b59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:44.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.323+0000 7f822b1b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.323+0000 7f822b1b59c0 20 INFO: main: done 2024-09-14T10:52:44.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.327+0000 7f80defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:44.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.331+0000 7f822b1b59c0 20 remove_watcher() i=0 2024-09-14T10:52:44.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.331+0000 7f822b1b59c0 2 removed watcher, disabling cache 2024-09-14T10:52:44.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.331+0000 7f822b1b59c0 20 remove_watcher() i=1 2024-09-14T10:52:44.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.335+0000 7f822b1b59c0 20 remove_watcher() i=2 2024-09-14T10:52:44.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.335+0000 7f822b1b59c0 20 remove_watcher() i=3 2024-09-14T10:52:44.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.339+0000 7f822b1b59c0 20 remove_watcher() i=4 2024-09-14T10:52:44.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.343+0000 7f822b1b59c0 20 remove_watcher() i=5 2024-09-14T10:52:44.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.343+0000 7f822b1b59c0 20 remove_watcher() i=6 2024-09-14T10:52:44.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.347+0000 7f822b1b59c0 20 remove_watcher() i=7 2024-09-14T10:52:44.361 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:52:44.389 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:44.390 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:44.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.435+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.435+0000 7f9fedb519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.435+0000 7f9fedb519c0 20 realm 2024-09-14T10:52:44.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.435+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.435+0000 7f9fedb519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.435+0000 7f9fedb519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:44.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.435+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.439+0000 7f9fedb519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.439+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.439+0000 7f9fedb519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.439+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.439+0000 7f9fedb519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:44.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.439+0000 7f9fedb519c0 20 searching for the correct realm 2024-09-14T10:52:44.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.443+0000 7f9feae56640 0 -- 172.21.15.148:0/1220379238 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f9fe4001be0 msgr2=0x7f9fe4028410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:44.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.451+0000 7f9febe58640 0 -- 172.21.15.148:0/1220379238 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5621f35960e0 msgr2=0x5621f3598580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:44.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:44.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:44.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:44.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:44.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:44.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:44.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 zone default found 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 4 Realm: () 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 zonegroup default 2024-09-14T10:52:44.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.459+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.463+0000 7f9fedb519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.463+0000 7f9fedb519c0 20 started sync module instance, tier type = 2024-09-14T10:52:44.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.463+0000 7f9fedb519c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:44.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.479+0000 7f9fedb519c0 20 add_watcher() i=0 2024-09-14T10:52:44.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.479+0000 7f9fedb519c0 20 add_watcher() i=1 2024-09-14T10:52:44.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.479+0000 7f9fedb519c0 20 add_watcher() i=2 2024-09-14T10:52:44.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.479+0000 7f9fedb519c0 20 add_watcher() i=3 2024-09-14T10:52:44.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.479+0000 7f9fedb519c0 20 add_watcher() i=4 2024-09-14T10:52:44.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.479+0000 7f9fedb519c0 20 add_watcher() i=5 2024-09-14T10:52:44.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.479+0000 7f9fedb519c0 20 add_watcher() i=6 2024-09-14T10:52:44.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.483+0000 7f9fedb519c0 20 add_watcher() i=7 2024-09-14T10:52:44.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.483+0000 7f9fedb519c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:44.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9ea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9fedb519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9fedb519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9fedb519c0 5 note: GC not initialized 2024-09-14T10:52:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9ea0fe1640 20 reqs_thread_entry: start 2024-09-14T10:52:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9fedb519c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9fedb519c0 20 Filter name: none 2024-09-14T10:52:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9e1a7fc640 20 reqs_thread_entry: start 2024-09-14T10:52:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.487+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:44.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:44.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:44.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:44.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 INFO: main: starting shard=0 2024-09-14T10:52:44.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:44.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 INFO: main: starting shard=1 2024-09-14T10:52:44.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:44.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 INFO: main: starting shard=2 2024-09-14T10:52:44.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:44.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 INFO: main: starting shard=3 2024-09-14T10:52:44.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.491+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:44.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 INFO: main: starting shard=4 2024-09-14T10:52:44.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:44.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 INFO: main: starting shard=5 2024-09-14T10:52:44.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:44.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T10:52:44.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 INFO: main: starting shard=6 2024-09-14T10:52:44.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:44.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 INFO: main: starting shard=7 2024-09-14T10:52:44.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.495+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:44.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 INFO: main: starting shard=8 2024-09-14T10:52:44.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:44.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 INFO: main: starting shard=9 2024-09-14T10:52:44.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:44.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 INFO: main: starting shard=10 2024-09-14T10:52:44.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:44.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:44.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.499+0000 7f9fedb519c0 20 INFO: main: done 2024-09-14T10:52:44.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.503+0000 7f9ea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:44.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.507+0000 7f9fedb519c0 20 remove_watcher() i=0 2024-09-14T10:52:44.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.507+0000 7f9fedb519c0 2 removed watcher, disabling cache 2024-09-14T10:52:44.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.507+0000 7f9fedb519c0 20 remove_watcher() i=1 2024-09-14T10:52:44.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.511+0000 7f9fedb519c0 20 remove_watcher() i=2 2024-09-14T10:52:44.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.511+0000 7f9fedb519c0 20 remove_watcher() i=3 2024-09-14T10:52:44.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.515+0000 7f9fedb519c0 20 remove_watcher() i=4 2024-09-14T10:52:44.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.515+0000 7f9fedb519c0 20 remove_watcher() i=5 2024-09-14T10:52:44.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.519+0000 7f9fedb519c0 20 remove_watcher() i=6 2024-09-14T10:52:44.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.523+0000 7f9fedb519c0 20 remove_watcher() i=7 2024-09-14T10:52:44.535 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T10:52:44.535 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:44.536 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T10:52:44.565 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:44.565 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:44.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 20 realm 2024-09-14T10:52:44.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:44.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.611+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.615+0000 7f843782a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.615+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.615+0000 7f843782a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:44.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.615+0000 7f843782a9c0 20 searching for the correct realm 2024-09-14T10:52:44.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.619+0000 7f8435330640 0 -- 172.21.15.148:0/3747436990 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f842803cb10 msgr2=0x7f8428039930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:44.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.627+0000 7f8435330640 0 -- 172.21.15.148:0/3747436990 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f8430085050 msgr2=0x7f843003ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:44.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.631+0000 7f843782a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.631+0000 7f843782a9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.631+0000 7f843782a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.631+0000 7f843782a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.631+0000 7f843782a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.631+0000 7f843782a9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.631+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:44.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 zone default found 2024-09-14T10:52:44.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 4 Realm: () 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 zonegroup default 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 started sync module instance, tier type = 2024-09-14T10:52:44.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.635+0000 7f843782a9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:44.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.655+0000 7f843782a9c0 20 add_watcher() i=0 2024-09-14T10:52:44.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.655+0000 7f843782a9c0 20 add_watcher() i=1 2024-09-14T10:52:44.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.655+0000 7f843782a9c0 20 add_watcher() i=2 2024-09-14T10:52:44.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.655+0000 7f843782a9c0 20 add_watcher() i=3 2024-09-14T10:52:44.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.655+0000 7f843782a9c0 20 add_watcher() i=4 2024-09-14T10:52:44.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.655+0000 7f843782a9c0 20 add_watcher() i=5 2024-09-14T10:52:44.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.655+0000 7f843782a9c0 20 add_watcher() i=6 2024-09-14T10:52:44.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.659+0000 7f843782a9c0 20 add_watcher() i=7 2024-09-14T10:52:44.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.659+0000 7f843782a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:44.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.663+0000 7f82eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:44.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.663+0000 7f843782a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:44.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.663+0000 7f843782a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:44.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.663+0000 7f843782a9c0 5 note: GC not initialized 2024-09-14T10:52:44.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f82ea7e4640 20 reqs_thread_entry: start 2024-09-14T10:52:44.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:44.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 Filter name: none 2024-09-14T10:52:44.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f825bfff640 20 reqs_thread_entry: start 2024-09-14T10:52:44.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:44.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:44.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:44.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:44.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:44.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:52:44.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:44.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:52:44.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.667+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:44.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.671+0000 7f843782a9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:52:44.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.671+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:44.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.671+0000 7f843782a9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:52:44.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.671+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:44.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.671+0000 7f843782a9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:52:44.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.671+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:44.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.671+0000 7f843782a9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T10:52:44.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.671+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:44.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.675+0000 7f843782a9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:52:44.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.675+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:44.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.675+0000 7f843782a9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:52:44.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.675+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:44.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.675+0000 7f843782a9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T10:52:44.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.675+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:44.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.675+0000 7f843782a9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:52:44.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.675+0000 7f843782a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:44.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.679+0000 7f843782a9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:52:44.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.679+0000 7f843782a9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-14T10:52:44.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.679+0000 7f82eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:44.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.683+0000 7f843782a9c0 20 remove_watcher() i=0 2024-09-14T10:52:44.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.683+0000 7f843782a9c0 2 removed watcher, disabling cache 2024-09-14T10:52:44.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.683+0000 7f843782a9c0 20 remove_watcher() i=1 2024-09-14T10:52:44.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.687+0000 7f843782a9c0 20 remove_watcher() i=2 2024-09-14T10:52:44.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.691+0000 7f843782a9c0 20 remove_watcher() i=3 2024-09-14T10:52:44.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.691+0000 7f843782a9c0 20 remove_watcher() i=4 2024-09-14T10:52:44.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.695+0000 7f843782a9c0 20 remove_watcher() i=5 2024-09-14T10:52:44.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.695+0000 7f843782a9c0 20 remove_watcher() i=6 2024-09-14T10:52:44.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.699+0000 7f843782a9c0 20 remove_watcher() i=7 2024-09-14T10:52:44.712 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T10:52:44.712 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:44.712 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:52:44.744 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:44.744 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:44.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 realm 2024-09-14T10:52:44.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:44.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.791+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.795+0000 7fbbde3019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:44.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.795+0000 7fbbde3019c0 20 searching for the correct realm 2024-09-14T10:52:44.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.799+0000 7fbbdc608640 0 -- 172.21.15.148:0/1719910882 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5622d9c83250 msgr2=0x5622d9c856e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:44.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.807+0000 7fbbdbe07640 0 -- 172.21.15.148:0/1719910882 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5622d9c874b0 msgr2=0x5622d9c898e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:44.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:44.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:44.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:44.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:44.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:44.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:44.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 zone default found 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 4 Realm: () 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:44.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:44.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 zonegroup default 2024-09-14T10:52:44.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.815+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.819+0000 7fbbde3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.819+0000 7fbbde3019c0 20 started sync module instance, tier type = 2024-09-14T10:52:44.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.819+0000 7fbbde3019c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:44.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.839+0000 7fbbde3019c0 20 add_watcher() i=0 2024-09-14T10:52:44.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.839+0000 7fbbde3019c0 20 add_watcher() i=1 2024-09-14T10:52:44.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.839+0000 7fbbde3019c0 20 add_watcher() i=2 2024-09-14T10:52:44.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.839+0000 7fbbde3019c0 20 add_watcher() i=3 2024-09-14T10:52:44.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.839+0000 7fbbde3019c0 20 add_watcher() i=4 2024-09-14T10:52:44.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.839+0000 7fbbde3019c0 20 add_watcher() i=5 2024-09-14T10:52:44.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.839+0000 7fbbde3019c0 20 add_watcher() i=6 2024-09-14T10:52:44.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.843+0000 7fbbde3019c0 20 add_watcher() i=7 2024-09-14T10:52:44.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.843+0000 7fbbde3019c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:44.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.843+0000 7fba927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:44.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.843+0000 7fbbde3019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:44.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.843+0000 7fbbde3019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:44.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.843+0000 7fbbde3019c0 5 note: GC not initialized 2024-09-14T10:52:44.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fba917e2640 20 reqs_thread_entry: start 2024-09-14T10:52:44.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:44.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 20 Filter name: none 2024-09-14T10:52:44.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fba8a7fc640 20 reqs_thread_entry: start 2024-09-14T10:52:44.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:44.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:44.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:44.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:44.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:44.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:44.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:44.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:44.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:52:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.847+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.851+0000 7fbbde3019c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T10:52:44.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.851+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:44.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.851+0000 7fbbde3019c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:52:44.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.851+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:44.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.851+0000 7fbbde3019c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:52:44.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.851+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:44.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.851+0000 7fbbde3019c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:52:44.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.851+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:44.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.855+0000 7fbbde3019c0 20 get_obj_state: octx=0x5622d9a129b0 obj=check-bucket:d state=0x5622d9cc3de8 s->prefetch_data=0 2024-09-14T10:52:44.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.855+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:44.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.855+0000 7fbbde3019c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:52:44.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.855+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:44.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.855+0000 7fbbde3019c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:52:44.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.855+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:44.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.855+0000 7fbbde3019c0 20 get_obj_state: octx=0x5622d9a24620 obj=check-bucket:c state=0x5622d9cc04f8 s->prefetch_data=0 2024-09-14T10:52:44.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.855+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:44.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:52:44.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:44.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T10:52:44.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 get_obj_state: setting s->obj_tag to 78aa46begcjbdc4iikqcyrh9dej3o4hb 2024-09-14T10:52:44.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 get_obj_state_impl: setting s->olh_tag to e1mguu4vmr390voo90ihrftqdcahxo3f 2024-09-14T10:52:44.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:44.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 get_obj_state: setting s->obj_tag to 1gyuoleyb4b9bmrnygce5ux6vhyzjd8a 2024-09-14T10:52:44.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 get_obj_state_impl: setting s->olh_tag to pja79533vjjx3c2enkgr1skz9p4tqv3u 2024-09-14T10:52:44.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:44.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T10:52:44.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 olh_log_entry: epoch=4 op=3 key=c[2VUfbVkiXClMyGBxpP2hgkR4vtbav5g] 2024-09-14T10:52:44.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 get_obj_state: octx=0x5622d9d0b5a0 obj=check-bucket:_:2VUfbVkiXClMyGBxpP2hgkR4vtbav5g_c state=0x5622d9cbda58 s->prefetch_data=0 2024-09-14T10:52:44.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T10:52:44.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 olh_log_entry: epoch=4 op=3 key=d[VJp-nVYnOgd73KTQeaknDBKVhR1R0im] 2024-09-14T10:52:44.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.859+0000 7fbbde3019c0 20 get_obj_state: octx=0x5622d9ceb5a0 obj=check-bucket:_:VJp-nVYnOgd73KTQeaknDBKVhR1R0im_d state=0x5622d9d178e8 s->prefetch_data=0 2024-09-14T10:52:44.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.863+0000 7fbbde3019c0 20 get_obj_state: octx=0x5622d9d0b5a0 obj=check-bucket:c state=0x5622d9d17878 s->prefetch_data=0 2024-09-14T10:52:44.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.863+0000 7fbbde3019c0 20 get_obj_state: octx=0x5622d9ceb5a0 obj=check-bucket:d state=0x5622d9cba3b8 s->prefetch_data=0 2024-09-14T10:52:44.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.863+0000 7fbbde3019c0 20 get_obj_state: setting s->obj_tag to 1gyuoleyb4b9bmrnygce5ux6vhyzjd8a 2024-09-14T10:52:44.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.863+0000 7fbbde3019c0 20 get_obj_state_impl: setting s->olh_tag to pja79533vjjx3c2enkgr1skz9p4tqv3u 2024-09-14T10:52:44.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.863+0000 7fbbde3019c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pja79533vjjx3c2enkgr1skz9p4tqv3u 2024-09-14T10:52:44.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.863+0000 7fbbde3019c0 20 get_obj_state: setting s->obj_tag to 78aa46begcjbdc4iikqcyrh9dej3o4hb 2024-09-14T10:52:44.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.863+0000 7fbbde3019c0 20 get_obj_state_impl: setting s->olh_tag to e1mguu4vmr390voo90ihrftqdcahxo3f 2024-09-14T10:52:44.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.863+0000 7fbbde3019c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=e1mguu4vmr390voo90ihrftqdcahxo3f 2024-09-14T10:52:44.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.875+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:44.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.875+0000 7fbbde3019c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:44.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.879+0000 7fbbde3019c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:52:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.879+0000 7fbbde3019c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:52:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.879+0000 7fbbde3019c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T10:52:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.879+0000 7fba927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:44.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.883+0000 7fbbde3019c0 20 remove_watcher() i=0 2024-09-14T10:52:44.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.883+0000 7fbbde3019c0 2 removed watcher, disabling cache 2024-09-14T10:52:44.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.887+0000 7fbbde3019c0 20 remove_watcher() i=1 2024-09-14T10:52:44.888 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.891+0000 7fbbde3019c0 20 remove_watcher() i=2 2024-09-14T10:52:44.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.891+0000 7fbbde3019c0 20 remove_watcher() i=3 2024-09-14T10:52:44.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.895+0000 7fbbde3019c0 20 remove_watcher() i=4 2024-09-14T10:52:44.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.895+0000 7fbbde3019c0 20 remove_watcher() i=5 2024-09-14T10:52:44.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.899+0000 7fbbde3019c0 20 remove_watcher() i=6 2024-09-14T10:52:44.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.903+0000 7fbbde3019c0 20 remove_watcher() i=7 2024-09-14T10:52:44.918 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:52:44.950 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:44.950 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:44.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.995+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.995+0000 7f54d8c9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.995+0000 7f54d8c9e9c0 20 realm 2024-09-14T10:52:44.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.995+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.995+0000 7f54d8c9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.995+0000 7f54d8c9e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:44.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.995+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.999+0000 7f54d8c9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:44.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.999+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.999+0000 7f54d8c9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:44.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.999+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:44.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.999+0000 7f54d8c9e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:44.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:44.999+0000 7f54d8c9e9c0 20 searching for the correct realm 2024-09-14T10:52:45.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.003+0000 7f54d67a4640 0 -- 172.21.15.148:0/2819767234 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f54c8020060 msgr2=0x7f54c805c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:45.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.011+0000 7f54d67a4640 0 -- 172.21.15.148:0/2819767234 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5593aa5238f0 msgr2=0x5593aa525ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:52:45.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:45.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 zone default found 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 4 Realm: () 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 zonegroup default 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 started sync module instance, tier type = 2024-09-14T10:52:45.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.019+0000 7f54d8c9e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 20 add_watcher() i=0 2024-09-14T10:52:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 20 add_watcher() i=1 2024-09-14T10:52:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 20 add_watcher() i=2 2024-09-14T10:52:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 20 add_watcher() i=3 2024-09-14T10:52:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 20 add_watcher() i=4 2024-09-14T10:52:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 20 add_watcher() i=5 2024-09-14T10:52:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 20 add_watcher() i=6 2024-09-14T10:52:45.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 20 add_watcher() i=7 2024-09-14T10:52:45.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.043+0000 7f54d8c9e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:45.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f538cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:45.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f54d8c9e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:45.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f54d8c9e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:45.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f54d8c9e9c0 5 note: GC not initialized 2024-09-14T10:52:45.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f53077fe640 20 reqs_thread_entry: start 2024-09-14T10:52:45.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f54d8c9e9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:45.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f54d8c9e9c0 20 Filter name: none 2024-09-14T10:52:45.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f53057fa640 20 reqs_thread_entry: start 2024-09-14T10:52:45.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f54d8c9e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:45.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.047+0000 7f54d8c9e9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:45.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:45.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:45.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: starting shard=0 2024-09-14T10:52:45.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:45.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: starting shard=1 2024-09-14T10:52:45.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:45.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: starting shard=2 2024-09-14T10:52:45.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:45.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: starting shard=3 2024-09-14T10:52:45.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 INFO: main: starting shard=4 2024-09-14T10:52:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.051+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:45.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 INFO: main: starting shard=5 2024-09-14T10:52:45.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 INFO: main: starting shard=6 2024-09-14T10:52:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 INFO: main: starting shard=7 2024-09-14T10:52:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.055+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:45.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 INFO: main: starting shard=8 2024-09-14T10:52:45.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:45.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 INFO: main: starting shard=9 2024-09-14T10:52:45.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:45.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 INFO: main: starting shard=10 2024-09-14T10:52:45.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.059+0000 7f54d8c9e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:45.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.063+0000 7f54d8c9e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.063+0000 7f54d8c9e9c0 20 INFO: main: done 2024-09-14T10:52:45.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.063+0000 7f538cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:45.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.067+0000 7f54d8c9e9c0 20 remove_watcher() i=0 2024-09-14T10:52:45.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.067+0000 7f54d8c9e9c0 2 removed watcher, disabling cache 2024-09-14T10:52:45.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.067+0000 7f54d8c9e9c0 20 remove_watcher() i=1 2024-09-14T10:52:45.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.071+0000 7f54d8c9e9c0 20 remove_watcher() i=2 2024-09-14T10:52:45.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.071+0000 7f54d8c9e9c0 20 remove_watcher() i=3 2024-09-14T10:52:45.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.075+0000 7f54d8c9e9c0 20 remove_watcher() i=4 2024-09-14T10:52:45.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.079+0000 7f54d8c9e9c0 20 remove_watcher() i=5 2024-09-14T10:52:45.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.079+0000 7f54d8c9e9c0 20 remove_watcher() i=6 2024-09-14T10:52:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.083+0000 7f54d8c9e9c0 20 remove_watcher() i=7 2024-09-14T10:52:45.097 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:52:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:45.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.171+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 realm 2024-09-14T10:52:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:45.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:45.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:45.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.175+0000 7f5c079c89c0 20 searching for the correct realm 2024-09-14T10:52:45.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.183+0000 7f5c04ccd640 0 -- 172.21.15.148:0/500988457 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x558aa8bcd0a0 msgr2=0x558aa8bcf490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.187+0000 7f5c054ce640 0 -- 172.21.15.148:0/500988457 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f5c00019bb0 msgr2=0x7f5c00039af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:45.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:45.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:45.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:45.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:45.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:45.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:45.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:45.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.195+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:45.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 zone default found 2024-09-14T10:52:45.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 4 Realm: () 2024-09-14T10:52:45.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:45.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:45.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:45.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 zonegroup default 2024-09-14T10:52:45.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 started sync module instance, tier type = 2024-09-14T10:52:45.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.199+0000 7f5c079c89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:45.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.219+0000 7f5c079c89c0 20 add_watcher() i=0 2024-09-14T10:52:45.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.219+0000 7f5c079c89c0 20 add_watcher() i=1 2024-09-14T10:52:45.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.219+0000 7f5c079c89c0 20 add_watcher() i=2 2024-09-14T10:52:45.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.219+0000 7f5c079c89c0 20 add_watcher() i=3 2024-09-14T10:52:45.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.219+0000 7f5c079c89c0 20 add_watcher() i=4 2024-09-14T10:52:45.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.219+0000 7f5c079c89c0 20 add_watcher() i=5 2024-09-14T10:52:45.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.219+0000 7f5c079c89c0 20 add_watcher() i=6 2024-09-14T10:52:45.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.223+0000 7f5c079c89c0 20 add_watcher() i=7 2024-09-14T10:52:45.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.223+0000 7f5c079c89c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:45.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5abb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5c079c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5c079c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5c079c89c0 5 note: GC not initialized 2024-09-14T10:52:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5aba7e4640 20 reqs_thread_entry: start 2024-09-14T10:52:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5c079c89c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5c079c89c0 20 Filter name: none 2024-09-14T10:52:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5a2bfff640 20 reqs_thread_entry: start 2024-09-14T10:52:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5c079c89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:45.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.227+0000 7f5c079c89c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:45.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:45.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:45.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 INFO: main: starting shard=0 2024-09-14T10:52:45.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:45.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 INFO: main: starting shard=1 2024-09-14T10:52:45.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:45.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 INFO: main: starting shard=2 2024-09-14T10:52:45.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:45.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 INFO: main: starting shard=3 2024-09-14T10:52:45.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.231+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:45.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 INFO: main: starting shard=4 2024-09-14T10:52:45.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:45.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 INFO: main: starting shard=5 2024-09-14T10:52:45.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:45.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 INFO: main: starting shard=6 2024-09-14T10:52:45.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:45.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 INFO: main: starting shard=7 2024-09-14T10:52:45.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.235+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:45.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 INFO: main: starting shard=8 2024-09-14T10:52:45.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:45.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 INFO: main: starting shard=9 2024-09-14T10:52:45.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 INFO: main: starting shard=10 2024-09-14T10:52:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.239+0000 7f5c079c89c0 20 INFO: main: done 2024-09-14T10:52:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.243+0000 7f5abb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:45.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.247+0000 7f5c079c89c0 20 remove_watcher() i=0 2024-09-14T10:52:45.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.247+0000 7f5c079c89c0 2 removed watcher, disabling cache 2024-09-14T10:52:45.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.247+0000 7f5c079c89c0 20 remove_watcher() i=1 2024-09-14T10:52:45.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.251+0000 7f5c079c89c0 20 remove_watcher() i=2 2024-09-14T10:52:45.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.251+0000 7f5c079c89c0 20 remove_watcher() i=3 2024-09-14T10:52:45.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.255+0000 7f5c079c89c0 20 remove_watcher() i=4 2024-09-14T10:52:45.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.255+0000 7f5c079c89c0 20 remove_watcher() i=5 2024-09-14T10:52:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.259+0000 7f5c079c89c0 20 remove_watcher() i=6 2024-09-14T10:52:45.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.263+0000 7f5c079c89c0 20 remove_watcher() i=7 2024-09-14T10:52:45.275 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T10:52:45.275 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:45.275 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T10:52:45.305 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:45.305 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:45.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.351+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.351+0000 7f0305fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.351+0000 7f0305fac9c0 20 realm 2024-09-14T10:52:45.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.351+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.351+0000 7f0305fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.351+0000 7f0305fac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.351+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.355+0000 7f0305fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.355+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.355+0000 7f0305fac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.355+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.355+0000 7f0305fac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.355+0000 7f0305fac9c0 20 searching for the correct realm 2024-09-14T10:52:45.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.359+0000 7f03032b1640 0 -- 172.21.15.148:0/4070941523 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f02fc033040 msgr2=0x7f02fc034430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:52:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.571+0000 7f03042b3640 0 -- 172.21.15.148:0/4070941523 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x562bd40209e0 msgr2=0x562bd4022e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:45.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:45.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:45.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:45.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:45.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:45.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:45.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:45.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.583+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:45.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 zone default found 2024-09-14T10:52:45.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 4 Realm: () 2024-09-14T10:52:45.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:45.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:45.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:45.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 zonegroup default 2024-09-14T10:52:45.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:45.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 started sync module instance, tier type = 2024-09-14T10:52:45.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.587+0000 7f0305fac9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:45.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.611+0000 7f0305fac9c0 20 add_watcher() i=0 2024-09-14T10:52:45.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.611+0000 7f0305fac9c0 20 add_watcher() i=1 2024-09-14T10:52:45.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.611+0000 7f0305fac9c0 20 add_watcher() i=2 2024-09-14T10:52:45.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.611+0000 7f0305fac9c0 20 add_watcher() i=3 2024-09-14T10:52:45.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.611+0000 7f0305fac9c0 20 add_watcher() i=4 2024-09-14T10:52:45.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.611+0000 7f0305fac9c0 20 add_watcher() i=5 2024-09-14T10:52:45.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.611+0000 7f0305fac9c0 20 add_watcher() i=6 2024-09-14T10:52:45.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.615+0000 7f0305fac9c0 20 add_watcher() i=7 2024-09-14T10:52:45.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.615+0000 7f0305fac9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:45.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.619+0000 7f01b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:45.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.619+0000 7f0305fac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:45.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.619+0000 7f0305fac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:45.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.619+0000 7f0305fac9c0 5 note: GC not initialized 2024-09-14T10:52:45.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.619+0000 7f01b8fe1640 20 reqs_thread_entry: start 2024-09-14T10:52:45.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.619+0000 7f0305fac9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:45.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.619+0000 7f0305fac9c0 20 Filter name: none 2024-09-14T10:52:45.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f01327fc640 20 reqs_thread_entry: start 2024-09-14T10:52:45.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:45.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:45.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:45.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:45.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:45.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:45.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:45.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:45.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:45.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:45.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:45.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:45.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:45.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:52:45.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.623+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:45.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.627+0000 7f0305fac9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:52:45.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.627+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:45.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.627+0000 7f0305fac9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:52:45.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.627+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:45.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.627+0000 7f0305fac9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:52:45.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.627+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:45.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.627+0000 7f0305fac9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:52:45.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.627+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:45.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.631+0000 7f0305fac9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:52:45.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.631+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:45.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.631+0000 7f0305fac9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:52:45.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.631+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:45.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.631+0000 7f0305fac9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:52:45.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.631+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:45.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.635+0000 7f0305fac9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:52:45.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.635+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:45.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.635+0000 7f0305fac9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:52:45.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.635+0000 7f0305fac9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:45.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.635+0000 7f0305fac9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:52:45.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.635+0000 7f0305fac9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:52:45.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.639+0000 7f01b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:45.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.643+0000 7f0305fac9c0 20 remove_watcher() i=0 2024-09-14T10:52:45.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.643+0000 7f0305fac9c0 2 removed watcher, disabling cache 2024-09-14T10:52:45.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.647+0000 7f0305fac9c0 20 remove_watcher() i=1 2024-09-14T10:52:45.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.647+0000 7f0305fac9c0 20 remove_watcher() i=2 2024-09-14T10:52:45.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.651+0000 7f0305fac9c0 20 remove_watcher() i=3 2024-09-14T10:52:45.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.651+0000 7f0305fac9c0 20 remove_watcher() i=4 2024-09-14T10:52:45.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.655+0000 7f0305fac9c0 20 remove_watcher() i=5 2024-09-14T10:52:45.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.659+0000 7f0305fac9c0 20 remove_watcher() i=6 2024-09-14T10:52:45.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:45.659+0000 7f0305fac9c0 20 remove_watcher() i=7 2024-09-14T10:52:45.677 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T10:52:45.677 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:45.680 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:45.680 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:45.718 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:45.718 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:45.762 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:45.762 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:45.884 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T10:52:45.884 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:52:45.886 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:45.886 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:46.000 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:46.001 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:46.507 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:46.507 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:46.678 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:46.678 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:46.739 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:46.739 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:46.886 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:46.886 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:46.956 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:46.956 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:47.106 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:47.106 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:47.178 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:47.178 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:47.324 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:47.324 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:47.392 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:47.392 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:47.554 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:47.554 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:47.627 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:47.627 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:47.781 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:47.782 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:47.851 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:52:48.296 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:52:49.738 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:49.738 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:49.905 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:52:49.905 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:52:49.942 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:49.942 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:49.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.987+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:49.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:49.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 realm 2024-09-14T10:52:49.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:49.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:49.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:49.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:49.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:49.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:49.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:49.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:49.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:49.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.991+0000 7feaec9159c0 20 searching for the correct realm 2024-09-14T10:52:49.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:49.999+0000 7feae9c1a640 0 -- 172.21.15.148:0/270399810 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7feae4063170 msgr2=0x7feae4061be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:50.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.207+0000 7feae9c1a640 0 -- 172.21.15.148:0/270399810 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55aabc39e190 msgr2=0x55aabc3a05e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:50.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:50.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:50.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:50.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:50.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:50.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:50.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:50.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:50.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 zone default found 2024-09-14T10:52:50.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 4 Realm: () 2024-09-14T10:52:50.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:50.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:50.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:50.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 zonegroup default 2024-09-14T10:52:50.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.219+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.223+0000 7feaec9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.223+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.223+0000 7feaec9159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.223+0000 7feaec9159c0 20 started sync module instance, tier type = 2024-09-14T10:52:50.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.223+0000 7feaec9159c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:50.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.243+0000 7feaec9159c0 20 add_watcher() i=0 2024-09-14T10:52:50.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.243+0000 7feaec9159c0 20 add_watcher() i=1 2024-09-14T10:52:50.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.243+0000 7feaec9159c0 20 add_watcher() i=2 2024-09-14T10:52:50.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.243+0000 7feaec9159c0 20 add_watcher() i=3 2024-09-14T10:52:50.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.243+0000 7feaec9159c0 20 add_watcher() i=4 2024-09-14T10:52:50.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.243+0000 7feaec9159c0 20 add_watcher() i=5 2024-09-14T10:52:50.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.243+0000 7feaec9159c0 20 add_watcher() i=6 2024-09-14T10:52:50.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.247+0000 7feaec9159c0 20 add_watcher() i=7 2024-09-14T10:52:50.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.247+0000 7feaec9159c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:50.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.247+0000 7fe9a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:50.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:50.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:50.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 5 note: GC not initialized 2024-09-14T10:52:50.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7fe91b7fe640 20 reqs_thread_entry: start 2024-09-14T10:52:50.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:50.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 Filter name: none 2024-09-14T10:52:50.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7fe9197fa640 20 reqs_thread_entry: start 2024-09-14T10:52:50.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:50.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:50.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:50.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:50.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 INFO: main: starting shard=0 2024-09-14T10:52:50.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.251+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:50.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 INFO: main: starting shard=1 2024-09-14T10:52:50.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:50.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 INFO: main: starting shard=2 2024-09-14T10:52:50.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:50.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 INFO: main: starting shard=3 2024-09-14T10:52:50.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:50.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 INFO: main: starting shard=4 2024-09-14T10:52:50.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.255+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:50.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 INFO: main: starting shard=5 2024-09-14T10:52:50.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:50.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 INFO: main: starting shard=6 2024-09-14T10:52:50.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:50.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 INFO: main: starting shard=7 2024-09-14T10:52:50.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:50.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 INFO: main: starting shard=8 2024-09-14T10:52:50.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.259+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:50.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:52:50.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7feaec9159c0 20 INFO: main: starting shard=9 2024-09-14T10:52:50.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:50.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7feaec9159c0 20 INFO: main: starting shard=10 2024-09-14T10:52:50.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7feaec9159c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:50.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7feaec9159c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7feaec9159c0 20 INFO: main: done 2024-09-14T10:52:50.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.263+0000 7fe9a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:50.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.267+0000 7feaec9159c0 20 remove_watcher() i=0 2024-09-14T10:52:50.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.267+0000 7feaec9159c0 2 removed watcher, disabling cache 2024-09-14T10:52:50.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.271+0000 7feaec9159c0 20 remove_watcher() i=1 2024-09-14T10:52:50.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.271+0000 7feaec9159c0 20 remove_watcher() i=2 2024-09-14T10:52:50.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.275+0000 7feaec9159c0 20 remove_watcher() i=3 2024-09-14T10:52:50.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.275+0000 7feaec9159c0 20 remove_watcher() i=4 2024-09-14T10:52:50.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.279+0000 7feaec9159c0 20 remove_watcher() i=5 2024-09-14T10:52:50.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.279+0000 7feaec9159c0 20 remove_watcher() i=6 2024-09-14T10:52:50.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.283+0000 7feaec9159c0 20 remove_watcher() i=7 2024-09-14T10:52:50.299 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:50.299 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:50.337 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:50.337 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:50.493 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:52:50.493 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:52:50.528 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:50.529 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:50.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 20 realm 2024-09-14T10:52:50.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:50.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.575+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.579+0000 7f05dfd3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:50.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.579+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.579+0000 7f05dfd3f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:50.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.579+0000 7f05dfd3f9c0 20 searching for the correct realm 2024-09-14T10:52:50.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.587+0000 7f05dd044640 0 -- 172.21.15.148:0/706345581 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f05d801c040 msgr2=0x7f05d8024410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:50.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.591+0000 7f05dd845640 0 -- 172.21.15.148:0/706345581 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f05d8008040 msgr2=0x7f05d8024410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:52:50.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:50.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:50.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:50.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:50.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:50.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:50.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:50.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:50.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 zone default found 2024-09-14T10:52:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 4 Realm: () 2024-09-14T10:52:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 zonegroup default 2024-09-14T10:52:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.599+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.603+0000 7f05dfd3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.603+0000 7f05dfd3f9c0 20 started sync module instance, tier type = 2024-09-14T10:52:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.603+0000 7f05dfd3f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:50.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.619+0000 7f05dfd3f9c0 20 add_watcher() i=0 2024-09-14T10:52:50.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.619+0000 7f05dfd3f9c0 20 add_watcher() i=1 2024-09-14T10:52:50.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.619+0000 7f05dfd3f9c0 20 add_watcher() i=2 2024-09-14T10:52:50.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.619+0000 7f05dfd3f9c0 20 add_watcher() i=3 2024-09-14T10:52:50.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.619+0000 7f05dfd3f9c0 20 add_watcher() i=4 2024-09-14T10:52:50.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.619+0000 7f05dfd3f9c0 20 add_watcher() i=5 2024-09-14T10:52:50.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.619+0000 7f05dfd3f9c0 20 add_watcher() i=6 2024-09-14T10:52:50.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.623+0000 7f05dfd3f9c0 20 add_watcher() i=7 2024-09-14T10:52:50.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.623+0000 7f05dfd3f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:50.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f048f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:50.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f05dfd3f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:50.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f05dfd3f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:50.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f05dfd3f9c0 5 note: GC not initialized 2024-09-14T10:52:50.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f048e7fc640 20 reqs_thread_entry: start 2024-09-14T10:52:50.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f05dfd3f9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:50.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f05dfd3f9c0 20 Filter name: none 2024-09-14T10:52:50.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f03fffff640 20 reqs_thread_entry: start 2024-09-14T10:52:50.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f05dfd3f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:50.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.627+0000 7f05dfd3f9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:50.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:50.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:50.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 INFO: main: starting shard=0 2024-09-14T10:52:50.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:50.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 INFO: main: starting shard=1 2024-09-14T10:52:50.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:50.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 INFO: main: starting shard=2 2024-09-14T10:52:50.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:50.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 INFO: main: starting shard=3 2024-09-14T10:52:50.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.631+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:50.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 INFO: main: starting shard=4 2024-09-14T10:52:50.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 INFO: main: starting shard=5 2024-09-14T10:52:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:50.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:52:50.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 INFO: main: starting shard=6 2024-09-14T10:52:50.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.635+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:50.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 INFO: main: starting shard=7 2024-09-14T10:52:50.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:50.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 INFO: main: starting shard=8 2024-09-14T10:52:50.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:50.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 INFO: main: starting shard=9 2024-09-14T10:52:50.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 INFO: main: starting shard=10 2024-09-14T10:52:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.639+0000 7f05dfd3f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:50.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.643+0000 7f05dfd3f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:50.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.643+0000 7f05dfd3f9c0 20 INFO: main: done 2024-09-14T10:52:50.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.643+0000 7f048f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:50.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.647+0000 7f05dfd3f9c0 20 remove_watcher() i=0 2024-09-14T10:52:50.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.647+0000 7f05dfd3f9c0 2 removed watcher, disabling cache 2024-09-14T10:52:50.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.651+0000 7f05dfd3f9c0 20 remove_watcher() i=1 2024-09-14T10:52:50.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.651+0000 7f05dfd3f9c0 20 remove_watcher() i=2 2024-09-14T10:52:50.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.655+0000 7f05dfd3f9c0 20 remove_watcher() i=3 2024-09-14T10:52:50.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.655+0000 7f05dfd3f9c0 20 remove_watcher() i=4 2024-09-14T10:52:50.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.659+0000 7f05dfd3f9c0 20 remove_watcher() i=5 2024-09-14T10:52:50.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.659+0000 7f05dfd3f9c0 20 remove_watcher() i=6 2024-09-14T10:52:50.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.663+0000 7f05dfd3f9c0 20 remove_watcher() i=7 2024-09-14T10:52:50.681 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:50.681 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:50.716 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:50.717 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:50.845 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:52:50.845 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:52:50.881 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:50.881 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:50.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.927+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 realm 2024-09-14T10:52:50.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:50.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:50.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:50.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:50.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:50.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.931+0000 7f6403abf9c0 20 searching for the correct realm 2024-09-14T10:52:50.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:50.939+0000 7f6400dc4640 0 -- 172.21.15.148:0/4140098485 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f63fc02b060 msgr2=0x7f63fc05f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:52:51.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.147+0000 7f6401dc6640 0 -- 172.21.15.148:0/4140098485 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55c1f74c9fb0 msgr2=0x55c1f74cc3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:51.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:51.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:51.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:51.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:51.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:51.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:51.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:51.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.159+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:51.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 zone default found 2024-09-14T10:52:51.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 4 Realm: () 2024-09-14T10:52:51.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:51.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:51.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:51.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 zonegroup default 2024-09-14T10:52:51.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 started sync module instance, tier type = 2024-09-14T10:52:51.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.163+0000 7f6403abf9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:51.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.187+0000 7f6403abf9c0 20 add_watcher() i=0 2024-09-14T10:52:51.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.187+0000 7f6403abf9c0 20 add_watcher() i=1 2024-09-14T10:52:51.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.187+0000 7f6403abf9c0 20 add_watcher() i=2 2024-09-14T10:52:51.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.187+0000 7f6403abf9c0 20 add_watcher() i=3 2024-09-14T10:52:51.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.187+0000 7f6403abf9c0 20 add_watcher() i=4 2024-09-14T10:52:51.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.187+0000 7f6403abf9c0 20 add_watcher() i=5 2024-09-14T10:52:51.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.187+0000 7f6403abf9c0 20 add_watcher() i=6 2024-09-14T10:52:51.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.191+0000 7f6403abf9c0 20 add_watcher() i=7 2024-09-14T10:52:51.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.191+0000 7f6403abf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:51.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.195+0000 7f62b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:51.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.195+0000 7f6403abf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:51.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.195+0000 7f6403abf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:51.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.195+0000 7f6403abf9c0 5 note: GC not initialized 2024-09-14T10:52:51.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.195+0000 7f62b67e4640 20 reqs_thread_entry: start 2024-09-14T10:52:51.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:51.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 Filter name: none 2024-09-14T10:52:51.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6227fff640 20 reqs_thread_entry: start 2024-09-14T10:52:51.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:51.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:51.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:51.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 INFO: main: starting shard=0 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 INFO: main: starting shard=1 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.199+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 INFO: main: starting shard=2 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 INFO: main: starting shard=3 2024-09-14T10:52:51.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:51.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 INFO: main: starting shard=4 2024-09-14T10:52:51.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 INFO: main: starting shard=5 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.203+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 INFO: main: starting shard=6 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 INFO: main: starting shard=7 2024-09-14T10:52:51.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:51.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 INFO: main: starting shard=8 2024-09-14T10:52:51.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.207+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:51.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f6403abf9c0 20 INFO: main: starting shard=9 2024-09-14T10:52:51.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:51.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f6403abf9c0 20 INFO: main: starting shard=10 2024-09-14T10:52:51.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f6403abf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:51.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f6403abf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f6403abf9c0 20 INFO: main: done 2024-09-14T10:52:51.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.211+0000 7f62b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:51.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.215+0000 7f6403abf9c0 20 remove_watcher() i=0 2024-09-14T10:52:51.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.215+0000 7f6403abf9c0 2 removed watcher, disabling cache 2024-09-14T10:52:51.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.219+0000 7f6403abf9c0 20 remove_watcher() i=1 2024-09-14T10:52:51.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.223+0000 7f6403abf9c0 20 remove_watcher() i=2 2024-09-14T10:52:51.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.223+0000 7f6403abf9c0 20 remove_watcher() i=3 2024-09-14T10:52:51.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.227+0000 7f6403abf9c0 20 remove_watcher() i=4 2024-09-14T10:52:51.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.227+0000 7f6403abf9c0 20 remove_watcher() i=5 2024-09-14T10:52:51.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.231+0000 7f6403abf9c0 20 remove_watcher() i=6 2024-09-14T10:52:51.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.235+0000 7f6403abf9c0 20 remove_watcher() i=7 2024-09-14T10:52:51.249 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:51.249 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:51.276 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:51.276 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:51.409 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:52:51.410 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:52:51.445 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:51.446 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:51.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.491+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 realm 2024-09-14T10:52:51.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:51.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:51.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:51.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.495+0000 7fed8619b9c0 20 searching for the correct realm 2024-09-14T10:52:51.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.503+0000 7fed844a2640 0 -- 172.21.15.148:0/464298719 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55ee8cba51b0 msgr2=0x55ee8cba7670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:51.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.507+0000 7fed83ca1640 0 -- 172.21.15.148:0/464298719 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55ee8c960b60 msgr2=0x7fed7c040910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:52:51.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:51.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:51.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:51.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:51.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:51.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:51.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.723+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:51.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 zone default found 2024-09-14T10:52:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 4 Realm: () 2024-09-14T10:52:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 zonegroup default 2024-09-14T10:52:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.727+0000 7fed8619b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:51.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.731+0000 7fed8619b9c0 20 started sync module instance, tier type = 2024-09-14T10:52:51.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.731+0000 7fed8619b9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:51.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 20 add_watcher() i=0 2024-09-14T10:52:51.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 20 add_watcher() i=1 2024-09-14T10:52:51.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 20 add_watcher() i=2 2024-09-14T10:52:51.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 20 add_watcher() i=3 2024-09-14T10:52:51.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 20 add_watcher() i=4 2024-09-14T10:52:51.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 20 add_watcher() i=5 2024-09-14T10:52:51.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 20 add_watcher() i=6 2024-09-14T10:52:51.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 20 add_watcher() i=7 2024-09-14T10:52:51.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.755+0000 7fed8619b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:51.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fec39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:51.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fed8619b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:51.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fed8619b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:51.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fed8619b9c0 5 note: GC not initialized 2024-09-14T10:52:51.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fec38fe1640 20 reqs_thread_entry: start 2024-09-14T10:52:51.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fed8619b9c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:51.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fed8619b9c0 20 Filter name: none 2024-09-14T10:52:51.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7febb27fc640 20 reqs_thread_entry: start 2024-09-14T10:52:51.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fed8619b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:51.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.763+0000 7fed8619b9c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:51.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:51.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:51.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:52:51.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 INFO: main: starting shard=0 2024-09-14T10:52:51.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:51.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 INFO: main: starting shard=1 2024-09-14T10:52:51.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:51.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 INFO: main: starting shard=2 2024-09-14T10:52:51.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:51.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 INFO: main: starting shard=3 2024-09-14T10:52:51.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.767+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:51.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 INFO: main: starting shard=4 2024-09-14T10:52:51.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:51.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 INFO: main: starting shard=5 2024-09-14T10:52:51.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:51.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 INFO: main: starting shard=6 2024-09-14T10:52:51.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:51.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 INFO: main: starting shard=7 2024-09-14T10:52:51.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.771+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:51.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.775+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.775+0000 7fed8619b9c0 20 INFO: main: starting shard=8 2024-09-14T10:52:51.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.775+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:51.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.775+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.775+0000 7fed8619b9c0 20 INFO: main: starting shard=9 2024-09-14T10:52:51.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.775+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:51.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.779+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:52:51.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.779+0000 7fed8619b9c0 20 INFO: main: starting shard=10 2024-09-14T10:52:51.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.779+0000 7fed8619b9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:51.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.779+0000 7fed8619b9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:52:51.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.779+0000 7fed8619b9c0 20 INFO: main: done 2024-09-14T10:52:51.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.779+0000 7fec39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:51.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.787+0000 7fed8619b9c0 20 remove_watcher() i=0 2024-09-14T10:52:51.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.787+0000 7fed8619b9c0 2 removed watcher, disabling cache 2024-09-14T10:52:51.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.787+0000 7fed8619b9c0 20 remove_watcher() i=1 2024-09-14T10:52:51.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.791+0000 7fed8619b9c0 20 remove_watcher() i=2 2024-09-14T10:52:51.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.791+0000 7fed8619b9c0 20 remove_watcher() i=3 2024-09-14T10:52:51.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.795+0000 7fed8619b9c0 20 remove_watcher() i=4 2024-09-14T10:52:51.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.795+0000 7fed8619b9c0 20 remove_watcher() i=5 2024-09-14T10:52:51.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.799+0000 7fed8619b9c0 20 remove_watcher() i=6 2024-09-14T10:52:51.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:51.803+0000 7fed8619b9c0 20 remove_watcher() i=7 2024-09-14T10:52:51.821 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:51.821 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:51.852 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:52:52.291 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:52:52.730 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:52:52.758 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:52.758 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:52.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 20 realm 2024-09-14T10:52:52.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:52.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.803+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.807+0000 7f839d4589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:52.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.807+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.807+0000 7f839d4589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:52.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.807+0000 7f839d4589c0 20 searching for the correct realm 2024-09-14T10:52:52.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.811+0000 7f8393fff640 0 -- 172.21.15.148:0/329699437 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f8394079040 msgr2=0x7f8394060090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:52.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.819+0000 7f839b75f640 0 -- 172.21.15.148:0/329699437 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55b4e328c4e0 msgr2=0x55b4e328e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:52.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:52.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.827+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:52.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 zone default found 2024-09-14T10:52:52.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 4 Realm: () 2024-09-14T10:52:52.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:52.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:52.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:52.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 zonegroup default 2024-09-14T10:52:52.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 started sync module instance, tier type = 2024-09-14T10:52:52.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.831+0000 7f839d4589c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:52.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 20 add_watcher() i=0 2024-09-14T10:52:52.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 20 add_watcher() i=1 2024-09-14T10:52:52.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 20 add_watcher() i=2 2024-09-14T10:52:52.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 20 add_watcher() i=3 2024-09-14T10:52:52.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 20 add_watcher() i=4 2024-09-14T10:52:52.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 20 add_watcher() i=5 2024-09-14T10:52:52.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 20 add_watcher() i=6 2024-09-14T10:52:52.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 20 add_watcher() i=7 2024-09-14T10:52:52.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.851+0000 7f839d4589c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:52.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.855+0000 7f82517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:52.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.855+0000 7f839d4589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:52.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.855+0000 7f839d4589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:52.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.855+0000 7f839d4589c0 5 note: GC not initialized 2024-09-14T10:52:52.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.855+0000 7f81cbfff640 20 reqs_thread_entry: start 2024-09-14T10:52:52.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.855+0000 7f839d4589c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:52.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.855+0000 7f839d4589c0 20 Filter name: none 2024-09-14T10:52:52.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f81c9ffb640 20 reqs_thread_entry: start 2024-09-14T10:52:52.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:52.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:52.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:52.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:52.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:52.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:52.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:52.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:52.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:52.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:52.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:52.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:52.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.859+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:52.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.863+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:52.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.863+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:52.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.863+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:52.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.863+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:52.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.867+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:52.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.867+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:52.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.867+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:52.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.871+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:52.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.871+0000 7f839d4589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:52.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.883+0000 7f82517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:52.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.887+0000 7f839d4589c0 20 remove_watcher() i=0 2024-09-14T10:52:52.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.887+0000 7f839d4589c0 2 removed watcher, disabling cache 2024-09-14T10:52:52.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.891+0000 7f839d4589c0 20 remove_watcher() i=1 2024-09-14T10:52:52.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.891+0000 7f839d4589c0 20 remove_watcher() i=2 2024-09-14T10:52:52.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.895+0000 7f839d4589c0 20 remove_watcher() i=3 2024-09-14T10:52:52.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.895+0000 7f839d4589c0 20 remove_watcher() i=4 2024-09-14T10:52:52.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.899+0000 7f839d4589c0 20 remove_watcher() i=5 2024-09-14T10:52:52.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.903+0000 7f839d4589c0 20 remove_watcher() i=6 2024-09-14T10:52:52.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.903+0000 7f839d4589c0 20 remove_watcher() i=7 2024-09-14T10:52:52.917 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:52:52.953 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:52.953 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:52.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 20 realm 2024-09-14T10:52:52.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:52.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:52.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:52.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:52.999+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.003+0000 7fcf6ccd19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:53.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.003+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.003+0000 7fcf6ccd19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:53.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.003+0000 7fcf6ccd19c0 20 searching for the correct realm 2024-09-14T10:52:53.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.007+0000 7fcf69fd6640 0 -- 172.21.15.148:0/349401143 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fcf64008040 msgr2=0x7fcf6405fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:53.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.219+0000 7fcf6afd8640 0 -- 172.21.15.148:0/349401143 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x561fe8126190 msgr2=0x561fe81285d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:53.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:53.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 zone default found 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 4 Realm: () 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 zonegroup default 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.231+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.235+0000 7fcf6ccd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.235+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.235+0000 7fcf6ccd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:53.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.235+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.235+0000 7fcf6ccd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:53.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.235+0000 7fcf6ccd19c0 20 started sync module instance, tier type = 2024-09-14T10:52:53.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.235+0000 7fcf6ccd19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:53.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 20 add_watcher() i=0 2024-09-14T10:52:53.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 20 add_watcher() i=1 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 20 add_watcher() i=2 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 20 add_watcher() i=3 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 20 add_watcher() i=4 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 20 add_watcher() i=5 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 20 add_watcher() i=6 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 20 add_watcher() i=7 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.259+0000 7fcf6ccd19c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.263+0000 7fce20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:53.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 5 note: GC not initialized 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcd9b7fe640 20 reqs_thread_entry: start 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 20 Filter name: none 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcd997fa640 20 reqs_thread_entry: start 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:52:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 : miss 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.267+0000 7fcf6ccd19c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 info.flags=0x17 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 to cache LRU end 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.0 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.2 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:52:53.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.271+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.3 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.275+0000 7fcf6ccd19c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.275+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.4 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.275+0000 7fcf6ccd19c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.275+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.275+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.6 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.275+0000 7fcf6ccd19c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.275+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.7 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.279+0000 7fcf6ccd19c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.279+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.279+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.9 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.279+0000 7fcf6ccd19c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:52:53.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.279+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:53.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.279+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:53.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe7eb69c0 obj=check-bucket:e state=0x561fe8165c98 s->prefetch_data=0 2024-09-14T10:52:53.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:53.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe7ec8630 obj=check-bucket:d state=0x561fe815eb28 s->prefetch_data=0 2024-09-14T10:52:53.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:53.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe8166e90 obj=check-bucket:c state=0x561fe8169568 s->prefetch_data=0 2024-09-14T10:52:53.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:53.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe815f880 obj=check-bucket:f state=0x561fe8161b28 s->prefetch_data=0 2024-09-14T10:52:53.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state: setting s->obj_tag to 0t9gicrx5h4criti83w10dpqgu3yni1r 2024-09-14T10:52:53.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state_impl: setting s->olh_tag to rhii9a16jnf6bt1bmvq7j6ix2s6iq1zg 2024-09-14T10:52:53.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rhii9a16jnf6bt1bmvq7j6ix2s6iq1zg 2024-09-14T10:52:53.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state: setting s->obj_tag to 6r548opn7whvpcupfkvi13wb1fpq9nhz 2024-09-14T10:52:53.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state_impl: setting s->olh_tag to cky376zrl7xkh3nmbfoj11gb1hdsm41b 2024-09-14T10:52:53.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cky376zrl7xkh3nmbfoj11gb1hdsm41b 2024-09-14T10:52:53.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state: setting s->obj_tag to kgq29853k4e4dj170h87mpja8vwfxfa5 2024-09-14T10:52:53.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 get_obj_state_impl: setting s->olh_tag to p4efgvbttxqzy7yj6alztvkzo2tjxveb 2024-09-14T10:52:53.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.283+0000 7fcf6ccd19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p4efgvbttxqzy7yj6alztvkzo2tjxveb 2024-09-14T10:52:53.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.287+0000 7fcf6ccd19c0 20 get_obj_state: setting s->obj_tag to nes3rjy82rpfxntk3fo47f8vwxpjx6rp 2024-09-14T10:52:53.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.287+0000 7fcf6ccd19c0 20 get_obj_state_impl: setting s->olh_tag to 881yzc6rx10c1s4nf740vzurt1f5oz5d 2024-09-14T10:52:53.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.287+0000 7fcf6ccd19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=881yzc6rx10c1s4nf740vzurt1f5oz5d 2024-09-14T10:52:53.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.287+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:53.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.291+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:53.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.291+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:53.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.291+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.291+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 olh_log_entry: epoch=3 op=3 key=d[KDkLpVSzE6UWgEM6NOkdl5T-iIzMEsM] 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe7ec8630 obj=check-bucket:_:KDkLpVSzE6UWgEM6NOkdl5T-iIzMEsM_d state=0x561fe820bcd8 s->prefetch_data=0 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 10 manifest: total_size = 9 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18251676026817149514 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe7ec8630 obj=check-bucket:_:KDkLpVSzE6UWgEM6NOkdl5T-iIzMEsM_d state=0x561fe820bcd8 s->prefetch_data=0 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 prepare_atomic_modification: state is not atomic. state=0x561fe820bcd8 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 olh_log_entry: epoch=2 op=3 key=e[kuxV7KzNtFrduCnYd9dBMBIzwzk5J.8] 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe7eb69c0 obj=check-bucket:_:kuxV7KzNtFrduCnYd9dBMBIzwzk5J.8_e state=0x561fe82046c8 s->prefetch_data=0 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 olh_log_entry: epoch=2 op=3 key=f[uw9eyrVqLWJs-141p5gZeOLzHJq3FPh] 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe815f880 obj=check-bucket:_:uw9eyrVqLWJs-141p5gZeOLzHJq3FPh_f state=0x561fe8218f58 s->prefetch_data=0 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 olh_log_entry: epoch=3 op=3 key=c[5lnv-xqHzU6EUsMWbYZo86q05C6dXgL] 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe8166e90 obj=check-bucket:_:5lnv-xqHzU6EUsMWbYZo86q05C6dXgL_c state=0x561fe821fec8 s->prefetch_data=0 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 10 manifest: total_size = 22 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7345048971450918503 2024-09-14T10:52:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe8166e90 obj=check-bucket:_:5lnv-xqHzU6EUsMWbYZo86q05C6dXgL_c state=0x561fe821fec8 s->prefetch_data=0 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 prepare_atomic_modification: state is not atomic. state=0x561fe821fec8 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 10 manifest: total_size = 22 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8624809496310713997 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe7eb69c0 obj=check-bucket:_:kuxV7KzNtFrduCnYd9dBMBIzwzk5J.8_e state=0x561fe82046c8 s->prefetch_data=0 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 prepare_atomic_modification: state is not atomic. state=0x561fe82046c8 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.295+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.299+0000 7fcf6ccd19c0 10 manifest: total_size = 22 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.299+0000 7fcf6ccd19c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6034002657107191574 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.299+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe815f880 obj=check-bucket:_:uw9eyrVqLWJs-141p5gZeOLzHJq3FPh_f state=0x561fe8218f58 s->prefetch_data=0 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.299+0000 7fcf6ccd19c0 20 prepare_atomic_modification: state is not atomic. state=0x561fe8218f58 2024-09-14T10:52:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.299+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:53.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.303+0000 7fcf6ccd19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:52:53.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.303+0000 7fcf6ccd19c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T10:52:53.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.303+0000 7fcf6ccd19c0 0 deleting objects inline since gc isn't initialized 2024-09-14T10:52:53.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.303+0000 7fcf6ccd19c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2__shadow:KDkLpVSzE6UWgEM6NOkdl5T-iIzMEsM_.6eedDfYMW7gmdGU-NeqeIOiKyjwctZS_0 2024-09-14T10:52:53.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.303+0000 7fcf6ccd19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:52:53.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.303+0000 7fcf6ccd19c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:52:53.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.303+0000 7fcf6ccd19c0 0 deleting objects inline since gc isn't initialized 2024-09-14T10:52:53.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.303+0000 7fcf6ccd19c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2__shadow:5lnv-xqHzU6EUsMWbYZo86q05C6dXgL_.r-Rk_yoMmxNWWOESBvQgu7AD_nENqHG_0 2024-09-14T10:52:53.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:52:53.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:52:53.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 0 deleting objects inline since gc isn't initialized 2024-09-14T10:52:53.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2__shadow:uw9eyrVqLWJs-141p5gZeOLzHJq3FPh_.Il9dVaP9Y_7SiE11a5InQuYYvqRZuBz_0 2024-09-14T10:52:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fce4d7fa640 20 handle_completion(): completion ok for obj=d[KDkLpVSzE6UWgEM6NOkdl5T-iIzMEsM] 2024-09-14T10:52:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:52:53.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:52:53.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:52:53.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 0 deleting objects inline since gc isn't initialized 2024-09-14T10:52:53.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.307+0000 7fcf6ccd19c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2__shadow:kuxV7KzNtFrduCnYd9dBMBIzwzk5J.8_.FkD1O9DnSIlhM0-ykc_x4iuXE4-4U_9_0 2024-09-14T10:52:53.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.311+0000 7fce4dffb640 20 handle_completion(): completion ok for obj=f[uw9eyrVqLWJs-141p5gZeOLzHJq3FPh] 2024-09-14T10:52:53.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.311+0000 7fcf6ccd19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:52:53.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.311+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:53.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.311+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:53.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.315+0000 7fce4d7fa640 20 handle_completion(): completion ok for obj=c[5lnv-xqHzU6EUsMWbYZo86q05C6dXgL] 2024-09-14T10:52:53.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.315+0000 7fcf6ccd19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:52:53.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.315+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:53.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.315+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:53.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.315+0000 7fce4dffb640 20 handle_completion(): completion ok for obj=e[kuxV7KzNtFrduCnYd9dBMBIzwzk5J.8] 2024-09-14T10:52:53.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.315+0000 7fcf6ccd19c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:52:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.319+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.5 2024-09-14T10:52:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.319+0000 7fcf6ccd19c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:52:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.319+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe815f880 obj=check-bucket:f state=0x561fe8161b28 s->prefetch_data=0 2024-09-14T10:52:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.319+0000 7fcf6ccd19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=881yzc6rx10c1s4nf740vzurt1f5oz5d 2024-09-14T10:52:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.319+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.8 2024-09-14T10:52:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.319+0000 7fcf6ccd19c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:52:53.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.319+0000 7fcf6ccd19c0 20 get_obj_state: octx=0x561fe7eb69c0 obj=check-bucket:e state=0x561fe8165c98 s->prefetch_data=0 2024-09-14T10:52:53.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.319+0000 7fcf6ccd19c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rhii9a16jnf6bt1bmvq7j6ix2s6iq1zg 2024-09-14T10:52:53.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.327+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:53.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.331+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:53.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.331+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.10 2024-09-14T10:52:53.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.331+0000 7fcf6ccd19c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T10:52:53.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.331+0000 7fcf6ccd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2.1 2024-09-14T10:52:53.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.331+0000 7fcf6ccd19c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T10:52:53.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.331+0000 7fcf6ccd19c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T10:52:53.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.335+0000 7fce20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:53.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.339+0000 7fcf6ccd19c0 20 remove_watcher() i=0 2024-09-14T10:52:53.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.339+0000 7fcf6ccd19c0 2 removed watcher, disabling cache 2024-09-14T10:52:53.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.339+0000 7fcf6ccd19c0 20 remove_watcher() i=1 2024-09-14T10:52:53.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.343+0000 7fcf6ccd19c0 20 remove_watcher() i=2 2024-09-14T10:52:53.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.343+0000 7fcf6ccd19c0 20 remove_watcher() i=3 2024-09-14T10:52:53.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.347+0000 7fcf6ccd19c0 20 remove_watcher() i=4 2024-09-14T10:52:53.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.351+0000 7fcf6ccd19c0 20 remove_watcher() i=5 2024-09-14T10:52:53.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.351+0000 7fcf6ccd19c0 20 remove_watcher() i=6 2024-09-14T10:52:53.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:53.355+0000 7fcf6ccd19c0 20 remove_watcher() i=7 2024-09-14T10:52:53.374 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:53.455 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:53.455 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:53.958 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:52:53.991 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:52:53.991 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:52:54.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.035+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.039+0000 7f829c4319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:54.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.039+0000 7f829c4319c0 20 realm 2024-09-14T10:52:54.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.039+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.039+0000 7f829c4319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:54.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.039+0000 7f829c4319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:52:54.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.039+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.039+0000 7f829c4319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:54.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.039+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.043+0000 7f829c4319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:54.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.043+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.043+0000 7f829c4319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:52:54.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.043+0000 7f829c4319c0 20 searching for the correct realm 2024-09-14T10:52:54.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.047+0000 7f8299736640 0 -- 172.21.15.148:0/744886679 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f8294062080 msgr2=0x7f8294060af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:54.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.055+0000 7f8299f37640 0 -- 172.21.15.148:0/744886679 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f829406b270 msgr2=0x7f8294060af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:52:54.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:52:54.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:52:54.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:52:54.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:52:54.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:52:54.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:52:54.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:54.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:52:54.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:52:54.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 zone default found 2024-09-14T10:52:54.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 4 Realm: () 2024-09-14T10:52:54.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:52:54.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:52:54.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:52:54.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 zonegroup default 2024-09-14T10:52:54.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:54.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:54.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:52:54.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 started sync module instance, tier type = 2024-09-14T10:52:54.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.063+0000 7f829c4319c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:52:54.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.083+0000 7f829c4319c0 20 add_watcher() i=0 2024-09-14T10:52:54.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.083+0000 7f829c4319c0 20 add_watcher() i=1 2024-09-14T10:52:54.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.083+0000 7f829c4319c0 20 add_watcher() i=2 2024-09-14T10:52:54.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.083+0000 7f829c4319c0 20 add_watcher() i=3 2024-09-14T10:52:54.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.083+0000 7f829c4319c0 20 add_watcher() i=4 2024-09-14T10:52:54.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.083+0000 7f829c4319c0 20 add_watcher() i=5 2024-09-14T10:52:54.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.083+0000 7f829c4319c0 20 add_watcher() i=6 2024-09-14T10:52:54.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.087+0000 7f829c4319c0 20 add_watcher() i=7 2024-09-14T10:52:54.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.087+0000 7f829c4319c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:52:54.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f814b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:54.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:52:54.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:52:54.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 5 note: GC not initialized 2024-09-14T10:52:54.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f814a7fc640 20 reqs_thread_entry: start 2024-09-14T10:52:54.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 init_complete bucket index max shards: 11 2024-09-14T10:52:54.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 Filter name: none 2024-09-14T10:52:54.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f80bbfff640 20 reqs_thread_entry: start 2024-09-14T10:52:54.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:54.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:54.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:54.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:52:54.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.091+0000 7f829c4319c0 20 rados->read ofs=0 len=0 2024-09-14T10:52:54.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.095+0000 7f829c4319c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:52:54.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.095+0000 7f829c4319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:52:54.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.095+0000 7f814b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:52:54.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.099+0000 7f829c4319c0 20 remove_watcher() i=0 2024-09-14T10:52:54.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.099+0000 7f829c4319c0 2 removed watcher, disabling cache 2024-09-14T10:52:54.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.103+0000 7f829c4319c0 20 remove_watcher() i=1 2024-09-14T10:52:54.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.107+0000 7f829c4319c0 20 remove_watcher() i=2 2024-09-14T10:52:54.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.107+0000 7f829c4319c0 20 remove_watcher() i=3 2024-09-14T10:52:54.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.111+0000 7f829c4319c0 20 remove_watcher() i=4 2024-09-14T10:52:54.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.111+0000 7f829c4319c0 20 remove_watcher() i=5 2024-09-14T10:52:54.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.115+0000 7f829c4319c0 20 remove_watcher() i=6 2024-09-14T10:52:54.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:52:54.119+0000 7f829c4319c0 20 remove_watcher() i=7 2024-09-14T10:52:54.133 INFO:tasks.workunit.client.0.smithi148.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T10:52:54.133 INFO:tasks.workunit.client.0.smithi148.stderr:Deleting bucket check-bucket 2024-09-14T10:52:54.135 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:54.135 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:54.188 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T10:52:54.188 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T10:52:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:Completed bucket check tests 2024-09-14T10:52:54.779 INFO:tasks.workunit.client.0.smithi148.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T10:52:54.780 INFO:tasks.workunit.client.0.smithi148.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T10:52:54.780 INFO:tasks.workunit.client.0.smithi148.stdout:connected to https://localhost:443 2024-09-14T10:52:54.881 INFO:tasks.workunit.client.0.smithi148.stderr:+ deactivate 2024-09-14T10:52:54.881 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T10:52:54.881 INFO:tasks.workunit.client.0.smithi148.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T10:52:54.881 INFO:tasks.workunit.client.0.smithi148.stderr:+ export PATH 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ hash -r 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset VIRTUAL_ENV 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset -f deactivate 2024-09-14T10:52:54.882 INFO:tasks.workunit.client.0.smithi148.stderr:+ echo OK. 2024-09-14T10:52:54.883 INFO:tasks.workunit.client.0.smithi148.stdout:OK. 2024-09-14T10:52:54.883 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:52:54.884 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:52:54.897 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T10:52:54.897 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T10:52:55.330 DEBUG:teuthology.parallel:result is None 2024-09-14T10:52:55.331 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:52:55.342 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:52:55.343 DEBUG:teuthology.orchestra.run.smithi148:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:52:55.388 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:52:55.388 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:52:55.397 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:52:55.397 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:52:55.397 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:52:55.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:52:55.437 INFO:teuthology.orchestra.run.smithi148.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:52:55.437 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:52:55.484 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:52:55.484 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:52:55.532 INFO:tasks.workunit:timeout=3h 2024-09-14T10:52:55.532 INFO:tasks.workunit:cleanup=True 2024-09-14T10:52:55.533 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:52:55.582 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:53:49.564 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:53:49.565 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-09-14T10:53:49.566 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:53:49.566 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-09-14T10:53:49.566 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:53:49.566 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-09-14T10:53:49.566 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:53:49.566 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:53:49.567 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T10:53:49.567 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:53:49.569 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:53:49.622 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:53:49.624 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:53:49.624 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:53:49.683 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:53:49.738 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:53:49.781 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:53:49.783 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:53:49.783 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:53:49.828 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:53:49.832 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T10:53:49.832 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:53:49.884 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T10:53:49.885 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T10:53:49.886 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T10:53:49.950 INFO:tasks.workunit.client.0.smithi148.stdout:Running main() from gmock_main.cc 2024-09-14T10:53:49.950 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T10:53:49.950 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:53:49.950 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 11 tests from ClsLock 2024-09-14T10:53:49.950 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T10:53:51.550 INFO:tasks.workunit.client.0.smithi148.stdout:lock: mylock 2024-09-14T10:53:51.550 INFO:tasks.workunit.client.0.smithi148.stdout: lock_type: exclusive 2024-09-14T10:53:51.550 INFO:tasks.workunit.client.0.smithi148.stdout: tag: 2024-09-14T10:53:51.551 INFO:tasks.workunit.client.0.smithi148.stdout: lockers: 2024-09-14T10:53:51.551 INFO:tasks.workunit.client.0.smithi148.stdout: client.5223 expiration=2024-09-14T10:55:51.547144+0000 addr=v1:172.21.15.148:0/3120216016 cookie= 2024-09-14T10:53:51.557 INFO:tasks.workunit.client.0.smithi148.stdout:lock: mylock 2024-09-14T10:53:51.557 INFO:tasks.workunit.client.0.smithi148.stdout: lock_type: shared 2024-09-14T10:53:51.557 INFO:tasks.workunit.client.0.smithi148.stdout: tag: 2024-09-14T10:53:51.558 INFO:tasks.workunit.client.0.smithi148.stdout: lockers: 2024-09-14T10:53:51.558 INFO:tasks.workunit.client.0.smithi148.stdout: client.5223 expiration=2024-09-14T10:55:51.560633+0000 addr=v1:172.21.15.148:0/3120216016 cookie= 2024-09-14T10:53:51.558 INFO:tasks.workunit.client.0.smithi148.stdout: client.5232 expiration=0.000000 addr=v1:172.21.15.148:0/2026614464 cookie= 2024-09-14T10:53:51.559 INFO:tasks.workunit.client.0.smithi148.stdout:lock: mylock 2024-09-14T10:53:51.559 INFO:tasks.workunit.client.0.smithi148.stdout: lock_type: shared 2024-09-14T10:53:51.560 INFO:tasks.workunit.client.0.smithi148.stdout: tag: 2024-09-14T10:53:51.560 INFO:tasks.workunit.client.0.smithi148.stdout: lockers: 2024-09-14T10:53:51.560 INFO:tasks.workunit.client.0.smithi148.stdout: client.5232 expiration=0.000000 addr=v1:172.21.15.148:0/2026614464 cookie= 2024-09-14T10:53:52.530 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestMultiLocking (2580 ms) 2024-09-14T10:53:52.530 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T10:53:54.586 INFO:tasks.workunit.client.0.smithi148.stdout:lock: mylock 2024-09-14T10:53:54.586 INFO:tasks.workunit.client.0.smithi148.stdout: lock_type: shared 2024-09-14T10:53:54.586 INFO:tasks.workunit.client.0.smithi148.stdout: tag: 2024-09-14T10:53:54.586 INFO:tasks.workunit.client.0.smithi148.stdout: lockers: 2024-09-14T10:53:54.586 INFO:tasks.workunit.client.0.smithi148.stdout: client.5244 expiration=0.000000 addr=v1:172.21.15.148:0/3183785646 cookie= 2024-09-14T10:53:54.588 INFO:tasks.workunit.client.0.smithi148.stdout:lock: mylock 2024-09-14T10:53:54.588 INFO:tasks.workunit.client.0.smithi148.stdout: lock_type: exclusive 2024-09-14T10:53:54.588 INFO:tasks.workunit.client.0.smithi148.stdout: tag: new_tag 2024-09-14T10:53:54.588 INFO:tasks.workunit.client.0.smithi148.stdout: lockers: 2024-09-14T10:53:54.588 INFO:tasks.workunit.client.0.smithi148.stdout: client.5072 expiration=0.000000 addr=v1:172.21.15.148:0/1108000217 cookie= 2024-09-14T10:53:55.541 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestMeta (3011 ms) 2024-09-14T10:53:55.541 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T10:53:57.628 INFO:tasks.workunit.client.0.smithi148.stdout:lock: mylock 2024-09-14T10:53:57.628 INFO:tasks.workunit.client.0.smithi148.stdout: lock_type: exclusive 2024-09-14T10:53:57.629 INFO:tasks.workunit.client.0.smithi148.stdout: tag: 2024-09-14T10:53:57.629 INFO:tasks.workunit.client.0.smithi148.stdout: lockers: 2024-09-14T10:53:57.633 INFO:tasks.workunit.client.0.smithi148.stdout:lock: mylock 2024-09-14T10:53:57.633 INFO:tasks.workunit.client.0.smithi148.stdout: lock_type: shared 2024-09-14T10:53:57.633 INFO:tasks.workunit.client.0.smithi148.stdout: tag: 2024-09-14T10:53:57.633 INFO:tasks.workunit.client.0.smithi148.stdout: lockers: 2024-09-14T10:53:57.633 INFO:tasks.workunit.client.0.smithi148.stdout: client.5081 expiration=0.000000 addr=v1:172.21.15.148:0/2227016750 cookie= 2024-09-14T10:53:57.633 INFO:tasks.workunit.client.0.smithi148.stdout: client.5081 expiration=0.000000 addr=v1:172.21.15.148:0/2227016750 cookie=new cookie 2024-09-14T10:53:58.588 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestCookie (3046 ms) 2024-09-14T10:53:58.588 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T10:54:01.646 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestMultipleLocks (3058 ms) 2024-09-14T10:54:01.647 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T10:54:09.429 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestLockDuration (7777 ms) 2024-09-14T10:54:09.429 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T10:54:12.460 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestAssertLocked (3035 ms) 2024-09-14T10:54:12.460 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T10:54:15.523 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestSetCookie (3063 ms) 2024-09-14T10:54:15.523 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T10:54:36.465 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestRenew (20936 ms) 2024-09-14T10:54:36.465 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T10:54:42.584 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6119 ms) 2024-09-14T10:54:42.584 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T10:54:49.668 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7085 ms) 2024-09-14T10:54:49.668 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T10:54:57.450 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7789 ms) 2024-09-14T10:54:57.451 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 11 tests from ClsLock (67500 ms total) 2024-09-14T10:54:57.451 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:54:57.451 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:54:57.451 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 11 tests from 1 test suite ran. (67500 ms total) 2024-09-14T10:54:57.451 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 11 tests. 2024-09-14T10:54:57.458 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:54:57.459 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:54:57.517 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T10:54:57.518 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T10:54:57.518 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T10:54:57.583 INFO:tasks.workunit.client.0.smithi148.stdout:Running main() from gmock_main.cc 2024-09-14T10:54:57.583 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:54:57.583 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:54:57.583 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 4 tests from cls_log 2024-09-14T10:54:57.583 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T10:55:00.498 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_log.test_log_add_same_time (2915 ms) 2024-09-14T10:55:00.498 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T10:55:03.508 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_log.test_log_add_different_time (3003 ms) 2024-09-14T10:55:03.508 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T10:55:06.586 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_log.trim_by_time (3086 ms) 2024-09-14T10:55:06.587 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T10:55:09.632 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_log.trim_by_marker (3045 ms) 2024-09-14T10:55:09.632 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 4 tests from cls_log (12049 ms total) 2024-09-14T10:55:09.633 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:55:09.633 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:55:09.633 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 4 tests from 1 test suite ran. (12049 ms total) 2024-09-14T10:55:09.633 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 4 tests. 2024-09-14T10:55:09.637 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:55:09.637 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:55:09.693 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T10:55:09.695 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T10:55:09.695 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T10:55:09.762 INFO:tasks.workunit.client.0.smithi148.stdout:Running main() from gmock_main.cc 2024-09-14T10:55:09.762 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T10:55:09.762 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:55:09.762 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 10 tests from cls_refcount 2024-09-14T10:55:09.762 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T10:55:12.671 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.test_implicit (2909 ms) 2024-09-14T10:55:12.671 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T10:55:15.708 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3038 ms) 2024-09-14T10:55:15.709 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T10:55:24.785 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.test_put_snap (9077 ms) 2024-09-14T10:55:24.785 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T10:55:27.836 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.test_explicit (3048 ms) 2024-09-14T10:55:27.837 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.set 2024-09-14T10:55:30.890 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.set (3056 ms) 2024-09-14T10:55:30.890 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T10:55:37.943 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.test_implicit_ec (7053 ms) 2024-09-14T10:55:37.943 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T10:55:44.965 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7023 ms) 2024-09-14T10:55:44.965 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T10:55:57.156 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.test_put_snap_ec (12191 ms) 2024-09-14T10:55:57.156 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T10:56:04.232 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.test_explicit_ec (7076 ms) 2024-09-14T10:56:04.232 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T10:56:11.271 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_refcount.set_ec (7039 ms) 2024-09-14T10:56:11.271 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 10 tests from cls_refcount (61510 ms total) 2024-09-14T10:56:11.271 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:56:11.271 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:56:11.272 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 10 tests from 1 test suite ran. (61510 ms total) 2024-09-14T10:56:11.272 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 10 tests. 2024-09-14T10:56:11.277 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:56:11.277 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:56:11.332 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T10:56:11.333 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T10:56:11.334 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T10:56:11.399 INFO:tasks.workunit.client.0.smithi148.stdout:Running main() from gmock_main.cc 2024-09-14T10:56:11.399 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T10:56:11.399 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:56:11.399 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 18 tests from cls_rgw 2024-09-14T10:56:13.294 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T10:56:13.405 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.index_basic (110 ms) 2024-09-14T10:56:13.405 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T10:56:13.480 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (76 ms) 2024-09-14T10:56:13.481 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T10:56:13.583 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.index_remove_object (102 ms) 2024-09-14T10:56:13.583 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T10:56:15.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.index_suggest (2389 ms) 2024-09-14T10:56:15.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T10:56:15.987 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.index_suggest_complete (16 ms) 2024-09-14T10:56:15.987 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T10:56:16.043 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.index_list (55 ms) 2024-09-14T10:56:16.043 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T10:57:14.646 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.index_list_delimited (58603 ms) 2024-09-14T10:57:14.646 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T10:57:14.868 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.bi_list (223 ms) 2024-09-14T10:57:14.868 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T10:57:14.894 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.gc_set (27 ms) 2024-09-14T10:57:14.895 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T10:57:14.922 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.gc_list (28 ms) 2024-09-14T10:57:14.923 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T10:57:21.601 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.gc_defer (6678 ms) 2024-09-14T10:57:21.601 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T10:57:21.827 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.usage_basic (226 ms) 2024-09-14T10:57:21.827 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T10:57:21.829 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-14T10:57:21.829 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T10:57:22.047 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.usage_clear (217 ms) 2024-09-14T10:57:22.047 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T10:57:22.176 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.bi_log_trim (129 ms) 2024-09-14T10:57:22.176 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T10:57:22.210 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.index_racing_removes (34 ms) 2024-09-14T10:57:22.210 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T10:57:22.244 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.reshardlog_list (35 ms) 2024-09-14T10:57:22.244 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T10:57:22.275 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw.reshardlog_num (31 ms) 2024-09-14T10:57:22.604 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 18 tests from cls_rgw (68982 ms total) 2024-09-14T10:57:22.605 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:57:22.605 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:57:22.605 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 18 tests from 1 test suite ran. (71207 ms total) 2024-09-14T10:57:22.605 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 18 tests. 2024-09-14T10:57:22.614 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:57:22.614 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:57:22.671 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T10:57:22.673 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T10:57:22.673 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T10:57:22.736 INFO:tasks.workunit.client.0.smithi148.stdout:Running main() from gmock_main.cc 2024-09-14T10:57:22.736 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T10:57:22.736 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:57:22.736 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T10:57:22.736 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T10:57:24.617 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.init (1881 ms) 2024-09-14T10:57:24.617 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T10:57:24.657 INFO:tasks.workunit.client.0.smithi148.stderr:[ ] list info tag = chain-0 2024-09-14T10:57:24.657 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (39 ms) 2024-09-14T10:57:24.657 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T10:57:24.668 INFO:tasks.workunit.client.0.smithi148.stderr:[ ] next_marker is: = 0/4263 2024-09-14T10:57:24.669 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (13 ms) 2024-09-14T10:57:24.669 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T10:57:24.687 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (18 ms) 2024-09-14T10:57:24.687 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T10:57:24.703 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (16 ms) 2024-09-14T10:57:24.703 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T10:57:24.720 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (17 ms) 2024-09-14T10:57:24.720 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T10:57:24.738 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-14T10:57:24.738 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T10:57:24.755 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (16 ms) 2024-09-14T10:57:24.755 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T10:57:25.613 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_gc.finalize (856 ms) 2024-09-14T10:57:25.613 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 9 tests from cls_rgw_gc (2874 ms total) 2024-09-14T10:57:25.613 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:57:25.613 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:57:25.614 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 9 tests from 1 test suite ran. (2874 ms total) 2024-09-14T10:57:25.614 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 9 tests. 2024-09-14T10:57:25.616 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:57:25.616 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:57:25.671 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T10:57:25.672 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T10:57:25.673 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T10:57:25.757 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T10:57:25.757 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:57:25.757 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:25.757 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:27.649 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T10:57:27.649 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T10:57:27.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.679+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=QDGPG1FMFGA5 type=del size=2045958 2024-09-14T10:57:27.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.683+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=FSJ31J47NNF7 type=del size=119631 2024-09-14T10:57:27.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.691+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~QHCH11FERA28.0 size=1048576 2024-09-14T10:57:27.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.695+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~QHCH11FERA28.1 size=542960 2024-09-14T10:57:27.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.695+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=QHCH11FERA28 tag=1KDP36WF13K9 type=write size=2640112 2024-09-14T10:57:27.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.699+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=1BTV9WEBIS1L type=del size=3579 2024-09-14T10:57:27.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.699+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=LXOKP18CXY1W type=del size=997858 2024-09-14T10:57:27.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~8UQKHUB5D8XY.0 size=289186 2024-09-14T10:57:27.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.707+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=8UQKHUB5D8XY tag=X0MIWZQY3NSD type=write size=1337762 2024-09-14T10:57:27.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.711+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=UPN0GYWEDHWT type=del size=1844274 2024-09-14T10:57:27.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.715+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=IB50D97H8V4I type=del size=1840250 2024-09-14T10:57:27.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.719+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=6U4T1SYCZKNI type=del size=3263818 2024-09-14T10:57:27.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.723+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=ES94WXWPT2O0 type=del size=3155542 2024-09-14T10:57:27.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.727+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=YVB91X87ITR7 type=del size=208140 2024-09-14T10:57:27.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.731+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~SQY75P29NGZZ.0 size=964504 2024-09-14T10:57:27.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.731+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=SQY75P29NGZZ tag=8W6H67OOTMF1 type=write size=2013080 2024-09-14T10:57:27.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.735+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=CTW24DYTZE5I type=write size=297593 2024-09-14T10:57:27.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.743+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~JLGEUELI7WN7.0 size=660771 2024-09-14T10:57:27.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.743+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=JLGEUELI7WN7 tag=L2SCHYOYZ8SG type=write size=1709347 2024-09-14T10:57:27.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.751+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~VED303CSL315.0 size=1048576 2024-09-14T10:57:27.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.751+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~VED303CSL315.1 size=142505 2024-09-14T10:57:27.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.751+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=VED303CSL315 tag=2S2PQR9C9Y2W type=write size=2239657 2024-09-14T10:57:27.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.755+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=ZKT3X5UES3P4 type=del size=3707102 2024-09-14T10:57:27.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.759+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=QDGPG1FMFGA5 type=del 2024-09-14T10:57:27.759 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.763+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=0SXB80ZVEP7O type=del size=4095642 2024-09-14T10:57:27.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.767+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=FSJ31J47NNF7 type=del 2024-09-14T10:57:27.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.771+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~FYVWJWL4DM6Q.0 size=150199 2024-09-14T10:57:27.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.771+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=FYVWJWL4DM6Q tag=DNN7KJ22IW01 type=write size=1198775 2024-09-14T10:57:27.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.775+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~QHCH11FERA28.0 size=1048576 2024-09-14T10:57:27.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.779+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~QHCH11FERA28.1 size=542960 2024-09-14T10:57:27.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.787+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=QHCH11FERA28 tag=1KDP36WF13K9 type=write size=2640112 2024-09-14T10:57:27.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.791+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=L8BT6K3V25PF type=del size=3763842 2024-09-14T10:57:27.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.795+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=1BTV9WEBIS1L type=del 2024-09-14T10:57:27.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.799+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=1V1AXXUNRUAD type=del size=1661208 2024-09-14T10:57:27.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.803+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=LXOKP18CXY1W type=del 2024-09-14T10:57:27.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.807+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~7HOI87YT8H39.0 size=845699 2024-09-14T10:57:27.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.807+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=7HOI87YT8H39 tag=Q9FBMDI8FTB9 type=write size=1894275 2024-09-14T10:57:27.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~8UQKHUB5D8XY.0 size=289186 2024-09-14T10:57:27.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.819+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=8UQKHUB5D8XY tag=X0MIWZQY3NSD type=write size=1337762 2024-09-14T10:57:27.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.827+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~JHUVKWRLTFPU.0 size=1048576 2024-09-14T10:57:27.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~JHUVKWRLTFPU.1 size=1048576 2024-09-14T10:57:27.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.835+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~JHUVKWRLTFPU.2 size=54015 2024-09-14T10:57:27.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.835+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=JHUVKWRLTFPU tag=T3BB8WNPAL6T type=write size=3199743 2024-09-14T10:57:27.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.839+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=UPN0GYWEDHWT type=del 2024-09-14T10:57:27.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.843+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~FEXJKHICYI7D.0 size=1048576 2024-09-14T10:57:27.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.847+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~FEXJKHICYI7D.1 size=256855 2024-09-14T10:57:27.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.847+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=FEXJKHICYI7D tag=3BO7N8U68SJH type=write size=2354007 2024-09-14T10:57:27.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.851+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=IB50D97H8V4I type=del 2024-09-14T10:57:27.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.851+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=YT22LBRYGWB6 type=del size=718195 2024-09-14T10:57:27.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.859+0000 7fdf8f02c8c0 1 < suggested remove operation key=HCGZ1MY5SKW9 tag=6U4T1SYCZKNI type=del 2024-09-14T10:57:27.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.859+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=IMLK6JO7HSL7 type=del size=1175186 2024-09-14T10:57:27.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.863+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=ES94WXWPT2O0 type=del 2024-09-14T10:57:27.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.867+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~SOI7YF2TCEGY.0 size=1048576 2024-09-14T10:57:27.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.871+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~SOI7YF2TCEGY.1 size=1048576 2024-09-14T10:57:27.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.871+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~SOI7YF2TCEGY.2 size=127014 2024-09-14T10:57:27.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.871+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=SOI7YF2TCEGY tag=FNCB2OWZ41ZY type=write size=3272742 2024-09-14T10:57:27.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.875+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=YVB91X87ITR7 type=del 2024-09-14T10:57:27.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.875+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=0Y2QHYT7FZYJ type=del size=1644852 2024-09-14T10:57:27.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.879+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~SQY75P29NGZZ.0 size=964504 2024-09-14T10:57:27.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.883+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=SQY75P29NGZZ tag=8W6H67OOTMF1 type=write size=2013080 2024-09-14T10:57:27.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.887+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=EW1EJ9BKTOBX type=del size=354861 2024-09-14T10:57:27.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.895+0000 7fdf8f02c8c0 1 < suggested update operation key=49O8DPTGA65S tag=CTW24DYTZE5I type=write size=297593 2024-09-14T10:57:27.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.899+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~PBWVMCE1111R.0 size=1048576 2024-09-14T10:57:27.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.903+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~PBWVMCE1111R.1 size=203367 2024-09-14T10:57:27.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.903+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=PBWVMCE1111R tag=RAYMH34V36XA type=write size=2300519 2024-09-14T10:57:27.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.907+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~JLGEUELI7WN7.0 size=660771 2024-09-14T10:57:27.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.911+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=JLGEUELI7WN7 tag=L2SCHYOYZ8SG type=write size=1709347 2024-09-14T10:57:27.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.915+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=9IYXKKMW7PSQ type=del size=3051923 2024-09-14T10:57:27.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.919+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~VED303CSL315.0 size=1048576 2024-09-14T10:57:27.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.923+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~VED303CSL315.1 size=142505 2024-09-14T10:57:27.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.927+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=VED303CSL315 tag=2S2PQR9C9Y2W type=write size=2239657 2024-09-14T10:57:27.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.931+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=DN25994MP2II type=del size=1335793 2024-09-14T10:57:27.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.939+0000 7fdf8f02c8c0 1 < suggested remove operation key=KVZEUYUSV5JI tag=ZKT3X5UES3P4 type=del 2024-09-14T10:57:27.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.943+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=KAX4PIOY6YWY type=write size=869 2024-09-14T10:57:27.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.947+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=0SXB80ZVEP7O type=del 2024-09-14T10:57:27.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.951+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=ORRMHFKMBE6Z type=write size=774313 2024-09-14T10:57:27.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~FYVWJWL4DM6Q.0 size=150199 2024-09-14T10:57:27.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.959+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=FYVWJWL4DM6Q tag=DNN7KJ22IW01 type=write size=1198775 2024-09-14T10:57:27.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.967+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~BB13W472V1AF.0 size=552208 2024-09-14T10:57:27.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.967+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=BB13W472V1AF tag=5CSB9Y6ULS6A type=write size=1600784 2024-09-14T10:57:27.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.971+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=L8BT6K3V25PF type=del 2024-09-14T10:57:27.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.975+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~T6LQU5B7ITXW.0 size=361025 2024-09-14T10:57:27.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.975+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=T6LQU5B7ITXW tag=HOHSGCBGFBDT type=write size=1409601 2024-09-14T10:57:27.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.983+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=1V1AXXUNRUAD type=del 2024-09-14T10:57:27.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~9048G45AXC98.0 size=970335 2024-09-14T10:57:27.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.987+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=9048G45AXC98 tag=1N5UFLVW2AWN type=write size=2018911 2024-09-14T10:57:27.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~7HOI87YT8H39.0 size=845699 2024-09-14T10:57:27.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:27.999+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=7HOI87YT8H39 tag=Q9FBMDI8FTB9 type=write size=1894275 2024-09-14T10:57:27.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.003+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=AYQP0RAJIGS5 type=del size=3312299 2024-09-14T10:57:28.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.007+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~JHUVKWRLTFPU.0 size=1048576 2024-09-14T10:57:28.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.007+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_1E72V12EPEH3.2~JHUVKWRLTFPU.1 size=1048576 2024-09-14T10:57:28.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.011+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~JHUVKWRLTFPU.2 size=54015 2024-09-14T10:57:28.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.019+0000 7fdf8f02c8c0 1 < canceled multipart upload key=1E72V12EPEH3 upload=JHUVKWRLTFPU tag=T3BB8WNPAL6T type=write size=3199743 2024-09-14T10:57:28.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.023+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~H07YL7TVFHHQ.0 size=952706 2024-09-14T10:57:28.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.023+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=H07YL7TVFHHQ tag=3NK60FY0L0VK type=write size=2001282 2024-09-14T10:57:28.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.031+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~FEXJKHICYI7D.0 size=1048576 2024-09-14T10:57:28.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.031+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STHEUJ6VDPQB.2~FEXJKHICYI7D.1 size=256855 2024-09-14T10:57:28.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.035+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STHEUJ6VDPQB upload=FEXJKHICYI7D tag=3BO7N8U68SJH type=write size=2354007 2024-09-14T10:57:28.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.047+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~DQPXAGK25G5C.0 size=1048576 2024-09-14T10:57:28.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.047+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~DQPXAGK25G5C.1 size=1048576 2024-09-14T10:57:28.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.051+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~DQPXAGK25G5C.2 size=91662 2024-09-14T10:57:28.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.051+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=DQPXAGK25G5C tag=3I6QXHDR0VYZ type=write size=3237390 2024-09-14T10:57:28.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.059+0000 7fdf8f02c8c0 1 < suggested remove operation key=0QJLAH0EPKVD tag=YT22LBRYGWB6 type=del 2024-09-14T10:57:28.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.063+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=TGJGB1VVWVDV type=del size=1638362 2024-09-14T10:57:28.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.071+0000 7fdf8f02c8c0 1 < suggested remove operation key=X0RT8UF3D0JC tag=IMLK6JO7HSL7 type=del 2024-09-14T10:57:28.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.075+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=UGLMVVJZSSNR type=del size=968146 2024-09-14T10:57:28.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.079+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~SOI7YF2TCEGY.0 size=1048576 2024-09-14T10:57:28.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.083+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~SOI7YF2TCEGY.1 size=1048576 2024-09-14T10:57:28.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.083+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~SOI7YF2TCEGY.2 size=127014 2024-09-14T10:57:28.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.091+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=SOI7YF2TCEGY tag=FNCB2OWZ41ZY type=write size=3272742 2024-09-14T10:57:28.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.095+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=R36OMMESBCLY type=del size=2819087 2024-09-14T10:57:28.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.099+0000 7fdf8f02c8c0 -1 < failed to complete operation key=0QJLAH0EPKVD tag=0Y2QHYT7FZYJ type=del size=1644852: (22) Invalid argument 2024-09-14T10:57:28.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.103+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=0A41WHOML4XE type=del size=2488011 2024-09-14T10:57:28.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.107+0000 7fdf8f02c8c0 1 < suggested remove operation key=3T0H42SC1ETB tag=EW1EJ9BKTOBX type=del 2024-09-14T10:57:28.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.111+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=9BJF4CDCMOBK type=del size=2410589 2024-09-14T10:57:28.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.115+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~PBWVMCE1111R.0 size=1048576 2024-09-14T10:57:28.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.119+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~PBWVMCE1111R.1 size=203367 2024-09-14T10:57:28.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.123+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=PBWVMCE1111R tag=RAYMH34V36XA type=write size=2300519 2024-09-14T10:57:28.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.127+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=23FVS3MY43UL type=write size=74744 2024-09-14T10:57:28.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.131+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=9IYXKKMW7PSQ type=del 2024-09-14T10:57:28.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.139+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~HEVZPVUPQVP5.0 size=389102 2024-09-14T10:57:28.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.139+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=HEVZPVUPQVP5 tag=ME73UNJDNHA4 type=write size=1437678 2024-09-14T10:57:28.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.143+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=DN25994MP2II type=del 2024-09-14T10:57:28.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.147+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=4QWVRX6CJ95D type=del size=3128248 2024-09-14T10:57:28.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.151+0000 7fdf8f02c8c0 1 < completed write operation key=XUT55FR490EO tag=KAX4PIOY6YWY type=write size=869 2024-09-14T10:57:28.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.151+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=FFVTV70UVAL3 type=del size=702083 2024-09-14T10:57:28.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.155+0000 7fdf8f02c8c0 1 < completed write operation key=WA7HE8ZJ1W1M tag=ORRMHFKMBE6Z type=write size=774313 2024-09-14T10:57:28.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.159+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=FNZP818SK48O type=del size=2645337 2024-09-14T10:57:28.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.167+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~BB13W472V1AF.0 size=552208 2024-09-14T10:57:28.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.171+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=BB13W472V1AF tag=5CSB9Y6ULS6A type=write size=1600784 2024-09-14T10:57:28.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.175+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=IJTIQVJ2KF4B type=del size=729067 2024-09-14T10:57:28.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.179+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~T6LQU5B7ITXW.0 size=361025 2024-09-14T10:57:28.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.183+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=T6LQU5B7ITXW tag=HOHSGCBGFBDT type=write size=1409601 2024-09-14T10:57:28.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.191+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~XI3T10UEA8YV.0 size=675580 2024-09-14T10:57:28.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.195+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=XI3T10UEA8YV tag=L4O2Z60FCCUC type=write size=1724156 2024-09-14T10:57:28.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.199+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~9048G45AXC98.0 size=970335 2024-09-14T10:57:28.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.203+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=9048G45AXC98 tag=1N5UFLVW2AWN type=write size=2018911 2024-09-14T10:57:28.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.207+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=UA8M6PZAN4S6 type=del size=2944457 2024-09-14T10:57:28.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.211+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=AYQP0RAJIGS5 type=del 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~5U2WEVKSNTYN.0 size=391707 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.219+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=5U2WEVKSNTYN tag=H8PO7FW2KRL4 type=write size=1440283 2024-09-14T10:57:28.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.223+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_YU9DAJA242Q7.2~H07YL7TVFHHQ.0 size=952706 2024-09-14T10:57:28.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.227+0000 7fdf8f02c8c0 1 < canceled multipart upload key=YU9DAJA242Q7 upload=H07YL7TVFHHQ tag=3NK60FY0L0VK type=write size=2001282 2024-09-14T10:57:28.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.235+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=X7GQTQTDJFO3 type=del size=453795 2024-09-14T10:57:28.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.239+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~DQPXAGK25G5C.0 size=1048576 2024-09-14T10:57:28.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~DQPXAGK25G5C.1 size=1048576 2024-09-14T10:57:28.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~DQPXAGK25G5C.2 size=91662 2024-09-14T10:57:28.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.251+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=DQPXAGK25G5C tag=3I6QXHDR0VYZ type=write size=3237390 2024-09-14T10:57:28.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.255+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=31QWZHJ5UW0Q type=del size=2553007 2024-09-14T10:57:28.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.263+0000 7fdf8f02c8c0 1 < suggested update operation key=LFLY0V3FRRW5 tag=TGJGB1VVWVDV type=del size=1638362 2024-09-14T10:57:28.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.267+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=ARWU78NGJFCF type=write size=188708 2024-09-14T10:57:28.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.271+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=UGLMVVJZSSNR type=del 2024-09-14T10:57:28.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.279+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~HPYICDAGUH6V.0 size=1048576 2024-09-14T10:57:28.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.283+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~HPYICDAGUH6V.1 size=1048576 2024-09-14T10:57:28.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.283+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~HPYICDAGUH6V.2 size=431286 2024-09-14T10:57:28.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.283+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=HPYICDAGUH6V tag=9FXIRHOTFQA2 type=write size=3577014 2024-09-14T10:57:28.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.287+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=R36OMMESBCLY type=del 2024-09-14T10:57:28.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.295+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~63EEC4GP9RU7.0 size=1048576 2024-09-14T10:57:28.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.299+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~63EEC4GP9RU7.1 size=1045242 2024-09-14T10:57:28.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.299+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=63EEC4GP9RU7 tag=ND2MU60A2T3H type=write size=3142394 2024-09-14T10:57:28.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.307+0000 7fdf8f02c8c0 1 < suggested remove operation key=49O8DPTGA65S tag=0A41WHOML4XE type=del 2024-09-14T10:57:28.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.315+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~T1UDNVW107ZG.0 size=366607 2024-09-14T10:57:28.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.315+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=T1UDNVW107ZG tag=ZMNW2CAHJXS1 type=write size=1415183 2024-09-14T10:57:28.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.319+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=9BJF4CDCMOBK type=del 2024-09-14T10:57:28.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.323+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~5W7FI70CCIK2.0 size=1048576 2024-09-14T10:57:28.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.327+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~5W7FI70CCIK2.1 size=1048576 2024-09-14T10:57:28.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.331+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~5W7FI70CCIK2.2 size=916046 2024-09-14T10:57:28.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.331+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=5W7FI70CCIK2 tag=UI2U63APEQUJ type=write size=4061774 2024-09-14T10:57:28.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.339+0000 7fdf8f02c8c0 1 < suggested update operation key=OFY1G5R28CK6 tag=23FVS3MY43UL type=write size=74744 2024-09-14T10:57:28.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~QLDUDT1FHHXC.0 size=1048576 2024-09-14T10:57:28.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~QLDUDT1FHHXC.1 size=1048576 2024-09-14T10:57:28.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~QLDUDT1FHHXC.2 size=247933 2024-09-14T10:57:28.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.351+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=QLDUDT1FHHXC tag=70OKX46KKLU8 type=write size=3393661 2024-09-14T10:57:28.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.359+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~HEVZPVUPQVP5.0 size=389102 2024-09-14T10:57:28.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.363+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=HEVZPVUPQVP5 tag=ME73UNJDNHA4 type=write size=1437678 2024-09-14T10:57:28.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.363+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=UIQ80DDLJCYK type=del size=3082775 2024-09-14T10:57:28.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.367+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=4QWVRX6CJ95D type=del 2024-09-14T10:57:28.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.375+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~BDZRM5C7CS8V.0 size=556317 2024-09-14T10:57:28.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.375+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=BDZRM5C7CS8V tag=7QI6TL8Z3AAL type=write size=1604893 2024-09-14T10:57:28.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.379+0000 7fdf8f02c8c0 -1 < failed to complete operation key=OFY1G5R28CK6 tag=FFVTV70UVAL3 type=del size=702083: (22) Invalid argument 2024-09-14T10:57:28.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.383+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=CFDJLRZT8U5S type=del size=2032635 2024-09-14T10:57:28.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.387+0000 7fdf8f02c8c0 1 < canceled operation key=LMNGCUFR187I tag=FNZP818SK48O type=del size=2645337 2024-09-14T10:57:28.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.391+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=0Q0RYKRIB1A5 type=del size=2933488 2024-09-14T10:57:28.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.395+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=IJTIQVJ2KF4B type=del 2024-09-14T10:57:28.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.399+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=V3WF0NML7CLW type=del size=1386877 2024-09-14T10:57:28.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.403+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~XI3T10UEA8YV.0 size=675580 2024-09-14T10:57:28.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.411+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=XI3T10UEA8YV tag=L4O2Z60FCCUC type=write size=1724156 2024-09-14T10:57:28.412 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.415+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=3O7KXD2KA1SE type=write size=851714 2024-09-14T10:57:28.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.419+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=49O8DPTGA65S tag=UA8M6PZAN4S6 type=del size=2944457: (2) No such file or directory 2024-09-14T10:57:28.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.423+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~C7NMPWH9TI44.0 size=309606 2024-09-14T10:57:28.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.423+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=C7NMPWH9TI44 tag=1EMN0BCGKT13 type=write size=1358182 2024-09-14T10:57:28.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.427+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~5U2WEVKSNTYN.0 size=391707 2024-09-14T10:57:28.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.435+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=5U2WEVKSNTYN tag=H8PO7FW2KRL4 type=write size=1440283 2024-09-14T10:57:28.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.439+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=LROSJVI8B31Z type=del size=4112030 2024-09-14T10:57:28.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.447+0000 7fdf8f02c8c0 1 < suggested update operation key=1E72V12EPEH3 tag=X7GQTQTDJFO3 type=del size=453795 2024-09-14T10:57:28.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.451+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~1KJWMTMCL634.0 size=5774 2024-09-14T10:57:28.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.451+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=1KJWMTMCL634 tag=UUC3SV0OS40M type=write size=1054350 2024-09-14T10:57:28.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.455+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=31QWZHJ5UW0Q type=del 2024-09-14T10:57:28.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.459+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=EG46GA0DGTTE type=del size=659974 2024-09-14T10:57:28.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.463+0000 7fdf8f02c8c0 -1 < failed to complete operation key=1E72V12EPEH3 tag=ARWU78NGJFCF type=write size=188708: (22) Invalid argument 2024-09-14T10:57:28.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.471+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~LSF23BU3FY52.0 size=1012470 2024-09-14T10:57:28.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.471+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=LSF23BU3FY52 tag=GP6NF67NCTB1 type=write size=2061046 2024-09-14T10:57:28.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.475+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~HPYICDAGUH6V.0 size=1048576 2024-09-14T10:57:28.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.479+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~HPYICDAGUH6V.1 size=1048576 2024-09-14T10:57:28.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.483+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~HPYICDAGUH6V.2 size=431286 2024-09-14T10:57:28.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.487+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=HPYICDAGUH6V tag=9FXIRHOTFQA2 type=write size=3577014 2024-09-14T10:57:28.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.495+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~41O7KB9U051S.0 size=1048576 2024-09-14T10:57:28.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.495+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~41O7KB9U051S.1 size=579656 2024-09-14T10:57:28.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.495+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=41O7KB9U051S tag=IO2NK621P818 type=write size=2676808 2024-09-14T10:57:28.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~63EEC4GP9RU7.0 size=1048576 2024-09-14T10:57:28.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.499+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_YU9DAJA242Q7.2~63EEC4GP9RU7.1 size=1045242 2024-09-14T10:57:28.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.507+0000 7fdf8f02c8c0 1 < canceled multipart upload key=YU9DAJA242Q7 upload=63EEC4GP9RU7 tag=ND2MU60A2T3H type=write size=3142394 2024-09-14T10:57:28.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.511+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=VB7ZZHG4N60K type=del size=1988003 2024-09-14T10:57:28.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.515+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~T1UDNVW107ZG.0 size=366607 2024-09-14T10:57:28.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.519+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=T1UDNVW107ZG tag=ZMNW2CAHJXS1 type=write size=1415183 2024-09-14T10:57:28.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.523+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=V5IDL3Q0LH3F type=del size=709096 2024-09-14T10:57:28.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.527+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~5W7FI70CCIK2.0 size=1048576 2024-09-14T10:57:28.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.531+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~5W7FI70CCIK2.1 size=1048576 2024-09-14T10:57:28.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.535+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~5W7FI70CCIK2.2 size=916046 2024-09-14T10:57:28.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.539+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=5W7FI70CCIK2 tag=UI2U63APEQUJ type=write size=4061774 2024-09-14T10:57:28.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.543+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=TB6KZUCEK8SX type=del size=1012457 2024-09-14T10:57:28.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.543+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_X0RT8UF3D0JC.2~QLDUDT1FHHXC.0 size=1048576 2024-09-14T10:57:28.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~QLDUDT1FHHXC.1 size=1048576 2024-09-14T10:57:28.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.551+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~QLDUDT1FHHXC.2 size=247933 2024-09-14T10:57:28.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.555+0000 7fdf8f02c8c0 1 < canceled multipart upload key=X0RT8UF3D0JC upload=QLDUDT1FHHXC tag=70OKX46KKLU8 type=write size=3393661 2024-09-14T10:57:28.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.559+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=CN8AKFLEQ3S0 type=del size=4054396 2024-09-14T10:57:28.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.563+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=UIQ80DDLJCYK type=del 2024-09-14T10:57:28.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.567+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=337Q52GOM9XD type=del size=2959423 2024-09-14T10:57:28.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.571+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~BDZRM5C7CS8V.0 size=556317 2024-09-14T10:57:28.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.575+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=BDZRM5C7CS8V tag=7QI6TL8Z3AAL type=write size=1604893 2024-09-14T10:57:28.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.579+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=0D7IE23OV7UG type=del size=3956346 2024-09-14T10:57:28.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.583+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=CFDJLRZT8U5S type=del 2024-09-14T10:57:28.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.587+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=WDZD5S5WCNGI type=del size=914758 2024-09-14T10:57:28.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.591+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=0Q0RYKRIB1A5 type=del 2024-09-14T10:57:28.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.595+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=LOTT010R35W2 type=write size=948334 2024-09-14T10:57:28.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.599+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=V3WF0NML7CLW type=del 2024-09-14T10:57:28.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~7P7LJWXD53Y5.0 size=1048576 2024-09-14T10:57:28.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.611+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~7P7LJWXD53Y5.1 size=1048576 2024-09-14T10:57:28.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.611+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~7P7LJWXD53Y5.2 size=609691 2024-09-14T10:57:28.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.611+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=7P7LJWXD53Y5 tag=OMMOL8Q47QP9 type=write size=3755419 2024-09-14T10:57:28.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.619+0000 7fdf8f02c8c0 1 < completed write operation key=KVZEUYUSV5JI tag=3O7KXD2KA1SE type=write size=851714 2024-09-14T10:57:28.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.627+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~TDA6B9PYI5RD.0 size=1048576 2024-09-14T10:57:28.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.627+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~TDA6B9PYI5RD.1 size=1048576 2024-09-14T10:57:28.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.631+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~TDA6B9PYI5RD.2 size=494821 2024-09-14T10:57:28.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.631+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=TDA6B9PYI5RD tag=OI5UKZQO4ZKJ type=write size=3640549 2024-09-14T10:57:28.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.635+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~C7NMPWH9TI44.0 size=309606 2024-09-14T10:57:28.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.643+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=C7NMPWH9TI44 tag=1EMN0BCGKT13 type=write size=1358182 2024-09-14T10:57:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.659+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=SQSZ7PNNTQ27 type=del size=4073293 2024-09-14T10:57:28.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.667+0000 7fdf8f02c8c0 1 < suggested remove operation key=WA7HE8ZJ1W1M tag=LROSJVI8B31Z type=del 2024-09-14T10:57:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.667+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=G7BAV6P04UAU type=del size=4149422 2024-09-14T10:57:28.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.671+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~1KJWMTMCL634.0 size=5774 2024-09-14T10:57:28.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.679+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=1KJWMTMCL634 tag=UUC3SV0OS40M type=write size=1054350 2024-09-14T10:57:28.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.683+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=SK5U4INR9II3 type=del size=1321318 2024-09-14T10:57:28.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.683+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=EG46GA0DGTTE type=del 2024-09-14T10:57:28.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.691+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~ZRXO6BYPV4Y5.0 size=205873 2024-09-14T10:57:28.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.691+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=ZRXO6BYPV4Y5 tag=SWLD1YTRXQA6 type=write size=1254449 2024-09-14T10:57:28.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.695+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~LSF23BU3FY52.0 size=1012470 2024-09-14T10:57:28.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.699+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=LSF23BU3FY52 tag=GP6NF67NCTB1 type=write size=2061046 2024-09-14T10:57:28.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.703+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~XFRNEANC6DWO.0 size=1048576 2024-09-14T10:57:28.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~XFRNEANC6DWO.1 size=961936 2024-09-14T10:57:28.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.707+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=XFRNEANC6DWO tag=1ZBQWYLNUQZQ type=write size=3059088 2024-09-14T10:57:28.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.711+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~41O7KB9U051S.0 size=1048576 2024-09-14T10:57:28.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.715+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~41O7KB9U051S.1 size=579656 2024-09-14T10:57:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.719+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=41O7KB9U051S tag=IO2NK621P818 type=write size=2676808 2024-09-14T10:57:28.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.723+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~N807H7LZS4X0.0 size=1048576 2024-09-14T10:57:28.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.727+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~N807H7LZS4X0.1 size=1048576 2024-09-14T10:57:28.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.727+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~N807H7LZS4X0.2 size=18526 2024-09-14T10:57:28.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.727+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=N807H7LZS4X0 tag=V3IGRE7VLQXE type=write size=3164254 2024-09-14T10:57:28.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.731+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=VB7ZZHG4N60K type=del 2024-09-14T10:57:28.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.735+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=87FZP007R9JO type=del size=1819341 2024-09-14T10:57:28.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.739+0000 7fdf8f02c8c0 1 < canceled operation key=ZSBCGOXXJ0D5 tag=V5IDL3Q0LH3F type=del size=709096 2024-09-14T10:57:28.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.739+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=I5M0KIWQSEZK type=write size=487475 2024-09-14T10:57:28.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.743+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=TB6KZUCEK8SX type=del 2024-09-14T10:57:28.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.747+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=9JC4DLTZIP3Z type=del size=1278289 2024-09-14T10:57:28.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.763+0000 7fdf8f02c8c0 1 < suggested remove operation key=3QSOKUSZ57QM tag=CN8AKFLEQ3S0 type=del 2024-09-14T10:57:28.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.763+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=XX6UQYTX4LPR type=del size=833083 2024-09-14T10:57:28.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.767+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=337Q52GOM9XD type=del 2024-09-14T10:57:28.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~C0BJGVTYZD08.0 size=1048576 2024-09-14T10:57:28.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~C0BJGVTYZD08.1 size=518599 2024-09-14T10:57:28.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.775+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=C0BJGVTYZD08 tag=VRJ6BAUD4S70 type=write size=2615751 2024-09-14T10:57:28.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.783+0000 7fdf8f02c8c0 1 < suggested update operation key=1E72V12EPEH3 tag=0D7IE23OV7UG type=del size=3956346 2024-09-14T10:57:28.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.791+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~BJ7EX6L0Z659.0 size=1048576 2024-09-14T10:57:28.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~BJ7EX6L0Z659.1 size=1048576 2024-09-14T10:57:28.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.799+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~BJ7EX6L0Z659.2 size=693279 2024-09-14T10:57:28.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.799+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=BJ7EX6L0Z659 tag=0KK7UV4Q8UZO type=write size=3839007 2024-09-14T10:57:28.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.807+0000 7fdf8f02c8c0 1 < suggested remove operation key=3CYCJJIQ210M tag=WDZD5S5WCNGI type=del 2024-09-14T10:57:28.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.811+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=0LGVWAKT9AO9 type=del size=2329183 2024-09-14T10:57:28.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.819+0000 7fdf8f02c8c0 -1 < failed to complete operation key=WA7HE8ZJ1W1M tag=LOTT010R35W2 type=write size=948334: (22) Invalid argument 2024-09-14T10:57:28.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.827+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~ABGU1QW2XBU2.0 size=1048576 2024-09-14T10:57:28.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.827+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~ABGU1QW2XBU2.1 size=1048576 2024-09-14T10:57:28.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~ABGU1QW2XBU2.2 size=476938 2024-09-14T10:57:28.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.831+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=ABGU1QW2XBU2 tag=ATY0MYDB7WIQ type=write size=3622666 2024-09-14T10:57:28.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.835+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_MNBXQTJBS1QS.2~7P7LJWXD53Y5.0 size=1048576 2024-09-14T10:57:28.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.835+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~7P7LJWXD53Y5.1 size=1048576 2024-09-14T10:57:28.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.839+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~7P7LJWXD53Y5.2 size=609691 2024-09-14T10:57:28.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.847+0000 7fdf8f02c8c0 1 < canceled multipart upload key=MNBXQTJBS1QS upload=7P7LJWXD53Y5 tag=OMMOL8Q47QP9 type=write size=3755419 2024-09-14T10:57:28.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.855+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~1Q23H3AELVXF.0 size=401905 2024-09-14T10:57:28.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.855+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=1Q23H3AELVXF tag=AVLVHQGW7ROF type=write size=1450481 2024-09-14T10:57:28.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.859+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~TDA6B9PYI5RD.0 size=1048576 2024-09-14T10:57:28.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.863+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~TDA6B9PYI5RD.1 size=1048576 2024-09-14T10:57:28.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.867+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~TDA6B9PYI5RD.2 size=494821 2024-09-14T10:57:28.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.871+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=TDA6B9PYI5RD tag=OI5UKZQO4ZKJ type=write size=3640549 2024-09-14T10:57:28.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.879+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~9TPK9OZYQY6M.0 size=365707 2024-09-14T10:57:28.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.879+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=9TPK9OZYQY6M tag=PNNP2CJ8J98G type=write size=1414283 2024-09-14T10:57:28.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.883+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=3QSOKUSZ57QM tag=SQSZ7PNNTQ27 type=del size=4073293: (2) No such file or directory 2024-09-14T10:57:28.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.887+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=XVYZ4R6TF0Y4 type=del size=3936520 2024-09-14T10:57:28.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.895+0000 7fdf8f02c8c0 1 < suggested remove operation key=HCGZ1MY5SKW9 tag=G7BAV6P04UAU type=del 2024-09-14T10:57:28.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.899+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=84P3NX9FR6S1 type=del size=2091978 2024-09-14T10:57:28.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.903+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=SK5U4INR9II3 type=del 2024-09-14T10:57:28.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.907+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=32YQKJULURYE type=del size=625137 2024-09-14T10:57:28.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.907+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_82N2FPU7LKTG.2~ZRXO6BYPV4Y5.0 size=205873 2024-09-14T10:57:28.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.915+0000 7fdf8f02c8c0 1 < canceled multipart upload key=82N2FPU7LKTG upload=ZRXO6BYPV4Y5 tag=SWLD1YTRXQA6 type=write size=1254449 2024-09-14T10:57:28.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.919+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~EIBFH63K44P7.0 size=1048576 2024-09-14T10:57:28.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~EIBFH63K44P7.1 size=400397 2024-09-14T10:57:28.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.923+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=EIBFH63K44P7 tag=8R85PMTR4SFU type=write size=2497549 2024-09-14T10:57:28.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.927+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~XFRNEANC6DWO.0 size=1048576 2024-09-14T10:57:28.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.931+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~XFRNEANC6DWO.1 size=961936 2024-09-14T10:57:28.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.939+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=XFRNEANC6DWO tag=1ZBQWYLNUQZQ type=write size=3059088 2024-09-14T10:57:28.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.939+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=KG0PA1L1645N type=write size=511000 2024-09-14T10:57:28.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.947+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~N807H7LZS4X0.0 size=1048576 2024-09-14T10:57:28.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.947+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~N807H7LZS4X0.1 size=1048576 2024-09-14T10:57:28.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.951+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~N807H7LZS4X0.2 size=18526 2024-09-14T10:57:28.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.955+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=N807H7LZS4X0 tag=V3IGRE7VLQXE type=write size=3164254 2024-09-14T10:57:28.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.963+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~QL2AKE8HIDXH.0 size=1048576 2024-09-14T10:57:28.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.967+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~QL2AKE8HIDXH.1 size=1048576 2024-09-14T10:57:28.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.971+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~QL2AKE8HIDXH.2 size=540530 2024-09-14T10:57:28.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.971+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=QL2AKE8HIDXH tag=Y3MGAIK4IDX6 type=write size=3686258 2024-09-14T10:57:28.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.971+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=87FZP007R9JO type=del 2024-09-14T10:57:28.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.975+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=T6GT422HV5TZ type=del size=204950 2024-09-14T10:57:28.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.979+0000 7fdf8f02c8c0 1 < completed write operation key=STHEUJ6VDPQB tag=I5M0KIWQSEZK type=write size=487475 2024-09-14T10:57:28.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.983+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=NI6V14ACSCX7 type=del size=4189946 2024-09-14T10:57:28.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.987+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=9JC4DLTZIP3Z type=del 2024-09-14T10:57:28.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.995+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~UATC46PIUDYD.0 size=1048576 2024-09-14T10:57:28.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.999+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~UATC46PIUDYD.1 size=12444 2024-09-14T10:57:28.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:28.999+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=UATC46PIUDYD tag=3U38O3Y4I6Z5 type=write size=2109596 2024-09-14T10:57:28.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.003+0000 7fdf8f02c8c0 -1 < failed to complete operation key=HCGZ1MY5SKW9 tag=XX6UQYTX4LPR type=del size=833083: (22) Invalid argument 2024-09-14T10:57:29.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.007+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=616GPQ8K7BN6 type=write size=315079 2024-09-14T10:57:29.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.007+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_304ZNF4OC1ML.2~C0BJGVTYZD08.0 size=1048576 2024-09-14T10:57:29.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.011+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~C0BJGVTYZD08.1 size=518599 2024-09-14T10:57:29.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.015+0000 7fdf8f02c8c0 1 < canceled multipart upload key=304ZNF4OC1ML upload=C0BJGVTYZD08 tag=VRJ6BAUD4S70 type=write size=2615751 2024-09-14T10:57:29.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.023+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~PXQFVHTDE8W4.0 size=951108 2024-09-14T10:57:29.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.023+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=PXQFVHTDE8W4 tag=NCTHJNRGUNIY type=write size=1999684 2024-09-14T10:57:29.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.027+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~BJ7EX6L0Z659.0 size=1048576 2024-09-14T10:57:29.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.031+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~BJ7EX6L0Z659.1 size=1048576 2024-09-14T10:57:29.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.031+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~BJ7EX6L0Z659.2 size=693279 2024-09-14T10:57:29.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.039+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=BJ7EX6L0Z659 tag=0KK7UV4Q8UZO type=write size=3839007 2024-09-14T10:57:29.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.043+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=C26OVTT7UN4Y type=del size=495644 2024-09-14T10:57:29.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.051+0000 7fdf8f02c8c0 1 < suggested remove operation key=Y32RWGISRBMT tag=0LGVWAKT9AO9 type=del 2024-09-14T10:57:29.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.055+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=QZN3JWBJDF4V type=del size=1296178 2024-09-14T10:57:29.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.059+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~ABGU1QW2XBU2.0 size=1048576 2024-09-14T10:57:29.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.063+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~ABGU1QW2XBU2.1 size=1048576 2024-09-14T10:57:29.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.063+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~ABGU1QW2XBU2.2 size=476938 2024-09-14T10:57:29.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.079+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=ABGU1QW2XBU2 tag=ATY0MYDB7WIQ type=write size=3622666 2024-09-14T10:57:29.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~CIEP1IJDG68R.0 size=942705 2024-09-14T10:57:29.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.083+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=CIEP1IJDG68R tag=OF6S3AOSZP5O type=write size=1991281 2024-09-14T10:57:29.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.087+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~1Q23H3AELVXF.0 size=401905 2024-09-14T10:57:29.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.095+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=1Q23H3AELVXF tag=AVLVHQGW7ROF type=write size=1450481 2024-09-14T10:57:29.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.099+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=SI0HF0GKAXZI type=del size=2165076 2024-09-14T10:57:29.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.103+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~9TPK9OZYQY6M.0 size=365707 2024-09-14T10:57:29.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.107+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=9TPK9OZYQY6M tag=PNNP2CJ8J98G type=write size=1414283 2024-09-14T10:57:29.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.111+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=76F2K7CZXGX7 type=del size=1990878 2024-09-14T10:57:29.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.119+0000 7fdf8f02c8c0 1 < canceled operation key=6VNI8FMHZ0FN tag=XVYZ4R6TF0Y4 type=del size=3936520 2024-09-14T10:57:29.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~QLWXN4GG9VYV.0 size=1048576 2024-09-14T10:57:29.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.131+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~QLWXN4GG9VYV.1 size=437872 2024-09-14T10:57:29.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.131+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=QLWXN4GG9VYV tag=OGR79RTIUK6K type=write size=2535024 2024-09-14T10:57:29.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.139+0000 7fdf8f02c8c0 1 < suggested remove operation key=MNBXQTJBS1QS tag=84P3NX9FR6S1 type=del 2024-09-14T10:57:29.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.143+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=1GPUHGZIDPG3 type=del size=3898110 2024-09-14T10:57:29.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.147+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=32YQKJULURYE type=del 2024-09-14T10:57:29.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~X46YBDKTUDXG.0 size=1048576 2024-09-14T10:57:29.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.155+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~X46YBDKTUDXG.1 size=1048576 2024-09-14T10:57:29.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.159+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~X46YBDKTUDXG.2 size=58923 2024-09-14T10:57:29.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.159+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=X46YBDKTUDXG tag=CE6N1YHPFT1E type=write size=3204651 2024-09-14T10:57:29.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~EIBFH63K44P7.0 size=1048576 2024-09-14T10:57:29.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~EIBFH63K44P7.1 size=400397 2024-09-14T10:57:29.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.171+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=EIBFH63K44P7 tag=8R85PMTR4SFU type=write size=2497549 2024-09-14T10:57:29.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.175+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=43NOA0MOKMME type=write size=223542 2024-09-14T10:57:29.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.179+0000 7fdf8f02c8c0 1 < canceled operation key=ZSBCGOXXJ0D5 tag=KG0PA1L1645N type=write size=511000 2024-09-14T10:57:29.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.183+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=FFZXENEDLNVZ type=write size=871891 2024-09-14T10:57:29.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.187+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~QL2AKE8HIDXH.0 size=1048576 2024-09-14T10:57:29.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.191+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~QL2AKE8HIDXH.1 size=1048576 2024-09-14T10:57:29.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.195+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~QL2AKE8HIDXH.2 size=540530 2024-09-14T10:57:29.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.199+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=QL2AKE8HIDXH tag=Y3MGAIK4IDX6 type=write size=3686258 2024-09-14T10:57:29.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.203+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=8J2URRNJVSNB type=del size=2614112 2024-09-14T10:57:29.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.207+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=T6GT422HV5TZ type=del 2024-09-14T10:57:29.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.215+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~ZIBNKKYAIR7K.0 size=1048576 2024-09-14T10:57:29.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~ZIBNKKYAIR7K.1 size=1048576 2024-09-14T10:57:29.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.223+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~ZIBNKKYAIR7K.2 size=834156 2024-09-14T10:57:29.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.223+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=ZIBNKKYAIR7K tag=MXT3AIWZRLWB type=write size=3979884 2024-09-14T10:57:29.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.227+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=NI6V14ACSCX7 type=del 2024-09-14T10:57:29.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.227+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=P478F610NX0O type=del size=360330 2024-09-14T10:57:29.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.231+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_49O8DPTGA65S.2~UATC46PIUDYD.0 size=1048576 2024-09-14T10:57:29.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.231+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~UATC46PIUDYD.1 size=12444 2024-09-14T10:57:29.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.239+0000 7fdf8f02c8c0 1 < canceled multipart upload key=49O8DPTGA65S upload=UATC46PIUDYD tag=3U38O3Y4I6Z5 type=write size=2109596 2024-09-14T10:57:29.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.243+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=EX0Y97K7D29P type=del size=1747422 2024-09-14T10:57:29.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.247+0000 7fdf8f02c8c0 1 < completed write operation key=WA7HE8ZJ1W1M tag=616GPQ8K7BN6 type=write size=315079 2024-09-14T10:57:29.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.251+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=NJHHARSNW467 type=del size=3848092 2024-09-14T10:57:29.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.255+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~PXQFVHTDE8W4.0 size=951108 2024-09-14T10:57:29.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.259+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=PXQFVHTDE8W4 tag=NCTHJNRGUNIY type=write size=1999684 2024-09-14T10:57:29.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.263+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=WJRQ1U54RLCF type=write size=896227 2024-09-14T10:57:29.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.271+0000 7fdf8f02c8c0 1 < suggested remove operation key=TZZ05IIMZJ4J tag=C26OVTT7UN4Y type=del 2024-09-14T10:57:29.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.275+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=FPZZC5WVHH92 type=del size=433693 2024-09-14T10:57:29.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.275+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=QZN3JWBJDF4V type=del 2024-09-14T10:57:29.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.283+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~A336WJERXZTH.0 size=1048576 2024-09-14T10:57:29.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.287+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~A336WJERXZTH.1 size=938406 2024-09-14T10:57:29.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.287+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=A336WJERXZTH tag=5W2C92VLDRF2 type=write size=3035558 2024-09-14T10:57:29.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.287+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~CIEP1IJDG68R.0 size=942705 2024-09-14T10:57:29.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.291+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=CIEP1IJDG68R tag=OF6S3AOSZP5O type=write size=1991281 2024-09-14T10:57:29.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.299+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~6ZKRHU40RKH0.0 size=1048576 2024-09-14T10:57:29.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.303+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~6ZKRHU40RKH0.1 size=1048576 2024-09-14T10:57:29.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.303+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~6ZKRHU40RKH0.2 size=43186 2024-09-14T10:57:29.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.303+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=6ZKRHU40RKH0 tag=ELPNSBJ38KZC type=write size=3188914 2024-09-14T10:57:29.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.307+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=SI0HF0GKAXZI type=del 2024-09-14T10:57:29.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.311+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=0XPDY4GK3M6C type=del size=1050719 2024-09-14T10:57:29.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.319+0000 7fdf8f02c8c0 1 < suggested update operation key=9IDBODZBQRJR tag=76F2K7CZXGX7 type=del size=1990878 2024-09-14T10:57:29.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.323+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=TUNT2Z0YVQD0 type=write size=578455 2024-09-14T10:57:29.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.327+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~QLWXN4GG9VYV.0 size=1048576 2024-09-14T10:57:29.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.331+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~QLWXN4GG9VYV.1 size=437872 2024-09-14T10:57:29.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.339+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=QLWXN4GG9VYV tag=OGR79RTIUK6K type=write size=2535024 2024-09-14T10:57:29.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~FHSGOADNOPS0.0 size=1048576 2024-09-14T10:57:29.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~FHSGOADNOPS0.1 size=255884 2024-09-14T10:57:29.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.347+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=FHSGOADNOPS0 tag=WASN7L0NK8PT type=write size=2353036 2024-09-14T10:57:29.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.351+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=1GPUHGZIDPG3 type=del 2024-09-14T10:57:29.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.355+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=C961K6J16KAV type=del size=2924903 2024-09-14T10:57:29.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.359+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~X46YBDKTUDXG.0 size=1048576 2024-09-14T10:57:29.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.363+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~X46YBDKTUDXG.1 size=1048576 2024-09-14T10:57:29.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.367+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~X46YBDKTUDXG.2 size=58923 2024-09-14T10:57:29.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.371+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=X46YBDKTUDXG tag=CE6N1YHPFT1E type=write size=3204651 2024-09-14T10:57:29.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.379+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~AEKGRKIY32LB.0 size=1048576 2024-09-14T10:57:29.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.383+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~AEKGRKIY32LB.1 size=1048576 2024-09-14T10:57:29.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.387+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~AEKGRKIY32LB.2 size=459387 2024-09-14T10:57:29.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.387+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=AEKGRKIY32LB tag=0JPQ6773LLAG type=write size=3605115 2024-09-14T10:57:29.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.391+0000 7fdf8f02c8c0 -1 < failed to complete operation key=TZZ05IIMZJ4J tag=43NOA0MOKMME type=write size=223542: (22) Invalid argument 2024-09-14T10:57:29.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.395+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=2FCHI727P8WC type=del size=3170122 2024-09-14T10:57:29.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.403+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=FFZXENEDLNVZ type=write size=871891 2024-09-14T10:57:29.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.403+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=WB5577CIAE2W type=del size=3808504 2024-09-14T10:57:29.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.411+0000 7fdf8f02c8c0 1 < suggested remove operation key=XUT55FR490EO tag=8J2URRNJVSNB type=del 2024-09-14T10:57:29.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.419+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~BPZ560FPDKK3.0 size=1048576 2024-09-14T10:57:29.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.419+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~BPZ560FPDKK3.1 size=969803 2024-09-14T10:57:29.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.419+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=BPZ560FPDKK3 tag=O5VH0S4ZSWNT type=write size=3066955 2024-09-14T10:57:29.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.423+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~ZIBNKKYAIR7K.0 size=1048576 2024-09-14T10:57:29.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.427+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~ZIBNKKYAIR7K.1 size=1048576 2024-09-14T10:57:29.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.431+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~ZIBNKKYAIR7K.2 size=834156 2024-09-14T10:57:29.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.435+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=ZIBNKKYAIR7K tag=MXT3AIWZRLWB type=write size=3979884 2024-09-14T10:57:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.439+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=FSJIEPCJZO28 type=del size=1437136 2024-09-14T10:57:29.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.443+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=P478F610NX0O type=del 2024-09-14T10:57:29.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.447+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=FZAJRVNEKN8L type=del size=3305777 2024-09-14T10:57:29.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.447+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=EX0Y97K7D29P type=del 2024-09-14T10:57:29.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.455+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~00G5AVGEPWTW.0 size=331056 2024-09-14T10:57:29.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.455+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=00G5AVGEPWTW tag=LWSZN81YFEY8 type=write size=1379632 2024-09-14T10:57:29.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.459+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=NJHHARSNW467 type=del 2024-09-14T10:57:29.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.463+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=C5ZATFLPWZXS type=write size=562738 2024-09-14T10:57:29.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.467+0000 7fdf8f02c8c0 -1 < failed to complete operation key=TZZ05IIMZJ4J tag=WJRQ1U54RLCF type=write size=896227: (22) Invalid argument 2024-09-14T10:57:29.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.471+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=09BV1TTXK1ZB type=del size=3729658 2024-09-14T10:57:29.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.475+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=FPZZC5WVHH92 type=del 2024-09-14T10:57:29.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.479+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=21CPKKWYOERA type=del size=2068017 2024-09-14T10:57:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.483+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~A336WJERXZTH.0 size=1048576 2024-09-14T10:57:29.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.487+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~A336WJERXZTH.1 size=938406 2024-09-14T10:57:29.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.491+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=A336WJERXZTH tag=5W2C92VLDRF2 type=write size=3035558 2024-09-14T10:57:29.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.495+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=UAOEPS0YX5BC type=del size=667006 2024-09-14T10:57:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~6ZKRHU40RKH0.0 size=1048576 2024-09-14T10:57:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~6ZKRHU40RKH0.1 size=1048576 2024-09-14T10:57:29.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.503+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~6ZKRHU40RKH0.2 size=43186 2024-09-14T10:57:29.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.511+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=6ZKRHU40RKH0 tag=ELPNSBJ38KZC type=write size=3188914 2024-09-14T10:57:29.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~AYWOI8K9R20P.0 size=437158 2024-09-14T10:57:29.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.515+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=AYWOI8K9R20P tag=041HCXIWKVAZ type=write size=1485734 2024-09-14T10:57:29.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.519+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=0XPDY4GK3M6C type=del 2024-09-14T10:57:29.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.527+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~D2A9H78YMZG1.0 size=1048576 2024-09-14T10:57:29.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.531+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~D2A9H78YMZG1.1 size=440797 2024-09-14T10:57:29.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.531+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=D2A9H78YMZG1 tag=AD6DKIHEPAH1 type=write size=2537949 2024-09-14T10:57:29.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.535+0000 7fdf8f02c8c0 1 < completed write operation key=L1ERJ0JSRDMG tag=TUNT2Z0YVQD0 type=write size=578455 2024-09-14T10:57:29.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.535+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=BD7TWTYM9JZT type=del size=1493223 2024-09-14T10:57:29.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.539+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~FHSGOADNOPS0.0 size=1048576 2024-09-14T10:57:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.543+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~FHSGOADNOPS0.1 size=255884 2024-09-14T10:57:29.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.547+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=FHSGOADNOPS0 tag=WASN7L0NK8PT type=write size=2353036 2024-09-14T10:57:29.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.555+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~HJI8BUQTX9J9.0 size=218061 2024-09-14T10:57:29.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.555+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=HJI8BUQTX9J9 tag=RNLAW4I8RS35 type=write size=1266637 2024-09-14T10:57:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.559+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=C961K6J16KAV type=del 2024-09-14T10:57:29.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.567+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~872NLP41IP2V.0 size=1048576 2024-09-14T10:57:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~872NLP41IP2V.1 size=1048576 2024-09-14T10:57:29.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~872NLP41IP2V.2 size=507594 2024-09-14T10:57:29.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.571+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=872NLP41IP2V tag=MVV821N4XGJ9 type=write size=3653322 2024-09-14T10:57:29.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.575+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~AEKGRKIY32LB.0 size=1048576 2024-09-14T10:57:29.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.579+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~AEKGRKIY32LB.1 size=1048576 2024-09-14T10:57:29.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.579+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_APDKRWHOUH9T.2~AEKGRKIY32LB.2 size=459387 2024-09-14T10:57:29.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.587+0000 7fdf8f02c8c0 1 < canceled multipart upload key=APDKRWHOUH9T upload=AEKGRKIY32LB tag=0JPQ6773LLAG type=write size=3605115 2024-09-14T10:57:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.591+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~8E2BHLLXRTA0.0 size=1048576 2024-09-14T10:57:29.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.595+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~8E2BHLLXRTA0.1 size=1018439 2024-09-14T10:57:29.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.595+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=8E2BHLLXRTA0 tag=5GKVLOQHNUTC type=write size=3115591 2024-09-14T10:57:29.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.603+0000 7fdf8f02c8c0 1 < suggested update operation key=YU9DAJA242Q7 tag=2FCHI727P8WC type=del size=3170122 2024-09-14T10:57:29.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.607+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=HVLWGITT1HQA type=del size=128658 2024-09-14T10:57:29.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.611+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=WB5577CIAE2W type=del 2024-09-14T10:57:29.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.615+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~AVK18T23L6S8.0 size=1048576 2024-09-14T10:57:29.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.619+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~AVK18T23L6S8.1 size=884461 2024-09-14T10:57:29.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.619+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=AVK18T23L6S8 tag=TFJF53N7XWYL type=write size=2981613 2024-09-14T10:57:29.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.623+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~BPZ560FPDKK3.0 size=1048576 2024-09-14T10:57:29.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.627+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~BPZ560FPDKK3.1 size=969803 2024-09-14T10:57:29.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.631+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=BPZ560FPDKK3 tag=O5VH0S4ZSWNT type=write size=3066955 2024-09-14T10:57:29.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.635+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=EYOUR0ZOAWB3 type=write size=91192 2024-09-14T10:57:29.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.639+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=FSJIEPCJZO28 type=del 2024-09-14T10:57:29.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.643+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=76047HMACEV6 type=write size=986174 2024-09-14T10:57:29.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.647+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=FZAJRVNEKN8L type=del 2024-09-14T10:57:29.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~RVE1RWNOZQPQ.0 size=1048576 2024-09-14T10:57:29.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.659+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~RVE1RWNOZQPQ.1 size=920404 2024-09-14T10:57:29.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.659+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=RVE1RWNOZQPQ tag=IDMDK2XQHRHH type=write size=3017556 2024-09-14T10:57:29.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.659+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_9IDBODZBQRJR.2~00G5AVGEPWTW.0 size=331056 2024-09-14T10:57:29.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.663+0000 7fdf8f02c8c0 1 < canceled multipart upload key=9IDBODZBQRJR upload=00G5AVGEPWTW tag=LWSZN81YFEY8 type=write size=1379632 2024-09-14T10:57:29.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~1RLGCGZ1AU14.0 size=1048576 2024-09-14T10:57:29.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.675+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~1RLGCGZ1AU14.1 size=1048576 2024-09-14T10:57:29.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.679+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~1RLGCGZ1AU14.2 size=169569 2024-09-14T10:57:29.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.679+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=1RLGCGZ1AU14 tag=CHY10CD9ZVT4 type=write size=3315297 2024-09-14T10:57:29.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.683+0000 7fdf8f02c8c0 1 < completed write operation key=XUT55FR490EO tag=C5ZATFLPWZXS type=write size=562738 2024-09-14T10:57:29.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.687+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=02ZMHOO83K63 type=del size=2151446 2024-09-14T10:57:29.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.695+0000 7fdf8f02c8c0 1 < suggested remove operation key=YU9DAJA242Q7 tag=09BV1TTXK1ZB type=del 2024-09-14T10:57:29.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.699+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=WUYADFBRBSDZ type=del size=2138117 2024-09-14T10:57:29.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.703+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=21CPKKWYOERA type=del 2024-09-14T10:57:29.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.711+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~RLYCS811KNN2.0 size=1048576 2024-09-14T10:57:29.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.711+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~RLYCS811KNN2.1 size=1048576 2024-09-14T10:57:29.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.715+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~RLYCS811KNN2.2 size=584182 2024-09-14T10:57:29.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.715+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=RLYCS811KNN2 tag=6DYLTPM30MK2 type=write size=3729910 2024-09-14T10:57:29.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.719+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=UAOEPS0YX5BC type=del 2024-09-14T10:57:29.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.723+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=Z3LB5303Q419 type=write size=969898 2024-09-14T10:57:29.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.731+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~AYWOI8K9R20P.0 size=437158 2024-09-14T10:57:29.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.735+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=AYWOI8K9R20P tag=041HCXIWKVAZ type=write size=1485734 2024-09-14T10:57:29.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.743+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~XWWW4XBNM63U.0 size=1048576 2024-09-14T10:57:29.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.747+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~XWWW4XBNM63U.1 size=1048576 2024-09-14T10:57:29.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.751+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~XWWW4XBNM63U.2 size=263874 2024-09-14T10:57:29.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.751+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=XWWW4XBNM63U tag=5N7MJPT0GK6I type=write size=3409602 2024-09-14T10:57:29.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.751+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~D2A9H78YMZG1.0 size=1048576 2024-09-14T10:57:29.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.755+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~D2A9H78YMZG1.1 size=440797 2024-09-14T10:57:29.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.763+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=D2A9H78YMZG1 tag=AD6DKIHEPAH1 type=write size=2537949 2024-09-14T10:57:29.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.767+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=1V5ICYSK86YM type=del size=819916 2024-09-14T10:57:29.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.771+0000 7fdf8f02c8c0 1 < canceled operation key=L1ERJ0JSRDMG tag=BD7TWTYM9JZT type=del size=1493223 2024-09-14T10:57:29.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.775+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=L442Z6UPBXYC type=del size=2145939 2024-09-14T10:57:29.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.779+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~HJI8BUQTX9J9.0 size=218061 2024-09-14T10:57:29.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.787+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=HJI8BUQTX9J9 tag=RNLAW4I8RS35 type=write size=1266637 2024-09-14T10:57:29.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.791+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~51PN50FDFLY6.0 size=435462 2024-09-14T10:57:29.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.791+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=51PN50FDFLY6 tag=515VNR749LM0 type=write size=1484038 2024-09-14T10:57:29.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.795+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_49O8DPTGA65S.2~872NLP41IP2V.0 size=1048576 2024-09-14T10:57:29.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.795+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~872NLP41IP2V.1 size=1048576 2024-09-14T10:57:29.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.799+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~872NLP41IP2V.2 size=507594 2024-09-14T10:57:29.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.803+0000 7fdf8f02c8c0 1 < canceled multipart upload key=49O8DPTGA65S upload=872NLP41IP2V tag=MVV821N4XGJ9 type=write size=3653322 2024-09-14T10:57:29.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.807+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=6SO6WJTMIQ5R type=del size=3804438 2024-09-14T10:57:29.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~8E2BHLLXRTA0.0 size=1048576 2024-09-14T10:57:29.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~8E2BHLLXRTA0.1 size=1018439 2024-09-14T10:57:29.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.823+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=8E2BHLLXRTA0 tag=5GKVLOQHNUTC type=write size=3115591 2024-09-14T10:57:29.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.827+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=OAJTNL9G2908 type=write size=774592 2024-09-14T10:57:29.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.831+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=HVLWGITT1HQA type=del 2024-09-14T10:57:29.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.835+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~0MLDCF428NBC.0 size=1048576 2024-09-14T10:57:29.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.839+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~0MLDCF428NBC.1 size=469507 2024-09-14T10:57:29.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.839+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=0MLDCF428NBC tag=AD1AONTZCUZR type=write size=2566659 2024-09-14T10:57:29.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.843+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~AVK18T23L6S8.0 size=1048576 2024-09-14T10:57:29.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.847+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~AVK18T23L6S8.1 size=884461 2024-09-14T10:57:29.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.851+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=AVK18T23L6S8 tag=TFJF53N7XWYL type=write size=2981613 2024-09-14T10:57:29.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.859+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~SDZCV7KFY7OO.0 size=1048576 2024-09-14T10:57:29.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.859+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~SDZCV7KFY7OO.1 size=266151 2024-09-14T10:57:29.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.859+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=SDZCV7KFY7OO tag=Y7YZIKHE4JWQ type=write size=2363303 2024-09-14T10:57:29.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.863+0000 7fdf8f02c8c0 1 < completed write operation key=X0RT8UF3D0JC tag=EYOUR0ZOAWB3 type=write size=91192 2024-09-14T10:57:29.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.871+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~AOSSM71EMDJM.0 size=1048576 2024-09-14T10:57:29.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.875+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~AOSSM71EMDJM.1 size=131969 2024-09-14T10:57:29.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.875+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=AOSSM71EMDJM tag=VOPCLLB0NRSM type=write size=2229121 2024-09-14T10:57:29.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.879+0000 7fdf8f02c8c0 1 < completed write operation key=LFLY0V3FRRW5 tag=76047HMACEV6 type=write size=986174 2024-09-14T10:57:29.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.883+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=IPUOACSNL08F type=del size=109554 2024-09-14T10:57:29.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.887+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~RVE1RWNOZQPQ.0 size=1048576 2024-09-14T10:57:29.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.887+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_82N2FPU7LKTG.2~RVE1RWNOZQPQ.1 size=920404 2024-09-14T10:57:29.888 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.891+0000 7fdf8f02c8c0 1 < canceled multipart upload key=82N2FPU7LKTG upload=RVE1RWNOZQPQ tag=IDMDK2XQHRHH type=write size=3017556 2024-09-14T10:57:29.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.895+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=AETZZRP25MC9 type=write size=481938 2024-09-14T10:57:29.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~1RLGCGZ1AU14.0 size=1048576 2024-09-14T10:57:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~1RLGCGZ1AU14.1 size=1048576 2024-09-14T10:57:29.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.907+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~1RLGCGZ1AU14.2 size=169569 2024-09-14T10:57:29.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.911+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=1RLGCGZ1AU14 tag=CHY10CD9ZVT4 type=write size=3315297 2024-09-14T10:57:29.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.919+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=ODYA3EGGDIHW type=write size=965201 2024-09-14T10:57:29.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.927+0000 7fdf8f02c8c0 1 < suggested update operation key=APDKRWHOUH9T tag=02ZMHOO83K63 type=del size=2151446 2024-09-14T10:57:29.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.931+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~2KB97GBK881O.0 size=1048576 2024-09-14T10:57:29.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.935+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~2KB97GBK881O.1 size=962567 2024-09-14T10:57:29.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.935+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=2KB97GBK881O tag=SBX2EMRE1XZE type=write size=3059719 2024-09-14T10:57:29.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.939+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=WUYADFBRBSDZ type=del 2024-09-14T10:57:29.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.943+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~RW8LYBEP0NUT.0 size=1048576 2024-09-14T10:57:29.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.947+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~RW8LYBEP0NUT.1 size=1048576 2024-09-14T10:57:29.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~RW8LYBEP0NUT.2 size=563316 2024-09-14T10:57:29.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.951+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=RW8LYBEP0NUT tag=XVSQ3RW5O30R type=write size=3709044 2024-09-14T10:57:29.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~RLYCS811KNN2.0 size=1048576 2024-09-14T10:57:29.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~RLYCS811KNN2.1 size=1048576 2024-09-14T10:57:29.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.959+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~RLYCS811KNN2.2 size=584182 2024-09-14T10:57:29.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.963+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=RLYCS811KNN2 tag=6DYLTPM30MK2 type=write size=3729910 2024-09-14T10:57:29.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.971+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~C6V9YLRSLA0C.0 size=1048576 2024-09-14T10:57:29.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.975+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~C6V9YLRSLA0C.1 size=1048576 2024-09-14T10:57:29.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.975+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~C6V9YLRSLA0C.2 size=490701 2024-09-14T10:57:29.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.975+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=C6V9YLRSLA0C tag=TTNLGG4MOUNS type=write size=3636429 2024-09-14T10:57:29.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.979+0000 7fdf8f02c8c0 1 < canceled operation key=82N2FPU7LKTG tag=Z3LB5303Q419 type=write size=969898 2024-09-14T10:57:29.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.983+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=FJ5X3YORRCZA type=del size=147886 2024-09-14T10:57:29.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~XWWW4XBNM63U.0 size=1048576 2024-09-14T10:57:29.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~XWWW4XBNM63U.1 size=1048576 2024-09-14T10:57:29.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~XWWW4XBNM63U.2 size=263874 2024-09-14T10:57:29.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:29.999+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=XWWW4XBNM63U tag=5N7MJPT0GK6I type=write size=3409602 2024-09-14T10:57:30.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.007+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~I0D0QO25QRUA.0 size=1048576 2024-09-14T10:57:30.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.007+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~I0D0QO25QRUA.1 size=1048576 2024-09-14T10:57:30.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~I0D0QO25QRUA.2 size=670910 2024-09-14T10:57:30.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.011+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=I0D0QO25QRUA tag=MRRFO4P0MKU9 type=write size=3816638 2024-09-14T10:57:30.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.015+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=1V5ICYSK86YM type=del 2024-09-14T10:57:30.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.019+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=KFCSH7X454G1 type=del size=1405308 2024-09-14T10:57:30.024 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.027+0000 7fdf8f02c8c0 1 < suggested remove operation key=STB3W5URFJEZ tag=L442Z6UPBXYC type=del 2024-09-14T10:57:30.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.031+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=IOITMC9L94Z9 type=del size=2223734 2024-09-14T10:57:30.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.035+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~51PN50FDFLY6.0 size=435462 2024-09-14T10:57:30.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.043+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=51PN50FDFLY6 tag=515VNR749LM0 type=write size=1484038 2024-09-14T10:57:30.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.047+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=T5D4RP9YCYA6 type=del size=3551139 2024-09-14T10:57:30.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.047+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=6SO6WJTMIQ5R type=del 2024-09-14T10:57:30.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.051+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=FBGMYAJL0VL5 type=del size=2005544 2024-09-14T10:57:30.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.055+0000 7fdf8f02c8c0 1 < completed write operation key=49O8DPTGA65S tag=OAJTNL9G2908 type=write size=774592 2024-09-14T10:57:30.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.059+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=1H4U02EFJG33 type=del size=1780803 2024-09-14T10:57:30.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.063+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~0MLDCF428NBC.0 size=1048576 2024-09-14T10:57:30.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.067+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~0MLDCF428NBC.1 size=469507 2024-09-14T10:57:30.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.071+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=0MLDCF428NBC tag=AD1AONTZCUZR type=write size=2566659 2024-09-14T10:57:30.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.075+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=2DJLWJJ1QO52 type=write size=510397 2024-09-14T10:57:30.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.079+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~SDZCV7KFY7OO.0 size=1048576 2024-09-14T10:57:30.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.083+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~SDZCV7KFY7OO.1 size=266151 2024-09-14T10:57:30.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.087+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=SDZCV7KFY7OO tag=Y7YZIKHE4JWQ type=write size=2363303 2024-09-14T10:57:30.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.091+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=S4R6E1H802L8 type=del size=3558368 2024-09-14T10:57:30.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.095+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~AOSSM71EMDJM.0 size=1048576 2024-09-14T10:57:30.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.099+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~AOSSM71EMDJM.1 size=131969 2024-09-14T10:57:30.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.107+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=AOSSM71EMDJM tag=VOPCLLB0NRSM type=write size=2229121 2024-09-14T10:57:30.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.107+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=N81H7ER9SVTP type=del size=2194680 2024-09-14T10:57:30.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.115+0000 7fdf8f02c8c0 1 < suggested update operation key=3T0H42SC1ETB tag=IPUOACSNL08F type=del size=109554 2024-09-14T10:57:30.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~0S357C42MZFQ.0 size=780263 2024-09-14T10:57:30.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.123+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=0S357C42MZFQ tag=T3WRK9LTB28U type=write size=1828839 2024-09-14T10:57:30.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.127+0000 7fdf8f02c8c0 1 < canceled operation key=TZZ05IIMZJ4J tag=AETZZRP25MC9 type=write size=481938 2024-09-14T10:57:30.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.131+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=GRX62SCNUUMZ type=del size=3495115 2024-09-14T10:57:30.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.135+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=ODYA3EGGDIHW type=write size=965201 2024-09-14T10:57:30.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.139+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=7UNJS1IP87OV type=del size=2544883 2024-09-14T10:57:30.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.143+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~2KB97GBK881O.0 size=1048576 2024-09-14T10:57:30.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.147+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~2KB97GBK881O.1 size=962567 2024-09-14T10:57:30.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.151+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=2KB97GBK881O tag=SBX2EMRE1XZE type=write size=3059719 2024-09-14T10:57:30.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.159+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=NYYRQNFWD9PD type=del size=2583131 2024-09-14T10:57:30.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~RW8LYBEP0NUT.0 size=1048576 2024-09-14T10:57:30.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.167+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~RW8LYBEP0NUT.1 size=1048576 2024-09-14T10:57:30.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~RW8LYBEP0NUT.2 size=563316 2024-09-14T10:57:30.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.175+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=RW8LYBEP0NUT tag=XVSQ3RW5O30R type=write size=3709044 2024-09-14T10:57:30.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.179+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=R5K5PQX8HA7R type=del size=1813020 2024-09-14T10:57:30.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.183+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~C6V9YLRSLA0C.0 size=1048576 2024-09-14T10:57:30.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.187+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~C6V9YLRSLA0C.1 size=1048576 2024-09-14T10:57:30.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.191+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~C6V9YLRSLA0C.2 size=490701 2024-09-14T10:57:30.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.199+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=C6V9YLRSLA0C tag=TTNLGG4MOUNS type=write size=3636429 2024-09-14T10:57:30.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.203+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=PV8FG7TECRQJ type=write size=169874 2024-09-14T10:57:30.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.207+0000 7fdf8f02c8c0 -1 < failed to complete operation key=3T0H42SC1ETB tag=FJ5X3YORRCZA type=del size=147886: (22) Invalid argument 2024-09-14T10:57:30.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.211+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=F6BKGDX8VGTL type=del size=2730774 2024-09-14T10:57:30.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.215+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~I0D0QO25QRUA.0 size=1048576 2024-09-14T10:57:30.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.219+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~I0D0QO25QRUA.1 size=1048576 2024-09-14T10:57:30.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.219+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~I0D0QO25QRUA.2 size=670910 2024-09-14T10:57:30.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.227+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=I0D0QO25QRUA tag=MRRFO4P0MKU9 type=write size=3816638 2024-09-14T10:57:30.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.231+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~U1JYBJTE5R75.0 size=1048576 2024-09-14T10:57:30.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.235+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~U1JYBJTE5R75.1 size=1038773 2024-09-14T10:57:30.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.235+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=U1JYBJTE5R75 tag=RCIVW6OINJGQ type=write size=3135925 2024-09-14T10:57:30.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.239+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=KFCSH7X454G1 type=del 2024-09-14T10:57:30.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.243+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=M27AJ3Z3717B type=del size=170176 2024-09-14T10:57:30.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.247+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=IOITMC9L94Z9 type=del 2024-09-14T10:57:30.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.255+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~O2JWUY40G1B0.0 size=1048576 2024-09-14T10:57:30.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.255+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~O2JWUY40G1B0.1 size=1048576 2024-09-14T10:57:30.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~O2JWUY40G1B0.2 size=352190 2024-09-14T10:57:30.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.259+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=O2JWUY40G1B0 tag=Y2QS460VPKYL type=write size=3497918 2024-09-14T10:57:30.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.267+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=T5D4RP9YCYA6 type=del size=3551139 2024-09-14T10:57:30.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.271+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~FDCZDH913TV5.0 size=1048576 2024-09-14T10:57:30.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.275+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~FDCZDH913TV5.1 size=1048576 2024-09-14T10:57:30.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.279+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~FDCZDH913TV5.2 size=808624 2024-09-14T10:57:30.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.279+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=FDCZDH913TV5 tag=0SJGLKL8035V type=write size=3954352 2024-09-14T10:57:30.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.283+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=FBGMYAJL0VL5 type=del 2024-09-14T10:57:30.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.287+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~E19RZD7ZBFJP.0 size=39518 2024-09-14T10:57:30.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.287+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=E19RZD7ZBFJP tag=1NA29KEMY12Y type=write size=1088094 2024-09-14T10:57:30.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.291+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=1H4U02EFJG33 type=del 2024-09-14T10:57:30.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.299+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~7LP5OB9MOC13.0 size=1048576 2024-09-14T10:57:30.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.303+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~7LP5OB9MOC13.1 size=112493 2024-09-14T10:57:30.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.303+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=7LP5OB9MOC13 tag=4DVWFE2BBCMP type=write size=2209645 2024-09-14T10:57:30.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.307+0000 7fdf8f02c8c0 1 < completed write operation key=LCEH2YXNSOGT tag=2DJLWJJ1QO52 type=write size=510397 2024-09-14T10:57:30.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.311+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=8T7NSZ9UZHX5 type=del size=322316 2024-09-14T10:57:30.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.315+0000 7fdf8f02c8c0 1 < canceled operation key=TZZ05IIMZJ4J tag=S4R6E1H802L8 type=del size=3558368 2024-09-14T10:57:30.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.319+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~4S1Y2232KYMB.0 size=1048576 2024-09-14T10:57:30.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.323+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~4S1Y2232KYMB.1 size=1048576 2024-09-14T10:57:30.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.327+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~4S1Y2232KYMB.2 size=904802 2024-09-14T10:57:30.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.327+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=4S1Y2232KYMB tag=YO84ARWMA5CZ type=write size=4050530 2024-09-14T10:57:30.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.335+0000 7fdf8f02c8c0 1 < suggested update operation key=WA7HE8ZJ1W1M tag=N81H7ER9SVTP type=del size=2194680 2024-09-14T10:57:30.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.339+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=9VR09BNMCHS8 type=del size=2369936 2024-09-14T10:57:30.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.339+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_6VNI8FMHZ0FN.2~0S357C42MZFQ.0 size=780263 2024-09-14T10:57:30.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.343+0000 7fdf8f02c8c0 1 < canceled multipart upload key=6VNI8FMHZ0FN upload=0S357C42MZFQ tag=T3WRK9LTB28U type=write size=1828839 2024-09-14T10:57:30.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~0DGSM7SWCWQU.0 size=1048576 2024-09-14T10:57:30.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~0DGSM7SWCWQU.1 size=1048576 2024-09-14T10:57:30.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.355+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~0DGSM7SWCWQU.2 size=467581 2024-09-14T10:57:30.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.355+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=0DGSM7SWCWQU tag=PWEVCG49BY9B type=write size=3613309 2024-09-14T10:57:30.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.359+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=GRX62SCNUUMZ type=del 2024-09-14T10:57:30.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.363+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=67Y79FDUL95E type=del size=3692233 2024-09-14T10:57:30.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.371+0000 7fdf8f02c8c0 1 < suggested remove operation key=K3KJ7HDQF6ZH tag=7UNJS1IP87OV type=del 2024-09-14T10:57:30.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.375+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=RVDFUH8KNTP9 type=del size=3261222 2024-09-14T10:57:30.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.379+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=NYYRQNFWD9PD type=del 2024-09-14T10:57:30.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.383+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=S75YUD5R16QN type=del size=1314811 2024-09-14T10:57:30.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.391+0000 7fdf8f02c8c0 1 < suggested remove operation key=WA7HE8ZJ1W1M tag=R5K5PQX8HA7R type=del 2024-09-14T10:57:30.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.395+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=YM5T6HDFPQCO type=del size=1777865 2024-09-14T10:57:30.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.403+0000 7fdf8f02c8c0 1 < suggested update operation key=3T0H42SC1ETB tag=PV8FG7TECRQJ type=write size=169874 2024-09-14T10:57:30.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.407+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=K453ENCBTXSF type=write size=1044547 2024-09-14T10:57:30.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.411+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=F6BKGDX8VGTL type=del 2024-09-14T10:57:30.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.415+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=QANSLSOOVDOE type=del size=2142646 2024-09-14T10:57:30.412 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.415+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LCEH2YXNSOGT.2~U1JYBJTE5R75.0 size=1048576 2024-09-14T10:57:30.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.419+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~U1JYBJTE5R75.1 size=1038773 2024-09-14T10:57:30.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.423+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LCEH2YXNSOGT upload=U1JYBJTE5R75 tag=RCIVW6OINJGQ type=write size=3135925 2024-09-14T10:57:30.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.431+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~0Q946Q01HM3V.0 size=1048576 2024-09-14T10:57:30.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.435+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~0Q946Q01HM3V.1 size=1048576 2024-09-14T10:57:30.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.439+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~0Q946Q01HM3V.2 size=557975 2024-09-14T10:57:30.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.439+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=0Q946Q01HM3V tag=VMXGARN6N7OZ type=write size=3703703 2024-09-14T10:57:30.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.447+0000 7fdf8f02c8c0 1 < suggested update operation key=X0RT8UF3D0JC tag=M27AJ3Z3717B type=del size=170176 2024-09-14T10:57:30.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.451+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=DEHVMGQSPUGJ type=del size=1843984 2024-09-14T10:57:30.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~O2JWUY40G1B0.0 size=1048576 2024-09-14T10:57:30.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~O2JWUY40G1B0.1 size=1048576 2024-09-14T10:57:30.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.459+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~O2JWUY40G1B0.2 size=352190 2024-09-14T10:57:30.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.463+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=O2JWUY40G1B0 tag=Y2QS460VPKYL type=write size=3497918 2024-09-14T10:57:30.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.471+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~KE1ON5L8WW3S.0 size=1048576 2024-09-14T10:57:30.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.471+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~KE1ON5L8WW3S.1 size=1048576 2024-09-14T10:57:30.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.475+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~KE1ON5L8WW3S.2 size=372364 2024-09-14T10:57:30.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.475+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=KE1ON5L8WW3S tag=12UQRN1U6472 type=write size=3518092 2024-09-14T10:57:30.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.479+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~FDCZDH913TV5.0 size=1048576 2024-09-14T10:57:30.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.479+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_49O8DPTGA65S.2~FDCZDH913TV5.1 size=1048576 2024-09-14T10:57:30.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.479+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_49O8DPTGA65S.2~FDCZDH913TV5.2 size=808624 2024-09-14T10:57:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.487+0000 7fdf8f02c8c0 1 < canceled multipart upload key=49O8DPTGA65S upload=FDCZDH913TV5 tag=0SJGLKL8035V type=write size=3954352 2024-09-14T10:57:30.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.491+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~FCNH1IZ1DZOP.0 size=171973 2024-09-14T10:57:30.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.491+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=FCNH1IZ1DZOP tag=AHHD8GVBOJL9 type=write size=1220549 2024-09-14T10:57:30.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.495+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~E19RZD7ZBFJP.0 size=39518 2024-09-14T10:57:30.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.503+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=E19RZD7ZBFJP tag=1NA29KEMY12Y type=write size=1088094 2024-09-14T10:57:30.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.507+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=SQM0GE6JFD1W type=write size=330497 2024-09-14T10:57:30.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.511+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~7LP5OB9MOC13.0 size=1048576 2024-09-14T10:57:30.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.511+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~7LP5OB9MOC13.1 size=112493 2024-09-14T10:57:30.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.519+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=7LP5OB9MOC13 tag=4DVWFE2BBCMP type=write size=2209645 2024-09-14T10:57:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~L6ZWGWN1LTDI.0 size=1048576 2024-09-14T10:57:30.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.527+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~L6ZWGWN1LTDI.1 size=261205 2024-09-14T10:57:30.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.527+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=L6ZWGWN1LTDI tag=OHXK0MV0PUBO type=write size=2358357 2024-09-14T10:57:30.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.531+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=8T7NSZ9UZHX5 type=del 2024-09-14T10:57:30.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.539+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~I8GYDRRW60FC.0 size=1048576 2024-09-14T10:57:30.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.539+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~I8GYDRRW60FC.1 size=144785 2024-09-14T10:57:30.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.539+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=I8GYDRRW60FC tag=MS2FZQ7HUZIK type=write size=2241937 2024-09-14T10:57:30.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.543+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~4S1Y2232KYMB.0 size=1048576 2024-09-14T10:57:30.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~4S1Y2232KYMB.1 size=1048576 2024-09-14T10:57:30.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.551+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~4S1Y2232KYMB.2 size=904802 2024-09-14T10:57:30.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.555+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=4S1Y2232KYMB tag=YO84ARWMA5CZ type=write size=4050530 2024-09-14T10:57:30.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.559+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=MAJNQZRD5VR2 type=del size=3708537 2024-09-14T10:57:30.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.563+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=9VR09BNMCHS8 type=del 2024-09-14T10:57:30.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~YL5VJTRMEZQ8.0 size=1048576 2024-09-14T10:57:30.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.575+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~YL5VJTRMEZQ8.1 size=1048576 2024-09-14T10:57:30.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.575+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~YL5VJTRMEZQ8.2 size=343174 2024-09-14T10:57:30.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.575+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=YL5VJTRMEZQ8 tag=08E4P3C1E0J8 type=write size=3488902 2024-09-14T10:57:30.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.579+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_TZZ05IIMZJ4J.2~0DGSM7SWCWQU.0 size=1048576 2024-09-14T10:57:30.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.579+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_TZZ05IIMZJ4J.2~0DGSM7SWCWQU.1 size=1048576 2024-09-14T10:57:30.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.579+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~0DGSM7SWCWQU.2 size=467581 2024-09-14T10:57:30.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.587+0000 7fdf8f02c8c0 1 < canceled multipart upload key=TZZ05IIMZJ4J upload=0DGSM7SWCWQU tag=PWEVCG49BY9B type=write size=3613309 2024-09-14T10:57:30.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.591+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=IY9LVEOTXGVD type=del size=2503753 2024-09-14T10:57:30.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.599+0000 7fdf8f02c8c0 1 < suggested update operation key=HCGZ1MY5SKW9 tag=67Y79FDUL95E type=del size=3692233 2024-09-14T10:57:30.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~I4TJ00WAFO4E.0 size=727154 2024-09-14T10:57:30.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.607+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=I4TJ00WAFO4E tag=62EY7Y88F7J2 type=write size=1775730 2024-09-14T10:57:30.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.611+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=RVDFUH8KNTP9 type=del 2024-09-14T10:57:30.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.615+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=AUX38WM3WCSD type=del size=3480420 2024-09-14T10:57:30.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.623+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=S75YUD5R16QN type=del size=1314811 2024-09-14T10:57:30.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.631+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~036YIXGWSSRD.0 size=1048576 2024-09-14T10:57:30.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.635+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~036YIXGWSSRD.1 size=1048576 2024-09-14T10:57:30.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.635+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~036YIXGWSSRD.2 size=472572 2024-09-14T10:57:30.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.635+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=036YIXGWSSRD tag=NGN4H8EYVXX2 type=write size=3618300 2024-09-14T10:57:30.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.639+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=YM5T6HDFPQCO type=del 2024-09-14T10:57:30.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~HF0O3VIF1D5H.0 size=857461 2024-09-14T10:57:30.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.647+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=HF0O3VIF1D5H tag=57FU8D1URIZZ type=write size=1906037 2024-09-14T10:57:30.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.651+0000 7fdf8f02c8c0 1 < completed write operation key=1E72V12EPEH3 tag=K453ENCBTXSF type=write size=1044547 2024-09-14T10:57:30.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.659+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~LK3CPYRUDEX8.0 size=833068 2024-09-14T10:57:30.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.659+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=LK3CPYRUDEX8 tag=QNCL48QLFFBU type=write size=1881644 2024-09-14T10:57:30.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.663+0000 7fdf8f02c8c0 1 < suggested remove operation key=OFY1G5R28CK6 tag=QANSLSOOVDOE type=del 2024-09-14T10:57:30.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~IUWIQUS1LSH0.0 size=1048576 2024-09-14T10:57:30.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.675+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~IUWIQUS1LSH0.1 size=322061 2024-09-14T10:57:30.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.675+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=IUWIQUS1LSH0 tag=ZTRZLPDZ1BPA type=write size=2419213 2024-09-14T10:57:30.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.675+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_HCGZ1MY5SKW9.2~0Q946Q01HM3V.0 size=1048576 2024-09-14T10:57:30.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.679+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~0Q946Q01HM3V.1 size=1048576 2024-09-14T10:57:30.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.679+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_HCGZ1MY5SKW9.2~0Q946Q01HM3V.2 size=557975 2024-09-14T10:57:30.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.683+0000 7fdf8f02c8c0 1 < canceled multipart upload key=HCGZ1MY5SKW9 upload=0Q946Q01HM3V tag=VMXGARN6N7OZ type=write size=3703703 2024-09-14T10:57:30.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.687+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=JG12QDG0UXRZ type=del size=1265538 2024-09-14T10:57:30.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.695+0000 7fdf8f02c8c0 1 < suggested remove operation key=TZZ05IIMZJ4J tag=DEHVMGQSPUGJ type=del 2024-09-14T10:57:30.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.703+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~NOR044ULNKLM.0 size=1048576 2024-09-14T10:57:30.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~NOR044ULNKLM.1 size=1048576 2024-09-14T10:57:30.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~NOR044ULNKLM.2 size=361331 2024-09-14T10:57:30.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.707+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=NOR044ULNKLM tag=Y5L74JU6XRKD type=write size=3507059 2024-09-14T10:57:30.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.711+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~KE1ON5L8WW3S.0 size=1048576 2024-09-14T10:57:30.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.715+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~KE1ON5L8WW3S.1 size=1048576 2024-09-14T10:57:30.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.719+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~KE1ON5L8WW3S.2 size=372364 2024-09-14T10:57:30.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.723+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=KE1ON5L8WW3S tag=12UQRN1U6472 type=write size=3518092 2024-09-14T10:57:30.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.731+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~QH57DWIGSEK9.0 size=1048576 2024-09-14T10:57:30.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.731+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~QH57DWIGSEK9.1 size=1048576 2024-09-14T10:57:30.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.735+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~QH57DWIGSEK9.2 size=708992 2024-09-14T10:57:30.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.735+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=QH57DWIGSEK9 tag=PNCE3ZZXXZMS type=write size=3854720 2024-09-14T10:57:30.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.735+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_82N2FPU7LKTG.2~FCNH1IZ1DZOP.0 size=171973 2024-09-14T10:57:30.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.743+0000 7fdf8f02c8c0 1 < canceled multipart upload key=82N2FPU7LKTG upload=FCNH1IZ1DZOP tag=AHHD8GVBOJL9 type=write size=1220549 2024-09-14T10:57:30.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.747+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~24UHN3Q2Y2KZ.0 size=18162 2024-09-14T10:57:30.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.747+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=24UHN3Q2Y2KZ tag=8QHBAM92S2CL type=write size=1066738 2024-09-14T10:57:30.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.755+0000 7fdf8f02c8c0 1 < suggested update operation key=6VNI8FMHZ0FN tag=SQM0GE6JFD1W type=write size=330497 2024-09-14T10:57:30.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.759+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~1SHTESYTMXSY.0 size=1048576 2024-09-14T10:57:30.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~1SHTESYTMXSY.1 size=2933 2024-09-14T10:57:30.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.763+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=1SHTESYTMXSY tag=9YZBUCCAQ6FK type=write size=2100085 2024-09-14T10:57:30.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.767+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~L6ZWGWN1LTDI.0 size=1048576 2024-09-14T10:57:30.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.771+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~L6ZWGWN1LTDI.1 size=261205 2024-09-14T10:57:30.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.775+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=L6ZWGWN1LTDI tag=OHXK0MV0PUBO type=write size=2358357 2024-09-14T10:57:30.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.779+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=EVI8MLFOWDKY type=write size=1007877 2024-09-14T10:57:30.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.783+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~I8GYDRRW60FC.0 size=1048576 2024-09-14T10:57:30.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.787+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~I8GYDRRW60FC.1 size=144785 2024-09-14T10:57:30.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.791+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=I8GYDRRW60FC tag=MS2FZQ7HUZIK type=write size=2241937 2024-09-14T10:57:30.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.795+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=HBWY29I2A6W9 type=del size=3892887 2024-09-14T10:57:30.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.799+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=MAJNQZRD5VR2 type=del 2024-09-14T10:57:30.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.807+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~F0H6JW2NX6V1.0 size=1048576 2024-09-14T10:57:30.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.807+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~F0H6JW2NX6V1.1 size=731547 2024-09-14T10:57:30.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.807+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=F0H6JW2NX6V1 tag=YRWLBCZPQFN0 type=write size=2828699 2024-09-14T10:57:30.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~YL5VJTRMEZQ8.0 size=1048576 2024-09-14T10:57:30.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~YL5VJTRMEZQ8.1 size=1048576 2024-09-14T10:57:30.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.819+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~YL5VJTRMEZQ8.2 size=343174 2024-09-14T10:57:30.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.823+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=YL5VJTRMEZQ8 tag=08E4P3C1E0J8 type=write size=3488902 2024-09-14T10:57:30.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.827+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=BGLZN84ULOJO type=write size=887155 2024-09-14T10:57:30.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.831+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=IY9LVEOTXGVD type=del 2024-09-14T10:57:30.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.839+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~2NP6DPKOB3FU.0 size=1048576 2024-09-14T10:57:30.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.843+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~2NP6DPKOB3FU.1 size=502858 2024-09-14T10:57:30.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.843+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=2NP6DPKOB3FU tag=B5WMOKLN4Q2A type=write size=2600010 2024-09-14T10:57:30.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.847+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~I4TJ00WAFO4E.0 size=727154 2024-09-14T10:57:30.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.851+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=I4TJ00WAFO4E tag=62EY7Y88F7J2 type=write size=1775730 2024-09-14T10:57:30.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.859+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=DMAM7GS70BUJ type=write size=876484 2024-09-14T10:57:30.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.863+0000 7fdf8f02c8c0 1 < suggested remove operation key=0QJLAH0EPKVD tag=AUX38WM3WCSD type=del 2024-09-14T10:57:30.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.867+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=PDRLCYIXT89D type=del size=719710 2024-09-14T10:57:30.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~036YIXGWSSRD.0 size=1048576 2024-09-14T10:57:30.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.875+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~036YIXGWSSRD.1 size=1048576 2024-09-14T10:57:30.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.879+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~036YIXGWSSRD.2 size=472572 2024-09-14T10:57:30.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.883+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=036YIXGWSSRD tag=NGN4H8EYVXX2 type=write size=3618300 2024-09-14T10:57:30.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~WM7KYNQP932Y.0 size=1048576 2024-09-14T10:57:30.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~WM7KYNQP932Y.1 size=1048576 2024-09-14T10:57:30.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~WM7KYNQP932Y.2 size=398571 2024-09-14T10:57:30.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.895+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=WM7KYNQP932Y tag=E8956QG8281X type=write size=3544299 2024-09-14T10:57:30.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~HF0O3VIF1D5H.0 size=857461 2024-09-14T10:57:30.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.907+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=HF0O3VIF1D5H tag=57FU8D1URIZZ type=write size=1906037 2024-09-14T10:57:30.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.911+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=17IG0FVCGJNE type=write size=513379 2024-09-14T10:57:30.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.915+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~LK3CPYRUDEX8.0 size=833068 2024-09-14T10:57:30.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.919+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=LK3CPYRUDEX8 tag=QNCL48QLFFBU type=write size=1881644 2024-09-14T10:57:30.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.927+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~9Y69DSPI1J9W.0 size=1048576 2024-09-14T10:57:30.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.931+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~9Y69DSPI1J9W.1 size=1048576 2024-09-14T10:57:30.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.931+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~9Y69DSPI1J9W.2 size=909649 2024-09-14T10:57:30.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.931+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=9Y69DSPI1J9W tag=GJYCJJBGMVWJ type=write size=4055377 2024-09-14T10:57:30.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.935+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~IUWIQUS1LSH0.0 size=1048576 2024-09-14T10:57:30.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.939+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~IUWIQUS1LSH0.1 size=322061 2024-09-14T10:57:30.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.943+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=IUWIQUS1LSH0 tag=ZTRZLPDZ1BPA type=write size=2419213 2024-09-14T10:57:30.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~FQYESD3YZQN3.0 size=1048576 2024-09-14T10:57:30.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.955+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~FQYESD3YZQN3.1 size=1048576 2024-09-14T10:57:30.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.959+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~FQYESD3YZQN3.2 size=363290 2024-09-14T10:57:30.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.959+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=FQYESD3YZQN3 tag=25X7XCA0FOJW type=write size=3509018 2024-09-14T10:57:30.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.959+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=JG12QDG0UXRZ type=del 2024-09-14T10:57:30.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.963+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=FEIWXCBMNJ9C type=del size=4079290 2024-09-14T10:57:30.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.967+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~NOR044ULNKLM.0 size=1048576 2024-09-14T10:57:30.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.971+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~NOR044ULNKLM.1 size=1048576 2024-09-14T10:57:30.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.975+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~NOR044ULNKLM.2 size=361331 2024-09-14T10:57:30.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.979+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=NOR044ULNKLM tag=Y5L74JU6XRKD type=write size=3507059 2024-09-14T10:57:30.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~PUDD5X7DTSRH.0 size=1048576 2024-09-14T10:57:30.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~PUDD5X7DTSRH.1 size=1048576 2024-09-14T10:57:30.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.991+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~PUDD5X7DTSRH.2 size=703732 2024-09-14T10:57:30.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.991+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=PUDD5X7DTSRH tag=XZIGO7X62P5S type=write size=3849460 2024-09-14T10:57:30.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.991+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3T0H42SC1ETB.2~QH57DWIGSEK9.0 size=1048576 2024-09-14T10:57:30.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.995+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~QH57DWIGSEK9.1 size=1048576 2024-09-14T10:57:30.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:30.995+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3T0H42SC1ETB.2~QH57DWIGSEK9.2 size=708992 2024-09-14T10:57:30.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.003+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3T0H42SC1ETB upload=QH57DWIGSEK9 tag=PNCE3ZZXXZMS type=write size=3854720 2024-09-14T10:57:31.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.003+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=H0K21FJ4KR2H type=write size=1014516 2024-09-14T10:57:31.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.007+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~24UHN3Q2Y2KZ.0 size=18162 2024-09-14T10:57:31.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.015+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=24UHN3Q2Y2KZ tag=8QHBAM92S2CL type=write size=1066738 2024-09-14T10:57:31.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.019+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=P3HRY5EPBU1J type=del size=61038 2024-09-14T10:57:31.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.023+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~1SHTESYTMXSY.0 size=1048576 2024-09-14T10:57:31.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.023+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~1SHTESYTMXSY.1 size=2933 2024-09-14T10:57:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.031+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=1SHTESYTMXSY tag=9YZBUCCAQ6FK type=write size=2100085 2024-09-14T10:57:31.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.035+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~I13BH14RGZQJ.0 size=619920 2024-09-14T10:57:31.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.035+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=I13BH14RGZQJ tag=58CG1O5OLYX4 type=write size=1668496 2024-09-14T10:57:31.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.039+0000 7fdf8f02c8c0 1 < completed write operation key=Y32RWGISRBMT tag=EVI8MLFOWDKY type=write size=1007877 2024-09-14T10:57:31.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.043+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=8196ALJUFBK5 type=del size=1396979 2024-09-14T10:57:31.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.047+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=HBWY29I2A6W9 type=del 2024-09-14T10:57:31.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.051+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=37QRB2PHTSRK type=del size=3332456 2024-09-14T10:57:31.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.055+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~F0H6JW2NX6V1.0 size=1048576 2024-09-14T10:57:31.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.059+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~F0H6JW2NX6V1.1 size=731547 2024-09-14T10:57:31.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.063+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=F0H6JW2NX6V1 tag=YRWLBCZPQFN0 type=write size=2828699 2024-09-14T10:57:31.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.067+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=9L71WEDC0TC0 type=del size=2057177 2024-09-14T10:57:31.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.075+0000 7fdf8f02c8c0 1 < suggested remove operation key=6VNI8FMHZ0FN tag=BGLZN84ULOJO type=write 2024-09-14T10:57:31.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.079+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=DY1F9C1HXUXZ type=del size=1650350 2024-09-14T10:57:31.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.083+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~2NP6DPKOB3FU.0 size=1048576 2024-09-14T10:57:31.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.087+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~2NP6DPKOB3FU.1 size=502858 2024-09-14T10:57:31.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.095+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=2NP6DPKOB3FU tag=B5WMOKLN4Q2A type=write size=2600010 2024-09-14T10:57:31.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.099+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=PC6GAET4O8PN type=del size=2851184 2024-09-14T10:57:31.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.103+0000 7fdf8f02c8c0 1 < completed write operation key=STHEUJ6VDPQB tag=DMAM7GS70BUJ type=write size=876484 2024-09-14T10:57:31.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.107+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~0I50HBET41JE.0 size=1048576 2024-09-14T10:57:31.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.111+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~0I50HBET41JE.1 size=1048576 2024-09-14T10:57:31.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.115+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~0I50HBET41JE.2 size=996012 2024-09-14T10:57:31.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.115+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=0I50HBET41JE tag=Z8SOLLYIM70S type=write size=4141740 2024-09-14T10:57:31.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.119+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=PDRLCYIXT89D type=del 2024-09-14T10:57:31.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.123+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=WRL12FSQPBJ0 type=del size=3651447 2024-09-14T10:57:31.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.127+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~WM7KYNQP932Y.0 size=1048576 2024-09-14T10:57:31.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.127+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~WM7KYNQP932Y.1 size=1048576 2024-09-14T10:57:31.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.131+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~WM7KYNQP932Y.2 size=398571 2024-09-14T10:57:31.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.139+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=WM7KYNQP932Y tag=E8956QG8281X type=write size=3544299 2024-09-14T10:57:31.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.143+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~FVXPO522926L.0 size=1048576 2024-09-14T10:57:31.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.147+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~FVXPO522926L.1 size=1048576 2024-09-14T10:57:31.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~FVXPO522926L.2 size=292718 2024-09-14T10:57:31.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.151+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=FVXPO522926L tag=DX1R317Y0VSB type=write size=3438446 2024-09-14T10:57:31.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.159+0000 7fdf8f02c8c0 1 < suggested remove operation key=KVZEUYUSV5JI tag=17IG0FVCGJNE type=write 2024-09-14T10:57:31.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.163+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=092ZDHKKTSH8 type=del size=2347994 2024-09-14T10:57:31.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.167+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~9Y69DSPI1J9W.0 size=1048576 2024-09-14T10:57:31.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~9Y69DSPI1J9W.1 size=1048576 2024-09-14T10:57:31.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.175+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~9Y69DSPI1J9W.2 size=909649 2024-09-14T10:57:31.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.179+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=9Y69DSPI1J9W tag=GJYCJJBGMVWJ type=write size=4055377 2024-09-14T10:57:31.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.187+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~Z3V32VG49K51.0 size=18511 2024-09-14T10:57:31.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.187+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=Z3V32VG49K51 tag=4C74KU6H9QR1 type=write size=1067087 2024-09-14T10:57:31.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.191+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~FQYESD3YZQN3.0 size=1048576 2024-09-14T10:57:31.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.195+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~FQYESD3YZQN3.1 size=1048576 2024-09-14T10:57:31.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.195+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~FQYESD3YZQN3.2 size=363290 2024-09-14T10:57:31.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.203+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=FQYESD3YZQN3 tag=25X7XCA0FOJW type=write size=3509018 2024-09-14T10:57:31.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.207+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=VSC4G5KCFARQ type=del size=286992 2024-09-14T10:57:31.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.211+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=FEIWXCBMNJ9C type=del 2024-09-14T10:57:31.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.215+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=OO8T08BL2HG9 type=del size=786674 2024-09-14T10:57:31.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.219+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~PUDD5X7DTSRH.0 size=1048576 2024-09-14T10:57:31.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.223+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~PUDD5X7DTSRH.1 size=1048576 2024-09-14T10:57:31.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.223+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~PUDD5X7DTSRH.2 size=703732 2024-09-14T10:57:31.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.231+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=PUDD5X7DTSRH tag=XZIGO7X62P5S type=write size=3849460 2024-09-14T10:57:31.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.235+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=TU8YINO5CSB6 type=del size=1300416 2024-09-14T10:57:31.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.239+0000 7fdf8f02c8c0 1 < completed write operation key=9IDBODZBQRJR tag=H0K21FJ4KR2H type=write size=1014516 2024-09-14T10:57:31.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.243+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~WXFOV5RAC8IP.0 size=179315 2024-09-14T10:57:31.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.243+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=WXFOV5RAC8IP tag=OZ4TJJ888PLI type=write size=1227891 2024-09-14T10:57:31.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.247+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=P3HRY5EPBU1J type=del 2024-09-14T10:57:31.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.255+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~A1FCBMFL5D72.0 size=831264 2024-09-14T10:57:31.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.255+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=A1FCBMFL5D72 tag=FCSV2YK9F8M6 type=write size=1879840 2024-09-14T10:57:31.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.259+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~I13BH14RGZQJ.0 size=619920 2024-09-14T10:57:31.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.267+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=I13BH14RGZQJ tag=58CG1O5OLYX4 type=write size=1668496 2024-09-14T10:57:31.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.267+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=K3QV10949SHH type=del size=3906953 2024-09-14T10:57:31.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.275+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=8196ALJUFBK5 type=del 2024-09-14T10:57:31.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.279+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~CALH7ZBHPKPJ.0 size=1048576 2024-09-14T10:57:31.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.283+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~CALH7ZBHPKPJ.1 size=969242 2024-09-14T10:57:31.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.283+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=CALH7ZBHPKPJ tag=TB9S0RPH612V type=write size=3066394 2024-09-14T10:57:31.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.287+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=37QRB2PHTSRK type=del 2024-09-14T10:57:31.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.291+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~HUM8O51LZQ2P.0 size=1015307 2024-09-14T10:57:31.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.291+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=HUM8O51LZQ2P tag=J28EHFR25342 type=write size=2063883 2024-09-14T10:57:31.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.295+0000 7fdf8f02c8c0 1 < canceled operation key=TZZ05IIMZJ4J tag=9L71WEDC0TC0 type=del size=2057177 2024-09-14T10:57:31.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.299+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=D10VXPBH1H92 type=write size=520686 2024-09-14T10:57:31.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.303+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=DY1F9C1HXUXZ type=del 2024-09-14T10:57:31.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.307+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=5L24HN72SPXP type=del size=1546438 2024-09-14T10:57:31.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.311+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=PC6GAET4O8PN type=del 2024-09-14T10:57:31.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.315+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=9P7FKPZ2H01I type=del size=3680764 2024-09-14T10:57:31.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.319+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~0I50HBET41JE.0 size=1048576 2024-09-14T10:57:31.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.323+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~0I50HBET41JE.1 size=1048576 2024-09-14T10:57:31.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.323+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~0I50HBET41JE.2 size=996012 2024-09-14T10:57:31.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.331+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=0I50HBET41JE tag=Z8SOLLYIM70S type=write size=4141740 2024-09-14T10:57:31.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.335+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=OELMFH4W14TK type=del size=1323521 2024-09-14T10:57:31.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.343+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=WRL12FSQPBJ0 type=del size=3651447 2024-09-14T10:57:31.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.347+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=0BO4G2DQDA7U type=del size=3449851 2024-09-14T10:57:31.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.351+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~FVXPO522926L.0 size=1048576 2024-09-14T10:57:31.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.355+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~FVXPO522926L.1 size=1048576 2024-09-14T10:57:31.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.359+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~FVXPO522926L.2 size=292718 2024-09-14T10:57:31.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.363+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=FVXPO522926L tag=DX1R317Y0VSB type=write size=3438446 2024-09-14T10:57:31.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.371+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~N6QXW1366J42.0 size=614789 2024-09-14T10:57:31.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.371+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=N6QXW1366J42 tag=90AWE9ER5DDS type=write size=1663365 2024-09-14T10:57:31.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.379+0000 7fdf8f02c8c0 1 < suggested remove operation key=HCGZ1MY5SKW9 tag=092ZDHKKTSH8 type=del 2024-09-14T10:57:31.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.387+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~Z8XBN9LISEHQ.0 size=1048576 2024-09-14T10:57:31.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.391+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~Z8XBN9LISEHQ.1 size=468399 2024-09-14T10:57:31.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.391+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=Z8XBN9LISEHQ tag=OJ4JULSREEO2 type=write size=2565551 2024-09-14T10:57:31.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.395+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~Z3V32VG49K51.0 size=18511 2024-09-14T10:57:31.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.399+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=Z3V32VG49K51 tag=4C74KU6H9QR1 type=write size=1067087 2024-09-14T10:57:31.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.403+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=ACWLYMQ78F95 type=del size=2428240 2024-09-14T10:57:31.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.415+0000 7fdf8f02c8c0 1 < suggested update operation key=LCEH2YXNSOGT tag=VSC4G5KCFARQ type=del size=286992 2024-09-14T10:57:31.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.419+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=ZF533JC8X9HL type=del size=1139187 2024-09-14T10:57:31.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.423+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=OO8T08BL2HG9 type=del 2024-09-14T10:57:31.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.427+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=P5IFW7XLVD78 type=del size=3564805 2024-09-14T10:57:31.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.431+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=TU8YINO5CSB6 type=del 2024-09-14T10:57:31.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.431+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=B7DZVBP50SQS type=del size=2922372 2024-09-14T10:57:31.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.435+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~WXFOV5RAC8IP.0 size=179315 2024-09-14T10:57:31.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.443+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=WXFOV5RAC8IP tag=OZ4TJJ888PLI type=write size=1227891 2024-09-14T10:57:31.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.447+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=DQ4KRTXWZKLG type=del size=1993008 2024-09-14T10:57:31.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.447+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~A1FCBMFL5D72.0 size=831264 2024-09-14T10:57:31.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.455+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=A1FCBMFL5D72 tag=FCSV2YK9F8M6 type=write size=1879840 2024-09-14T10:57:31.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.459+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=L9I3FCUML9UY type=del size=2152993 2024-09-14T10:57:31.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.463+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=K3QV10949SHH type=del 2024-09-14T10:57:31.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.467+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~5HR7S1P718VQ.0 size=1048576 2024-09-14T10:57:31.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.471+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~5HR7S1P718VQ.1 size=1048576 2024-09-14T10:57:31.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.475+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~5HR7S1P718VQ.2 size=241229 2024-09-14T10:57:31.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.475+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=5HR7S1P718VQ tag=OYA1X6ZQDSNE type=write size=3386957 2024-09-14T10:57:31.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.479+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~CALH7ZBHPKPJ.0 size=1048576 2024-09-14T10:57:31.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.479+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~CALH7ZBHPKPJ.1 size=969242 2024-09-14T10:57:31.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.487+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=CALH7ZBHPKPJ tag=TB9S0RPH612V type=write size=3066394 2024-09-14T10:57:31.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.491+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=OTLWT5NTTC2V type=del size=542811 2024-09-14T10:57:31.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.495+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~HUM8O51LZQ2P.0 size=1015307 2024-09-14T10:57:31.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.499+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=HUM8O51LZQ2P tag=J28EHFR25342 type=write size=2063883 2024-09-14T10:57:31.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.503+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=TX1XZHNRD8L0 type=del size=97830 2024-09-14T10:57:31.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.511+0000 7fdf8f02c8c0 1 < suggested remove operation key=5VZCCFRUAQJ7 tag=D10VXPBH1H92 type=write 2024-09-14T10:57:31.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.515+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=8B8ZB54VM7SQ type=write size=697983 2024-09-14T10:57:31.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.519+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=5L24HN72SPXP type=del 2024-09-14T10:57:31.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.527+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~7QG10UPPOPC7.0 size=1048576 2024-09-14T10:57:31.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.531+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~7QG10UPPOPC7.1 size=277563 2024-09-14T10:57:31.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.531+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=7QG10UPPOPC7 tag=LGNGNH7WX9PP type=write size=2374715 2024-09-14T10:57:31.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.539+0000 7fdf8f02c8c0 1 < suggested update operation key=304ZNF4OC1ML tag=9P7FKPZ2H01I type=del size=3680764 2024-09-14T10:57:31.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.543+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=XHHG4RTIJTRA type=del size=537411 2024-09-14T10:57:31.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.551+0000 7fdf8f02c8c0 1 < suggested remove operation key=X0RT8UF3D0JC tag=OELMFH4W14TK type=del 2024-09-14T10:57:31.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.559+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~LQVP9KGKXIK4.0 size=1048576 2024-09-14T10:57:31.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~LQVP9KGKXIK4.1 size=1048576 2024-09-14T10:57:31.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~LQVP9KGKXIK4.2 size=135681 2024-09-14T10:57:31.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.563+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=LQVP9KGKXIK4 tag=FZ6IHYTJ9SVL type=write size=3281409 2024-09-14T10:57:31.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.571+0000 7fdf8f02c8c0 1 < suggested remove operation key=82N2FPU7LKTG tag=0BO4G2DQDA7U type=del 2024-09-14T10:57:31.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.575+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=AGHSIU3UFU5E type=write size=973225 2024-09-14T10:57:31.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.579+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~N6QXW1366J42.0 size=614789 2024-09-14T10:57:31.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.583+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=N6QXW1366J42 tag=90AWE9ER5DDS type=write size=1663365 2024-09-14T10:57:31.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.587+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=ECYHAZVUMPIE type=del size=3505104 2024-09-14T10:57:31.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.591+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~Z8XBN9LISEHQ.0 size=1048576 2024-09-14T10:57:31.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.595+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~Z8XBN9LISEHQ.1 size=468399 2024-09-14T10:57:31.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.599+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=Z8XBN9LISEHQ tag=OJ4JULSREEO2 type=write size=2565551 2024-09-14T10:57:31.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.603+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=MKE4S6QLE224 type=del size=2825469 2024-09-14T10:57:31.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.607+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=ACWLYMQ78F95 type=del 2024-09-14T10:57:31.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.611+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=2UQ9DH68JWRR type=del size=1179257 2024-09-14T10:57:31.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.619+0000 7fdf8f02c8c0 1 < suggested update operation key=0QJLAH0EPKVD tag=ZF533JC8X9HL type=del size=1139187 2024-09-14T10:57:31.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.623+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=DM6QDN1VG6FG type=del size=2118933 2024-09-14T10:57:31.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.631+0000 7fdf8f02c8c0 1 < suggested update operation key=WA7HE8ZJ1W1M tag=P5IFW7XLVD78 type=del size=3564805 2024-09-14T10:57:31.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.635+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=SYUAGCF6FKAT type=del size=1633075 2024-09-14T10:57:31.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.643+0000 7fdf8f02c8c0 1 < suggested update operation key=6VNI8FMHZ0FN tag=B7DZVBP50SQS type=del size=2922372 2024-09-14T10:57:31.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.643+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=3RVH1P9X3MIO type=write size=805895 2024-09-14T10:57:31.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.647+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=DQ4KRTXWZKLG type=del 2024-09-14T10:57:31.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~CHBVS4PHF8L6.0 size=1048576 2024-09-14T10:57:31.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.659+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~CHBVS4PHF8L6.1 size=1048576 2024-09-14T10:57:31.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.659+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~CHBVS4PHF8L6.2 size=75279 2024-09-14T10:57:31.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.659+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=CHBVS4PHF8L6 tag=55OD66CMRDUG type=write size=3221007 2024-09-14T10:57:31.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.663+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=L9I3FCUML9UY type=del 2024-09-14T10:57:31.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.667+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=QCSL8Q5SV5NH type=write size=180209 2024-09-14T10:57:31.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.671+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~5HR7S1P718VQ.0 size=1048576 2024-09-14T10:57:31.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.679+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~5HR7S1P718VQ.1 size=1048576 2024-09-14T10:57:31.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.679+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~5HR7S1P718VQ.2 size=241229 2024-09-14T10:57:31.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.683+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=5HR7S1P718VQ tag=OYA1X6ZQDSNE type=write size=3386957 2024-09-14T10:57:31.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.687+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=WMQ6VH8K4XG3 type=del size=3942752 2024-09-14T10:57:31.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.695+0000 7fdf8f02c8c0 1 < suggested update operation key=6VNI8FMHZ0FN tag=OTLWT5NTTC2V type=del size=542811 2024-09-14T10:57:31.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.703+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~69D6JW3DNK26.0 size=1048576 2024-09-14T10:57:31.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~69D6JW3DNK26.1 size=1048576 2024-09-14T10:57:31.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.711+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~69D6JW3DNK26.2 size=142926 2024-09-14T10:57:31.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.711+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=69D6JW3DNK26 tag=5KFT0THGKX06 type=write size=3288654 2024-09-14T10:57:31.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.719+0000 7fdf8f02c8c0 1 < suggested remove operation key=X1BN3054IKNS tag=TX1XZHNRD8L0 type=del 2024-09-14T10:57:31.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.723+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~WEBZJVIASZEX.0 size=1048576 2024-09-14T10:57:31.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.727+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~WEBZJVIASZEX.1 size=1048576 2024-09-14T10:57:31.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.731+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~WEBZJVIASZEX.2 size=159976 2024-09-14T10:57:31.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.731+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=WEBZJVIASZEX tag=V0UCA0LEBGKQ type=write size=3305704 2024-09-14T10:57:31.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.735+0000 7fdf8f02c8c0 1 < completed write operation key=9IDBODZBQRJR tag=8B8ZB54VM7SQ type=write size=697983 2024-09-14T10:57:31.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.743+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~FUE74E3FJLY7.0 size=571843 2024-09-14T10:57:31.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.743+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=FUE74E3FJLY7 tag=LWWFSSQKI9SE type=write size=1620419 2024-09-14T10:57:31.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.747+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~7QG10UPPOPC7.0 size=1048576 2024-09-14T10:57:31.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.751+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~7QG10UPPOPC7.1 size=277563 2024-09-14T10:57:31.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.755+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=7QG10UPPOPC7 tag=LGNGNH7WX9PP type=write size=2374715 2024-09-14T10:57:31.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~2PSCBHR9QMVJ.0 size=1048576 2024-09-14T10:57:31.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.767+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~2PSCBHR9QMVJ.1 size=1001672 2024-09-14T10:57:31.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.767+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=2PSCBHR9QMVJ tag=I8I0NRGAE9RK type=write size=3098824 2024-09-14T10:57:31.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.767+0000 7fdf8f02c8c0 -1 < failed to complete operation key=X1BN3054IKNS tag=XHHG4RTIJTRA type=del size=537411: (22) Invalid argument 2024-09-14T10:57:31.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~P1PIMQ8WWV9V.0 size=126699 2024-09-14T10:57:31.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.775+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=P1PIMQ8WWV9V tag=51XMJEF3CDTH type=write size=1175275 2024-09-14T10:57:31.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.779+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~LQVP9KGKXIK4.0 size=1048576 2024-09-14T10:57:31.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.783+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~LQVP9KGKXIK4.1 size=1048576 2024-09-14T10:57:31.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.787+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~LQVP9KGKXIK4.2 size=135681 2024-09-14T10:57:31.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.791+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=LQVP9KGKXIK4 tag=FZ6IHYTJ9SVL type=write size=3281409 2024-09-14T10:57:31.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.795+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=LK19GKNKJMY7 type=del size=3435374 2024-09-14T10:57:31.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.799+0000 7fdf8f02c8c0 1 < canceled operation key=1E72V12EPEH3 tag=AGHSIU3UFU5E type=write size=973225 2024-09-14T10:57:31.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.803+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=NEFU7IK2SSZM type=del size=4088100 2024-09-14T10:57:31.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.807+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=ECYHAZVUMPIE type=del 2024-09-14T10:57:31.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.815+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~IKQX5TVBO26W.0 size=1048576 2024-09-14T10:57:31.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.819+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~IKQX5TVBO26W.1 size=1048576 2024-09-14T10:57:31.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.819+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~IKQX5TVBO26W.2 size=361753 2024-09-14T10:57:31.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.819+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=IKQX5TVBO26W tag=J94MMXA2DGJ0 type=write size=3507481 2024-09-14T10:57:31.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.823+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=MKE4S6QLE224 type=del 2024-09-14T10:57:31.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.827+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=RU688W2JHBR3 type=del size=664003 2024-09-14T10:57:31.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.831+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=2UQ9DH68JWRR type=del 2024-09-14T10:57:31.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.835+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=I5J3K2JYYWM3 type=del size=3023720 2024-09-14T10:57:31.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.839+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=DM6QDN1VG6FG type=del 2024-09-14T10:57:31.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.843+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=JH4IWEKJOIK2 type=del size=2738730 2024-09-14T10:57:31.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.847+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=SYUAGCF6FKAT type=del 2024-09-14T10:57:31.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.851+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~AJ1EEWUO8S5C.0 size=1048576 2024-09-14T10:57:31.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.855+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~AJ1EEWUO8S5C.1 size=465595 2024-09-14T10:57:31.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.855+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=AJ1EEWUO8S5C tag=HOUMMAEZDZOW type=write size=2562747 2024-09-14T10:57:31.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.863+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=3RVH1P9X3MIO type=write size=805895 2024-09-14T10:57:31.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.867+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=KX8G7TC692W8 type=del size=3787355 2024-09-14T10:57:31.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~CHBVS4PHF8L6.0 size=1048576 2024-09-14T10:57:31.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.871+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_82N2FPU7LKTG.2~CHBVS4PHF8L6.1 size=1048576 2024-09-14T10:57:31.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.875+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~CHBVS4PHF8L6.2 size=75279 2024-09-14T10:57:31.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.883+0000 7fdf8f02c8c0 1 < canceled multipart upload key=82N2FPU7LKTG upload=CHBVS4PHF8L6 tag=55OD66CMRDUG type=write size=3221007 2024-09-14T10:57:31.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.887+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=L1HJ0YFIK9FH type=write size=312606 2024-09-14T10:57:31.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.895+0000 7fdf8f02c8c0 1 < suggested update operation key=X0RT8UF3D0JC tag=QCSL8Q5SV5NH type=write size=180209 2024-09-14T10:57:31.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.903+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~302C2U5YY8P3.0 size=320430 2024-09-14T10:57:31.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.903+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=302C2U5YY8P3 tag=OQDU4ZKPA98M type=write size=1369006 2024-09-14T10:57:31.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.907+0000 7fdf8f02c8c0 1 < canceled operation key=XUT55FR490EO tag=WMQ6VH8K4XG3 type=del size=3942752 2024-09-14T10:57:31.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.915+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~Y96JIV6VQAHA.0 size=634207 2024-09-14T10:57:31.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.915+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=Y96JIV6VQAHA tag=CA61I1D7R6G5 type=write size=1682783 2024-09-14T10:57:31.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.919+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~69D6JW3DNK26.0 size=1048576 2024-09-14T10:57:31.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.919+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~69D6JW3DNK26.1 size=1048576 2024-09-14T10:57:31.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.923+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~69D6JW3DNK26.2 size=142926 2024-09-14T10:57:31.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.931+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=69D6JW3DNK26 tag=5KFT0THGKX06 type=write size=3288654 2024-09-14T10:57:31.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.935+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=6I4QSMNGNTGQ type=write size=466649 2024-09-14T10:57:31.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.939+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~WEBZJVIASZEX.0 size=1048576 2024-09-14T10:57:31.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.939+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~WEBZJVIASZEX.1 size=1048576 2024-09-14T10:57:31.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.943+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~WEBZJVIASZEX.2 size=159976 2024-09-14T10:57:31.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.947+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=WEBZJVIASZEX tag=V0UCA0LEBGKQ type=write size=3305704 2024-09-14T10:57:31.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.955+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=KQAMDXNAQ37E type=del size=2648927 2024-09-14T10:57:31.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~FUE74E3FJLY7.0 size=571843 2024-09-14T10:57:31.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.963+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=FUE74E3FJLY7 tag=LWWFSSQKI9SE type=write size=1620419 2024-09-14T10:57:31.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.967+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~4UZ1S7CZL7GY.0 size=1048576 2024-09-14T10:57:31.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.971+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~4UZ1S7CZL7GY.1 size=1048576 2024-09-14T10:57:31.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.971+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~4UZ1S7CZL7GY.2 size=290614 2024-09-14T10:57:31.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.971+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=4UZ1S7CZL7GY tag=5JAF8PP9XG3Z type=write size=3436342 2024-09-14T10:57:31.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.975+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~2PSCBHR9QMVJ.0 size=1048576 2024-09-14T10:57:31.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.979+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~2PSCBHR9QMVJ.1 size=1001672 2024-09-14T10:57:31.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.983+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=2PSCBHR9QMVJ tag=I8I0NRGAE9RK type=write size=3098824 2024-09-14T10:57:31.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.987+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=DGMAC9OUTSAD type=del size=3019967 2024-09-14T10:57:31.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~P1PIMQ8WWV9V.0 size=126699 2024-09-14T10:57:31.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.995+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=P1PIMQ8WWV9V tag=51XMJEF3CDTH type=write size=1175275 2024-09-14T10:57:31.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:31.999+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=LZX1C4FQKQRT type=del size=3317590 2024-09-14T10:57:32.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.003+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=LK19GKNKJMY7 type=del 2024-09-14T10:57:32.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~B0DAH55KKMTH.0 size=241136 2024-09-14T10:57:32.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.011+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=B0DAH55KKMTH tag=BY4B0XJGUHEV type=write size=1289712 2024-09-14T10:57:32.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.015+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=NEFU7IK2SSZM type=del 2024-09-14T10:57:32.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.023+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~1UIZDAG96LV3.0 size=1048576 2024-09-14T10:57:32.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.027+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~1UIZDAG96LV3.1 size=1048576 2024-09-14T10:57:32.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.031+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~1UIZDAG96LV3.2 size=254623 2024-09-14T10:57:32.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.031+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=1UIZDAG96LV3 tag=0L348ZR4Q3BA type=write size=3400351 2024-09-14T10:57:32.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.035+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~IKQX5TVBO26W.0 size=1048576 2024-09-14T10:57:32.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.039+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~IKQX5TVBO26W.1 size=1048576 2024-09-14T10:57:32.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.039+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~IKQX5TVBO26W.2 size=361753 2024-09-14T10:57:32.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.047+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=IKQX5TVBO26W tag=J94MMXA2DGJ0 type=write size=3507481 2024-09-14T10:57:32.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.051+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=N59T24MNKWOS type=del size=615463 2024-09-14T10:57:32.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.055+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=RU688W2JHBR3 type=del 2024-09-14T10:57:32.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.059+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=05964B5EIIJX type=del size=2997324 2024-09-14T10:57:32.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.067+0000 7fdf8f02c8c0 1 < suggested update operation key=82N2FPU7LKTG tag=I5J3K2JYYWM3 type=del size=3023720 2024-09-14T10:57:32.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~E1CJZ45FBU9O.0 size=1048576 2024-09-14T10:57:32.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.079+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~E1CJZ45FBU9O.1 size=756242 2024-09-14T10:57:32.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.079+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=E1CJZ45FBU9O tag=ALJGKWBK97YE type=write size=2853394 2024-09-14T10:57:32.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.083+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=JH4IWEKJOIK2 type=del 2024-09-14T10:57:32.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.087+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=PRA4XF2AM0L6 type=write size=98472 2024-09-14T10:57:32.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.087+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~AJ1EEWUO8S5C.0 size=1048576 2024-09-14T10:57:32.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.091+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~AJ1EEWUO8S5C.1 size=465595 2024-09-14T10:57:32.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.099+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=AJ1EEWUO8S5C tag=HOUMMAEZDZOW type=write size=2562747 2024-09-14T10:57:32.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.103+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~00EC5SF1HQG9.0 size=1048576 2024-09-14T10:57:32.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.107+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~00EC5SF1HQG9.1 size=1048576 2024-09-14T10:57:32.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.111+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~00EC5SF1HQG9.2 size=1012543 2024-09-14T10:57:32.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.111+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=00EC5SF1HQG9 tag=WPVKM1O809MW type=write size=4158271 2024-09-14T10:57:32.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.115+0000 7fdf8f02c8c0 1 < canceled operation key=STHEUJ6VDPQB tag=KX8G7TC692W8 type=del size=3787355 2024-09-14T10:57:32.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.119+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=N63I4W2KHU4M type=del size=2904046 2024-09-14T10:57:32.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.119+0000 7fdf8f02c8c0 1 < canceled operation key=L1ERJ0JSRDMG tag=L1HJ0YFIK9FH type=write size=312606 2024-09-14T10:57:32.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.123+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=ZNSJ1HIWQQAC type=del size=1001378 2024-09-14T10:57:32.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.127+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~302C2U5YY8P3.0 size=320430 2024-09-14T10:57:32.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.135+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=302C2U5YY8P3 tag=OQDU4ZKPA98M type=write size=1369006 2024-09-14T10:57:32.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.139+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=DMQL5VXTV8Z5 type=del size=977811 2024-09-14T10:57:32.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.143+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~Y96JIV6VQAHA.0 size=634207 2024-09-14T10:57:32.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.147+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=Y96JIV6VQAHA tag=CA61I1D7R6G5 type=write size=1682783 2024-09-14T10:57:32.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.155+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~RKER80HXRU45.0 size=1048576 2024-09-14T10:57:32.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.159+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~RKER80HXRU45.1 size=475433 2024-09-14T10:57:32.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.159+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=RKER80HXRU45 tag=5AMX6P3TL14K type=write size=2572585 2024-09-14T10:57:32.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.163+0000 7fdf8f02c8c0 1 < completed write operation key=OFY1G5R28CK6 tag=6I4QSMNGNTGQ type=write size=466649 2024-09-14T10:57:32.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.167+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~5RH2S33366M1.0 size=1048576 2024-09-14T10:57:32.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.171+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~5RH2S33366M1.1 size=1048576 2024-09-14T10:57:32.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.175+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~5RH2S33366M1.2 size=59331 2024-09-14T10:57:32.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.175+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=5RH2S33366M1 tag=4F1DC36917LC type=write size=3205059 2024-09-14T10:57:32.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.179+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=KQAMDXNAQ37E type=del 2024-09-14T10:57:32.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.183+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=VWHPNZEGT3ZA type=del size=2510692 2024-09-14T10:57:32.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.187+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~4UZ1S7CZL7GY.0 size=1048576 2024-09-14T10:57:32.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.191+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~4UZ1S7CZL7GY.1 size=1048576 2024-09-14T10:57:32.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.195+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~4UZ1S7CZL7GY.2 size=290614 2024-09-14T10:57:32.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.203+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=4UZ1S7CZL7GY tag=5JAF8PP9XG3Z type=write size=3436342 2024-09-14T10:57:32.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.207+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=PRCUBZQO4IW2 type=del size=2122808 2024-09-14T10:57:32.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.211+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=DGMAC9OUTSAD type=del 2024-09-14T10:57:32.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.223+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~4V66FQMT0OVB.0 size=1048576 2024-09-14T10:57:32.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.227+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~4V66FQMT0OVB.1 size=1048576 2024-09-14T10:57:32.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.231+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~4V66FQMT0OVB.2 size=154327 2024-09-14T10:57:32.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.231+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=4V66FQMT0OVB tag=FGS6H46G36IC type=write size=3300055 2024-09-14T10:57:32.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.235+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=LZX1C4FQKQRT type=del 2024-09-14T10:57:32.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.239+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=I0H08GL3TXF3 type=del size=3083383 2024-09-14T10:57:32.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~B0DAH55KKMTH.0 size=241136 2024-09-14T10:57:32.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.247+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=B0DAH55KKMTH tag=BY4B0XJGUHEV type=write size=1289712 2024-09-14T10:57:32.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.255+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~YT7T25YQXCME.0 size=312546 2024-09-14T10:57:32.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.255+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=YT7T25YQXCME tag=ML3J5TYGXBD3 type=write size=1361122 2024-09-14T10:57:32.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.259+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~1UIZDAG96LV3.0 size=1048576 2024-09-14T10:57:32.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.259+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~1UIZDAG96LV3.1 size=1048576 2024-09-14T10:57:32.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.263+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~1UIZDAG96LV3.2 size=254623 2024-09-14T10:57:32.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.271+0000 7fdf8f02c8c0 1 < canceled multipart upload key=XUT55FR490EO upload=1UIZDAG96LV3 tag=0L348ZR4Q3BA type=write size=3400351 2024-09-14T10:57:32.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.275+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=YS1T97YW0DC7 type=del size=1147066 2024-09-14T10:57:32.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.279+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=N59T24MNKWOS type=del 2024-09-14T10:57:32.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.283+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=PBYEMP9CCWCG type=del size=2404520 2024-09-14T10:57:32.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.287+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=05964B5EIIJX type=del 2024-09-14T10:57:32.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.291+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=FX1MT2C5WED7 type=write size=633802 2024-09-14T10:57:32.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.295+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~E1CJZ45FBU9O.0 size=1048576 2024-09-14T10:57:32.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.295+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~E1CJZ45FBU9O.1 size=756242 2024-09-14T10:57:32.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.303+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=E1CJZ45FBU9O tag=ALJGKWBK97YE type=write size=2853394 2024-09-14T10:57:32.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.311+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~9HQR5BXG9BA4.0 size=1048576 2024-09-14T10:57:32.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.315+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~9HQR5BXG9BA4.1 size=857924 2024-09-14T10:57:32.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.315+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=9HQR5BXG9BA4 tag=ASWNKO28F807 type=write size=2955076 2024-09-14T10:57:32.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.323+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=PRA4XF2AM0L6 type=write size=98472 2024-09-14T10:57:32.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.327+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=EM80OLPVBW10 type=del size=3874392 2024-09-14T10:57:32.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.331+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~00EC5SF1HQG9.0 size=1048576 2024-09-14T10:57:32.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.335+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~00EC5SF1HQG9.1 size=1048576 2024-09-14T10:57:32.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.335+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_MNBXQTJBS1QS.2~00EC5SF1HQG9.2 size=1012543 2024-09-14T10:57:32.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.339+0000 7fdf8f02c8c0 1 < canceled multipart upload key=MNBXQTJBS1QS upload=00EC5SF1HQG9 tag=WPVKM1O809MW type=write size=4158271 2024-09-14T10:57:32.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.343+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=UDM093NONNCH type=del size=1162995 2024-09-14T10:57:32.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.351+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=N63I4W2KHU4M type=del size=2904046 2024-09-14T10:57:32.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.355+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=U37ZJIXPL87G type=del size=2205631 2024-09-14T10:57:32.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.359+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=ZNSJ1HIWQQAC type=del 2024-09-14T10:57:32.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.363+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=H5W7U2T85WW6 type=del size=2315917 2024-09-14T10:57:32.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.367+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=DMQL5VXTV8Z5 type=del 2024-09-14T10:57:32.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.371+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=F84BBHOVCPZF type=write size=832163 2024-09-14T10:57:32.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.371+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LMNGCUFR187I.2~RKER80HXRU45.0 size=1048576 2024-09-14T10:57:32.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.375+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~RKER80HXRU45.1 size=475433 2024-09-14T10:57:32.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.383+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LMNGCUFR187I upload=RKER80HXRU45 tag=5AMX6P3TL14K type=write size=2572585 2024-09-14T10:57:32.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.387+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~E8H0T1QXTLF2.0 size=841782 2024-09-14T10:57:32.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.387+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=E8H0T1QXTLF2 tag=AI4EF8QPS76J type=write size=1890358 2024-09-14T10:57:32.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.391+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_9IDBODZBQRJR.2~5RH2S33366M1.0 size=1048576 2024-09-14T10:57:32.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.391+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~5RH2S33366M1.1 size=1048576 2024-09-14T10:57:32.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.395+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~5RH2S33366M1.2 size=59331 2024-09-14T10:57:32.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.399+0000 7fdf8f02c8c0 1 < canceled multipart upload key=9IDBODZBQRJR upload=5RH2S33366M1 tag=4F1DC36917LC type=write size=3205059 2024-09-14T10:57:32.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~K0UG0KFD7XCF.0 size=281331 2024-09-14T10:57:32.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.407+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=K0UG0KFD7XCF tag=EXC0HLXLNBLM type=write size=1329907 2024-09-14T10:57:32.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.411+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=VWHPNZEGT3ZA type=del 2024-09-14T10:57:32.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.415+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=YUWM1Q0L5TMT type=del size=2741783 2024-09-14T10:57:32.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.423+0000 7fdf8f02c8c0 1 < suggested update operation key=1E72V12EPEH3 tag=PRCUBZQO4IW2 type=del size=2122808 2024-09-14T10:57:32.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.431+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~QL5A0GKP0U39.0 size=1048576 2024-09-14T10:57:32.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.435+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~QL5A0GKP0U39.1 size=511501 2024-09-14T10:57:32.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.435+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=QL5A0GKP0U39 tag=MX076XG5QBXV type=write size=2608653 2024-09-14T10:57:32.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.439+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~4V66FQMT0OVB.0 size=1048576 2024-09-14T10:57:32.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~4V66FQMT0OVB.1 size=1048576 2024-09-14T10:57:32.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.447+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~4V66FQMT0OVB.2 size=154327 2024-09-14T10:57:32.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.451+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=4V66FQMT0OVB tag=FGS6H46G36IC type=write size=3300055 2024-09-14T10:57:32.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.459+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~CKMD31Y7KL8M.0 size=1048576 2024-09-14T10:57:32.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.463+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~CKMD31Y7KL8M.1 size=474672 2024-09-14T10:57:32.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.463+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=CKMD31Y7KL8M tag=V1M5UKQCY6CA type=write size=2571824 2024-09-14T10:57:32.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.467+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=I0H08GL3TXF3 type=del 2024-09-14T10:57:32.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.471+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=35S37CW6J41I type=del size=2447356 2024-09-14T10:57:32.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.475+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~YT7T25YQXCME.0 size=312546 2024-09-14T10:57:32.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.479+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=YT7T25YQXCME tag=ML3J5TYGXBD3 type=write size=1361122 2024-09-14T10:57:32.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.483+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=FJ0Q55GIVXER type=del size=3512177 2024-09-14T10:57:32.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.491+0000 7fdf8f02c8c0 1 < suggested update operation key=OFY1G5R28CK6 tag=YS1T97YW0DC7 type=del size=1147066 2024-09-14T10:57:32.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.495+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=JCLI3QH3ZH9S type=del size=1387491 2024-09-14T10:57:32.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.495+0000 7fdf8f02c8c0 -1 < failed to complete operation key=1E72V12EPEH3 tag=PBYEMP9CCWCG type=del size=2404520: (22) Invalid argument 2024-09-14T10:57:32.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.503+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~J6IOXCTY6WEJ.0 size=958863 2024-09-14T10:57:32.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.503+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=J6IOXCTY6WEJ tag=TP5XLN0P4P2I type=write size=2007439 2024-09-14T10:57:32.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.511+0000 7fdf8f02c8c0 1 < suggested remove operation key=LFLY0V3FRRW5 tag=FX1MT2C5WED7 type=write 2024-09-14T10:57:32.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.515+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=MFT3ALC5I3OG type=del size=381530 2024-09-14T10:57:32.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.519+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~9HQR5BXG9BA4.0 size=1048576 2024-09-14T10:57:32.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.519+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~9HQR5BXG9BA4.1 size=857924 2024-09-14T10:57:32.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.527+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=9HQR5BXG9BA4 tag=ASWNKO28F807 type=write size=2955076 2024-09-14T10:57:32.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.531+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=ES65TVB6AO17 type=del size=2537842 2024-09-14T10:57:32.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.535+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=EM80OLPVBW10 type=del 2024-09-14T10:57:32.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.539+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=3OBCPVTFTO0I type=del size=2675085 2024-09-14T10:57:32.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.543+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=UDM093NONNCH type=del 2024-09-14T10:57:32.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.547+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~J2UXMBBQNEG8.0 size=1048576 2024-09-14T10:57:32.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.551+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~J2UXMBBQNEG8.1 size=788837 2024-09-14T10:57:32.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.551+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=J2UXMBBQNEG8 tag=Z1DX93DU71JC type=write size=2885989 2024-09-14T10:57:32.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.555+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=U37ZJIXPL87G type=del 2024-09-14T10:57:32.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~UM0O7ED4RH74.0 size=1048576 2024-09-14T10:57:32.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~UM0O7ED4RH74.1 size=1048576 2024-09-14T10:57:32.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.567+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~UM0O7ED4RH74.2 size=443676 2024-09-14T10:57:32.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.567+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=UM0O7ED4RH74 tag=N849Q5CCD0O9 type=write size=3589404 2024-09-14T10:57:32.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.571+0000 7fdf8f02c8c0 1 < canceled operation key=X0RT8UF3D0JC tag=H5W7U2T85WW6 type=del size=2315917 2024-09-14T10:57:32.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.575+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=KK1EXEHR144J type=del size=2229302 2024-09-14T10:57:32.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.579+0000 7fdf8f02c8c0 1 < completed write operation key=STB3W5URFJEZ tag=F84BBHOVCPZF type=write size=832163 2024-09-14T10:57:32.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.583+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=RKCNNZ82ESD8 type=del size=2895311 2024-09-14T10:57:32.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.587+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~E8H0T1QXTLF2.0 size=841782 2024-09-14T10:57:32.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.595+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=E8H0T1QXTLF2 tag=AI4EF8QPS76J type=write size=1890358 2024-09-14T10:57:32.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.599+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~JXPPLBGP885J.0 size=1048576 2024-09-14T10:57:32.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.603+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~JXPPLBGP885J.1 size=1048576 2024-09-14T10:57:32.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~JXPPLBGP885J.2 size=764832 2024-09-14T10:57:32.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.607+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=JXPPLBGP885J tag=6E6MKL3UGT73 type=write size=3910560 2024-09-14T10:57:32.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.611+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~K0UG0KFD7XCF.0 size=281331 2024-09-14T10:57:32.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.615+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=K0UG0KFD7XCF tag=EXC0HLXLNBLM type=write size=1329907 2024-09-14T10:57:32.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.619+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=UCX6DBUMFPG8 type=del size=784044 2024-09-14T10:57:32.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.623+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=YUWM1Q0L5TMT type=del 2024-09-14T10:57:32.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.627+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=Y3LDBQP2H62F type=del size=4058033 2024-09-14T10:57:32.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.631+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~QL5A0GKP0U39.0 size=1048576 2024-09-14T10:57:32.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.635+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~QL5A0GKP0U39.1 size=511501 2024-09-14T10:57:32.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.639+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=QL5A0GKP0U39 tag=MX076XG5QBXV type=write size=2608653 2024-09-14T10:57:32.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~4A5AZGRU4LBX.0 size=1048576 2024-09-14T10:57:32.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~4A5AZGRU4LBX.1 size=1048576 2024-09-14T10:57:32.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~4A5AZGRU4LBX.2 size=696680 2024-09-14T10:57:32.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.651+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=4A5AZGRU4LBX tag=6NKJEBAUJGY6 type=write size=3842408 2024-09-14T10:57:32.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.655+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~CKMD31Y7KL8M.0 size=1048576 2024-09-14T10:57:32.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.655+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~CKMD31Y7KL8M.1 size=474672 2024-09-14T10:57:32.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.663+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=CKMD31Y7KL8M tag=V1M5UKQCY6CA type=write size=2571824 2024-09-14T10:57:32.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~0D3VK59X5ABD.0 size=1048576 2024-09-14T10:57:32.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~0D3VK59X5ABD.1 size=569262 2024-09-14T10:57:32.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.671+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=0D3VK59X5ABD tag=UYV1JJ15XQFI type=write size=2666414 2024-09-14T10:57:32.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.675+0000 7fdf8f02c8c0 -1 < failed to complete operation key=OFY1G5R28CK6 tag=35S37CW6J41I type=del size=2447356: (22) Invalid argument 2024-09-14T10:57:32.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~SLXQP6Q293JC.0 size=1048576 2024-09-14T10:57:32.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~SLXQP6Q293JC.1 size=384421 2024-09-14T10:57:32.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.683+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=SLXQP6Q293JC tag=T153O40HZLRK type=write size=2481573 2024-09-14T10:57:32.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.687+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=FJ0Q55GIVXER type=del 2024-09-14T10:57:32.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.695+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~TW413TWG2QXE.0 size=63254 2024-09-14T10:57:32.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.695+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=TW413TWG2QXE tag=QLBEEFO4EMCN type=write size=1111830 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.699+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=JCLI3QH3ZH9S type=del 2024-09-14T10:57:32.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~1K3D7NERC8H0.0 size=1048576 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~1K3D7NERC8H0.1 size=1048576 2024-09-14T10:57:32.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.711+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~1K3D7NERC8H0.2 size=194503 2024-09-14T10:57:32.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.711+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=1K3D7NERC8H0 tag=QGFQTSPLU698 type=write size=3340231 2024-09-14T10:57:32.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.715+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~J6IOXCTY6WEJ.0 size=958863 2024-09-14T10:57:32.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.723+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=J6IOXCTY6WEJ tag=TP5XLN0P4P2I type=write size=2007439 2024-09-14T10:57:32.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.727+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=WB7S7NC341E1 type=del size=288027 2024-09-14T10:57:32.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.731+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=MFT3ALC5I3OG type=del 2024-09-14T10:57:32.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.735+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=B025UW0CEV62 type=del size=857102 2024-09-14T10:57:32.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.739+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=ES65TVB6AO17 type=del 2024-09-14T10:57:32.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.743+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~OPP3ZLRCROQL.0 size=850796 2024-09-14T10:57:32.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.743+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=OPP3ZLRCROQL tag=124P73DBQIS0 type=write size=1899372 2024-09-14T10:57:32.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.751+0000 7fdf8f02c8c0 1 < suggested update operation key=X1BN3054IKNS tag=3OBCPVTFTO0I type=del size=2675085 2024-09-14T10:57:32.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.755+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=RB4QJMWUJ3JP type=del size=2217178 2024-09-14T10:57:32.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.759+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~J2UXMBBQNEG8.0 size=1048576 2024-09-14T10:57:32.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.763+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~J2UXMBBQNEG8.1 size=788837 2024-09-14T10:57:32.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.767+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=J2UXMBBQNEG8 tag=Z1DX93DU71JC type=write size=2885989 2024-09-14T10:57:32.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~L4AP1TRM6Y8U.0 size=1048576 2024-09-14T10:57:32.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~L4AP1TRM6Y8U.1 size=833153 2024-09-14T10:57:32.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.775+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=L4AP1TRM6Y8U tag=UFYFKX5B8SIZ type=write size=2930305 2024-09-14T10:57:32.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.775+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~UM0O7ED4RH74.0 size=1048576 2024-09-14T10:57:32.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.779+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~UM0O7ED4RH74.1 size=1048576 2024-09-14T10:57:32.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.783+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~UM0O7ED4RH74.2 size=443676 2024-09-14T10:57:32.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.787+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=UM0O7ED4RH74 tag=N849Q5CCD0O9 type=write size=3589404 2024-09-14T10:57:32.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.791+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=BI5HKBDUPLBS type=del size=185391 2024-09-14T10:57:32.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.795+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=KK1EXEHR144J type=del 2024-09-14T10:57:32.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.803+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~8MORR4W45GT4.0 size=1048576 2024-09-14T10:57:32.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.807+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~8MORR4W45GT4.1 size=200579 2024-09-14T10:57:32.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.807+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=8MORR4W45GT4 tag=1EQFYKJ25CJR type=write size=2297731 2024-09-14T10:57:32.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.815+0000 7fdf8f02c8c0 1 < suggested remove operation key=Y32RWGISRBMT tag=RKCNNZ82ESD8 type=del 2024-09-14T10:57:32.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.823+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~X8MQKYE29E11.0 size=983623 2024-09-14T10:57:32.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.823+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=X8MQKYE29E11 tag=NBGOJE57BBTT type=write size=2032199 2024-09-14T10:57:32.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.827+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~JXPPLBGP885J.0 size=1048576 2024-09-14T10:57:32.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.831+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~JXPPLBGP885J.1 size=1048576 2024-09-14T10:57:32.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.831+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~JXPPLBGP885J.2 size=764832 2024-09-14T10:57:32.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.839+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=JXPPLBGP885J tag=6E6MKL3UGT73 type=write size=3910560 2024-09-14T10:57:32.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.847+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~5PBUPTYWBP13.0 size=1048576 2024-09-14T10:57:32.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.847+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~5PBUPTYWBP13.1 size=8506 2024-09-14T10:57:32.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.847+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=5PBUPTYWBP13 tag=QKB5OJY0Q29S type=write size=2105658 2024-09-14T10:57:32.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.855+0000 7fdf8f02c8c0 1 < suggested update operation key=STHEUJ6VDPQB tag=UCX6DBUMFPG8 type=del size=784044 2024-09-14T10:57:32.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~CJLHYWHDHWNN.0 size=1048576 2024-09-14T10:57:32.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.867+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~CJLHYWHDHWNN.1 size=1048576 2024-09-14T10:57:32.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.871+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~CJLHYWHDHWNN.2 size=210085 2024-09-14T10:57:32.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.871+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=CJLHYWHDHWNN tag=QI04336O19Y1 type=write size=3355813 2024-09-14T10:57:32.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.875+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=Y3LDBQP2H62F type=del 2024-09-14T10:57:32.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.879+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=7LS5PQ3U8WJB type=del size=1928102 2024-09-14T10:57:32.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.879+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~4A5AZGRU4LBX.0 size=1048576 2024-09-14T10:57:32.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.883+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~4A5AZGRU4LBX.1 size=1048576 2024-09-14T10:57:32.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.883+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~4A5AZGRU4LBX.2 size=696680 2024-09-14T10:57:32.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.891+0000 7fdf8f02c8c0 1 < canceled multipart upload key=OFY1G5R28CK6 upload=4A5AZGRU4LBX tag=6NKJEBAUJGY6 type=write size=3842408 2024-09-14T10:57:32.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.895+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=VABCI6LG6SMB type=del size=4085447 2024-09-14T10:57:32.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~0D3VK59X5ABD.0 size=1048576 2024-09-14T10:57:32.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~0D3VK59X5ABD.1 size=569262 2024-09-14T10:57:32.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.907+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=0D3VK59X5ABD tag=UYV1JJ15XQFI type=write size=2666414 2024-09-14T10:57:32.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.911+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=AJSE9E49GAUG type=del size=1432718 2024-09-14T10:57:32.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.915+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~SLXQP6Q293JC.0 size=1048576 2024-09-14T10:57:32.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.915+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_WA7HE8ZJ1W1M.2~SLXQP6Q293JC.1 size=384421 2024-09-14T10:57:32.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.927+0000 7fdf8f02c8c0 1 < canceled multipart upload key=WA7HE8ZJ1W1M upload=SLXQP6Q293JC tag=T153O40HZLRK type=write size=2481573 2024-09-14T10:57:32.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.931+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=003RUJRH17E1 type=del size=3833252 2024-09-14T10:57:32.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.935+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~TW413TWG2QXE.0 size=63254 2024-09-14T10:57:32.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.943+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=TW413TWG2QXE tag=QLBEEFO4EMCN type=write size=1111830 2024-09-14T10:57:32.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.947+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=T3V5214VXEVM type=del size=595501 2024-09-14T10:57:32.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.951+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~1K3D7NERC8H0.0 size=1048576 2024-09-14T10:57:32.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.951+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_1E72V12EPEH3.2~1K3D7NERC8H0.1 size=1048576 2024-09-14T10:57:32.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~1K3D7NERC8H0.2 size=194503 2024-09-14T10:57:32.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.959+0000 7fdf8f02c8c0 1 < canceled multipart upload key=1E72V12EPEH3 upload=1K3D7NERC8H0 tag=QGFQTSPLU698 type=write size=3340231 2024-09-14T10:57:32.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.967+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~4WO4UP5MBJDO.0 size=1048576 2024-09-14T10:57:32.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.971+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~4WO4UP5MBJDO.1 size=1048576 2024-09-14T10:57:32.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.971+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~4WO4UP5MBJDO.2 size=291528 2024-09-14T10:57:32.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.971+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=4WO4UP5MBJDO tag=KYNNMPRCDAQQ type=write size=3437256 2024-09-14T10:57:32.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.975+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=WB7S7NC341E1 type=del 2024-09-14T10:57:32.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~V90W9W7C8ZXQ.0 size=878868 2024-09-14T10:57:32.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.983+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=V90W9W7C8ZXQ tag=3GNINDPX1II5 type=write size=1927444 2024-09-14T10:57:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.987+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=B025UW0CEV62 type=del 2024-09-14T10:57:32.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.991+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~DAIL6T64YLPV.0 size=1048576 2024-09-14T10:57:32.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.995+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~DAIL6T64YLPV.1 size=1048576 2024-09-14T10:57:32.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.999+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~DAIL6T64YLPV.2 size=545082 2024-09-14T10:57:32.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:32.999+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=DAIL6T64YLPV tag=UE8ZBKEK2GE5 type=write size=3690810 2024-09-14T10:57:32.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.003+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~OPP3ZLRCROQL.0 size=850796 2024-09-14T10:57:33.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.007+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=OPP3ZLRCROQL tag=124P73DBQIS0 type=write size=1899372 2024-09-14T10:57:33.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.011+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=7H9U2LJ2QHJM type=write size=446997 2024-09-14T10:57:33.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.015+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=RB4QJMWUJ3JP type=del 2024-09-14T10:57:33.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.019+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=G6VIIHPDXSH3 type=write size=871709 2024-09-14T10:57:33.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.023+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~L4AP1TRM6Y8U.0 size=1048576 2024-09-14T10:57:33.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.027+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~L4AP1TRM6Y8U.1 size=833153 2024-09-14T10:57:33.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.031+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=L4AP1TRM6Y8U tag=UFYFKX5B8SIZ type=write size=2930305 2024-09-14T10:57:33.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.039+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~F0U5YWVMWSWA.0 size=1029687 2024-09-14T10:57:33.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.039+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=F0U5YWVMWSWA tag=ZNLW3DHPYWZH type=write size=2078263 2024-09-14T10:57:33.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.043+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=BI5HKBDUPLBS type=del 2024-09-14T10:57:33.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.047+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~E3MRBQB30S31.0 size=1048576 2024-09-14T10:57:33.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.051+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~E3MRBQB30S31.1 size=1048576 2024-09-14T10:57:33.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.055+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~E3MRBQB30S31.2 size=964947 2024-09-14T10:57:33.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.055+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=E3MRBQB30S31 tag=A9RGU4YH7LIX type=write size=4110675 2024-09-14T10:57:33.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.059+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~8MORR4W45GT4.0 size=1048576 2024-09-14T10:57:33.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.059+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~8MORR4W45GT4.1 size=200579 2024-09-14T10:57:33.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.067+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=8MORR4W45GT4 tag=1EQFYKJ25CJR type=write size=2297731 2024-09-14T10:57:33.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.071+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=LWU5U4M2RYXU type=del size=20151 2024-09-14T10:57:33.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.075+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~X8MQKYE29E11.0 size=983623 2024-09-14T10:57:33.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.083+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=X8MQKYE29E11 tag=NBGOJE57BBTT type=write size=2032199 2024-09-14T10:57:33.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.087+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=TOC2OVV9LN3A type=del size=3356284 2024-09-14T10:57:33.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.091+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~5PBUPTYWBP13.0 size=1048576 2024-09-14T10:57:33.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.091+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~5PBUPTYWBP13.1 size=8506 2024-09-14T10:57:33.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.099+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=5PBUPTYWBP13 tag=QKB5OJY0Q29S type=write size=2105658 2024-09-14T10:57:33.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.103+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=RFBX77QV7XH4 type=write size=177230 2024-09-14T10:57:33.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.107+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~CJLHYWHDHWNN.0 size=1048576 2024-09-14T10:57:33.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.111+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~CJLHYWHDHWNN.1 size=1048576 2024-09-14T10:57:33.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.111+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~CJLHYWHDHWNN.2 size=210085 2024-09-14T10:57:33.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.119+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=CJLHYWHDHWNN tag=QI04336O19Y1 type=write size=3355813 2024-09-14T10:57:33.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.123+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=JDL85AH3U2LQ type=del size=4041985 2024-09-14T10:57:33.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.127+0000 7fdf8f02c8c0 1 < canceled operation key=0QJLAH0EPKVD tag=7LS5PQ3U8WJB type=del size=1928102 2024-09-14T10:57:33.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.131+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=BOZK5Q407LSD type=del size=2191435 2024-09-14T10:57:33.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.139+0000 7fdf8f02c8c0 1 < suggested update operation key=6VNI8FMHZ0FN tag=VABCI6LG6SMB type=del size=4085447 2024-09-14T10:57:33.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.143+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=AVNE7C46C52E type=del size=3620543 2024-09-14T10:57:33.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.143+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=AJSE9E49GAUG type=del 2024-09-14T10:57:33.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~EAAVYBZUNNU7.0 size=1048576 2024-09-14T10:57:33.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.155+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~EAAVYBZUNNU7.1 size=876878 2024-09-14T10:57:33.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.155+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=EAAVYBZUNNU7 tag=31GYVRHRX0ZO type=write size=2974030 2024-09-14T10:57:33.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.159+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=003RUJRH17E1 type=del 2024-09-14T10:57:33.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.163+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=6Y3N8TA523FR type=del size=3667001 2024-09-14T10:57:33.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.167+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=T3V5214VXEVM type=del 2024-09-14T10:57:33.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.171+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=NOEMH61K68Q6 type=del size=3815756 2024-09-14T10:57:33.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.175+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~4WO4UP5MBJDO.0 size=1048576 2024-09-14T10:57:33.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.175+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~4WO4UP5MBJDO.1 size=1048576 2024-09-14T10:57:33.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.179+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~4WO4UP5MBJDO.2 size=291528 2024-09-14T10:57:33.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.187+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=4WO4UP5MBJDO tag=KYNNMPRCDAQQ type=write size=3437256 2024-09-14T10:57:33.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.191+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=LK9R5VEQQDNF type=del size=1225735 2024-09-14T10:57:33.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.191+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~V90W9W7C8ZXQ.0 size=878868 2024-09-14T10:57:33.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.199+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=V90W9W7C8ZXQ tag=3GNINDPX1II5 type=write size=1927444 2024-09-14T10:57:33.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~83NVSYNR8VUX.0 size=1048576 2024-09-14T10:57:33.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~83NVSYNR8VUX.1 size=793100 2024-09-14T10:57:33.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.207+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=83NVSYNR8VUX tag=DPTABHDWFJSN type=write size=2890252 2024-09-14T10:57:33.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.211+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~DAIL6T64YLPV.0 size=1048576 2024-09-14T10:57:33.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.215+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~DAIL6T64YLPV.1 size=1048576 2024-09-14T10:57:33.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.215+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_5VZCCFRUAQJ7.2~DAIL6T64YLPV.2 size=545082 2024-09-14T10:57:33.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.223+0000 7fdf8f02c8c0 1 < canceled multipart upload key=5VZCCFRUAQJ7 upload=DAIL6T64YLPV tag=UE8ZBKEK2GE5 type=write size=3690810 2024-09-14T10:57:33.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.231+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~YZJE5L38AXLM.0 size=1048576 2024-09-14T10:57:33.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.231+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~YZJE5L38AXLM.1 size=1048576 2024-09-14T10:57:33.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.239+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~YZJE5L38AXLM.2 size=768550 2024-09-14T10:57:33.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.239+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=YZJE5L38AXLM tag=NO7QEJIF0ZP3 type=write size=3914278 2024-09-14T10:57:33.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.243+0000 7fdf8f02c8c0 1 < suggested remove operation key=3CYCJJIQ210M tag=7H9U2LJ2QHJM type=write 2024-09-14T10:57:33.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.247+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=ZTSO4WFMCCWZ type=del size=1050402 2024-09-14T10:57:33.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.251+0000 7fdf8f02c8c0 1 < completed write operation key=HCGZ1MY5SKW9 tag=G6VIIHPDXSH3 type=write size=871709 2024-09-14T10:57:33.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.255+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=CRLMWQG1AGOF type=del size=1440977 2024-09-14T10:57:33.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.259+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~F0U5YWVMWSWA.0 size=1029687 2024-09-14T10:57:33.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.267+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=F0U5YWVMWSWA tag=ZNLW3DHPYWZH type=write size=2078263 2024-09-14T10:57:33.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.271+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=RIJDV3C6BAXL type=del size=1457666 2024-09-14T10:57:33.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.275+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~E3MRBQB30S31.0 size=1048576 2024-09-14T10:57:33.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~E3MRBQB30S31.1 size=1048576 2024-09-14T10:57:33.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~E3MRBQB30S31.2 size=964947 2024-09-14T10:57:33.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.287+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=E3MRBQB30S31 tag=A9RGU4YH7LIX type=write size=4110675 2024-09-14T10:57:33.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.291+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~6KZVQPW8UFNN.0 size=1048576 2024-09-14T10:57:33.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.295+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~6KZVQPW8UFNN.1 size=897234 2024-09-14T10:57:33.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.295+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=6KZVQPW8UFNN tag=DRF1M5DO35BY type=write size=2994386 2024-09-14T10:57:33.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.299+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=LWU5U4M2RYXU type=del 2024-09-14T10:57:33.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.303+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~1KXDTIRIKYLX.0 size=1048576 2024-09-14T10:57:33.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.307+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~1KXDTIRIKYLX.1 size=949583 2024-09-14T10:57:33.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.307+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=1KXDTIRIKYLX tag=9DJZL56NU05R type=write size=3046735 2024-09-14T10:57:33.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.311+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=TOC2OVV9LN3A type=del 2024-09-14T10:57:33.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.315+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=TYTS78U72QLZ type=del size=1150962 2024-09-14T10:57:33.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.319+0000 7fdf8f02c8c0 1 < canceled operation key=XUT55FR490EO tag=RFBX77QV7XH4 type=write size=177230 2024-09-14T10:57:33.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.323+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=0II594JVCBAG type=del size=3193909 2024-09-14T10:57:33.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.327+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=JDL85AH3U2LQ type=del 2024-09-14T10:57:33.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.331+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=AV544JGYTSDX type=write size=178838 2024-09-14T10:57:33.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.335+0000 7fdf8f02c8c0 1 < suggested remove operation key=APDKRWHOUH9T tag=BOZK5Q407LSD type=del 2024-09-14T10:57:33.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.343+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~T1HDD6KH6GV2.0 size=1048576 2024-09-14T10:57:33.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~T1HDD6KH6GV2.1 size=1048576 2024-09-14T10:57:33.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~T1HDD6KH6GV2.2 size=621966 2024-09-14T10:57:33.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.351+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=T1HDD6KH6GV2 tag=YG8L4P4YBTBX type=write size=3767694 2024-09-14T10:57:33.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.355+0000 7fdf8f02c8c0 1 < canceled operation key=STB3W5URFJEZ tag=AVNE7C46C52E type=del size=3620543 2024-09-14T10:57:33.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.359+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~A6T8B6I899LG.0 size=1048576 2024-09-14T10:57:33.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.363+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~A6T8B6I899LG.1 size=175250 2024-09-14T10:57:33.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.363+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=A6T8B6I899LG tag=MGJTB5CUX22H type=write size=2272402 2024-09-14T10:57:33.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.367+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~EAAVYBZUNNU7.0 size=1048576 2024-09-14T10:57:33.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.371+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~EAAVYBZUNNU7.1 size=876878 2024-09-14T10:57:33.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.375+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=EAAVYBZUNNU7 tag=31GYVRHRX0ZO type=write size=2974030 2024-09-14T10:57:33.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.379+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=FB6N894RVXEK type=write size=544862 2024-09-14T10:57:33.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.383+0000 7fdf8f02c8c0 1 < canceled operation key=L1ERJ0JSRDMG tag=6Y3N8TA523FR type=del size=3667001 2024-09-14T10:57:33.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.387+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=KG4B2ZG2L4BW type=del size=2274423 2024-09-14T10:57:33.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.391+0000 7fdf8f02c8c0 1 < canceled operation key=82N2FPU7LKTG tag=NOEMH61K68Q6 type=del size=3815756 2024-09-14T10:57:33.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.395+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=KKJFG5T0Y8O8 type=del size=2863583 2024-09-14T10:57:33.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.403+0000 7fdf8f02c8c0 1 < suggested remove operation key=OFY1G5R28CK6 tag=LK9R5VEQQDNF type=del 2024-09-14T10:57:33.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~BUW34YGSHO3V.0 size=1048576 2024-09-14T10:57:33.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~BUW34YGSHO3V.1 size=477151 2024-09-14T10:57:33.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.411+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=BUW34YGSHO3V tag=58PKMF3YPUEH type=write size=2574303 2024-09-14T10:57:33.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.415+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~83NVSYNR8VUX.0 size=1048576 2024-09-14T10:57:33.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.419+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~83NVSYNR8VUX.1 size=793100 2024-09-14T10:57:33.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.427+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=83NVSYNR8VUX tag=DPTABHDWFJSN type=write size=2890252 2024-09-14T10:57:33.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.431+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~FU80TE8U3FZP.0 size=1048576 2024-09-14T10:57:33.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.435+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~FU80TE8U3FZP.1 size=1048576 2024-09-14T10:57:33.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.439+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~FU80TE8U3FZP.2 size=259853 2024-09-14T10:57:33.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.439+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=FU80TE8U3FZP tag=T32EVF099BB5 type=write size=3405581 2024-09-14T10:57:33.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~YZJE5L38AXLM.0 size=1048576 2024-09-14T10:57:33.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.447+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~YZJE5L38AXLM.1 size=1048576 2024-09-14T10:57:33.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.447+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~YZJE5L38AXLM.2 size=768550 2024-09-14T10:57:33.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.455+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=YZJE5L38AXLM tag=NO7QEJIF0ZP3 type=write size=3914278 2024-09-14T10:57:33.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.463+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~T341QJP33NFO.0 size=1048576 2024-09-14T10:57:33.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.467+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~T341QJP33NFO.1 size=1048576 2024-09-14T10:57:33.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.467+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~T341QJP33NFO.2 size=777764 2024-09-14T10:57:33.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.467+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=T341QJP33NFO tag=H74NSUCE73YV type=write size=3923492 2024-09-14T10:57:33.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.475+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=ZTSO4WFMCCWZ type=del size=1050402 2024-09-14T10:57:33.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.479+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=ZKD0WMK3APTN type=del size=1630730 2024-09-14T10:57:33.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.483+0000 7fdf8f02c8c0 -1 < failed to complete operation key=OFY1G5R28CK6 tag=CRLMWQG1AGOF type=del size=1440977: (22) Invalid argument 2024-09-14T10:57:33.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.487+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=NWZ43OEN9Z9M type=del size=1178798 2024-09-14T10:57:33.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.491+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=RIJDV3C6BAXL type=del 2024-09-14T10:57:33.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.499+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~YFX7YOWUQ76W.0 size=1048576 2024-09-14T10:57:33.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.499+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~YFX7YOWUQ76W.1 size=1048576 2024-09-14T10:57:33.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.503+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~YFX7YOWUQ76W.2 size=158990 2024-09-14T10:57:33.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.503+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=YFX7YOWUQ76W tag=LZU8RQNQW9RL type=write size=3304718 2024-09-14T10:57:33.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.507+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~6KZVQPW8UFNN.0 size=1048576 2024-09-14T10:57:33.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.507+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_Y32RWGISRBMT.2~6KZVQPW8UFNN.1 size=897234 2024-09-14T10:57:33.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.515+0000 7fdf8f02c8c0 1 < canceled multipart upload key=Y32RWGISRBMT upload=6KZVQPW8UFNN tag=DRF1M5DO35BY type=write size=2994386 2024-09-14T10:57:33.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.515+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=0EQ232R32WGO type=del size=2586573 2024-09-14T10:57:33.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.523+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~1KXDTIRIKYLX.0 size=1048576 2024-09-14T10:57:33.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.523+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~1KXDTIRIKYLX.1 size=949583 2024-09-14T10:57:33.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.531+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=1KXDTIRIKYLX tag=9DJZL56NU05R type=write size=3046735 2024-09-14T10:57:33.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.535+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=R4B3M58IMV97 type=write size=915362 2024-09-14T10:57:33.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.539+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=TYTS78U72QLZ type=del 2024-09-14T10:57:33.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.539+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=NTVHI41KX61P type=del size=2922096 2024-09-14T10:57:33.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.547+0000 7fdf8f02c8c0 1 < suggested remove operation key=X1BN3054IKNS tag=0II594JVCBAG type=del 2024-09-14T10:57:33.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.555+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~LEBFWXISDDAL.0 size=1048576 2024-09-14T10:57:33.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.555+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~LEBFWXISDDAL.1 size=369803 2024-09-14T10:57:33.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.555+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=LEBFWXISDDAL tag=ZZBRS6AIWDIN type=write size=2466955 2024-09-14T10:57:33.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.559+0000 7fdf8f02c8c0 1 < canceled operation key=XUT55FR490EO tag=AV544JGYTSDX type=write size=178838 2024-09-14T10:57:33.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.563+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=YZ92E3SERTAJ type=del size=1064996 2024-09-14T10:57:33.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.567+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~T1HDD6KH6GV2.0 size=1048576 2024-09-14T10:57:33.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.571+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~T1HDD6KH6GV2.1 size=1048576 2024-09-14T10:57:33.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.571+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~T1HDD6KH6GV2.2 size=621966 2024-09-14T10:57:33.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.579+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=T1HDD6KH6GV2 tag=YG8L4P4YBTBX type=write size=3767694 2024-09-14T10:57:33.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.583+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=GT7TASENUUSJ type=del size=1257689 2024-09-14T10:57:33.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.583+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~A6T8B6I899LG.0 size=1048576 2024-09-14T10:57:33.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.587+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~A6T8B6I899LG.1 size=175250 2024-09-14T10:57:33.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.591+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=A6T8B6I899LG tag=MGJTB5CUX22H type=write size=2272402 2024-09-14T10:57:33.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.595+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=BM4B0CVR81AD type=write size=669163 2024-09-14T10:57:33.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.607+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=FB6N894RVXEK type=write size=544862 2024-09-14T10:57:33.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.607+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=KK0MC2RRYZ66 type=del size=461360 2024-09-14T10:57:33.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.615+0000 7fdf8f02c8c0 1 < suggested update operation key=82N2FPU7LKTG tag=KG4B2ZG2L4BW type=del size=2274423 2024-09-14T10:57:33.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.623+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~2GXMD3O67FNS.0 size=1048576 2024-09-14T10:57:33.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.623+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~2GXMD3O67FNS.1 size=497132 2024-09-14T10:57:33.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.623+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=2GXMD3O67FNS tag=0EA4A0Y0921S type=write size=2594284 2024-09-14T10:57:33.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.631+0000 7fdf8f02c8c0 1 < suggested remove operation key=KVZEUYUSV5JI tag=KKJFG5T0Y8O8 type=del 2024-09-14T10:57:33.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.635+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=OTI1Y7959Y74 type=write size=491540 2024-09-14T10:57:33.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.639+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~BUW34YGSHO3V.0 size=1048576 2024-09-14T10:57:33.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.643+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~BUW34YGSHO3V.1 size=477151 2024-09-14T10:57:33.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.647+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=BUW34YGSHO3V tag=58PKMF3YPUEH type=write size=2574303 2024-09-14T10:57:33.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.651+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=9UTKZR1VZ61D type=del size=2057871 2024-09-14T10:57:33.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.655+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~FU80TE8U3FZP.0 size=1048576 2024-09-14T10:57:33.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.655+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~FU80TE8U3FZP.1 size=1048576 2024-09-14T10:57:33.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.659+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~FU80TE8U3FZP.2 size=259853 2024-09-14T10:57:33.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.663+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=FU80TE8U3FZP tag=T32EVF099BB5 type=write size=3405581 2024-09-14T10:57:33.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~JTRILTT2SAF1.0 size=906940 2024-09-14T10:57:33.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.671+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=JTRILTT2SAF1 tag=0J6PLRMGI0C1 type=write size=1955516 2024-09-14T10:57:33.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.675+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~T341QJP33NFO.0 size=1048576 2024-09-14T10:57:33.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.675+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~T341QJP33NFO.1 size=1048576 2024-09-14T10:57:33.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.679+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~T341QJP33NFO.2 size=777764 2024-09-14T10:57:33.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.687+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=T341QJP33NFO tag=H74NSUCE73YV type=write size=3923492 2024-09-14T10:57:33.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.691+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=M8V1OK41QASD type=del size=1446805 2024-09-14T10:57:33.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.695+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=ZKD0WMK3APTN type=del size=1630730 2024-09-14T10:57:33.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.703+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~Q0FKIY95SWKL.0 size=1048576 2024-09-14T10:57:33.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~Q0FKIY95SWKL.1 size=1048576 2024-09-14T10:57:33.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~Q0FKIY95SWKL.2 size=445844 2024-09-14T10:57:33.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.707+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=Q0FKIY95SWKL tag=V8HPUZNL86RN type=write size=3591572 2024-09-14T10:57:33.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.711+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=NWZ43OEN9Z9M type=del 2024-09-14T10:57:33.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.715+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=4EHBVKH9Q7AN type=del size=4097507 2024-09-14T10:57:33.713 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.715+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_1E72V12EPEH3.2~YFX7YOWUQ76W.0 size=1048576 2024-09-14T10:57:33.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.719+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~YFX7YOWUQ76W.1 size=1048576 2024-09-14T10:57:33.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~YFX7YOWUQ76W.2 size=158990 2024-09-14T10:57:33.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.727+0000 7fdf8f02c8c0 1 < canceled multipart upload key=1E72V12EPEH3 upload=YFX7YOWUQ76W tag=LZU8RQNQW9RL type=write size=3304718 2024-09-14T10:57:33.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.735+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~I7ZOHM2TGOSO.0 size=1048576 2024-09-14T10:57:33.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.735+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~I7ZOHM2TGOSO.1 size=1048576 2024-09-14T10:57:33.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.739+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~I7ZOHM2TGOSO.2 size=715041 2024-09-14T10:57:33.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.739+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=I7ZOHM2TGOSO tag=3G1MBJLN19C9 type=write size=3860769 2024-09-14T10:57:33.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.747+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=0EQ232R32WGO type=del 2024-09-14T10:57:33.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.751+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=49EVC3V5VMEX type=del size=1962599 2024-09-14T10:57:33.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.755+0000 7fdf8f02c8c0 1 < completed write operation key=3T0H42SC1ETB tag=R4B3M58IMV97 type=write size=915362 2024-09-14T10:57:33.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.759+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=N0JHV9Y63YBD type=write size=218508 2024-09-14T10:57:33.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.763+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=NTVHI41KX61P type=del 2024-09-14T10:57:33.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.767+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~6NAG736EVKCZ.0 size=1048576 2024-09-14T10:57:33.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.771+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~6NAG736EVKCZ.1 size=1048576 2024-09-14T10:57:33.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~6NAG736EVKCZ.2 size=710082 2024-09-14T10:57:33.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.775+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=6NAG736EVKCZ tag=63VBCR88GNBQ type=write size=3855810 2024-09-14T10:57:33.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.775+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~LEBFWXISDDAL.0 size=1048576 2024-09-14T10:57:33.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.779+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~LEBFWXISDDAL.1 size=369803 2024-09-14T10:57:33.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.783+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=LEBFWXISDDAL tag=ZZBRS6AIWDIN type=write size=2466955 2024-09-14T10:57:33.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.791+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~14QXFY9XYUC4.0 size=1048576 2024-09-14T10:57:33.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~14QXFY9XYUC4.1 size=377993 2024-09-14T10:57:33.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.795+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=14QXFY9XYUC4 tag=O94M5P5O4CHM type=write size=2475145 2024-09-14T10:57:33.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.799+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=YZ92E3SERTAJ type=del 2024-09-14T10:57:33.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.803+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=M0ER435IAW2Q type=write size=614782 2024-09-14T10:57:33.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.807+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=GT7TASENUUSJ type=del 2024-09-14T10:57:33.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.811+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=LOGABL0J0RAT type=del size=4107177 2024-09-14T10:57:33.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.811+0000 7fdf8f02c8c0 1 < completed write operation key=K3KJ7HDQF6ZH tag=BM4B0CVR81AD type=write size=669163 2024-09-14T10:57:33.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.819+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~XIC37M3TKHLS.0 size=336618 2024-09-14T10:57:33.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.819+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=XIC37M3TKHLS tag=S3TNTN5H1A9Y type=write size=1385194 2024-09-14T10:57:33.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.823+0000 7fdf8f02c8c0 -1 < failed to complete operation key=82N2FPU7LKTG tag=KK0MC2RRYZ66 type=del size=461360: (22) Invalid argument 2024-09-14T10:57:33.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~AR3W5H2SZG6L.0 size=1048576 2024-09-14T10:57:33.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~AR3W5H2SZG6L.1 size=331097 2024-09-14T10:57:33.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.831+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=AR3W5H2SZG6L tag=0QF30PG0QH6H type=write size=2428249 2024-09-14T10:57:33.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.835+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~2GXMD3O67FNS.0 size=1048576 2024-09-14T10:57:33.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.839+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~2GXMD3O67FNS.1 size=497132 2024-09-14T10:57:33.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.843+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=2GXMD3O67FNS tag=0EA4A0Y0921S type=write size=2594284 2024-09-14T10:57:33.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.851+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~PPV9YHZ2W5QT.0 size=534037 2024-09-14T10:57:33.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.851+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=PPV9YHZ2W5QT tag=WNK21PKQ0PMH type=write size=1582613 2024-09-14T10:57:33.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.855+0000 7fdf8f02c8c0 -1 < failed to complete operation key=9IDBODZBQRJR tag=OTI1Y7959Y74 type=write size=491540: (22) Invalid argument 2024-09-14T10:57:33.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.859+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=V0ZQ5WHOGI4P type=write size=102988 2024-09-14T10:57:33.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.863+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=9UTKZR1VZ61D type=del 2024-09-14T10:57:33.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.867+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=7HIB2Z3XUSRM type=write size=7575 2024-09-14T10:57:33.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~JTRILTT2SAF1.0 size=906940 2024-09-14T10:57:33.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.875+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=JTRILTT2SAF1 tag=0J6PLRMGI0C1 type=write size=1955516 2024-09-14T10:57:33.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.883+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~33VAEDJOW10K.0 size=837185 2024-09-14T10:57:33.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.883+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=33VAEDJOW10K tag=4H6S7J216B46 type=write size=1885761 2024-09-14T10:57:33.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.887+0000 7fdf8f02c8c0 -1 < failed to complete operation key=5VZCCFRUAQJ7 tag=M8V1OK41QASD type=del size=1446805: (22) Invalid argument 2024-09-14T10:57:33.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.891+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=R2OBWDYIKJC5 type=del size=2941432 2024-09-14T10:57:33.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.895+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~Q0FKIY95SWKL.0 size=1048576 2024-09-14T10:57:33.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~Q0FKIY95SWKL.1 size=1048576 2024-09-14T10:57:33.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~Q0FKIY95SWKL.2 size=445844 2024-09-14T10:57:33.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.907+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=Q0FKIY95SWKL tag=V8HPUZNL86RN type=write size=3591572 2024-09-14T10:57:33.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.915+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~XUGJT9RDTCYS.0 size=1048576 2024-09-14T10:57:33.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.915+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~XUGJT9RDTCYS.1 size=439379 2024-09-14T10:57:33.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.915+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=XUGJT9RDTCYS tag=ACXJQX8LTYDX type=write size=2536531 2024-09-14T10:57:33.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.923+0000 7fdf8f02c8c0 1 < suggested remove operation key=STB3W5URFJEZ tag=4EHBVKH9Q7AN type=del 2024-09-14T10:57:33.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.927+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=HOFJCOW4XWGH type=del size=2325502 2024-09-14T10:57:33.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.935+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~I7ZOHM2TGOSO.0 size=1048576 2024-09-14T10:57:33.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.939+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~I7ZOHM2TGOSO.1 size=1048576 2024-09-14T10:57:33.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.939+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~I7ZOHM2TGOSO.2 size=715041 2024-09-14T10:57:33.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.947+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=I7ZOHM2TGOSO tag=3G1MBJLN19C9 type=write size=3860769 2024-09-14T10:57:33.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~TPD20F4ZBUX1.0 size=1048576 2024-09-14T10:57:33.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.955+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~TPD20F4ZBUX1.1 size=1048576 2024-09-14T10:57:33.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.959+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~TPD20F4ZBUX1.2 size=694841 2024-09-14T10:57:33.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.959+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=TPD20F4ZBUX1 tag=JJV39TNIEC0T type=write size=3840569 2024-09-14T10:57:33.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.963+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=49EVC3V5VMEX type=del 2024-09-14T10:57:33.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.967+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=L736XB9FSURS type=del size=3412273 2024-09-14T10:57:33.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.971+0000 7fdf8f02c8c0 1 < completed write operation key=WA7HE8ZJ1W1M tag=N0JHV9Y63YBD type=write size=218508 2024-09-14T10:57:33.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.975+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=TWV7EHY8RVJX type=write size=669117 2024-09-14T10:57:33.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.979+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~6NAG736EVKCZ.0 size=1048576 2024-09-14T10:57:33.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.979+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~6NAG736EVKCZ.1 size=1048576 2024-09-14T10:57:33.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.983+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~6NAG736EVKCZ.2 size=710082 2024-09-14T10:57:33.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.991+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=6NAG736EVKCZ tag=63VBCR88GNBQ type=write size=3855810 2024-09-14T10:57:33.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.995+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~PFCA9OMY5RB3.0 size=1048576 2024-09-14T10:57:33.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.999+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~PFCA9OMY5RB3.1 size=1048576 2024-09-14T10:57:33.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.999+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~PFCA9OMY5RB3.2 size=588039 2024-09-14T10:57:33.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:33.999+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=PFCA9OMY5RB3 tag=MO9B0QW6MILK type=write size=3733767 2024-09-14T10:57:34.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.003+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~14QXFY9XYUC4.0 size=1048576 2024-09-14T10:57:34.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.007+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~14QXFY9XYUC4.1 size=377993 2024-09-14T10:57:34.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.015+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=14QXFY9XYUC4 tag=O94M5P5O4CHM type=write size=2475145 2024-09-14T10:57:34.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.019+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=IMG0DI36IBTQ type=write size=47403 2024-09-14T10:57:34.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.023+0000 7fdf8f02c8c0 1 < completed write operation key=1E72V12EPEH3 tag=M0ER435IAW2Q type=write size=614782 2024-09-14T10:57:34.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.027+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=491XN8ZDH8YS type=del size=2311696 2024-09-14T10:57:34.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.035+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=LOGABL0J0RAT type=del size=4107177 2024-09-14T10:57:34.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.039+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=UANAYDJ8A4ZQ type=write size=370994 2024-09-14T10:57:34.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.043+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~XIC37M3TKHLS.0 size=336618 2024-09-14T10:57:34.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.047+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=XIC37M3TKHLS tag=S3TNTN5H1A9Y type=write size=1385194 2024-09-14T10:57:34.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.051+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=KD4QPKCU3H6W type=del size=3670109 2024-09-14T10:57:34.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.055+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~AR3W5H2SZG6L.0 size=1048576 2024-09-14T10:57:34.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.059+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~AR3W5H2SZG6L.1 size=331097 2024-09-14T10:57:34.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.063+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=AR3W5H2SZG6L tag=0QF30PG0QH6H type=write size=2428249 2024-09-14T10:57:34.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.071+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~6UIGQ7A6B417.0 size=1048576 2024-09-14T10:57:34.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~6UIGQ7A6B417.1 size=1048576 2024-09-14T10:57:34.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.079+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~6UIGQ7A6B417.2 size=732434 2024-09-14T10:57:34.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.079+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=6UIGQ7A6B417 tag=5IW37CHF6T3S type=write size=3878162 2024-09-14T10:57:34.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.083+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~PPV9YHZ2W5QT.0 size=534037 2024-09-14T10:57:34.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.087+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=PPV9YHZ2W5QT tag=WNK21PKQ0PMH type=write size=1582613 2024-09-14T10:57:34.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.091+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=QYYC01CQLGMH type=del size=4151513 2024-09-14T10:57:34.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.095+0000 7fdf8f02c8c0 1 < canceled operation key=X0RT8UF3D0JC tag=V0ZQ5WHOGI4P type=write size=102988 2024-09-14T10:57:34.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.099+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=R2EKUK4XHDLU type=write size=834307 2024-09-14T10:57:34.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.103+0000 7fdf8f02c8c0 1 < completed write operation key=YU9DAJA242Q7 tag=7HIB2Z3XUSRM type=write size=7575 2024-09-14T10:57:34.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.107+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=7QE3NIXXBZKN type=del size=1232512 2024-09-14T10:57:34.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.111+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~33VAEDJOW10K.0 size=837185 2024-09-14T10:57:34.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.119+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=33VAEDJOW10K tag=4H6S7J216B46 type=write size=1885761 2024-09-14T10:57:34.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.123+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=7E2XHVECUTPM type=write size=938762 2024-09-14T10:57:34.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.127+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=R2OBWDYIKJC5 type=del 2024-09-14T10:57:34.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.131+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=G5Y3XRLYRMJD type=del size=409494 2024-09-14T10:57:34.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.135+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~XUGJT9RDTCYS.0 size=1048576 2024-09-14T10:57:34.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.135+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~XUGJT9RDTCYS.1 size=439379 2024-09-14T10:57:34.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.143+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=XUGJT9RDTCYS tag=ACXJQX8LTYDX type=write size=2536531 2024-09-14T10:57:34.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.147+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=B7F67CG547RE type=del size=582850 2024-09-14T10:57:34.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.151+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=HOFJCOW4XWGH type=del 2024-09-14T10:57:34.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.159+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~JG4XRQXXIJJF.0 size=1048576 2024-09-14T10:57:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.159+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~JG4XRQXXIJJF.1 size=717178 2024-09-14T10:57:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.159+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=JG4XRQXXIJJF tag=4RFHOZYOBP8L type=write size=2814330 2024-09-14T10:57:34.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~TPD20F4ZBUX1.0 size=1048576 2024-09-14T10:57:34.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.167+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~TPD20F4ZBUX1.1 size=1048576 2024-09-14T10:57:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~TPD20F4ZBUX1.2 size=694841 2024-09-14T10:57:34.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.175+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=TPD20F4ZBUX1 tag=JJV39TNIEC0T type=write size=3840569 2024-09-14T10:57:34.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.183+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~J93SZ4Y9AUB5.0 size=1048576 2024-09-14T10:57:34.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.187+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~J93SZ4Y9AUB5.1 size=785159 2024-09-14T10:57:34.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.187+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=J93SZ4Y9AUB5 tag=KT5UK28LZNQY type=write size=2882311 2024-09-14T10:57:34.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.195+0000 7fdf8f02c8c0 1 < suggested update operation key=LFLY0V3FRRW5 tag=L736XB9FSURS type=del size=3412273 2024-09-14T10:57:34.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.199+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~0DH8GLQLH7WY.0 size=1048576 2024-09-14T10:57:34.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~0DH8GLQLH7WY.1 size=1048576 2024-09-14T10:57:34.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~0DH8GLQLH7WY.2 size=292123 2024-09-14T10:57:34.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.207+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=0DH8GLQLH7WY tag=UZDAAHYQ9EAR type=write size=3437851 2024-09-14T10:57:34.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.211+0000 7fdf8f02c8c0 1 < completed write operation key=ZSBCGOXXJ0D5 tag=TWV7EHY8RVJX type=write size=669117 2024-09-14T10:57:34.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~A7P30Q9I7GHJ.0 size=976327 2024-09-14T10:57:34.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.219+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=A7P30Q9I7GHJ tag=QUD3JVERDGUB type=write size=2024903 2024-09-14T10:57:34.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.223+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~PFCA9OMY5RB3.0 size=1048576 2024-09-14T10:57:34.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.223+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~PFCA9OMY5RB3.1 size=1048576 2024-09-14T10:57:34.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.227+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~PFCA9OMY5RB3.2 size=588039 2024-09-14T10:57:34.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.235+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=PFCA9OMY5RB3 tag=MO9B0QW6MILK type=write size=3733767 2024-09-14T10:57:34.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.239+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=O2UZ47R206BZ type=del size=1464305 2024-09-14T10:57:34.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.247+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=IMG0DI36IBTQ type=write size=47403 2024-09-14T10:57:34.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.255+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~GD2C2262DPZV.0 size=1048576 2024-09-14T10:57:34.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~GD2C2262DPZV.1 size=1048576 2024-09-14T10:57:34.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~GD2C2262DPZV.2 size=701758 2024-09-14T10:57:34.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.259+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=GD2C2262DPZV tag=DXCITKVSPY1N type=write size=3847486 2024-09-14T10:57:34.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.271+0000 7fdf8f02c8c0 1 < suggested update operation key=OFY1G5R28CK6 tag=491XN8ZDH8YS type=del size=2311696 2024-09-14T10:57:34.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.275+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=IF83HNLETSFI type=write size=900098 2024-09-14T10:57:34.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.279+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=UANAYDJ8A4ZQ type=write size=370994 2024-09-14T10:57:34.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.283+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=PJRCO1PKGE3X type=del size=2736306 2024-09-14T10:57:34.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.291+0000 7fdf8f02c8c0 1 < suggested remove operation key=XUT55FR490EO tag=KD4QPKCU3H6W type=del 2024-09-14T10:57:34.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.295+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=4YZ2IYPOUU4Y type=write size=882275 2024-09-14T10:57:34.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.299+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~6UIGQ7A6B417.0 size=1048576 2024-09-14T10:57:34.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.303+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~6UIGQ7A6B417.1 size=1048576 2024-09-14T10:57:34.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.307+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~6UIGQ7A6B417.2 size=732434 2024-09-14T10:57:34.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.311+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=6UIGQ7A6B417 tag=5IW37CHF6T3S type=write size=3878162 2024-09-14T10:57:34.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.315+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=T4YLFZWGNST7 type=del size=3088670 2024-09-14T10:57:34.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.319+0000 7fdf8f02c8c0 -1 < failed to complete operation key=XUT55FR490EO tag=QYYC01CQLGMH type=del size=4151513: (22) Invalid argument 2024-09-14T10:57:34.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.323+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=XX093Y592WPM type=del size=324900 2024-09-14T10:57:34.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.327+0000 7fdf8f02c8c0 1 < completed write operation key=LMNGCUFR187I tag=R2EKUK4XHDLU type=write size=834307 2024-09-14T10:57:34.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.331+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=VQ54YW83NXYS type=write size=86285 2024-09-14T10:57:34.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.335+0000 7fdf8f02c8c0 1 < canceled operation key=0QJLAH0EPKVD tag=7QE3NIXXBZKN type=del size=1232512 2024-09-14T10:57:34.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.339+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=4JPLGS4704JK type=del size=3812579 2024-09-14T10:57:34.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.343+0000 7fdf8f02c8c0 -1 < failed to complete operation key=XUT55FR490EO tag=7E2XHVECUTPM type=write size=938762: (22) Invalid argument 2024-09-14T10:57:34.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.347+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=VT5CW3DEF6YZ type=del size=3178938 2024-09-14T10:57:34.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.351+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=G5Y3XRLYRMJD type=del 2024-09-14T10:57:34.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.355+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~MIMLDGWQ050B.0 size=1048576 2024-09-14T10:57:34.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.359+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~MIMLDGWQ050B.1 size=1048576 2024-09-14T10:57:34.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.363+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~MIMLDGWQ050B.2 size=132388 2024-09-14T10:57:34.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.363+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=MIMLDGWQ050B tag=1BDWJC2OMNQ0 type=write size=3278116 2024-09-14T10:57:34.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.367+0000 7fdf8f02c8c0 1 < canceled operation key=9IDBODZBQRJR tag=B7F67CG547RE type=del size=582850 2024-09-14T10:57:34.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.371+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~F92IPKGJQLSG.0 size=1048576 2024-09-14T10:57:34.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.375+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~F92IPKGJQLSG.1 size=1048576 2024-09-14T10:57:34.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.379+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~F92IPKGJQLSG.2 size=520043 2024-09-14T10:57:34.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.379+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=F92IPKGJQLSG tag=ALPXZTHP15ZY type=write size=3665771 2024-09-14T10:57:34.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.383+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~JG4XRQXXIJJF.0 size=1048576 2024-09-14T10:57:34.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.383+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~JG4XRQXXIJJF.1 size=717178 2024-09-14T10:57:34.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.391+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=JG4XRQXXIJJF tag=4RFHOZYOBP8L type=write size=2814330 2024-09-14T10:57:34.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.395+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=RL6ZT3ZCZOKL type=del size=2182852 2024-09-14T10:57:34.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.399+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~J93SZ4Y9AUB5.0 size=1048576 2024-09-14T10:57:34.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.399+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_304ZNF4OC1ML.2~J93SZ4Y9AUB5.1 size=785159 2024-09-14T10:57:34.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.403+0000 7fdf8f02c8c0 1 < canceled multipart upload key=304ZNF4OC1ML upload=J93SZ4Y9AUB5 tag=KT5UK28LZNQY type=write size=2882311 2024-09-14T10:57:34.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.407+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=AVWNU6YIJUB1 type=del size=3390624 2024-09-14T10:57:34.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.407+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LFLY0V3FRRW5.2~0DH8GLQLH7WY.0 size=1048576 2024-09-14T10:57:34.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.411+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~0DH8GLQLH7WY.1 size=1048576 2024-09-14T10:57:34.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.415+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~0DH8GLQLH7WY.2 size=292123 2024-09-14T10:57:34.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.419+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LFLY0V3FRRW5 upload=0DH8GLQLH7WY tag=UZDAAHYQ9EAR type=write size=3437851 2024-09-14T10:57:34.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.427+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~Y75PJ6315ROO.0 size=1048576 2024-09-14T10:57:34.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.431+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~Y75PJ6315ROO.1 size=183830 2024-09-14T10:57:34.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.431+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=Y75PJ6315ROO tag=Z5IX0V620FH9 type=write size=2280982 2024-09-14T10:57:34.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.435+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~A7P30Q9I7GHJ.0 size=976327 2024-09-14T10:57:34.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.439+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=A7P30Q9I7GHJ tag=QUD3JVERDGUB type=write size=2024903 2024-09-14T10:57:34.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.443+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=9Y3O2C16T4KR type=del size=877423 2024-09-14T10:57:34.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.447+0000 7fdf8f02c8c0 1 < canceled operation key=3CYCJJIQ210M tag=O2UZ47R206BZ type=del size=1464305 2024-09-14T10:57:34.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.451+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=69ND2EKBFZTC type=del size=4017890 2024-09-14T10:57:34.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.451+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~GD2C2262DPZV.0 size=1048576 2024-09-14T10:57:34.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.455+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_X1BN3054IKNS.2~GD2C2262DPZV.1 size=1048576 2024-09-14T10:57:34.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~GD2C2262DPZV.2 size=701758 2024-09-14T10:57:34.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.463+0000 7fdf8f02c8c0 1 < canceled multipart upload key=X1BN3054IKNS upload=GD2C2262DPZV tag=DXCITKVSPY1N type=write size=3847486 2024-09-14T10:57:34.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.467+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~FMDBNZEID2VX.0 size=258688 2024-09-14T10:57:34.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.467+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=FMDBNZEID2VX tag=DRSI1J5RVB6C type=write size=1307264 2024-09-14T10:57:34.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.475+0000 7fdf8f02c8c0 1 < suggested update operation key=APDKRWHOUH9T tag=IF83HNLETSFI type=write size=900098 2024-09-14T10:57:34.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.479+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=43KA0HG4LA6Z type=del size=2621205 2024-09-14T10:57:34.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.483+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=PJRCO1PKGE3X type=del 2024-09-14T10:57:34.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.487+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=BRQ6V87GTC2P type=del size=1687449 2024-09-14T10:57:34.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.491+0000 7fdf8f02c8c0 1 < completed write operation key=5VZCCFRUAQJ7 tag=4YZ2IYPOUU4Y type=write size=882275 2024-09-14T10:57:34.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.495+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=EJ6XYMREQPRR type=del size=610515 2024-09-14T10:57:34.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.499+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=T4YLFZWGNST7 type=del 2024-09-14T10:57:34.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.503+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=0JE8D7Z0O1Q2 type=del size=1632257 2024-09-14T10:57:34.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.503+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=XX093Y592WPM type=del 2024-09-14T10:57:34.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.507+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=2LO88CHZ11HX type=del size=1137847 2024-09-14T10:57:34.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.511+0000 7fdf8f02c8c0 1 < completed write operation key=X1BN3054IKNS tag=VQ54YW83NXYS type=write size=86285 2024-09-14T10:57:34.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.515+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=EU2K431C6C29 type=del size=3115106 2024-09-14T10:57:34.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.523+0000 7fdf8f02c8c0 1 < suggested update operation key=49O8DPTGA65S tag=4JPLGS4704JK type=del size=3812579 2024-09-14T10:57:34.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.531+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~8FKO4CLH7XAH.0 size=1048576 2024-09-14T10:57:34.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.535+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~8FKO4CLH7XAH.1 size=1048576 2024-09-14T10:57:34.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.535+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~8FKO4CLH7XAH.2 size=1034279 2024-09-14T10:57:34.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.535+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=8FKO4CLH7XAH tag=3BRZ637141CX type=write size=4180007 2024-09-14T10:57:34.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.539+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=VT5CW3DEF6YZ type=del 2024-09-14T10:57:34.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.543+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=A4QPU8PURFIF type=del size=1232466 2024-09-14T10:57:34.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~MIMLDGWQ050B.0 size=1048576 2024-09-14T10:57:34.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.551+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~MIMLDGWQ050B.1 size=1048576 2024-09-14T10:57:34.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.555+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~MIMLDGWQ050B.2 size=132388 2024-09-14T10:57:34.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.559+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=MIMLDGWQ050B tag=1BDWJC2OMNQ0 type=write size=3278116 2024-09-14T10:57:34.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.563+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=807C5HCQM5T6 type=write size=819903 2024-09-14T10:57:34.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.567+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_MNBXQTJBS1QS.2~F92IPKGJQLSG.0 size=1048576 2024-09-14T10:57:34.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.567+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~F92IPKGJQLSG.1 size=1048576 2024-09-14T10:57:34.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.571+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~F92IPKGJQLSG.2 size=520043 2024-09-14T10:57:34.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.579+0000 7fdf8f02c8c0 1 < canceled multipart upload key=MNBXQTJBS1QS upload=F92IPKGJQLSG tag=ALPXZTHP15ZY type=write size=3665771 2024-09-14T10:57:34.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.587+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~2WBJP5OXCNLM.0 size=660398 2024-09-14T10:57:34.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.587+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=2WBJP5OXCNLM tag=4TNBEXSR0NIW type=write size=1708974 2024-09-14T10:57:34.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.591+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=RL6ZT3ZCZOKL type=del 2024-09-14T10:57:34.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.595+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=T9Q8K5THMR8P type=del size=223623 2024-09-14T10:57:34.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.599+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=AVWNU6YIJUB1 type=del 2024-09-14T10:57:34.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.603+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=PEF1WCSV5FUS type=del size=3348507 2024-09-14T10:57:34.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.607+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~Y75PJ6315ROO.0 size=1048576 2024-09-14T10:57:34.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.611+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~Y75PJ6315ROO.1 size=183830 2024-09-14T10:57:34.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.619+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=Y75PJ6315ROO tag=Z5IX0V620FH9 type=write size=2280982 2024-09-14T10:57:34.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.623+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=GDM267K6PGLQ type=del size=523272 2024-09-14T10:57:34.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.627+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=9Y3O2C16T4KR type=del 2024-09-14T10:57:34.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.631+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=EFXTP64ECDJX type=del size=30738 2024-09-14T10:57:34.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.639+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=69ND2EKBFZTC type=del 2024-09-14T10:57:34.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.643+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=PZ33DPBXPCKT type=write size=113813 2024-09-14T10:57:34.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.647+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~FMDBNZEID2VX.0 size=258688 2024-09-14T10:57:34.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.655+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=FMDBNZEID2VX tag=DRSI1J5RVB6C type=write size=1307264 2024-09-14T10:57:34.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.659+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=94W3PB1FN7G4 type=del size=1884557 2024-09-14T10:57:34.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.663+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=43KA0HG4LA6Z type=del 2024-09-14T10:57:34.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.667+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=6KC6IQUNCGDJ type=write size=551201 2024-09-14T10:57:34.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.671+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=BRQ6V87GTC2P type=del 2024-09-14T10:57:34.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.675+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=CIIHVL7ZOIL3 type=del size=112029 2024-09-14T10:57:34.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.679+0000 7fdf8f02c8c0 1 < canceled operation key=YU9DAJA242Q7 tag=EJ6XYMREQPRR type=del size=610515 2024-09-14T10:57:34.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.683+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=0SBQRCTWSEDG type=del size=4084980 2024-09-14T10:57:34.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.687+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=0JE8D7Z0O1Q2 type=del 2024-09-14T10:57:34.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.695+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~ILD89OYBII03.0 size=1048576 2024-09-14T10:57:34.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.699+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~ILD89OYBII03.1 size=1048576 2024-09-14T10:57:34.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.699+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~ILD89OYBII03.2 size=601827 2024-09-14T10:57:34.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.699+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=ILD89OYBII03 tag=SE5NW7P9O4GN type=write size=3747555 2024-09-14T10:57:34.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.707+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=2LO88CHZ11HX type=del 2024-09-14T10:57:34.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.711+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=5YUTK76DL3Y9 type=del size=4056011 2024-09-14T10:57:34.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.715+0000 7fdf8f02c8c0 -1 < failed to complete operation key=49O8DPTGA65S tag=EU2K431C6C29 type=del size=3115106: (22) Invalid argument 2024-09-14T10:57:34.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.719+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~059BUXQJBXRI.0 size=1048576 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.723+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~059BUXQJBXRI.1 size=1048576 2024-09-14T10:57:34.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.727+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~059BUXQJBXRI.2 size=846355 2024-09-14T10:57:34.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.727+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=059BUXQJBXRI tag=RT7FANJOIW9O type=write size=3992083 2024-09-14T10:57:34.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.731+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~8FKO4CLH7XAH.0 size=1048576 2024-09-14T10:57:34.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.735+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~8FKO4CLH7XAH.1 size=1048576 2024-09-14T10:57:34.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.735+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~8FKO4CLH7XAH.2 size=1034279 2024-09-14T10:57:34.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.743+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=8FKO4CLH7XAH tag=3BRZ637141CX type=write size=4180007 2024-09-14T10:57:34.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.751+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~B7Y6I32YAJVR.0 size=1048576 2024-09-14T10:57:34.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.751+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~B7Y6I32YAJVR.1 size=339016 2024-09-14T10:57:34.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.751+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=B7Y6I32YAJVR tag=XV3B7N2UOFFI type=write size=2436168 2024-09-14T10:57:34.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.755+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=A4QPU8PURFIF type=del 2024-09-14T10:57:34.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.759+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=QI42AYN4XKIE type=del size=2439472 2024-09-14T10:57:34.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.767+0000 7fdf8f02c8c0 1 < suggested update operation key=0QJLAH0EPKVD tag=807C5HCQM5T6 type=write size=819903 2024-09-14T10:57:34.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.771+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=W3Z4DR33UCP1 type=del size=1503280 2024-09-14T10:57:34.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.771+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LCEH2YXNSOGT.2~2WBJP5OXCNLM.0 size=660398 2024-09-14T10:57:34.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.775+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LCEH2YXNSOGT upload=2WBJP5OXCNLM tag=4TNBEXSR0NIW type=write size=1708974 2024-09-14T10:57:34.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.783+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=ZQR5FVGFFFZ8 type=del size=105652 2024-09-14T10:57:34.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.783+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=T9Q8K5THMR8P type=del 2024-09-14T10:57:34.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.787+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=OBHDDUZ4ONJ9 type=del size=1128768 2024-09-14T10:57:34.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.795+0000 7fdf8f02c8c0 1 < suggested remove operation key=MNBXQTJBS1QS tag=PEF1WCSV5FUS type=del 2024-09-14T10:57:34.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.799+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=OXUBD1S0VLRC type=del size=4185732 2024-09-14T10:57:34.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.803+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=GDM267K6PGLQ type=del 2024-09-14T10:57:34.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.807+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=DP0O625MI1HY type=del size=3155569 2024-09-14T10:57:34.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.811+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=EFXTP64ECDJX type=del 2024-09-14T10:57:34.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.815+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=VXHYG14BXNLR type=del size=2513189 2024-09-14T10:57:34.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.819+0000 7fdf8f02c8c0 1 < completed write operation key=LCEH2YXNSOGT tag=PZ33DPBXPCKT type=write size=113813 2024-09-14T10:57:34.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.823+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=N3WTXYSVZHSW type=del size=2519989 2024-09-14T10:57:34.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.827+0000 7fdf8f02c8c0 1 < suggested update operation key=TZZ05IIMZJ4J tag=94W3PB1FN7G4 type=del size=1884557 2024-09-14T10:57:34.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.831+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=T1GER06YJ4TT type=del size=1748165 2024-09-14T10:57:34.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.835+0000 7fdf8f02c8c0 1 < completed write operation key=APDKRWHOUH9T tag=6KC6IQUNCGDJ type=write size=551201 2024-09-14T10:57:34.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.839+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=C70DUDNY2UJQ type=del size=449597 2024-09-14T10:57:34.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.843+0000 7fdf8f02c8c0 1 < canceled operation key=Y32RWGISRBMT tag=CIIHVL7ZOIL3 type=del size=112029 2024-09-14T10:57:34.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.847+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=8Y4PS35NFEOF type=del size=1449569 2024-09-14T10:57:34.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.855+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZSBCGOXXJ0D5 tag=0SBQRCTWSEDG type=del 2024-09-14T10:57:34.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.859+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~0I2AEJUDKSVU.0 size=1048576 2024-09-14T10:57:34.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.867+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~0I2AEJUDKSVU.1 size=431952 2024-09-14T10:57:34.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.867+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=0I2AEJUDKSVU tag=B51UNPSTSU1L type=write size=2529104 2024-09-14T10:57:34.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~ILD89OYBII03.0 size=1048576 2024-09-14T10:57:34.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.875+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~ILD89OYBII03.1 size=1048576 2024-09-14T10:57:34.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.875+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_L1ERJ0JSRDMG.2~ILD89OYBII03.2 size=601827 2024-09-14T10:57:34.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.883+0000 7fdf8f02c8c0 1 < canceled multipart upload key=L1ERJ0JSRDMG upload=ILD89OYBII03 tag=SE5NW7P9O4GN type=write size=3747555 2024-09-14T10:57:34.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.887+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=YOODUDWKB1W2 type=del size=439129 2024-09-14T10:57:34.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.891+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=5YUTK76DL3Y9 type=del size=4056011 2024-09-14T10:57:34.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.895+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=Q4X8H9W698LJ type=del size=2396195 2024-09-14T10:57:34.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.899+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~059BUXQJBXRI.0 size=1048576 2024-09-14T10:57:34.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~059BUXQJBXRI.1 size=1048576 2024-09-14T10:57:34.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~059BUXQJBXRI.2 size=846355 2024-09-14T10:57:34.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.911+0000 7fdf8f02c8c0 1 < canceled multipart upload key=XUT55FR490EO upload=059BUXQJBXRI tag=RT7FANJOIW9O type=write size=3992083 2024-09-14T10:57:34.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.915+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~EHTPF7HGBZGM.0 size=1048576 2024-09-14T10:57:34.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.919+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~EHTPF7HGBZGM.1 size=978295 2024-09-14T10:57:34.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.919+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=EHTPF7HGBZGM tag=BUXSAJFZMH2U type=write size=3075447 2024-09-14T10:57:34.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.923+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~B7Y6I32YAJVR.0 size=1048576 2024-09-14T10:57:34.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.927+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~B7Y6I32YAJVR.1 size=339016 2024-09-14T10:57:34.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.931+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=B7Y6I32YAJVR tag=XV3B7N2UOFFI type=write size=2436168 2024-09-14T10:57:34.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.935+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=VP35HY38C4S2 type=del size=135876 2024-09-14T10:57:34.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.939+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=QI42AYN4XKIE type=del 2024-09-14T10:57:34.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.943+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=THJ6DYCMO9FU type=del size=3565692 2024-09-14T10:57:34.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.947+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=MNBXQTJBS1QS tag=W3Z4DR33UCP1 type=del size=1503280: (2) No such file or directory 2024-09-14T10:57:34.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.955+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~6NANNERSYM3I.0 size=482598 2024-09-14T10:57:34.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.955+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=6NANNERSYM3I tag=1WHHQL3SQK40 type=write size=1531174 2024-09-14T10:57:34.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.959+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=ZQR5FVGFFFZ8 type=del 2024-09-14T10:57:34.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.963+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=230GUE9EAJ46 type=write size=209257 2024-09-14T10:57:34.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.963+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=OBHDDUZ4ONJ9 type=del 2024-09-14T10:57:34.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.967+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=2Z05RF5TCPW7 type=del size=3497884 2024-09-14T10:57:34.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.971+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=OXUBD1S0VLRC type=del 2024-09-14T10:57:34.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.979+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~7KC2HVTPQ1RF.0 size=1048576 2024-09-14T10:57:34.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~7KC2HVTPQ1RF.1 size=55748 2024-09-14T10:57:34.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.983+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=7KC2HVTPQ1RF tag=J6Z3UQ4TLM8L type=write size=2152900 2024-09-14T10:57:34.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.987+0000 7fdf8f02c8c0 1 < canceled operation key=0QJLAH0EPKVD tag=DP0O625MI1HY type=del size=3155569 2024-09-14T10:57:34.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.991+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=BD41YKVB2RDC type=write size=979719 2024-09-14T10:57:34.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:34.999+0000 7fdf8f02c8c0 1 < suggested update operation key=6VNI8FMHZ0FN tag=VXHYG14BXNLR type=del size=2513189 2024-09-14T10:57:34.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.003+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=A4Q2AP05320R type=del size=3390753 2024-09-14T10:57:35.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.011+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=N3WTXYSVZHSW type=del 2024-09-14T10:57:35.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.015+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=Q4KDSAE1HV39 type=del size=563905 2024-09-14T10:57:35.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.023+0000 7fdf8f02c8c0 1 < suggested remove operation key=3T0H42SC1ETB tag=T1GER06YJ4TT type=del 2024-09-14T10:57:35.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.027+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=P1MMFSE3DF31 type=del size=2333459 2024-09-14T10:57:35.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.035+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=C70DUDNY2UJQ type=del size=449597 2024-09-14T10:57:35.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.039+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=020I1NGU3J60 type=del size=2538988 2024-09-14T10:57:35.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.047+0000 7fdf8f02c8c0 1 < suggested update operation key=Y32RWGISRBMT tag=8Y4PS35NFEOF type=del size=1449569 2024-09-14T10:57:35.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.055+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~KZZFF0E5WKQM.0 size=230918 2024-09-14T10:57:35.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.055+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=KZZFF0E5WKQM tag=KZAZE544X38A type=write size=1279494 2024-09-14T10:57:35.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.055+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~0I2AEJUDKSVU.0 size=1048576 2024-09-14T10:57:35.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.055+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~0I2AEJUDKSVU.1 size=431952 2024-09-14T10:57:35.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.059+0000 7fdf8f02c8c0 1 < canceled multipart upload key=OFY1G5R28CK6 upload=0I2AEJUDKSVU tag=B51UNPSTSU1L type=write size=2529104 2024-09-14T10:57:35.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.063+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=MUN5J80Q3C3O type=del size=3611372 2024-09-14T10:57:35.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.067+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=YOODUDWKB1W2 type=del 2024-09-14T10:57:35.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~J04S79T8FQDM.0 size=1048576 2024-09-14T10:57:35.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.079+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~J04S79T8FQDM.1 size=526861 2024-09-14T10:57:35.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.079+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=J04S79T8FQDM tag=2C09MBSDY2FO type=write size=2624013 2024-09-14T10:57:35.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.083+0000 7fdf8f02c8c0 1 < suggested update operation key=82N2FPU7LKTG tag=Q4X8H9W698LJ type=del size=2396195 2024-09-14T10:57:35.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.087+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=WGREQ3FBOBZQ type=del size=134140 2024-09-14T10:57:35.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.095+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~EHTPF7HGBZGM.0 size=1048576 2024-09-14T10:57:35.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.095+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~EHTPF7HGBZGM.1 size=978295 2024-09-14T10:57:35.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.103+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=EHTPF7HGBZGM tag=BUXSAJFZMH2U type=write size=3075447 2024-09-14T10:57:35.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.107+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=FDCAGR2QRRKS type=del size=2558903 2024-09-14T10:57:35.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.111+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=VP35HY38C4S2 type=del 2024-09-14T10:57:35.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.115+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~WTD58KUUZN5X.0 size=1048576 2024-09-14T10:57:35.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.119+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~WTD58KUUZN5X.1 size=229019 2024-09-14T10:57:35.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.119+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=WTD58KUUZN5X tag=TOY8SP277D8N type=write size=2326171 2024-09-14T10:57:35.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.123+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=THJ6DYCMO9FU type=del 2024-09-14T10:57:35.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.127+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=7TLGYFBFK0O3 type=del size=387650 2024-09-14T10:57:35.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.131+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~6NANNERSYM3I.0 size=482598 2024-09-14T10:57:35.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.139+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=6NANNERSYM3I tag=1WHHQL3SQK40 type=write size=1531174 2024-09-14T10:57:35.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.143+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=WOPMY9BBJBUP type=del size=3713941 2024-09-14T10:57:35.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.147+0000 7fdf8f02c8c0 1 < canceled operation key=3QSOKUSZ57QM tag=230GUE9EAJ46 type=write size=209257 2024-09-14T10:57:35.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.151+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=X9O13WGWH3YS type=write size=394771 2024-09-14T10:57:35.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.155+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=2Z05RF5TCPW7 type=del 2024-09-14T10:57:35.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.163+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~P79K5T9RLXL2.0 size=1048576 2024-09-14T10:57:35.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.167+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~P79K5T9RLXL2.1 size=712904 2024-09-14T10:57:35.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.167+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=P79K5T9RLXL2 tag=I1J5HXL58TGC type=write size=2810056 2024-09-14T10:57:35.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~7KC2HVTPQ1RF.0 size=1048576 2024-09-14T10:57:35.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.171+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_WA7HE8ZJ1W1M.2~7KC2HVTPQ1RF.1 size=55748 2024-09-14T10:57:35.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.175+0000 7fdf8f02c8c0 1 < canceled multipart upload key=WA7HE8ZJ1W1M upload=7KC2HVTPQ1RF tag=J6Z3UQ4TLM8L type=write size=2152900 2024-09-14T10:57:35.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.183+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~AIV5A55BZT3A.0 size=1048576 2024-09-14T10:57:35.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.183+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~AIV5A55BZT3A.1 size=1048576 2024-09-14T10:57:35.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.187+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~AIV5A55BZT3A.2 size=820893 2024-09-14T10:57:35.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.187+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=AIV5A55BZT3A tag=ZA4W8Y4216PG type=write size=3966621 2024-09-14T10:57:35.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.191+0000 7fdf8f02c8c0 -1 < failed to complete operation key=Y32RWGISRBMT tag=BD41YKVB2RDC type=write size=979719: (22) Invalid argument 2024-09-14T10:57:35.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.199+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~AAP0FVBV6HRO.0 size=1048576 2024-09-14T10:57:35.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~AAP0FVBV6HRO.1 size=1048576 2024-09-14T10:57:35.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~AAP0FVBV6HRO.2 size=799374 2024-09-14T10:57:35.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.203+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=AAP0FVBV6HRO tag=021IJ21Q1SXW type=write size=3945102 2024-09-14T10:57:35.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.207+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=A4Q2AP05320R type=del 2024-09-14T10:57:35.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.211+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=E3E7148954Z6 type=del size=713935 2024-09-14T10:57:35.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.215+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=3T0H42SC1ETB tag=Q4KDSAE1HV39 type=del size=563905: (2) No such file or directory 2024-09-14T10:57:35.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~KG1HRZMBR2UA.0 size=1048576 2024-09-14T10:57:35.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.223+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~KG1HRZMBR2UA.1 size=1048576 2024-09-14T10:57:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.227+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~KG1HRZMBR2UA.2 size=247611 2024-09-14T10:57:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.227+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=KG1HRZMBR2UA tag=9E7TWUWZWQ73 type=write size=3393339 2024-09-14T10:57:35.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.231+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=P1MMFSE3DF31 type=del 2024-09-14T10:57:35.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.235+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=F9LFN06IO8YY type=del size=742197 2024-09-14T10:57:35.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.239+0000 7fdf8f02c8c0 1 < suggested remove operation key=X0RT8UF3D0JC tag=020I1NGU3J60 type=del 2024-09-14T10:57:35.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.247+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~XINPQRM5EF1F.0 size=1048576 2024-09-14T10:57:35.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.251+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~XINPQRM5EF1F.1 size=1048576 2024-09-14T10:57:35.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.251+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~XINPQRM5EF1F.2 size=598889 2024-09-14T10:57:35.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.251+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=XINPQRM5EF1F tag=PJCK7MB2966H type=write size=3744617 2024-09-14T10:57:35.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.255+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~KZZFF0E5WKQM.0 size=230918 2024-09-14T10:57:35.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.263+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=KZZFF0E5WKQM tag=KZAZE544X38A type=write size=1279494 2024-09-14T10:57:35.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.267+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=9SLVXVCWJXU8 type=del size=3082832 2024-09-14T10:57:35.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.271+0000 7fdf8f02c8c0 1 < canceled operation key=STHEUJ6VDPQB tag=MUN5J80Q3C3O type=del size=3611372 2024-09-14T10:57:35.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.275+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=Z9HD8C8FV6V2 type=del size=2860066 2024-09-14T10:57:35.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~J04S79T8FQDM.0 size=1048576 2024-09-14T10:57:35.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~J04S79T8FQDM.1 size=526861 2024-09-14T10:57:35.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.287+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=J04S79T8FQDM tag=2C09MBSDY2FO type=write size=2624013 2024-09-14T10:57:35.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.291+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=XIIYE0EPNVKS type=del size=3251317 2024-09-14T10:57:35.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.295+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=WGREQ3FBOBZQ type=del 2024-09-14T10:57:35.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.295+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=FX7CYVEUYWF5 type=del size=1336092 2024-09-14T10:57:35.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.299+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=FDCAGR2QRRKS type=del 2024-09-14T10:57:35.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.303+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=URM2WA0K1ATY type=write size=329054 2024-09-14T10:57:35.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.307+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~WTD58KUUZN5X.0 size=1048576 2024-09-14T10:57:35.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.311+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~WTD58KUUZN5X.1 size=229019 2024-09-14T10:57:35.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.319+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=WTD58KUUZN5X tag=TOY8SP277D8N type=write size=2326171 2024-09-14T10:57:35.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.323+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~7ZA1V44YNC3G.0 size=1048576 2024-09-14T10:57:35.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.327+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~7ZA1V44YNC3G.1 size=856820 2024-09-14T10:57:35.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.327+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=7ZA1V44YNC3G tag=5LC0UJCHBQRJ type=write size=2953972 2024-09-14T10:57:35.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.331+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=7TLGYFBFK0O3 type=del 2024-09-14T10:57:35.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.339+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~JTZCYG5LB2IF.0 size=19645 2024-09-14T10:57:35.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.339+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=JTZCYG5LB2IF tag=NF6XCPPG5LZL type=write size=1068221 2024-09-14T10:57:35.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.347+0000 7fdf8f02c8c0 1 < suggested update operation key=OFY1G5R28CK6 tag=WOPMY9BBJBUP type=del size=3713941 2024-09-14T10:57:35.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.351+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=F4YHLP38KSWM type=del size=2014643 2024-09-14T10:57:35.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.359+0000 7fdf8f02c8c0 1 < suggested update operation key=L1ERJ0JSRDMG tag=X9O13WGWH3YS type=write size=394771 2024-09-14T10:57:35.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.363+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=MB5Y2B246BT5 type=write size=791672 2024-09-14T10:57:35.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.367+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~P79K5T9RLXL2.0 size=1048576 2024-09-14T10:57:35.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.371+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~P79K5T9RLXL2.1 size=712904 2024-09-14T10:57:35.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.379+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=P79K5T9RLXL2 tag=I1J5HXL58TGC type=write size=2810056 2024-09-14T10:57:35.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.383+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=T81WGK5N7CAF type=write size=664849 2024-09-14T10:57:35.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.387+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~AIV5A55BZT3A.0 size=1048576 2024-09-14T10:57:35.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.387+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~AIV5A55BZT3A.1 size=1048576 2024-09-14T10:57:35.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.391+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~AIV5A55BZT3A.2 size=820893 2024-09-14T10:57:35.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.399+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=AIV5A55BZT3A tag=ZA4W8Y4216PG type=write size=3966621 2024-09-14T10:57:35.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~VUUWH8TJHUCB.0 size=1048576 2024-09-14T10:57:35.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~VUUWH8TJHUCB.1 size=799652 2024-09-14T10:57:35.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.407+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=VUUWH8TJHUCB tag=4QLUVF40U833 type=write size=2896804 2024-09-14T10:57:35.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.411+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~AAP0FVBV6HRO.0 size=1048576 2024-09-14T10:57:35.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.411+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LMNGCUFR187I.2~AAP0FVBV6HRO.1 size=1048576 2024-09-14T10:57:35.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.415+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~AAP0FVBV6HRO.2 size=799374 2024-09-14T10:57:35.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.419+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LMNGCUFR187I upload=AAP0FVBV6HRO tag=021IJ21Q1SXW type=write size=3945102 2024-09-14T10:57:35.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.423+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=KAJIENHJ4PXD type=del size=2638217 2024-09-14T10:57:35.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.431+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=E3E7148954Z6 type=del 2024-09-14T10:57:35.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.435+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~H23N79B9AOYF.0 size=272711 2024-09-14T10:57:35.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.435+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=H23N79B9AOYF tag=QSXI2X5NN5YY type=write size=1321287 2024-09-14T10:57:35.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.439+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~KG1HRZMBR2UA.0 size=1048576 2024-09-14T10:57:35.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~KG1HRZMBR2UA.1 size=1048576 2024-09-14T10:57:35.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.447+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~KG1HRZMBR2UA.2 size=247611 2024-09-14T10:57:35.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.451+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=KG1HRZMBR2UA tag=9E7TWUWZWQ73 type=write size=3393339 2024-09-14T10:57:35.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.455+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=NZV0P8KYLWL1 type=del size=2599183 2024-09-14T10:57:35.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.459+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=F9LFN06IO8YY type=del 2024-09-14T10:57:35.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.463+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=D0H4R5LGLVW8 type=del size=1964533 2024-09-14T10:57:35.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.467+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~XINPQRM5EF1F.0 size=1048576 2024-09-14T10:57:35.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.471+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~XINPQRM5EF1F.1 size=1048576 2024-09-14T10:57:35.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.471+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~XINPQRM5EF1F.2 size=598889 2024-09-14T10:57:35.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.479+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=XINPQRM5EF1F tag=PJCK7MB2966H type=write size=3744617 2024-09-14T10:57:35.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.483+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=SR8CMYAZYNO9 type=del size=1928321 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.487+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=9SLVXVCWJXU8 type=del 2024-09-14T10:57:35.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.491+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=PL3TIEY4Q3PG type=write size=365299 2024-09-14T10:57:35.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.495+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=Z9HD8C8FV6V2 type=del 2024-09-14T10:57:35.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.499+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=D1W4FA4600MY type=del size=774493 2024-09-14T10:57:35.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.503+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=XIIYE0EPNVKS type=del 2024-09-14T10:57:35.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.511+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~UTW0CFBJ6P6T.0 size=1048576 2024-09-14T10:57:35.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~UTW0CFBJ6P6T.1 size=1048576 2024-09-14T10:57:35.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~UTW0CFBJ6P6T.2 size=949311 2024-09-14T10:57:35.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.515+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=UTW0CFBJ6P6T tag=2A1Z1CDJVTBG type=write size=4095039 2024-09-14T10:57:35.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.527+0000 7fdf8f02c8c0 1 < suggested update operation key=3QSOKUSZ57QM tag=FX7CYVEUYWF5 type=del size=1336092 2024-09-14T10:57:35.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.531+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=260DSJD8C5JQ type=del size=2334735 2024-09-14T10:57:35.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.539+0000 7fdf8f02c8c0 1 < suggested remove operation key=49O8DPTGA65S tag=URM2WA0K1ATY type=write 2024-09-14T10:57:35.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.543+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=VOI1SEVRK2CJ type=del size=2531387 2024-09-14T10:57:35.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~7ZA1V44YNC3G.0 size=1048576 2024-09-14T10:57:35.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~7ZA1V44YNC3G.1 size=856820 2024-09-14T10:57:35.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.555+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=7ZA1V44YNC3G tag=5LC0UJCHBQRJ type=write size=2953972 2024-09-14T10:57:35.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.559+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~4EBPJ1J31XV6.0 size=905794 2024-09-14T10:57:35.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.559+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=4EBPJ1J31XV6 tag=9NMLENE505P3 type=write size=1954370 2024-09-14T10:57:35.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.563+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3T0H42SC1ETB.2~JTZCYG5LB2IF.0 size=19645 2024-09-14T10:57:35.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.567+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3T0H42SC1ETB upload=JTZCYG5LB2IF tag=NF6XCPPG5LZL type=write size=1068221 2024-09-14T10:57:35.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.571+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=Y8CEMUYQ24OC type=del size=1424493 2024-09-14T10:57:35.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.575+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=F4YHLP38KSWM type=del 2024-09-14T10:57:35.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.579+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=KYH1O4GOQ0SF type=del size=2458956 2024-09-14T10:57:35.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.583+0000 7fdf8f02c8c0 1 < canceled operation key=XUT55FR490EO tag=MB5Y2B246BT5 type=write size=791672 2024-09-14T10:57:35.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.587+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=0GZUFGEW6DAJ type=del size=334847 2024-09-14T10:57:35.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.595+0000 7fdf8f02c8c0 1 < suggested update operation key=ZF6IDD8B3CFO tag=T81WGK5N7CAF type=write size=664849 2024-09-14T10:57:35.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.599+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=HDE3Y0WWH971 type=write size=71649 2024-09-14T10:57:35.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.603+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~VUUWH8TJHUCB.0 size=1048576 2024-09-14T10:57:35.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.603+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LFLY0V3FRRW5.2~VUUWH8TJHUCB.1 size=799652 2024-09-14T10:57:35.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.611+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LFLY0V3FRRW5 upload=VUUWH8TJHUCB tag=4QLUVF40U833 type=write size=2896804 2024-09-14T10:57:35.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.611+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=S4X5KAG9BPIU type=write size=909066 2024-09-14T10:57:35.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.615+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=KAJIENHJ4PXD type=del 2024-09-14T10:57:35.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.619+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=DUVQNWAX5GVL type=del size=3325378 2024-09-14T10:57:35.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.623+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_TZZ05IIMZJ4J.2~H23N79B9AOYF.0 size=272711 2024-09-14T10:57:35.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.627+0000 7fdf8f02c8c0 1 < canceled multipart upload key=TZZ05IIMZJ4J upload=H23N79B9AOYF tag=QSXI2X5NN5YY type=write size=1321287 2024-09-14T10:57:35.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.635+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~9HO6H4WM7P4E.0 size=707989 2024-09-14T10:57:35.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.635+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=9HO6H4WM7P4E tag=4Z4P7CMLHAGT type=write size=1756565 2024-09-14T10:57:35.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.639+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=NZV0P8KYLWL1 type=del 2024-09-14T10:57:35.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.643+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~8APKHZEGE1UU.0 size=1048576 2024-09-14T10:57:35.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~8APKHZEGE1UU.1 size=1048576 2024-09-14T10:57:35.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~8APKHZEGE1UU.2 size=560464 2024-09-14T10:57:35.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.651+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=8APKHZEGE1UU tag=MRYW0P1R0CWX type=write size=3706192 2024-09-14T10:57:35.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.655+0000 7fdf8f02c8c0 1 < canceled operation key=OFY1G5R28CK6 tag=D0H4R5LGLVW8 type=del size=1964533 2024-09-14T10:57:35.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.659+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~NX0969O9AR0G.0 size=474296 2024-09-14T10:57:35.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.659+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=NX0969O9AR0G tag=25RHDAEJ0NR8 type=write size=1522872 2024-09-14T10:57:35.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.663+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=SR8CMYAZYNO9 type=del 2024-09-14T10:57:35.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~LH63QQZHXGH8.0 size=1048576 2024-09-14T10:57:35.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.675+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~LH63QQZHXGH8.1 size=24409 2024-09-14T10:57:35.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.675+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=LH63QQZHXGH8 tag=BO2QUHS5L27G type=write size=2121561 2024-09-14T10:57:35.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.679+0000 7fdf8f02c8c0 1 < completed write operation key=82N2FPU7LKTG tag=PL3TIEY4Q3PG type=write size=365299 2024-09-14T10:57:35.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.683+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=S53TMGUBIC5P type=write size=457811 2024-09-14T10:57:35.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.687+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=D1W4FA4600MY type=del 2024-09-14T10:57:35.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.691+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=QRKRM0H4ZD5Q type=write size=41625 2024-09-14T10:57:35.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.695+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~UTW0CFBJ6P6T.0 size=1048576 2024-09-14T10:57:35.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.695+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~UTW0CFBJ6P6T.1 size=1048576 2024-09-14T10:57:35.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.699+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~UTW0CFBJ6P6T.2 size=949311 2024-09-14T10:57:35.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.703+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=UTW0CFBJ6P6T tag=2A1Z1CDJVTBG type=write size=4095039 2024-09-14T10:57:35.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.711+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~SNADNYR27PV9.0 size=1033533 2024-09-14T10:57:35.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.711+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=SNADNYR27PV9 tag=2DY4R1XJHW8N type=write size=2082109 2024-09-14T10:57:35.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.715+0000 7fdf8f02c8c0 -1 < failed to complete operation key=49O8DPTGA65S tag=260DSJD8C5JQ type=del size=2334735: (22) Invalid argument 2024-09-14T10:57:35.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.723+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=B3IC7H2RGVLP type=del size=2052136 2024-09-14T10:57:35.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.727+0000 7fdf8f02c8c0 1 < canceled operation key=X0RT8UF3D0JC tag=VOI1SEVRK2CJ type=del size=2531387 2024-09-14T10:57:35.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.731+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=U3WKWTOE7ZXG type=del size=1511308 2024-09-14T10:57:35.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.731+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~4EBPJ1J31XV6.0 size=905794 2024-09-14T10:57:35.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.739+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=4EBPJ1J31XV6 tag=9NMLENE505P3 type=write size=1954370 2024-09-14T10:57:35.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.743+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=T3TUPT68T9LB type=del size=3712359 2024-09-14T10:57:35.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.747+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=Y8CEMUYQ24OC type=del 2024-09-14T10:57:35.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.751+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=E4F5HYWX70OV type=del size=330835 2024-09-14T10:57:35.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.755+0000 7fdf8f02c8c0 1 < canceled operation key=APDKRWHOUH9T tag=KYH1O4GOQ0SF type=del size=2458956 2024-09-14T10:57:35.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.759+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=HOLTRAC6F85J type=del size=906590 2024-09-14T10:57:35.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.763+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=0GZUFGEW6DAJ type=del 2024-09-14T10:57:35.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.767+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=3VWAA0KKFO9Y type=write size=714636 2024-09-14T10:57:35.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.771+0000 7fdf8f02c8c0 1 < canceled operation key=ZF6IDD8B3CFO tag=HDE3Y0WWH971 type=write size=71649 2024-09-14T10:57:35.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.775+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=ERMV2STIAL5Y type=write size=944807 2024-09-14T10:57:35.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.779+0000 7fdf8f02c8c0 1 < completed write operation key=ZF6IDD8B3CFO tag=S4X5KAG9BPIU type=write size=909066 2024-09-14T10:57:35.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.779+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=ZQP3FISKK0MY type=del size=3169447 2024-09-14T10:57:35.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.787+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=DUVQNWAX5GVL type=del 2024-09-14T10:57:35.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.791+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~YFEMHY6AXDJE.0 size=95890 2024-09-14T10:57:35.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.791+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=YFEMHY6AXDJE tag=R2M0FNYZZ20O type=write size=1144466 2024-09-14T10:57:35.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.795+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_1E72V12EPEH3.2~9HO6H4WM7P4E.0 size=707989 2024-09-14T10:57:35.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.799+0000 7fdf8f02c8c0 1 < canceled multipart upload key=1E72V12EPEH3 upload=9HO6H4WM7P4E tag=4Z4P7CMLHAGT type=write size=1756565 2024-09-14T10:57:35.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.807+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=F1EE7WW1N2QZ type=del size=2272029 2024-09-14T10:57:35.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~8APKHZEGE1UU.0 size=1048576 2024-09-14T10:57:35.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~8APKHZEGE1UU.1 size=1048576 2024-09-14T10:57:35.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~8APKHZEGE1UU.2 size=560464 2024-09-14T10:57:35.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.823+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=8APKHZEGE1UU tag=MRYW0P1R0CWX type=write size=3706192 2024-09-14T10:57:35.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.827+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=57GHG7EBT3EA type=del size=1725909 2024-09-14T10:57:35.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.827+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~NX0969O9AR0G.0 size=474296 2024-09-14T10:57:35.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.835+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=NX0969O9AR0G tag=25RHDAEJ0NR8 type=write size=1522872 2024-09-14T10:57:35.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.843+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~814M9VC0GVF3.0 size=1048576 2024-09-14T10:57:35.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.843+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~814M9VC0GVF3.1 size=1048576 2024-09-14T10:57:35.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.847+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~814M9VC0GVF3.2 size=170918 2024-09-14T10:57:35.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.847+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=814M9VC0GVF3 tag=VMIA1K8XCDDN type=write size=3316646 2024-09-14T10:57:35.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.851+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~LH63QQZHXGH8.0 size=1048576 2024-09-14T10:57:35.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.855+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~LH63QQZHXGH8.1 size=24409 2024-09-14T10:57:35.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.859+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=LH63QQZHXGH8 tag=BO2QUHS5L27G type=write size=2121561 2024-09-14T10:57:35.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.863+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=W9OE525FROY0 type=del size=664329 2024-09-14T10:57:35.864 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.867+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=S53TMGUBIC5P type=write size=457811 2024-09-14T10:57:35.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.871+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=573W60FZ6E85 type=write size=775877 2024-09-14T10:57:35.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.875+0000 7fdf8f02c8c0 1 < completed write operation key=ZF6IDD8B3CFO tag=QRKRM0H4ZD5Q type=write size=41625 2024-09-14T10:57:35.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.879+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=WSDQNXIEPO11 type=del size=2823473 2024-09-14T10:57:35.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.883+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~SNADNYR27PV9.0 size=1033533 2024-09-14T10:57:35.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.887+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=SNADNYR27PV9 tag=2DY4R1XJHW8N type=write size=2082109 2024-09-14T10:57:35.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~DPADMLK5A83T.0 size=1048576 2024-09-14T10:57:35.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~DPADMLK5A83T.1 size=162412 2024-09-14T10:57:35.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.895+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=DPADMLK5A83T tag=H7IYRYVD3P18 type=write size=2259564 2024-09-14T10:57:35.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.899+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=B3IC7H2RGVLP type=del 2024-09-14T10:57:35.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.903+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=HHEDID5Q7M4F type=del size=1698271 2024-09-14T10:57:35.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.907+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=U3WKWTOE7ZXG type=del 2024-09-14T10:57:35.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.915+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~8VMVI14EPEPC.0 size=51214 2024-09-14T10:57:35.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.915+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=8VMVI14EPEPC tag=VWNP8L1HE661 type=write size=1099790 2024-09-14T10:57:35.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.919+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=T3TUPT68T9LB type=del 2024-09-14T10:57:35.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.927+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~R1OCW8JBEQZJ.0 size=882053 2024-09-14T10:57:35.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.927+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=R1OCW8JBEQZJ tag=7Z3FTHAN2E0X type=write size=1930629 2024-09-14T10:57:35.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.935+0000 7fdf8f02c8c0 1 < suggested update operation key=MNBXQTJBS1QS tag=E4F5HYWX70OV type=del size=330835 2024-09-14T10:57:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.943+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~AGX33Z0NRJ0V.0 size=1048576 2024-09-14T10:57:35.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.947+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~AGX33Z0NRJ0V.1 size=1048576 2024-09-14T10:57:35.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~AGX33Z0NRJ0V.2 size=985975 2024-09-14T10:57:35.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.951+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=AGX33Z0NRJ0V tag=XHJWW3FEQSSR type=write size=4131703 2024-09-14T10:57:35.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.955+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=HOLTRAC6F85J type=del 2024-09-14T10:57:35.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.959+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=YWDQYT0U4PBK type=del size=78057 2024-09-14T10:57:35.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.967+0000 7fdf8f02c8c0 1 < suggested update operation key=LCEH2YXNSOGT tag=3VWAA0KKFO9Y type=write size=714636 2024-09-14T10:57:35.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.971+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=4C9DOUHBR3R6 type=del size=1197515 2024-09-14T10:57:35.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.979+0000 7fdf8f02c8c0 1 < suggested update operation key=ZSBCGOXXJ0D5 tag=ERMV2STIAL5Y type=write size=944807 2024-09-14T10:57:35.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~CL2J9LG8E100.0 size=1048576 2024-09-14T10:57:35.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~CL2J9LG8E100.1 size=626425 2024-09-14T10:57:35.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.987+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=CL2J9LG8E100 tag=XY8B90AMOQ1L type=write size=2723577 2024-09-14T10:57:35.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.995+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=ZQP3FISKK0MY type=del 2024-09-14T10:57:35.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.995+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=R7FYU9IU3NC6 type=write size=501452 2024-09-14T10:57:35.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:35.999+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~YFEMHY6AXDJE.0 size=95890 2024-09-14T10:57:36.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.007+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=YFEMHY6AXDJE tag=R2M0FNYZZ20O type=write size=1144466 2024-09-14T10:57:36.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.011+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=QRAVJCC7AD12 type=del size=2801469 2024-09-14T10:57:36.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.015+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=F1EE7WW1N2QZ type=del 2024-09-14T10:57:36.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.019+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=REK82CRYQXFK type=del size=3459245 2024-09-14T10:57:36.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.023+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=57GHG7EBT3EA type=del 2024-09-14T10:57:36.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.027+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=4J5ZH8UIWTFF type=del size=2355463 2024-09-14T10:57:36.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.031+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~814M9VC0GVF3.0 size=1048576 2024-09-14T10:57:36.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.035+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~814M9VC0GVF3.1 size=1048576 2024-09-14T10:57:36.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.035+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~814M9VC0GVF3.2 size=170918 2024-09-14T10:57:36.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.043+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=814M9VC0GVF3 tag=VMIA1K8XCDDN type=write size=3316646 2024-09-14T10:57:36.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.047+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=FVFWPPFV0NK1 type=write size=345670 2024-09-14T10:57:36.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.051+0000 7fdf8f02c8c0 -1 < failed to complete operation key=MNBXQTJBS1QS tag=W9OE525FROY0 type=del size=664329: (22) Invalid argument 2024-09-14T10:57:36.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.055+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=GCRH1M9J3XK8 type=del size=3187429 2024-09-14T10:57:36.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.059+0000 7fdf8f02c8c0 1 < completed write operation key=X0RT8UF3D0JC tag=573W60FZ6E85 type=write size=775877 2024-09-14T10:57:36.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~99HV2H4V00A0.0 size=1048576 2024-09-14T10:57:36.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.067+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~99HV2H4V00A0.1 size=1048576 2024-09-14T10:57:36.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.071+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~99HV2H4V00A0.2 size=687253 2024-09-14T10:57:36.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.071+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=99HV2H4V00A0 tag=AGXY65AYJHKI type=write size=3832981 2024-09-14T10:57:36.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.079+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=WSDQNXIEPO11 type=del size=2823473 2024-09-14T10:57:36.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.087+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=T0ZUX3TLDX4U type=write size=221938 2024-09-14T10:57:36.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.091+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~DPADMLK5A83T.0 size=1048576 2024-09-14T10:57:36.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.091+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~DPADMLK5A83T.1 size=162412 2024-09-14T10:57:36.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.099+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=DPADMLK5A83T tag=H7IYRYVD3P18 type=write size=2259564 2024-09-14T10:57:36.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.103+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~KP4KNN8CFUS8.0 size=1048576 2024-09-14T10:57:36.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.107+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~KP4KNN8CFUS8.1 size=1048576 2024-09-14T10:57:36.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.111+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~KP4KNN8CFUS8.2 size=788550 2024-09-14T10:57:36.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.111+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=KP4KNN8CFUS8 tag=3U3S57C86QK9 type=write size=3934278 2024-09-14T10:57:36.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.115+0000 7fdf8f02c8c0 1 < suggested remove operation key=6VNI8FMHZ0FN tag=HHEDID5Q7M4F type=del 2024-09-14T10:57:36.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~OZHVZAMI0P1X.0 size=1048576 2024-09-14T10:57:36.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.127+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~OZHVZAMI0P1X.1 size=1048576 2024-09-14T10:57:36.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.127+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~OZHVZAMI0P1X.2 size=534751 2024-09-14T10:57:36.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.127+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=OZHVZAMI0P1X tag=LO1JDSU5CC6X type=write size=3680479 2024-09-14T10:57:36.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.131+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~8VMVI14EPEPC.0 size=51214 2024-09-14T10:57:36.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.143+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=8VMVI14EPEPC tag=VWNP8L1HE661 type=write size=1099790 2024-09-14T10:57:36.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.147+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~UPZ2Z9C83BP6.0 size=82272 2024-09-14T10:57:36.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.147+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=UPZ2Z9C83BP6 tag=PBVBKX75SA2Y type=write size=1130848 2024-09-14T10:57:36.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.151+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~R1OCW8JBEQZJ.0 size=882053 2024-09-14T10:57:36.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.155+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=R1OCW8JBEQZJ tag=7Z3FTHAN2E0X type=write size=1930629 2024-09-14T10:57:36.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.159+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=MM3A20ACIWEB type=del size=1059490 2024-09-14T10:57:36.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~AGX33Z0NRJ0V.0 size=1048576 2024-09-14T10:57:36.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.167+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~AGX33Z0NRJ0V.1 size=1048576 2024-09-14T10:57:36.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~AGX33Z0NRJ0V.2 size=985975 2024-09-14T10:57:36.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.175+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=AGX33Z0NRJ0V tag=XHJWW3FEQSSR type=write size=4131703 2024-09-14T10:57:36.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.179+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=CAY1BKX49P1J type=del size=3449086 2024-09-14T10:57:36.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.183+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=YWDQYT0U4PBK type=del 2024-09-14T10:57:36.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.191+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~U3K04O9KPZ9T.0 size=1048576 2024-09-14T10:57:36.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.191+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~U3K04O9KPZ9T.1 size=1048576 2024-09-14T10:57:36.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.195+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~U3K04O9KPZ9T.2 size=944604 2024-09-14T10:57:36.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.195+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=U3K04O9KPZ9T tag=NKL0XAAPCLN2 type=write size=4090332 2024-09-14T10:57:36.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.199+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=4C9DOUHBR3R6 type=del 2024-09-14T10:57:36.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~ATVM34JR3T0K.0 size=1048576 2024-09-14T10:57:36.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.211+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~ATVM34JR3T0K.1 size=598090 2024-09-14T10:57:36.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.211+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=ATVM34JR3T0K tag=3ODKUIZZ76Y1 type=write size=2695242 2024-09-14T10:57:36.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.211+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3QSOKUSZ57QM.2~CL2J9LG8E100.0 size=1048576 2024-09-14T10:57:36.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.215+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~CL2J9LG8E100.1 size=626425 2024-09-14T10:57:36.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.219+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3QSOKUSZ57QM upload=CL2J9LG8E100 tag=XY8B90AMOQ1L type=write size=2723577 2024-09-14T10:57:36.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.227+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~HO5M2D9WA1SU.0 size=1048576 2024-09-14T10:57:36.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.227+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~HO5M2D9WA1SU.1 size=1048576 2024-09-14T10:57:36.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.231+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~HO5M2D9WA1SU.2 size=1015309 2024-09-14T10:57:36.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.231+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=HO5M2D9WA1SU tag=RQ1E7SQLFHGD type=write size=4161037 2024-09-14T10:57:36.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.231+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=6VNI8FMHZ0FN tag=R7FYU9IU3NC6 type=write size=501452: (2) No such file or directory 2024-09-14T10:57:36.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.239+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~FN4P81P4QKOZ.0 size=1048576 2024-09-14T10:57:36.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.243+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~FN4P81P4QKOZ.1 size=139643 2024-09-14T10:57:36.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.243+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=FN4P81P4QKOZ tag=ICOTO1OK8RD5 type=write size=2236795 2024-09-14T10:57:36.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.247+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=QRAVJCC7AD12 type=del 2024-09-14T10:57:36.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.251+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=KK5A88UCZQGD type=del size=2935643 2024-09-14T10:57:36.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.255+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=REK82CRYQXFK type=del 2024-09-14T10:57:36.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.259+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=X232515C7EI3 type=del size=276679 2024-09-14T10:57:36.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.263+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=4J5ZH8UIWTFF type=del 2024-09-14T10:57:36.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.267+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~YF2B2HGVDT1Y.0 size=1048576 2024-09-14T10:57:36.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.271+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~YF2B2HGVDT1Y.1 size=1048576 2024-09-14T10:57:36.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.275+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~YF2B2HGVDT1Y.2 size=136166 2024-09-14T10:57:36.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.275+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=YF2B2HGVDT1Y tag=A4H32KEU6C4H type=write size=3281894 2024-09-14T10:57:36.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.283+0000 7fdf8f02c8c0 1 < suggested update operation key=0QJLAH0EPKVD tag=FVFWPPFV0NK1 type=write size=345670 2024-09-14T10:57:36.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.287+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~GPGPVVVGCUWM.0 size=77778 2024-09-14T10:57:36.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.287+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=GPGPVVVGCUWM tag=Z6F809Z1LFCD type=write size=1126354 2024-09-14T10:57:36.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.291+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=GCRH1M9J3XK8 type=del 2024-09-14T10:57:36.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.299+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~SHS1WKJN1ZM4.0 size=1048576 2024-09-14T10:57:36.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.303+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~SHS1WKJN1ZM4.1 size=169144 2024-09-14T10:57:36.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.303+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=SHS1WKJN1ZM4 tag=LJJEVLII9G1I type=write size=2266296 2024-09-14T10:57:36.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.307+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~99HV2H4V00A0.0 size=1048576 2024-09-14T10:57:36.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.311+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~99HV2H4V00A0.1 size=1048576 2024-09-14T10:57:36.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.315+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~99HV2H4V00A0.2 size=687253 2024-09-14T10:57:36.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.319+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=99HV2H4V00A0 tag=AGXY65AYJHKI type=write size=3832981 2024-09-14T10:57:36.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.327+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~JB5LCHFRW66P.0 size=1048576 2024-09-14T10:57:36.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.331+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~JB5LCHFRW66P.1 size=1048576 2024-09-14T10:57:36.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.335+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~JB5LCHFRW66P.2 size=755189 2024-09-14T10:57:36.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.335+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=JB5LCHFRW66P tag=ML0OVS4Z82CY type=write size=3900917 2024-09-14T10:57:36.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.339+0000 7fdf8f02c8c0 1 < completed write operation key=TZZ05IIMZJ4J tag=T0ZUX3TLDX4U type=write size=221938 2024-09-14T10:57:36.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.343+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~39XC8C6SNIWG.0 size=1048576 2024-09-14T10:57:36.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~39XC8C6SNIWG.1 size=371199 2024-09-14T10:57:36.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.347+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=39XC8C6SNIWG tag=47X8STHL3DPS type=write size=2468351 2024-09-14T10:57:36.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.351+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~KP4KNN8CFUS8.0 size=1048576 2024-09-14T10:57:36.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.355+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~KP4KNN8CFUS8.1 size=1048576 2024-09-14T10:57:36.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.355+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_KVZEUYUSV5JI.2~KP4KNN8CFUS8.2 size=788550 2024-09-14T10:57:36.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.359+0000 7fdf8f02c8c0 1 < canceled multipart upload key=KVZEUYUSV5JI upload=KP4KNN8CFUS8 tag=3U3S57C86QK9 type=write size=3934278 2024-09-14T10:57:36.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.363+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=4SK0NGX4UPRH type=del size=2124233 2024-09-14T10:57:36.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.367+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~OZHVZAMI0P1X.0 size=1048576 2024-09-14T10:57:36.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.371+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~OZHVZAMI0P1X.1 size=1048576 2024-09-14T10:57:36.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.371+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~OZHVZAMI0P1X.2 size=534751 2024-09-14T10:57:36.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.379+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=OZHVZAMI0P1X tag=LO1JDSU5CC6X type=write size=3680479 2024-09-14T10:57:36.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.387+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~S6USELE5XZE1.0 size=1017494 2024-09-14T10:57:36.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.387+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=S6USELE5XZE1 tag=SBOOCFO448E8 type=write size=2066070 2024-09-14T10:57:36.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.391+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~UPZ2Z9C83BP6.0 size=82272 2024-09-14T10:57:36.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.395+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=UPZ2Z9C83BP6 tag=PBVBKX75SA2Y type=write size=1130848 2024-09-14T10:57:36.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.399+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=D4ZVUSTOPJD0 type=write size=880625 2024-09-14T10:57:36.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.403+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=MM3A20ACIWEB type=del 2024-09-14T10:57:36.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~6SXHTVH238HG.0 size=256136 2024-09-14T10:57:36.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.411+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=6SXHTVH238HG tag=AV15H6YE0NZ5 type=write size=1304712 2024-09-14T10:57:36.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.415+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=CAY1BKX49P1J type=del 2024-09-14T10:57:36.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.423+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~AA4EPEI4QR8N.0 size=571248 2024-09-14T10:57:36.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.423+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=AA4EPEI4QR8N tag=JXZWAYOSCHJI type=write size=1619824 2024-09-14T10:57:36.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.427+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~U3K04O9KPZ9T.0 size=1048576 2024-09-14T10:57:36.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.431+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~U3K04O9KPZ9T.1 size=1048576 2024-09-14T10:57:36.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.435+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~U3K04O9KPZ9T.2 size=944604 2024-09-14T10:57:36.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.439+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=U3K04O9KPZ9T tag=NKL0XAAPCLN2 type=write size=4090332 2024-09-14T10:57:36.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.447+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~5MMGOOERYXTS.0 size=1048576 2024-09-14T10:57:36.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.451+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~5MMGOOERYXTS.1 size=159094 2024-09-14T10:57:36.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.451+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=5MMGOOERYXTS tag=Q2HYUZB9BWF2 type=write size=2256246 2024-09-14T10:57:36.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~ATVM34JR3T0K.0 size=1048576 2024-09-14T10:57:36.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.459+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~ATVM34JR3T0K.1 size=598090 2024-09-14T10:57:36.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.463+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=ATVM34JR3T0K tag=3ODKUIZZ76Y1 type=write size=2695242 2024-09-14T10:57:36.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.471+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~00DEPUB6HBTG.0 size=837290 2024-09-14T10:57:36.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.471+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=00DEPUB6HBTG tag=KSQTG5CBKGPY type=write size=1885866 2024-09-14T10:57:36.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.471+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_WA7HE8ZJ1W1M.2~HO5M2D9WA1SU.0 size=1048576 2024-09-14T10:57:36.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.475+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~HO5M2D9WA1SU.1 size=1048576 2024-09-14T10:57:36.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.479+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~HO5M2D9WA1SU.2 size=1015309 2024-09-14T10:57:36.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.483+0000 7fdf8f02c8c0 1 < canceled multipart upload key=WA7HE8ZJ1W1M upload=HO5M2D9WA1SU tag=RQ1E7SQLFHGD type=write size=4161037 2024-09-14T10:57:36.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.487+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~ZCCC2L49IG1F.0 size=683004 2024-09-14T10:57:36.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.487+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=ZCCC2L49IG1F tag=LWHFZT1HP9PG type=write size=1731580 2024-09-14T10:57:36.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.491+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_ZF6IDD8B3CFO.2~FN4P81P4QKOZ.0 size=1048576 2024-09-14T10:57:36.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.491+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~FN4P81P4QKOZ.1 size=139643 2024-09-14T10:57:36.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.499+0000 7fdf8f02c8c0 1 < canceled multipart upload key=ZF6IDD8B3CFO upload=FN4P81P4QKOZ tag=ICOTO1OK8RD5 type=write size=2236795 2024-09-14T10:57:36.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.503+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~LRFUCPOPOKH5.0 size=1048576 2024-09-14T10:57:36.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.507+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~LRFUCPOPOKH5.1 size=704480 2024-09-14T10:57:36.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.507+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=LRFUCPOPOKH5 tag=AVUI4JW6B17W type=write size=2801632 2024-09-14T10:57:36.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.511+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=KK5A88UCZQGD type=del 2024-09-14T10:57:36.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.519+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~7N2GD0BFD31A.0 size=1048576 2024-09-14T10:57:36.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~7N2GD0BFD31A.1 size=1048576 2024-09-14T10:57:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~7N2GD0BFD31A.2 size=818443 2024-09-14T10:57:36.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.523+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=7N2GD0BFD31A tag=4YGI2FTPCHWN type=write size=3964171 2024-09-14T10:57:36.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.527+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=X232515C7EI3 type=del 2024-09-14T10:57:36.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.531+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=FYA9ACMSRZNP type=del size=801837 2024-09-14T10:57:36.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.535+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~YF2B2HGVDT1Y.0 size=1048576 2024-09-14T10:57:36.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.535+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STHEUJ6VDPQB.2~YF2B2HGVDT1Y.1 size=1048576 2024-09-14T10:57:36.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.539+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~YF2B2HGVDT1Y.2 size=136166 2024-09-14T10:57:36.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.547+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STHEUJ6VDPQB upload=YF2B2HGVDT1Y tag=A4H32KEU6C4H type=write size=3281894 2024-09-14T10:57:36.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.551+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~XPKA3XWGHEEL.0 size=605869 2024-09-14T10:57:36.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.551+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=XPKA3XWGHEEL tag=B2Y5GSTNFZO3 type=write size=1654445 2024-09-14T10:57:36.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.555+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~GPGPVVVGCUWM.0 size=77778 2024-09-14T10:57:36.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.563+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=GPGPVVVGCUWM tag=Z6F809Z1LFCD type=write size=1126354 2024-09-14T10:57:36.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~MN1TQYRVVB4O.0 size=1048576 2024-09-14T10:57:36.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~MN1TQYRVVB4O.1 size=272815 2024-09-14T10:57:36.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.571+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=MN1TQYRVVB4O tag=OX5B7FYLWG5L type=write size=2369967 2024-09-14T10:57:36.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.575+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~SHS1WKJN1ZM4.0 size=1048576 2024-09-14T10:57:36.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.575+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~SHS1WKJN1ZM4.1 size=169144 2024-09-14T10:57:36.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.583+0000 7fdf8f02c8c0 1 < canceled multipart upload key=OFY1G5R28CK6 upload=SHS1WKJN1ZM4 tag=LJJEVLII9G1I type=write size=2266296 2024-09-14T10:57:36.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.587+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=RZ2LX32OOWJD type=del size=2997970 2024-09-14T10:57:36.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.591+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~JB5LCHFRW66P.0 size=1048576 2024-09-14T10:57:36.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.591+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~JB5LCHFRW66P.1 size=1048576 2024-09-14T10:57:36.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.595+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~JB5LCHFRW66P.2 size=755189 2024-09-14T10:57:36.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.599+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=JB5LCHFRW66P tag=ML0OVS4Z82CY type=write size=3900917 2024-09-14T10:57:36.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.603+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=DASHEFKDY2C0 type=del size=1235725 2024-09-14T10:57:36.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.607+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STB3W5URFJEZ.2~39XC8C6SNIWG.0 size=1048576 2024-09-14T10:57:36.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.607+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~39XC8C6SNIWG.1 size=371199 2024-09-14T10:57:36.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.615+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STB3W5URFJEZ upload=39XC8C6SNIWG tag=47X8STHL3DPS type=write size=2468351 2024-09-14T10:57:36.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.619+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=L59LQIJ6BJ80 type=write size=840092 2024-09-14T10:57:36.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.623+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=4SK0NGX4UPRH type=del 2024-09-14T10:57:36.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.627+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=NDAGLNEXBI2H type=del size=769152 2024-09-14T10:57:36.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.627+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_49O8DPTGA65S.2~S6USELE5XZE1.0 size=1017494 2024-09-14T10:57:36.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.635+0000 7fdf8f02c8c0 1 < canceled multipart upload key=49O8DPTGA65S upload=S6USELE5XZE1 tag=SBOOCFO448E8 type=write size=2066070 2024-09-14T10:57:36.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.639+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~NUSMGF7P3FQP.0 size=1048576 2024-09-14T10:57:36.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.643+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~NUSMGF7P3FQP.1 size=887683 2024-09-14T10:57:36.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.643+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=NUSMGF7P3FQP tag=QW3YV3XJI1DX type=write size=2984835 2024-09-14T10:57:36.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.651+0000 7fdf8f02c8c0 1 < suggested update operation key=MNBXQTJBS1QS tag=D4ZVUSTOPJD0 type=write size=880625 2024-09-14T10:57:36.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.655+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=XFOR6UL1ZKW4 type=write size=487223 2024-09-14T10:57:36.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.659+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~6SXHTVH238HG.0 size=256136 2024-09-14T10:57:36.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.663+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=6SXHTVH238HG tag=AV15H6YE0NZ5 type=write size=1304712 2024-09-14T10:57:36.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.667+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=R2GQPWTMDJKO type=del size=3766594 2024-09-14T10:57:36.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.671+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~AA4EPEI4QR8N.0 size=571248 2024-09-14T10:57:36.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.675+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=AA4EPEI4QR8N tag=JXZWAYOSCHJI type=write size=1619824 2024-09-14T10:57:36.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~6PBC4GIHWKDY.0 size=1048576 2024-09-14T10:57:36.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.687+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~6PBC4GIHWKDY.1 size=498448 2024-09-14T10:57:36.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.687+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=6PBC4GIHWKDY tag=YM9W4V91ZX8C type=write size=2595600 2024-09-14T10:57:36.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.691+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~5MMGOOERYXTS.0 size=1048576 2024-09-14T10:57:36.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.691+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~5MMGOOERYXTS.1 size=159094 2024-09-14T10:57:36.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.703+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=5MMGOOERYXTS tag=Q2HYUZB9BWF2 type=write size=2256246 2024-09-14T10:57:36.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.703+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=AAS3SBV3SNVD type=del size=3890492 2024-09-14T10:57:36.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.707+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~00DEPUB6HBTG.0 size=837290 2024-09-14T10:57:36.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.711+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=00DEPUB6HBTG tag=KSQTG5CBKGPY type=write size=1885866 2024-09-14T10:57:36.713 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.715+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=VXDUUJW5O974 type=del size=3801119 2024-09-14T10:57:36.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~ZCCC2L49IG1F.0 size=683004 2024-09-14T10:57:36.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.727+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=ZCCC2L49IG1F tag=LWHFZT1HP9PG type=write size=1731580 2024-09-14T10:57:36.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.731+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=N0SWMJT14UZM type=del size=1223396 2024-09-14T10:57:36.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.735+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~LRFUCPOPOKH5.0 size=1048576 2024-09-14T10:57:36.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.739+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~LRFUCPOPOKH5.1 size=704480 2024-09-14T10:57:36.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.747+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=LRFUCPOPOKH5 tag=AVUI4JW6B17W type=write size=2801632 2024-09-14T10:57:36.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.747+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=BZ0PSV23HBKK type=del size=1187747 2024-09-14T10:57:36.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.751+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~7N2GD0BFD31A.0 size=1048576 2024-09-14T10:57:36.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.755+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~7N2GD0BFD31A.1 size=1048576 2024-09-14T10:57:36.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.755+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STB3W5URFJEZ.2~7N2GD0BFD31A.2 size=818443 2024-09-14T10:57:36.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.763+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STB3W5URFJEZ upload=7N2GD0BFD31A tag=4YGI2FTPCHWN type=write size=3964171 2024-09-14T10:57:36.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.771+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~OUHP8WZ5UXEV.0 size=349778 2024-09-14T10:57:36.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.771+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=OUHP8WZ5UXEV tag=C5CGI5PH3DCB type=write size=1398354 2024-09-14T10:57:36.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.775+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=FYA9ACMSRZNP type=del 2024-09-14T10:57:36.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.779+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=CTAIUZK04L9M type=write size=440206 2024-09-14T10:57:36.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.783+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~XPKA3XWGHEEL.0 size=605869 2024-09-14T10:57:36.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.787+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=XPKA3XWGHEEL tag=B2Y5GSTNFZO3 type=write size=1654445 2024-09-14T10:57:36.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.791+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=KW62K4D5X08W type=del size=855483 2024-09-14T10:57:36.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.795+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~MN1TQYRVVB4O.0 size=1048576 2024-09-14T10:57:36.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.799+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~MN1TQYRVVB4O.1 size=272815 2024-09-14T10:57:36.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.807+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=MN1TQYRVVB4O tag=OX5B7FYLWG5L type=write size=2369967 2024-09-14T10:57:36.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.811+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=YC9PA3326C4L type=del size=3366932 2024-09-14T10:57:36.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.819+0000 7fdf8f02c8c0 1 < suggested remove operation key=3T0H42SC1ETB tag=RZ2LX32OOWJD type=del 2024-09-14T10:57:36.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.823+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=G52GGC2PZE0P type=write size=209017 2024-09-14T10:57:36.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.827+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=DASHEFKDY2C0 type=del 2024-09-14T10:57:36.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~N3VTHMDP01A2.0 size=387977 2024-09-14T10:57:36.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.831+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=N3VTHMDP01A2 tag=3TBKHLCZ5KP6 type=write size=1436553 2024-09-14T10:57:36.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.835+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=3T0H42SC1ETB tag=L59LQIJ6BJ80 type=write size=840092: (2) No such file or directory 2024-09-14T10:57:36.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.839+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~HW6RKMLZCAK5.0 size=1048576 2024-09-14T10:57:36.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.843+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~HW6RKMLZCAK5.1 size=308847 2024-09-14T10:57:36.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.843+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=HW6RKMLZCAK5 tag=GIF3GEF8246C type=write size=2405999 2024-09-14T10:57:36.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.851+0000 7fdf8f02c8c0 1 < suggested remove operation key=YU9DAJA242Q7 tag=NDAGLNEXBI2H type=del 2024-09-14T10:57:36.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.859+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~BZSD3QGWN8LT.0 size=1048576 2024-09-14T10:57:36.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.859+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~BZSD3QGWN8LT.1 size=1048576 2024-09-14T10:57:36.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~BZSD3QGWN8LT.2 size=217436 2024-09-14T10:57:36.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.863+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=BZSD3QGWN8LT tag=ZBNNA2G8YAA5 type=write size=3363164 2024-09-14T10:57:36.864 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.867+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~NUSMGF7P3FQP.0 size=1048576 2024-09-14T10:57:36.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~NUSMGF7P3FQP.1 size=887683 2024-09-14T10:57:36.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.875+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=NUSMGF7P3FQP tag=QW3YV3XJI1DX type=write size=2984835 2024-09-14T10:57:36.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.879+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=81HNEP2XJ8NY type=write size=488107 2024-09-14T10:57:36.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.883+0000 7fdf8f02c8c0 1 < canceled operation key=5VZCCFRUAQJ7 tag=XFOR6UL1ZKW4 type=write size=487223 2024-09-14T10:57:36.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~Q854FK0HJZR5.0 size=1048576 2024-09-14T10:57:36.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~Q854FK0HJZR5.1 size=1048576 2024-09-14T10:57:36.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.899+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~Q854FK0HJZR5.2 size=1035750 2024-09-14T10:57:36.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.899+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=Q854FK0HJZR5 tag=O82PZTW3Y131 type=write size=4181478 2024-09-14T10:57:36.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.903+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=R2GQPWTMDJKO type=del 2024-09-14T10:57:36.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.907+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=KC8D1QHRSKOG type=write size=994699 2024-09-14T10:57:36.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.907+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_TZZ05IIMZJ4J.2~6PBC4GIHWKDY.0 size=1048576 2024-09-14T10:57:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.911+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~6PBC4GIHWKDY.1 size=498448 2024-09-14T10:57:36.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.915+0000 7fdf8f02c8c0 1 < canceled multipart upload key=TZZ05IIMZJ4J upload=6PBC4GIHWKDY tag=YM9W4V91ZX8C type=write size=2595600 2024-09-14T10:57:36.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.919+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=V4P8DN4GIVER type=del size=3269820 2024-09-14T10:57:36.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.923+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=AAS3SBV3SNVD type=del 2024-09-14T10:57:36.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.927+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=64U6DSXTJ4AO type=del size=2113883 2024-09-14T10:57:36.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.935+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=VXDUUJW5O974 type=del 2024-09-14T10:57:36.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.939+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=KA4RVQSIAMZF type=del size=3572482 2024-09-14T10:57:36.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.943+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=N0SWMJT14UZM type=del 2024-09-14T10:57:36.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.947+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~B6HSBT1YFO3L.0 size=303179 2024-09-14T10:57:36.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.947+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=B6HSBT1YFO3L tag=VDTY92J1436Y type=write size=1351755 2024-09-14T10:57:36.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.951+0000 7fdf8f02c8c0 1 < canceled operation key=5VZCCFRUAQJ7 tag=BZ0PSV23HBKK type=del size=1187747 2024-09-14T10:57:36.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.955+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=NWL9LPGIUM3D type=del size=1379765 2024-09-14T10:57:36.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.959+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_6VNI8FMHZ0FN.2~OUHP8WZ5UXEV.0 size=349778 2024-09-14T10:57:36.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.963+0000 7fdf8f02c8c0 1 < canceled multipart upload key=6VNI8FMHZ0FN upload=OUHP8WZ5UXEV tag=C5CGI5PH3DCB type=write size=1398354 2024-09-14T10:57:36.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.967+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=TA5D4M64BJIX type=del size=2357736 2024-09-14T10:57:36.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.975+0000 7fdf8f02c8c0 1 < suggested remove operation key=X1BN3054IKNS tag=CTAIUZK04L9M type=write 2024-09-14T10:57:36.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~CAH9DJ2NME2J.0 size=1048576 2024-09-14T10:57:36.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~CAH9DJ2NME2J.1 size=983441 2024-09-14T10:57:36.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.983+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=CAH9DJ2NME2J tag=P4PKUJAKRL55 type=write size=3080593 2024-09-14T10:57:36.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.991+0000 7fdf8f02c8c0 1 < suggested update operation key=ZSBCGOXXJ0D5 tag=KW62K4D5X08W type=del size=855483 2024-09-14T10:57:36.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.995+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=C1R99ONV5TZM type=del size=3812934 2024-09-14T10:57:36.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:36.999+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=YC9PA3326C4L type=del 2024-09-14T10:57:37.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.007+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~5K2AE9QGHU6V.0 size=1048576 2024-09-14T10:57:37.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~5K2AE9QGHU6V.1 size=825659 2024-09-14T10:57:37.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.011+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=5K2AE9QGHU6V tag=DUNOPO0Y11YK type=write size=2922811 2024-09-14T10:57:37.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.019+0000 7fdf8f02c8c0 1 < suggested update operation key=STB3W5URFJEZ tag=G52GGC2PZE0P type=write size=209017 2024-09-14T10:57:37.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.023+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=C9EAM1R4U8YA type=del size=4043396 2024-09-14T10:57:37.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.027+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~N3VTHMDP01A2.0 size=387977 2024-09-14T10:57:37.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.031+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=N3VTHMDP01A2 tag=3TBKHLCZ5KP6 type=write size=1436553 2024-09-14T10:57:37.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.035+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~XB77I0Q4WQ6W.0 size=550995 2024-09-14T10:57:37.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.035+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=XB77I0Q4WQ6W tag=U7AW4ULN29O5 type=write size=1599571 2024-09-14T10:57:37.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.039+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~HW6RKMLZCAK5.0 size=1048576 2024-09-14T10:57:37.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.043+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~HW6RKMLZCAK5.1 size=308847 2024-09-14T10:57:37.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.051+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=HW6RKMLZCAK5 tag=GIF3GEF8246C type=write size=2405999 2024-09-14T10:57:37.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.051+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=L2Q90OPLY9KI type=del size=3352262 2024-09-14T10:57:37.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.055+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~BZSD3QGWN8LT.0 size=1048576 2024-09-14T10:57:37.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.059+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~BZSD3QGWN8LT.1 size=1048576 2024-09-14T10:57:37.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.063+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~BZSD3QGWN8LT.2 size=217436 2024-09-14T10:57:37.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.067+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=BZSD3QGWN8LT tag=ZBNNA2G8YAA5 type=write size=3363164 2024-09-14T10:57:37.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.071+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=MKL1T9D170X4 type=del size=3698522 2024-09-14T10:57:37.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.075+0000 7fdf8f02c8c0 1 < completed write operation key=49O8DPTGA65S tag=81HNEP2XJ8NY type=write size=488107 2024-09-14T10:57:37.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~KJLTJLP6GAX9.0 size=1048576 2024-09-14T10:57:37.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.087+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~KJLTJLP6GAX9.1 size=452117 2024-09-14T10:57:37.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.087+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=KJLTJLP6GAX9 tag=1ZXIRC1VEELT type=write size=2549269 2024-09-14T10:57:37.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.091+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~Q854FK0HJZR5.0 size=1048576 2024-09-14T10:57:37.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.091+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~Q854FK0HJZR5.1 size=1048576 2024-09-14T10:57:37.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.095+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~Q854FK0HJZR5.2 size=1035750 2024-09-14T10:57:37.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.103+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=Q854FK0HJZR5 tag=O82PZTW3Y131 type=write size=4181478 2024-09-14T10:57:37.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.107+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=O3T7NF3WY80B type=del size=2911437 2024-09-14T10:57:37.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.111+0000 7fdf8f02c8c0 1 < completed write operation key=OFY1G5R28CK6 tag=KC8D1QHRSKOG type=write size=994699 2024-09-14T10:57:37.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.115+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=GVZIXSU6PS5Y type=del size=1501907 2024-09-14T10:57:37.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.119+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=V4P8DN4GIVER type=del 2024-09-14T10:57:37.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.123+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=92NE6RHOH4HF type=write size=766614 2024-09-14T10:57:37.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.127+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=64U6DSXTJ4AO type=del 2024-09-14T10:57:37.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.131+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=7Z53WW9W3J9J type=del size=1803950 2024-09-14T10:57:37.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.135+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=KA4RVQSIAMZF type=del 2024-09-14T10:57:37.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.139+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=3RXB7YSW81BD type=del size=3421462 2024-09-14T10:57:37.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.143+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~B6HSBT1YFO3L.0 size=303179 2024-09-14T10:57:37.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.147+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=B6HSBT1YFO3L tag=VDTY92J1436Y type=write size=1351755 2024-09-14T10:57:37.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.155+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~5OUA58T2INQB.0 size=205922 2024-09-14T10:57:37.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.155+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=5OUA58T2INQB tag=WAMW1772MV7W type=write size=1254498 2024-09-14T10:57:37.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.159+0000 7fdf8f02c8c0 1 < canceled operation key=3CYCJJIQ210M tag=NWL9LPGIUM3D type=del size=1379765 2024-09-14T10:57:37.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.163+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=22KQ3F08WKTN type=del size=2793365 2024-09-14T10:57:37.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.167+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=TA5D4M64BJIX type=del 2024-09-14T10:57:37.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.171+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=3EWVW3A0IYI2 type=write size=321436 2024-09-14T10:57:37.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.175+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~CAH9DJ2NME2J.0 size=1048576 2024-09-14T10:57:37.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.179+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~CAH9DJ2NME2J.1 size=983441 2024-09-14T10:57:37.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.183+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=CAH9DJ2NME2J tag=P4PKUJAKRL55 type=write size=3080593 2024-09-14T10:57:37.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.187+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=11DDB456M0Q2 type=write size=268321 2024-09-14T10:57:37.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.191+0000 7fdf8f02c8c0 1 < canceled operation key=YU9DAJA242Q7 tag=C1R99ONV5TZM type=del size=3812934 2024-09-14T10:57:37.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.199+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~8NM7TFRIVJDB.0 size=1048576 2024-09-14T10:57:37.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.199+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~8NM7TFRIVJDB.1 size=1048576 2024-09-14T10:57:37.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~8NM7TFRIVJDB.2 size=675311 2024-09-14T10:57:37.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.203+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=8NM7TFRIVJDB tag=UT7ML0OK2YX9 type=write size=3821039 2024-09-14T10:57:37.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.207+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~5K2AE9QGHU6V.0 size=1048576 2024-09-14T10:57:37.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.211+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~5K2AE9QGHU6V.1 size=825659 2024-09-14T10:57:37.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.215+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=5K2AE9QGHU6V tag=DUNOPO0Y11YK type=write size=2922811 2024-09-14T10:57:37.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.219+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=MI8D776MOVJR type=del size=1347842 2024-09-14T10:57:37.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.223+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=C9EAM1R4U8YA type=del 2024-09-14T10:57:37.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.227+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=7W3FLGEO99YR type=del size=1227552 2024-09-14T10:57:37.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.231+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~XB77I0Q4WQ6W.0 size=550995 2024-09-14T10:57:37.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.239+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=XB77I0Q4WQ6W tag=U7AW4ULN29O5 type=write size=1599571 2024-09-14T10:57:37.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.243+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~NN2329WF6EWY.0 size=1048576 2024-09-14T10:57:37.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.247+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~NN2329WF6EWY.1 size=512113 2024-09-14T10:57:37.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.247+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=NN2329WF6EWY tag=0ICU5WDP75ZH type=write size=2609265 2024-09-14T10:57:37.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.255+0000 7fdf8f02c8c0 1 < suggested update operation key=MNBXQTJBS1QS tag=L2Q90OPLY9KI type=del size=3352262 2024-09-14T10:57:37.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~KO0AZW8JVBCU.0 size=1048576 2024-09-14T10:57:37.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.263+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~KO0AZW8JVBCU.1 size=1048576 2024-09-14T10:57:37.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.267+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~KO0AZW8JVBCU.2 size=579003 2024-09-14T10:57:37.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.267+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=KO0AZW8JVBCU tag=TI723F266Q8P type=write size=3724731 2024-09-14T10:57:37.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.275+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZSBCGOXXJ0D5 tag=MKL1T9D170X4 type=del 2024-09-14T10:57:37.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.279+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=FJEG6D2YED9G type=del size=1910638 2024-09-14T10:57:37.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.283+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~KJLTJLP6GAX9.0 size=1048576 2024-09-14T10:57:37.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.283+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~KJLTJLP6GAX9.1 size=452117 2024-09-14T10:57:37.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.291+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=KJLTJLP6GAX9 tag=1ZXIRC1VEELT type=write size=2549269 2024-09-14T10:57:37.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.295+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=U7ZMO96LQ64Z type=write size=999422 2024-09-14T10:57:37.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.299+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=O3T7NF3WY80B type=del 2024-09-14T10:57:37.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.307+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~LJ8Y7TSWXX6C.0 size=1048576 2024-09-14T10:57:37.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.307+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~LJ8Y7TSWXX6C.1 size=297473 2024-09-14T10:57:37.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.307+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=LJ8Y7TSWXX6C tag=IM32PH2CMIUF type=write size=2394625 2024-09-14T10:57:37.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.311+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=GVZIXSU6PS5Y type=del 2024-09-14T10:57:37.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.319+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~Z2Z946LBNFK4.0 size=1048576 2024-09-14T10:57:37.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.319+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~Z2Z946LBNFK4.1 size=428338 2024-09-14T10:57:37.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.319+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=Z2Z946LBNFK4 tag=L4GSXWB292B7 type=write size=2525490 2024-09-14T10:57:37.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.327+0000 7fdf8f02c8c0 1 < suggested update operation key=L1ERJ0JSRDMG tag=92NE6RHOH4HF type=write size=766614 2024-09-14T10:57:37.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.335+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~MT6BA34FGXJO.0 size=1048576 2024-09-14T10:57:37.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.339+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~MT6BA34FGXJO.1 size=1048576 2024-09-14T10:57:37.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.343+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~MT6BA34FGXJO.2 size=511548 2024-09-14T10:57:37.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.343+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=MT6BA34FGXJO tag=7AYT9H58IU6W type=write size=3657276 2024-09-14T10:57:37.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.347+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=7Z53WW9W3J9J type=del 2024-09-14T10:57:37.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~LB2N3PGO9SUH.0 size=411168 2024-09-14T10:57:37.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.351+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=LB2N3PGO9SUH tag=2I0VZT8HOAL2 type=write size=1459744 2024-09-14T10:57:37.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.355+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=3RXB7YSW81BD type=del 2024-09-14T10:57:37.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.359+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=GFJ2GJ4ND7ZA type=del size=3792287 2024-09-14T10:57:37.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.363+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~5OUA58T2INQB.0 size=205922 2024-09-14T10:57:37.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.371+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=5OUA58T2INQB tag=WAMW1772MV7W type=write size=1254498 2024-09-14T10:57:37.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.375+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=7WBIJZL19GRK type=del size=968821 2024-09-14T10:57:37.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.379+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=22KQ3F08WKTN type=del 2024-09-14T10:57:37.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.383+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=N418WQBO9DO9 type=del size=3530140 2024-09-14T10:57:37.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.387+0000 7fdf8f02c8c0 1 < completed write operation key=STHEUJ6VDPQB tag=3EWVW3A0IYI2 type=write size=321436 2024-09-14T10:57:37.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.391+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=MLVGRQWU4XE1 type=del size=267355 2024-09-14T10:57:37.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.399+0000 7fdf8f02c8c0 1 < suggested remove operation key=APDKRWHOUH9T tag=11DDB456M0Q2 type=write 2024-09-14T10:57:37.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.403+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=7K9B9SQJTAOO type=write size=8814 2024-09-14T10:57:37.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.407+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~8NM7TFRIVJDB.0 size=1048576 2024-09-14T10:57:37.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.407+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~8NM7TFRIVJDB.1 size=1048576 2024-09-14T10:57:37.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.411+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~8NM7TFRIVJDB.2 size=675311 2024-09-14T10:57:37.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.419+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=8NM7TFRIVJDB tag=UT7ML0OK2YX9 type=write size=3821039 2024-09-14T10:57:37.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.423+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=2W4W35V0VY3O type=del size=2076713 2024-09-14T10:57:37.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.427+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=MI8D776MOVJR type=del 2024-09-14T10:57:37.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.431+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=SKY8WMNSRDB2 type=del size=1284378 2024-09-14T10:57:37.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.435+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=7W3FLGEO99YR type=del 2024-09-14T10:57:37.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.439+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~KIQCV33BPLRA.0 size=1048576 2024-09-14T10:57:37.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.443+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~KIQCV33BPLRA.1 size=90214 2024-09-14T10:57:37.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.443+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=KIQCV33BPLRA tag=O07W0SWJ8DPN type=write size=2187366 2024-09-14T10:57:37.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.447+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~NN2329WF6EWY.0 size=1048576 2024-09-14T10:57:37.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.451+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~NN2329WF6EWY.1 size=512113 2024-09-14T10:57:37.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.455+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=NN2329WF6EWY tag=0ICU5WDP75ZH type=write size=2609265 2024-09-14T10:57:37.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.459+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=PEDLD69WYWG5 type=del size=1410387 2024-09-14T10:57:37.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.467+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~KO0AZW8JVBCU.0 size=1048576 2024-09-14T10:57:37.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.471+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~KO0AZW8JVBCU.1 size=1048576 2024-09-14T10:57:37.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.475+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~KO0AZW8JVBCU.2 size=579003 2024-09-14T10:57:37.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.479+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=KO0AZW8JVBCU tag=TI723F266Q8P type=write size=3724731 2024-09-14T10:57:37.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.483+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=5UIULSP5BXLL type=del size=3791187 2024-09-14T10:57:37.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.487+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=FJEG6D2YED9G type=del 2024-09-14T10:57:37.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.491+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=AS4XK03CEJB6 type=del size=2586349 2024-09-14T10:57:37.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.495+0000 7fdf8f02c8c0 -1 < failed to complete operation key=L1ERJ0JSRDMG tag=U7ZMO96LQ64Z type=write size=999422: (22) Invalid argument 2024-09-14T10:57:37.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.499+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=C7C0Y6K1DWY2 type=del size=3975834 2024-09-14T10:57:37.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.503+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~LJ8Y7TSWXX6C.0 size=1048576 2024-09-14T10:57:37.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.507+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~LJ8Y7TSWXX6C.1 size=297473 2024-09-14T10:57:37.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.511+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=LJ8Y7TSWXX6C tag=IM32PH2CMIUF type=write size=2394625 2024-09-14T10:57:37.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.519+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=M6PS7LRYFAIP type=del size=465281 2024-09-14T10:57:37.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.519+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~Z2Z946LBNFK4.0 size=1048576 2024-09-14T10:57:37.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.523+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~Z2Z946LBNFK4.1 size=428338 2024-09-14T10:57:37.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.531+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=Z2Z946LBNFK4 tag=L4GSXWB292B7 type=write size=2525490 2024-09-14T10:57:37.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.535+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~L802AR5HDDE6.0 size=1048576 2024-09-14T10:57:37.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.539+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~L802AR5HDDE6.1 size=1048576 2024-09-14T10:57:37.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.543+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~L802AR5HDDE6.2 size=99056 2024-09-14T10:57:37.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.543+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=L802AR5HDDE6 tag=EYBI6W3O9RAR type=write size=3244784 2024-09-14T10:57:37.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~MT6BA34FGXJO.0 size=1048576 2024-09-14T10:57:37.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.547+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_Y32RWGISRBMT.2~MT6BA34FGXJO.1 size=1048576 2024-09-14T10:57:37.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~MT6BA34FGXJO.2 size=511548 2024-09-14T10:57:37.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.555+0000 7fdf8f02c8c0 1 < canceled multipart upload key=Y32RWGISRBMT upload=MT6BA34FGXJO tag=7AYT9H58IU6W type=write size=3657276 2024-09-14T10:57:37.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.559+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=KWGQHME0DHD8 type=del size=2538464 2024-09-14T10:57:37.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.559+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_6VNI8FMHZ0FN.2~LB2N3PGO9SUH.0 size=411168 2024-09-14T10:57:37.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.567+0000 7fdf8f02c8c0 1 < canceled multipart upload key=6VNI8FMHZ0FN upload=LB2N3PGO9SUH tag=2I0VZT8HOAL2 type=write size=1459744 2024-09-14T10:57:37.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.571+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=88HEB788C9FB type=del size=1368932 2024-09-14T10:57:37.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.575+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=GFJ2GJ4ND7ZA type=del 2024-09-14T10:57:37.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.579+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=EYWYPJ4PJQSG type=del size=3809277 2024-09-14T10:57:37.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.583+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=7WBIJZL19GRK type=del 2024-09-14T10:57:37.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.587+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=FMOHU3OOXD7B type=del size=339789 2024-09-14T10:57:37.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.591+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=N418WQBO9DO9 type=del 2024-09-14T10:57:37.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.595+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=H3UINHJ4WMPD type=del size=2741899 2024-09-14T10:57:37.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.595+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=MLVGRQWU4XE1 type=del 2024-09-14T10:57:37.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.599+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=20R3DZ4P1DMB type=del size=760656 2024-09-14T10:57:37.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.607+0000 7fdf8f02c8c0 1 < canceled operation key=49O8DPTGA65S tag=7K9B9SQJTAOO type=write size=8814 2024-09-14T10:57:37.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.611+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=N9N3RXA5L5LO type=write size=716844 2024-09-14T10:57:37.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.615+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=2W4W35V0VY3O type=del 2024-09-14T10:57:37.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.619+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=9JXD300HAI1M type=del size=2224864 2024-09-14T10:57:37.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.623+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=SKY8WMNSRDB2 type=del 2024-09-14T10:57:37.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.627+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=FBRFONZ05QFL type=del size=1114966 2024-09-14T10:57:37.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.631+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_1E72V12EPEH3.2~KIQCV33BPLRA.0 size=1048576 2024-09-14T10:57:37.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.631+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~KIQCV33BPLRA.1 size=90214 2024-09-14T10:57:37.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.639+0000 7fdf8f02c8c0 1 < canceled multipart upload key=1E72V12EPEH3 upload=KIQCV33BPLRA tag=O07W0SWJ8DPN type=write size=2187366 2024-09-14T10:57:37.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~G71LGVZI90EQ.0 size=1048576 2024-09-14T10:57:37.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~G71LGVZI90EQ.1 size=1048576 2024-09-14T10:57:37.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~G71LGVZI90EQ.2 size=369886 2024-09-14T10:57:37.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.651+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=G71LGVZI90EQ tag=1W9VUMYKDD55 type=write size=3515614 2024-09-14T10:57:37.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.655+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=PEDLD69WYWG5 type=del 2024-09-14T10:57:37.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.659+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=KGE7QFS6SILA type=write size=474646 2024-09-14T10:57:37.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.671+0000 7fdf8f02c8c0 1 < suggested remove operation key=L1ERJ0JSRDMG tag=5UIULSP5BXLL type=del 2024-09-14T10:57:37.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.675+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=Y2ZI3T8VFVYL type=del size=830190 2024-09-14T10:57:37.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.679+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=AS4XK03CEJB6 type=del size=2586349 2024-09-14T10:57:37.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.687+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~O1CU69D2XHL8.0 size=612430 2024-09-14T10:57:37.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.687+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=O1CU69D2XHL8 tag=A0NRHLAVLX82 type=write size=1661006 2024-09-14T10:57:37.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.691+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=C7C0Y6K1DWY2 type=del 2024-09-14T10:57:37.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.699+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~9G3920UQHP07.0 size=741136 2024-09-14T10:57:37.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.699+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=9G3920UQHP07 tag=VN9AMKD5T8E6 type=write size=1789712 2024-09-14T10:57:37.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.703+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=M6PS7LRYFAIP type=del 2024-09-14T10:57:37.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.707+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=ZRLUC406G0NG type=del size=271137 2024-09-14T10:57:37.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.711+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~L802AR5HDDE6.0 size=1048576 2024-09-14T10:57:37.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.715+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~L802AR5HDDE6.1 size=1048576 2024-09-14T10:57:37.713 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.719+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~L802AR5HDDE6.2 size=99056 2024-09-14T10:57:37.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.723+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=L802AR5HDDE6 tag=EYBI6W3O9RAR type=write size=3244784 2024-09-14T10:57:37.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.727+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=FRJHMFGWNLR1 type=del size=2341931 2024-09-14T10:57:37.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.731+0000 7fdf8f02c8c0 1 < canceled operation key=3T0H42SC1ETB tag=KWGQHME0DHD8 type=del size=2538464 2024-09-14T10:57:37.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.735+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=7V08L7XT2O92 type=del size=3144097 2024-09-14T10:57:37.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.743+0000 7fdf8f02c8c0 1 < suggested update operation key=82N2FPU7LKTG tag=88HEB788C9FB type=del size=1368932 2024-09-14T10:57:37.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.747+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~CNPS674QYVLC.0 size=771027 2024-09-14T10:57:37.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.747+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=CNPS674QYVLC tag=KA52LOESTTQU type=write size=1819603 2024-09-14T10:57:37.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.751+0000 7fdf8f02c8c0 1 < canceled operation key=X0RT8UF3D0JC tag=EYWYPJ4PJQSG type=del size=3809277 2024-09-14T10:57:37.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.759+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~GQC479SGGT4W.0 size=1048576 2024-09-14T10:57:37.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~GQC479SGGT4W.1 size=1048576 2024-09-14T10:57:37.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~GQC479SGGT4W.2 size=331056 2024-09-14T10:57:37.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.763+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=GQC479SGGT4W tag=1MLV7QNT0SRC type=write size=3476784 2024-09-14T10:57:37.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.767+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=FMOHU3OOXD7B type=del 2024-09-14T10:57:37.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~VHQQGS91JKE1.0 size=1048576 2024-09-14T10:57:37.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.779+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~VHQQGS91JKE1.1 size=1048576 2024-09-14T10:57:37.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.779+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~VHQQGS91JKE1.2 size=924934 2024-09-14T10:57:37.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.779+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=VHQQGS91JKE1 tag=R51T91EZC191 type=write size=4070662 2024-09-14T10:57:37.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.783+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=H3UINHJ4WMPD type=del 2024-09-14T10:57:37.787 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.791+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~U7IFJ8YOB93C.0 size=1048576 2024-09-14T10:57:37.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~U7IFJ8YOB93C.1 size=297737 2024-09-14T10:57:37.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.795+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=U7IFJ8YOB93C tag=Q87313U254KR type=write size=2394889 2024-09-14T10:57:37.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.799+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=20R3DZ4P1DMB type=del 2024-09-14T10:57:37.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.803+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=0TCT02BMX4J4 type=write size=33677 2024-09-14T10:57:37.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.807+0000 7fdf8f02c8c0 1 < completed write operation key=LCEH2YXNSOGT tag=N9N3RXA5L5LO type=write size=716844 2024-09-14T10:57:37.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.811+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=7QBAZ7Y1DVKC type=write size=655377 2024-09-14T10:57:37.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.815+0000 7fdf8f02c8c0 1 < canceled operation key=XUT55FR490EO tag=9JXD300HAI1M type=del size=2224864 2024-09-14T10:57:37.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.819+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~RBD9NHS13LSQ.0 size=1048576 2024-09-14T10:57:37.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.823+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~RBD9NHS13LSQ.1 size=1048576 2024-09-14T10:57:37.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.827+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~RBD9NHS13LSQ.2 size=768140 2024-09-14T10:57:37.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.827+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=RBD9NHS13LSQ tag=EW30LEHLT27R type=write size=3913868 2024-09-14T10:57:37.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.831+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=FBRFONZ05QFL type=del 2024-09-14T10:57:37.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.839+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~EG2T30QCE23Z.0 size=65068 2024-09-14T10:57:37.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.839+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=EG2T30QCE23Z tag=ZCTR2S7ZXJVK type=write size=1113644 2024-09-14T10:57:37.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.843+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~G71LGVZI90EQ.0 size=1048576 2024-09-14T10:57:37.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.847+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~G71LGVZI90EQ.1 size=1048576 2024-09-14T10:57:37.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.851+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~G71LGVZI90EQ.2 size=369886 2024-09-14T10:57:37.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.855+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=G71LGVZI90EQ tag=1W9VUMYKDD55 type=write size=3515614 2024-09-14T10:57:37.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.859+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=P23RRBB2VSEW type=del size=3744423 2024-09-14T10:57:37.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.863+0000 7fdf8f02c8c0 -1 < failed to complete operation key=5VZCCFRUAQJ7 tag=KGE7QFS6SILA type=write size=474646: (22) Invalid argument 2024-09-14T10:57:37.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.867+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=ULUMKP1CR1OT type=del size=1327505 2024-09-14T10:57:37.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.871+0000 7fdf8f02c8c0 1 < canceled operation key=9IDBODZBQRJR tag=Y2ZI3T8VFVYL type=del size=830190 2024-09-14T10:57:37.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.875+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=HF6HUK22G32N type=del size=661041 2024-09-14T10:57:37.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.879+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~O1CU69D2XHL8.0 size=612430 2024-09-14T10:57:37.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.883+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=O1CU69D2XHL8 tag=A0NRHLAVLX82 type=write size=1661006 2024-09-14T10:57:37.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~X9YPAHLUZEEL.0 size=1048576 2024-09-14T10:57:37.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~X9YPAHLUZEEL.1 size=1048576 2024-09-14T10:57:37.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~X9YPAHLUZEEL.2 size=178137 2024-09-14T10:57:37.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.895+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=X9YPAHLUZEEL tag=F0N3MSM5B3EB type=write size=3323865 2024-09-14T10:57:37.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.899+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_KVZEUYUSV5JI.2~9G3920UQHP07.0 size=741136 2024-09-14T10:57:37.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.903+0000 7fdf8f02c8c0 1 < canceled multipart upload key=KVZEUYUSV5JI upload=9G3920UQHP07 tag=VN9AMKD5T8E6 type=write size=1789712 2024-09-14T10:57:37.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.907+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=5KDLBMSAMU6E type=del size=3984970 2024-09-14T10:57:37.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.911+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=ZRLUC406G0NG type=del 2024-09-14T10:57:37.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.919+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~5WWCSFEDFF2W.0 size=1048576 2024-09-14T10:57:37.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~5WWCSFEDFF2W.1 size=1048576 2024-09-14T10:57:37.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.927+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~5WWCSFEDFF2W.2 size=254202 2024-09-14T10:57:37.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.927+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=5WWCSFEDFF2W tag=VRNJ8ZKHUN3E type=write size=3399930 2024-09-14T10:57:37.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.935+0000 7fdf8f02c8c0 1 < suggested remove operation key=49O8DPTGA65S tag=FRJHMFGWNLR1 type=del 2024-09-14T10:57:37.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.939+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=YXQE1BTMSM8X type=del size=1620291 2024-09-14T10:57:37.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.943+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=7V08L7XT2O92 type=del 2024-09-14T10:57:37.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.947+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~B2IAJTY2EDDV.0 size=1048576 2024-09-14T10:57:37.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~B2IAJTY2EDDV.1 size=1037323 2024-09-14T10:57:37.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.951+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=B2IAJTY2EDDV tag=MXPVTIM1CFYG type=write size=3134475 2024-09-14T10:57:37.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~CNPS674QYVLC.0 size=771027 2024-09-14T10:57:37.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.963+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=CNPS674QYVLC tag=KA52LOESTTQU type=write size=1819603 2024-09-14T10:57:37.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.967+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=OC3ADJ7JLPIA type=write size=149751 2024-09-14T10:57:37.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.971+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~GQC479SGGT4W.0 size=1048576 2024-09-14T10:57:37.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.975+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~GQC479SGGT4W.1 size=1048576 2024-09-14T10:57:37.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.975+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~GQC479SGGT4W.2 size=331056 2024-09-14T10:57:37.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.983+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=GQC479SGGT4W tag=1MLV7QNT0SRC type=write size=3476784 2024-09-14T10:57:37.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.991+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~BG6H5VL4DQEM.0 size=1048576 2024-09-14T10:57:37.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.995+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~BG6H5VL4DQEM.1 size=699729 2024-09-14T10:57:37.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.995+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=BG6H5VL4DQEM tag=UBX3O0Z0N5KC type=write size=2796881 2024-09-14T10:57:37.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.999+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~VHQQGS91JKE1.0 size=1048576 2024-09-14T10:57:37.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:37.999+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~VHQQGS91JKE1.1 size=1048576 2024-09-14T10:57:38.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.003+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~VHQQGS91JKE1.2 size=924934 2024-09-14T10:57:38.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.011+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=VHQQGS91JKE1 tag=R51T91EZC191 type=write size=4070662 2024-09-14T10:57:38.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.015+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~IDFVN8X3727V.0 size=1048576 2024-09-14T10:57:38.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.019+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~IDFVN8X3727V.1 size=133009 2024-09-14T10:57:38.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.019+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=IDFVN8X3727V tag=D5VK1VQQ2HOL type=write size=2230161 2024-09-14T10:57:38.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.019+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~U7IFJ8YOB93C.0 size=1048576 2024-09-14T10:57:38.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.019+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~U7IFJ8YOB93C.1 size=297737 2024-09-14T10:57:38.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.027+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=U7IFJ8YOB93C tag=Q87313U254KR type=write size=2394889 2024-09-14T10:57:38.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.031+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=1IBP7LW0Q2KA type=del size=3261327 2024-09-14T10:57:38.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.035+0000 7fdf8f02c8c0 1 < completed write operation key=0QJLAH0EPKVD tag=0TCT02BMX4J4 type=write size=33677 2024-09-14T10:57:38.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.039+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=NT03VWZFEJP3 type=del size=2138605 2024-09-14T10:57:38.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.043+0000 7fdf8f02c8c0 1 < completed write operation key=ZSBCGOXXJ0D5 tag=7QBAZ7Y1DVKC type=write size=655377 2024-09-14T10:57:38.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.047+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=S4VHWK0SA9LS type=write size=780662 2024-09-14T10:57:38.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.047+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~RBD9NHS13LSQ.0 size=1048576 2024-09-14T10:57:38.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.047+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~RBD9NHS13LSQ.1 size=1048576 2024-09-14T10:57:38.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.051+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~RBD9NHS13LSQ.2 size=768140 2024-09-14T10:57:38.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.059+0000 7fdf8f02c8c0 1 < canceled multipart upload key=XUT55FR490EO upload=RBD9NHS13LSQ tag=EW30LEHLT27R type=write size=3913868 2024-09-14T10:57:38.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.067+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~3JW2PHLDHGWQ.0 size=1048576 2024-09-14T10:57:38.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.071+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~3JW2PHLDHGWQ.1 size=1048576 2024-09-14T10:57:38.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~3JW2PHLDHGWQ.2 size=46708 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.075+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=3JW2PHLDHGWQ tag=S0A1ISS3RPIN type=write size=3192436 2024-09-14T10:57:38.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.079+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~EG2T30QCE23Z.0 size=65068 2024-09-14T10:57:38.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.083+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=EG2T30QCE23Z tag=ZCTR2S7ZXJVK type=write size=1113644 2024-09-14T10:57:38.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.091+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~1J0Z3JRBSK3F.0 size=1048576 2024-09-14T10:57:38.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.095+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~1J0Z3JRBSK3F.1 size=826523 2024-09-14T10:57:38.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.095+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=1J0Z3JRBSK3F tag=L3L6KMGUY7V2 type=write size=2923675 2024-09-14T10:57:38.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.099+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=P23RRBB2VSEW type=del 2024-09-14T10:57:38.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.103+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=6SHKM02BBQC4 type=del size=3929451 2024-09-14T10:57:38.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.107+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=ULUMKP1CR1OT type=del 2024-09-14T10:57:38.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.111+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=S4NZWZPFRZVY type=write size=420679 2024-09-14T10:57:38.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.115+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=HF6HUK22G32N type=del 2024-09-14T10:57:38.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.119+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=RLL16HYRL09S type=del size=1665795 2024-09-14T10:57:38.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.123+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~X9YPAHLUZEEL.0 size=1048576 2024-09-14T10:57:38.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.127+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~X9YPAHLUZEEL.1 size=1048576 2024-09-14T10:57:38.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.127+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~X9YPAHLUZEEL.2 size=178137 2024-09-14T10:57:38.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.135+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=X9YPAHLUZEEL tag=F0N3MSM5B3EB type=write size=3323865 2024-09-14T10:57:38.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.139+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=NDAXC33YA3W0 type=del size=715697 2024-09-14T10:57:38.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.147+0000 7fdf8f02c8c0 1 < suggested remove operation key=HCGZ1MY5SKW9 tag=5KDLBMSAMU6E type=del 2024-09-14T10:57:38.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~ZDOL6IT2OAUN.0 size=1048576 2024-09-14T10:57:38.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.155+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~ZDOL6IT2OAUN.1 size=1048576 2024-09-14T10:57:38.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.159+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~ZDOL6IT2OAUN.2 size=404928 2024-09-14T10:57:38.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.159+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=ZDOL6IT2OAUN tag=NZXXDJEY6X6I type=write size=3550656 2024-09-14T10:57:38.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.159+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_APDKRWHOUH9T.2~5WWCSFEDFF2W.0 size=1048576 2024-09-14T10:57:38.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.159+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_APDKRWHOUH9T.2~5WWCSFEDFF2W.1 size=1048576 2024-09-14T10:57:38.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~5WWCSFEDFF2W.2 size=254202 2024-09-14T10:57:38.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.167+0000 7fdf8f02c8c0 1 < canceled multipart upload key=APDKRWHOUH9T upload=5WWCSFEDFF2W tag=VRNJ8ZKHUN3E type=write size=3399930 2024-09-14T10:57:38.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.171+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=HOUKDTBAUQL4 type=write size=824866 2024-09-14T10:57:38.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.175+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=YXQE1BTMSM8X type=del 2024-09-14T10:57:38.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.179+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=MKF1RZEPE2PE type=del size=934137 2024-09-14T10:57:38.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.183+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~B2IAJTY2EDDV.0 size=1048576 2024-09-14T10:57:38.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.187+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~B2IAJTY2EDDV.1 size=1037323 2024-09-14T10:57:38.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.195+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=B2IAJTY2EDDV tag=MXPVTIM1CFYG type=write size=3134475 2024-09-14T10:57:38.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~G8QX3BIG9BN9.0 size=1048576 2024-09-14T10:57:38.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~G8QX3BIG9BN9.1 size=1048576 2024-09-14T10:57:38.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~G8QX3BIG9BN9.2 size=150995 2024-09-14T10:57:38.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.207+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=G8QX3BIG9BN9 tag=HYH23AKX90M1 type=write size=3296723 2024-09-14T10:57:38.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.211+0000 7fdf8f02c8c0 1 < completed write operation key=3CYCJJIQ210M tag=OC3ADJ7JLPIA type=write size=149751 2024-09-14T10:57:38.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~WI6TANZOYS2W.0 size=1048576 2024-09-14T10:57:38.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~WI6TANZOYS2W.1 size=96364 2024-09-14T10:57:38.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.219+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=WI6TANZOYS2W tag=47CZNOLBA3XV type=write size=2193516 2024-09-14T10:57:38.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.223+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~BG6H5VL4DQEM.0 size=1048576 2024-09-14T10:57:38.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.227+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~BG6H5VL4DQEM.1 size=699729 2024-09-14T10:57:38.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.235+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=BG6H5VL4DQEM tag=UBX3O0Z0N5KC type=write size=2796881 2024-09-14T10:57:38.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.239+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=SI6L50GX92CY type=del size=3761071 2024-09-14T10:57:38.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~IDFVN8X3727V.0 size=1048576 2024-09-14T10:57:38.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~IDFVN8X3727V.1 size=133009 2024-09-14T10:57:38.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.251+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=IDFVN8X3727V tag=D5VK1VQQ2HOL type=write size=2230161 2024-09-14T10:57:38.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.255+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=DZOV20377AF9 type=del size=68280 2024-09-14T10:57:38.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.259+0000 7fdf8f02c8c0 1 < canceled operation key=STHEUJ6VDPQB tag=1IBP7LW0Q2KA type=del size=3261327 2024-09-14T10:57:38.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.263+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=5YKJSLWDS3JL type=del size=2878638 2024-09-14T10:57:38.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.267+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=NT03VWZFEJP3 type=del 2024-09-14T10:57:38.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.271+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=T2VZV8TATOFP type=del size=2061253 2024-09-14T10:57:38.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.275+0000 7fdf8f02c8c0 1 < completed write operation key=6VNI8FMHZ0FN tag=S4VHWK0SA9LS type=write size=780662 2024-09-14T10:57:38.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.279+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~E21NS6I93ZGD.0 size=1048576 2024-09-14T10:57:38.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.283+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~E21NS6I93ZGD.1 size=114480 2024-09-14T10:57:38.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.283+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=E21NS6I93ZGD tag=60KGI6VPPJ0K type=write size=2211632 2024-09-14T10:57:38.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.287+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~3JW2PHLDHGWQ.0 size=1048576 2024-09-14T10:57:38.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.291+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~3JW2PHLDHGWQ.1 size=1048576 2024-09-14T10:57:38.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.295+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~3JW2PHLDHGWQ.2 size=46708 2024-09-14T10:57:38.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.299+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=3JW2PHLDHGWQ tag=S0A1ISS3RPIN type=write size=3192436 2024-09-14T10:57:38.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.307+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~VRV95WVQVYB9.0 size=1048576 2024-09-14T10:57:38.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.311+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~VRV95WVQVYB9.1 size=1048576 2024-09-14T10:57:38.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.311+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~VRV95WVQVYB9.2 size=116026 2024-09-14T10:57:38.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.311+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=VRV95WVQVYB9 tag=9IZUWLU76LHX type=write size=3261754 2024-09-14T10:57:38.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.315+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~1J0Z3JRBSK3F.0 size=1048576 2024-09-14T10:57:38.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.319+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~1J0Z3JRBSK3F.1 size=826523 2024-09-14T10:57:38.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.323+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=1J0Z3JRBSK3F tag=L3L6KMGUY7V2 type=write size=2923675 2024-09-14T10:57:38.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.327+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=7888MOLYVZM4 type=del size=676001 2024-09-14T10:57:38.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.331+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=6SHKM02BBQC4 type=del 2024-09-14T10:57:38.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.335+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~O72YOU3EGE07.0 size=507766 2024-09-14T10:57:38.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.335+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=O72YOU3EGE07 tag=ADPJ6T7SBGD0 type=write size=1556342 2024-09-14T10:57:38.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.343+0000 7fdf8f02c8c0 1 < suggested remove operation key=LCEH2YXNSOGT tag=S4NZWZPFRZVY type=write 2024-09-14T10:57:38.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.347+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=6OTDC8Y79N4B type=del size=2269297 2024-09-14T10:57:38.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.351+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=RLL16HYRL09S type=del 2024-09-14T10:57:38.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.355+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~WGV0STJ7L5RB.0 size=1048576 2024-09-14T10:57:38.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.359+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~WGV0STJ7L5RB.1 size=1048576 2024-09-14T10:57:38.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.363+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~WGV0STJ7L5RB.2 size=805774 2024-09-14T10:57:38.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.363+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=WGV0STJ7L5RB tag=3V3RK920EK3X type=write size=3951502 2024-09-14T10:57:38.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.371+0000 7fdf8f02c8c0 1 < suggested update operation key=XUT55FR490EO tag=NDAXC33YA3W0 type=del size=715697 2024-09-14T10:57:38.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.375+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=G428KI12P0AY type=write size=683184 2024-09-14T10:57:38.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.383+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~ZDOL6IT2OAUN.0 size=1048576 2024-09-14T10:57:38.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.383+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~ZDOL6IT2OAUN.1 size=1048576 2024-09-14T10:57:38.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.387+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~ZDOL6IT2OAUN.2 size=404928 2024-09-14T10:57:38.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.391+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=ZDOL6IT2OAUN tag=NZXXDJEY6X6I type=write size=3550656 2024-09-14T10:57:38.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.395+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=7I1MQ7AYD12B type=del size=2167171 2024-09-14T10:57:38.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.403+0000 7fdf8f02c8c0 1 < suggested update operation key=X1BN3054IKNS tag=HOUKDTBAUQL4 type=write size=824866 2024-09-14T10:57:38.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.407+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=84B92GVWSM6M type=del size=3426905 2024-09-14T10:57:38.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.415+0000 7fdf8f02c8c0 1 < suggested update operation key=APDKRWHOUH9T tag=MKF1RZEPE2PE type=del size=934137 2024-09-14T10:57:38.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.419+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=ENLDPJ9JXIX6 type=write size=126960 2024-09-14T10:57:38.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.423+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~G8QX3BIG9BN9.0 size=1048576 2024-09-14T10:57:38.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.427+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~G8QX3BIG9BN9.1 size=1048576 2024-09-14T10:57:38.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.427+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~G8QX3BIG9BN9.2 size=150995 2024-09-14T10:57:38.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.435+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=G8QX3BIG9BN9 tag=HYH23AKX90M1 type=write size=3296723 2024-09-14T10:57:38.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.439+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=LXM9FEUFGY0R type=del size=1723794 2024-09-14T10:57:38.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~WI6TANZOYS2W.0 size=1048576 2024-09-14T10:57:38.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~WI6TANZOYS2W.1 size=96364 2024-09-14T10:57:38.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.451+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=WI6TANZOYS2W tag=47CZNOLBA3XV type=write size=2193516 2024-09-14T10:57:38.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.455+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~1SWCXWOVH61P.0 size=1048576 2024-09-14T10:57:38.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.459+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~1SWCXWOVH61P.1 size=1048576 2024-09-14T10:57:38.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.463+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~1SWCXWOVH61P.2 size=511946 2024-09-14T10:57:38.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.463+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=1SWCXWOVH61P tag=PG4C6SUQD8HU type=write size=3657674 2024-09-14T10:57:38.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.463+0000 7fdf8f02c8c0 1 < canceled operation key=ZSBCGOXXJ0D5 tag=SI6L50GX92CY type=del size=3761071 2024-09-14T10:57:38.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.467+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=QNPP72UF267V type=del size=3800885 2024-09-14T10:57:38.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.471+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=DZOV20377AF9 type=del 2024-09-14T10:57:38.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.475+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=A21UWG7E1C4S type=del size=3373886 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.479+0000 7fdf8f02c8c0 1 < canceled operation key=82N2FPU7LKTG tag=5YKJSLWDS3JL type=del size=2878638 2024-09-14T10:57:38.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.487+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~WERP53549BXL.0 size=1048576 2024-09-14T10:57:38.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.491+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~WERP53549BXL.1 size=968021 2024-09-14T10:57:38.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.491+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=WERP53549BXL tag=CYF7R3SYWR12 type=write size=3065173 2024-09-14T10:57:38.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.495+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=T2VZV8TATOFP type=del 2024-09-14T10:57:38.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.499+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=0WL6OBN4VJGL type=del size=3840375 2024-09-14T10:57:38.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~E21NS6I93ZGD.0 size=1048576 2024-09-14T10:57:38.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.503+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~E21NS6I93ZGD.1 size=114480 2024-09-14T10:57:38.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.511+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=E21NS6I93ZGD tag=60KGI6VPPJ0K type=write size=2211632 2024-09-14T10:57:38.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.515+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=ADXN9ZRMF1XG type=del size=2561750 2024-09-14T10:57:38.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.523+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~VRV95WVQVYB9.0 size=1048576 2024-09-14T10:57:38.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.527+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~VRV95WVQVYB9.1 size=1048576 2024-09-14T10:57:38.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.531+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~VRV95WVQVYB9.2 size=116026 2024-09-14T10:57:38.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.535+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=VRV95WVQVYB9 tag=9IZUWLU76LHX type=write size=3261754 2024-09-14T10:57:38.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.539+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=M0Z7WK0Y06DQ type=write size=623009 2024-09-14T10:57:38.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.543+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=7888MOLYVZM4 type=del 2024-09-14T10:57:38.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.551+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~R4MNGR6QJ2UU.0 size=1048576 2024-09-14T10:57:38.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.551+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~R4MNGR6QJ2UU.1 size=1048576 2024-09-14T10:57:38.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.555+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~R4MNGR6QJ2UU.2 size=828092 2024-09-14T10:57:38.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.555+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=R4MNGR6QJ2UU tag=HAA7KFXVQYER type=write size=3973820 2024-09-14T10:57:38.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.559+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~O72YOU3EGE07.0 size=507766 2024-09-14T10:57:38.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.567+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=O72YOU3EGE07 tag=ADPJ6T7SBGD0 type=write size=1556342 2024-09-14T10:57:38.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.567+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=NTY6S04XWWOI type=del size=2490216 2024-09-14T10:57:38.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.571+0000 7fdf8f02c8c0 1 < canceled operation key=82N2FPU7LKTG tag=6OTDC8Y79N4B type=del size=2269297 2024-09-14T10:57:38.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.575+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=16EWERCAR287 type=write size=63791 2024-09-14T10:57:38.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.579+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~WGV0STJ7L5RB.0 size=1048576 2024-09-14T10:57:38.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.583+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~WGV0STJ7L5RB.1 size=1048576 2024-09-14T10:57:38.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.587+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~WGV0STJ7L5RB.2 size=805774 2024-09-14T10:57:38.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.591+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=WGV0STJ7L5RB tag=3V3RK920EK3X type=write size=3951502 2024-09-14T10:57:38.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.595+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=I4N23KEUF7UQ type=del size=201902 2024-09-14T10:57:38.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.599+0000 7fdf8f02c8c0 1 < completed write operation key=Y32RWGISRBMT tag=G428KI12P0AY type=write size=683184 2024-09-14T10:57:38.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.603+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=XWVJ234K3Z0F type=del size=78648 2024-09-14T10:57:38.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.607+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=7I1MQ7AYD12B type=del 2024-09-14T10:57:38.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.611+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~BXC0XIO5B2DE.0 size=500567 2024-09-14T10:57:38.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.611+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=BXC0XIO5B2DE tag=GTNALKHBKRYS type=write size=1549143 2024-09-14T10:57:38.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.615+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=84B92GVWSM6M type=del 2024-09-14T10:57:38.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.619+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=H5XCI0NDCWHX type=del size=1193535 2024-09-14T10:57:38.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.627+0000 7fdf8f02c8c0 1 < suggested remove operation key=HCGZ1MY5SKW9 tag=ENLDPJ9JXIX6 type=write 2024-09-14T10:57:38.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.631+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=GWDUHWWMQ4DX type=del size=1814704 2024-09-14T10:57:38.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.635+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=LXM9FEUFGY0R type=del 2024-09-14T10:57:38.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.639+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=6M4UYG72QOD0 type=del size=589511 2024-09-14T10:57:38.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.643+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~1SWCXWOVH61P.0 size=1048576 2024-09-14T10:57:38.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.643+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~1SWCXWOVH61P.1 size=1048576 2024-09-14T10:57:38.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.647+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~1SWCXWOVH61P.2 size=511946 2024-09-14T10:57:38.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.655+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=1SWCXWOVH61P tag=PG4C6SUQD8HU type=write size=3657674 2024-09-14T10:57:38.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.659+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~UJ4L32UY6C8V.0 size=1048576 2024-09-14T10:57:38.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.663+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~UJ4L32UY6C8V.1 size=1048576 2024-09-14T10:57:38.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~UJ4L32UY6C8V.2 size=236025 2024-09-14T10:57:38.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.667+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=UJ4L32UY6C8V tag=NDPWQ24LOKAH type=write size=3381753 2024-09-14T10:57:38.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.667+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=QNPP72UF267V type=del 2024-09-14T10:57:38.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.671+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=5NO6LFJMCIQF type=del size=3078847 2024-09-14T10:57:38.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.679+0000 7fdf8f02c8c0 1 < suggested update operation key=49O8DPTGA65S tag=A21UWG7E1C4S type=del size=3373886 2024-09-14T10:57:38.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.687+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~L8J7P036IN0E.0 size=1048576 2024-09-14T10:57:38.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.691+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~L8J7P036IN0E.1 size=1048576 2024-09-14T10:57:38.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.691+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~L8J7P036IN0E.2 size=56568 2024-09-14T10:57:38.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.691+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=L8J7P036IN0E tag=MQHFI8YTR6F1 type=write size=3202296 2024-09-14T10:57:38.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.695+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~WERP53549BXL.0 size=1048576 2024-09-14T10:57:38.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.699+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~WERP53549BXL.1 size=968021 2024-09-14T10:57:38.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.703+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=WERP53549BXL tag=CYF7R3SYWR12 type=write size=3065173 2024-09-14T10:57:38.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.707+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=UPXRTQ314V5L type=del size=4124629 2024-09-14T10:57:38.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.711+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=0WL6OBN4VJGL type=del 2024-09-14T10:57:38.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.715+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=EJOAJPIS8UJU type=del size=3300947 2024-09-14T10:57:38.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.719+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=ADXN9ZRMF1XG type=del 2024-09-14T10:57:38.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.723+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=SMOU5HZBYFKC type=del size=3814797 2024-09-14T10:57:38.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.727+0000 7fdf8f02c8c0 1 < completed write operation key=OFY1G5R28CK6 tag=M0Z7WK0Y06DQ type=write size=623009 2024-09-14T10:57:38.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.731+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=LCS00IMPF6DR type=write size=1026241 2024-09-14T10:57:38.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.735+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~R4MNGR6QJ2UU.0 size=1048576 2024-09-14T10:57:38.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.735+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~R4MNGR6QJ2UU.1 size=1048576 2024-09-14T10:57:38.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.739+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~R4MNGR6QJ2UU.2 size=828092 2024-09-14T10:57:38.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.747+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=R4MNGR6QJ2UU tag=HAA7KFXVQYER type=write size=3973820 2024-09-14T10:57:38.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.751+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=VS0XOWUOFFXM type=write size=899873 2024-09-14T10:57:38.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.751+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=NTY6S04XWWOI type=del 2024-09-14T10:57:38.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.755+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=FT6YL1SVUF38 type=del size=283593 2024-09-14T10:57:38.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.763+0000 7fdf8f02c8c0 1 < suggested update operation key=9IDBODZBQRJR tag=16EWERCAR287 type=write size=63791 2024-09-14T10:57:38.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.771+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=0L8Y8MC8ZQWZ type=write size=905903 2024-09-14T10:57:38.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.775+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=I4N23KEUF7UQ type=del 2024-09-14T10:57:38.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.783+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~R8OEK4C319IH.0 size=1048576 2024-09-14T10:57:38.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.783+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~R8OEK4C319IH.1 size=1048576 2024-09-14T10:57:38.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.787+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~R8OEK4C319IH.2 size=29651 2024-09-14T10:57:38.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.787+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=R8OEK4C319IH tag=W31MUC6FBEJC type=write size=3175379 2024-09-14T10:57:38.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.795+0000 7fdf8f02c8c0 1 < suggested remove operation key=K3KJ7HDQF6ZH tag=XWVJ234K3Z0F type=del 2024-09-14T10:57:38.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.799+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=2V1ZJP4G47EL type=del size=2792118 2024-09-14T10:57:38.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.807+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~BXC0XIO5B2DE.0 size=500567 2024-09-14T10:57:38.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.811+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=BXC0XIO5B2DE tag=GTNALKHBKRYS type=write size=1549143 2024-09-14T10:57:38.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.819+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~TY9AXT7JMMU9.0 size=1048576 2024-09-14T10:57:38.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.823+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~TY9AXT7JMMU9.1 size=27957 2024-09-14T10:57:38.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.823+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=TY9AXT7JMMU9 tag=25ZFY98XPW8R type=write size=2125109 2024-09-14T10:57:38.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.827+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=H5XCI0NDCWHX type=del 2024-09-14T10:57:38.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.831+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=35PBBMPM4F81 type=write size=352012 2024-09-14T10:57:38.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.835+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=GWDUHWWMQ4DX type=del 2024-09-14T10:57:38.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.839+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~R2MKNNF1W2PU.0 size=1048576 2024-09-14T10:57:38.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.843+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~R2MKNNF1W2PU.1 size=1048576 2024-09-14T10:57:38.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.847+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~R2MKNNF1W2PU.2 size=397651 2024-09-14T10:57:38.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.847+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=R2MKNNF1W2PU tag=U6BL33KTBWJN type=write size=3543379 2024-09-14T10:57:38.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.851+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=6M4UYG72QOD0 type=del 2024-09-14T10:57:38.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.855+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=X3X6CM0YGCFW type=del size=1946541 2024-09-14T10:57:38.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.859+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~UJ4L32UY6C8V.0 size=1048576 2024-09-14T10:57:38.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.859+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_MNBXQTJBS1QS.2~UJ4L32UY6C8V.1 size=1048576 2024-09-14T10:57:38.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.859+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~UJ4L32UY6C8V.2 size=236025 2024-09-14T10:57:38.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.871+0000 7fdf8f02c8c0 1 < canceled multipart upload key=MNBXQTJBS1QS upload=UJ4L32UY6C8V tag=NDPWQ24LOKAH type=write size=3381753 2024-09-14T10:57:38.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.875+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=E4WOKRAMXLGV type=del size=645703 2024-09-14T10:57:38.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.879+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=5NO6LFJMCIQF type=del 2024-09-14T10:57:38.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.883+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=UTWQCO2BHRGI type=del size=1002082 2024-09-14T10:57:38.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.887+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~L8J7P036IN0E.0 size=1048576 2024-09-14T10:57:38.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.891+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~L8J7P036IN0E.1 size=1048576 2024-09-14T10:57:38.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.891+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~L8J7P036IN0E.2 size=56568 2024-09-14T10:57:38.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.899+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=L8J7P036IN0E tag=MQHFI8YTR6F1 type=write size=3202296 2024-09-14T10:57:38.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.907+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~XR1UK0H515T7.0 size=1048576 2024-09-14T10:57:38.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.907+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~XR1UK0H515T7.1 size=1038899 2024-09-14T10:57:38.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.907+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=XR1UK0H515T7 tag=VTPLZJP1VNDC type=write size=3136051 2024-09-14T10:57:38.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.911+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=UPXRTQ314V5L type=del 2024-09-14T10:57:38.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.919+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~DTAOGAOLQ81M.0 size=1048576 2024-09-14T10:57:38.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~DTAOGAOLQ81M.1 size=382254 2024-09-14T10:57:38.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.923+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=DTAOGAOLQ81M tag=A1RR84BOW4X3 type=write size=2479406 2024-09-14T10:57:38.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.927+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=EJOAJPIS8UJU type=del 2024-09-14T10:57:38.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.931+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~C90LJS9182T0.0 size=1048576 2024-09-14T10:57:38.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.935+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~C90LJS9182T0.1 size=1048576 2024-09-14T10:57:38.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.939+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~C90LJS9182T0.2 size=1007291 2024-09-14T10:57:38.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.939+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=C90LJS9182T0 tag=8JDHU43FRPA1 type=write size=4153019 2024-09-14T10:57:38.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.943+0000 7fdf8f02c8c0 1 < canceled operation key=49O8DPTGA65S tag=SMOU5HZBYFKC type=del size=3814797 2024-09-14T10:57:38.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.947+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=V06ZZ667G7HS type=del size=799857 2024-09-14T10:57:38.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.951+0000 7fdf8f02c8c0 1 < completed write operation key=5VZCCFRUAQJ7 tag=LCS00IMPF6DR type=write size=1026241 2024-09-14T10:57:38.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.955+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=GG9UF1P3XUM5 type=write size=711714 2024-09-14T10:57:38.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.959+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=VS0XOWUOFFXM type=write size=899873 2024-09-14T10:57:38.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.963+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=UOYM8BEWQDAB type=write size=652874 2024-09-14T10:57:38.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.967+0000 7fdf8f02c8c0 1 < canceled operation key=82N2FPU7LKTG tag=FT6YL1SVUF38 type=del size=283593 2024-09-14T10:57:38.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.971+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~RQB8D0FGF8T9.0 size=467550 2024-09-14T10:57:38.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.971+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=RQB8D0FGF8T9 tag=ZMV8DPH8ST29 type=write size=1516126 2024-09-14T10:57:38.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.975+0000 7fdf8f02c8c0 1 < completed write operation key=3CYCJJIQ210M tag=0L8Y8MC8ZQWZ type=write size=905903 2024-09-14T10:57:38.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.979+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=6NSIGR9753FQ type=write size=461729 2024-09-14T10:57:38.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.983+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~R8OEK4C319IH.0 size=1048576 2024-09-14T10:57:38.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~R8OEK4C319IH.1 size=1048576 2024-09-14T10:57:38.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~R8OEK4C319IH.2 size=29651 2024-09-14T10:57:38.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.995+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=R8OEK4C319IH tag=W31MUC6FBEJC type=write size=3175379 2024-09-14T10:57:38.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:38.999+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=UF0R9LK6KWMW type=write size=621086 2024-09-14T10:57:39.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.003+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=2V1ZJP4G47EL type=del 2024-09-14T10:57:39.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.007+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=1AQFGUNNTYNG type=del size=479089 2024-09-14T10:57:39.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.007+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_X0RT8UF3D0JC.2~TY9AXT7JMMU9.0 size=1048576 2024-09-14T10:57:39.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.011+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~TY9AXT7JMMU9.1 size=27957 2024-09-14T10:57:39.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.019+0000 7fdf8f02c8c0 1 < canceled multipart upload key=X0RT8UF3D0JC upload=TY9AXT7JMMU9 tag=25ZFY98XPW8R type=write size=2125109 2024-09-14T10:57:39.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.023+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=UVVS5T1OMHNA type=del size=2570139 2024-09-14T10:57:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.027+0000 7fdf8f02c8c0 1 < completed write operation key=82N2FPU7LKTG tag=35PBBMPM4F81 type=write size=352012 2024-09-14T10:57:39.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.031+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=C9RLD4YANPXG type=del size=822242 2024-09-14T10:57:39.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.035+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~R2MKNNF1W2PU.0 size=1048576 2024-09-14T10:57:39.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.035+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~R2MKNNF1W2PU.1 size=1048576 2024-09-14T10:57:39.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.039+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~R2MKNNF1W2PU.2 size=397651 2024-09-14T10:57:39.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.047+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=R2MKNNF1W2PU tag=U6BL33KTBWJN type=write size=3543379 2024-09-14T10:57:39.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.051+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=GJROQIDWZZUB type=del size=2414353 2024-09-14T10:57:39.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.055+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=X3X6CM0YGCFW type=del 2024-09-14T10:57:39.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MSUEA7871P4D.0 size=1048576 2024-09-14T10:57:39.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.067+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MSUEA7871P4D.1 size=1048576 2024-09-14T10:57:39.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.067+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MSUEA7871P4D.2 size=877278 2024-09-14T10:57:39.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.067+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=MSUEA7871P4D tag=P84AFGUJW7GE type=write size=4023006 2024-09-14T10:57:39.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.075+0000 7fdf8f02c8c0 1 < suggested update operation key=OFY1G5R28CK6 tag=E4WOKRAMXLGV type=del size=645703 2024-09-14T10:57:39.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~I0C0X2GV053V.0 size=660209 2024-09-14T10:57:39.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.083+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=I0C0X2GV053V tag=614MNPRJ2KNL type=write size=1708785 2024-09-14T10:57:39.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.087+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=UTWQCO2BHRGI type=del 2024-09-14T10:57:39.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.091+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=ZLB0ZXFOH8HR type=del size=1827227 2024-09-14T10:57:39.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.095+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~XR1UK0H515T7.0 size=1048576 2024-09-14T10:57:39.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.099+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~XR1UK0H515T7.1 size=1038899 2024-09-14T10:57:39.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.107+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=XR1UK0H515T7 tag=VTPLZJP1VNDC type=write size=3136051 2024-09-14T10:57:39.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.111+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=8OLD0UROZYGI type=del size=2579335 2024-09-14T10:57:39.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.115+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~DTAOGAOLQ81M.0 size=1048576 2024-09-14T10:57:39.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.115+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~DTAOGAOLQ81M.1 size=382254 2024-09-14T10:57:39.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.123+0000 7fdf8f02c8c0 1 < canceled multipart upload key=XUT55FR490EO upload=DTAOGAOLQ81M tag=A1RR84BOW4X3 type=write size=2479406 2024-09-14T10:57:39.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.127+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~7ISL63XVXQ5Q.0 size=1048576 2024-09-14T10:57:39.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.131+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~7ISL63XVXQ5Q.1 size=1048576 2024-09-14T10:57:39.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.135+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~7ISL63XVXQ5Q.2 size=150935 2024-09-14T10:57:39.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.135+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=7ISL63XVXQ5Q tag=5QRE9VG7RSUD type=write size=3296663 2024-09-14T10:57:39.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.139+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~C90LJS9182T0.0 size=1048576 2024-09-14T10:57:39.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.143+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~C90LJS9182T0.1 size=1048576 2024-09-14T10:57:39.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.143+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~C90LJS9182T0.2 size=1007291 2024-09-14T10:57:39.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.151+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=C90LJS9182T0 tag=8JDHU43FRPA1 type=write size=4153019 2024-09-14T10:57:39.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.155+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=H1G8OI0MWQXD type=write size=233372 2024-09-14T10:57:39.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.159+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=V06ZZ667G7HS type=del 2024-09-14T10:57:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.159+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=TOK3PQDTDR5T type=del size=416469 2024-09-14T10:57:39.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.163+0000 7fdf8f02c8c0 1 < completed write operation key=5VZCCFRUAQJ7 tag=GG9UF1P3XUM5 type=write size=711714 2024-09-14T10:57:39.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.167+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=OL7YT23ACKL2 type=write size=627939 2024-09-14T10:57:39.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.175+0000 7fdf8f02c8c0 1 < suggested remove operation key=OFY1G5R28CK6 tag=UOYM8BEWQDAB type=write 2024-09-14T10:57:39.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.183+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~7E5JLI65B410.0 size=1048576 2024-09-14T10:57:39.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.187+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~7E5JLI65B410.1 size=317927 2024-09-14T10:57:39.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.187+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=7E5JLI65B410 tag=1873D32CVGI6 type=write size=2415079 2024-09-14T10:57:39.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.191+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~RQB8D0FGF8T9.0 size=467550 2024-09-14T10:57:39.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.199+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=RQB8D0FGF8T9 tag=ZMV8DPH8ST29 type=write size=1516126 2024-09-14T10:57:39.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~UL4P2HK4I3B7.0 size=1048576 2024-09-14T10:57:39.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.211+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~UL4P2HK4I3B7.1 size=1048576 2024-09-14T10:57:39.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.215+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~UL4P2HK4I3B7.2 size=69500 2024-09-14T10:57:39.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.215+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=UL4P2HK4I3B7 tag=CCJBNO3YUCDJ type=write size=3215228 2024-09-14T10:57:39.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.219+0000 7fdf8f02c8c0 1 < completed write operation key=9IDBODZBQRJR tag=6NSIGR9753FQ type=write size=461729 2024-09-14T10:57:39.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.227+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~5812JBRGOC8T.0 size=1048576 2024-09-14T10:57:39.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.235+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~5812JBRGOC8T.1 size=401107 2024-09-14T10:57:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.235+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=5812JBRGOC8T tag=MB1V17ATGBZQ type=write size=2498259 2024-09-14T10:57:39.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.243+0000 7fdf8f02c8c0 1 < suggested remove operation key=STHEUJ6VDPQB tag=UF0R9LK6KWMW type=write 2024-09-14T10:57:39.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.251+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~T1IM58XQFDIR.0 size=710580 2024-09-14T10:57:39.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.251+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=T1IM58XQFDIR tag=38YI05ARC2H8 type=write size=1759156 2024-09-14T10:57:39.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.255+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=1AQFGUNNTYNG type=del 2024-09-14T10:57:39.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~BLHFTS29FLQX.0 size=412391 2024-09-14T10:57:39.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.259+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=BLHFTS29FLQX tag=29U1Y67GVTJ0 type=write size=1460967 2024-09-14T10:57:39.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.263+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=UVVS5T1OMHNA type=del 2024-09-14T10:57:39.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.267+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=E1J4UDP0CC31 type=del size=4112864 2024-09-14T10:57:39.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.271+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=C9RLD4YANPXG type=del 2024-09-14T10:57:39.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.275+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=FDGSP6GEST3M type=del size=714445 2024-09-14T10:57:39.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.283+0000 7fdf8f02c8c0 1 < suggested remove operation key=APDKRWHOUH9T tag=GJROQIDWZZUB type=del 2024-09-14T10:57:39.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.287+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=DLES5RRAMO6U type=del size=2692454 2024-09-14T10:57:39.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.291+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MSUEA7871P4D.0 size=1048576 2024-09-14T10:57:39.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.295+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MSUEA7871P4D.1 size=1048576 2024-09-14T10:57:39.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.295+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MSUEA7871P4D.2 size=877278 2024-09-14T10:57:39.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.303+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=MSUEA7871P4D tag=P84AFGUJW7GE type=write size=4023006 2024-09-14T10:57:39.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.307+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=XKHB2RDD4YNF type=write size=325383 2024-09-14T10:57:39.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.311+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~I0C0X2GV053V.0 size=660209 2024-09-14T10:57:39.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.315+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=I0C0X2GV053V tag=614MNPRJ2KNL type=write size=1708785 2024-09-14T10:57:39.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.319+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=AZ91X9UQNGY3 type=del size=790978 2024-09-14T10:57:39.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.323+0000 7fdf8f02c8c0 -1 < failed to complete operation key=OFY1G5R28CK6 tag=ZLB0ZXFOH8HR type=del size=1827227: (22) Invalid argument 2024-09-14T10:57:39.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.331+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~JKVJ0YKX394F.0 size=690868 2024-09-14T10:57:39.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.331+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=JKVJ0YKX394F tag=NVVHCIQB2LMW type=write size=1739444 2024-09-14T10:57:39.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.335+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=8OLD0UROZYGI type=del 2024-09-14T10:57:39.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.339+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=U3WD8WFL029R type=del size=2300327 2024-09-14T10:57:39.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.343+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~7ISL63XVXQ5Q.0 size=1048576 2024-09-14T10:57:39.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.347+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~7ISL63XVXQ5Q.1 size=1048576 2024-09-14T10:57:39.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.351+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~7ISL63XVXQ5Q.2 size=150935 2024-09-14T10:57:39.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.355+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=7ISL63XVXQ5Q tag=5QRE9VG7RSUD type=write size=3296663 2024-09-14T10:57:39.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.359+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=ZDWXWL3XBMEB type=del size=2265545 2024-09-14T10:57:39.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.363+0000 7fdf8f02c8c0 -1 < failed to complete operation key=OFY1G5R28CK6 tag=H1G8OI0MWQXD type=write size=233372: (22) Invalid argument 2024-09-14T10:57:39.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.367+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=FSK3OM4UZF8H type=write size=114007 2024-09-14T10:57:39.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.371+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=TOK3PQDTDR5T type=del 2024-09-14T10:57:39.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.375+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=AMRM79BTJMKG type=del size=1073353 2024-09-14T10:57:39.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.379+0000 7fdf8f02c8c0 1 < completed write operation key=X0RT8UF3D0JC tag=OL7YT23ACKL2 type=write size=627939 2024-09-14T10:57:39.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.383+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=LXGQNUBASRDQ type=del size=506384 2024-09-14T10:57:39.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.387+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~7E5JLI65B410.0 size=1048576 2024-09-14T10:57:39.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.391+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~7E5JLI65B410.1 size=317927 2024-09-14T10:57:39.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.399+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=7E5JLI65B410 tag=1873D32CVGI6 type=write size=2415079 2024-09-14T10:57:39.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.403+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=B9O5B2B5245A type=del size=265477 2024-09-14T10:57:39.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.407+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~UL4P2HK4I3B7.0 size=1048576 2024-09-14T10:57:39.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.407+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~UL4P2HK4I3B7.1 size=1048576 2024-09-14T10:57:39.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.411+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~UL4P2HK4I3B7.2 size=69500 2024-09-14T10:57:39.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.415+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=UL4P2HK4I3B7 tag=CCJBNO3YUCDJ type=write size=3215228 2024-09-14T10:57:39.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.419+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=6DUT7TN1ZT2B type=del size=2351432 2024-09-14T10:57:39.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.419+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3CYCJJIQ210M.2~5812JBRGOC8T.0 size=1048576 2024-09-14T10:57:39.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.419+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~5812JBRGOC8T.1 size=401107 2024-09-14T10:57:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.423+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3CYCJJIQ210M upload=5812JBRGOC8T tag=MB1V17ATGBZQ type=write size=2498259 2024-09-14T10:57:39.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.427+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=7UST006RJVQD type=write size=822247 2024-09-14T10:57:39.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.431+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~T1IM58XQFDIR.0 size=710580 2024-09-14T10:57:39.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.435+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=T1IM58XQFDIR tag=38YI05ARC2H8 type=write size=1759156 2024-09-14T10:57:39.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.439+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=JW0NJZQGHM5Y type=del size=690163 2024-09-14T10:57:39.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~BLHFTS29FLQX.0 size=412391 2024-09-14T10:57:39.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.447+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=BLHFTS29FLQX tag=29U1Y67GVTJ0 type=write size=1460967 2024-09-14T10:57:39.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.451+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~6TIX7WFIQIO0.0 size=1048576 2024-09-14T10:57:39.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.455+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~6TIX7WFIQIO0.1 size=737515 2024-09-14T10:57:39.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.455+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=6TIX7WFIQIO0 tag=IIHMJY9ABR9H type=write size=2834667 2024-09-14T10:57:39.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.459+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=E1J4UDP0CC31 type=del 2024-09-14T10:57:39.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.463+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~RT009XPPGXEF.0 size=279488 2024-09-14T10:57:39.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.463+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=RT009XPPGXEF tag=6SPHS998H1XV type=write size=1328064 2024-09-14T10:57:39.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.471+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=FDGSP6GEST3M type=del 2024-09-14T10:57:39.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.475+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=L1BEM6LLGR8F type=write size=171755 2024-09-14T10:57:39.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.479+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=DLES5RRAMO6U type=del 2024-09-14T10:57:39.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.483+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=5ROXV1CUNFWF type=del size=1986362 2024-09-14T10:57:39.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.487+0000 7fdf8f02c8c0 1 < canceled operation key=6VNI8FMHZ0FN tag=XKHB2RDD4YNF type=write size=325383 2024-09-14T10:57:39.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.491+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=F2TY18MSL0VG type=del size=2538070 2024-09-14T10:57:39.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.495+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=AZ91X9UQNGY3 type=del 2024-09-14T10:57:39.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.499+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=3Z06VCVPV48F type=write size=733058 2024-09-14T10:57:39.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.503+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~JKVJ0YKX394F.0 size=690868 2024-09-14T10:57:39.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.507+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=JKVJ0YKX394F tag=NVVHCIQB2LMW type=write size=1739444 2024-09-14T10:57:39.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.511+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~KG01I34M89TP.0 size=27066 2024-09-14T10:57:39.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.511+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=KG01I34M89TP tag=8NBL1AHN638Y type=write size=1075642 2024-09-14T10:57:39.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.515+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=U3WD8WFL029R type=del 2024-09-14T10:57:39.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.519+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=45UER4CPWYR3 type=del size=3252370 2024-09-14T10:57:39.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.527+0000 7fdf8f02c8c0 1 < suggested update operation key=HCGZ1MY5SKW9 tag=ZDWXWL3XBMEB type=del size=2265545 2024-09-14T10:57:39.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.531+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=AL8J7B7HJ9B2 type=write size=243836 2024-09-14T10:57:39.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.539+0000 7fdf8f02c8c0 1 < suggested update operation key=OFY1G5R28CK6 tag=FSK3OM4UZF8H type=write size=114007 2024-09-14T10:57:39.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.543+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~I9TXS9PR83QY.0 size=1048576 2024-09-14T10:57:39.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.547+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~I9TXS9PR83QY.1 size=1048576 2024-09-14T10:57:39.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.551+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~I9TXS9PR83QY.2 size=367380 2024-09-14T10:57:39.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.551+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=I9TXS9PR83QY tag=SJ6VAUC5GH1R type=write size=3513108 2024-09-14T10:57:39.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.555+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=AMRM79BTJMKG type=del 2024-09-14T10:57:39.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.559+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~X4L2OTG4GZ9G.0 size=412381 2024-09-14T10:57:39.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.559+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=X4L2OTG4GZ9G tag=3UY62QDHL3Z2 type=write size=1460957 2024-09-14T10:57:39.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.563+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=LXGQNUBASRDQ type=del 2024-09-14T10:57:39.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.567+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=Y9EZQMZDOPE8 type=del size=3502868 2024-09-14T10:57:39.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.575+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=B9O5B2B5245A type=del 2024-09-14T10:57:39.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.579+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=1W1TEKPVJT6X type=del size=1542112 2024-09-14T10:57:39.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.583+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=6DUT7TN1ZT2B type=del 2024-09-14T10:57:39.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.583+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=L8IOCDXM4D1Z type=del size=3857751 2024-09-14T10:57:39.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.591+0000 7fdf8f02c8c0 1 < suggested remove operation key=3CYCJJIQ210M tag=7UST006RJVQD type=write 2024-09-14T10:57:39.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.595+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=SI7NY4LOCD52 type=del size=1167332 2024-09-14T10:57:39.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.599+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=JW0NJZQGHM5Y type=del 2024-09-14T10:57:39.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~1F89DAU72QZJ.0 size=1048576 2024-09-14T10:57:39.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~1F89DAU72QZJ.1 size=1048576 2024-09-14T10:57:39.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.611+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~1F89DAU72QZJ.2 size=111797 2024-09-14T10:57:39.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.611+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=1F89DAU72QZJ tag=LMIXWKDSLMK4 type=write size=3257525 2024-09-14T10:57:39.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.615+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~6TIX7WFIQIO0.0 size=1048576 2024-09-14T10:57:39.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.619+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~6TIX7WFIQIO0.1 size=737515 2024-09-14T10:57:39.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.623+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=6TIX7WFIQIO0 tag=IIHMJY9ABR9H type=write size=2834667 2024-09-14T10:57:39.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.627+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=9JC5Y4DWL19L type=del size=3312765 2024-09-14T10:57:39.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.631+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~RT009XPPGXEF.0 size=279488 2024-09-14T10:57:39.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.635+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=RT009XPPGXEF tag=6SPHS998H1XV type=write size=1328064 2024-09-14T10:57:39.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.639+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=ZGB1DAI1I074 type=del size=3638330 2024-09-14T10:57:39.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.643+0000 7fdf8f02c8c0 1 < completed write operation key=TZZ05IIMZJ4J tag=L1BEM6LLGR8F type=write size=171755 2024-09-14T10:57:39.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~PO485G28R339.0 size=1048576 2024-09-14T10:57:39.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~PO485G28R339.1 size=1048576 2024-09-14T10:57:39.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~PO485G28R339.2 size=290064 2024-09-14T10:57:39.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.655+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=PO485G28R339 tag=T19OLVW5RO25 type=write size=3435792 2024-09-14T10:57:39.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.659+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=5ROXV1CUNFWF type=del 2024-09-14T10:57:39.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.663+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~DZT8BUTJLEMZ.0 size=1048576 2024-09-14T10:57:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~DZT8BUTJLEMZ.1 size=534526 2024-09-14T10:57:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.667+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=DZT8BUTJLEMZ tag=OC0FUQ8JZ3HK type=write size=2631678 2024-09-14T10:57:39.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.671+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=F2TY18MSL0VG type=del 2024-09-14T10:57:39.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.675+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=4L3K7JJJ64OJ type=del size=174990 2024-09-14T10:57:39.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.679+0000 7fdf8f02c8c0 1 < completed write operation key=304ZNF4OC1ML tag=3Z06VCVPV48F type=write size=733058 2024-09-14T10:57:39.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~51EHW86FH3BQ.0 size=1048576 2024-09-14T10:57:39.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.687+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~51EHW86FH3BQ.1 size=615430 2024-09-14T10:57:39.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.687+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=51EHW86FH3BQ tag=8AF9OVNXB58A type=write size=2712582 2024-09-14T10:57:39.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.691+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~KG01I34M89TP.0 size=27066 2024-09-14T10:57:39.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.695+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=KG01I34M89TP tag=8NBL1AHN638Y type=write size=1075642 2024-09-14T10:57:39.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.699+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=D6H3VQBPZ1EB type=del size=2964098 2024-09-14T10:57:39.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.707+0000 7fdf8f02c8c0 1 < suggested remove operation key=APDKRWHOUH9T tag=45UER4CPWYR3 type=del 2024-09-14T10:57:39.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.711+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=2DFJ4E9P61WV type=del size=3509993 2024-09-14T10:57:39.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.715+0000 7fdf8f02c8c0 1 < completed write operation key=Y32RWGISRBMT tag=AL8J7B7HJ9B2 type=write size=243836 2024-09-14T10:57:39.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.719+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=PGB025JOHRVP type=del size=3917535 2024-09-14T10:57:39.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.719+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~I9TXS9PR83QY.0 size=1048576 2024-09-14T10:57:39.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~I9TXS9PR83QY.1 size=1048576 2024-09-14T10:57:39.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.727+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~I9TXS9PR83QY.2 size=367380 2024-09-14T10:57:39.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.731+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=I9TXS9PR83QY tag=SJ6VAUC5GH1R type=write size=3513108 2024-09-14T10:57:39.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.739+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~OIUG17DNVG0E.0 size=1048576 2024-09-14T10:57:39.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.739+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~OIUG17DNVG0E.1 size=1048576 2024-09-14T10:57:39.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.743+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~OIUG17DNVG0E.2 size=930352 2024-09-14T10:57:39.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.743+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=OIUG17DNVG0E tag=3IYW21YWYH5E type=write size=4076080 2024-09-14T10:57:39.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.747+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~X4L2OTG4GZ9G.0 size=412381 2024-09-14T10:57:39.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.751+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=X4L2OTG4GZ9G tag=3UY62QDHL3Z2 type=write size=1460957 2024-09-14T10:57:39.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.759+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~NJWJDVTDNMNR.0 size=1048576 2024-09-14T10:57:39.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~NJWJDVTDNMNR.1 size=125964 2024-09-14T10:57:39.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.763+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=NJWJDVTDNMNR tag=C0NY74TXFHXJ type=write size=2223116 2024-09-14T10:57:39.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.767+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=Y9EZQMZDOPE8 type=del 2024-09-14T10:57:39.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.771+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~9G3KHSY80ZPT.0 size=1048576 2024-09-14T10:57:39.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~9G3KHSY80ZPT.1 size=1048576 2024-09-14T10:57:39.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~9G3KHSY80ZPT.2 size=638422 2024-09-14T10:57:39.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.775+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=9G3KHSY80ZPT tag=2POMURH20Z75 type=write size=3784150 2024-09-14T10:57:39.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.779+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=1W1TEKPVJT6X type=del 2024-09-14T10:57:39.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.783+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=F70A8750QDH7 type=del size=2766652 2024-09-14T10:57:39.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.787+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=L8IOCDXM4D1Z type=del 2024-09-14T10:57:39.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.791+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~4IDQMFRUZCRM.0 size=1048576 2024-09-14T10:57:39.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~4IDQMFRUZCRM.1 size=1048576 2024-09-14T10:57:39.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.799+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~4IDQMFRUZCRM.2 size=140351 2024-09-14T10:57:39.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.799+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=4IDQMFRUZCRM tag=WPV71QKX2FUW type=write size=3286079 2024-09-14T10:57:39.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.803+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=SI7NY4LOCD52 type=del 2024-09-14T10:57:39.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.811+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~X0PM8JYMENSZ.0 size=327771 2024-09-14T10:57:39.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.811+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=X0PM8JYMENSZ tag=Y451Q7D6DSV0 type=write size=1376347 2024-09-14T10:57:39.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~1F89DAU72QZJ.0 size=1048576 2024-09-14T10:57:39.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~1F89DAU72QZJ.1 size=1048576 2024-09-14T10:57:39.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.819+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~1F89DAU72QZJ.2 size=111797 2024-09-14T10:57:39.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.823+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=1F89DAU72QZJ tag=LMIXWKDSLMK4 type=write size=3257525 2024-09-14T10:57:39.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.827+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=8QRZB1X2TIL5 type=write size=461801 2024-09-14T10:57:39.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.831+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=9JC5Y4DWL19L type=del 2024-09-14T10:57:39.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.835+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=8VR9N5MBO0I9 type=write size=807391 2024-09-14T10:57:39.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.839+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=ZGB1DAI1I074 type=del 2024-09-14T10:57:39.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.843+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=LA3S8CS0PWZT type=del size=960743 2024-09-14T10:57:39.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.847+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~PO485G28R339.0 size=1048576 2024-09-14T10:57:39.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.847+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_Y32RWGISRBMT.2~PO485G28R339.1 size=1048576 2024-09-14T10:57:39.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.847+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~PO485G28R339.2 size=290064 2024-09-14T10:57:39.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.855+0000 7fdf8f02c8c0 1 < canceled multipart upload key=Y32RWGISRBMT upload=PO485G28R339 tag=T19OLVW5RO25 type=write size=3435792 2024-09-14T10:57:39.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.859+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=XNP247Q11TTH type=del size=1177190 2024-09-14T10:57:39.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.863+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~DZT8BUTJLEMZ.0 size=1048576 2024-09-14T10:57:39.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.863+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~DZT8BUTJLEMZ.1 size=534526 2024-09-14T10:57:39.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.871+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=DZT8BUTJLEMZ tag=OC0FUQ8JZ3HK type=write size=2631678 2024-09-14T10:57:39.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.879+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~P4UUTPNV3SA4.0 size=1048576 2024-09-14T10:57:39.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.879+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~P4UUTPNV3SA4.1 size=1048576 2024-09-14T10:57:39.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.883+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~P4UUTPNV3SA4.2 size=556455 2024-09-14T10:57:39.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.883+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=P4UUTPNV3SA4 tag=RGFCUEUKSQ9W type=write size=3702183 2024-09-14T10:57:39.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.887+0000 7fdf8f02c8c0 1 < canceled operation key=5VZCCFRUAQJ7 tag=4L3K7JJJ64OJ type=del size=174990 2024-09-14T10:57:39.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.891+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=1E71DMKM10FI type=del size=1113120 2024-09-14T10:57:39.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.895+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~51EHW86FH3BQ.0 size=1048576 2024-09-14T10:57:39.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~51EHW86FH3BQ.1 size=615430 2024-09-14T10:57:39.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.903+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=51EHW86FH3BQ tag=8AF9OVNXB58A type=write size=2712582 2024-09-14T10:57:39.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.907+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=71SQWUKPLM2C type=del size=1158736 2024-09-14T10:57:39.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.915+0000 7fdf8f02c8c0 1 < suggested update operation key=LCEH2YXNSOGT tag=D6H3VQBPZ1EB type=del size=2964098 2024-09-14T10:57:39.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~M7EJW7B58OBQ.0 size=1048576 2024-09-14T10:57:39.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~M7EJW7B58OBQ.1 size=1042127 2024-09-14T10:57:39.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.923+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=M7EJW7B58OBQ tag=RC0I0O5KQB76 type=write size=3139279 2024-09-14T10:57:39.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.927+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=2DFJ4E9P61WV type=del 2024-09-14T10:57:39.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.935+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~KQ0JLV1AKB60.0 size=1048576 2024-09-14T10:57:39.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.939+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~KQ0JLV1AKB60.1 size=857813 2024-09-14T10:57:39.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.939+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=KQ0JLV1AKB60 tag=M4MEFN5JJ8RN type=write size=2954965 2024-09-14T10:57:39.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.943+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=PGB025JOHRVP type=del 2024-09-14T10:57:39.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.947+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=Y2FWJLOCRXTT type=del size=2785669 2024-09-14T10:57:39.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.951+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~OIUG17DNVG0E.0 size=1048576 2024-09-14T10:57:39.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.951+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~OIUG17DNVG0E.1 size=1048576 2024-09-14T10:57:39.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~OIUG17DNVG0E.2 size=930352 2024-09-14T10:57:39.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.959+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=OIUG17DNVG0E tag=3IYW21YWYH5E type=write size=4076080 2024-09-14T10:57:39.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.967+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~MHEGRIJ6W8LE.0 size=1048576 2024-09-14T10:57:39.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.967+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~MHEGRIJ6W8LE.1 size=482829 2024-09-14T10:57:39.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.967+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=MHEGRIJ6W8LE tag=IW4ZU0BU8BFE type=write size=2579981 2024-09-14T10:57:39.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.971+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_5VZCCFRUAQJ7.2~NJWJDVTDNMNR.0 size=1048576 2024-09-14T10:57:39.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.971+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_5VZCCFRUAQJ7.2~NJWJDVTDNMNR.1 size=125964 2024-09-14T10:57:39.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.975+0000 7fdf8f02c8c0 1 < canceled multipart upload key=5VZCCFRUAQJ7 upload=NJWJDVTDNMNR tag=C0NY74TXFHXJ type=write size=2223116 2024-09-14T10:57:39.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~MLDFJITPK0BY.0 size=1048576 2024-09-14T10:57:39.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~MLDFJITPK0BY.1 size=1048576 2024-09-14T10:57:39.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~MLDFJITPK0BY.2 size=427328 2024-09-14T10:57:39.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.987+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=MLDFJITPK0BY tag=3AWODVQAXFSX type=write size=3573056 2024-09-14T10:57:39.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~9G3KHSY80ZPT.0 size=1048576 2024-09-14T10:57:39.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~9G3KHSY80ZPT.1 size=1048576 2024-09-14T10:57:39.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.995+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~9G3KHSY80ZPT.2 size=638422 2024-09-14T10:57:39.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:39.999+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=9G3KHSY80ZPT tag=2POMURH20Z75 type=write size=3784150 2024-09-14T10:57:40.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.007+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~IYBQKWFZSE1N.0 size=861734 2024-09-14T10:57:40.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.007+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=IYBQKWFZSE1N tag=Q5KPMUD5DV6V type=write size=1910310 2024-09-14T10:57:40.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.011+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=F70A8750QDH7 type=del 2024-09-14T10:57:40.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.015+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=CYL7L8C8T71D type=del size=1777215 2024-09-14T10:57:40.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.019+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~4IDQMFRUZCRM.0 size=1048576 2024-09-14T10:57:40.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.019+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~4IDQMFRUZCRM.1 size=1048576 2024-09-14T10:57:40.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.023+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~4IDQMFRUZCRM.2 size=140351 2024-09-14T10:57:40.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.031+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=4IDQMFRUZCRM tag=WPV71QKX2FUW type=write size=3286079 2024-09-14T10:57:40.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.035+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=VOY34IWW3DVP type=del size=3841936 2024-09-14T10:57:40.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.039+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~X0PM8JYMENSZ.0 size=327771 2024-09-14T10:57:40.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.043+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=X0PM8JYMENSZ tag=Y451Q7D6DSV0 type=write size=1376347 2024-09-14T10:57:40.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.047+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=XXLLNWYC278F type=del size=1531740 2024-09-14T10:57:40.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.051+0000 7fdf8f02c8c0 1 < completed write operation key=ZSBCGOXXJ0D5 tag=8QRZB1X2TIL5 type=write size=461801 2024-09-14T10:57:40.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.059+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~OTPIJ381A586.0 size=1048576 2024-09-14T10:57:40.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~OTPIJ381A586.1 size=741850 2024-09-14T10:57:40.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.063+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=OTPIJ381A586 tag=QPY84YVNH0GF type=write size=2839002 2024-09-14T10:57:40.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.067+0000 7fdf8f02c8c0 1 < completed write operation key=304ZNF4OC1ML tag=8VR9N5MBO0I9 type=write size=807391 2024-09-14T10:57:40.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.071+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~15XS54B2PFC8.0 size=1048576 2024-09-14T10:57:40.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~15XS54B2PFC8.1 size=1048576 2024-09-14T10:57:40.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.079+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~15XS54B2PFC8.2 size=221339 2024-09-14T10:57:40.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.079+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=15XS54B2PFC8 tag=DXZ7J6VT3DQ1 type=write size=3367067 2024-09-14T10:57:40.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.083+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=LA3S8CS0PWZT type=del 2024-09-14T10:57:40.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.087+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=LDL1GRMB1HA8 type=write size=811437 2024-09-14T10:57:40.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.095+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=XNP247Q11TTH type=del size=1177190 2024-09-14T10:57:40.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.099+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=V0AGQG4OH9LH type=del size=1016353 2024-09-14T10:57:40.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.103+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~P4UUTPNV3SA4.0 size=1048576 2024-09-14T10:57:40.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.103+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~P4UUTPNV3SA4.1 size=1048576 2024-09-14T10:57:40.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.107+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~P4UUTPNV3SA4.2 size=556455 2024-09-14T10:57:40.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.115+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=P4UUTPNV3SA4 tag=RGFCUEUKSQ9W type=write size=3702183 2024-09-14T10:57:40.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.119+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=X13MZWOBQF13 type=del size=2630428 2024-09-14T10:57:40.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.123+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=1E71DMKM10FI type=del 2024-09-14T10:57:40.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.127+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=27RD83FEMTMT type=del size=1487587 2024-09-14T10:57:40.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.135+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZSBCGOXXJ0D5 tag=71SQWUKPLM2C type=del 2024-09-14T10:57:40.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.139+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~190TMV0H3WO5.0 size=283031 2024-09-14T10:57:40.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.139+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=190TMV0H3WO5 tag=3ZTH4EBNPPD2 type=write size=1331607 2024-09-14T10:57:40.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.147+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~M7EJW7B58OBQ.0 size=1048576 2024-09-14T10:57:40.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.147+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~M7EJW7B58OBQ.1 size=1042127 2024-09-14T10:57:40.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.155+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=M7EJW7B58OBQ tag=RC0I0O5KQB76 type=write size=3139279 2024-09-14T10:57:40.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.159+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=YQ2ZZHHTS9Y7 type=del size=79395 2024-09-14T10:57:40.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~KQ0JLV1AKB60.0 size=1048576 2024-09-14T10:57:40.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~KQ0JLV1AKB60.1 size=857813 2024-09-14T10:57:40.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.171+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=KQ0JLV1AKB60 tag=M4MEFN5JJ8RN type=write size=2954965 2024-09-14T10:57:40.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.175+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~4S8KJX6UI30O.0 size=1048576 2024-09-14T10:57:40.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.179+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~4S8KJX6UI30O.1 size=275887 2024-09-14T10:57:40.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.179+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=4S8KJX6UI30O tag=25ACPNNO9TRU type=write size=2373039 2024-09-14T10:57:40.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.183+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=Y2FWJLOCRXTT type=del 2024-09-14T10:57:40.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.187+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=VESWNXZ4TZO6 type=del size=3119674 2024-09-14T10:57:40.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.191+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~MHEGRIJ6W8LE.0 size=1048576 2024-09-14T10:57:40.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.195+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~MHEGRIJ6W8LE.1 size=482829 2024-09-14T10:57:40.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.199+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=MHEGRIJ6W8LE tag=IW4ZU0BU8BFE type=write size=2579981 2024-09-14T10:57:40.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~PX6BPDTC1LQU.0 size=209431 2024-09-14T10:57:40.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.207+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=PX6BPDTC1LQU tag=TR6WV35NZGCE type=write size=1258007 2024-09-14T10:57:40.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.211+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~MLDFJITPK0BY.0 size=1048576 2024-09-14T10:57:40.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.211+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~MLDFJITPK0BY.1 size=1048576 2024-09-14T10:57:40.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.215+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~MLDFJITPK0BY.2 size=427328 2024-09-14T10:57:40.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.223+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=MLDFJITPK0BY tag=3AWODVQAXFSX type=write size=3573056 2024-09-14T10:57:40.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.235+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~4D33FLXUWNBZ.0 size=1048576 2024-09-14T10:57:40.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.239+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~4D33FLXUWNBZ.1 size=1048576 2024-09-14T10:57:40.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.239+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~4D33FLXUWNBZ.2 size=257836 2024-09-14T10:57:40.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.239+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=4D33FLXUWNBZ tag=Z53LYCQWBZUR type=write size=3403564 2024-09-14T10:57:40.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~IYBQKWFZSE1N.0 size=861734 2024-09-14T10:57:40.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.251+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=IYBQKWFZSE1N tag=Q5KPMUD5DV6V type=write size=1910310 2024-09-14T10:57:40.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~EWKOBIIAV59F.0 size=1048576 2024-09-14T10:57:40.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.263+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~EWKOBIIAV59F.1 size=1048576 2024-09-14T10:57:40.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.263+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~EWKOBIIAV59F.2 size=219572 2024-09-14T10:57:40.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.267+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=EWKOBIIAV59F tag=Q545I2TWBPSH type=write size=3365300 2024-09-14T10:57:40.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.271+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=CYL7L8C8T71D type=del 2024-09-14T10:57:40.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.275+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~KCNNRC2JTS3A.0 size=389150 2024-09-14T10:57:40.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.275+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=KCNNRC2JTS3A tag=A6QKRAWZCJ0W type=write size=1437726 2024-09-14T10:57:40.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.283+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=VOY34IWW3DVP type=del 2024-09-14T10:57:40.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.287+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=9Q4YP7LY5R8V type=del size=1879860 2024-09-14T10:57:40.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.291+0000 7fdf8f02c8c0 1 < canceled operation key=HCGZ1MY5SKW9 tag=XXLLNWYC278F type=del size=1531740 2024-09-14T10:57:40.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.299+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~CGBRIOGH2PQ9.0 size=229298 2024-09-14T10:57:40.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.299+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=CGBRIOGH2PQ9 tag=A75B07ML8GXQ type=write size=1277874 2024-09-14T10:57:40.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.303+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~OTPIJ381A586.0 size=1048576 2024-09-14T10:57:40.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.303+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_9IDBODZBQRJR.2~OTPIJ381A586.1 size=741850 2024-09-14T10:57:40.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.311+0000 7fdf8f02c8c0 1 < canceled multipart upload key=9IDBODZBQRJR upload=OTPIJ381A586 tag=QPY84YVNH0GF type=write size=2839002 2024-09-14T10:57:40.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.311+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=2UL5ICUCV12L type=del size=3761465 2024-09-14T10:57:40.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.319+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~15XS54B2PFC8.0 size=1048576 2024-09-14T10:57:40.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.319+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~15XS54B2PFC8.1 size=1048576 2024-09-14T10:57:40.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.323+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~15XS54B2PFC8.2 size=221339 2024-09-14T10:57:40.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.331+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=15XS54B2PFC8 tag=DXZ7J6VT3DQ1 type=write size=3367067 2024-09-14T10:57:40.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.335+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=EAUHZVZHJNF2 type=del size=3397431 2024-09-14T10:57:40.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.339+0000 7fdf8f02c8c0 1 < suggested remove operation key=YU9DAJA242Q7 tag=LDL1GRMB1HA8 type=write 2024-09-14T10:57:40.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~YMZ07H8ETW5R.0 size=1048576 2024-09-14T10:57:40.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~YMZ07H8ETW5R.1 size=312778 2024-09-14T10:57:40.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.351+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=YMZ07H8ETW5R tag=YAHQL7CG7ISP type=write size=2409930 2024-09-14T10:57:40.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.355+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=V0AGQG4OH9LH type=del 2024-09-14T10:57:40.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.359+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=OJ1W2BFDRQ5Z type=del size=2983882 2024-09-14T10:57:40.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.363+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=X13MZWOBQF13 type=del 2024-09-14T10:57:40.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.367+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~N5NS3GHPK8G2.0 size=1048576 2024-09-14T10:57:40.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.371+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~N5NS3GHPK8G2.1 size=1048576 2024-09-14T10:57:40.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.375+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~N5NS3GHPK8G2.2 size=9197 2024-09-14T10:57:40.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.375+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=N5NS3GHPK8G2 tag=OAV18SYQC81Y type=write size=3154925 2024-09-14T10:57:40.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.379+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=27RD83FEMTMT type=del 2024-09-14T10:57:40.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.383+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~X6CN5192B0CW.0 size=144868 2024-09-14T10:57:40.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.383+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=X6CN5192B0CW tag=V8Y9LBBJ3WTW type=write size=1193444 2024-09-14T10:57:40.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.387+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~190TMV0H3WO5.0 size=283031 2024-09-14T10:57:40.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.395+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=190TMV0H3WO5 tag=3ZTH4EBNPPD2 type=write size=1331607 2024-09-14T10:57:40.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.399+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=H3DN9AAMIIPE type=del size=3751542 2024-09-14T10:57:40.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.403+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=YQ2ZZHHTS9Y7 type=del 2024-09-14T10:57:40.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.407+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=9CUIPCU3433G type=write size=1009102 2024-09-14T10:57:40.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.411+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~4S8KJX6UI30O.0 size=1048576 2024-09-14T10:57:40.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.415+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~4S8KJX6UI30O.1 size=275887 2024-09-14T10:57:40.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.419+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=4S8KJX6UI30O tag=25ACPNNO9TRU type=write size=2373039 2024-09-14T10:57:40.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.423+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=SB6709X915P3 type=del size=3283338 2024-09-14T10:57:40.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.427+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=VESWNXZ4TZO6 type=del 2024-09-14T10:57:40.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.431+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=02QEK32D5DTV type=write size=79111 2024-09-14T10:57:40.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.435+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~PX6BPDTC1LQU.0 size=209431 2024-09-14T10:57:40.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.439+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=PX6BPDTC1LQU tag=TR6WV35NZGCE type=write size=1258007 2024-09-14T10:57:40.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.443+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=42P6NACHZTDT type=del size=1537222 2024-09-14T10:57:40.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.447+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~4D33FLXUWNBZ.0 size=1048576 2024-09-14T10:57:40.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.451+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~4D33FLXUWNBZ.1 size=1048576 2024-09-14T10:57:40.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~4D33FLXUWNBZ.2 size=257836 2024-09-14T10:57:40.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.459+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=4D33FLXUWNBZ tag=Z53LYCQWBZUR type=write size=3403564 2024-09-14T10:57:40.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.463+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=PYTS60PYJJ2L type=del size=4081642 2024-09-14T10:57:40.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.467+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~EWKOBIIAV59F.0 size=1048576 2024-09-14T10:57:40.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.471+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~EWKOBIIAV59F.1 size=1048576 2024-09-14T10:57:40.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.475+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~EWKOBIIAV59F.2 size=219572 2024-09-14T10:57:40.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.483+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=EWKOBIIAV59F tag=Q545I2TWBPSH type=write size=3365300 2024-09-14T10:57:40.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.491+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~9R7AOISB9VN9.0 size=1048576 2024-09-14T10:57:40.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.491+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~9R7AOISB9VN9.1 size=1048576 2024-09-14T10:57:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.495+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~9R7AOISB9VN9.2 size=195771 2024-09-14T10:57:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.495+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=9R7AOISB9VN9 tag=ZTO0J68RT6IL type=write size=3341499 2024-09-14T10:57:40.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~KCNNRC2JTS3A.0 size=389150 2024-09-14T10:57:40.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.503+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=KCNNRC2JTS3A tag=A6QKRAWZCJ0W type=write size=1437726 2024-09-14T10:57:40.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.507+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=M3Q8XOQPIZW0 type=del size=670779 2024-09-14T10:57:40.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.511+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=9Q4YP7LY5R8V type=del 2024-09-14T10:57:40.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.519+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~WANPNWYJ5LFY.0 size=1048576 2024-09-14T10:57:40.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~WANPNWYJ5LFY.1 size=1048576 2024-09-14T10:57:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~WANPNWYJ5LFY.2 size=854847 2024-09-14T10:57:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.523+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=WANPNWYJ5LFY tag=BFM3CIJIFRS4 type=write size=4000575 2024-09-14T10:57:40.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.527+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~CGBRIOGH2PQ9.0 size=229298 2024-09-14T10:57:40.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.535+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=CGBRIOGH2PQ9 tag=A75B07ML8GXQ type=write size=1277874 2024-09-14T10:57:40.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.543+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~T7Z9WK7EKPLX.0 size=1048576 2024-09-14T10:57:40.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.543+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~T7Z9WK7EKPLX.1 size=936589 2024-09-14T10:57:40.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.543+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=T7Z9WK7EKPLX tag=FQCSOCH8K8EB type=write size=3033741 2024-09-14T10:57:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.547+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=2UL5ICUCV12L type=del 2024-09-14T10:57:40.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.555+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~FVAFI2D90N2R.0 size=1048576 2024-09-14T10:57:40.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.559+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~FVAFI2D90N2R.1 size=1048576 2024-09-14T10:57:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~FVAFI2D90N2R.2 size=513922 2024-09-14T10:57:40.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.563+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=FVAFI2D90N2R tag=SXZNVWTUINFB type=write size=3659650 2024-09-14T10:57:40.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.567+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=EAUHZVZHJNF2 type=del 2024-09-14T10:57:40.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~USWLGRQO5K1K.0 size=1048576 2024-09-14T10:57:40.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.575+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~USWLGRQO5K1K.1 size=955346 2024-09-14T10:57:40.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.575+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=USWLGRQO5K1K tag=8C4T201MSI31 type=write size=3052498 2024-09-14T10:57:40.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.583+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~YMZ07H8ETW5R.0 size=1048576 2024-09-14T10:57:40.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.587+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~YMZ07H8ETW5R.1 size=312778 2024-09-14T10:57:40.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.591+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=YMZ07H8ETW5R tag=YAHQL7CG7ISP type=write size=2409930 2024-09-14T10:57:40.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.595+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=B7LB7JVR2F9Z type=del size=19059 2024-09-14T10:57:40.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.603+0000 7fdf8f02c8c0 1 < suggested remove operation key=3CYCJJIQ210M tag=OJ1W2BFDRQ5Z type=del 2024-09-14T10:57:40.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.607+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=K4JH1U1BWCNJ type=del size=2064600 2024-09-14T10:57:40.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.611+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~N5NS3GHPK8G2.0 size=1048576 2024-09-14T10:57:40.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.615+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~N5NS3GHPK8G2.1 size=1048576 2024-09-14T10:57:40.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.615+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~N5NS3GHPK8G2.2 size=9197 2024-09-14T10:57:40.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.623+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=N5NS3GHPK8G2 tag=OAV18SYQC81Y type=write size=3154925 2024-09-14T10:57:40.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.627+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=Q0TR9ZJEADZU type=del size=2193365 2024-09-14T10:57:40.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.631+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~X6CN5192B0CW.0 size=144868 2024-09-14T10:57:40.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.635+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=X6CN5192B0CW tag=V8Y9LBBJ3WTW type=write size=1193444 2024-09-14T10:57:40.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.639+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=4II5A58KJPO1 type=del size=906591 2024-09-14T10:57:40.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.643+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=H3DN9AAMIIPE type=del 2024-09-14T10:57:40.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.647+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=BMEKRCZCLFWF type=write size=726426 2024-09-14T10:57:40.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.655+0000 7fdf8f02c8c0 1 < suggested update operation key=0QJLAH0EPKVD tag=9CUIPCU3433G type=write size=1009102 2024-09-14T10:57:40.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.659+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=7VLPS5F0050T type=del size=4029636 2024-09-14T10:57:40.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.663+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=SB6709X915P3 type=del 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.667+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=C75SGHKR8FDR type=del size=1044089 2024-09-14T10:57:40.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.671+0000 7fdf8f02c8c0 1 < completed write operation key=49O8DPTGA65S tag=02QEK32D5DTV type=write size=79111 2024-09-14T10:57:40.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.675+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=ONKUHOY7SWNZ type=del size=4089394 2024-09-14T10:57:40.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.675+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=42P6NACHZTDT type=del 2024-09-14T10:57:40.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.679+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=Y5YDQI69A3BF type=del size=3701326 2024-09-14T10:57:40.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.683+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=PYTS60PYJJ2L type=del 2024-09-14T10:57:40.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.687+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=HU442AFIBU0L type=del size=19704 2024-09-14T10:57:40.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.691+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~9R7AOISB9VN9.0 size=1048576 2024-09-14T10:57:40.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.695+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~9R7AOISB9VN9.1 size=1048576 2024-09-14T10:57:40.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.699+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~9R7AOISB9VN9.2 size=195771 2024-09-14T10:57:40.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.703+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=9R7AOISB9VN9 tag=ZTO0J68RT6IL type=write size=3341499 2024-09-14T10:57:40.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.711+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~L0COIA8VLOVV.0 size=377336 2024-09-14T10:57:40.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.711+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=L0COIA8VLOVV tag=F9TMLCKRQXNT type=write size=1425912 2024-09-14T10:57:40.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.715+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=M3Q8XOQPIZW0 type=del 2024-09-14T10:57:40.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.719+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=AQMM71V7F4N6 type=del size=2651119 2024-09-14T10:57:40.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~WANPNWYJ5LFY.0 size=1048576 2024-09-14T10:57:40.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.727+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~WANPNWYJ5LFY.1 size=1048576 2024-09-14T10:57:40.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.727+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~WANPNWYJ5LFY.2 size=854847 2024-09-14T10:57:40.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.731+0000 7fdf8f02c8c0 1 < canceled multipart upload key=XUT55FR490EO upload=WANPNWYJ5LFY tag=BFM3CIJIFRS4 type=write size=4000575 2024-09-14T10:57:40.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.739+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~YQWNRQXC0ST0.0 size=991388 2024-09-14T10:57:40.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.739+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=YQWNRQXC0ST0 tag=RJFEVT3RB31D type=write size=2039964 2024-09-14T10:57:40.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.743+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~T7Z9WK7EKPLX.0 size=1048576 2024-09-14T10:57:40.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.747+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~T7Z9WK7EKPLX.1 size=936589 2024-09-14T10:57:40.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.751+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=T7Z9WK7EKPLX tag=FQCSOCH8K8EB type=write size=3033741 2024-09-14T10:57:40.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.759+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~29MV1NK03ELD.0 size=1048576 2024-09-14T10:57:40.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~29MV1NK03ELD.1 size=1048576 2024-09-14T10:57:40.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~29MV1NK03ELD.2 size=856618 2024-09-14T10:57:40.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.763+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=29MV1NK03ELD tag=MII6R6C7R3AF type=write size=4002346 2024-09-14T10:57:40.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.767+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~FVAFI2D90N2R.0 size=1048576 2024-09-14T10:57:40.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.771+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~FVAFI2D90N2R.1 size=1048576 2024-09-14T10:57:40.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.775+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~FVAFI2D90N2R.2 size=513922 2024-09-14T10:57:40.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.779+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=FVAFI2D90N2R tag=SXZNVWTUINFB type=write size=3659650 2024-09-14T10:57:40.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.783+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=64830HQEKLPP type=write size=281321 2024-09-14T10:57:40.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.783+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_ZSBCGOXXJ0D5.2~USWLGRQO5K1K.0 size=1048576 2024-09-14T10:57:40.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.787+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~USWLGRQO5K1K.1 size=955346 2024-09-14T10:57:40.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.795+0000 7fdf8f02c8c0 1 < canceled multipart upload key=ZSBCGOXXJ0D5 upload=USWLGRQO5K1K tag=8C4T201MSI31 type=write size=3052498 2024-09-14T10:57:40.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.799+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=W774FJXSRKNI type=del size=971492 2024-09-14T10:57:40.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.807+0000 7fdf8f02c8c0 1 < suggested remove operation key=LMNGCUFR187I tag=B7LB7JVR2F9Z type=del 2024-09-14T10:57:40.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.815+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~V5CU2UKAKGVH.0 size=809565 2024-09-14T10:57:40.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.815+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=V5CU2UKAKGVH tag=A03M0I7F2AAF type=write size=1858141 2024-09-14T10:57:40.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.823+0000 7fdf8f02c8c0 1 < suggested remove operation key=304ZNF4OC1ML tag=K4JH1U1BWCNJ type=del 2024-09-14T10:57:40.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.827+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=XDOZVDS5OU0Q type=del size=1686984 2024-09-14T10:57:40.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.831+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=Q0TR9ZJEADZU type=del 2024-09-14T10:57:40.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.835+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~6OAJVUJ2LR4Q.0 size=1048576 2024-09-14T10:57:40.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.839+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~6OAJVUJ2LR4Q.1 size=313168 2024-09-14T10:57:40.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.839+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=6OAJVUJ2LR4Q tag=S4A07T5GDJQG type=write size=2410320 2024-09-14T10:57:40.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.843+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=4II5A58KJPO1 type=del 2024-09-14T10:57:40.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.847+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=AIAZDG5JVG6L type=del size=3082975 2024-09-14T10:57:40.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.851+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=BMEKRCZCLFWF type=write size=726426 2024-09-14T10:57:40.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.855+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~WTU61YRMY00Z.0 size=1048576 2024-09-14T10:57:40.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.859+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~WTU61YRMY00Z.1 size=1048576 2024-09-14T10:57:40.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~WTU61YRMY00Z.2 size=888908 2024-09-14T10:57:40.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.863+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=WTU61YRMY00Z tag=YTRW54QUB58R type=write size=4034636 2024-09-14T10:57:40.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.867+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=7VLPS5F0050T type=del 2024-09-14T10:57:40.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.871+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=J2EJFH9GOFQE type=del size=269517 2024-09-14T10:57:40.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.875+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=C75SGHKR8FDR type=del 2024-09-14T10:57:40.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.879+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=75VZN0MA1QVK type=write size=969112 2024-09-14T10:57:40.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.883+0000 7fdf8f02c8c0 -1 < failed to complete operation key=304ZNF4OC1ML tag=ONKUHOY7SWNZ type=del size=4089394: (22) Invalid argument 2024-09-14T10:57:40.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.887+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~CUB4V7M6L3NJ.0 size=411868 2024-09-14T10:57:40.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.887+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=CUB4V7M6L3NJ tag=ZAMLQRW22B6R type=write size=1460444 2024-09-14T10:57:40.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.891+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=Y5YDQI69A3BF type=del 2024-09-14T10:57:40.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.899+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=RCLT6DJHEDTN type=del size=2472428 2024-09-14T10:57:40.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.903+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=HU442AFIBU0L type=del 2024-09-14T10:57:40.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.907+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=NNPTYDK2MFNS type=write size=706609 2024-09-14T10:57:40.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.911+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~L0COIA8VLOVV.0 size=377336 2024-09-14T10:57:40.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.915+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=L0COIA8VLOVV tag=F9TMLCKRQXNT type=write size=1425912 2024-09-14T10:57:40.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.919+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=S1Y5ERO81MYA type=del size=381952 2024-09-14T10:57:40.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.923+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=AQMM71V7F4N6 type=del 2024-09-14T10:57:40.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.927+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=UB2WS173RFA7 type=del size=2438588 2024-09-14T10:57:40.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.931+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~YQWNRQXC0ST0.0 size=991388 2024-09-14T10:57:40.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.943+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=YQWNRQXC0ST0 tag=RJFEVT3RB31D type=write size=2039964 2024-09-14T10:57:40.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.947+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=2WX6LVVKJE8X type=del size=3359496 2024-09-14T10:57:40.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~29MV1NK03ELD.0 size=1048576 2024-09-14T10:57:40.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.955+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~29MV1NK03ELD.1 size=1048576 2024-09-14T10:57:40.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.955+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LFLY0V3FRRW5.2~29MV1NK03ELD.2 size=856618 2024-09-14T10:57:40.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.963+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LFLY0V3FRRW5 upload=29MV1NK03ELD tag=MII6R6C7R3AF type=write size=4002346 2024-09-14T10:57:40.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.967+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=42HVEXNIH2HY type=del size=3129539 2024-09-14T10:57:40.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.971+0000 7fdf8f02c8c0 1 < completed write operation key=STB3W5URFJEZ tag=64830HQEKLPP type=write size=281321 2024-09-14T10:57:40.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.975+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=50QCWUHT9CYY type=del size=2737892 2024-09-14T10:57:40.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.979+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=W774FJXSRKNI type=del 2024-09-14T10:57:40.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~6K1I2JYJMNDU.0 size=592213 2024-09-14T10:57:40.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.983+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=6K1I2JYJMNDU tag=XFA751UQSG9T type=write size=1640789 2024-09-14T10:57:40.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~V5CU2UKAKGVH.0 size=809565 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.995+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=V5CU2UKAKGVH tag=A03M0I7F2AAF type=write size=1858141 2024-09-14T10:57:40.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:40.999+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=64XLNQ268J1Q type=del size=2891933 2024-09-14T10:57:41.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.003+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=XDOZVDS5OU0Q type=del 2024-09-14T10:57:41.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.007+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=B7KD904BTSWF type=del size=3845326 2024-09-14T10:57:41.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.011+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~6OAJVUJ2LR4Q.0 size=1048576 2024-09-14T10:57:41.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.015+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~6OAJVUJ2LR4Q.1 size=313168 2024-09-14T10:57:41.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.023+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=6OAJVUJ2LR4Q tag=S4A07T5GDJQG type=write size=2410320 2024-09-14T10:57:41.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.027+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=6JKINCNWG47L type=del size=710974 2024-09-14T10:57:41.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.031+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=AIAZDG5JVG6L type=del 2024-09-14T10:57:41.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.035+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=1ZWXEAOC3FZB type=del size=311910 2024-09-14T10:57:41.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.039+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~WTU61YRMY00Z.0 size=1048576 2024-09-14T10:57:41.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.043+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~WTU61YRMY00Z.1 size=1048576 2024-09-14T10:57:41.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.043+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~WTU61YRMY00Z.2 size=888908 2024-09-14T10:57:41.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.051+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=WTU61YRMY00Z tag=YTRW54QUB58R type=write size=4034636 2024-09-14T10:57:41.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.059+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~8KLTIZG3QOE8.0 size=1048576 2024-09-14T10:57:41.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~8KLTIZG3QOE8.1 size=708438 2024-09-14T10:57:41.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.063+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=8KLTIZG3QOE8 tag=EFMSE1ZLK0LD type=write size=2805590 2024-09-14T10:57:41.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.067+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=J2EJFH9GOFQE type=del 2024-09-14T10:57:41.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.071+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=R5WOIOMN50XO type=del size=3064154 2024-09-14T10:57:41.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.075+0000 7fdf8f02c8c0 1 < completed write operation key=HCGZ1MY5SKW9 tag=75VZN0MA1QVK type=write size=969112 2024-09-14T10:57:41.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.079+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=R2UXVXD6S6CB type=del size=1139419 2024-09-14T10:57:41.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.083+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~CUB4V7M6L3NJ.0 size=411868 2024-09-14T10:57:41.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.091+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=CUB4V7M6L3NJ tag=ZAMLQRW22B6R type=write size=1460444 2024-09-14T10:57:41.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.095+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=KOFIKYOYYX9A type=del size=765443 2024-09-14T10:57:41.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.099+0000 7fdf8f02c8c0 1 < suggested remove operation key=X1BN3054IKNS tag=RCLT6DJHEDTN type=del 2024-09-14T10:57:41.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.103+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=JPEI05FX47TM type=del size=2347773 2024-09-14T10:57:41.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.107+0000 7fdf8f02c8c0 1 < completed write operation key=5VZCCFRUAQJ7 tag=NNPTYDK2MFNS type=write size=706609 2024-09-14T10:57:41.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.115+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~411YTIAMRT6Z.0 size=1048576 2024-09-14T10:57:41.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.119+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~411YTIAMRT6Z.1 size=1048576 2024-09-14T10:57:41.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.119+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~411YTIAMRT6Z.2 size=684500 2024-09-14T10:57:41.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.119+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=411YTIAMRT6Z tag=K541XDE0M2RK type=write size=3830228 2024-09-14T10:57:41.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.127+0000 7fdf8f02c8c0 1 < suggested update operation key=L1ERJ0JSRDMG tag=S1Y5ERO81MYA type=del size=381952 2024-09-14T10:57:41.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.135+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~TPU9FUOD39UM.0 size=1048576 2024-09-14T10:57:41.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.135+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~TPU9FUOD39UM.1 size=566073 2024-09-14T10:57:41.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.135+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=TPU9FUOD39UM tag=VVIZJJY0KLGO type=write size=2663225 2024-09-14T10:57:41.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.139+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=UB2WS173RFA7 type=del 2024-09-14T10:57:41.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.147+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~9XL15ODWKL1S.0 size=1048576 2024-09-14T10:57:41.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~9XL15ODWKL1S.1 size=1048576 2024-09-14T10:57:41.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.155+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~9XL15ODWKL1S.2 size=826879 2024-09-14T10:57:41.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.155+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=9XL15ODWKL1S tag=55O61IBVY3VV type=write size=3972607 2024-09-14T10:57:41.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.159+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=2WX6LVVKJE8X type=del 2024-09-14T10:57:41.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.167+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~D8T3QY6A4IPJ.0 size=119170 2024-09-14T10:57:41.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.167+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=D8T3QY6A4IPJ tag=XFV9RF8Z4RND type=write size=1167746 2024-09-14T10:57:41.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.175+0000 7fdf8f02c8c0 1 < suggested update operation key=1E72V12EPEH3 tag=42HVEXNIH2HY type=del size=3129539 2024-09-14T10:57:41.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.179+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=VC63S5E0ZJDZ type=del size=2308926 2024-09-14T10:57:41.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.183+0000 7fdf8f02c8c0 1 < canceled operation key=LMNGCUFR187I tag=50QCWUHT9CYY type=del size=2737892 2024-09-14T10:57:41.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.187+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=IVQETQVELSCA type=del size=2181186 2024-09-14T10:57:41.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.191+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~6K1I2JYJMNDU.0 size=592213 2024-09-14T10:57:41.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.195+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=6K1I2JYJMNDU tag=XFA751UQSG9T type=write size=1640789 2024-09-14T10:57:41.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~ZO5GL7N36OJO.0 size=904628 2024-09-14T10:57:41.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.203+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=ZO5GL7N36OJO tag=2II1DB04NVX0 type=write size=1953204 2024-09-14T10:57:41.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.207+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=64XLNQ268J1Q type=del 2024-09-14T10:57:41.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.211+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=DPWL5IN2L1EO type=del size=773258 2024-09-14T10:57:41.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.215+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=B7KD904BTSWF type=del 2024-09-14T10:57:41.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.219+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=O6FH45TCA8BO type=del size=3274592 2024-09-14T10:57:41.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.223+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=6JKINCNWG47L type=del 2024-09-14T10:57:41.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.227+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~70233K71CMRF.0 size=560898 2024-09-14T10:57:41.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.227+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=70233K71CMRF tag=8OQP9HO5XV1L type=write size=1609474 2024-09-14T10:57:41.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.231+0000 7fdf8f02c8c0 -1 < failed to complete operation key=1E72V12EPEH3 tag=1ZWXEAOC3FZB type=del size=311910: (22) Invalid argument 2024-09-14T10:57:41.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.235+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=V2JZZ54Y8H1Q type=del size=846977 2024-09-14T10:57:41.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.239+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~8KLTIZG3QOE8.0 size=1048576 2024-09-14T10:57:41.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~8KLTIZG3QOE8.1 size=708438 2024-09-14T10:57:41.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.247+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=8KLTIZG3QOE8 tag=EFMSE1ZLK0LD type=write size=2805590 2024-09-14T10:57:41.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.255+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~24F3E45OZSFE.0 size=1048576 2024-09-14T10:57:41.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~24F3E45OZSFE.1 size=1019521 2024-09-14T10:57:41.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.259+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=24F3E45OZSFE tag=RQGHNLMDXNS7 type=write size=3116673 2024-09-14T10:57:41.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.263+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=R5WOIOMN50XO type=del 2024-09-14T10:57:41.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.267+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=TLGMH0GWX7OJ type=del size=3309042 2024-09-14T10:57:41.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.271+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=R2UXVXD6S6CB type=del 2024-09-14T10:57:41.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.275+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=I3R9A4AO2F0S type=del size=3434426 2024-09-14T10:57:41.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.283+0000 7fdf8f02c8c0 1 < suggested remove operation key=0QJLAH0EPKVD tag=KOFIKYOYYX9A type=del 2024-09-14T10:57:41.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.287+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~R5VRZ6VMTALB.0 size=655239 2024-09-14T10:57:41.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.287+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=R5VRZ6VMTALB tag=KTDFJDL22JKN type=write size=1703815 2024-09-14T10:57:41.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.291+0000 7fdf8f02c8c0 1 < canceled operation key=3T0H42SC1ETB tag=JPEI05FX47TM type=del size=2347773 2024-09-14T10:57:41.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.295+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=VQV95U4D8X02 type=del size=2825795 2024-09-14T10:57:41.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.299+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~411YTIAMRT6Z.0 size=1048576 2024-09-14T10:57:41.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.307+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~411YTIAMRT6Z.1 size=1048576 2024-09-14T10:57:41.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.311+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~411YTIAMRT6Z.2 size=684500 2024-09-14T10:57:41.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.315+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=411YTIAMRT6Z tag=K541XDE0M2RK type=write size=3830228 2024-09-14T10:57:41.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.319+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=9BBO52T1LFYM type=del size=3939030 2024-09-14T10:57:41.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.323+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~TPU9FUOD39UM.0 size=1048576 2024-09-14T10:57:41.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.327+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~TPU9FUOD39UM.1 size=566073 2024-09-14T10:57:41.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.331+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=TPU9FUOD39UM tag=VVIZJJY0KLGO type=write size=2663225 2024-09-14T10:57:41.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.335+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=GQS13Q5EKUE4 type=write size=23858 2024-09-14T10:57:41.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.339+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~9XL15ODWKL1S.0 size=1048576 2024-09-14T10:57:41.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.343+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~9XL15ODWKL1S.1 size=1048576 2024-09-14T10:57:41.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.347+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~9XL15ODWKL1S.2 size=826879 2024-09-14T10:57:41.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.351+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=9XL15ODWKL1S tag=55O61IBVY3VV type=write size=3972607 2024-09-14T10:57:41.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.355+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=AINQC1GLNURF type=del size=2749712 2024-09-14T10:57:41.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.359+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~D8T3QY6A4IPJ.0 size=119170 2024-09-14T10:57:41.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.367+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=D8T3QY6A4IPJ tag=XFV9RF8Z4RND type=write size=1167746 2024-09-14T10:57:41.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.371+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=RX4GMEAOX1C8 type=write size=567176 2024-09-14T10:57:41.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.375+0000 7fdf8f02c8c0 1 < suggested remove operation key=3QSOKUSZ57QM tag=VC63S5E0ZJDZ type=del 2024-09-14T10:57:41.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.379+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=HDYLPBLA5UBJ type=write size=448706 2024-09-14T10:57:41.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.383+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=IVQETQVELSCA type=del 2024-09-14T10:57:41.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.391+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=GWQZ7ZJJU0JG type=del size=2963197 2024-09-14T10:57:41.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.395+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~ZO5GL7N36OJO.0 size=904628 2024-09-14T10:57:41.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.399+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=ZO5GL7N36OJO tag=2II1DB04NVX0 type=write size=1953204 2024-09-14T10:57:41.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.407+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=MPDWTCY8VQQI type=write size=931464 2024-09-14T10:57:41.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.407+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=3QSOKUSZ57QM tag=DPWL5IN2L1EO type=del size=773258: (2) No such file or directory 2024-09-14T10:57:41.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.411+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=4FZ2FUMP8SOF type=del size=1149683 2024-09-14T10:57:41.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.415+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=O6FH45TCA8BO type=del 2024-09-14T10:57:41.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.423+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~51HQVLNXM495.0 size=1048576 2024-09-14T10:57:41.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.423+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~51HQVLNXM495.1 size=351769 2024-09-14T10:57:41.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.423+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=51HQVLNXM495 tag=BILWMQMS3Y8Q type=write size=2448921 2024-09-14T10:57:41.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.427+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~70233K71CMRF.0 size=560898 2024-09-14T10:57:41.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.435+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=70233K71CMRF tag=8OQP9HO5XV1L type=write size=1609474 2024-09-14T10:57:41.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.439+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=GJ3QZUCRHQCI type=del size=2847196 2024-09-14T10:57:41.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.443+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=V2JZZ54Y8H1Q type=del 2024-09-14T10:57:41.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.451+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~ULNSU7W4SOT6.0 size=221956 2024-09-14T10:57:41.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.451+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=ULNSU7W4SOT6 tag=GZ9960ZPARXA type=write size=1270532 2024-09-14T10:57:41.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.451+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~24F3E45OZSFE.0 size=1048576 2024-09-14T10:57:41.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~24F3E45OZSFE.1 size=1019521 2024-09-14T10:57:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.463+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=24F3E45OZSFE tag=RQGHNLMDXNS7 type=write size=3116673 2024-09-14T10:57:41.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.467+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=ZSS1O83REKML type=del size=660398 2024-09-14T10:57:41.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.475+0000 7fdf8f02c8c0 1 < suggested update operation key=304ZNF4OC1ML tag=TLGMH0GWX7OJ type=del size=3309042 2024-09-14T10:57:41.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.479+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=KH1C25NAK0IY type=del size=3777736 2024-09-14T10:57:41.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.483+0000 7fdf8f02c8c0 1 < suggested remove operation key=LFLY0V3FRRW5 tag=I3R9A4AO2F0S type=del 2024-09-14T10:57:41.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.487+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=3YSFLZIP7B3B type=del size=1359124 2024-09-14T10:57:41.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.491+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~R5VRZ6VMTALB.0 size=655239 2024-09-14T10:57:41.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.499+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=R5VRZ6VMTALB tag=KTDFJDL22JKN type=write size=1703815 2024-09-14T10:57:41.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.503+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=IIK98R5362AX type=write size=293106 2024-09-14T10:57:41.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.511+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=VQV95U4D8X02 type=del 2024-09-14T10:57:41.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.515+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=6DKMXPVD2B1H type=del size=1564691 2024-09-14T10:57:41.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.519+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=9BBO52T1LFYM type=del 2024-09-14T10:57:41.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.527+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~NLGSER37P4L8.0 size=295247 2024-09-14T10:57:41.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.527+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=NLGSER37P4L8 tag=T0PH3QS5PLZ8 type=write size=1343823 2024-09-14T10:57:41.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.531+0000 7fdf8f02c8c0 1 < completed write operation key=YU9DAJA242Q7 tag=GQS13Q5EKUE4 type=write size=23858 2024-09-14T10:57:41.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.535+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=I4YAB77MC16Z type=del size=2828415 2024-09-14T10:57:41.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.539+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=AINQC1GLNURF type=del 2024-09-14T10:57:41.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.543+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=V4UZH9W5VH11 type=del size=2377038 2024-09-14T10:57:41.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.547+0000 7fdf8f02c8c0 1 < completed write operation key=YU9DAJA242Q7 tag=RX4GMEAOX1C8 type=write size=567176 2024-09-14T10:57:41.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.555+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~U78XV6FF5I89.0 size=1048576 2024-09-14T10:57:41.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.559+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~U78XV6FF5I89.1 size=1048576 2024-09-14T10:57:41.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~U78XV6FF5I89.2 size=109459 2024-09-14T10:57:41.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.563+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=U78XV6FF5I89 tag=26KTRN72UA4V type=write size=3255187 2024-09-14T10:57:41.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.563+0000 7fdf8f02c8c0 1 < completed write operation key=WA7HE8ZJ1W1M tag=HDYLPBLA5UBJ type=write size=448706 2024-09-14T10:57:41.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.567+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=21HQ8USZ5036 type=del size=1831172 2024-09-14T10:57:41.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.571+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=GWQZ7ZJJU0JG type=del 2024-09-14T10:57:41.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.575+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=GX9YNIC9YQ6I type=del size=3790826 2024-09-14T10:57:41.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.579+0000 7fdf8f02c8c0 1 < completed write operation key=ZSBCGOXXJ0D5 tag=MPDWTCY8VQQI type=write size=931464 2024-09-14T10:57:41.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.583+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=F3LSIW0RZKV0 type=del size=678087 2024-09-14T10:57:41.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.587+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=4FZ2FUMP8SOF type=del 2024-09-14T10:57:41.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.591+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=EQJ197ND35V6 type=del size=2863624 2024-09-14T10:57:41.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.595+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~51HQVLNXM495.0 size=1048576 2024-09-14T10:57:41.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.599+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~51HQVLNXM495.1 size=351769 2024-09-14T10:57:41.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.603+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=51HQVLNXM495 tag=BILWMQMS3Y8Q type=write size=2448921 2024-09-14T10:57:41.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.607+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=T5ZNUQCYSLBX type=del size=4185665 2024-09-14T10:57:41.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.611+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=GJ3QZUCRHQCI type=del 2024-09-14T10:57:41.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.615+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=WOTR9S2Z9WOO type=del size=2205230 2024-09-14T10:57:41.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.619+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~ULNSU7W4SOT6.0 size=221956 2024-09-14T10:57:41.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.623+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=ULNSU7W4SOT6 tag=GZ9960ZPARXA type=write size=1270532 2024-09-14T10:57:41.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.631+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~UK0AOPJYRFPH.0 size=1048576 2024-09-14T10:57:41.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.635+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~UK0AOPJYRFPH.1 size=61241 2024-09-14T10:57:41.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.635+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=UK0AOPJYRFPH tag=FEQVX3NOU1U3 type=write size=2158393 2024-09-14T10:57:41.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.639+0000 7fdf8f02c8c0 1 < canceled operation key=0QJLAH0EPKVD tag=ZSS1O83REKML type=del size=660398 2024-09-14T10:57:41.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~3ZWKMNHVV1SQ.0 size=1048576 2024-09-14T10:57:41.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~3ZWKMNHVV1SQ.1 size=1048576 2024-09-14T10:57:41.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~3ZWKMNHVV1SQ.2 size=1002578 2024-09-14T10:57:41.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.651+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=3ZWKMNHVV1SQ tag=85EA39WU7WML type=write size=4148306 2024-09-14T10:57:41.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.659+0000 7fdf8f02c8c0 1 < suggested remove operation key=LCEH2YXNSOGT tag=KH1C25NAK0IY type=del 2024-09-14T10:57:41.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.663+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=WOWCTNZCY4BW type=write size=859553 2024-09-14T10:57:41.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.671+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=3YSFLZIP7B3B type=del 2024-09-14T10:57:41.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.679+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MNW4N1C5KV4M.0 size=1048576 2024-09-14T10:57:41.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MNW4N1C5KV4M.1 size=1048576 2024-09-14T10:57:41.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.687+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MNW4N1C5KV4M.2 size=230941 2024-09-14T10:57:41.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.687+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=MNW4N1C5KV4M tag=RDRUEGNUZAHU type=write size=3376669 2024-09-14T10:57:41.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.695+0000 7fdf8f02c8c0 1 < suggested remove operation key=OFY1G5R28CK6 tag=IIK98R5362AX type=write 2024-09-14T10:57:41.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.699+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=BIGIAY54G3D6 type=del size=909821 2024-09-14T10:57:41.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.703+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=6DKMXPVD2B1H type=del 2024-09-14T10:57:41.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.711+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~3SCUUP7NMF72.0 size=11331 2024-09-14T10:57:41.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.711+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=3SCUUP7NMF72 tag=4L9UIY8X7B06 type=write size=1059907 2024-09-14T10:57:41.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.715+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~NLGSER37P4L8.0 size=295247 2024-09-14T10:57:41.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.723+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=NLGSER37P4L8 tag=T0PH3QS5PLZ8 type=write size=1343823 2024-09-14T10:57:41.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.723+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=LHQDI15WR7YD type=del size=3239291 2024-09-14T10:57:41.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.727+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=I4YAB77MC16Z type=del 2024-09-14T10:57:41.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.731+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=Y0XS0HHGI35S type=del size=224307 2024-09-14T10:57:41.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.735+0000 7fdf8f02c8c0 1 < canceled operation key=TZZ05IIMZJ4J tag=V4UZH9W5VH11 type=del size=2377038 2024-09-14T10:57:41.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.743+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~4JF2IWX5HZ4Y.0 size=446799 2024-09-14T10:57:41.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.743+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=4JF2IWX5HZ4Y tag=TG35LHCNO1ZX type=write size=1495375 2024-09-14T10:57:41.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.747+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~U78XV6FF5I89.0 size=1048576 2024-09-14T10:57:41.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.751+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~U78XV6FF5I89.1 size=1048576 2024-09-14T10:57:41.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.751+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~U78XV6FF5I89.2 size=109459 2024-09-14T10:57:41.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.759+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=U78XV6FF5I89 tag=26KTRN72UA4V type=write size=3255187 2024-09-14T10:57:41.759 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.763+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=C92XHN184FB0 type=del size=2168253 2024-09-14T10:57:41.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.767+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=21HQ8USZ5036 type=del 2024-09-14T10:57:41.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.775+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~1H82ZZ30OBIB.0 size=1048576 2024-09-14T10:57:41.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.779+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~1H82ZZ30OBIB.1 size=1048576 2024-09-14T10:57:41.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.783+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~1H82ZZ30OBIB.2 size=359699 2024-09-14T10:57:41.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.783+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=1H82ZZ30OBIB tag=TDWWAIYW4947 type=write size=3505427 2024-09-14T10:57:41.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.791+0000 7fdf8f02c8c0 1 < suggested update operation key=Y32RWGISRBMT tag=GX9YNIC9YQ6I type=del size=3790826 2024-09-14T10:57:41.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~YKKYCWEVHXHE.0 size=1048576 2024-09-14T10:57:41.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.799+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~YKKYCWEVHXHE.1 size=1048576 2024-09-14T10:57:41.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.803+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~YKKYCWEVHXHE.2 size=145910 2024-09-14T10:57:41.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.803+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=YKKYCWEVHXHE tag=1HJ04Z9UY8OV type=write size=3291638 2024-09-14T10:57:41.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.811+0000 7fdf8f02c8c0 1 < suggested update operation key=APDKRWHOUH9T tag=F3LSIW0RZKV0 type=del size=678087 2024-09-14T10:57:41.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.815+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=8KCABG9CVMTW type=del size=2387517 2024-09-14T10:57:41.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.819+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=EQJ197ND35V6 type=del 2024-09-14T10:57:41.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.827+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~WZPJTI4RS6E3.0 size=459632 2024-09-14T10:57:41.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.827+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=WZPJTI4RS6E3 tag=M9FY7SVHOGHD type=write size=1508208 2024-09-14T10:57:41.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.831+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=T5ZNUQCYSLBX type=del 2024-09-14T10:57:41.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.835+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=8354MV22E6A3 type=write size=438511 2024-09-14T10:57:41.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.839+0000 7fdf8f02c8c0 -1 < failed to complete operation key=APDKRWHOUH9T tag=WOTR9S2Z9WOO type=del size=2205230: (22) Invalid argument 2024-09-14T10:57:41.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.839+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=T33KA946VVZ2 type=del size=1047305 2024-09-14T10:57:41.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.843+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~UK0AOPJYRFPH.0 size=1048576 2024-09-14T10:57:41.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.847+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~UK0AOPJYRFPH.1 size=61241 2024-09-14T10:57:41.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.855+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=UK0AOPJYRFPH tag=FEQVX3NOU1U3 type=write size=2158393 2024-09-14T10:57:41.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.859+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~AMJ1ILBWO2JQ.0 size=1048576 2024-09-14T10:57:41.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~AMJ1ILBWO2JQ.1 size=1048576 2024-09-14T10:57:41.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.867+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~AMJ1ILBWO2JQ.2 size=408685 2024-09-14T10:57:41.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.867+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=AMJ1ILBWO2JQ tag=FG9U4OSWWNJP type=write size=3554413 2024-09-14T10:57:41.864 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.867+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~3ZWKMNHVV1SQ.0 size=1048576 2024-09-14T10:57:41.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~3ZWKMNHVV1SQ.1 size=1048576 2024-09-14T10:57:41.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.875+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~3ZWKMNHVV1SQ.2 size=1002578 2024-09-14T10:57:41.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.879+0000 7fdf8f02c8c0 1 < canceled multipart upload key=OFY1G5R28CK6 upload=3ZWKMNHVV1SQ tag=85EA39WU7WML type=write size=4148306 2024-09-14T10:57:41.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.883+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=HWRT3V85QVO0 type=del size=1950516 2024-09-14T10:57:41.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.887+0000 7fdf8f02c8c0 1 < completed write operation key=0QJLAH0EPKVD tag=WOWCTNZCY4BW type=write size=859553 2024-09-14T10:57:41.888 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.891+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=KVIQQIX27B0E type=del size=3134549 2024-09-14T10:57:41.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.895+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MNW4N1C5KV4M.0 size=1048576 2024-09-14T10:57:41.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MNW4N1C5KV4M.1 size=1048576 2024-09-14T10:57:41.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MNW4N1C5KV4M.2 size=230941 2024-09-14T10:57:41.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.911+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=MNW4N1C5KV4M tag=RDRUEGNUZAHU type=write size=3376669 2024-09-14T10:57:41.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.919+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~XWZNP4XC34QC.0 size=1048576 2024-09-14T10:57:41.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~XWZNP4XC34QC.1 size=662824 2024-09-14T10:57:41.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.923+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=XWZNP4XC34QC tag=PN7P58A1NLKM type=write size=2759976 2024-09-14T10:57:41.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.927+0000 7fdf8f02c8c0 -1 < failed to complete operation key=Y32RWGISRBMT tag=BIGIAY54G3D6 type=del size=909821: (22) Invalid argument 2024-09-14T10:57:41.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.931+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=KMRL2X4KU1F6 type=del size=890455 2024-09-14T10:57:41.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.935+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~3SCUUP7NMF72.0 size=11331 2024-09-14T10:57:41.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.943+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=3SCUUP7NMF72 tag=4L9UIY8X7B06 type=write size=1059907 2024-09-14T10:57:41.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~76B780Y24B4V.0 size=1048576 2024-09-14T10:57:41.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~76B780Y24B4V.1 size=677655 2024-09-14T10:57:41.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.951+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=76B780Y24B4V tag=QWF5XTHU1DRL type=write size=2774807 2024-09-14T10:57:41.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.959+0000 7fdf8f02c8c0 1 < suggested remove operation key=OFY1G5R28CK6 tag=LHQDI15WR7YD type=del 2024-09-14T10:57:41.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.967+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=PNVXAB3TKMNW type=del size=2668430 2024-09-14T10:57:41.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.971+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=Y0XS0HHGI35S type=del 2024-09-14T10:57:41.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.979+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~S9036K9ML61Q.0 size=1048576 2024-09-14T10:57:41.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.979+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~S9036K9ML61Q.1 size=184419 2024-09-14T10:57:41.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.979+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=S9036K9ML61Q tag=W2H08100TCEC type=write size=2281571 2024-09-14T10:57:41.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~4JF2IWX5HZ4Y.0 size=446799 2024-09-14T10:57:41.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.991+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=4JF2IWX5HZ4Y tag=TG35LHCNO1ZX type=write size=1495375 2024-09-14T10:57:41.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.999+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~P634KBJVDXQY.0 size=987659 2024-09-14T10:57:41.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:41.999+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=P634KBJVDXQY tag=5Q06HQ5M6GOX type=write size=2036235 2024-09-14T10:57:41.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.003+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=C92XHN184FB0 type=del 2024-09-14T10:57:42.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~6F1H56IPWQRK.0 size=1048576 2024-09-14T10:57:42.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~6F1H56IPWQRK.1 size=993736 2024-09-14T10:57:42.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.011+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=6F1H56IPWQRK tag=3BAZ2YN9HR1M type=write size=3090888 2024-09-14T10:57:42.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.015+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~1H82ZZ30OBIB.0 size=1048576 2024-09-14T10:57:42.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.019+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~1H82ZZ30OBIB.1 size=1048576 2024-09-14T10:57:42.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.023+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~1H82ZZ30OBIB.2 size=359699 2024-09-14T10:57:42.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.027+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=1H82ZZ30OBIB tag=TDWWAIYW4947 type=write size=3505427 2024-09-14T10:57:42.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.031+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=APJIGMGXAMJ0 type=del size=1109322 2024-09-14T10:57:42.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.039+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~YKKYCWEVHXHE.0 size=1048576 2024-09-14T10:57:42.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.043+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~YKKYCWEVHXHE.1 size=1048576 2024-09-14T10:57:42.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.043+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LFLY0V3FRRW5.2~YKKYCWEVHXHE.2 size=145910 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.047+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LFLY0V3FRRW5 upload=YKKYCWEVHXHE tag=1HJ04Z9UY8OV type=write size=3291638 2024-09-14T10:57:42.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.051+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=KU5MXITHZH6W type=del size=1820506 2024-09-14T10:57:42.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.055+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=8KCABG9CVMTW type=del 2024-09-14T10:57:42.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~FC4Z2VYLI0RI.0 size=555665 2024-09-14T10:57:42.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.063+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=FC4Z2VYLI0RI tag=624WN99H77C1 type=write size=1604241 2024-09-14T10:57:42.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.067+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~WZPJTI4RS6E3.0 size=459632 2024-09-14T10:57:42.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.075+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=WZPJTI4RS6E3 tag=M9FY7SVHOGHD type=write size=1508208 2024-09-14T10:57:42.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.075+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=UOD0NIJVMXVI type=del size=2010214 2024-09-14T10:57:42.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.083+0000 7fdf8f02c8c0 1 < completed write operation key=82N2FPU7LKTG tag=8354MV22E6A3 type=write size=438511 2024-09-14T10:57:42.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.087+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~Y4X5G6FZAR9J.0 size=246576 2024-09-14T10:57:42.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.087+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=Y4X5G6FZAR9J tag=BAYCVCX2FQEL type=write size=1295152 2024-09-14T10:57:42.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.091+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=T33KA946VVZ2 type=del 2024-09-14T10:57:42.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.095+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=4RMWBW397WUV type=del size=4114778 2024-09-14T10:57:42.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.099+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~AMJ1ILBWO2JQ.0 size=1048576 2024-09-14T10:57:42.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.103+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~AMJ1ILBWO2JQ.1 size=1048576 2024-09-14T10:57:42.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.107+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~AMJ1ILBWO2JQ.2 size=408685 2024-09-14T10:57:42.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.115+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=AMJ1ILBWO2JQ tag=FG9U4OSWWNJP type=write size=3554413 2024-09-14T10:57:42.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~EEYAXGCOCM5L.0 size=1048576 2024-09-14T10:57:42.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~EEYAXGCOCM5L.1 size=1048576 2024-09-14T10:57:42.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.127+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~EEYAXGCOCM5L.2 size=120086 2024-09-14T10:57:42.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.127+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=EEYAXGCOCM5L tag=BSBEJ84W8H32 type=write size=3265814 2024-09-14T10:57:42.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.131+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=HWRT3V85QVO0 type=del 2024-09-14T10:57:42.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.135+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=E7TW09054FN7 type=del size=3377445 2024-09-14T10:57:42.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.139+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=KVIQQIX27B0E type=del 2024-09-14T10:57:42.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.147+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~TXL2SUZK7MDX.0 size=1048576 2024-09-14T10:57:42.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~TXL2SUZK7MDX.1 size=1048576 2024-09-14T10:57:42.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~TXL2SUZK7MDX.2 size=555381 2024-09-14T10:57:42.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.151+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=TXL2SUZK7MDX tag=KN72ANNPJN19 type=write size=3701109 2024-09-14T10:57:42.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.155+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~XWZNP4XC34QC.0 size=1048576 2024-09-14T10:57:42.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.159+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~XWZNP4XC34QC.1 size=662824 2024-09-14T10:57:42.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.167+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=XWZNP4XC34QC tag=PN7P58A1NLKM type=write size=2759976 2024-09-14T10:57:42.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.171+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=V2ICPAC6QHQ1 type=write size=117965 2024-09-14T10:57:42.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.175+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=KMRL2X4KU1F6 type=del 2024-09-14T10:57:42.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.179+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=CE4A3KFGKB6Y type=del size=1943022 2024-09-14T10:57:42.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.183+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~76B780Y24B4V.0 size=1048576 2024-09-14T10:57:42.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.187+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~76B780Y24B4V.1 size=677655 2024-09-14T10:57:42.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.195+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=76B780Y24B4V tag=QWF5XTHU1DRL type=write size=2774807 2024-09-14T10:57:42.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.199+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=0VP6K4MO3IFU type=del size=3190698 2024-09-14T10:57:42.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.203+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=PNVXAB3TKMNW type=del 2024-09-14T10:57:42.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.211+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~85518HJUT610.0 size=730065 2024-09-14T10:57:42.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.211+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=85518HJUT610 tag=HRNZXJODA9KH type=write size=1778641 2024-09-14T10:57:42.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.215+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~S9036K9ML61Q.0 size=1048576 2024-09-14T10:57:42.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.219+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~S9036K9ML61Q.1 size=184419 2024-09-14T10:57:42.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.223+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=S9036K9ML61Q tag=W2H08100TCEC type=write size=2281571 2024-09-14T10:57:42.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.231+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~MM1FOZDPEH8J.0 size=1048576 2024-09-14T10:57:42.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.235+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~MM1FOZDPEH8J.1 size=1048576 2024-09-14T10:57:42.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.239+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~MM1FOZDPEH8J.2 size=511998 2024-09-14T10:57:42.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.239+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=MM1FOZDPEH8J tag=VFCZ5LR5W9I6 type=write size=3657726 2024-09-14T10:57:42.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~P634KBJVDXQY.0 size=987659 2024-09-14T10:57:42.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.247+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=P634KBJVDXQY tag=5Q06HQ5M6GOX type=write size=2036235 2024-09-14T10:57:42.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.251+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=V6HRM9MZUYV1 type=del size=3372920 2024-09-14T10:57:42.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.255+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~6F1H56IPWQRK.0 size=1048576 2024-09-14T10:57:42.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.259+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~6F1H56IPWQRK.1 size=993736 2024-09-14T10:57:42.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.263+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=6F1H56IPWQRK tag=3BAZ2YN9HR1M type=write size=3090888 2024-09-14T10:57:42.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.267+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=547697PPW19B type=write size=973346 2024-09-14T10:57:42.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.271+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=APJIGMGXAMJ0 type=del 2024-09-14T10:57:42.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.275+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=P750F3L9Y50J type=del size=905453 2024-09-14T10:57:42.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.283+0000 7fdf8f02c8c0 1 < suggested update operation key=WA7HE8ZJ1W1M tag=KU5MXITHZH6W type=del size=1820506 2024-09-14T10:57:42.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.287+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=MB0ZI27EYNG5 type=del size=3383365 2024-09-14T10:57:42.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.287+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_304ZNF4OC1ML.2~FC4Z2VYLI0RI.0 size=555665 2024-09-14T10:57:42.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.295+0000 7fdf8f02c8c0 1 < canceled multipart upload key=304ZNF4OC1ML upload=FC4Z2VYLI0RI tag=624WN99H77C1 type=write size=1604241 2024-09-14T10:57:42.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.299+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=OOWOUKRCKBCP type=del size=3586514 2024-09-14T10:57:42.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.303+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=UOD0NIJVMXVI type=del 2024-09-14T10:57:42.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.307+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=YMNYHIMXE9CH type=del size=2660299 2024-09-14T10:57:42.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.311+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~Y4X5G6FZAR9J.0 size=246576 2024-09-14T10:57:42.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.315+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=Y4X5G6FZAR9J tag=BAYCVCX2FQEL type=write size=1295152 2024-09-14T10:57:42.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.319+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=6TPW95O2IQZX type=del size=2201040 2024-09-14T10:57:42.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.323+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=4RMWBW397WUV type=del 2024-09-14T10:57:42.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.331+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~Z1XZUS3ZV42C.0 size=1048576 2024-09-14T10:57:42.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.335+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~Z1XZUS3ZV42C.1 size=1048576 2024-09-14T10:57:42.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.335+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~Z1XZUS3ZV42C.2 size=942358 2024-09-14T10:57:42.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.335+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=Z1XZUS3ZV42C tag=55ZP3X32HGYL type=write size=4088086 2024-09-14T10:57:42.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.339+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~EEYAXGCOCM5L.0 size=1048576 2024-09-14T10:57:42.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.343+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~EEYAXGCOCM5L.1 size=1048576 2024-09-14T10:57:42.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.347+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~EEYAXGCOCM5L.2 size=120086 2024-09-14T10:57:42.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.351+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=EEYAXGCOCM5L tag=BSBEJ84W8H32 type=write size=3265814 2024-09-14T10:57:42.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.355+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=D5J4Y3AA6OCA type=del size=1017711 2024-09-14T10:57:42.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.363+0000 7fdf8f02c8c0 1 < suggested update operation key=YU9DAJA242Q7 tag=E7TW09054FN7 type=del size=3377445 2024-09-14T10:57:42.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.367+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=AFL0ZWBFHXOK type=del size=71252 2024-09-14T10:57:42.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.371+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~TXL2SUZK7MDX.0 size=1048576 2024-09-14T10:57:42.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.375+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~TXL2SUZK7MDX.1 size=1048576 2024-09-14T10:57:42.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.375+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~TXL2SUZK7MDX.2 size=555381 2024-09-14T10:57:42.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.383+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=TXL2SUZK7MDX tag=KN72ANNPJN19 type=write size=3701109 2024-09-14T10:57:42.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.391+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~C9VK1D8X4FFM.0 size=148883 2024-09-14T10:57:42.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.391+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=C9VK1D8X4FFM tag=85D2Z3YEE3G5 type=write size=1197459 2024-09-14T10:57:42.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.399+0000 7fdf8f02c8c0 1 < completed write operation key=49O8DPTGA65S tag=V2ICPAC6QHQ1 type=write size=117965 2024-09-14T10:57:42.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~54BZQLPVUVX0.0 size=1048576 2024-09-14T10:57:42.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~54BZQLPVUVX0.1 size=1048576 2024-09-14T10:57:42.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~54BZQLPVUVX0.2 size=709281 2024-09-14T10:57:42.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.411+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=54BZQLPVUVX0 tag=BQ5I95QYACQV type=write size=3855009 2024-09-14T10:57:42.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.419+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZSBCGOXXJ0D5 tag=CE4A3KFGKB6Y type=del 2024-09-14T10:57:42.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.423+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=0O0CKM4CBSNK type=del size=2494636 2024-09-14T10:57:42.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.427+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=0VP6K4MO3IFU type=del 2024-09-14T10:57:42.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.431+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~8R0XSYUU6028.0 size=190523 2024-09-14T10:57:42.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.431+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=8R0XSYUU6028 tag=P3NJZHP3NVDQ type=write size=1239099 2024-09-14T10:57:42.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.435+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~85518HJUT610.0 size=730065 2024-09-14T10:57:42.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.443+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=85518HJUT610 tag=HRNZXJODA9KH type=write size=1778641 2024-09-14T10:57:42.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.447+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~E3LVBK7W4WHK.0 size=97794 2024-09-14T10:57:42.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.447+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=E3LVBK7W4WHK tag=NZ0BGYJSKU9P type=write size=1146370 2024-09-14T10:57:42.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.451+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~MM1FOZDPEH8J.0 size=1048576 2024-09-14T10:57:42.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~MM1FOZDPEH8J.1 size=1048576 2024-09-14T10:57:42.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.459+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~MM1FOZDPEH8J.2 size=511998 2024-09-14T10:57:42.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.463+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=MM1FOZDPEH8J tag=VFCZ5LR5W9I6 type=write size=3657726 2024-09-14T10:57:42.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.467+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=RV2S33NDJI43 type=del size=598481 2024-09-14T10:57:42.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.471+0000 7fdf8f02c8c0 -1 < failed to complete operation key=WA7HE8ZJ1W1M tag=V6HRM9MZUYV1 type=del size=3372920: (22) Invalid argument 2024-09-14T10:57:42.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.475+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=I58GEN267E10 type=del size=3080172 2024-09-14T10:57:42.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.479+0000 7fdf8f02c8c0 1 < completed write operation key=KVZEUYUSV5JI tag=547697PPW19B type=write size=973346 2024-09-14T10:57:42.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.487+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~8YI9YIPP74AN.0 size=58595 2024-09-14T10:57:42.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.487+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=8YI9YIPP74AN tag=JK1INP5K93UB type=write size=1107171 2024-09-14T10:57:42.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.491+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=P750F3L9Y50J type=del 2024-09-14T10:57:42.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.495+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=JW1RBAS7GB82 type=del size=2546242 2024-09-14T10:57:42.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.499+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=MB0ZI27EYNG5 type=del size=3383365 2024-09-14T10:57:42.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.507+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~392GW05VY54Z.0 size=708615 2024-09-14T10:57:42.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.507+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=392GW05VY54Z tag=0M6V3MFU6DKC type=write size=1757191 2024-09-14T10:57:42.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.511+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=OOWOUKRCKBCP type=del 2024-09-14T10:57:42.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.519+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~2OFDPS64M7GC.0 size=711901 2024-09-14T10:57:42.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.519+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=2OFDPS64M7GC tag=UTA399O2WTZ3 type=write size=1760477 2024-09-14T10:57:42.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.523+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=YMNYHIMXE9CH type=del 2024-09-14T10:57:42.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.527+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=2MJY9AANIZ49 type=write size=245305 2024-09-14T10:57:42.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.531+0000 7fdf8f02c8c0 1 < canceled operation key=X0RT8UF3D0JC tag=6TPW95O2IQZX type=del size=2201040 2024-09-14T10:57:42.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.539+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~N9IOL92PL2OA.0 size=59897 2024-09-14T10:57:42.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.539+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=N9IOL92PL2OA tag=JBOC7BCPIUNF type=write size=1108473 2024-09-14T10:57:42.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.539+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3CYCJJIQ210M.2~Z1XZUS3ZV42C.0 size=1048576 2024-09-14T10:57:42.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.543+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~Z1XZUS3ZV42C.1 size=1048576 2024-09-14T10:57:42.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.543+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3CYCJJIQ210M.2~Z1XZUS3ZV42C.2 size=942358 2024-09-14T10:57:42.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.547+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3CYCJJIQ210M upload=Z1XZUS3ZV42C tag=55ZP3X32HGYL type=write size=4088086 2024-09-14T10:57:42.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.551+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=06G6ILK38ZJY type=del size=3600534 2024-09-14T10:57:42.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.555+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=D5J4Y3AA6OCA type=del 2024-09-14T10:57:42.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~XSX9CVKEE8SQ.0 size=1048576 2024-09-14T10:57:42.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.567+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~XSX9CVKEE8SQ.1 size=1048576 2024-09-14T10:57:42.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.567+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~XSX9CVKEE8SQ.2 size=7650 2024-09-14T10:57:42.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.567+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=XSX9CVKEE8SQ tag=X2UHUPDDDRCQ type=write size=3153378 2024-09-14T10:57:42.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.575+0000 7fdf8f02c8c0 1 < suggested remove operation key=STB3W5URFJEZ tag=AFL0ZWBFHXOK type=del 2024-09-14T10:57:42.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.579+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=S24P2QKOQJXQ type=del size=573828 2024-09-14T10:57:42.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.583+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~C9VK1D8X4FFM.0 size=148883 2024-09-14T10:57:42.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.591+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=C9VK1D8X4FFM tag=85D2Z3YEE3G5 type=write size=1197459 2024-09-14T10:57:42.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.595+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~F5QVTE1T4PCC.0 size=166789 2024-09-14T10:57:42.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.595+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=F5QVTE1T4PCC tag=F54HZUROBX9E type=write size=1215365 2024-09-14T10:57:42.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.599+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~54BZQLPVUVX0.0 size=1048576 2024-09-14T10:57:42.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.599+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_L1ERJ0JSRDMG.2~54BZQLPVUVX0.1 size=1048576 2024-09-14T10:57:42.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.603+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~54BZQLPVUVX0.2 size=709281 2024-09-14T10:57:42.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.607+0000 7fdf8f02c8c0 1 < canceled multipart upload key=L1ERJ0JSRDMG upload=54BZQLPVUVX0 tag=BQ5I95QYACQV type=write size=3855009 2024-09-14T10:57:42.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.611+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=DHZ1RR36LTS5 type=del size=3376174 2024-09-14T10:57:42.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.615+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=STB3W5URFJEZ tag=0O0CKM4CBSNK type=del size=2494636: (2) No such file or directory 2024-09-14T10:57:42.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.623+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~5O83ZWVI328Y.0 size=264640 2024-09-14T10:57:42.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.623+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=5O83ZWVI328Y tag=ZIYG57PZHN8G type=write size=1313216 2024-09-14T10:57:42.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.623+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~8R0XSYUU6028.0 size=190523 2024-09-14T10:57:42.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.631+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=8R0XSYUU6028 tag=P3NJZHP3NVDQ type=write size=1239099 2024-09-14T10:57:42.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.635+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~LQ5QHW846F3Q.0 size=59801 2024-09-14T10:57:42.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.639+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=LQ5QHW846F3Q tag=K8T94KYHLYZA type=write size=1108377 2024-09-14T10:57:42.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.639+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~E3LVBK7W4WHK.0 size=97794 2024-09-14T10:57:42.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.647+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=E3LVBK7W4WHK tag=NZ0BGYJSKU9P type=write size=1146370 2024-09-14T10:57:42.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.651+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=5XB2M1FOTIUS type=write size=1005299 2024-09-14T10:57:42.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.655+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=RV2S33NDJI43 type=del 2024-09-14T10:57:42.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.659+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~QJ8Y000TWOC7.0 size=1048576 2024-09-14T10:57:42.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.663+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~QJ8Y000TWOC7.1 size=1048576 2024-09-14T10:57:42.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~QJ8Y000TWOC7.2 size=799522 2024-09-14T10:57:42.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.667+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=QJ8Y000TWOC7 tag=ZR26A16BV9KG type=write size=3945250 2024-09-14T10:57:42.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.675+0000 7fdf8f02c8c0 1 < suggested update operation key=ZF6IDD8B3CFO tag=I58GEN267E10 type=del size=3080172 2024-09-14T10:57:42.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.679+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=HFZTK6JY14SJ type=del size=941207 2024-09-14T10:57:42.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.683+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~8YI9YIPP74AN.0 size=58595 2024-09-14T10:57:42.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.687+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=8YI9YIPP74AN tag=JK1INP5K93UB type=write size=1107171 2024-09-14T10:57:42.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.695+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~OMVP8VANBBOF.0 size=1048576 2024-09-14T10:57:42.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.699+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~OMVP8VANBBOF.1 size=565384 2024-09-14T10:57:42.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.699+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=OMVP8VANBBOF tag=5KSO0IHX6GIC type=write size=2662536 2024-09-14T10:57:42.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.707+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=JW1RBAS7GB82 type=del 2024-09-14T10:57:42.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.711+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=9BS6Z3FW3MKG type=write size=699087 2024-09-14T10:57:42.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.715+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~392GW05VY54Z.0 size=708615 2024-09-14T10:57:42.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.719+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=392GW05VY54Z tag=0M6V3MFU6DKC type=write size=1757191 2024-09-14T10:57:42.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.727+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~9E0KBNJX3TN9.0 size=1048576 2024-09-14T10:57:42.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.727+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~9E0KBNJX3TN9.1 size=1048576 2024-09-14T10:57:42.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.731+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~9E0KBNJX3TN9.2 size=864709 2024-09-14T10:57:42.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.731+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=9E0KBNJX3TN9 tag=UDP0UTN0NQ2F type=write size=4010437 2024-09-14T10:57:42.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.735+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~2OFDPS64M7GC.0 size=711901 2024-09-14T10:57:42.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.747+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=2OFDPS64M7GC tag=UTA399O2WTZ3 type=write size=1760477 2024-09-14T10:57:42.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.751+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=0ZT6MQTVIPLT type=write size=65682 2024-09-14T10:57:42.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.759+0000 7fdf8f02c8c0 1 < completed write operation key=WA7HE8ZJ1W1M tag=2MJY9AANIZ49 type=write size=245305 2024-09-14T10:57:42.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.759+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=77EC38Y8U8W1 type=del size=2378436 2024-09-14T10:57:42.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.759+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_YU9DAJA242Q7.2~N9IOL92PL2OA.0 size=59897 2024-09-14T10:57:42.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.767+0000 7fdf8f02c8c0 1 < canceled multipart upload key=YU9DAJA242Q7 upload=N9IOL92PL2OA tag=JBOC7BCPIUNF type=write size=1108473 2024-09-14T10:57:42.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.771+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=HAWAU5VBOUP0 type=del size=2752865 2024-09-14T10:57:42.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.775+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=06G6ILK38ZJY type=del 2024-09-14T10:57:42.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.779+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=E7PV3THWEQ0A type=write size=67367 2024-09-14T10:57:42.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.783+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~XSX9CVKEE8SQ.0 size=1048576 2024-09-14T10:57:42.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.783+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_82N2FPU7LKTG.2~XSX9CVKEE8SQ.1 size=1048576 2024-09-14T10:57:42.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.787+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~XSX9CVKEE8SQ.2 size=7650 2024-09-14T10:57:42.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.795+0000 7fdf8f02c8c0 1 < canceled multipart upload key=82N2FPU7LKTG upload=XSX9CVKEE8SQ tag=X2UHUPDDDRCQ type=write size=3153378 2024-09-14T10:57:42.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.799+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~UO6NUTH9SGZX.0 size=1048576 2024-09-14T10:57:42.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.803+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~UO6NUTH9SGZX.1 size=1043308 2024-09-14T10:57:42.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.803+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=UO6NUTH9SGZX tag=VNPH3IJ54K49 type=write size=3140460 2024-09-14T10:57:42.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.807+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=S24P2QKOQJXQ type=del 2024-09-14T10:57:42.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.811+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=UN3R4OKN9IDC type=write size=1031716 2024-09-14T10:57:42.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~F5QVTE1T4PCC.0 size=166789 2024-09-14T10:57:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.819+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=F5QVTE1T4PCC tag=F54HZUROBX9E type=write size=1215365 2024-09-14T10:57:42.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.823+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=IGOLQ77JU6XJ type=del size=1652771 2024-09-14T10:57:42.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.827+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=DHZ1RR36LTS5 type=del 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.831+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=TY9E9IDEAHYC type=del size=2531193 2024-09-14T10:57:42.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.835+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~5O83ZWVI328Y.0 size=264640 2024-09-14T10:57:42.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.843+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=5O83ZWVI328Y tag=ZIYG57PZHN8G type=write size=1313216 2024-09-14T10:57:42.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.847+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=HWX3K12U58PQ type=del size=2946621 2024-09-14T10:57:42.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.851+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~LQ5QHW846F3Q.0 size=59801 2024-09-14T10:57:42.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.855+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=LQ5QHW846F3Q tag=K8T94KYHLYZA type=write size=1108377 2024-09-14T10:57:42.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~4A9MU4HQ25SV.0 size=1048576 2024-09-14T10:57:42.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.867+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~4A9MU4HQ25SV.1 size=323078 2024-09-14T10:57:42.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.867+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=4A9MU4HQ25SV tag=FEXKKV1OQ7Z8 type=write size=2420230 2024-09-14T10:57:42.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.875+0000 7fdf8f02c8c0 1 < suggested update operation key=WA7HE8ZJ1W1M tag=5XB2M1FOTIUS type=write size=1005299 2024-09-14T10:57:42.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.879+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=7IA9QSIPUUYV type=del size=292597 2024-09-14T10:57:42.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.883+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~QJ8Y000TWOC7.0 size=1048576 2024-09-14T10:57:42.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.883+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~QJ8Y000TWOC7.1 size=1048576 2024-09-14T10:57:42.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.887+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~QJ8Y000TWOC7.2 size=799522 2024-09-14T10:57:42.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.895+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=QJ8Y000TWOC7 tag=ZR26A16BV9KG type=write size=3945250 2024-09-14T10:57:42.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.895+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=W3NN4N1P0YOW type=del size=2170434 2024-09-14T10:57:42.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.899+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=9IDBODZBQRJR tag=HFZTK6JY14SJ type=del size=941207: (2) No such file or directory 2024-09-14T10:57:42.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.907+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~J1L7HM5X4KOP.0 size=1048576 2024-09-14T10:57:42.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.907+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~J1L7HM5X4KOP.1 size=906015 2024-09-14T10:57:42.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.907+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=J1L7HM5X4KOP tag=7G0RSWJL1FG8 type=write size=3003167 2024-09-14T10:57:42.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.911+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~OMVP8VANBBOF.0 size=1048576 2024-09-14T10:57:42.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.915+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~OMVP8VANBBOF.1 size=565384 2024-09-14T10:57:42.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.923+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=OMVP8VANBBOF tag=5KSO0IHX6GIC type=write size=2662536 2024-09-14T10:57:42.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.927+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=9LPIOK6X1TOO type=write size=38754 2024-09-14T10:57:42.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.931+0000 7fdf8f02c8c0 1 < completed write operation key=5VZCCFRUAQJ7 tag=9BS6Z3FW3MKG type=write size=699087 2024-09-14T10:57:42.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.935+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=RWIJFZG7JEQA type=del size=1069500 2024-09-14T10:57:42.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.939+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~9E0KBNJX3TN9.0 size=1048576 2024-09-14T10:57:42.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.939+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~9E0KBNJX3TN9.1 size=1048576 2024-09-14T10:57:42.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.943+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~9E0KBNJX3TN9.2 size=864709 2024-09-14T10:57:42.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.947+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=9E0KBNJX3TN9 tag=UDP0UTN0NQ2F type=write size=4010437 2024-09-14T10:57:42.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.951+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=1OVB4WY91JX9 type=write size=814228 2024-09-14T10:57:42.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.955+0000 7fdf8f02c8c0 1 < completed write operation key=APDKRWHOUH9T tag=0ZT6MQTVIPLT type=write size=65682 2024-09-14T10:57:42.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.963+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~CFX0K3YKNCWN.0 size=88390 2024-09-14T10:57:42.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.963+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=CFX0K3YKNCWN tag=XE7CU07KR51C type=write size=1136966 2024-09-14T10:57:42.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.967+0000 7fdf8f02c8c0 1 < canceled operation key=0QJLAH0EPKVD tag=77EC38Y8U8W1 type=del size=2378436 2024-09-14T10:57:42.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.971+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=1ZRRP3S4LRM3 type=del size=3351059 2024-09-14T10:57:42.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.975+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=HAWAU5VBOUP0 type=del 2024-09-14T10:57:42.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~KUZ8J00IAV5E.0 size=1048576 2024-09-14T10:57:42.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~KUZ8J00IAV5E.1 size=1048576 2024-09-14T10:57:42.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~KUZ8J00IAV5E.2 size=908402 2024-09-14T10:57:42.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.987+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=KUZ8J00IAV5E tag=F9BBKDBEQ530 type=write size=4054130 2024-09-14T10:57:42.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.991+0000 7fdf8f02c8c0 1 < completed write operation key=5VZCCFRUAQJ7 tag=E7PV3THWEQ0A type=write size=67367 2024-09-14T10:57:42.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.995+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=E0JSEO1H7LOB type=del size=3096584 2024-09-14T10:57:42.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.995+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_ZF6IDD8B3CFO.2~UO6NUTH9SGZX.0 size=1048576 2024-09-14T10:57:42.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:42.999+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~UO6NUTH9SGZX.1 size=1043308 2024-09-14T10:57:43.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.003+0000 7fdf8f02c8c0 1 < canceled multipart upload key=ZF6IDD8B3CFO upload=UO6NUTH9SGZX tag=VNPH3IJ54K49 type=write size=3140460 2024-09-14T10:57:43.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.007+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=BVFOBDZWDQGQ type=write size=974366 2024-09-14T10:57:43.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.011+0000 7fdf8f02c8c0 1 < completed write operation key=LCEH2YXNSOGT tag=UN3R4OKN9IDC type=write size=1031716 2024-09-14T10:57:43.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.015+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=GYCU26C0ATG5 type=del size=1878501 2024-09-14T10:57:43.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.019+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=IGOLQ77JU6XJ type=del 2024-09-14T10:57:43.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.027+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~1Z2EWSBZXSFL.0 size=1048576 2024-09-14T10:57:43.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.027+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~1Z2EWSBZXSFL.1 size=545058 2024-09-14T10:57:43.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.027+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=1Z2EWSBZXSFL tag=0AZKBHCMRDOF type=write size=2642210 2024-09-14T10:57:43.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.031+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=TY9E9IDEAHYC type=del 2024-09-14T10:57:43.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.035+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=4VU7W5BKZKNA type=del size=3065273 2024-09-14T10:57:43.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.039+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=HWX3K12U58PQ type=del 2024-09-14T10:57:43.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.047+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~JSEDILT2SUQ0.0 size=1048576 2024-09-14T10:57:43.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.051+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~JSEDILT2SUQ0.1 size=1048576 2024-09-14T10:57:43.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.055+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~JSEDILT2SUQ0.2 size=440434 2024-09-14T10:57:43.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.055+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=JSEDILT2SUQ0 tag=RORBKYVRRJU0 type=write size=3586162 2024-09-14T10:57:43.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.055+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_X1BN3054IKNS.2~4A9MU4HQ25SV.0 size=1048576 2024-09-14T10:57:43.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.059+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~4A9MU4HQ25SV.1 size=323078 2024-09-14T10:57:43.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.063+0000 7fdf8f02c8c0 1 < canceled multipart upload key=X1BN3054IKNS upload=4A9MU4HQ25SV tag=FEXKKV1OQ7Z8 type=write size=2420230 2024-09-14T10:57:43.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.071+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~B7106GJUV1JV.0 size=468233 2024-09-14T10:57:43.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.071+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=B7106GJUV1JV tag=MOMELKXFFOJI type=write size=1516809 2024-09-14T10:57:43.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.079+0000 7fdf8f02c8c0 1 < suggested update operation key=X1BN3054IKNS tag=7IA9QSIPUUYV type=del size=292597 2024-09-14T10:57:43.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~AGF1QXWMQQFQ.0 size=676152 2024-09-14T10:57:43.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.083+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=AGF1QXWMQQFQ tag=33TDHI1G5B83 type=write size=1724728 2024-09-14T10:57:43.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.087+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=W3NN4N1P0YOW type=del 2024-09-14T10:57:43.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.091+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=C8EBF3PXB5KN type=del size=939561 2024-09-14T10:57:43.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.095+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~J1L7HM5X4KOP.0 size=1048576 2024-09-14T10:57:43.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.103+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~J1L7HM5X4KOP.1 size=906015 2024-09-14T10:57:43.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.107+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=J1L7HM5X4KOP tag=7G0RSWJL1FG8 type=write size=3003167 2024-09-14T10:57:43.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.111+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=V25C96EP62GP type=del size=2839468 2024-09-14T10:57:43.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.115+0000 7fdf8f02c8c0 1 < completed write operation key=APDKRWHOUH9T tag=9LPIOK6X1TOO type=write size=38754 2024-09-14T10:57:43.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.119+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=IUF54BEA1ANB type=del size=1105660 2024-09-14T10:57:43.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.127+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=RWIJFZG7JEQA type=del 2024-09-14T10:57:43.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.131+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=KEFFQE7ZTZEV type=del size=242272 2024-09-14T10:57:43.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.135+0000 7fdf8f02c8c0 1 < completed write operation key=XUT55FR490EO tag=1OVB4WY91JX9 type=write size=814228 2024-09-14T10:57:43.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.139+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=ZGNGFN8R04UH type=del size=1277766 2024-09-14T10:57:43.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.143+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~CFX0K3YKNCWN.0 size=88390 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.151+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=CFX0K3YKNCWN tag=XE7CU07KR51C type=write size=1136966 2024-09-14T10:57:43.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.155+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=N5C0OMEV4Z0O type=write size=934310 2024-09-14T10:57:43.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.159+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=1ZRRP3S4LRM3 type=del 2024-09-14T10:57:43.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.167+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~E7CZQWAYFIW9.0 size=674154 2024-09-14T10:57:43.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.167+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=E7CZQWAYFIW9 tag=PGDUCAJO2D2S type=write size=1722730 2024-09-14T10:57:43.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~KUZ8J00IAV5E.0 size=1048576 2024-09-14T10:57:43.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~KUZ8J00IAV5E.1 size=1048576 2024-09-14T10:57:43.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.175+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~KUZ8J00IAV5E.2 size=908402 2024-09-14T10:57:43.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.183+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=KUZ8J00IAV5E tag=F9BBKDBEQ530 type=write size=4054130 2024-09-14T10:57:43.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.187+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=OCVECD2IC2MT type=del size=3501567 2024-09-14T10:57:43.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.187+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=E0JSEO1H7LOB type=del 2024-09-14T10:57:43.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.195+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~078NKWAD5N9V.0 size=1048576 2024-09-14T10:57:43.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.199+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~078NKWAD5N9V.1 size=272657 2024-09-14T10:57:43.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.199+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=078NKWAD5N9V tag=E4UCDVRAYNVA type=write size=2369809 2024-09-14T10:57:43.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.203+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=BVFOBDZWDQGQ type=write size=974366 2024-09-14T10:57:43.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.207+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=LOB8TL9W623P type=del size=2049323 2024-09-14T10:57:43.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.211+0000 7fdf8f02c8c0 -1 < failed to complete operation key=X1BN3054IKNS tag=GYCU26C0ATG5 type=del size=1878501: (22) Invalid argument 2024-09-14T10:57:43.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~5LNRA8YJ28B5.0 size=1048576 2024-09-14T10:57:43.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~5LNRA8YJ28B5.1 size=296979 2024-09-14T10:57:43.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.219+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=5LNRA8YJ28B5 tag=6QS3MZGM5ZI5 type=write size=2394131 2024-09-14T10:57:43.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.223+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~1Z2EWSBZXSFL.0 size=1048576 2024-09-14T10:57:43.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.223+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_X0RT8UF3D0JC.2~1Z2EWSBZXSFL.1 size=545058 2024-09-14T10:57:43.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.231+0000 7fdf8f02c8c0 1 < canceled multipart upload key=X0RT8UF3D0JC upload=1Z2EWSBZXSFL tag=0AZKBHCMRDOF type=write size=2642210 2024-09-14T10:57:43.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.235+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=FU92KMINTL8A type=del size=597849 2024-09-14T10:57:43.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.239+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=4VU7W5BKZKNA type=del 2024-09-14T10:57:43.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.243+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=INT3RQOQBUMQ type=del size=964004 2024-09-14T10:57:43.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.247+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~JSEDILT2SUQ0.0 size=1048576 2024-09-14T10:57:43.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.247+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~JSEDILT2SUQ0.1 size=1048576 2024-09-14T10:57:43.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.251+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~JSEDILT2SUQ0.2 size=440434 2024-09-14T10:57:43.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.259+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=JSEDILT2SUQ0 tag=RORBKYVRRJU0 type=write size=3586162 2024-09-14T10:57:43.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.263+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~P2TJLMF1XNON.0 size=80046 2024-09-14T10:57:43.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.263+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=P2TJLMF1XNON tag=S2IF1OV1W1Z3 type=write size=1128622 2024-09-14T10:57:43.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.267+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~B7106GJUV1JV.0 size=468233 2024-09-14T10:57:43.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.275+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=B7106GJUV1JV tag=MOMELKXFFOJI type=write size=1516809 2024-09-14T10:57:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.279+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=CPF4JLG54NDW type=del size=241129 2024-09-14T10:57:43.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.283+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~AGF1QXWMQQFQ.0 size=676152 2024-09-14T10:57:43.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.291+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=AGF1QXWMQQFQ tag=33TDHI1G5B83 type=write size=1724728 2024-09-14T10:57:43.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.295+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=OUH5LDX02SA6 type=write size=769453 2024-09-14T10:57:43.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.303+0000 7fdf8f02c8c0 1 < suggested remove operation key=TZZ05IIMZJ4J tag=C8EBF3PXB5KN type=del 2024-09-14T10:57:43.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.307+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~J0YXJXISAUVX.0 size=1048576 2024-09-14T10:57:43.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.311+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~J0YXJXISAUVX.1 size=1048576 2024-09-14T10:57:43.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.315+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~J0YXJXISAUVX.2 size=406677 2024-09-14T10:57:43.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.315+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=J0YXJXISAUVX tag=LD32GPVEROCJ type=write size=3552405 2024-09-14T10:57:43.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.319+0000 7fdf8f02c8c0 1 < canceled operation key=82N2FPU7LKTG tag=V25C96EP62GP type=del size=2839468 2024-09-14T10:57:43.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.323+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~NE1MVMUY07HM.0 size=1048576 2024-09-14T10:57:43.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.327+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~NE1MVMUY07HM.1 size=335400 2024-09-14T10:57:43.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.327+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=NE1MVMUY07HM tag=2RWGWOUE9HDI type=write size=2432552 2024-09-14T10:57:43.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.331+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=IUF54BEA1ANB type=del 2024-09-14T10:57:43.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.335+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=KIOTRFBV2AIV type=del size=3644330 2024-09-14T10:57:43.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.339+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=KEFFQE7ZTZEV type=del 2024-09-14T10:57:43.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~4DU6YWZBNBZO.0 size=728615 2024-09-14T10:57:43.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.347+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=4DU6YWZBNBZO tag=88YHAXOQVCSG type=write size=1777191 2024-09-14T10:57:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.351+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=ZGNGFN8R04UH type=del 2024-09-14T10:57:43.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.355+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=9VXJ6PKRED70 type=del size=2249228 2024-09-14T10:57:43.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.363+0000 7fdf8f02c8c0 1 < suggested remove operation key=49O8DPTGA65S tag=N5C0OMEV4Z0O type=write 2024-09-14T10:57:43.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.371+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~MLAMFJ3SF4HZ.0 size=1048576 2024-09-14T10:57:43.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.371+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~MLAMFJ3SF4HZ.1 size=850803 2024-09-14T10:57:43.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.371+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=MLAMFJ3SF4HZ tag=DW2DQ3THC7QU type=write size=2947955 2024-09-14T10:57:43.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.375+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~E7CZQWAYFIW9.0 size=674154 2024-09-14T10:57:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.383+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=E7CZQWAYFIW9 tag=PGDUCAJO2D2S type=write size=1722730 2024-09-14T10:57:43.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.391+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~I1T40JV7RIMU.0 size=1048576 2024-09-14T10:57:43.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.395+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~I1T40JV7RIMU.1 size=1048576 2024-09-14T10:57:43.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.395+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~I1T40JV7RIMU.2 size=214340 2024-09-14T10:57:43.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.395+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=I1T40JV7RIMU tag=EK075U01N10U type=write size=3360068 2024-09-14T10:57:43.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.399+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=OCVECD2IC2MT type=del 2024-09-14T10:57:43.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~4WOL1AGZCZDX.0 size=1048576 2024-09-14T10:57:43.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~4WOL1AGZCZDX.1 size=1048576 2024-09-14T10:57:43.412 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.415+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~4WOL1AGZCZDX.2 size=821328 2024-09-14T10:57:43.412 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.415+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=4WOL1AGZCZDX tag=CJ3OM0NXEPWL type=write size=3967056 2024-09-14T10:57:43.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.419+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~078NKWAD5N9V.0 size=1048576 2024-09-14T10:57:43.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.423+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~078NKWAD5N9V.1 size=272657 2024-09-14T10:57:43.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.431+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=078NKWAD5N9V tag=E4UCDVRAYNVA type=write size=2369809 2024-09-14T10:57:43.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.439+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~T9LSN3DP0D97.0 size=1048576 2024-09-14T10:57:43.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.439+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~T9LSN3DP0D97.1 size=625752 2024-09-14T10:57:43.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.439+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=T9LSN3DP0D97 tag=EAGLGVCNUWMK type=write size=2722904 2024-09-14T10:57:43.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.443+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=LOB8TL9W623P type=del 2024-09-14T10:57:43.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.451+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~1VOFU9I3BM4E.0 size=591687 2024-09-14T10:57:43.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.451+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=1VOFU9I3BM4E tag=3QUT65UFU73F type=write size=1640263 2024-09-14T10:57:43.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~5LNRA8YJ28B5.0 size=1048576 2024-09-14T10:57:43.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.459+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~5LNRA8YJ28B5.1 size=296979 2024-09-14T10:57:43.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.471+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=5LNRA8YJ28B5 tag=6QS3MZGM5ZI5 type=write size=2394131 2024-09-14T10:57:43.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.475+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=M6YRJNHWHZSG type=del size=2292108 2024-09-14T10:57:43.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.479+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=FU92KMINTL8A type=del 2024-09-14T10:57:43.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.483+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=V8X2WA94LTVW type=write size=62316 2024-09-14T10:57:43.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.491+0000 7fdf8f02c8c0 1 < suggested remove operation key=HCGZ1MY5SKW9 tag=INT3RQOQBUMQ type=del 2024-09-14T10:57:43.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.495+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=MA09R6CO7ZOJ type=del size=2403586 2024-09-14T10:57:43.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~P2TJLMF1XNON.0 size=80046 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.503+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=P2TJLMF1XNON tag=S2IF1OV1W1Z3 type=write size=1128622 2024-09-14T10:57:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.511+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~UK5EZ5U9IB0G.0 size=1048576 2024-09-14T10:57:43.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~UK5EZ5U9IB0G.1 size=774610 2024-09-14T10:57:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.515+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=UK5EZ5U9IB0G tag=IGS1BT9HK1UW type=write size=2871762 2024-09-14T10:57:43.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.515+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=CPF4JLG54NDW type=del 2024-09-14T10:57:43.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~QQXIASP4O30K.0 size=1048576 2024-09-14T10:57:43.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.527+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~QQXIASP4O30K.1 size=1048576 2024-09-14T10:57:43.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.531+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~QQXIASP4O30K.2 size=248175 2024-09-14T10:57:43.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.531+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=QQXIASP4O30K tag=2G4MANPC7Y09 type=write size=3393903 2024-09-14T10:57:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.539+0000 7fdf8f02c8c0 1 < suggested update operation key=X1BN3054IKNS tag=OUH5LDX02SA6 type=write size=769453 2024-09-14T10:57:43.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.543+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=2TPOQMB46YT4 type=del size=2824821 2024-09-14T10:57:43.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~J0YXJXISAUVX.0 size=1048576 2024-09-14T10:57:43.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.547+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~J0YXJXISAUVX.1 size=1048576 2024-09-14T10:57:43.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.551+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~J0YXJXISAUVX.2 size=406677 2024-09-14T10:57:43.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.559+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=J0YXJXISAUVX tag=LD32GPVEROCJ type=write size=3552405 2024-09-14T10:57:43.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.563+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=6YR57P3CF1C1 type=del size=397194 2024-09-14T10:57:43.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.567+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~NE1MVMUY07HM.0 size=1048576 2024-09-14T10:57:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.567+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~NE1MVMUY07HM.1 size=335400 2024-09-14T10:57:43.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.575+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=NE1MVMUY07HM tag=2RWGWOUE9HDI type=write size=2432552 2024-09-14T10:57:43.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.579+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~HUZAQZR0SHWH.0 size=228574 2024-09-14T10:57:43.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.579+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=HUZAQZR0SHWH tag=8ROLU1QF9C5E type=write size=1277150 2024-09-14T10:57:43.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.583+0000 7fdf8f02c8c0 -1 < failed to complete operation key=49O8DPTGA65S tag=KIOTRFBV2AIV type=del size=3644330: (22) Invalid argument 2024-09-14T10:57:43.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.587+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=0019ZGB9H32S type=del size=3991436 2024-09-14T10:57:43.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.595+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~4DU6YWZBNBZO.0 size=728615 2024-09-14T10:57:43.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.599+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=4DU6YWZBNBZO tag=88YHAXOQVCSG type=write size=1777191 2024-09-14T10:57:43.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~NH19WEMUA2G1.0 size=1048576 2024-09-14T10:57:43.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~NH19WEMUA2G1.1 size=1048576 2024-09-14T10:57:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.611+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~NH19WEMUA2G1.2 size=31363 2024-09-14T10:57:43.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.611+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=NH19WEMUA2G1 tag=EZMKAGFS0ZPW type=write size=3177091 2024-09-14T10:57:43.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.615+0000 7fdf8f02c8c0 1 < canceled operation key=5VZCCFRUAQJ7 tag=9VXJ6PKRED70 type=del size=2249228 2024-09-14T10:57:43.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.619+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=LG88RA6XVFC9 type=del size=1437613 2024-09-14T10:57:43.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.623+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~MLAMFJ3SF4HZ.0 size=1048576 2024-09-14T10:57:43.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.627+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~MLAMFJ3SF4HZ.1 size=850803 2024-09-14T10:57:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.631+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=MLAMFJ3SF4HZ tag=DW2DQ3THC7QU type=write size=2947955 2024-09-14T10:57:43.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.639+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~GVZXHFXBV0H7.0 size=634004 2024-09-14T10:57:43.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.639+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=GVZXHFXBV0H7 tag=U94H1FVH0837 type=write size=1682580 2024-09-14T10:57:43.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.639+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_L1ERJ0JSRDMG.2~I1T40JV7RIMU.0 size=1048576 2024-09-14T10:57:43.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.643+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~I1T40JV7RIMU.1 size=1048576 2024-09-14T10:57:43.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.643+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~I1T40JV7RIMU.2 size=214340 2024-09-14T10:57:43.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.651+0000 7fdf8f02c8c0 1 < canceled multipart upload key=L1ERJ0JSRDMG upload=I1T40JV7RIMU tag=EK075U01N10U type=write size=3360068 2024-09-14T10:57:43.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~30FRGW7KRL0U.0 size=1048576 2024-09-14T10:57:43.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.659+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~30FRGW7KRL0U.1 size=3715 2024-09-14T10:57:43.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.659+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=30FRGW7KRL0U tag=3G0LPAP1VKCV type=write size=2100867 2024-09-14T10:57:43.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.663+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~4WOL1AGZCZDX.0 size=1048576 2024-09-14T10:57:43.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.667+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~4WOL1AGZCZDX.1 size=1048576 2024-09-14T10:57:43.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.671+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~4WOL1AGZCZDX.2 size=821328 2024-09-14T10:57:43.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.675+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=4WOL1AGZCZDX tag=CJ3OM0NXEPWL type=write size=3967056 2024-09-14T10:57:43.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.679+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=XENHC4ZTWECJ type=del size=478797 2024-09-14T10:57:43.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.683+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~T9LSN3DP0D97.0 size=1048576 2024-09-14T10:57:43.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.687+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~T9LSN3DP0D97.1 size=625752 2024-09-14T10:57:43.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.691+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=T9LSN3DP0D97 tag=EAGLGVCNUWMK type=write size=2722904 2024-09-14T10:57:43.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.695+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=P0BI8ZSKSXR9 type=del size=354715 2024-09-14T10:57:43.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.699+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~1VOFU9I3BM4E.0 size=591687 2024-09-14T10:57:43.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.707+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=1VOFU9I3BM4E tag=3QUT65UFU73F type=write size=1640263 2024-09-14T10:57:43.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.711+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~6K9MDWOEBUUM.0 size=1048576 2024-09-14T10:57:43.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.715+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~6K9MDWOEBUUM.1 size=365419 2024-09-14T10:57:43.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.715+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=6K9MDWOEBUUM tag=NV6VNYWZWFVL type=write size=2462571 2024-09-14T10:57:43.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.719+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=M6YRJNHWHZSG type=del 2024-09-14T10:57:43.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.723+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=LZGPJ94YQR24 type=del size=1177423 2024-09-14T10:57:43.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.727+0000 7fdf8f02c8c0 1 < completed write operation key=OFY1G5R28CK6 tag=V8X2WA94LTVW type=write size=62316 2024-09-14T10:57:43.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.727+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=BQWQHIHZBCWW type=del size=2713642 2024-09-14T10:57:43.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.731+0000 7fdf8f02c8c0 -1 < failed to complete operation key=X1BN3054IKNS tag=MA09R6CO7ZOJ type=del size=2403586: (22) Invalid argument 2024-09-14T10:57:43.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.735+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=FIRKH4W32T6E type=del size=3544642 2024-09-14T10:57:43.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.739+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~UK5EZ5U9IB0G.0 size=1048576 2024-09-14T10:57:43.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.743+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~UK5EZ5U9IB0G.1 size=774610 2024-09-14T10:57:43.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.747+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=UK5EZ5U9IB0G tag=IGS1BT9HK1UW type=write size=2871762 2024-09-14T10:57:43.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.751+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=D67V6YB0U48U type=del size=1724422 2024-09-14T10:57:43.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.755+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~QQXIASP4O30K.0 size=1048576 2024-09-14T10:57:43.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.759+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~QQXIASP4O30K.1 size=1048576 2024-09-14T10:57:43.759 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.763+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~QQXIASP4O30K.2 size=248175 2024-09-14T10:57:43.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.767+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=QQXIASP4O30K tag=2G4MANPC7Y09 type=write size=3393903 2024-09-14T10:57:43.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.771+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=2BVVRL02HGQQ type=del size=1774631 2024-09-14T10:57:43.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.779+0000 7fdf8f02c8c0 1 < suggested remove operation key=LMNGCUFR187I tag=2TPOQMB46YT4 type=del 2024-09-14T10:57:43.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.783+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=60VMDN7XY9ML type=del size=1496636 2024-09-14T10:57:43.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.787+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=6YR57P3CF1C1 type=del 2024-09-14T10:57:43.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~WZAFM99UH9K4.0 size=1048576 2024-09-14T10:57:43.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.799+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~WZAFM99UH9K4.1 size=686290 2024-09-14T10:57:43.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.799+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=WZAFM99UH9K4 tag=8LI6HGKGU7LM type=write size=2783442 2024-09-14T10:57:43.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.799+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~HUZAQZR0SHWH.0 size=228574 2024-09-14T10:57:43.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.811+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=HUZAQZR0SHWH tag=8ROLU1QF9C5E type=write size=1277150 2024-09-14T10:57:43.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.815+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=K3GV4L3EVMLJ type=del size=2350431 2024-09-14T10:57:43.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.819+0000 7fdf8f02c8c0 1 < canceled operation key=LFLY0V3FRRW5 tag=0019ZGB9H32S type=del size=3991436 2024-09-14T10:57:43.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.823+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=4HN53QRZULW3 type=del size=2407533 2024-09-14T10:57:43.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.827+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~NH19WEMUA2G1.0 size=1048576 2024-09-14T10:57:43.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.831+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~NH19WEMUA2G1.1 size=1048576 2024-09-14T10:57:43.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.835+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~NH19WEMUA2G1.2 size=31363 2024-09-14T10:57:43.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.839+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=NH19WEMUA2G1 tag=EZMKAGFS0ZPW type=write size=3177091 2024-09-14T10:57:43.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.843+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=1CVIVCG1824M type=del size=1720576 2024-09-14T10:57:43.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.847+0000 7fdf8f02c8c0 1 < canceled operation key=Y32RWGISRBMT tag=LG88RA6XVFC9 type=del size=1437613 2024-09-14T10:57:43.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.851+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=X87CMY53IZBY type=write size=375752 2024-09-14T10:57:43.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.855+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~GVZXHFXBV0H7.0 size=634004 2024-09-14T10:57:43.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.859+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=GVZXHFXBV0H7 tag=U94H1FVH0837 type=write size=1682580 2024-09-14T10:57:43.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~36D4SKNWZLFO.0 size=908406 2024-09-14T10:57:43.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.863+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=36D4SKNWZLFO tag=QN6SKLC4RU4R type=write size=1956982 2024-09-14T10:57:43.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.867+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~30FRGW7KRL0U.0 size=1048576 2024-09-14T10:57:43.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~30FRGW7KRL0U.1 size=3715 2024-09-14T10:57:43.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.875+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=30FRGW7KRL0U tag=3G0LPAP1VKCV type=write size=2100867 2024-09-14T10:57:43.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.883+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~4I2ZAE461B0K.0 size=360226 2024-09-14T10:57:43.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.883+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=4I2ZAE461B0K tag=7J26ZRLKSWNJ type=write size=1408802 2024-09-14T10:57:43.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.891+0000 7fdf8f02c8c0 1 < suggested update operation key=LFLY0V3FRRW5 tag=XENHC4ZTWECJ type=del size=478797 2024-09-14T10:57:43.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.899+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~RYXR7RUSJ77W.0 size=1048576 2024-09-14T10:57:43.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.899+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~RYXR7RUSJ77W.1 size=1048576 2024-09-14T10:57:43.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.903+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~RYXR7RUSJ77W.2 size=363188 2024-09-14T10:57:43.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.903+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=RYXR7RUSJ77W tag=1Z81WP65PVUX type=write size=3508916 2024-09-14T10:57:43.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.911+0000 7fdf8f02c8c0 1 < suggested update operation key=XUT55FR490EO tag=P0BI8ZSKSXR9 type=del size=354715 2024-09-14T10:57:43.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.915+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=ZHNOPAJNTZRL type=del size=305022 2024-09-14T10:57:43.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.919+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~6K9MDWOEBUUM.0 size=1048576 2024-09-14T10:57:43.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.919+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~6K9MDWOEBUUM.1 size=365419 2024-09-14T10:57:43.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.927+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=6K9MDWOEBUUM tag=NV6VNYWZWFVL type=write size=2462571 2024-09-14T10:57:43.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.931+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~KTCAD4SHB7IF.0 size=372606 2024-09-14T10:57:43.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.931+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=KTCAD4SHB7IF tag=5VR0K1ZSH2AF type=write size=1421182 2024-09-14T10:57:43.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.935+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=LZGPJ94YQR24 type=del 2024-09-14T10:57:43.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.939+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=XT2WBOU5AN0Y type=del size=2363362 2024-09-14T10:57:43.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.943+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=BQWQHIHZBCWW type=del 2024-09-14T10:57:43.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~O2JBWS171XH8.0 size=76622 2024-09-14T10:57:43.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.951+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=O2JBWS171XH8 tag=BBEYWFRO2TVX type=write size=1125198 2024-09-14T10:57:43.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.955+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=FIRKH4W32T6E type=del 2024-09-14T10:57:43.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.959+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=R0ZKV48YX4TB type=del size=2512629 2024-09-14T10:57:43.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.959+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=D67V6YB0U48U type=del 2024-09-14T10:57:43.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.963+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=DEDXDDS52IDL type=del size=95198 2024-09-14T10:57:43.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.967+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=2BVVRL02HGQQ type=del 2024-09-14T10:57:43.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.971+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=IBUH3WPHRUHM type=del size=2345188 2024-09-14T10:57:43.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.975+0000 7fdf8f02c8c0 1 < canceled operation key=YU9DAJA242Q7 tag=60VMDN7XY9ML type=del size=1496636 2024-09-14T10:57:43.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.979+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=7S896WKIA9T9 type=del size=2735141 2024-09-14T10:57:43.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~WZAFM99UH9K4.0 size=1048576 2024-09-14T10:57:43.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~WZAFM99UH9K4.1 size=686290 2024-09-14T10:57:43.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:43.995+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=WZAFM99UH9K4 tag=8LI6HGKGU7LM type=write size=2783442 2024-09-14T10:57:43.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.003+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MU41FXRJ3XHS.0 size=203864 2024-09-14T10:57:43.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.003+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=MU41FXRJ3XHS tag=U23CYPTN8BL6 type=write size=1252440 2024-09-14T10:57:44.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.007+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=K3GV4L3EVMLJ type=del 2024-09-14T10:57:44.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.011+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=AE1G0CSZGFCB type=del size=3376047 2024-09-14T10:57:44.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.015+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=4HN53QRZULW3 type=del 2024-09-14T10:57:44.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.019+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=E3ZBWLHS5Z0M type=write size=793835 2024-09-14T10:57:44.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.027+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=1CVIVCG1824M type=del 2024-09-14T10:57:44.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.031+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=J9V5U1IT480I type=del size=717257 2024-09-14T10:57:44.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.031+0000 7fdf8f02c8c0 -1 < failed to complete operation key=LFLY0V3FRRW5 tag=X87CMY53IZBY type=write size=375752: (22) Invalid argument 2024-09-14T10:57:44.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.035+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=K9ZMJ7JTB68G type=write size=980834 2024-09-14T10:57:44.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.039+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~36D4SKNWZLFO.0 size=908406 2024-09-14T10:57:44.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.047+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=36D4SKNWZLFO tag=QN6SKLC4RU4R type=write size=1956982 2024-09-14T10:57:44.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.051+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=81JEX17HA78H type=del size=1917176 2024-09-14T10:57:44.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.055+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~4I2ZAE461B0K.0 size=360226 2024-09-14T10:57:44.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.059+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=4I2ZAE461B0K tag=7J26ZRLKSWNJ type=write size=1408802 2024-09-14T10:57:44.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.067+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~CSHM2X9FG9DG.0 size=1048576 2024-09-14T10:57:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.071+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~CSHM2X9FG9DG.1 size=1048576 2024-09-14T10:57:44.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~CSHM2X9FG9DG.2 size=192330 2024-09-14T10:57:44.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.075+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=CSHM2X9FG9DG tag=HZPK927F4IBE type=write size=3338058 2024-09-14T10:57:44.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.075+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~RYXR7RUSJ77W.0 size=1048576 2024-09-14T10:57:44.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.079+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~RYXR7RUSJ77W.1 size=1048576 2024-09-14T10:57:44.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.079+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_ZSBCGOXXJ0D5.2~RYXR7RUSJ77W.2 size=363188 2024-09-14T10:57:44.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.087+0000 7fdf8f02c8c0 1 < canceled multipart upload key=ZSBCGOXXJ0D5 upload=RYXR7RUSJ77W tag=1Z81WP65PVUX type=write size=3508916 2024-09-14T10:57:44.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.091+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=1LQFP3OOS37H type=del size=740972 2024-09-14T10:57:44.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.095+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=ZHNOPAJNTZRL type=del 2024-09-14T10:57:44.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.099+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~IFH2C64PA677.0 size=1048576 2024-09-14T10:57:44.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.103+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~IFH2C64PA677.1 size=204625 2024-09-14T10:57:44.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.103+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=IFH2C64PA677 tag=129GGO9ZM9O2 type=write size=2301777 2024-09-14T10:57:44.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.107+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~KTCAD4SHB7IF.0 size=372606 2024-09-14T10:57:44.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.115+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=KTCAD4SHB7IF tag=5VR0K1ZSH2AF type=write size=1421182 2024-09-14T10:57:44.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.119+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~S64ICMAASITV.0 size=1048576 2024-09-14T10:57:44.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~S64ICMAASITV.1 size=1048576 2024-09-14T10:57:44.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.127+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~S64ICMAASITV.2 size=929539 2024-09-14T10:57:44.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.127+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=S64ICMAASITV tag=JA6T650PDEV2 type=write size=4075267 2024-09-14T10:57:44.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.135+0000 7fdf8f02c8c0 1 < suggested update operation key=3T0H42SC1ETB tag=XT2WBOU5AN0Y type=del size=2363362 2024-09-14T10:57:44.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.139+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=DO2YV72S7BON type=del size=1703628 2024-09-14T10:57:44.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.143+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~O2JBWS171XH8.0 size=76622 2024-09-14T10:57:44.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.147+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=O2JBWS171XH8 tag=BBEYWFRO2TVX type=write size=1125198 2024-09-14T10:57:44.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.151+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=6XHVX16D893X type=del size=152643 2024-09-14T10:57:44.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.163+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=R0ZKV48YX4TB type=del 2024-09-14T10:57:44.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.167+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=J4FGRIOPC0SO type=del size=1574257 2024-09-14T10:57:44.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.171+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=DEDXDDS52IDL type=del 2024-09-14T10:57:44.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.175+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=BUBOQYYH8V4A type=del size=3000715 2024-09-14T10:57:44.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.179+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=IBUH3WPHRUHM type=del 2024-09-14T10:57:44.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.187+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~QZ0IRCZJLB6G.0 size=262514 2024-09-14T10:57:44.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.187+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=QZ0IRCZJLB6G tag=ZUI94GYNUU64 type=write size=1311090 2024-09-14T10:57:44.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.191+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=7S896WKIA9T9 type=del 2024-09-14T10:57:44.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.195+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=7UDYQHUX1AVH type=del size=3451293 2024-09-14T10:57:44.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.199+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MU41FXRJ3XHS.0 size=203864 2024-09-14T10:57:44.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.203+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=MU41FXRJ3XHS tag=U23CYPTN8BL6 type=write size=1252440 2024-09-14T10:57:44.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.207+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=ODK93DQMTHEX type=del size=4004295 2024-09-14T10:57:44.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.215+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZSBCGOXXJ0D5 tag=AE1G0CSZGFCB type=del 2024-09-14T10:57:44.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~9XO7H2JXF6TY.0 size=1048576 2024-09-14T10:57:44.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.223+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~9XO7H2JXF6TY.1 size=929129 2024-09-14T10:57:44.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.223+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=9XO7H2JXF6TY tag=00KVUCAX0E61 type=write size=3026281 2024-09-14T10:57:44.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.227+0000 7fdf8f02c8c0 1 < completed write operation key=5VZCCFRUAQJ7 tag=E3ZBWLHS5Z0M type=write size=793835 2024-09-14T10:57:44.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.235+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~K6O5TVRY6UMS.0 size=1048576 2024-09-14T10:57:44.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.235+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~K6O5TVRY6UMS.1 size=577162 2024-09-14T10:57:44.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.235+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=K6O5TVRY6UMS tag=HYKCK490RQ1G type=write size=2674314 2024-09-14T10:57:44.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.239+0000 7fdf8f02c8c0 -1 < failed to complete operation key=ZSBCGOXXJ0D5 tag=J9V5U1IT480I type=del size=717257: (22) Invalid argument 2024-09-14T10:57:44.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.243+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=HO41H7RBGUIA type=write size=253948 2024-09-14T10:57:44.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.247+0000 7fdf8f02c8c0 1 < completed write operation key=STB3W5URFJEZ tag=K9ZMJ7JTB68G type=write size=980834 2024-09-14T10:57:44.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.255+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~5M4CBFGGFV8E.0 size=1048576 2024-09-14T10:57:44.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~5M4CBFGGFV8E.1 size=433956 2024-09-14T10:57:44.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.259+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=5M4CBFGGFV8E tag=RVWZEDY6EKRA type=write size=2531108 2024-09-14T10:57:44.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.263+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=81JEX17HA78H type=del 2024-09-14T10:57:44.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.267+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~PIX3N4XY21U9.0 size=1048576 2024-09-14T10:57:44.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.271+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~PIX3N4XY21U9.1 size=1048576 2024-09-14T10:57:44.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.275+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~PIX3N4XY21U9.2 size=830245 2024-09-14T10:57:44.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.275+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=PIX3N4XY21U9 tag=X2WIF31TV8LT type=write size=3975973 2024-09-14T10:57:44.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.275+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_TZZ05IIMZJ4J.2~CSHM2X9FG9DG.0 size=1048576 2024-09-14T10:57:44.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.275+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_TZZ05IIMZJ4J.2~CSHM2X9FG9DG.1 size=1048576 2024-09-14T10:57:44.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~CSHM2X9FG9DG.2 size=192330 2024-09-14T10:57:44.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.283+0000 7fdf8f02c8c0 1 < canceled multipart upload key=TZZ05IIMZJ4J upload=CSHM2X9FG9DG tag=HZPK927F4IBE type=write size=3338058 2024-09-14T10:57:44.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.291+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~BQU7FWW34WTH.0 size=605169 2024-09-14T10:57:44.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.291+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=BQU7FWW34WTH tag=05MGXZ71KYCV type=write size=1653745 2024-09-14T10:57:44.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.295+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=1LQFP3OOS37H type=del 2024-09-14T10:57:44.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.299+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=6QLILBPARFRG type=del size=3945445 2024-09-14T10:57:44.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.303+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~IFH2C64PA677.0 size=1048576 2024-09-14T10:57:44.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.303+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~IFH2C64PA677.1 size=204625 2024-09-14T10:57:44.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.311+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=IFH2C64PA677 tag=129GGO9ZM9O2 type=write size=2301777 2024-09-14T10:57:44.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.315+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~LC6ZVVAB5BQ8.0 size=1048576 2024-09-14T10:57:44.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.319+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~LC6ZVVAB5BQ8.1 size=1048576 2024-09-14T10:57:44.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.323+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~LC6ZVVAB5BQ8.2 size=200850 2024-09-14T10:57:44.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.323+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=LC6ZVVAB5BQ8 tag=EVMOAKWDW3MA type=write size=3346578 2024-09-14T10:57:44.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.327+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~S64ICMAASITV.0 size=1048576 2024-09-14T10:57:44.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.331+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~S64ICMAASITV.1 size=1048576 2024-09-14T10:57:44.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.331+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~S64ICMAASITV.2 size=929539 2024-09-14T10:57:44.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.339+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=S64ICMAASITV tag=JA6T650PDEV2 type=write size=4075267 2024-09-14T10:57:44.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.343+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=49K70C6OYCP3 type=del size=2808807 2024-09-14T10:57:44.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.351+0000 7fdf8f02c8c0 1 < suggested update operation key=L1ERJ0JSRDMG tag=DO2YV72S7BON type=del size=1703628 2024-09-14T10:57:44.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.359+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~IJCDGD0932HA.0 size=1048576 2024-09-14T10:57:44.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.359+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~IJCDGD0932HA.1 size=666909 2024-09-14T10:57:44.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.359+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=IJCDGD0932HA tag=K6FU0CWSDQ9E type=write size=2764061 2024-09-14T10:57:44.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.367+0000 7fdf8f02c8c0 1 < suggested remove operation key=KVZEUYUSV5JI tag=6XHVX16D893X type=del 2024-09-14T10:57:44.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.371+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=A4VMHHRINOY3 type=del size=3412108 2024-09-14T10:57:44.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.375+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=J4FGRIOPC0SO type=del 2024-09-14T10:57:44.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.383+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~HQLU1RLXK2D8.0 size=110584 2024-09-14T10:57:44.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.383+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=HQLU1RLXK2D8 tag=7G3VSOGTUUVN type=write size=1159160 2024-09-14T10:57:44.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.387+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=BUBOQYYH8V4A type=del 2024-09-14T10:57:44.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.391+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=SK13R785DS4O type=del size=495659 2024-09-14T10:57:44.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.391+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~QZ0IRCZJLB6G.0 size=262514 2024-09-14T10:57:44.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.399+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=QZ0IRCZJLB6G tag=ZUI94GYNUU64 type=write size=1311090 2024-09-14T10:57:44.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.403+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=CDB5PPU5RMSL type=del size=685060 2024-09-14T10:57:44.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.407+0000 7fdf8f02c8c0 -1 < failed to complete operation key=L1ERJ0JSRDMG tag=7UDYQHUX1AVH type=del size=3451293: (22) Invalid argument 2024-09-14T10:57:44.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~B6C9LIGN9Q2Y.0 size=833829 2024-09-14T10:57:44.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.411+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=B6C9LIGN9Q2Y tag=UFAPR7Z228Z9 type=write size=1882405 2024-09-14T10:57:44.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.419+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZF6IDD8B3CFO tag=ODK93DQMTHEX type=del 2024-09-14T10:57:44.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.427+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~FFN3UEXQP506.0 size=103035 2024-09-14T10:57:44.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.427+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=FFN3UEXQP506 tag=EJS6OZXYNM3G type=write size=1151611 2024-09-14T10:57:44.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.431+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~9XO7H2JXF6TY.0 size=1048576 2024-09-14T10:57:44.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.435+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~9XO7H2JXF6TY.1 size=929129 2024-09-14T10:57:44.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.439+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=9XO7H2JXF6TY tag=00KVUCAX0E61 type=write size=3026281 2024-09-14T10:57:44.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.447+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~29C93HM000JV.0 size=1048576 2024-09-14T10:57:44.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.451+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~29C93HM000JV.1 size=1048576 2024-09-14T10:57:44.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.451+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~29C93HM000JV.2 size=258072 2024-09-14T10:57:44.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.451+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=29C93HM000JV tag=AF7P9SS3UF1E type=write size=3403800 2024-09-14T10:57:44.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~K6O5TVRY6UMS.0 size=1048576 2024-09-14T10:57:44.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.455+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_APDKRWHOUH9T.2~K6O5TVRY6UMS.1 size=577162 2024-09-14T10:57:44.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.463+0000 7fdf8f02c8c0 1 < canceled multipart upload key=APDKRWHOUH9T upload=K6O5TVRY6UMS tag=HYKCK490RQ1G type=write size=2674314 2024-09-14T10:57:44.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.467+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=D5VL9B52ONUL type=del size=4090036 2024-09-14T10:57:44.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.475+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=HO41H7RBGUIA type=write size=253948 2024-09-14T10:57:44.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.479+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=RKKSQBB2L8EQ type=del size=836757 2024-09-14T10:57:44.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.483+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~5M4CBFGGFV8E.0 size=1048576 2024-09-14T10:57:44.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.483+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~5M4CBFGGFV8E.1 size=433956 2024-09-14T10:57:44.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.491+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=5M4CBFGGFV8E tag=RVWZEDY6EKRA type=write size=2531108 2024-09-14T10:57:44.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.495+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=FM4EHMT82ZNP type=del size=1512992 2024-09-14T10:57:44.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.503+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~PIX3N4XY21U9.0 size=1048576 2024-09-14T10:57:44.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.503+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~PIX3N4XY21U9.1 size=1048576 2024-09-14T10:57:44.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.511+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~PIX3N4XY21U9.2 size=830245 2024-09-14T10:57:44.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.515+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=PIX3N4XY21U9 tag=X2WIF31TV8LT type=write size=3975973 2024-09-14T10:57:44.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~U9178RS1AOGR.0 size=1048576 2024-09-14T10:57:44.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~U9178RS1AOGR.1 size=581058 2024-09-14T10:57:44.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.523+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=U9178RS1AOGR tag=QCUWX539FFJU type=write size=2678210 2024-09-14T10:57:44.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.527+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~BQU7FWW34WTH.0 size=605169 2024-09-14T10:57:44.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.535+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=BQU7FWW34WTH tag=05MGXZ71KYCV type=write size=1653745 2024-09-14T10:57:44.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.543+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~B4DU9HT191B2.0 size=1048576 2024-09-14T10:57:44.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.543+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~B4DU9HT191B2.1 size=1048576 2024-09-14T10:57:44.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.547+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~B4DU9HT191B2.2 size=704040 2024-09-14T10:57:44.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.547+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=B4DU9HT191B2 tag=54YZ4P7FTTE7 type=write size=3849768 2024-09-14T10:57:44.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.555+0000 7fdf8f02c8c0 1 < suggested remove operation key=APDKRWHOUH9T tag=6QLILBPARFRG type=del 2024-09-14T10:57:44.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.559+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=VFJSY0RYWP3M type=write size=243411 2024-09-14T10:57:44.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.563+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~LC6ZVVAB5BQ8.0 size=1048576 2024-09-14T10:57:44.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.567+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~LC6ZVVAB5BQ8.1 size=1048576 2024-09-14T10:57:44.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.567+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~LC6ZVVAB5BQ8.2 size=200850 2024-09-14T10:57:44.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.575+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=LC6ZVVAB5BQ8 tag=EVMOAKWDW3MA type=write size=3346578 2024-09-14T10:57:44.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.583+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~NEAXRBDV9QRZ.0 size=1048576 2024-09-14T10:57:44.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.587+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~NEAXRBDV9QRZ.1 size=1048576 2024-09-14T10:57:44.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.587+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~NEAXRBDV9QRZ.2 size=743418 2024-09-14T10:57:44.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.587+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=NEAXRBDV9QRZ tag=13ER1STPF2XJ type=write size=3889146 2024-09-14T10:57:44.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.591+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=49K70C6OYCP3 type=del 2024-09-14T10:57:44.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.595+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=GEAENFH7WPZK type=del size=405905 2024-09-14T10:57:44.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.603+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~IJCDGD0932HA.0 size=1048576 2024-09-14T10:57:44.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.603+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~IJCDGD0932HA.1 size=666909 2024-09-14T10:57:44.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.611+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=IJCDGD0932HA tag=K6FU0CWSDQ9E type=write size=2764061 2024-09-14T10:57:44.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.615+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=UI3UQUP7FX2V type=del size=1667165 2024-09-14T10:57:44.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.619+0000 7fdf8f02c8c0 -1 < failed to complete operation key=ZF6IDD8B3CFO tag=A4VMHHRINOY3 type=del size=3412108: (22) Invalid argument 2024-09-14T10:57:44.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.623+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=J0DC1Y2U7DFR type=del size=1429467 2024-09-14T10:57:44.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.627+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~HQLU1RLXK2D8.0 size=110584 2024-09-14T10:57:44.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.635+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=HQLU1RLXK2D8 tag=7G3VSOGTUUVN type=write size=1159160 2024-09-14T10:57:44.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.639+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~3URHY2IK8V7C.0 size=1048576 2024-09-14T10:57:44.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.643+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~3URHY2IK8V7C.1 size=946588 2024-09-14T10:57:44.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.643+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=3URHY2IK8V7C tag=AUCTLHWCNC72 type=write size=3043740 2024-09-14T10:57:44.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.647+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=SK13R785DS4O type=del 2024-09-14T10:57:44.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~33EW48CU2PTP.0 size=364871 2024-09-14T10:57:44.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.655+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=33EW48CU2PTP tag=W5W80IA33SG6 type=write size=1413447 2024-09-14T10:57:44.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.659+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=CDB5PPU5RMSL type=del 2024-09-14T10:57:44.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~1UKE4P6MTZ1I.0 size=1048576 2024-09-14T10:57:44.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~1UKE4P6MTZ1I.1 size=709463 2024-09-14T10:57:44.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.667+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=1UKE4P6MTZ1I tag=KRI9N83W5K27 type=write size=2806615 2024-09-14T10:57:44.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.671+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~B6C9LIGN9Q2Y.0 size=833829 2024-09-14T10:57:44.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.679+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=B6C9LIGN9Q2Y tag=UFAPR7Z228Z9 type=write size=1882405 2024-09-14T10:57:44.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.683+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=6GFMW2DZ29UQ type=del size=2300919 2024-09-14T10:57:44.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.683+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STB3W5URFJEZ.2~FFN3UEXQP506.0 size=103035 2024-09-14T10:57:44.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.691+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STB3W5URFJEZ upload=FFN3UEXQP506 tag=EJS6OZXYNM3G type=write size=1151611 2024-09-14T10:57:44.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.699+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~3GKJ2BN1UFK5.0 size=1048576 2024-09-14T10:57:44.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.703+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~3GKJ2BN1UFK5.1 size=20019 2024-09-14T10:57:44.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.703+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=3GKJ2BN1UFK5 tag=RY0U88KQDGFA type=write size=2117171 2024-09-14T10:57:44.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.707+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~29C93HM000JV.0 size=1048576 2024-09-14T10:57:44.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.707+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~29C93HM000JV.1 size=1048576 2024-09-14T10:57:44.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.711+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~29C93HM000JV.2 size=258072 2024-09-14T10:57:44.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.719+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=29C93HM000JV tag=AF7P9SS3UF1E type=write size=3403800 2024-09-14T10:57:44.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.723+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=54N9JGLP2FLC type=del size=1097143 2024-09-14T10:57:44.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.727+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=D5VL9B52ONUL type=del 2024-09-14T10:57:44.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.731+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~NBQSZVJ5DBGA.0 size=1048576 2024-09-14T10:57:44.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.735+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~NBQSZVJ5DBGA.1 size=1048576 2024-09-14T10:57:44.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.739+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~NBQSZVJ5DBGA.2 size=991108 2024-09-14T10:57:44.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.739+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=NBQSZVJ5DBGA tag=A531EI0CO0KE type=write size=4136836 2024-09-14T10:57:44.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.743+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=RKKSQBB2L8EQ type=del 2024-09-14T10:57:44.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.747+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~4TYBIOH8N1HP.0 size=1048576 2024-09-14T10:57:44.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.751+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~4TYBIOH8N1HP.1 size=1026634 2024-09-14T10:57:44.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.751+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=4TYBIOH8N1HP tag=HVWC564RM417 type=write size=3123786 2024-09-14T10:57:44.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.755+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=FM4EHMT82ZNP type=del 2024-09-14T10:57:44.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.759+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=BS4AHSH93Y0G type=write size=984047 2024-09-14T10:57:44.759 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.763+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~U9178RS1AOGR.0 size=1048576 2024-09-14T10:57:44.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.767+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~U9178RS1AOGR.1 size=581058 2024-09-14T10:57:44.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.771+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=U9178RS1AOGR tag=QCUWX539FFJU type=write size=2678210 2024-09-14T10:57:44.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.775+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=ON9CO8GYK4YV type=del size=49677 2024-09-14T10:57:44.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.779+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~B4DU9HT191B2.0 size=1048576 2024-09-14T10:57:44.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.779+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_82N2FPU7LKTG.2~B4DU9HT191B2.1 size=1048576 2024-09-14T10:57:44.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.783+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~B4DU9HT191B2.2 size=704040 2024-09-14T10:57:44.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.787+0000 7fdf8f02c8c0 1 < canceled multipart upload key=82N2FPU7LKTG upload=B4DU9HT191B2 tag=54YZ4P7FTTE7 type=write size=3849768 2024-09-14T10:57:44.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.791+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=SLLETSGWPASV type=del size=1922948 2024-09-14T10:57:44.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.795+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=VFJSY0RYWP3M type=write size=243411 2024-09-14T10:57:44.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.799+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=SN35QFE9X1FX type=del size=4100770 2024-09-14T10:57:44.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.803+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~NEAXRBDV9QRZ.0 size=1048576 2024-09-14T10:57:44.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.807+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~NEAXRBDV9QRZ.1 size=1048576 2024-09-14T10:57:44.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~NEAXRBDV9QRZ.2 size=743418 2024-09-14T10:57:44.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.819+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=NEAXRBDV9QRZ tag=13ER1STPF2XJ type=write size=3889146 2024-09-14T10:57:44.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.823+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=E82UBIRN5FFA type=del size=1111548 2024-09-14T10:57:44.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.827+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=GEAENFH7WPZK type=del 2024-09-14T10:57:44.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.835+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~HJH8K1XVHNG9.0 size=3942 2024-09-14T10:57:44.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.835+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=HJH8K1XVHNG9 tag=LP2Q7W4JO36Q type=write size=1052518 2024-09-14T10:57:44.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.839+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=UI3UQUP7FX2V type=del 2024-09-14T10:57:44.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.843+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=LWBPISZ2VFIA type=del size=2562767 2024-09-14T10:57:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.851+0000 7fdf8f02c8c0 1 < suggested remove operation key=WA7HE8ZJ1W1M tag=J0DC1Y2U7DFR type=del 2024-09-14T10:57:44.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.855+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=UKVIK87QKBL0 type=del size=2770165 2024-09-14T10:57:44.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.859+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~3URHY2IK8V7C.0 size=1048576 2024-09-14T10:57:44.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.867+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~3URHY2IK8V7C.1 size=946588 2024-09-14T10:57:44.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.875+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=3URHY2IK8V7C tag=AUCTLHWCNC72 type=write size=3043740 2024-09-14T10:57:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.883+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~SED9XY1FWH7E.0 size=1048576 2024-09-14T10:57:44.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.887+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~SED9XY1FWH7E.1 size=1048576 2024-09-14T10:57:44.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.887+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~SED9XY1FWH7E.2 size=577062 2024-09-14T10:57:44.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.887+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=SED9XY1FWH7E tag=3I16VOEBUKBO type=write size=3722790 2024-09-14T10:57:44.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.895+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~33EW48CU2PTP.0 size=364871 2024-09-14T10:57:44.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.899+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=33EW48CU2PTP tag=W5W80IA33SG6 type=write size=1413447 2024-09-14T10:57:44.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.903+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=IFREG71DM81N type=del size=3114031 2024-09-14T10:57:44.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.907+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~1UKE4P6MTZ1I.0 size=1048576 2024-09-14T10:57:44.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.911+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~1UKE4P6MTZ1I.1 size=709463 2024-09-14T10:57:44.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.915+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=1UKE4P6MTZ1I tag=KRI9N83W5K27 type=write size=2806615 2024-09-14T10:57:44.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~MVOY743GZ749.0 size=1048576 2024-09-14T10:57:44.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~MVOY743GZ749.1 size=292271 2024-09-14T10:57:44.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.923+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=MVOY743GZ749 tag=NRZ17WIPJXTA type=write size=2389423 2024-09-14T10:57:44.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.927+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=6GFMW2DZ29UQ type=del 2024-09-14T10:57:44.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.935+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~UIZDMFIRWJTW.0 size=1048576 2024-09-14T10:57:44.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.939+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~UIZDMFIRWJTW.1 size=716885 2024-09-14T10:57:44.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.939+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=UIZDMFIRWJTW tag=MYMAEE19MV9A type=write size=2814037 2024-09-14T10:57:44.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.943+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~3GKJ2BN1UFK5.0 size=1048576 2024-09-14T10:57:44.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.947+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~3GKJ2BN1UFK5.1 size=20019 2024-09-14T10:57:44.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.951+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=3GKJ2BN1UFK5 tag=RY0U88KQDGFA type=write size=2117171 2024-09-14T10:57:44.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.955+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=DGAXN1IKLJO2 type=del size=3018882 2024-09-14T10:57:44.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.959+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=54N9JGLP2FLC type=del 2024-09-14T10:57:44.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.963+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=SSH0Y5TC6F63 type=del size=2206766 2024-09-14T10:57:44.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.967+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~NBQSZVJ5DBGA.0 size=1048576 2024-09-14T10:57:44.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.971+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~NBQSZVJ5DBGA.1 size=1048576 2024-09-14T10:57:44.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.971+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~NBQSZVJ5DBGA.2 size=991108 2024-09-14T10:57:44.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.979+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=NBQSZVJ5DBGA tag=A531EI0CO0KE type=write size=4136836 2024-09-14T10:57:44.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.983+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=76XCU0SHAKPE type=write size=986875 2024-09-14T10:57:44.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~4TYBIOH8N1HP.0 size=1048576 2024-09-14T10:57:44.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~4TYBIOH8N1HP.1 size=1026634 2024-09-14T10:57:44.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.995+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=4TYBIOH8N1HP tag=HVWC564RM417 type=write size=3123786 2024-09-14T10:57:44.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:44.999+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=50ZRD07IV1LJ type=write size=774798 2024-09-14T10:57:44.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.003+0000 7fdf8f02c8c0 1 < completed write operation key=3T0H42SC1ETB tag=BS4AHSH93Y0G type=write size=984047 2024-09-14T10:57:45.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~PID6FT7IEPDY.0 size=1048576 2024-09-14T10:57:45.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~PID6FT7IEPDY.1 size=889150 2024-09-14T10:57:45.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.011+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=PID6FT7IEPDY tag=PRUEHGGWGSA0 type=write size=2986302 2024-09-14T10:57:45.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.015+0000 7fdf8f02c8c0 1 < canceled operation key=APDKRWHOUH9T tag=ON9CO8GYK4YV type=del size=49677 2024-09-14T10:57:45.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.019+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=5TH0PHXYCKDR type=del size=1827942 2024-09-14T10:57:45.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.023+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=SLLETSGWPASV type=del 2024-09-14T10:57:45.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.031+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~BMWL12YEO8OW.0 size=922725 2024-09-14T10:57:45.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.031+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=BMWL12YEO8OW tag=DDI0SXC002OZ type=write size=1971301 2024-09-14T10:57:45.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.035+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=SN35QFE9X1FX type=del 2024-09-14T10:57:45.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.039+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~69ROUPATMLEX.0 size=1048576 2024-09-14T10:57:45.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.043+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~69ROUPATMLEX.1 size=1048576 2024-09-14T10:57:45.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.047+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~69ROUPATMLEX.2 size=645256 2024-09-14T10:57:45.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.047+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=69ROUPATMLEX tag=H64DOG5YRD5R type=write size=3790984 2024-09-14T10:57:45.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.051+0000 7fdf8f02c8c0 1 < suggested update operation key=L1ERJ0JSRDMG tag=E82UBIRN5FFA type=del size=1111548 2024-09-14T10:57:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.059+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~HTR51B694KJM.0 size=1048576 2024-09-14T10:57:45.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~HTR51B694KJM.1 size=566524 2024-09-14T10:57:45.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.063+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=HTR51B694KJM tag=DPK3I5CR5BOL type=write size=2663676 2024-09-14T10:57:45.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.063+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~HJH8K1XVHNG9.0 size=3942 2024-09-14T10:57:45.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.071+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=HJH8K1XVHNG9 tag=LP2Q7W4JO36Q type=write size=1052518 2024-09-14T10:57:45.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~3EPZSMN08X0T.0 size=1048576 2024-09-14T10:57:45.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.079+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~3EPZSMN08X0T.1 size=259084 2024-09-14T10:57:45.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.079+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=3EPZSMN08X0T tag=WA5QSD1GNJ20 type=write size=2356236 2024-09-14T10:57:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.087+0000 7fdf8f02c8c0 1 < suggested remove operation key=X0RT8UF3D0JC tag=LWBPISZ2VFIA type=del 2024-09-14T10:57:45.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.091+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=9LWWO0P0RM4H type=del size=1050862 2024-09-14T10:57:45.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.095+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=UKVIK87QKBL0 type=del 2024-09-14T10:57:45.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.095+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=C1HJELPSY5QV type=del size=2891521 2024-09-14T10:57:45.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.099+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~SED9XY1FWH7E.0 size=1048576 2024-09-14T10:57:45.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.103+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~SED9XY1FWH7E.1 size=1048576 2024-09-14T10:57:45.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.107+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~SED9XY1FWH7E.2 size=577062 2024-09-14T10:57:45.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.115+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=SED9XY1FWH7E tag=3I16VOEBUKBO type=write size=3722790 2024-09-14T10:57:45.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.119+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~Y6RN6WES23XH.0 size=1048576 2024-09-14T10:57:45.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~Y6RN6WES23XH.1 size=1048576 2024-09-14T10:57:45.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.127+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~Y6RN6WES23XH.2 size=607687 2024-09-14T10:57:45.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.127+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=Y6RN6WES23XH tag=XCBMUSE7XWO9 type=write size=3753415 2024-09-14T10:57:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.131+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=IFREG71DM81N type=del 2024-09-14T10:57:45.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.135+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=7S3ORBLXY1FF type=del size=2576631 2024-09-14T10:57:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.139+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~MVOY743GZ749.0 size=1048576 2024-09-14T10:57:45.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.143+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~MVOY743GZ749.1 size=292271 2024-09-14T10:57:45.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.147+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=MVOY743GZ749 tag=NRZ17WIPJXTA type=write size=2389423 2024-09-14T10:57:45.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.155+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~C3I99UBGQMCT.0 size=1048576 2024-09-14T10:57:45.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.159+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~C3I99UBGQMCT.1 size=549501 2024-09-14T10:57:45.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.159+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=C3I99UBGQMCT tag=1TEL8AWOQMNO type=write size=2646653 2024-09-14T10:57:45.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~UIZDMFIRWJTW.0 size=1048576 2024-09-14T10:57:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~UIZDMFIRWJTW.1 size=716885 2024-09-14T10:57:45.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.171+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=UIZDMFIRWJTW tag=MYMAEE19MV9A type=write size=2814037 2024-09-14T10:57:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.179+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~T0LPV16LRGUG.0 size=83610 2024-09-14T10:57:45.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.179+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=T0LPV16LRGUG tag=2PCUY9AX1JB9 type=write size=1132186 2024-09-14T10:57:45.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.183+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=DGAXN1IKLJO2 type=del 2024-09-14T10:57:45.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.183+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=6VIT44DFUT9D type=del size=2911679 2024-09-14T10:57:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.187+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=SSH0Y5TC6F63 type=del 2024-09-14T10:57:45.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.191+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=PA7K3LZ5OO89 type=write size=802514 2024-09-14T10:57:45.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.195+0000 7fdf8f02c8c0 1 < completed write operation key=0QJLAH0EPKVD tag=76XCU0SHAKPE type=write size=986875 2024-09-14T10:57:45.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.199+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=5GWPXSE9SW2Q type=del size=3673421 2024-09-14T10:57:45.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.207+0000 7fdf8f02c8c0 1 < canceled operation key=WA7HE8ZJ1W1M tag=50ZRD07IV1LJ type=write size=774798 2024-09-14T10:57:45.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.215+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~VTTKD5LMKJ1F.0 size=1048576 2024-09-14T10:57:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~VTTKD5LMKJ1F.1 size=1048576 2024-09-14T10:57:45.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.219+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~VTTKD5LMKJ1F.2 size=1042261 2024-09-14T10:57:45.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.219+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=VTTKD5LMKJ1F tag=NNAZF8J13OGT type=write size=4187989 2024-09-14T10:57:45.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.223+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~PID6FT7IEPDY.0 size=1048576 2024-09-14T10:57:45.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.227+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~PID6FT7IEPDY.1 size=889150 2024-09-14T10:57:45.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.231+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=PID6FT7IEPDY tag=PRUEHGGWGSA0 type=write size=2986302 2024-09-14T10:57:45.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.235+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=61V4YNIOFQM9 type=write size=712845 2024-09-14T10:57:45.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.239+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=5TH0PHXYCKDR type=del 2024-09-14T10:57:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.243+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=O53LZ3YTBCKD type=write size=972982 2024-09-14T10:57:45.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.247+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~BMWL12YEO8OW.0 size=922725 2024-09-14T10:57:45.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.255+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=BMWL12YEO8OW tag=DDI0SXC002OZ type=write size=1971301 2024-09-14T10:57:45.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~XDIIADHYLSFG.0 size=112068 2024-09-14T10:57:45.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.259+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=XDIIADHYLSFG tag=04NS7W8C5M5D type=write size=1160644 2024-09-14T10:57:45.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.263+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~69ROUPATMLEX.0 size=1048576 2024-09-14T10:57:45.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.267+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~69ROUPATMLEX.1 size=1048576 2024-09-14T10:57:45.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.271+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~69ROUPATMLEX.2 size=645256 2024-09-14T10:57:45.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.279+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=69ROUPATMLEX tag=H64DOG5YRD5R type=write size=3790984 2024-09-14T10:57:45.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.279+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=OI55M46D2XZU type=del size=3339788 2024-09-14T10:57:45.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.283+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~HTR51B694KJM.0 size=1048576 2024-09-14T10:57:45.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.287+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~HTR51B694KJM.1 size=566524 2024-09-14T10:57:45.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.295+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=HTR51B694KJM tag=DPK3I5CR5BOL type=write size=2663676 2024-09-14T10:57:45.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.299+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=N1ZHIRSIKKDU type=del size=1123560 2024-09-14T10:57:45.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.299+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~3EPZSMN08X0T.0 size=1048576 2024-09-14T10:57:45.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.303+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~3EPZSMN08X0T.1 size=259084 2024-09-14T10:57:45.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.311+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=3EPZSMN08X0T tag=WA5QSD1GNJ20 type=write size=2356236 2024-09-14T10:57:45.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.315+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=2SI4OR8PYOVF type=del size=2307833 2024-09-14T10:57:45.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.319+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=9LWWO0P0RM4H type=del 2024-09-14T10:57:45.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.323+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=FOO2NZBH6N5X type=del size=3663980 2024-09-14T10:57:45.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.331+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZF6IDD8B3CFO tag=C1HJELPSY5QV type=del 2024-09-14T10:57:45.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.331+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=FFGVKY19GB95 type=del size=821669 2024-09-14T10:57:45.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.335+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_Y32RWGISRBMT.2~Y6RN6WES23XH.0 size=1048576 2024-09-14T10:57:45.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.335+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~Y6RN6WES23XH.1 size=1048576 2024-09-14T10:57:45.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.339+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~Y6RN6WES23XH.2 size=607687 2024-09-14T10:57:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.347+0000 7fdf8f02c8c0 1 < canceled multipart upload key=Y32RWGISRBMT upload=Y6RN6WES23XH tag=XCBMUSE7XWO9 type=write size=3753415 2024-09-14T10:57:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.351+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=WNWSAPUPV2O0 type=del size=2739570 2024-09-14T10:57:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.355+0000 7fdf8f02c8c0 1 < suggested remove operation key=3T0H42SC1ETB tag=7S3ORBLXY1FF type=del 2024-09-14T10:57:45.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.359+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=2W5TLW35RFZJ type=del size=1285369 2024-09-14T10:57:45.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.363+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~C3I99UBGQMCT.0 size=1048576 2024-09-14T10:57:45.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.367+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~C3I99UBGQMCT.1 size=549501 2024-09-14T10:57:45.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.371+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=C3I99UBGQMCT tag=1TEL8AWOQMNO type=write size=2646653 2024-09-14T10:57:45.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.375+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=R96CJOXU80AO type=write size=312999 2024-09-14T10:57:45.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.383+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~T0LPV16LRGUG.0 size=83610 2024-09-14T10:57:45.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.387+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=T0LPV16LRGUG tag=2PCUY9AX1JB9 type=write size=1132186 2024-09-14T10:57:45.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.391+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=AEZNSYIOQ6P7 type=del size=1337810 2024-09-14T10:57:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.399+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=6VIT44DFUT9D type=del 2024-09-14T10:57:45.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.403+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=PKXIH5D5B8BP type=del size=2021816 2024-09-14T10:57:45.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.407+0000 7fdf8f02c8c0 -1 < failed to complete operation key=ZF6IDD8B3CFO tag=PA7K3LZ5OO89 type=write size=802514: (22) Invalid argument 2024-09-14T10:57:45.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~ZKDT9RNCXBPP.0 size=1048576 2024-09-14T10:57:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.415+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~ZKDT9RNCXBPP.1 size=360816 2024-09-14T10:57:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.415+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=ZKDT9RNCXBPP tag=JHIRFHSBP4OB type=write size=2457968 2024-09-14T10:57:45.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.419+0000 7fdf8f02c8c0 -1 < failed to complete operation key=9IDBODZBQRJR tag=5GWPXSE9SW2Q type=del size=3673421: (22) Invalid argument 2024-09-14T10:57:45.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.427+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~4AV4F04SO0PA.0 size=136803 2024-09-14T10:57:45.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.427+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=4AV4F04SO0PA tag=NCDESILVCY16 type=write size=1185379 2024-09-14T10:57:45.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.431+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~VTTKD5LMKJ1F.0 size=1048576 2024-09-14T10:57:45.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.431+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~VTTKD5LMKJ1F.1 size=1048576 2024-09-14T10:57:45.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.435+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~VTTKD5LMKJ1F.2 size=1042261 2024-09-14T10:57:45.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.439+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=VTTKD5LMKJ1F tag=NNAZF8J13OGT type=write size=4187989 2024-09-14T10:57:45.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.443+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=NUZFRJ5DKZQ1 type=del size=905429 2024-09-14T10:57:45.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.447+0000 7fdf8f02c8c0 1 < canceled operation key=X1BN3054IKNS tag=61V4YNIOFQM9 type=write size=712845 2024-09-14T10:57:45.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.451+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=0T4MK55VOQ6J type=del size=3200632 2024-09-14T10:57:45.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.459+0000 7fdf8f02c8c0 1 < suggested remove operation key=3QSOKUSZ57QM tag=O53LZ3YTBCKD type=write 2024-09-14T10:57:45.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.463+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=7Y6SVSI3535U type=del size=4100553 2024-09-14T10:57:45.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.467+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~XDIIADHYLSFG.0 size=112068 2024-09-14T10:57:45.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.475+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=XDIIADHYLSFG tag=04NS7W8C5M5D type=write size=1160644 2024-09-14T10:57:45.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.483+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~H8KU5BV7L818.0 size=1048576 2024-09-14T10:57:45.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.487+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~H8KU5BV7L818.1 size=1048576 2024-09-14T10:57:45.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.487+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~H8KU5BV7L818.2 size=938777 2024-09-14T10:57:45.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.487+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=H8KU5BV7L818 tag=PM70U1R23NBG type=write size=4084505 2024-09-14T10:57:45.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.495+0000 7fdf8f02c8c0 1 < canceled operation key=HCGZ1MY5SKW9 tag=OI55M46D2XZU type=del size=3339788 2024-09-14T10:57:45.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.499+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~0KPGVIT2JX1E.0 size=1048576 2024-09-14T10:57:45.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.503+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~0KPGVIT2JX1E.1 size=685132 2024-09-14T10:57:45.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.503+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=0KPGVIT2JX1E tag=CDL6WA63B3VB type=write size=2782284 2024-09-14T10:57:45.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.511+0000 7fdf8f02c8c0 1 < suggested update operation key=304ZNF4OC1ML tag=N1ZHIRSIKKDU type=del size=1123560 2024-09-14T10:57:45.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.515+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=A83DQHEKGXHW type=del size=845277 2024-09-14T10:57:45.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.519+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=2SI4OR8PYOVF type=del 2024-09-14T10:57:45.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.527+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~YYMMBCK1QBCP.0 size=1048576 2024-09-14T10:57:45.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.531+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~YYMMBCK1QBCP.1 size=1048576 2024-09-14T10:57:45.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.535+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~YYMMBCK1QBCP.2 size=932352 2024-09-14T10:57:45.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.535+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=YYMMBCK1QBCP tag=TAC046N6VHXA type=write size=4078080 2024-09-14T10:57:45.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.539+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=FOO2NZBH6N5X type=del 2024-09-14T10:57:45.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.543+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=B06RBGM317GV type=del size=3797 2024-09-14T10:57:45.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.551+0000 7fdf8f02c8c0 1 < suggested update operation key=LCEH2YXNSOGT tag=FFGVKY19GB95 type=del size=821669 2024-09-14T10:57:45.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.559+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~5JN8XTK85LZL.0 size=1048576 2024-09-14T10:57:45.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~5JN8XTK85LZL.1 size=116901 2024-09-14T10:57:45.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.563+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=5JN8XTK85LZL tag=N6WN8K4707K8 type=write size=2214053 2024-09-14T10:57:45.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.567+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=WNWSAPUPV2O0 type=del 2024-09-14T10:57:45.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.571+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=51CJP6QRLDWQ type=del size=1495237 2024-09-14T10:57:45.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.575+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=2W5TLW35RFZJ type=del 2024-09-14T10:57:45.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.579+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=VDZQWOEF22VQ type=write size=181937 2024-09-14T10:57:45.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.583+0000 7fdf8f02c8c0 1 < completed write operation key=0QJLAH0EPKVD tag=R96CJOXU80AO type=write size=312999 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.591+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~U8NJ9Y9MATYE.0 size=360455 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.591+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=U8NJ9Y9MATYE tag=SIZBSDO4F8X2 type=write size=1409031 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.599+0000 7fdf8f02c8c0 1 < suggested update operation key=X0RT8UF3D0JC tag=AEZNSYIOQ6P7 type=del size=1337810 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.603+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=MG0801QT91AB type=del size=1480855 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.607+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=PKXIH5D5B8BP type=del 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.611+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=WXY626T940VE type=del size=876563 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.615+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~ZKDT9RNCXBPP.0 size=1048576 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.619+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~ZKDT9RNCXBPP.1 size=360816 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.623+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=ZKDT9RNCXBPP tag=JHIRFHSBP4OB type=write size=2457968 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.627+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=MF3O8DYG9LTR type=del size=875167 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.627+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_Y32RWGISRBMT.2~4AV4F04SO0PA.0 size=136803 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.635+0000 7fdf8f02c8c0 1 < canceled multipart upload key=Y32RWGISRBMT upload=4AV4F04SO0PA tag=NCDESILVCY16 type=write size=1185379 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.639+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=I50S12PF6RN6 type=del size=544672 2024-09-14T10:57:45.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.643+0000 7fdf8f02c8c0 1 < suggested remove operation key=MNBXQTJBS1QS tag=NUZFRJ5DKZQ1 type=del 2024-09-14T10:57:45.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~0UEC4VJNXJPH.0 size=1048576 2024-09-14T10:57:45.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~0UEC4VJNXJPH.1 size=322854 2024-09-14T10:57:45.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.655+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=0UEC4VJNXJPH tag=H8HBP59L05OF type=write size=2420006 2024-09-14T10:57:45.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.659+0000 7fdf8f02c8c0 1 < suggested remove operation key=LMNGCUFR187I tag=0T4MK55VOQ6J type=del 2024-09-14T10:57:45.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~S6Z9H2LBN427.0 size=1048576 2024-09-14T10:57:45.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~S6Z9H2LBN427.1 size=1023765 2024-09-14T10:57:45.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.671+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=S6Z9H2LBN427 tag=9WV8XV52C5FX type=write size=3120917 2024-09-14T10:57:45.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.675+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=7Y6SVSI3535U type=del 2024-09-14T10:57:45.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.679+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=790JIBXCOP7G type=write size=148130 2024-09-14T10:57:45.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.683+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~H8KU5BV7L818.0 size=1048576 2024-09-14T10:57:45.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.683+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_1E72V12EPEH3.2~H8KU5BV7L818.1 size=1048576 2024-09-14T10:57:45.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.683+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~H8KU5BV7L818.2 size=938777 2024-09-14T10:57:45.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.691+0000 7fdf8f02c8c0 1 < canceled multipart upload key=1E72V12EPEH3 upload=H8KU5BV7L818 tag=PM70U1R23NBG type=write size=4084505 2024-09-14T10:57:45.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.695+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=8I56M70OM3D0 type=del size=1923638 2024-09-14T10:57:45.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.695+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~0KPGVIT2JX1E.0 size=1048576 2024-09-14T10:57:45.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.695+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3QSOKUSZ57QM.2~0KPGVIT2JX1E.1 size=685132 2024-09-14T10:57:45.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.703+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3QSOKUSZ57QM upload=0KPGVIT2JX1E tag=CDL6WA63B3VB type=write size=2782284 2024-09-14T10:57:45.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.707+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=G9LI2VKCS7NB type=del size=4027189 2024-09-14T10:57:45.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.711+0000 7fdf8f02c8c0 -1 < failed to complete operation key=LCEH2YXNSOGT tag=A83DQHEKGXHW type=del size=845277: (22) Invalid argument 2024-09-14T10:57:45.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.715+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=IRCAP1AW8J24 type=del size=3331281 2024-09-14T10:57:45.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.719+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~YYMMBCK1QBCP.0 size=1048576 2024-09-14T10:57:45.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~YYMMBCK1QBCP.1 size=1048576 2024-09-14T10:57:45.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~YYMMBCK1QBCP.2 size=932352 2024-09-14T10:57:45.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.731+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=YYMMBCK1QBCP tag=TAC046N6VHXA type=write size=4078080 2024-09-14T10:57:45.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.735+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=AHIQWL1QJD8N type=del size=1560511 2024-09-14T10:57:45.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.739+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=B06RBGM317GV type=del 2024-09-14T10:57:45.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.743+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=ER2D2UTFGOB9 type=write size=308259 2024-09-14T10:57:45.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.747+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~5JN8XTK85LZL.0 size=1048576 2024-09-14T10:57:45.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.747+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~5JN8XTK85LZL.1 size=116901 2024-09-14T10:57:45.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.755+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=5JN8XTK85LZL tag=N6WN8K4707K8 type=write size=2214053 2024-09-14T10:57:45.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~GJPLH7EZTSXG.0 size=1048576 2024-09-14T10:57:45.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.763+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~GJPLH7EZTSXG.1 size=1048576 2024-09-14T10:57:45.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.767+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~GJPLH7EZTSXG.2 size=666352 2024-09-14T10:57:45.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.767+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=GJPLH7EZTSXG tag=D3S1JRCVOIXM type=write size=3812080 2024-09-14T10:57:45.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.771+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=51CJP6QRLDWQ type=del 2024-09-14T10:57:45.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.779+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~XRFUNXQK1TVS.0 size=1048576 2024-09-14T10:57:45.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.783+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~XRFUNXQK1TVS.1 size=1048576 2024-09-14T10:57:45.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.783+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~XRFUNXQK1TVS.2 size=756644 2024-09-14T10:57:45.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.783+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=XRFUNXQK1TVS tag=9105NC0CVO8N type=write size=3902372 2024-09-14T10:57:45.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.787+0000 7fdf8f02c8c0 1 < completed write operation key=APDKRWHOUH9T tag=VDZQWOEF22VQ type=write size=181937 2024-09-14T10:57:45.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~OZ17C15H423F.0 size=580901 2024-09-14T10:57:45.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.795+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=OZ17C15H423F tag=E9QQPR4YF9D5 type=write size=1629477 2024-09-14T10:57:45.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.799+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~U8NJ9Y9MATYE.0 size=360455 2024-09-14T10:57:45.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.803+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=U8NJ9Y9MATYE tag=SIZBSDO4F8X2 type=write size=1409031 2024-09-14T10:57:45.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.807+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=HYMGCUQAQMDA type=del size=624402 2024-09-14T10:57:45.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.815+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=MG0801QT91AB type=del size=1480855 2024-09-14T10:57:45.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.819+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=ENZYRJOWH845 type=del size=1912240 2024-09-14T10:57:45.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.819+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=WXY626T940VE type=del 2024-09-14T10:57:45.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.823+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=EO349KJL0CJK type=del size=1528043 2024-09-14T10:57:45.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.827+0000 7fdf8f02c8c0 1 < canceled operation key=L1ERJ0JSRDMG tag=MF3O8DYG9LTR type=del size=875167 2024-09-14T10:57:45.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.835+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~IQIJMPOMNJ1F.0 size=141133 2024-09-14T10:57:45.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.835+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=IQIJMPOMNJ1F tag=S9RWZBU9ON22 type=write size=1189709 2024-09-14T10:57:45.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.839+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=I50S12PF6RN6 type=del 2024-09-14T10:57:45.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.843+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=6JNFIMBNWRA6 type=del size=4020608 2024-09-14T10:57:45.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.847+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~0UEC4VJNXJPH.0 size=1048576 2024-09-14T10:57:45.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.851+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~0UEC4VJNXJPH.1 size=322854 2024-09-14T10:57:45.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.855+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=0UEC4VJNXJPH tag=H8HBP59L05OF type=write size=2420006 2024-09-14T10:57:45.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~QDKD0Q9O8SF7.0 size=905770 2024-09-14T10:57:45.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.863+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=QDKD0Q9O8SF7 tag=4EKIFPIV2AQD type=write size=1954346 2024-09-14T10:57:45.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.867+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~S6Z9H2LBN427.0 size=1048576 2024-09-14T10:57:45.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.867+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~S6Z9H2LBN427.1 size=1023765 2024-09-14T10:57:45.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.875+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=S6Z9H2LBN427 tag=9WV8XV52C5FX type=write size=3120917 2024-09-14T10:57:45.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.879+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~E8GRTJWK2ABZ.0 size=78254 2024-09-14T10:57:45.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.879+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=E8GRTJWK2ABZ tag=5WO4AK5M7IP0 type=write size=1126830 2024-09-14T10:57:45.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.883+0000 7fdf8f02c8c0 1 < completed write operation key=49O8DPTGA65S tag=790JIBXCOP7G type=write size=148130 2024-09-14T10:57:45.888 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~QHASRPQOKK72.0 size=1048576 2024-09-14T10:57:45.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~QHASRPQOKK72.1 size=165504 2024-09-14T10:57:45.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.895+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=QHASRPQOKK72 tag=R47EWH6LVI2X type=write size=2262656 2024-09-14T10:57:45.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.899+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=8I56M70OM3D0 type=del 2024-09-14T10:57:45.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.911+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~2YX1HRL1SF9L.0 size=37654 2024-09-14T10:57:45.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.911+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=2YX1HRL1SF9L tag=9RRXY2VJUA32 type=write size=1086230 2024-09-14T10:57:45.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.915+0000 7fdf8f02c8c0 1 < suggested update operation key=9IDBODZBQRJR tag=G9LI2VKCS7NB type=del size=4027189 2024-09-14T10:57:45.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~CRCRH8D0ADI2.0 size=1048576 2024-09-14T10:57:45.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.927+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~CRCRH8D0ADI2.1 size=1048576 2024-09-14T10:57:45.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.931+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~CRCRH8D0ADI2.2 size=123830 2024-09-14T10:57:45.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.931+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=CRCRH8D0ADI2 tag=9BRJ0N1PLZQK type=write size=3269558 2024-09-14T10:57:45.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.935+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=IRCAP1AW8J24 type=del 2024-09-14T10:57:45.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.939+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=WWJNQSBNB3L6 type=del size=9417 2024-09-14T10:57:45.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.943+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=AHIQWL1QJD8N type=del 2024-09-14T10:57:45.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.947+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=QVNOODLBRZRJ type=del size=3940621 2024-09-14T10:57:45.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.951+0000 7fdf8f02c8c0 1 < completed write operation key=3CYCJJIQ210M tag=ER2D2UTFGOB9 type=write size=308259 2024-09-14T10:57:45.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.955+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=WY5U6YHE8HJ7 type=del size=2462388 2024-09-14T10:57:45.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.959+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~GJPLH7EZTSXG.0 size=1048576 2024-09-14T10:57:45.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.959+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~GJPLH7EZTSXG.1 size=1048576 2024-09-14T10:57:45.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.963+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~GJPLH7EZTSXG.2 size=666352 2024-09-14T10:57:45.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.971+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=GJPLH7EZTSXG tag=D3S1JRCVOIXM type=write size=3812080 2024-09-14T10:57:45.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.971+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=ASV10EPQSBHO type=write size=901616 2024-09-14T10:57:45.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.975+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~XRFUNXQK1TVS.0 size=1048576 2024-09-14T10:57:45.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.979+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~XRFUNXQK1TVS.1 size=1048576 2024-09-14T10:57:45.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.983+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~XRFUNXQK1TVS.2 size=756644 2024-09-14T10:57:45.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.987+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=XRFUNXQK1TVS tag=9105NC0CVO8N type=write size=3902372 2024-09-14T10:57:45.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.991+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=2WHVJOHBN6X6 type=del size=3652030 2024-09-14T10:57:45.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:45.995+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~OZ17C15H423F.0 size=580901 2024-09-14T10:57:45.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.003+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=OZ17C15H423F tag=E9QQPR4YF9D5 type=write size=1629477 2024-09-14T10:57:46.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.007+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=KWO6T9P50OYU type=write size=343600 2024-09-14T10:57:46.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.015+0000 7fdf8f02c8c0 1 < suggested update operation key=0QJLAH0EPKVD tag=HYMGCUQAQMDA type=del size=624402 2024-09-14T10:57:46.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.019+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=8GTPY4FEQIEA type=del size=3997286 2024-09-14T10:57:46.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.023+0000 7fdf8f02c8c0 1 < suggested remove operation key=5VZCCFRUAQJ7 tag=ENZYRJOWH845 type=del 2024-09-14T10:57:46.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.027+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=ANR07WMSZ4JX type=del size=1549317 2024-09-14T10:57:46.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.035+0000 7fdf8f02c8c0 1 < suggested update operation key=0QJLAH0EPKVD tag=EO349KJL0CJK type=del size=1528043 2024-09-14T10:57:46.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.043+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~TTK6FKRCPK4Z.0 size=1048576 2024-09-14T10:57:46.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.047+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~TTK6FKRCPK4Z.1 size=948175 2024-09-14T10:57:46.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.047+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=TTK6FKRCPK4Z tag=4J94KN6BHVTH type=write size=3045327 2024-09-14T10:57:46.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.047+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~IQIJMPOMNJ1F.0 size=141133 2024-09-14T10:57:46.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.055+0000 7fdf8f02c8c0 1 < canceled multipart upload key=OFY1G5R28CK6 upload=IQIJMPOMNJ1F tag=S9RWZBU9ON22 type=write size=1189709 2024-09-14T10:57:46.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~7FSKLUY78MVZ.0 size=1048576 2024-09-14T10:57:46.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~7FSKLUY78MVZ.1 size=1048576 2024-09-14T10:57:46.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.067+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~7FSKLUY78MVZ.2 size=584041 2024-09-14T10:57:46.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.067+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=7FSKLUY78MVZ tag=VZ654P6VV8G2 type=write size=3729769 2024-09-14T10:57:46.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.071+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=6JNFIMBNWRA6 type=del 2024-09-14T10:57:46.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.079+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~2P2V6OUNU8QR.0 size=1048576 2024-09-14T10:57:46.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.079+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~2P2V6OUNU8QR.1 size=1048576 2024-09-14T10:57:46.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~2P2V6OUNU8QR.2 size=743952 2024-09-14T10:57:46.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.083+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=2P2V6OUNU8QR tag=8G62SOBAV64V type=write size=3889680 2024-09-14T10:57:46.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.087+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~QDKD0Q9O8SF7.0 size=905770 2024-09-14T10:57:46.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.095+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=QDKD0Q9O8SF7 tag=4EKIFPIV2AQD type=write size=1954346 2024-09-14T10:57:46.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.099+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=RQDVWD4TQBQX type=del size=4148276 2024-09-14T10:57:46.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.099+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_APDKRWHOUH9T.2~E8GRTJWK2ABZ.0 size=78254 2024-09-14T10:57:46.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.107+0000 7fdf8f02c8c0 1 < canceled multipart upload key=APDKRWHOUH9T upload=E8GRTJWK2ABZ tag=5WO4AK5M7IP0 type=write size=1126830 2024-09-14T10:57:46.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.111+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~JR8CDV72NQP5.0 size=1048576 2024-09-14T10:57:46.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.115+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~JR8CDV72NQP5.1 size=1048576 2024-09-14T10:57:46.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.119+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~JR8CDV72NQP5.2 size=675760 2024-09-14T10:57:46.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.119+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=JR8CDV72NQP5 tag=2XIPS8V4KNDD type=write size=3821488 2024-09-14T10:57:46.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.123+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~QHASRPQOKK72.0 size=1048576 2024-09-14T10:57:46.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.127+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~QHASRPQOKK72.1 size=165504 2024-09-14T10:57:46.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.131+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=QHASRPQOKK72 tag=R47EWH6LVI2X type=write size=2262656 2024-09-14T10:57:46.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.135+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=EB7LS1Y98YP5 type=write size=301067 2024-09-14T10:57:46.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.135+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_304ZNF4OC1ML.2~2YX1HRL1SF9L.0 size=37654 2024-09-14T10:57:46.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.143+0000 7fdf8f02c8c0 1 < canceled multipart upload key=304ZNF4OC1ML upload=2YX1HRL1SF9L tag=9RRXY2VJUA32 type=write size=1086230 2024-09-14T10:57:46.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.147+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~Z7AD1QDFGSGT.0 size=1048576 2024-09-14T10:57:46.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~Z7AD1QDFGSGT.1 size=1048576 2024-09-14T10:57:46.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.155+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~Z7AD1QDFGSGT.2 size=629962 2024-09-14T10:57:46.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.155+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=Z7AD1QDFGSGT tag=DLVBV6GC1M9E type=write size=3775690 2024-09-14T10:57:46.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.155+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_9IDBODZBQRJR.2~CRCRH8D0ADI2.0 size=1048576 2024-09-14T10:57:46.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.155+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~CRCRH8D0ADI2.1 size=1048576 2024-09-14T10:57:46.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.159+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~CRCRH8D0ADI2.2 size=123830 2024-09-14T10:57:46.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.167+0000 7fdf8f02c8c0 1 < canceled multipart upload key=9IDBODZBQRJR upload=CRCRH8D0ADI2 tag=9BRJ0N1PLZQK type=write size=3269558 2024-09-14T10:57:46.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.171+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~BMPOMQV0YNDG.0 size=1048576 2024-09-14T10:57:46.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.175+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~BMPOMQV0YNDG.1 size=1048576 2024-09-14T10:57:46.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.175+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~BMPOMQV0YNDG.2 size=82019 2024-09-14T10:57:46.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.175+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=BMPOMQV0YNDG tag=HN8TAJP78DZ4 type=write size=3227747 2024-09-14T10:57:46.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.179+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=WWJNQSBNB3L6 type=del 2024-09-14T10:57:46.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.183+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=SWGKZ4G2Z3A4 type=del size=1515136 2024-09-14T10:57:46.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.187+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=QVNOODLBRZRJ type=del 2024-09-14T10:57:46.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.195+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~UYNPJPFFW8AI.0 size=1048576 2024-09-14T10:57:46.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.199+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~UYNPJPFFW8AI.1 size=1048576 2024-09-14T10:57:46.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~UYNPJPFFW8AI.2 size=647545 2024-09-14T10:57:46.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.203+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=UYNPJPFFW8AI tag=3K11C30D5BIZ type=write size=3793273 2024-09-14T10:57:46.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.207+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=WY5U6YHE8HJ7 type=del 2024-09-14T10:57:46.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.211+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=GMN6C0VJMBZZ type=write size=861568 2024-09-14T10:57:46.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.215+0000 7fdf8f02c8c0 1 < completed write operation key=X1BN3054IKNS tag=ASV10EPQSBHO type=write size=901616 2024-09-14T10:57:46.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.223+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~3S0I4LYO5N7V.0 size=414450 2024-09-14T10:57:46.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.223+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=3S0I4LYO5N7V tag=49HJ6NSWA07W type=write size=1463026 2024-09-14T10:57:46.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.227+0000 7fdf8f02c8c0 1 < canceled operation key=6VNI8FMHZ0FN tag=2WHVJOHBN6X6 type=del size=3652030 2024-09-14T10:57:46.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.231+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~MRE3R2V4ZXTY.0 size=472021 2024-09-14T10:57:46.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.231+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=MRE3R2V4ZXTY tag=REBY38RMFBNN type=write size=1520597 2024-09-14T10:57:46.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.243+0000 7fdf8f02c8c0 1 < suggested remove operation key=49O8DPTGA65S tag=KWO6T9P50OYU type=write 2024-09-14T10:57:46.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.247+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=5SBLUFXW22XQ type=del size=2200111 2024-09-14T10:57:46.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.251+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=8GTPY4FEQIEA type=del 2024-09-14T10:57:46.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.259+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=L2SP2CKDJYB9 type=del size=1749415 2024-09-14T10:57:46.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.263+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=ANR07WMSZ4JX type=del 2024-09-14T10:57:46.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.271+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~Q5SCF71S1BDY.0 size=243504 2024-09-14T10:57:46.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.271+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=Q5SCF71S1BDY tag=MSHL69Y3P5RO type=write size=1292080 2024-09-14T10:57:46.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.275+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~TTK6FKRCPK4Z.0 size=1048576 2024-09-14T10:57:46.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~TTK6FKRCPK4Z.1 size=948175 2024-09-14T10:57:46.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.283+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=TTK6FKRCPK4Z tag=4J94KN6BHVTH type=write size=3045327 2024-09-14T10:57:46.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.287+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=VDEYSDP8XTDN type=del size=2589091 2024-09-14T10:57:46.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.291+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~7FSKLUY78MVZ.0 size=1048576 2024-09-14T10:57:46.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.295+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~7FSKLUY78MVZ.1 size=1048576 2024-09-14T10:57:46.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.299+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~7FSKLUY78MVZ.2 size=584041 2024-09-14T10:57:46.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.303+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=7FSKLUY78MVZ tag=VZ654P6VV8G2 type=write size=3729769 2024-09-14T10:57:46.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.307+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=B3TR1PC5JEF0 type=del size=3021127 2024-09-14T10:57:46.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.311+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~2P2V6OUNU8QR.0 size=1048576 2024-09-14T10:57:46.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.315+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~2P2V6OUNU8QR.1 size=1048576 2024-09-14T10:57:46.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.319+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~2P2V6OUNU8QR.2 size=743952 2024-09-14T10:57:46.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.323+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=2P2V6OUNU8QR tag=8G62SOBAV64V type=write size=3889680 2024-09-14T10:57:46.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.331+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~AO7IX47ES20B.0 size=1048576 2024-09-14T10:57:46.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.335+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~AO7IX47ES20B.1 size=1001595 2024-09-14T10:57:46.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.335+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=AO7IX47ES20B tag=TMK1MDY80JCQ type=write size=3098747 2024-09-14T10:57:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.339+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=RQDVWD4TQBQX type=del 2024-09-14T10:57:46.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.343+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=WXF5JB2ZCUJY type=del size=3595750 2024-09-14T10:57:46.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.347+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~JR8CDV72NQP5.0 size=1048576 2024-09-14T10:57:46.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.351+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~JR8CDV72NQP5.1 size=1048576 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.351+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~JR8CDV72NQP5.2 size=675760 2024-09-14T10:57:46.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.359+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=JR8CDV72NQP5 tag=2XIPS8V4KNDD type=write size=3821488 2024-09-14T10:57:46.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.363+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=36NFZI9EIXK7 type=del size=2465592 2024-09-14T10:57:46.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.367+0000 7fdf8f02c8c0 1 < completed write operation key=WA7HE8ZJ1W1M tag=EB7LS1Y98YP5 type=write size=301067 2024-09-14T10:57:46.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.375+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~5VD217J5TDNE.0 size=1048576 2024-09-14T10:57:46.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.375+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~5VD217J5TDNE.1 size=402494 2024-09-14T10:57:46.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.375+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=5VD217J5TDNE tag=0V2A37NY68YK type=write size=2499646 2024-09-14T10:57:46.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.379+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~Z7AD1QDFGSGT.0 size=1048576 2024-09-14T10:57:46.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.383+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~Z7AD1QDFGSGT.1 size=1048576 2024-09-14T10:57:46.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.387+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~Z7AD1QDFGSGT.2 size=629962 2024-09-14T10:57:46.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.391+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=Z7AD1QDFGSGT tag=DLVBV6GC1M9E type=write size=3775690 2024-09-14T10:57:46.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.399+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~TRZULK5JIAKI.0 size=1048576 2024-09-14T10:57:46.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.403+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~TRZULK5JIAKI.1 size=1048576 2024-09-14T10:57:46.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.403+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~TRZULK5JIAKI.2 size=384391 2024-09-14T10:57:46.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.403+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=TRZULK5JIAKI tag=IFS5ZNV4CB7S type=write size=3530119 2024-09-14T10:57:46.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.407+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~BMPOMQV0YNDG.0 size=1048576 2024-09-14T10:57:46.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.411+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~BMPOMQV0YNDG.1 size=1048576 2024-09-14T10:57:46.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.415+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~BMPOMQV0YNDG.2 size=82019 2024-09-14T10:57:46.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.419+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=BMPOMQV0YNDG tag=HN8TAJP78DZ4 type=write size=3227747 2024-09-14T10:57:46.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.423+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=QRQFJ0BMX1MB type=del size=2517446 2024-09-14T10:57:46.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.427+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=SWGKZ4G2Z3A4 type=del 2024-09-14T10:57:46.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.435+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~O8GY1FGBBU6V.0 size=1048576 2024-09-14T10:57:46.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.439+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~O8GY1FGBBU6V.1 size=16661 2024-09-14T10:57:46.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.439+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=O8GY1FGBBU6V tag=ES5V3Z0WJA0C type=write size=2113813 2024-09-14T10:57:46.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~UYNPJPFFW8AI.0 size=1048576 2024-09-14T10:57:46.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~UYNPJPFFW8AI.1 size=1048576 2024-09-14T10:57:46.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.447+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~UYNPJPFFW8AI.2 size=647545 2024-09-14T10:57:46.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.451+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=UYNPJPFFW8AI tag=3K11C30D5BIZ type=write size=3793273 2024-09-14T10:57:46.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.459+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~QRAGCHKRX50Y.0 size=1048576 2024-09-14T10:57:46.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.463+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~QRAGCHKRX50Y.1 size=841188 2024-09-14T10:57:46.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.463+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=QRAGCHKRX50Y tag=JFBNRZYEVA7P type=write size=2938340 2024-09-14T10:57:46.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.471+0000 7fdf8f02c8c0 1 < suggested remove operation key=304ZNF4OC1ML tag=GMN6C0VJMBZZ type=write 2024-09-14T10:57:46.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.475+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~LFCZE4CUB3FP.0 size=407119 2024-09-14T10:57:46.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.475+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=LFCZE4CUB3FP tag=RWEN1GUIFDOU type=write size=1455695 2024-09-14T10:57:46.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.479+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~3S0I4LYO5N7V.0 size=414450 2024-09-14T10:57:46.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.487+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=3S0I4LYO5N7V tag=49HJ6NSWA07W type=write size=1463026 2024-09-14T10:57:46.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.495+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~G2S02DBDUGY0.0 size=109782 2024-09-14T10:57:46.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.495+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=G2S02DBDUGY0 tag=Z5O3IY0W8M02 type=write size=1158358 2024-09-14T10:57:46.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.495+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~MRE3R2V4ZXTY.0 size=472021 2024-09-14T10:57:46.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.503+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=MRE3R2V4ZXTY tag=REBY38RMFBNN type=write size=1520597 2024-09-14T10:57:46.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.507+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=WMFLCAGZXYQY type=del size=4139292 2024-09-14T10:57:46.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.515+0000 7fdf8f02c8c0 1 < suggested update operation key=YU9DAJA242Q7 tag=5SBLUFXW22XQ type=del size=2200111 2024-09-14T10:57:46.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.519+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=969BZYAUVSTG type=write size=559783 2024-09-14T10:57:46.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.523+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=L2SP2CKDJYB9 type=del 2024-09-14T10:57:46.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.527+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=7ETPIUUF5O83 type=del size=30280 2024-09-14T10:57:46.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.527+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~Q5SCF71S1BDY.0 size=243504 2024-09-14T10:57:46.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.531+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=Q5SCF71S1BDY tag=MSHL69Y3P5RO type=write size=1292080 2024-09-14T10:57:46.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.535+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=K0Z7RHV7AR24 type=del size=2565905 2024-09-14T10:57:46.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.539+0000 7fdf8f02c8c0 -1 < failed to complete operation key=304ZNF4OC1ML tag=VDEYSDP8XTDN type=del size=2589091: (22) Invalid argument 2024-09-14T10:57:46.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.543+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=3UAVSULB3VYW type=write size=13104 2024-09-14T10:57:46.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.547+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=B3TR1PC5JEF0 type=del 2024-09-14T10:57:46.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.551+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=508UO1IFFMDQ type=del size=2391259 2024-09-14T10:57:46.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.555+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~AO7IX47ES20B.0 size=1048576 2024-09-14T10:57:46.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.559+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~AO7IX47ES20B.1 size=1001595 2024-09-14T10:57:46.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.567+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=AO7IX47ES20B tag=TMK1MDY80JCQ type=write size=3098747 2024-09-14T10:57:46.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~AMWGJ4LQZ7DY.0 size=1048576 2024-09-14T10:57:46.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.575+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~AMWGJ4LQZ7DY.1 size=1048576 2024-09-14T10:57:46.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.579+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~AMWGJ4LQZ7DY.2 size=329121 2024-09-14T10:57:46.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.579+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=AMWGJ4LQZ7DY tag=NFRC5N2J5US3 type=write size=3474849 2024-09-14T10:57:46.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.583+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=WXF5JB2ZCUJY type=del 2024-09-14T10:57:46.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.587+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=WMFN7YUU1ZZ0 type=write size=711178 2024-09-14T10:57:46.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.595+0000 7fdf8f02c8c0 1 < suggested update operation key=L1ERJ0JSRDMG tag=36NFZI9EIXK7 type=del size=2465592 2024-09-14T10:57:46.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~XNGJGK28ET5C.0 size=1048576 2024-09-14T10:57:46.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.611+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~XNGJGK28ET5C.1 size=104725 2024-09-14T10:57:46.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.611+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=XNGJGK28ET5C tag=C821CPMZRL77 type=write size=2201877 2024-09-14T10:57:46.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.615+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~5VD217J5TDNE.0 size=1048576 2024-09-14T10:57:46.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.619+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~5VD217J5TDNE.1 size=402494 2024-09-14T10:57:46.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.623+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=5VD217J5TDNE tag=0V2A37NY68YK type=write size=2499646 2024-09-14T10:57:46.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.627+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=7YJFG8KU0815 type=write size=139878 2024-09-14T10:57:46.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.631+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~TRZULK5JIAKI.0 size=1048576 2024-09-14T10:57:46.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.631+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_APDKRWHOUH9T.2~TRZULK5JIAKI.1 size=1048576 2024-09-14T10:57:46.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.635+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~TRZULK5JIAKI.2 size=384391 2024-09-14T10:57:46.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.639+0000 7fdf8f02c8c0 1 < canceled multipart upload key=APDKRWHOUH9T upload=TRZULK5JIAKI tag=IFS5ZNV4CB7S type=write size=3530119 2024-09-14T10:57:46.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~HA8SSB5FFOKN.0 size=1048576 2024-09-14T10:57:46.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~HA8SSB5FFOKN.1 size=1048576 2024-09-14T10:57:46.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~HA8SSB5FFOKN.2 size=834442 2024-09-14T10:57:46.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.655+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=HA8SSB5FFOKN tag=E3ZB0UIHE5K7 type=write size=3980170 2024-09-14T10:57:46.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.655+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=QRQFJ0BMX1MB type=del 2024-09-14T10:57:46.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.659+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=S2A5AOZU5S51 type=del size=2487766 2024-09-14T10:57:46.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.663+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~O8GY1FGBBU6V.0 size=1048576 2024-09-14T10:57:46.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.667+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~O8GY1FGBBU6V.1 size=16661 2024-09-14T10:57:46.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.675+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=O8GY1FGBBU6V tag=ES5V3Z0WJA0C type=write size=2113813 2024-09-14T10:57:46.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.679+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~PKYK3FRLF59W.0 size=1048576 2024-09-14T10:57:46.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~PKYK3FRLF59W.1 size=1048576 2024-09-14T10:57:46.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.687+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~PKYK3FRLF59W.2 size=344216 2024-09-14T10:57:46.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.687+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=PKYK3FRLF59W tag=QZIUA4L9WOV2 type=write size=3489944 2024-09-14T10:57:46.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.691+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~QRAGCHKRX50Y.0 size=1048576 2024-09-14T10:57:46.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.691+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~QRAGCHKRX50Y.1 size=841188 2024-09-14T10:57:46.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.699+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=QRAGCHKRX50Y tag=JFBNRZYEVA7P type=write size=2938340 2024-09-14T10:57:46.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.703+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=X9X131EJBW2C type=del size=201865 2024-09-14T10:57:46.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.707+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~LFCZE4CUB3FP.0 size=407119 2024-09-14T10:57:46.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.711+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=LFCZE4CUB3FP tag=RWEN1GUIFDOU type=write size=1455695 2024-09-14T10:57:46.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.715+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=DM6Y2LKTH1FV type=del size=1223740 2024-09-14T10:57:46.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.715+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LCEH2YXNSOGT.2~G2S02DBDUGY0.0 size=109782 2024-09-14T10:57:46.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.723+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LCEH2YXNSOGT upload=G2S02DBDUGY0 tag=Z5O3IY0W8M02 type=write size=1158358 2024-09-14T10:57:46.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.727+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=1A3U652TIVIM type=del size=2018984 2024-09-14T10:57:46.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.731+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=WMFLCAGZXYQY type=del 2024-09-14T10:57:46.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.735+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~M0WEK5D6CU7L.0 size=1048576 2024-09-14T10:57:46.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.739+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~M0WEK5D6CU7L.1 size=1048576 2024-09-14T10:57:46.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.743+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~M0WEK5D6CU7L.2 size=970388 2024-09-14T10:57:46.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.743+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=M0WEK5D6CU7L tag=JCLZ6PYVJG80 type=write size=4116116 2024-09-14T10:57:46.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.747+0000 7fdf8f02c8c0 1 < completed write operation key=49O8DPTGA65S tag=969BZYAUVSTG type=write size=559783 2024-09-14T10:57:46.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.755+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~ACEJLJN4JWMM.0 size=797553 2024-09-14T10:57:46.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.755+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=ACEJLJN4JWMM tag=TJ8SJ7EL2TIU type=write size=1846129 2024-09-14T10:57:46.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.763+0000 7fdf8f02c8c0 1 < suggested update operation key=ZSBCGOXXJ0D5 tag=7ETPIUUF5O83 type=del size=30280 2024-09-14T10:57:46.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.767+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=QVL2W92XNH6Q type=del size=3014342 2024-09-14T10:57:46.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.775+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=K0Z7RHV7AR24 type=del size=2565905 2024-09-14T10:57:46.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.779+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=MMIWEX80P9HG type=del size=2089020 2024-09-14T10:57:46.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.783+0000 7fdf8f02c8c0 -1 < failed to complete operation key=L1ERJ0JSRDMG tag=3UAVSULB3VYW type=write size=13104: (22) Invalid argument 2024-09-14T10:57:46.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.787+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~8JTENB2XAJNL.0 size=659283 2024-09-14T10:57:46.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.787+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=8JTENB2XAJNL tag=DNDX78QDG192 type=write size=1707859 2024-09-14T10:57:46.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.799+0000 7fdf8f02c8c0 1 < suggested update operation key=304ZNF4OC1ML tag=508UO1IFFMDQ type=del size=2391259 2024-09-14T10:57:46.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.803+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=OUEZ9J5ECPCM type=write size=962296 2024-09-14T10:57:46.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.807+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~AMWGJ4LQZ7DY.0 size=1048576 2024-09-14T10:57:46.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~AMWGJ4LQZ7DY.1 size=1048576 2024-09-14T10:57:46.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~AMWGJ4LQZ7DY.2 size=329121 2024-09-14T10:57:46.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.819+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=AMWGJ4LQZ7DY tag=NFRC5N2J5US3 type=write size=3474849 2024-09-14T10:57:46.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.823+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=DGHA27LGYLYL type=write size=46988 2024-09-14T10:57:46.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.827+0000 7fdf8f02c8c0 1 < completed write operation key=ZF6IDD8B3CFO tag=WMFN7YUU1ZZ0 type=write size=711178 2024-09-14T10:57:46.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.831+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=BFNCPEHPG8M4 type=del size=2589294 2024-09-14T10:57:46.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.835+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~XNGJGK28ET5C.0 size=1048576 2024-09-14T10:57:46.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.839+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~XNGJGK28ET5C.1 size=104725 2024-09-14T10:57:46.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.847+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=XNGJGK28ET5C tag=C821CPMZRL77 type=write size=2201877 2024-09-14T10:57:46.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.851+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=YR9DQCB9DRAJ type=del size=4068153 2024-09-14T10:57:46.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.855+0000 7fdf8f02c8c0 1 < completed write operation key=LFLY0V3FRRW5 tag=7YJFG8KU0815 type=write size=139878 2024-09-14T10:57:46.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~F15QZQJQNE0Q.0 size=764993 2024-09-14T10:57:46.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.863+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=F15QZQJQNE0Q tag=HIX7PUNA3JBD type=write size=1813569 2024-09-14T10:57:46.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.867+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~HA8SSB5FFOKN.0 size=1048576 2024-09-14T10:57:46.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.867+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~HA8SSB5FFOKN.1 size=1048576 2024-09-14T10:57:46.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~HA8SSB5FFOKN.2 size=834442 2024-09-14T10:57:46.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.879+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=HA8SSB5FFOKN tag=E3ZB0UIHE5K7 type=write size=3980170 2024-09-14T10:57:46.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.883+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~KFCD49SDY1YW.0 size=371545 2024-09-14T10:57:46.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.883+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=KFCD49SDY1YW tag=WAB1FOAM2BN7 type=write size=1420121 2024-09-14T10:57:46.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.887+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=S2A5AOZU5S51 type=del 2024-09-14T10:57:46.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.895+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=24O9HVG9T1ZA type=del size=2447924 2024-09-14T10:57:46.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.895+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~PKYK3FRLF59W.0 size=1048576 2024-09-14T10:57:46.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.895+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STB3W5URFJEZ.2~PKYK3FRLF59W.1 size=1048576 2024-09-14T10:57:46.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~PKYK3FRLF59W.2 size=344216 2024-09-14T10:57:46.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.907+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STB3W5URFJEZ upload=PKYK3FRLF59W tag=QZIUA4L9WOV2 type=write size=3489944 2024-09-14T10:57:46.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.915+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~CAOIM4PRX844.0 size=1048576 2024-09-14T10:57:46.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.915+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~CAOIM4PRX844.1 size=1048576 2024-09-14T10:57:46.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.919+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~CAOIM4PRX844.2 size=980122 2024-09-14T10:57:46.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.919+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=CAOIM4PRX844 tag=0QQNX4EZUR2V type=write size=4125850 2024-09-14T10:57:46.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.923+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=X9X131EJBW2C type=del 2024-09-14T10:57:46.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.931+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~UONYFGRG2WEZ.0 size=1048576 2024-09-14T10:57:46.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.935+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~UONYFGRG2WEZ.1 size=1048576 2024-09-14T10:57:46.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.935+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~UONYFGRG2WEZ.2 size=681779 2024-09-14T10:57:46.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.935+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=UONYFGRG2WEZ tag=RAQUAUN72Z17 type=write size=3827507 2024-09-14T10:57:46.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.943+0000 7fdf8f02c8c0 1 < suggested remove operation key=LFLY0V3FRRW5 tag=DM6Y2LKTH1FV type=del 2024-09-14T10:57:46.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~51IHKEXDGEIN.0 size=192925 2024-09-14T10:57:46.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.951+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=51IHKEXDGEIN tag=ENMEASGTP2XS type=write size=1241501 2024-09-14T10:57:46.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.963+0000 7fdf8f02c8c0 1 < suggested update operation key=ZSBCGOXXJ0D5 tag=1A3U652TIVIM type=del size=2018984 2024-09-14T10:57:46.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.967+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~2U06V74OJBSJ.0 size=1048576 2024-09-14T10:57:46.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.971+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~2U06V74OJBSJ.1 size=279034 2024-09-14T10:57:46.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.971+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=2U06V74OJBSJ tag=FP76CUATGXPH type=write size=2376186 2024-09-14T10:57:46.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.971+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_WA7HE8ZJ1W1M.2~M0WEK5D6CU7L.0 size=1048576 2024-09-14T10:57:46.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.975+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~M0WEK5D6CU7L.1 size=1048576 2024-09-14T10:57:46.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.979+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~M0WEK5D6CU7L.2 size=970388 2024-09-14T10:57:46.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.983+0000 7fdf8f02c8c0 1 < canceled multipart upload key=WA7HE8ZJ1W1M upload=M0WEK5D6CU7L tag=JCLZ6PYVJG80 type=write size=4116116 2024-09-14T10:57:46.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.987+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=UT3D9HVONWFL type=del size=2087177 2024-09-14T10:57:46.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.991+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~ACEJLJN4JWMM.0 size=797553 2024-09-14T10:57:46.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:46.999+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=ACEJLJN4JWMM tag=TJ8SJ7EL2TIU type=write size=1846129 2024-09-14T10:57:46.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.003+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=I3BCV082IOFF type=del size=2609367 2024-09-14T10:57:47.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.003+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=QVL2W92XNH6Q type=del 2024-09-14T10:57:47.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~GZPGV2MS5HYX.0 size=1048576 2024-09-14T10:57:47.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.015+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~GZPGV2MS5HYX.1 size=1048576 2024-09-14T10:57:47.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.019+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~GZPGV2MS5HYX.2 size=744100 2024-09-14T10:57:47.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.019+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=GZPGV2MS5HYX tag=JEAF7JT6AWSO type=write size=3889828 2024-09-14T10:57:47.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.023+0000 7fdf8f02c8c0 -1 < failed to complete operation key=304ZNF4OC1ML tag=MMIWEX80P9HG type=del size=2089020: (22) Invalid argument 2024-09-14T10:57:47.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.027+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~9N7J7ER6QVOX.0 size=935922 2024-09-14T10:57:47.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.027+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=9N7J7ER6QVOX tag=MFCUIWKFYL78 type=write size=1984498 2024-09-14T10:57:47.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.031+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~8JTENB2XAJNL.0 size=659283 2024-09-14T10:57:47.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.039+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=8JTENB2XAJNL tag=DNDX78QDG192 type=write size=1707859 2024-09-14T10:57:47.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.043+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~W89JVWRM6CZ5.0 size=1048576 2024-09-14T10:57:47.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.047+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~W89JVWRM6CZ5.1 size=1048576 2024-09-14T10:57:47.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.051+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~W89JVWRM6CZ5.2 size=961529 2024-09-14T10:57:47.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.051+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=W89JVWRM6CZ5 tag=VSNHW7BTSUJB type=write size=4107257 2024-09-14T10:57:47.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.055+0000 7fdf8f02c8c0 1 < canceled operation key=304ZNF4OC1ML tag=OUEZ9J5ECPCM type=write size=962296 2024-09-14T10:57:47.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.059+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~I9PM5Y9FR9OC.0 size=1031760 2024-09-14T10:57:47.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.059+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=I9PM5Y9FR9OC tag=WP1497NQPMTQ type=write size=2080336 2024-09-14T10:57:47.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.063+0000 7fdf8f02c8c0 1 < completed write operation key=STHEUJ6VDPQB tag=DGHA27LGYLYL type=write size=46988 2024-09-14T10:57:47.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.071+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~BR9H6K5J4PS1.0 size=1048576 2024-09-14T10:57:47.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~BR9H6K5J4PS1.1 size=438259 2024-09-14T10:57:47.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.075+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=BR9H6K5J4PS1 tag=Q7BZOW2YEILF type=write size=2535411 2024-09-14T10:57:47.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.075+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=BFNCPEHPG8M4 type=del 2024-09-14T10:57:47.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~G6MW4BRFWHYR.0 size=1048576 2024-09-14T10:57:47.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.087+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~G6MW4BRFWHYR.1 size=1048576 2024-09-14T10:57:47.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.087+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~G6MW4BRFWHYR.2 size=8923 2024-09-14T10:57:47.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.087+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=G6MW4BRFWHYR tag=DL0DH7NZC57V type=write size=3154651 2024-09-14T10:57:47.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.091+0000 7fdf8f02c8c0 -1 < failed to complete operation key=LFLY0V3FRRW5 tag=YR9DQCB9DRAJ type=del size=4068153: (22) Invalid argument 2024-09-14T10:57:47.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.095+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=YAY08SX1B6Z5 type=del size=2631858 2024-09-14T10:57:47.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.099+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~F15QZQJQNE0Q.0 size=764993 2024-09-14T10:57:47.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.103+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=F15QZQJQNE0Q tag=HIX7PUNA3JBD type=write size=1813569 2024-09-14T10:57:47.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.111+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~PQTODAIHL4VX.0 size=142485 2024-09-14T10:57:47.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.111+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=PQTODAIHL4VX tag=3W2NXJCU96MM type=write size=1191061 2024-09-14T10:57:47.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.115+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~KFCD49SDY1YW.0 size=371545 2024-09-14T10:57:47.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.123+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=KFCD49SDY1YW tag=WAB1FOAM2BN7 type=write size=1420121 2024-09-14T10:57:47.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.127+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=LGPFVGZCWEQI type=del size=2413471 2024-09-14T10:57:47.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.135+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=24O9HVG9T1ZA type=del size=2447924 2024-09-14T10:57:47.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.139+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~KXLIZ24BHCR0.0 size=1048576 2024-09-14T10:57:47.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.143+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~KXLIZ24BHCR0.1 size=1048576 2024-09-14T10:57:47.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.143+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~KXLIZ24BHCR0.2 size=695886 2024-09-14T10:57:47.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.143+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=KXLIZ24BHCR0 tag=JBPIKIHCLZGY type=write size=3841614 2024-09-14T10:57:47.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.147+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~CAOIM4PRX844.0 size=1048576 2024-09-14T10:57:47.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.151+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~CAOIM4PRX844.1 size=1048576 2024-09-14T10:57:47.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.155+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~CAOIM4PRX844.2 size=980122 2024-09-14T10:57:47.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.159+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=CAOIM4PRX844 tag=0QQNX4EZUR2V type=write size=4125850 2024-09-14T10:57:47.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.163+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~0YPJ8EOYL3MN.0 size=205093 2024-09-14T10:57:47.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.163+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=0YPJ8EOYL3MN tag=5V8BGLT1ZHNR type=write size=1253669 2024-09-14T10:57:47.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.167+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~UONYFGRG2WEZ.0 size=1048576 2024-09-14T10:57:47.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~UONYFGRG2WEZ.1 size=1048576 2024-09-14T10:57:47.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~UONYFGRG2WEZ.2 size=681779 2024-09-14T10:57:47.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.179+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=UONYFGRG2WEZ tag=RAQUAUN72Z17 type=write size=3827507 2024-09-14T10:57:47.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.183+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~I7WVQH3VTS2J.0 size=1048576 2024-09-14T10:57:47.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.187+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~I7WVQH3VTS2J.1 size=360815 2024-09-14T10:57:47.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.187+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=I7WVQH3VTS2J tag=I4D1ZLSE611X type=write size=2457967 2024-09-14T10:57:47.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.187+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~51IHKEXDGEIN.0 size=192925 2024-09-14T10:57:47.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.195+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=51IHKEXDGEIN tag=ENMEASGTP2XS type=write size=1241501 2024-09-14T10:57:47.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.199+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~VDK8M3K00T4I.0 size=1048576 2024-09-14T10:57:47.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~VDK8M3K00T4I.1 size=344710 2024-09-14T10:57:47.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.203+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=VDK8M3K00T4I tag=KCLUR4OINQ80 type=write size=2441862 2024-09-14T10:57:47.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.207+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~2U06V74OJBSJ.0 size=1048576 2024-09-14T10:57:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.207+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~2U06V74OJBSJ.1 size=279034 2024-09-14T10:57:47.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.215+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=2U06V74OJBSJ tag=FP76CUATGXPH type=write size=2376186 2024-09-14T10:57:47.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.219+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=USZ5O8LKBSD6 type=del size=3895223 2024-09-14T10:57:47.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.223+0000 7fdf8f02c8c0 1 < canceled operation key=1E72V12EPEH3 tag=UT3D9HVONWFL type=del size=2087177 2024-09-14T10:57:47.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.227+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=1LOEEYLBA6AY type=del size=2516800 2024-09-14T10:57:47.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.231+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=I3BCV082IOFF type=del 2024-09-14T10:57:47.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.235+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=TTERZOT1O00L type=write size=139302 2024-09-14T10:57:47.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.239+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~GZPGV2MS5HYX.0 size=1048576 2024-09-14T10:57:47.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~GZPGV2MS5HYX.1 size=1048576 2024-09-14T10:57:47.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.247+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~GZPGV2MS5HYX.2 size=744100 2024-09-14T10:57:47.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.255+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=GZPGV2MS5HYX tag=JEAF7JT6AWSO type=write size=3889828 2024-09-14T10:57:47.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.259+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=D0KDCCG6SB43 type=del size=3357998 2024-09-14T10:57:47.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.263+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~9N7J7ER6QVOX.0 size=935922 2024-09-14T10:57:47.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.271+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=9N7J7ER6QVOX tag=MFCUIWKFYL78 type=write size=1984498 2024-09-14T10:57:47.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.275+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=76DGHC4OH6CU type=del size=3600569 2024-09-14T10:57:47.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~W89JVWRM6CZ5.0 size=1048576 2024-09-14T10:57:47.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~W89JVWRM6CZ5.1 size=1048576 2024-09-14T10:57:47.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.283+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~W89JVWRM6CZ5.2 size=961529 2024-09-14T10:57:47.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.295+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=W89JVWRM6CZ5 tag=VSNHW7BTSUJB type=write size=4107257 2024-09-14T10:57:47.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.299+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~D1URMTHDS46A.0 size=953311 2024-09-14T10:57:47.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.299+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=D1URMTHDS46A tag=GUA2WR7I8P7M type=write size=2001887 2024-09-14T10:57:47.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.303+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_5VZCCFRUAQJ7.2~I9PM5Y9FR9OC.0 size=1031760 2024-09-14T10:57:47.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.307+0000 7fdf8f02c8c0 1 < canceled multipart upload key=5VZCCFRUAQJ7 upload=I9PM5Y9FR9OC tag=WP1497NQPMTQ type=write size=2080336 2024-09-14T10:57:47.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.311+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=EYSH4PDIPQD2 type=del size=1568667 2024-09-14T10:57:47.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.315+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~BR9H6K5J4PS1.0 size=1048576 2024-09-14T10:57:47.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.319+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~BR9H6K5J4PS1.1 size=438259 2024-09-14T10:57:47.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.323+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=BR9H6K5J4PS1 tag=Q7BZOW2YEILF type=write size=2535411 2024-09-14T10:57:47.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.327+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=Q6MKSMXFOX2W type=del size=1277758 2024-09-14T10:57:47.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.331+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~G6MW4BRFWHYR.0 size=1048576 2024-09-14T10:57:47.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.335+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~G6MW4BRFWHYR.1 size=1048576 2024-09-14T10:57:47.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.335+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~G6MW4BRFWHYR.2 size=8923 2024-09-14T10:57:47.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.343+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=G6MW4BRFWHYR tag=DL0DH7NZC57V type=write size=3154651 2024-09-14T10:57:47.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~WM10JVG1T2G5.0 size=1048576 2024-09-14T10:57:47.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~WM10JVG1T2G5.1 size=1048576 2024-09-14T10:57:47.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.355+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~WM10JVG1T2G5.2 size=637251 2024-09-14T10:57:47.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.355+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=WM10JVG1T2G5 tag=ZUFE22NPLX6U type=write size=3782979 2024-09-14T10:57:47.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.363+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=YAY08SX1B6Z5 type=del size=2631858 2024-09-14T10:57:47.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.367+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~IMEOUG6KT9TX.0 size=1048576 2024-09-14T10:57:47.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.371+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~IMEOUG6KT9TX.1 size=1048576 2024-09-14T10:57:47.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.375+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~IMEOUG6KT9TX.2 size=540316 2024-09-14T10:57:47.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.375+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=IMEOUG6KT9TX tag=QSWP0SO7M2J4 type=write size=3686044 2024-09-14T10:57:47.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.379+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~PQTODAIHL4VX.0 size=142485 2024-09-14T10:57:47.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.383+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=PQTODAIHL4VX tag=3W2NXJCU96MM type=write size=1191061 2024-09-14T10:57:47.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.387+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=ZW5AO1CJ48CP type=write size=992668 2024-09-14T10:57:47.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.391+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=LGPFVGZCWEQI type=del 2024-09-14T10:57:47.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.399+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~5V0OQJSQPAUG.0 size=1048576 2024-09-14T10:57:47.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.403+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~5V0OQJSQPAUG.1 size=1048576 2024-09-14T10:57:47.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.403+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~5V0OQJSQPAUG.2 size=742107 2024-09-14T10:57:47.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.403+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=5V0OQJSQPAUG tag=C78TEYUBBR7O type=write size=3887835 2024-09-14T10:57:47.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.407+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~KXLIZ24BHCR0.0 size=1048576 2024-09-14T10:57:47.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.411+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~KXLIZ24BHCR0.1 size=1048576 2024-09-14T10:57:47.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.415+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~KXLIZ24BHCR0.2 size=695886 2024-09-14T10:57:47.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.423+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=KXLIZ24BHCR0 tag=JBPIKIHCLZGY type=write size=3841614 2024-09-14T10:57:47.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.427+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=0PKLZIHDA15R type=del size=1997197 2024-09-14T10:57:47.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.431+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~0YPJ8EOYL3MN.0 size=205093 2024-09-14T10:57:47.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.435+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=0YPJ8EOYL3MN tag=5V8BGLT1ZHNR type=write size=1253669 2024-09-14T10:57:47.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.439+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=7GYJ43BOAAHI type=del size=1707379 2024-09-14T10:57:47.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.443+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~I7WVQH3VTS2J.0 size=1048576 2024-09-14T10:57:47.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.443+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_82N2FPU7LKTG.2~I7WVQH3VTS2J.1 size=360815 2024-09-14T10:57:47.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.451+0000 7fdf8f02c8c0 1 < canceled multipart upload key=82N2FPU7LKTG upload=I7WVQH3VTS2J tag=I4D1ZLSE611X type=write size=2457967 2024-09-14T10:57:47.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.455+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=S8FEZJ0N35JN type=write size=474499 2024-09-14T10:57:47.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~VDK8M3K00T4I.0 size=1048576 2024-09-14T10:57:47.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.459+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~VDK8M3K00T4I.1 size=344710 2024-09-14T10:57:47.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.467+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=VDK8M3K00T4I tag=KCLUR4OINQ80 type=write size=2441862 2024-09-14T10:57:47.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.471+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=BCIY7ABQNBV0 type=del size=4163376 2024-09-14T10:57:47.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.471+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=USZ5O8LKBSD6 type=del 2024-09-14T10:57:47.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.475+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=1Q76VJJSQ3RG type=write size=492418 2024-09-14T10:57:47.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.479+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=1LOEEYLBA6AY type=del 2024-09-14T10:57:47.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.483+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=T68QQ7CHFM1P type=write size=201220 2024-09-14T10:57:47.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.487+0000 7fdf8f02c8c0 1 < completed write operation key=STB3W5URFJEZ tag=TTERZOT1O00L type=write size=139302 2024-09-14T10:57:47.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.491+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=V7JIN2PK25J6 type=del size=1404308 2024-09-14T10:57:47.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.495+0000 7fdf8f02c8c0 1 < suggested remove operation key=82N2FPU7LKTG tag=D0KDCCG6SB43 type=del 2024-09-14T10:57:47.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.499+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=TUGZPL285XYJ type=del size=3834808 2024-09-14T10:57:47.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.503+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=76DGHC4OH6CU type=del 2024-09-14T10:57:47.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.511+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~KE8RLKHZ2601.0 size=1048576 2024-09-14T10:57:47.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~KE8RLKHZ2601.1 size=1048576 2024-09-14T10:57:47.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~KE8RLKHZ2601.2 size=93665 2024-09-14T10:57:47.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.515+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=KE8RLKHZ2601 tag=SUPLBYXMRDRG type=write size=3239393 2024-09-14T10:57:47.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.519+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~D1URMTHDS46A.0 size=953311 2024-09-14T10:57:47.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.527+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=D1URMTHDS46A tag=GUA2WR7I8P7M type=write size=2001887 2024-09-14T10:57:47.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.531+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~IEEKK392KXMP.0 size=1048576 2024-09-14T10:57:47.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.535+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~IEEKK392KXMP.1 size=729008 2024-09-14T10:57:47.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.535+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=IEEKK392KXMP tag=ORHPDDB2ZDJ0 type=write size=2826160 2024-09-14T10:57:47.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.539+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=EYSH4PDIPQD2 type=del 2024-09-14T10:57:47.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.543+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=30RRJ2KIW73P type=del size=1879837 2024-09-14T10:57:47.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.547+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=Q6MKSMXFOX2W type=del 2024-09-14T10:57:47.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.551+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~NV4A2TIKPHBT.0 size=1048576 2024-09-14T10:57:47.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.555+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~NV4A2TIKPHBT.1 size=1048576 2024-09-14T10:57:47.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.559+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~NV4A2TIKPHBT.2 size=40588 2024-09-14T10:57:47.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.559+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=NV4A2TIKPHBT tag=OU8ZLXPIAYGR type=write size=3186316 2024-09-14T10:57:47.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.563+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~WM10JVG1T2G5.0 size=1048576 2024-09-14T10:57:47.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.563+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~WM10JVG1T2G5.1 size=1048576 2024-09-14T10:57:47.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.567+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~WM10JVG1T2G5.2 size=637251 2024-09-14T10:57:47.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.571+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=WM10JVG1T2G5 tag=ZUFE22NPLX6U type=write size=3782979 2024-09-14T10:57:47.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.575+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=N2Y7HY5OU6BC type=del size=2690413 2024-09-14T10:57:47.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.579+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~IMEOUG6KT9TX.0 size=1048576 2024-09-14T10:57:47.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.583+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~IMEOUG6KT9TX.1 size=1048576 2024-09-14T10:57:47.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.587+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~IMEOUG6KT9TX.2 size=540316 2024-09-14T10:57:47.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.591+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=IMEOUG6KT9TX tag=QSWP0SO7M2J4 type=write size=3686044 2024-09-14T10:57:47.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.599+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~N0F9UZT1ELI5.0 size=594880 2024-09-14T10:57:47.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.599+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=N0F9UZT1ELI5 tag=97524UNDGEW8 type=write size=1643456 2024-09-14T10:57:47.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.603+0000 7fdf8f02c8c0 -1 < failed to complete operation key=82N2FPU7LKTG tag=ZW5AO1CJ48CP type=write size=992668: (22) Invalid argument 2024-09-14T10:57:47.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.607+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=KIX3V81NN8TW type=write size=273666 2024-09-14T10:57:47.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.611+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~5V0OQJSQPAUG.0 size=1048576 2024-09-14T10:57:47.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.615+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~5V0OQJSQPAUG.1 size=1048576 2024-09-14T10:57:47.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.619+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~5V0OQJSQPAUG.2 size=742107 2024-09-14T10:57:47.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.631+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=5V0OQJSQPAUG tag=C78TEYUBBR7O type=write size=3887835 2024-09-14T10:57:47.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.635+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=EPNLU8YC7QBT type=del size=1446720 2024-09-14T10:57:47.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.639+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=0PKLZIHDA15R type=del 2024-09-14T10:57:47.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.639+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=773EGYRHU6NA type=del size=3198785 2024-09-14T10:57:47.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.643+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=7GYJ43BOAAHI type=del 2024-09-14T10:57:47.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~434TN4LGSZKO.0 size=1048576 2024-09-14T10:57:47.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~434TN4LGSZKO.1 size=1048576 2024-09-14T10:57:47.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~434TN4LGSZKO.2 size=824032 2024-09-14T10:57:47.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.655+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=434TN4LGSZKO tag=26JGQAZFTJCD type=write size=3969760 2024-09-14T10:57:47.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.663+0000 7fdf8f02c8c0 1 < suggested update operation key=MNBXQTJBS1QS tag=S8FEZJ0N35JN type=write size=474499 2024-09-14T10:57:47.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~7FGM3X7L6XW7.0 size=1048576 2024-09-14T10:57:47.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~7FGM3X7L6XW7.1 size=1048576 2024-09-14T10:57:47.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.675+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~7FGM3X7L6XW7.2 size=449082 2024-09-14T10:57:47.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.675+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=7FGM3X7L6XW7 tag=ZQGOLKQTILYC type=write size=3594810 2024-09-14T10:57:47.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.679+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=BCIY7ABQNBV0 type=del 2024-09-14T10:57:47.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~QXVBN2MB87QK.0 size=662950 2024-09-14T10:57:47.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.683+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=QXVBN2MB87QK tag=1RPG2I7TL29U type=write size=1711526 2024-09-14T10:57:47.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.687+0000 7fdf8f02c8c0 1 < completed write operation key=K3KJ7HDQF6ZH tag=1Q76VJJSQ3RG type=write size=492418 2024-09-14T10:57:47.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.695+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~JEG1US8F0CI8.0 size=1048576 2024-09-14T10:57:47.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.695+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~JEG1US8F0CI8.1 size=1048576 2024-09-14T10:57:47.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.699+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~JEG1US8F0CI8.2 size=825732 2024-09-14T10:57:47.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.699+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=JEG1US8F0CI8 tag=Q0IHYYPOZVIV type=write size=3971460 2024-09-14T10:57:47.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.703+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=T68QQ7CHFM1P type=write size=201220 2024-09-14T10:57:47.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.707+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=E24QQSEPO2DM type=del size=3847842 2024-09-14T10:57:47.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.711+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=V7JIN2PK25J6 type=del 2024-09-14T10:57:47.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.715+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=WB3LO1GXAVRU type=del size=2643218 2024-09-14T10:57:47.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.719+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=TUGZPL285XYJ type=del 2024-09-14T10:57:47.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.727+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~NMR86W8PVTMK.0 size=17236 2024-09-14T10:57:47.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.727+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=NMR86W8PVTMK tag=ZYT3XEPEXK16 type=write size=1065812 2024-09-14T10:57:47.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.731+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~KE8RLKHZ2601.0 size=1048576 2024-09-14T10:57:47.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.731+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~KE8RLKHZ2601.1 size=1048576 2024-09-14T10:57:47.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.735+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~KE8RLKHZ2601.2 size=93665 2024-09-14T10:57:47.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.743+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=KE8RLKHZ2601 tag=SUPLBYXMRDRG type=write size=3239393 2024-09-14T10:57:47.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.743+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=C8R03Z37ZQTO type=del size=598515 2024-09-14T10:57:47.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.747+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~IEEKK392KXMP.0 size=1048576 2024-09-14T10:57:47.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.751+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~IEEKK392KXMP.1 size=729008 2024-09-14T10:57:47.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.759+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=IEEKK392KXMP tag=ORHPDDB2ZDJ0 type=write size=2826160 2024-09-14T10:57:47.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.763+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=9UMH84T4R4VW type=del size=2166050 2024-09-14T10:57:47.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.767+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=30RRJ2KIW73P type=del 2024-09-14T10:57:47.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.771+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~9NFE28XXY0KB.0 size=648808 2024-09-14T10:57:47.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.771+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=9NFE28XXY0KB tag=L1507ADGIQ13 type=write size=1697384 2024-09-14T10:57:47.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.775+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~NV4A2TIKPHBT.0 size=1048576 2024-09-14T10:57:47.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.779+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~NV4A2TIKPHBT.1 size=1048576 2024-09-14T10:57:47.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.783+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~NV4A2TIKPHBT.2 size=40588 2024-09-14T10:57:47.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.787+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=NV4A2TIKPHBT tag=OU8ZLXPIAYGR type=write size=3186316 2024-09-14T10:57:47.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.791+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=UU7NVXP1KEOB type=write size=143096 2024-09-14T10:57:47.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.799+0000 7fdf8f02c8c0 1 < suggested remove operation key=6VNI8FMHZ0FN tag=N2Y7HY5OU6BC type=del 2024-09-14T10:57:47.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.803+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=P0VKVZ71JO24 type=del size=154692 2024-09-14T10:57:47.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.807+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~N0F9UZT1ELI5.0 size=594880 2024-09-14T10:57:47.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.815+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=N0F9UZT1ELI5 tag=97524UNDGEW8 type=write size=1643456 2024-09-14T10:57:47.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.823+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~MPHKF3KKAHLR.0 size=1048576 2024-09-14T10:57:47.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.827+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~MPHKF3KKAHLR.1 size=1048576 2024-09-14T10:57:47.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.827+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~MPHKF3KKAHLR.2 size=56036 2024-09-14T10:57:47.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.827+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=MPHKF3KKAHLR tag=YHQTP8Y7ZQXC type=write size=3201764 2024-09-14T10:57:47.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.831+0000 7fdf8f02c8c0 1 < completed write operation key=ZSBCGOXXJ0D5 tag=KIX3V81NN8TW type=write size=273666 2024-09-14T10:57:47.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.839+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~ACK71242Y77N.0 size=571548 2024-09-14T10:57:47.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.839+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=ACK71242Y77N tag=GD21EO0RQK17 type=write size=1620124 2024-09-14T10:57:47.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.843+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=EPNLU8YC7QBT type=del 2024-09-14T10:57:47.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.847+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=RZC7K33DCSDC type=del size=800403 2024-09-14T10:57:47.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.851+0000 7fdf8f02c8c0 1 < canceled operation key=1E72V12EPEH3 tag=773EGYRHU6NA type=del size=3198785 2024-09-14T10:57:47.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.855+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=0ALMSWBWEG1V type=del size=2363331 2024-09-14T10:57:47.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.859+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~434TN4LGSZKO.0 size=1048576 2024-09-14T10:57:47.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.863+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~434TN4LGSZKO.1 size=1048576 2024-09-14T10:57:47.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.863+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_TZZ05IIMZJ4J.2~434TN4LGSZKO.2 size=824032 2024-09-14T10:57:47.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.871+0000 7fdf8f02c8c0 1 < canceled multipart upload key=TZZ05IIMZJ4J upload=434TN4LGSZKO tag=26JGQAZFTJCD type=write size=3969760 2024-09-14T10:57:47.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.875+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=SD9LFN1C0ZPZ type=del size=2803450 2024-09-14T10:57:47.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.879+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~7FGM3X7L6XW7.0 size=1048576 2024-09-14T10:57:47.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.883+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~7FGM3X7L6XW7.1 size=1048576 2024-09-14T10:57:47.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.887+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~7FGM3X7L6XW7.2 size=449082 2024-09-14T10:57:47.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.895+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=7FGM3X7L6XW7 tag=ZQGOLKQTILYC type=write size=3594810 2024-09-14T10:57:47.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.899+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=SFZT33USIMCR type=del size=3472274 2024-09-14T10:57:47.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~QXVBN2MB87QK.0 size=662950 2024-09-14T10:57:47.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.911+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=QXVBN2MB87QK tag=1RPG2I7TL29U type=write size=1711526 2024-09-14T10:57:47.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.915+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=7Q36KGB7YUSZ type=del size=1278552 2024-09-14T10:57:47.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.919+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~JEG1US8F0CI8.0 size=1048576 2024-09-14T10:57:47.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.923+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~JEG1US8F0CI8.1 size=1048576 2024-09-14T10:57:47.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.927+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~JEG1US8F0CI8.2 size=825732 2024-09-14T10:57:47.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.931+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=JEG1US8F0CI8 tag=Q0IHYYPOZVIV type=write size=3971460 2024-09-14T10:57:47.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.935+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=QUQZCYEEV3QT type=del size=2709173 2024-09-14T10:57:47.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.939+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=E24QQSEPO2DM type=del 2024-09-14T10:57:47.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.943+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=55VZZJXWRXEO type=del size=3076497 2024-09-14T10:57:47.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.947+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=WB3LO1GXAVRU type=del 2024-09-14T10:57:47.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.955+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~CBAMI0ZMRX0L.0 size=653736 2024-09-14T10:57:47.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.955+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=CBAMI0ZMRX0L tag=5X6ZNUP23E5A type=write size=1702312 2024-09-14T10:57:47.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.955+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_ZF6IDD8B3CFO.2~NMR86W8PVTMK.0 size=17236 2024-09-14T10:57:47.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.963+0000 7fdf8f02c8c0 1 < canceled multipart upload key=ZF6IDD8B3CFO upload=NMR86W8PVTMK tag=ZYT3XEPEXK16 type=write size=1065812 2024-09-14T10:57:47.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.963+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=TJRW4A8PZCJO type=write size=103449 2024-09-14T10:57:47.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.967+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=C8R03Z37ZQTO type=del 2024-09-14T10:57:47.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.971+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=DSHHHFX1A43E type=del size=3083762 2024-09-14T10:57:47.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.975+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=9UMH84T4R4VW type=del 2024-09-14T10:57:47.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.979+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=W7GK9CY61L1D type=write size=878241 2024-09-14T10:57:47.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~9NFE28XXY0KB.0 size=648808 2024-09-14T10:57:47.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.995+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=9NFE28XXY0KB tag=L1507ADGIQ13 type=write size=1697384 2024-09-14T10:57:47.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:47.999+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=VPMXVO1KIF3C type=write size=112649 2024-09-14T10:57:47.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.003+0000 7fdf8f02c8c0 1 < completed write operation key=L1ERJ0JSRDMG tag=UU7NVXP1KEOB type=write size=143096 2024-09-14T10:57:48.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~WWYVEYRHWULM.0 size=1048576 2024-09-14T10:57:48.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.011+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~WWYVEYRHWULM.1 size=4780 2024-09-14T10:57:48.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.011+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=WWYVEYRHWULM tag=FJHSIRYDILEU type=write size=2101932 2024-09-14T10:57:48.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.019+0000 7fdf8f02c8c0 1 < suggested remove operation key=82N2FPU7LKTG tag=P0VKVZ71JO24 type=del 2024-09-14T10:57:48.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.023+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=ZR9OWW7OB99G type=write size=405968 2024-09-14T10:57:48.024 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.027+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~MPHKF3KKAHLR.0 size=1048576 2024-09-14T10:57:48.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.031+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~MPHKF3KKAHLR.1 size=1048576 2024-09-14T10:57:48.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.035+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~MPHKF3KKAHLR.2 size=56036 2024-09-14T10:57:48.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.039+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=MPHKF3KKAHLR tag=YHQTP8Y7ZQXC type=write size=3201764 2024-09-14T10:57:48.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.043+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=FSEQ28ROTKSO type=del size=3413580 2024-09-14T10:57:48.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.047+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~ACK71242Y77N.0 size=571548 2024-09-14T10:57:48.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.055+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=ACK71242Y77N tag=GD21EO0RQK17 type=write size=1620124 2024-09-14T10:57:48.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~EENU6FVY0MXJ.0 size=1048576 2024-09-14T10:57:48.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~EENU6FVY0MXJ.1 size=759584 2024-09-14T10:57:48.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.063+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=EENU6FVY0MXJ tag=HQW7VQPMFPHA type=write size=2856736 2024-09-14T10:57:48.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.067+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=RZC7K33DCSDC type=del 2024-09-14T10:57:48.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.071+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=9LSBOVSUOWU5 type=write size=459838 2024-09-14T10:57:48.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.075+0000 7fdf8f02c8c0 1 < canceled operation key=L1ERJ0JSRDMG tag=0ALMSWBWEG1V type=del size=2363331 2024-09-14T10:57:48.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~WELBMWCXNIRG.0 size=1048576 2024-09-14T10:57:48.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~WELBMWCXNIRG.1 size=729283 2024-09-14T10:57:48.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.083+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=WELBMWCXNIRG tag=YTEB768AWHC4 type=write size=2826435 2024-09-14T10:57:48.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.087+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=SD9LFN1C0ZPZ type=del 2024-09-14T10:57:48.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.095+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~OU7UB5SO6P3S.0 size=1907 2024-09-14T10:57:48.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.095+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=OU7UB5SO6P3S tag=B1FXQ2ID5LZZ type=write size=1050483 2024-09-14T10:57:48.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.103+0000 7fdf8f02c8c0 1 < suggested update operation key=MNBXQTJBS1QS tag=SFZT33USIMCR type=del size=3472274 2024-09-14T10:57:48.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.107+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=386LV80D1K9C type=del size=919448 2024-09-14T10:57:48.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.115+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=7Q36KGB7YUSZ type=del size=1278552 2024-09-14T10:57:48.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~X3EXDF9OAIHC.0 size=170532 2024-09-14T10:57:48.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.123+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=X3EXDF9OAIHC tag=NP7EGO0D78NU type=write size=1219108 2024-09-14T10:57:48.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.127+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=QUQZCYEEV3QT type=del 2024-09-14T10:57:48.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.131+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~CE3WM7OB420M.0 size=442705 2024-09-14T10:57:48.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.131+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=CE3WM7OB420M tag=PHD1MHSNL6HA type=write size=1491281 2024-09-14T10:57:48.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.139+0000 7fdf8f02c8c0 1 < canceled operation key=L1ERJ0JSRDMG tag=55VZZJXWRXEO type=del size=3076497 2024-09-14T10:57:48.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.143+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=FOZID0DA136M type=del size=2867359 2024-09-14T10:57:48.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.147+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~CBAMI0ZMRX0L.0 size=653736 2024-09-14T10:57:48.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.151+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=CBAMI0ZMRX0L tag=5X6ZNUP23E5A type=write size=1702312 2024-09-14T10:57:48.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.155+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=LEP1AO2BXE81 type=del size=298879 2024-09-14T10:57:48.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.163+0000 7fdf8f02c8c0 1 < suggested remove operation key=X1BN3054IKNS tag=TJRW4A8PZCJO type=write 2024-09-14T10:57:48.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.167+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=SJRCBNLX1JJS type=del size=471686 2024-09-14T10:57:48.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.175+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=DSHHHFX1A43E type=del 2024-09-14T10:57:48.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.179+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=ZXMCP0DRZI5R type=del size=477019 2024-09-14T10:57:48.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.183+0000 7fdf8f02c8c0 -1 < failed to complete operation key=MNBXQTJBS1QS tag=W7GK9CY61L1D type=write size=878241: (22) Invalid argument 2024-09-14T10:57:48.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.187+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=CLZN18W6RD43 type=del size=609517 2024-09-14T10:57:48.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.191+0000 7fdf8f02c8c0 1 < completed write operation key=0QJLAH0EPKVD tag=VPMXVO1KIF3C type=write size=112649 2024-09-14T10:57:48.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.195+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=729H4QAKX4O4 type=del size=2440076 2024-09-14T10:57:48.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.195+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~WWYVEYRHWULM.0 size=1048576 2024-09-14T10:57:48.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.199+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~WWYVEYRHWULM.1 size=4780 2024-09-14T10:57:48.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.207+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=WWYVEYRHWULM tag=FJHSIRYDILEU type=write size=2101932 2024-09-14T10:57:48.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.211+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=MA8IYANX5CZL type=del size=3243467 2024-09-14T10:57:48.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.215+0000 7fdf8f02c8c0 1 < completed write operation key=ZF6IDD8B3CFO tag=ZR9OWW7OB99G type=write size=405968 2024-09-14T10:57:48.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.219+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=CT1KOHVWZ422 type=del size=3215890 2024-09-14T10:57:48.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.223+0000 7fdf8f02c8c0 1 < suggested remove operation key=X0RT8UF3D0JC tag=FSEQ28ROTKSO type=del 2024-09-14T10:57:48.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.227+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=9KIC0T4RMHS8 type=del size=3957509 2024-09-14T10:57:48.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.231+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~EENU6FVY0MXJ.0 size=1048576 2024-09-14T10:57:48.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.235+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~EENU6FVY0MXJ.1 size=759584 2024-09-14T10:57:48.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.243+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=EENU6FVY0MXJ tag=HQW7VQPMFPHA type=write size=2856736 2024-09-14T10:57:48.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.247+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=C2ZVXDJVP4D6 type=del size=2618857 2024-09-14T10:57:48.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.251+0000 7fdf8f02c8c0 -1 < failed to complete operation key=X1BN3054IKNS tag=9LSBOVSUOWU5 type=write size=459838: (22) Invalid argument 2024-09-14T10:57:48.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.255+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~MAR6BS95PW6S.0 size=323093 2024-09-14T10:57:48.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.255+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=MAR6BS95PW6S tag=XR2U7K863GTN type=write size=1371669 2024-09-14T10:57:48.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.259+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~WELBMWCXNIRG.0 size=1048576 2024-09-14T10:57:48.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.263+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~WELBMWCXNIRG.1 size=729283 2024-09-14T10:57:48.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.267+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=WELBMWCXNIRG tag=YTEB768AWHC4 type=write size=2826435 2024-09-14T10:57:48.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.275+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~8PA6LWFXAJ1P.0 size=1048576 2024-09-14T10:57:48.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.279+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~8PA6LWFXAJ1P.1 size=1048576 2024-09-14T10:57:48.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.283+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~8PA6LWFXAJ1P.2 size=705789 2024-09-14T10:57:48.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.283+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=8PA6LWFXAJ1P tag=25TLHUA1HKLK type=write size=3851517 2024-09-14T10:57:48.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.287+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~OU7UB5SO6P3S.0 size=1907 2024-09-14T10:57:48.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.291+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=OU7UB5SO6P3S tag=B1FXQ2ID5LZZ type=write size=1050483 2024-09-14T10:57:48.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.295+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=8GX9SFPH4NR8 type=del size=1187327 2024-09-14T10:57:48.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.299+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=386LV80D1K9C type=del 2024-09-14T10:57:48.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.303+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=3HLRFOWCSIPP type=write size=922677 2024-09-14T10:57:48.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.303+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_ZSBCGOXXJ0D5.2~X3EXDF9OAIHC.0 size=170532 2024-09-14T10:57:48.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.311+0000 7fdf8f02c8c0 1 < canceled multipart upload key=ZSBCGOXXJ0D5 upload=X3EXDF9OAIHC tag=NP7EGO0D78NU type=write size=1219108 2024-09-14T10:57:48.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.315+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=82UKKGSVA8LJ type=del size=2874941 2024-09-14T10:57:48.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.319+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~CE3WM7OB420M.0 size=442705 2024-09-14T10:57:48.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.323+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=CE3WM7OB420M tag=PHD1MHSNL6HA type=write size=1491281 2024-09-14T10:57:48.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.331+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~WQ3T6W79YOZ5.0 size=1048576 2024-09-14T10:57:48.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.331+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~WQ3T6W79YOZ5.1 size=308160 2024-09-14T10:57:48.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.331+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=WQ3T6W79YOZ5 tag=X9BSWH1JDHC2 type=write size=2405312 2024-09-14T10:57:48.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.335+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=FOZID0DA136M type=del 2024-09-14T10:57:48.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.339+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=HVQFRPPUMND0 type=write size=988241 2024-09-14T10:57:48.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.355+0000 7fdf8f02c8c0 1 < suggested remove operation key=6VNI8FMHZ0FN tag=LEP1AO2BXE81 type=del 2024-09-14T10:57:48.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.355+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=8JA5YAP19V8B type=del size=3741928 2024-09-14T10:57:48.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.359+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=SJRCBNLX1JJS type=del 2024-09-14T10:57:48.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.367+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=ZDWL1YMBI1HB type=write size=223064 2024-09-14T10:57:48.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.371+0000 7fdf8f02c8c0 1 < canceled operation key=LCEH2YXNSOGT tag=ZXMCP0DRZI5R type=del size=477019 2024-09-14T10:57:48.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.375+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=V4RGI8B07KOJ type=del size=1494930 2024-09-14T10:57:48.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.379+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=CLZN18W6RD43 type=del 2024-09-14T10:57:48.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.383+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=DI7QP1GESFAA type=del size=1626432 2024-09-14T10:57:48.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.387+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=729H4QAKX4O4 type=del 2024-09-14T10:57:48.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.395+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~VZ28PTJ6340M.0 size=481568 2024-09-14T10:57:48.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.395+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=VZ28PTJ6340M tag=CSMR0G4Z7V7X type=write size=1530144 2024-09-14T10:57:48.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.399+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=MA8IYANX5CZL type=del 2024-09-14T10:57:48.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~M1CAGYUP219M.0 size=1048576 2024-09-14T10:57:48.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~M1CAGYUP219M.1 size=1048576 2024-09-14T10:57:48.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~M1CAGYUP219M.2 size=857376 2024-09-14T10:57:48.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.411+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=M1CAGYUP219M tag=VJLNJ3MJVYH5 type=write size=4003104 2024-09-14T10:57:48.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.415+0000 7fdf8f02c8c0 -1 < failed to complete operation key=X0RT8UF3D0JC tag=CT1KOHVWZ422 type=del size=3215890: (22) Invalid argument 2024-09-14T10:57:48.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.419+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=3QKHK23OKGY1 type=del size=3704416 2024-09-14T10:57:48.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.423+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=9KIC0T4RMHS8 type=del 2024-09-14T10:57:48.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.427+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=9RR2141HZ0U0 type=del size=3470576 2024-09-14T10:57:48.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.431+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=C2ZVXDJVP4D6 type=del 2024-09-14T10:57:48.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.435+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=B4QP1ZZ0TW4Y type=del size=689762 2024-09-14T10:57:48.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.439+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~MAR6BS95PW6S.0 size=323093 2024-09-14T10:57:48.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.443+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=MAR6BS95PW6S tag=XR2U7K863GTN type=write size=1371669 2024-09-14T10:57:48.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.447+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=T3L5J8LPCMNN type=write size=791437 2024-09-14T10:57:48.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.451+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~8PA6LWFXAJ1P.0 size=1048576 2024-09-14T10:57:48.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~8PA6LWFXAJ1P.1 size=1048576 2024-09-14T10:57:48.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.455+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~8PA6LWFXAJ1P.2 size=705789 2024-09-14T10:57:48.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.463+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=8PA6LWFXAJ1P tag=25TLHUA1HKLK type=write size=3851517 2024-09-14T10:57:48.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.467+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=3REOZW4S65NO type=del size=2630091 2024-09-14T10:57:48.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.471+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=8GX9SFPH4NR8 type=del 2024-09-14T10:57:48.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.475+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=HE109QQD99FV type=del size=2542431 2024-09-14T10:57:48.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.479+0000 7fdf8f02c8c0 1 < completed write operation key=X1BN3054IKNS tag=3HLRFOWCSIPP type=write size=922677 2024-09-14T10:57:48.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.483+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=G1AO3WA5BB5X type=write size=285996 2024-09-14T10:57:48.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.487+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=82UKKGSVA8LJ type=del 2024-09-14T10:57:48.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.495+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~0WORH3RDP8Q0.0 size=371887 2024-09-14T10:57:48.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.495+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=0WORH3RDP8Q0 tag=TNCKFAT51EK3 type=write size=1420463 2024-09-14T10:57:48.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~WQ3T6W79YOZ5.0 size=1048576 2024-09-14T10:57:48.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~WQ3T6W79YOZ5.1 size=308160 2024-09-14T10:57:48.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.507+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=WQ3T6W79YOZ5 tag=X9BSWH1JDHC2 type=write size=2405312 2024-09-14T10:57:48.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.511+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=8G20AU6R0C6G type=del size=1124006 2024-09-14T10:57:48.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.519+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZSBCGOXXJ0D5 tag=HVQFRPPUMND0 type=write 2024-09-14T10:57:48.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.523+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=PXR3I3YCMY66 type=del size=3592391 2024-09-14T10:57:48.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.527+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=8JA5YAP19V8B type=del 2024-09-14T10:57:48.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.531+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~546ZJA208PL6.0 size=1048576 2024-09-14T10:57:48.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.535+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~546ZJA208PL6.1 size=1048576 2024-09-14T10:57:48.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.539+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~546ZJA208PL6.2 size=1035208 2024-09-14T10:57:48.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.539+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=546ZJA208PL6 tag=KSNI35DOZRQS type=write size=4180936 2024-09-14T10:57:48.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.543+0000 7fdf8f02c8c0 1 < completed write operation key=X0RT8UF3D0JC tag=ZDWL1YMBI1HB type=write size=223064 2024-09-14T10:57:48.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.547+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=7CHOQTTG79A3 type=write size=601015 2024-09-14T10:57:48.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.551+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=V4RGI8B07KOJ type=del 2024-09-14T10:57:48.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.555+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~ZRYFO0J3C9RL.0 size=432622 2024-09-14T10:57:48.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.555+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=ZRYFO0J3C9RL tag=JNTCL3ZWY3V3 type=write size=1481198 2024-09-14T10:57:48.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.559+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=DI7QP1GESFAA type=del 2024-09-14T10:57:48.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.563+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=UWK0JQVQO0YJ type=del size=402243 2024-09-14T10:57:48.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.567+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~VZ28PTJ6340M.0 size=481568 2024-09-14T10:57:48.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.575+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=VZ28PTJ6340M tag=CSMR0G4Z7V7X type=write size=1530144 2024-09-14T10:57:48.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.579+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=8SROGNKRZQMN type=del size=2783162 2024-09-14T10:57:48.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.583+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~M1CAGYUP219M.0 size=1048576 2024-09-14T10:57:48.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.587+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~M1CAGYUP219M.1 size=1048576 2024-09-14T10:57:48.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.587+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~M1CAGYUP219M.2 size=857376 2024-09-14T10:57:48.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.595+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=M1CAGYUP219M tag=VJLNJ3MJVYH5 type=write size=4003104 2024-09-14T10:57:48.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.603+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~341U3R2ZSC6T.0 size=1048576 2024-09-14T10:57:48.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.603+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~341U3R2ZSC6T.1 size=1048576 2024-09-14T10:57:48.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~341U3R2ZSC6T.2 size=445541 2024-09-14T10:57:48.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.607+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=341U3R2ZSC6T tag=V3INJ2M1NSQC type=write size=3591269 2024-09-14T10:57:48.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.611+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=3QKHK23OKGY1 type=del 2024-09-14T10:57:48.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.615+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=EFB5BZVQODUT type=write size=923594 2024-09-14T10:57:48.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.619+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=9RR2141HZ0U0 type=del 2024-09-14T10:57:48.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.627+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~XZUZAQOFRMOE.0 size=1048576 2024-09-14T10:57:48.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.631+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~XZUZAQOFRMOE.1 size=1048576 2024-09-14T10:57:48.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.631+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~XZUZAQOFRMOE.2 size=495387 2024-09-14T10:57:48.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.631+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=XZUZAQOFRMOE tag=AKXEH36FSVFU type=write size=3641115 2024-09-14T10:57:48.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.635+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=B4QP1ZZ0TW4Y type=del 2024-09-14T10:57:48.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.643+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=4CZ5ZQ8X2IQX type=del size=2692240 2024-09-14T10:57:48.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.643+0000 7fdf8f02c8c0 1 < canceled operation key=LFLY0V3FRRW5 tag=T3L5J8LPCMNN type=write size=791437 2024-09-14T10:57:48.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.647+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=OVJOLSXMCWW3 type=del size=2995373 2024-09-14T10:57:48.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.651+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=3REOZW4S65NO type=del 2024-09-14T10:57:48.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.655+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=H6Z7XMRQ7GOU type=del size=3324876 2024-09-14T10:57:48.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.659+0000 7fdf8f02c8c0 1 < canceled operation key=XUT55FR490EO tag=HE109QQD99FV type=del size=2542431 2024-09-14T10:57:48.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~JDZT6RBJNZUO.0 size=1048576 2024-09-14T10:57:48.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~JDZT6RBJNZUO.1 size=357304 2024-09-14T10:57:48.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.671+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=JDZT6RBJNZUO tag=7ZG4UAD5PFGS type=write size=2454456 2024-09-14T10:57:48.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.675+0000 7fdf8f02c8c0 1 < canceled operation key=LCEH2YXNSOGT tag=G1AO3WA5BB5X type=write size=285996 2024-09-14T10:57:48.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~13XN8B4XG730.0 size=1048576 2024-09-14T10:57:48.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~13XN8B4XG730.1 size=981210 2024-09-14T10:57:48.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.683+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=13XN8B4XG730 tag=YQNQ6L53EJGS type=write size=3078362 2024-09-14T10:57:48.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.691+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~0WORH3RDP8Q0.0 size=371887 2024-09-14T10:57:48.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.695+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=0WORH3RDP8Q0 tag=TNCKFAT51EK3 type=write size=1420463 2024-09-14T10:57:48.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.703+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~9MRJIBO7JYUB.0 size=1048576 2024-09-14T10:57:48.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~9MRJIBO7JYUB.1 size=288875 2024-09-14T10:57:48.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.707+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=9MRJIBO7JYUB tag=F3SWMQIXZTC2 type=write size=2386027 2024-09-14T10:57:48.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.715+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=8G20AU6R0C6G type=del 2024-09-14T10:57:48.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.719+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=BG1GKA48EOB4 type=del size=745719 2024-09-14T10:57:48.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.723+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=PXR3I3YCMY66 type=del 2024-09-14T10:57:48.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.727+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~OHEUFB1T4UQA.0 size=1048576 2024-09-14T10:57:48.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.731+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~OHEUFB1T4UQA.1 size=1048576 2024-09-14T10:57:48.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.735+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~OHEUFB1T4UQA.2 size=270545 2024-09-14T10:57:48.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.735+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=OHEUFB1T4UQA tag=M3QROI72SS3G type=write size=3416273 2024-09-14T10:57:48.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.739+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~546ZJA208PL6.0 size=1048576 2024-09-14T10:57:48.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.739+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~546ZJA208PL6.1 size=1048576 2024-09-14T10:57:48.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.743+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~546ZJA208PL6.2 size=1035208 2024-09-14T10:57:48.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.751+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=546ZJA208PL6 tag=KSNI35DOZRQS type=write size=4180936 2024-09-14T10:57:48.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.755+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=CD1SQN6ME6F3 type=del size=902205 2024-09-14T10:57:48.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.759+0000 7fdf8f02c8c0 1 < suggested update operation key=TZZ05IIMZJ4J tag=7CHOQTTG79A3 type=write size=601015 2024-09-14T10:57:48.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.767+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~3BJ40R8XWC81.0 size=375758 2024-09-14T10:57:48.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.767+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=3BJ40R8XWC81 tag=S8FRZLJNCXY8 type=write size=1424334 2024-09-14T10:57:48.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.771+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~ZRYFO0J3C9RL.0 size=432622 2024-09-14T10:57:48.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.775+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=ZRYFO0J3C9RL tag=JNTCL3ZWY3V3 type=write size=1481198 2024-09-14T10:57:48.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.779+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=IXH3EP2HK0QS type=write size=313604 2024-09-14T10:57:48.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.787+0000 7fdf8f02c8c0 1 < suggested update operation key=49O8DPTGA65S tag=UWK0JQVQO0YJ type=del size=402243 2024-09-14T10:57:48.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~OR5C1N4JZW99.0 size=1048576 2024-09-14T10:57:48.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.799+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~OR5C1N4JZW99.1 size=998613 2024-09-14T10:57:48.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.799+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=OR5C1N4JZW99 tag=ON3FV3WJHEMR type=write size=3095765 2024-09-14T10:57:48.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.803+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=8SROGNKRZQMN type=del 2024-09-14T10:57:48.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.807+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=5WHVQJK37RC7 type=del size=1181999 2024-09-14T10:57:48.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.807+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~341U3R2ZSC6T.0 size=1048576 2024-09-14T10:57:48.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.811+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~341U3R2ZSC6T.1 size=1048576 2024-09-14T10:57:48.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~341U3R2ZSC6T.2 size=445541 2024-09-14T10:57:48.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.823+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=341U3R2ZSC6T tag=V3INJ2M1NSQC type=write size=3591269 2024-09-14T10:57:48.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.827+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~PQ33A80NJY47.0 size=1048576 2024-09-14T10:57:48.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~PQ33A80NJY47.1 size=633223 2024-09-14T10:57:48.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.831+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=PQ33A80NJY47 tag=08JSGMGIPII9 type=write size=2730375 2024-09-14T10:57:48.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.835+0000 7fdf8f02c8c0 1 < completed write operation key=XUT55FR490EO tag=EFB5BZVQODUT type=write size=923594 2024-09-14T10:57:48.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.839+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=XYPGW12J7MBK type=del size=3345207 2024-09-14T10:57:48.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.843+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~XZUZAQOFRMOE.0 size=1048576 2024-09-14T10:57:48.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.843+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~XZUZAQOFRMOE.1 size=1048576 2024-09-14T10:57:48.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.847+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~XZUZAQOFRMOE.2 size=495387 2024-09-14T10:57:48.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.855+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=XZUZAQOFRMOE tag=AKXEH36FSVFU type=write size=3641115 2024-09-14T10:57:48.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.859+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=QUKTRG2EFRYU type=del size=3052630 2024-09-14T10:57:48.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.863+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=4CZ5ZQ8X2IQX type=del 2024-09-14T10:57:48.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.867+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=GIDX4GJLZT9C type=del size=3148827 2024-09-14T10:57:48.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.871+0000 7fdf8f02c8c0 1 < canceled operation key=YU9DAJA242Q7 tag=OVJOLSXMCWW3 type=del size=2995373 2024-09-14T10:57:48.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.871+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=R4FMJ9NGPJA1 type=del size=403545 2024-09-14T10:57:48.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.875+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=H6Z7XMRQ7GOU type=del 2024-09-14T10:57:48.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.879+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=2DMTPSBYKYXC type=del size=3447404 2024-09-14T10:57:48.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.883+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~JDZT6RBJNZUO.0 size=1048576 2024-09-14T10:57:48.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.887+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~JDZT6RBJNZUO.1 size=357304 2024-09-14T10:57:48.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.895+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=JDZT6RBJNZUO tag=7ZG4UAD5PFGS type=write size=2454456 2024-09-14T10:57:48.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.899+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=0MYMFM1FFJBO type=write size=531130 2024-09-14T10:57:48.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~13XN8B4XG730.0 size=1048576 2024-09-14T10:57:48.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~13XN8B4XG730.1 size=981210 2024-09-14T10:57:48.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.911+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=13XN8B4XG730 tag=YQNQ6L53EJGS type=write size=3078362 2024-09-14T10:57:48.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.915+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=6FN9Y9L0QW9B type=del size=1463656 2024-09-14T10:57:48.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.919+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~9MRJIBO7JYUB.0 size=1048576 2024-09-14T10:57:48.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.923+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~9MRJIBO7JYUB.1 size=288875 2024-09-14T10:57:48.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.927+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=9MRJIBO7JYUB tag=F3SWMQIXZTC2 type=write size=2386027 2024-09-14T10:57:48.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.931+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=7U5CVSFZBO3V type=del size=1442340 2024-09-14T10:57:48.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.935+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=BG1GKA48EOB4 type=del 2024-09-14T10:57:48.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.939+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=D1GS4IOPAYLX type=del size=943740 2024-09-14T10:57:48.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.943+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~OHEUFB1T4UQA.0 size=1048576 2024-09-14T10:57:48.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.947+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~OHEUFB1T4UQA.1 size=1048576 2024-09-14T10:57:48.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.947+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~OHEUFB1T4UQA.2 size=270545 2024-09-14T10:57:48.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.955+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=OHEUFB1T4UQA tag=M3QROI72SS3G type=write size=3416273 2024-09-14T10:57:48.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.963+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~21APY7QZUM01.0 size=1048576 2024-09-14T10:57:48.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.963+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~21APY7QZUM01.1 size=1048576 2024-09-14T10:57:48.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.967+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~21APY7QZUM01.2 size=113664 2024-09-14T10:57:48.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.967+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=21APY7QZUM01 tag=HS5RDITNDCSR type=write size=3259392 2024-09-14T10:57:48.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.975+0000 7fdf8f02c8c0 1 < suggested remove operation key=5VZCCFRUAQJ7 tag=CD1SQN6ME6F3 type=del 2024-09-14T10:57:48.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.979+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~SEKOAGTK7VOV.0 size=1048576 2024-09-14T10:57:48.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.983+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~SEKOAGTK7VOV.1 size=1048576 2024-09-14T10:57:48.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.987+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~SEKOAGTK7VOV.2 size=375167 2024-09-14T10:57:48.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.987+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=SEKOAGTK7VOV tag=PH0ZJB4FTK0W type=write size=3520895 2024-09-14T10:57:48.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.987+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_5VZCCFRUAQJ7.2~3BJ40R8XWC81.0 size=375758 2024-09-14T10:57:48.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.991+0000 7fdf8f02c8c0 1 < canceled multipart upload key=5VZCCFRUAQJ7 upload=3BJ40R8XWC81 tag=S8FRZLJNCXY8 type=write size=1424334 2024-09-14T10:57:48.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:48.999+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~F5Q4H5XKVQGK.0 size=1048576 2024-09-14T10:57:48.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.003+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~F5Q4H5XKVQGK.1 size=166416 2024-09-14T10:57:48.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.003+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=F5Q4H5XKVQGK tag=EQARZGBSP77Y type=write size=2263568 2024-09-14T10:57:49.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.007+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=IXH3EP2HK0QS type=write size=313604 2024-09-14T10:57:49.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.011+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=M9ZTNBS04571 type=del size=3423030 2024-09-14T10:57:49.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.015+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~OR5C1N4JZW99.0 size=1048576 2024-09-14T10:57:49.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.015+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~OR5C1N4JZW99.1 size=998613 2024-09-14T10:57:49.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.023+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=OR5C1N4JZW99 tag=ON3FV3WJHEMR type=write size=3095765 2024-09-14T10:57:49.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.031+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~WD2LI9N00YIY.0 size=741160 2024-09-14T10:57:49.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.031+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=WD2LI9N00YIY tag=P0RLTTNTTP77 type=write size=1789736 2024-09-14T10:57:49.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.035+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=5WHVQJK37RC7 type=del 2024-09-14T10:57:49.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.039+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=01BX9WL3N9VT type=del size=1180915 2024-09-14T10:57:49.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.043+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~PQ33A80NJY47.0 size=1048576 2024-09-14T10:57:49.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.043+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~PQ33A80NJY47.1 size=633223 2024-09-14T10:57:49.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.055+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=PQ33A80NJY47 tag=08JSGMGIPII9 type=write size=2730375 2024-09-14T10:57:49.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.059+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~TGITVA38KF7T.0 size=1048576 2024-09-14T10:57:49.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.063+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~TGITVA38KF7T.1 size=547695 2024-09-14T10:57:49.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.063+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=TGITVA38KF7T tag=OKMH19WMJ0QC type=write size=2644847 2024-09-14T10:57:49.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.067+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=XYPGW12J7MBK type=del 2024-09-14T10:57:49.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.071+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=5W0YZ9EQ956W type=del size=2430207 2024-09-14T10:57:49.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.075+0000 7fdf8f02c8c0 1 < canceled operation key=LFLY0V3FRRW5 tag=QUKTRG2EFRYU type=del size=3052630 2024-09-14T10:57:49.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.079+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=7Z4EUYH5B07N type=write size=92469 2024-09-14T10:57:49.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.083+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=GIDX4GJLZT9C type=del 2024-09-14T10:57:49.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.087+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=WX0CEIS8OICZ type=del size=2658296 2024-09-14T10:57:49.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.095+0000 7fdf8f02c8c0 1 < suggested remove operation key=XUT55FR490EO tag=R4FMJ9NGPJA1 type=del 2024-09-14T10:57:49.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.099+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=WTD69MRKK9HN type=write size=1015207 2024-09-14T10:57:49.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.103+0000 7fdf8f02c8c0 1 < canceled operation key=ZSBCGOXXJ0D5 tag=2DMTPSBYKYXC type=del size=3447404 2024-09-14T10:57:49.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.107+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=GAVVXUI1JELV type=write size=188440 2024-09-14T10:57:49.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.111+0000 7fdf8f02c8c0 1 < completed write operation key=304ZNF4OC1ML tag=0MYMFM1FFJBO type=write size=531130 2024-09-14T10:57:49.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.115+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=ER9ASDRAEE7J type=del size=2342187 2024-09-14T10:57:49.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.119+0000 7fdf8f02c8c0 1 < canceled operation key=3T0H42SC1ETB tag=6FN9Y9L0QW9B type=del size=1463656 2024-09-14T10:57:49.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.123+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=76WE7MWLZBJC type=del size=3967051 2024-09-14T10:57:49.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.127+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=7U5CVSFZBO3V type=del 2024-09-14T10:57:49.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.131+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~T2V2O4ZH9N1A.0 size=1048576 2024-09-14T10:57:49.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.135+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~T2V2O4ZH9N1A.1 size=953338 2024-09-14T10:57:49.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.135+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=T2V2O4ZH9N1A tag=K3MWVWGUVH6U type=write size=3050490 2024-09-14T10:57:49.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.139+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=D1GS4IOPAYLX type=del 2024-09-14T10:57:49.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.143+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=J5K05DIJOR2I type=del size=3809634 2024-09-14T10:57:49.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.147+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~21APY7QZUM01.0 size=1048576 2024-09-14T10:57:49.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.147+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STHEUJ6VDPQB.2~21APY7QZUM01.1 size=1048576 2024-09-14T10:57:49.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.151+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~21APY7QZUM01.2 size=113664 2024-09-14T10:57:49.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.155+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STHEUJ6VDPQB upload=21APY7QZUM01 tag=HS5RDITNDCSR type=write size=3259392 2024-09-14T10:57:49.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.159+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=9V5XXOCMUBYL type=del size=327687 2024-09-14T10:57:49.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~SEKOAGTK7VOV.0 size=1048576 2024-09-14T10:57:49.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.167+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~SEKOAGTK7VOV.1 size=1048576 2024-09-14T10:57:49.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~SEKOAGTK7VOV.2 size=375167 2024-09-14T10:57:49.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.175+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=SEKOAGTK7VOV tag=PH0ZJB4FTK0W type=write size=3520895 2024-09-14T10:57:49.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.183+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~EHE3PZI03OCA.0 size=1048576 2024-09-14T10:57:49.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.187+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~EHE3PZI03OCA.1 size=81897 2024-09-14T10:57:49.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.187+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=EHE3PZI03OCA tag=MHNN0IA2ZJ78 type=write size=2179049 2024-09-14T10:57:49.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.191+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~F5Q4H5XKVQGK.0 size=1048576 2024-09-14T10:57:49.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.191+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~F5Q4H5XKVQGK.1 size=166416 2024-09-14T10:57:49.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.195+0000 7fdf8f02c8c0 1 < canceled multipart upload key=OFY1G5R28CK6 upload=F5Q4H5XKVQGK tag=EQARZGBSP77Y type=write size=2263568 2024-09-14T10:57:49.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~P61KWBRYTJ8L.0 size=1048576 2024-09-14T10:57:49.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~P61KWBRYTJ8L.1 size=300422 2024-09-14T10:57:49.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.207+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=P61KWBRYTJ8L tag=2GAI9W9NOC17 type=write size=2397574 2024-09-14T10:57:49.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.211+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=M9ZTNBS04571 type=del 2024-09-14T10:57:49.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.215+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=6XRGISXFDVLA type=del size=2286864 2024-09-14T10:57:49.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.219+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~WD2LI9N00YIY.0 size=741160 2024-09-14T10:57:49.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.227+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=WD2LI9N00YIY tag=P0RLTTNTTP77 type=write size=1789736 2024-09-14T10:57:49.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.231+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=1RN3ZHV9660N type=del size=2467345 2024-09-14T10:57:49.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.235+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=01BX9WL3N9VT type=del 2024-09-14T10:57:49.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.239+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~RYDV4PZZCH0U.0 size=461095 2024-09-14T10:57:49.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.239+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=RYDV4PZZCH0U tag=E2EE537UXF2X type=write size=1509671 2024-09-14T10:57:49.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~TGITVA38KF7T.0 size=1048576 2024-09-14T10:57:49.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.247+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~TGITVA38KF7T.1 size=547695 2024-09-14T10:57:49.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.255+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=TGITVA38KF7T tag=OKMH19WMJ0QC type=write size=2644847 2024-09-14T10:57:49.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.259+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~PLPJNU74GSRU.0 size=949739 2024-09-14T10:57:49.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.259+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=PLPJNU74GSRU tag=IHCCYD6IJLHO type=write size=1998315 2024-09-14T10:57:49.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.263+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=5W0YZ9EQ956W type=del 2024-09-14T10:57:49.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.267+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=UK6N1HH6GPBF type=del size=3261419 2024-09-14T10:57:49.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.271+0000 7fdf8f02c8c0 1 < completed write operation key=YU9DAJA242Q7 tag=7Z4EUYH5B07N type=write size=92469 2024-09-14T10:57:49.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.275+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=J2WMHFHNMHG0 type=del size=3057835 2024-09-14T10:57:49.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.283+0000 7fdf8f02c8c0 1 < suggested update operation key=5VZCCFRUAQJ7 tag=WX0CEIS8OICZ type=del size=2658296 2024-09-14T10:57:49.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.291+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~N9YHYQ94K4PA.0 size=1048576 2024-09-14T10:57:49.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.295+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~N9YHYQ94K4PA.1 size=187471 2024-09-14T10:57:49.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.295+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=N9YHYQ94K4PA tag=K76T3F5LR9WE type=write size=2284623 2024-09-14T10:57:49.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.299+0000 7fdf8f02c8c0 1 < completed write operation key=YU9DAJA242Q7 tag=WTD69MRKK9HN type=write size=1015207 2024-09-14T10:57:49.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.307+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~GTSG5C4Z2A2S.0 size=364530 2024-09-14T10:57:49.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.307+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=GTSG5C4Z2A2S tag=6TKGOCFW32P8 type=write size=1413106 2024-09-14T10:57:49.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.311+0000 7fdf8f02c8c0 1 < completed write operation key=82N2FPU7LKTG tag=GAVVXUI1JELV type=write size=188440 2024-09-14T10:57:49.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.315+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~G8KSK2V0FQ7E.0 size=1048576 2024-09-14T10:57:49.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.319+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~G8KSK2V0FQ7E.1 size=1048576 2024-09-14T10:57:49.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.323+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~G8KSK2V0FQ7E.2 size=877972 2024-09-14T10:57:49.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.323+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=G8KSK2V0FQ7E tag=K2ZWJJYVI9SF type=write size=4023700 2024-09-14T10:57:49.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.327+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=ER9ASDRAEE7J type=del 2024-09-14T10:57:49.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.331+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=HYSL8F2VSRN3 type=del size=3026285 2024-09-14T10:57:49.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.335+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=76WE7MWLZBJC type=del 2024-09-14T10:57:49.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.343+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~C8MJCGOFPPK3.0 size=1048576 2024-09-14T10:57:49.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.343+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~C8MJCGOFPPK3.1 size=828337 2024-09-14T10:57:49.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.343+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=C8MJCGOFPPK3 tag=I6BAHN9YIM28 type=write size=2925489 2024-09-14T10:57:49.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.347+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~T2V2O4ZH9N1A.0 size=1048576 2024-09-14T10:57:49.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.351+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~T2V2O4ZH9N1A.1 size=953338 2024-09-14T10:57:49.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.359+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=T2V2O4ZH9N1A tag=K3MWVWGUVH6U type=write size=3050490 2024-09-14T10:57:49.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.363+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~TIJ1MU3MHWHW.0 size=1048576 2024-09-14T10:57:49.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.367+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~TIJ1MU3MHWHW.1 size=330202 2024-09-14T10:57:49.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.367+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=TIJ1MU3MHWHW tag=1TVQXFV5GDNZ type=write size=2427354 2024-09-14T10:57:49.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.371+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=J5K05DIJOR2I type=del 2024-09-14T10:57:49.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.379+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~2M8L5GT5X5I8.0 size=856516 2024-09-14T10:57:49.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.379+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=2M8L5GT5X5I8 tag=WVF4E2P69JGF type=write size=1905092 2024-09-14T10:57:49.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.383+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=9V5XXOCMUBYL type=del 2024-09-14T10:57:49.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.391+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~I9Q7K4CFCAL4.0 size=803436 2024-09-14T10:57:49.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.391+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=I9Q7K4CFCAL4 tag=KOR3I8FTL9X6 type=write size=1852012 2024-09-14T10:57:49.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.395+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~EHE3PZI03OCA.0 size=1048576 2024-09-14T10:57:49.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.399+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~EHE3PZI03OCA.1 size=81897 2024-09-14T10:57:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.403+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=EHE3PZI03OCA tag=MHNN0IA2ZJ78 type=write size=2179049 2024-09-14T10:57:49.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.407+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=X0T8E3XRA8AY type=del size=2278264 2024-09-14T10:57:49.412 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.415+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~P61KWBRYTJ8L.0 size=1048576 2024-09-14T10:57:49.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.419+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~P61KWBRYTJ8L.1 size=300422 2024-09-14T10:57:49.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.423+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=P61KWBRYTJ8L tag=2GAI9W9NOC17 type=write size=2397574 2024-09-14T10:57:49.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.427+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=C7A4B6CB29KB type=del size=2543793 2024-09-14T10:57:49.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.431+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=6XRGISXFDVLA type=del 2024-09-14T10:57:49.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.435+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=MSF0USJNYXE0 type=del size=3141856 2024-09-14T10:57:49.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.443+0000 7fdf8f02c8c0 1 < suggested update operation key=82N2FPU7LKTG tag=1RN3ZHV9660N type=del size=2467345 2024-09-14T10:57:49.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.447+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=G9Z60DXFOSPA type=write size=230033 2024-09-14T10:57:49.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.451+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~RYDV4PZZCH0U.0 size=461095 2024-09-14T10:57:49.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.455+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=RYDV4PZZCH0U tag=E2EE537UXF2X type=write size=1509671 2024-09-14T10:57:49.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.459+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=L2SD20EP0N3Y type=del size=2541495 2024-09-14T10:57:49.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.463+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~PLPJNU74GSRU.0 size=949739 2024-09-14T10:57:49.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.471+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=PLPJNU74GSRU tag=IHCCYD6IJLHO type=write size=1998315 2024-09-14T10:57:49.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.475+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=YP9HOPACPUMQ type=del size=2608024 2024-09-14T10:57:49.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.483+0000 7fdf8f02c8c0 1 < suggested remove operation key=YU9DAJA242Q7 tag=UK6N1HH6GPBF type=del 2024-09-14T10:57:49.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.483+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=HOHP3A53HPYT type=del size=4147527 2024-09-14T10:57:49.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.487+0000 7fdf8f02c8c0 1 < canceled operation key=ZF6IDD8B3CFO tag=J2WMHFHNMHG0 type=del size=3057835 2024-09-14T10:57:49.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.491+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=SUWWMO2RJLGN type=del size=1927675 2024-09-14T10:57:49.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.495+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~N9YHYQ94K4PA.0 size=1048576 2024-09-14T10:57:49.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.499+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~N9YHYQ94K4PA.1 size=187471 2024-09-14T10:57:49.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.503+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=N9YHYQ94K4PA tag=K76T3F5LR9WE type=write size=2284623 2024-09-14T10:57:49.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.511+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~OQL6O4DHENE3.0 size=1048576 2024-09-14T10:57:49.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~OQL6O4DHENE3.1 size=1048576 2024-09-14T10:57:49.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~OQL6O4DHENE3.2 size=488880 2024-09-14T10:57:49.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.515+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=OQL6O4DHENE3 tag=6DDCYO8R4MHK type=write size=3634608 2024-09-14T10:57:49.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.519+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~GTSG5C4Z2A2S.0 size=364530 2024-09-14T10:57:49.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.527+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=GTSG5C4Z2A2S tag=6TKGOCFW32P8 type=write size=1413106 2024-09-14T10:57:49.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.527+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=NJY210XC7EZJ type=del size=1344218 2024-09-14T10:57:49.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.531+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~G8KSK2V0FQ7E.0 size=1048576 2024-09-14T10:57:49.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.535+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~G8KSK2V0FQ7E.1 size=1048576 2024-09-14T10:57:49.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.539+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~G8KSK2V0FQ7E.2 size=877972 2024-09-14T10:57:49.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.543+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=G8KSK2V0FQ7E tag=K2ZWJJYVI9SF type=write size=4023700 2024-09-14T10:57:49.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.551+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~MPDWJ2S39NHE.0 size=552311 2024-09-14T10:57:49.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.551+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=MPDWJ2S39NHE tag=7VGX8SGYPUNL type=write size=1600887 2024-09-14T10:57:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.555+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=HYSL8F2VSRN3 type=del 2024-09-14T10:57:49.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~VE9R5MQUBTU9.0 size=1048576 2024-09-14T10:57:49.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.567+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~VE9R5MQUBTU9.1 size=90536 2024-09-14T10:57:49.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.567+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=VE9R5MQUBTU9 tag=WZ3X5TJM3FRR type=write size=2187688 2024-09-14T10:57:49.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.571+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~C8MJCGOFPPK3.0 size=1048576 2024-09-14T10:57:49.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.571+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~C8MJCGOFPPK3.1 size=828337 2024-09-14T10:57:49.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.579+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=C8MJCGOFPPK3 tag=I6BAHN9YIM28 type=write size=2925489 2024-09-14T10:57:49.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.583+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=OUQJWA6N2V0P type=del size=1514775 2024-09-14T10:57:49.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.587+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~TIJ1MU3MHWHW.0 size=1048576 2024-09-14T10:57:49.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.587+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_0QJLAH0EPKVD.2~TIJ1MU3MHWHW.1 size=330202 2024-09-14T10:57:49.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.591+0000 7fdf8f02c8c0 1 < canceled multipart upload key=0QJLAH0EPKVD upload=TIJ1MU3MHWHW tag=1TVQXFV5GDNZ type=write size=2427354 2024-09-14T10:57:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.599+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~JU41CIE2P6MM.0 size=1048576 2024-09-14T10:57:49.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.603+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~JU41CIE2P6MM.1 size=1048576 2024-09-14T10:57:49.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.603+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~JU41CIE2P6MM.2 size=786024 2024-09-14T10:57:49.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.603+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=JU41CIE2P6MM tag=IWO5U0RNWPAK type=write size=3931752 2024-09-14T10:57:49.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.607+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~2M8L5GT5X5I8.0 size=856516 2024-09-14T10:57:49.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.615+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=2M8L5GT5X5I8 tag=WVF4E2P69JGF type=write size=1905092 2024-09-14T10:57:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.623+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~DLYHSJGUD9PZ.0 size=1048576 2024-09-14T10:57:49.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.623+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~DLYHSJGUD9PZ.1 size=1048576 2024-09-14T10:57:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.627+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~DLYHSJGUD9PZ.2 size=738579 2024-09-14T10:57:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.627+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=DLYHSJGUD9PZ tag=2IX1TNRTIJMX type=write size=3884307 2024-09-14T10:57:49.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.631+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~I9Q7K4CFCAL4.0 size=803436 2024-09-14T10:57:49.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.639+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=I9Q7K4CFCAL4 tag=KOR3I8FTL9X6 type=write size=1852012 2024-09-14T10:57:49.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.643+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~N8B2L3PE4GZF.0 size=1048576 2024-09-14T10:57:49.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~N8B2L3PE4GZF.1 size=1048576 2024-09-14T10:57:49.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~N8B2L3PE4GZF.2 size=856996 2024-09-14T10:57:49.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.651+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=N8B2L3PE4GZF tag=I3BB8OUCLRZ3 type=write size=4002724 2024-09-14T10:57:49.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.655+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=X0T8E3XRA8AY type=del 2024-09-14T10:57:49.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.663+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~85FOD454ZFY0.0 size=1048576 2024-09-14T10:57:49.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.663+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~85FOD454ZFY0.1 size=1048576 2024-09-14T10:57:49.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~85FOD454ZFY0.2 size=596200 2024-09-14T10:57:49.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.667+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=85FOD454ZFY0 tag=H04EK2IK1FXD type=write size=3741928 2024-09-14T10:57:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.671+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=C7A4B6CB29KB type=del 2024-09-14T10:57:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.679+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~X7HBZRZ9RRIV.0 size=1048576 2024-09-14T10:57:49.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.679+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~X7HBZRZ9RRIV.1 size=1048576 2024-09-14T10:57:49.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.683+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~X7HBZRZ9RRIV.2 size=616707 2024-09-14T10:57:49.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.683+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=X7HBZRZ9RRIV tag=XZG5GID9TJAU type=write size=3762435 2024-09-14T10:57:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.687+0000 7fdf8f02c8c0 1 < canceled operation key=STB3W5URFJEZ tag=MSF0USJNYXE0 type=del size=3141856 2024-09-14T10:57:49.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.695+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~P0QNNIK1Y3V6.0 size=480865 2024-09-14T10:57:49.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.695+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=P0QNNIK1Y3V6 tag=DXPVBD183I42 type=write size=1529441 2024-09-14T10:57:49.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.699+0000 7fdf8f02c8c0 1 < completed write operation key=304ZNF4OC1ML tag=G9Z60DXFOSPA type=write size=230033 2024-09-14T10:57:49.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.703+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~3XSBVRPKMPDL.0 size=1048576 2024-09-14T10:57:49.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~3XSBVRPKMPDL.1 size=1048576 2024-09-14T10:57:49.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.707+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~3XSBVRPKMPDL.2 size=765435 2024-09-14T10:57:49.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.707+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=3XSBVRPKMPDL tag=WETBATB8LP8U type=write size=3911163 2024-09-14T10:57:49.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.711+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=L2SD20EP0N3Y type=del 2024-09-14T10:57:49.713 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.715+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=5W7H8Y2YGOTP type=del size=822464 2024-09-14T10:57:49.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.723+0000 7fdf8f02c8c0 1 < suggested remove operation key=1E72V12EPEH3 tag=YP9HOPACPUMQ type=del 2024-09-14T10:57:49.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.727+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=TG4B72AY55YQ type=del size=3463429 2024-09-14T10:57:49.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.735+0000 7fdf8f02c8c0 1 < suggested remove operation key=STHEUJ6VDPQB tag=HOHP3A53HPYT type=del 2024-09-14T10:57:49.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.743+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~V9ODY9834ZN1.0 size=1048576 2024-09-14T10:57:49.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.747+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~V9ODY9834ZN1.1 size=1048576 2024-09-14T10:57:49.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.751+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~V9ODY9834ZN1.2 size=778151 2024-09-14T10:57:49.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.751+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=V9ODY9834ZN1 tag=IVE02QBEAZ0V type=write size=3923879 2024-09-14T10:57:49.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.755+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=SUWWMO2RJLGN type=del 2024-09-14T10:57:49.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.759+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=F1Q635DCGA4H type=write size=569712 2024-09-14T10:57:49.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.763+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~OQL6O4DHENE3.0 size=1048576 2024-09-14T10:57:49.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.767+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~OQL6O4DHENE3.1 size=1048576 2024-09-14T10:57:49.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.771+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~OQL6O4DHENE3.2 size=488880 2024-09-14T10:57:49.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.775+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=OQL6O4DHENE3 tag=6DDCYO8R4MHK type=write size=3634608 2024-09-14T10:57:49.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.779+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=F82O81UMOF4Y type=del size=2916305 2024-09-14T10:57:49.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.787+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=NJY210XC7EZJ type=del size=1344218 2024-09-14T10:57:49.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.791+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=VBXBML56G678 type=del size=112610 2024-09-14T10:57:49.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.795+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~MPDWJ2S39NHE.0 size=552311 2024-09-14T10:57:49.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.799+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=MPDWJ2S39NHE tag=7VGX8SGYPUNL type=write size=1600887 2024-09-14T10:57:49.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.803+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=PJ1X82SE80X8 type=del size=576777 2024-09-14T10:57:49.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.807+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~VE9R5MQUBTU9.0 size=1048576 2024-09-14T10:57:49.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.807+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~VE9R5MQUBTU9.1 size=90536 2024-09-14T10:57:49.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.815+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=VE9R5MQUBTU9 tag=WZ3X5TJM3FRR type=write size=2187688 2024-09-14T10:57:49.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.819+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=R968C8EJXWOG type=del size=2365266 2024-09-14T10:57:49.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.823+0000 7fdf8f02c8c0 -1 < failed to complete operation key=K3KJ7HDQF6ZH tag=OUQJWA6N2V0P type=del size=1514775: (22) Invalid argument 2024-09-14T10:57:49.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.823+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=XZ36351VV0UH type=write size=999063 2024-09-14T10:57:49.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.827+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~JU41CIE2P6MM.0 size=1048576 2024-09-14T10:57:49.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.831+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~JU41CIE2P6MM.1 size=1048576 2024-09-14T10:57:49.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.831+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_9IDBODZBQRJR.2~JU41CIE2P6MM.2 size=786024 2024-09-14T10:57:49.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.839+0000 7fdf8f02c8c0 1 < canceled multipart upload key=9IDBODZBQRJR upload=JU41CIE2P6MM tag=IWO5U0RNWPAK type=write size=3931752 2024-09-14T10:57:49.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.843+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~IZQ5VE4JIU27.0 size=1048576 2024-09-14T10:57:49.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.847+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~IZQ5VE4JIU27.1 size=1048576 2024-09-14T10:57:49.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.851+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~IZQ5VE4JIU27.2 size=235812 2024-09-14T10:57:49.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.851+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=IZQ5VE4JIU27 tag=V5KPLFEPSQTN type=write size=3381540 2024-09-14T10:57:49.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.851+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~DLYHSJGUD9PZ.0 size=1048576 2024-09-14T10:57:49.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.855+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~DLYHSJGUD9PZ.1 size=1048576 2024-09-14T10:57:49.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.859+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~DLYHSJGUD9PZ.2 size=738579 2024-09-14T10:57:49.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.863+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=DLYHSJGUD9PZ tag=2IX1TNRTIJMX type=write size=3884307 2024-09-14T10:57:49.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.867+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=86A9KESKJ9EF type=del size=1306960 2024-09-14T10:57:49.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.871+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~N8B2L3PE4GZF.0 size=1048576 2024-09-14T10:57:49.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.875+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~N8B2L3PE4GZF.1 size=1048576 2024-09-14T10:57:49.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.879+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~N8B2L3PE4GZF.2 size=856996 2024-09-14T10:57:49.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.883+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=N8B2L3PE4GZF tag=I3BB8OUCLRZ3 type=write size=4002724 2024-09-14T10:57:49.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~I7YLED5S70NM.0 size=1048576 2024-09-14T10:57:49.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~I7YLED5S70NM.1 size=1048576 2024-09-14T10:57:49.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~I7YLED5S70NM.2 size=176175 2024-09-14T10:57:49.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.895+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=I7YLED5S70NM tag=WZR7DQCTCO3N type=write size=3321903 2024-09-14T10:57:49.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.899+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~85FOD454ZFY0.0 size=1048576 2024-09-14T10:57:49.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.903+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~85FOD454ZFY0.1 size=1048576 2024-09-14T10:57:49.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.907+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~85FOD454ZFY0.2 size=596200 2024-09-14T10:57:49.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.915+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=85FOD454ZFY0 tag=H04EK2IK1FXD type=write size=3741928 2024-09-14T10:57:49.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.919+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=EUD2Y2L8YFL2 type=del size=779072 2024-09-14T10:57:49.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.923+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~X7HBZRZ9RRIV.0 size=1048576 2024-09-14T10:57:49.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.923+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~X7HBZRZ9RRIV.1 size=1048576 2024-09-14T10:57:49.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.927+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~X7HBZRZ9RRIV.2 size=616707 2024-09-14T10:57:49.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.935+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=X7HBZRZ9RRIV tag=XZG5GID9TJAU type=write size=3762435 2024-09-14T10:57:49.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.939+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~F4B38KLQX8Z2.0 size=916584 2024-09-14T10:57:49.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.939+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=F4B38KLQX8Z2 tag=AQ0W590AUNOX type=write size=1965160 2024-09-14T10:57:49.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.943+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~P0QNNIK1Y3V6.0 size=480865 2024-09-14T10:57:49.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.951+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=P0QNNIK1Y3V6 tag=DXPVBD183I42 type=write size=1529441 2024-09-14T10:57:49.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.955+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=AUPFSOQ022OL type=del size=373829 2024-09-14T10:57:49.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.955+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STB3W5URFJEZ.2~3XSBVRPKMPDL.0 size=1048576 2024-09-14T10:57:49.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.959+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~3XSBVRPKMPDL.1 size=1048576 2024-09-14T10:57:49.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.963+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~3XSBVRPKMPDL.2 size=765435 2024-09-14T10:57:49.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.967+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STB3W5URFJEZ upload=3XSBVRPKMPDL tag=WETBATB8LP8U type=write size=3911163 2024-09-14T10:57:49.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.975+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~25HX6C5CD8LU.0 size=1048576 2024-09-14T10:57:49.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.979+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~25HX6C5CD8LU.1 size=1048576 2024-09-14T10:57:49.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.979+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~25HX6C5CD8LU.2 size=289873 2024-09-14T10:57:49.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.979+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=25HX6C5CD8LU tag=ZDK3CC5AC7PK type=write size=3435601 2024-09-14T10:57:49.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.983+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=5W7H8Y2YGOTP type=del 2024-09-14T10:57:49.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.987+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=ZAZMF8TOB0TX type=write size=586299 2024-09-14T10:57:49.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.991+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=TG4B72AY55YQ type=del 2024-09-14T10:57:49.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:49.999+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~MM4PRZYVXQUW.0 size=1048576 2024-09-14T10:57:49.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.003+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~MM4PRZYVXQUW.1 size=1048576 2024-09-14T10:57:50.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.007+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~MM4PRZYVXQUW.2 size=745601 2024-09-14T10:57:50.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.007+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=MM4PRZYVXQUW tag=SFD10EA5HPST type=write size=3891329 2024-09-14T10:57:50.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.011+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~V9ODY9834ZN1.0 size=1048576 2024-09-14T10:57:50.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.015+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~V9ODY9834ZN1.1 size=1048576 2024-09-14T10:57:50.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.015+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~V9ODY9834ZN1.2 size=778151 2024-09-14T10:57:50.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.023+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=V9ODY9834ZN1 tag=IVE02QBEAZ0V type=write size=3923879 2024-09-14T10:57:50.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.027+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=VVJPNYE0WBSF type=del size=71095 2024-09-14T10:57:50.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.031+0000 7fdf8f02c8c0 1 < completed write operation key=6VNI8FMHZ0FN tag=F1Q635DCGA4H type=write size=569712 2024-09-14T10:57:50.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.035+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=2FRO5T7DVZJE type=del size=3176088 2024-09-14T10:57:50.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.039+0000 7fdf8f02c8c0 1 < canceled operation key=304ZNF4OC1ML tag=F82O81UMOF4Y type=del size=2916305 2024-09-14T10:57:50.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.043+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=CP52KXVT0IPP type=write size=472332 2024-09-14T10:57:50.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.047+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=VBXBML56G678 type=del 2024-09-14T10:57:50.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.051+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=W6C01B3LUEUM type=write size=865700 2024-09-14T10:57:50.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.059+0000 7fdf8f02c8c0 1 < suggested update operation key=STHEUJ6VDPQB tag=PJ1X82SE80X8 type=del size=576777 2024-09-14T10:57:50.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.067+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=CXWJYE5POKR1 type=del size=485354 2024-09-14T10:57:50.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.067+0000 7fdf8f02c8c0 1 < canceled operation key=K3KJ7HDQF6ZH tag=R968C8EJXWOG type=del size=2365266 2024-09-14T10:57:50.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~14V0ZXUDXHEF.0 size=1048576 2024-09-14T10:57:50.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.079+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~14V0ZXUDXHEF.1 size=1048576 2024-09-14T10:57:50.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.083+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~14V0ZXUDXHEF.2 size=762534 2024-09-14T10:57:50.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.083+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=14V0ZXUDXHEF tag=7GIETWICT469 type=write size=3908262 2024-09-14T10:57:50.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.091+0000 7fdf8f02c8c0 1 < suggested remove operation key=ZSBCGOXXJ0D5 tag=XZ36351VV0UH type=write 2024-09-14T10:57:50.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.095+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=KMTS09SZAPIS type=del size=3689796 2024-09-14T10:57:50.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.099+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~IZQ5VE4JIU27.0 size=1048576 2024-09-14T10:57:50.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.099+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~IZQ5VE4JIU27.1 size=1048576 2024-09-14T10:57:50.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.103+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~IZQ5VE4JIU27.2 size=235812 2024-09-14T10:57:50.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.111+0000 7fdf8f02c8c0 1 < canceled multipart upload key=OFY1G5R28CK6 upload=IZQ5VE4JIU27 tag=V5KPLFEPSQTN type=write size=3381540 2024-09-14T10:57:50.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.115+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=7X01PZ62O7BX type=del size=73519 2024-09-14T10:57:50.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.119+0000 7fdf8f02c8c0 1 < canceled operation key=STB3W5URFJEZ tag=86A9KESKJ9EF type=del size=1306960 2024-09-14T10:57:50.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.123+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~504BIHMOKJVR.0 size=1048576 2024-09-14T10:57:50.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.127+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~504BIHMOKJVR.1 size=1048576 2024-09-14T10:57:50.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.127+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~504BIHMOKJVR.2 size=132861 2024-09-14T10:57:50.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.127+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=504BIHMOKJVR tag=9C3GGRZBPI95 type=write size=3278589 2024-09-14T10:57:50.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.131+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~I7YLED5S70NM.0 size=1048576 2024-09-14T10:57:50.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.131+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_YU9DAJA242Q7.2~I7YLED5S70NM.1 size=1048576 2024-09-14T10:57:50.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.131+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_YU9DAJA242Q7.2~I7YLED5S70NM.2 size=176175 2024-09-14T10:57:50.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.135+0000 7fdf8f02c8c0 1 < canceled multipart upload key=YU9DAJA242Q7 upload=I7YLED5S70NM tag=WZR7DQCTCO3N type=write size=3321903 2024-09-14T10:57:50.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.139+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~V1AN0NFBKVP2.0 size=1048576 2024-09-14T10:57:50.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.143+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~V1AN0NFBKVP2.1 size=1048576 2024-09-14T10:57:50.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.143+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~V1AN0NFBKVP2.2 size=681191 2024-09-14T10:57:50.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.143+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=V1AN0NFBKVP2 tag=X83VPWJEWPJI type=write size=3826919 2024-09-14T10:57:50.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.147+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=EUD2Y2L8YFL2 type=del 2024-09-14T10:57:50.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.151+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=JUCTPUUHCEY9 type=del size=3969607 2024-09-14T10:57:50.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.151+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~F4B38KLQX8Z2.0 size=916584 2024-09-14T10:57:50.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.155+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=F4B38KLQX8Z2 tag=AQ0W590AUNOX type=write size=1965160 2024-09-14T10:57:50.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.159+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~Q5PJB4OKK01J.0 size=785761 2024-09-14T10:57:50.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.159+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=Q5PJB4OKK01J tag=TYIKECZ9VLUM type=write size=1834337 2024-09-14T10:57:50.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.163+0000 7fdf8f02c8c0 -1 < failed to complete operation key=ZSBCGOXXJ0D5 tag=AUPFSOQ022OL type=del size=373829: (22) Invalid argument 2024-09-14T10:57:50.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.163+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=Q3S0GQ3CK86C type=del size=830589 2024-09-14T10:57:50.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.167+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~25HX6C5CD8LU.0 size=1048576 2024-09-14T10:57:50.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~25HX6C5CD8LU.1 size=1048576 2024-09-14T10:57:50.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~25HX6C5CD8LU.2 size=289873 2024-09-14T10:57:50.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.175+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=25HX6C5CD8LU tag=ZDK3CC5AC7PK type=write size=3435601 2024-09-14T10:57:50.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.179+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=AL9UKP8AF7SS type=del size=2579866 2024-09-14T10:57:50.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.183+0000 7fdf8f02c8c0 1 < completed write operation key=82N2FPU7LKTG tag=ZAZMF8TOB0TX type=write size=586299 2024-09-14T10:57:50.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.187+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~86W6ONZBQP4I.0 size=1048576 2024-09-14T10:57:50.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.191+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~86W6ONZBQP4I.1 size=711427 2024-09-14T10:57:50.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.191+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=86W6ONZBQP4I tag=C2XUIXL585B7 type=write size=2808579 2024-09-14T10:57:50.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.195+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~MM4PRZYVXQUW.0 size=1048576 2024-09-14T10:57:50.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.199+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~MM4PRZYVXQUW.1 size=1048576 2024-09-14T10:57:50.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.199+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STHEUJ6VDPQB.2~MM4PRZYVXQUW.2 size=745601 2024-09-14T10:57:50.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.203+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STHEUJ6VDPQB upload=MM4PRZYVXQUW tag=SFD10EA5HPST type=write size=3891329 2024-09-14T10:57:50.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.207+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=XRGXLPWSWXLQ type=del size=3643543 2024-09-14T10:57:50.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.211+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=VVJPNYE0WBSF type=del 2024-09-14T10:57:50.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.215+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=0CLX52Z5INEE type=write size=860849 2024-09-14T10:57:50.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.219+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=2FRO5T7DVZJE type=del 2024-09-14T10:57:50.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.223+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=67BY352CVXQY type=del size=136824 2024-09-14T10:57:50.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.231+0000 7fdf8f02c8c0 1 < suggested update operation key=49O8DPTGA65S tag=CP52KXVT0IPP type=write size=472332 2024-09-14T10:57:50.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.239+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~HS3CZKE7CPH9.0 size=541092 2024-09-14T10:57:50.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.239+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=HS3CZKE7CPH9 tag=KU9OVHM4D30W type=write size=1589668 2024-09-14T10:57:50.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.243+0000 7fdf8f02c8c0 1 < completed write operation key=MNBXQTJBS1QS tag=W6C01B3LUEUM type=write size=865700 2024-09-14T10:57:50.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.247+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~8XK9VTUY7PY5.0 size=429859 2024-09-14T10:57:50.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.247+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=8XK9VTUY7PY5 tag=CUT0N2Q36LYB type=write size=1478435 2024-09-14T10:57:50.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.255+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=CXWJYE5POKR1 type=del 2024-09-14T10:57:50.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.259+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=K7ZZL3X9HXRJ type=del size=2858828 2024-09-14T10:57:50.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.263+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~14V0ZXUDXHEF.0 size=1048576 2024-09-14T10:57:50.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.267+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~14V0ZXUDXHEF.1 size=1048576 2024-09-14T10:57:50.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.267+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~14V0ZXUDXHEF.2 size=762534 2024-09-14T10:57:50.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.275+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=14V0ZXUDXHEF tag=7GIETWICT469 type=write size=3908262 2024-09-14T10:57:50.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.279+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=BYY8SBAHZE2P type=del size=2422666 2024-09-14T10:57:50.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.283+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=KMTS09SZAPIS type=del 2024-09-14T10:57:50.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.287+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=3LNIM0702N3X type=write size=515469 2024-09-14T10:57:50.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.291+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=7X01PZ62O7BX type=del 2024-09-14T10:57:50.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.295+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=6A111GL6RD2B type=del size=270860 2024-09-14T10:57:50.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.299+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~504BIHMOKJVR.0 size=1048576 2024-09-14T10:57:50.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.299+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~504BIHMOKJVR.1 size=1048576 2024-09-14T10:57:50.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.303+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~504BIHMOKJVR.2 size=132861 2024-09-14T10:57:50.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.311+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=504BIHMOKJVR tag=9C3GGRZBPI95 type=write size=3278589 2024-09-14T10:57:50.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.315+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~OX1CAPIJ9WC3.0 size=1048576 2024-09-14T10:57:50.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.319+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~OX1CAPIJ9WC3.1 size=1048576 2024-09-14T10:57:50.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.323+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~OX1CAPIJ9WC3.2 size=846126 2024-09-14T10:57:50.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.323+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=OX1CAPIJ9WC3 tag=CS86H4K0GE8A type=write size=3991854 2024-09-14T10:57:50.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.327+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~V1AN0NFBKVP2.0 size=1048576 2024-09-14T10:57:50.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.331+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~V1AN0NFBKVP2.1 size=1048576 2024-09-14T10:57:50.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.335+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~V1AN0NFBKVP2.2 size=681191 2024-09-14T10:57:50.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.339+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=V1AN0NFBKVP2 tag=X83VPWJEWPJI type=write size=3826919 2024-09-14T10:57:50.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.343+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=ZMR8N3VRM01T type=del size=2898936 2024-09-14T10:57:50.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.347+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=JUCTPUUHCEY9 type=del 2024-09-14T10:57:50.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.351+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~KRINIR654U9G.0 size=1048576 2024-09-14T10:57:50.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.355+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~KRINIR654U9G.1 size=1048576 2024-09-14T10:57:50.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.359+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~KRINIR654U9G.2 size=138018 2024-09-14T10:57:50.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.359+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=KRINIR654U9G tag=O5F0D6XN5FFE type=write size=3283746 2024-09-14T10:57:50.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.363+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~Q5PJB4OKK01J.0 size=785761 2024-09-14T10:57:50.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.367+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=Q5PJB4OKK01J tag=TYIKECZ9VLUM type=write size=1834337 2024-09-14T10:57:50.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.375+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~CNT3XV2DB7WO.0 size=1048576 2024-09-14T10:57:50.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.379+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~CNT3XV2DB7WO.1 size=557526 2024-09-14T10:57:50.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.379+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=CNT3XV2DB7WO tag=LOEPGXOC6ZGF type=write size=2654678 2024-09-14T10:57:50.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.383+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=Q3S0GQ3CK86C type=del 2024-09-14T10:57:50.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.387+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~MOZZP8LCNN2V.0 size=1048576 2024-09-14T10:57:50.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.391+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~MOZZP8LCNN2V.1 size=896179 2024-09-14T10:57:50.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.391+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=MOZZP8LCNN2V tag=6OZX94Y3LPXO type=write size=2993331 2024-09-14T10:57:50.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.399+0000 7fdf8f02c8c0 1 < suggested update operation key=0QJLAH0EPKVD tag=AL9UKP8AF7SS type=del size=2579866 2024-09-14T10:57:50.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.407+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~4JOPRCSBR6EN.0 size=1048576 2024-09-14T10:57:50.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.411+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~4JOPRCSBR6EN.1 size=725896 2024-09-14T10:57:50.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.411+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=4JOPRCSBR6EN tag=2BBVC4HANCXI type=write size=2823048 2024-09-14T10:57:50.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.419+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~86W6ONZBQP4I.0 size=1048576 2024-09-14T10:57:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.419+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~86W6ONZBQP4I.1 size=711427 2024-09-14T10:57:50.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.427+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=86W6ONZBQP4I tag=C2XUIXL585B7 type=write size=2808579 2024-09-14T10:57:50.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.431+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=0ZKDDJ4CV8N6 type=del size=2680541 2024-09-14T10:57:50.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.435+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=XRGXLPWSWXLQ type=del 2024-09-14T10:57:50.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.439+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=M3JTSU01K7IK type=write size=120927 2024-09-14T10:57:50.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.443+0000 7fdf8f02c8c0 1 < completed write operation key=MNBXQTJBS1QS tag=0CLX52Z5INEE type=write size=860849 2024-09-14T10:57:50.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.451+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~3VF20FJFC8G3.0 size=410446 2024-09-14T10:57:50.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.451+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=3VF20FJFC8G3 tag=ORTXOMUE1741 type=write size=1459022 2024-09-14T10:57:50.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.455+0000 7fdf8f02c8c0 -1 < failed to complete operation key=0QJLAH0EPKVD tag=67BY352CVXQY type=del size=136824: (22) Invalid argument 2024-09-14T10:57:50.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.459+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=ZR37FSIRRN6U type=del size=3395184 2024-09-14T10:57:50.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.463+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~HS3CZKE7CPH9.0 size=541092 2024-09-14T10:57:50.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.467+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=HS3CZKE7CPH9 tag=KU9OVHM4D30W type=write size=1589668 2024-09-14T10:57:50.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.471+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=DKYMUWF9JCPO type=del size=2918458 2024-09-14T10:57:50.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.475+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~8XK9VTUY7PY5.0 size=429859 2024-09-14T10:57:50.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.483+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=8XK9VTUY7PY5 tag=CUT0N2Q36LYB type=write size=1478435 2024-09-14T10:57:50.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.491+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~HSBEZQWY8YCK.0 size=684573 2024-09-14T10:57:50.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.491+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=HSBEZQWY8YCK tag=HX35CDJW8OL4 type=write size=1733149 2024-09-14T10:57:50.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.495+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=K7ZZL3X9HXRJ type=del 2024-09-14T10:57:50.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.499+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~4YXZ5D9XGLZN.0 size=1048576 2024-09-14T10:57:50.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.503+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~4YXZ5D9XGLZN.1 size=1048576 2024-09-14T10:57:50.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.507+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~4YXZ5D9XGLZN.2 size=888093 2024-09-14T10:57:50.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.507+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=4YXZ5D9XGLZN tag=VA1546L16VWL type=write size=4033821 2024-09-14T10:57:50.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.511+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=BYY8SBAHZE2P type=del 2024-09-14T10:57:50.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.511+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=BQUP4UC1T418 type=del size=281430 2024-09-14T10:57:50.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.515+0000 7fdf8f02c8c0 1 < completed write operation key=ZF6IDD8B3CFO tag=3LNIM0702N3X type=write size=515469 2024-09-14T10:57:50.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.523+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~NKOU8WE3IXDY.0 size=1048576 2024-09-14T10:57:50.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.527+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~NKOU8WE3IXDY.1 size=463169 2024-09-14T10:57:50.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.527+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=NKOU8WE3IXDY tag=4H2B76QXJ7WW type=write size=2560321 2024-09-14T10:57:50.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.531+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=6A111GL6RD2B type=del 2024-09-14T10:57:50.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.535+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=X4N42R2AABRA type=del size=2065106 2024-09-14T10:57:50.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.539+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~OX1CAPIJ9WC3.0 size=1048576 2024-09-14T10:57:50.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.543+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~OX1CAPIJ9WC3.1 size=1048576 2024-09-14T10:57:50.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.543+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~OX1CAPIJ9WC3.2 size=846126 2024-09-14T10:57:50.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.551+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=OX1CAPIJ9WC3 tag=CS86H4K0GE8A type=write size=3991854 2024-09-14T10:57:50.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.555+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=0KS9W0K7S1HY type=del size=3144306 2024-09-14T10:57:50.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.559+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=ZMR8N3VRM01T type=del 2024-09-14T10:57:50.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.563+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~PG14EKG8VOXX.0 size=1048576 2024-09-14T10:57:50.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.567+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~PG14EKG8VOXX.1 size=39827 2024-09-14T10:57:50.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.567+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=PG14EKG8VOXX tag=C0EAZ30ND02T type=write size=2136979 2024-09-14T10:57:50.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.571+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~KRINIR654U9G.0 size=1048576 2024-09-14T10:57:50.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.575+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~KRINIR654U9G.1 size=1048576 2024-09-14T10:57:50.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.579+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~KRINIR654U9G.2 size=138018 2024-09-14T10:57:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.583+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=KRINIR654U9G tag=O5F0D6XN5FFE type=write size=3283746 2024-09-14T10:57:50.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.587+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=45Y3YKN26CUE type=del size=14405 2024-09-14T10:57:50.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.591+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~CNT3XV2DB7WO.0 size=1048576 2024-09-14T10:57:50.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.595+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~CNT3XV2DB7WO.1 size=557526 2024-09-14T10:57:50.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.599+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=CNT3XV2DB7WO tag=LOEPGXOC6ZGF type=write size=2654678 2024-09-14T10:57:50.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.607+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~9ZD2J91LD43Y.0 size=1048576 2024-09-14T10:57:50.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.611+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~9ZD2J91LD43Y.1 size=207406 2024-09-14T10:57:50.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.611+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=9ZD2J91LD43Y tag=DLWRDCZVM3VE type=write size=2304558 2024-09-14T10:57:50.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.615+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~MOZZP8LCNN2V.0 size=1048576 2024-09-14T10:57:50.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.615+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~MOZZP8LCNN2V.1 size=896179 2024-09-14T10:57:50.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.623+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=MOZZP8LCNN2V tag=6OZX94Y3LPXO type=write size=2993331 2024-09-14T10:57:50.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.627+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~U5ABV05YSDNG.0 size=1048576 2024-09-14T10:57:50.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.631+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~U5ABV05YSDNG.1 size=145932 2024-09-14T10:57:50.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.631+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=U5ABV05YSDNG tag=WIL9QPZW8STC type=write size=2243084 2024-09-14T10:57:50.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.635+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~4JOPRCSBR6EN.0 size=1048576 2024-09-14T10:57:50.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.639+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~4JOPRCSBR6EN.1 size=725896 2024-09-14T10:57:50.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.643+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=4JOPRCSBR6EN tag=2BBVC4HANCXI type=write size=2823048 2024-09-14T10:57:50.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.651+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~A5E4D7H1K4OM.0 size=421354 2024-09-14T10:57:50.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.651+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=A5E4D7H1K4OM tag=EJR3EPNV5P1S type=write size=1469930 2024-09-14T10:57:50.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.655+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=0ZKDDJ4CV8N6 type=del 2024-09-14T10:57:50.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.659+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=AYKJE0KQJXIV type=del size=2263730 2024-09-14T10:57:50.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.667+0000 7fdf8f02c8c0 1 < suggested remove operation key=L1ERJ0JSRDMG tag=M3JTSU01K7IK type=write 2024-09-14T10:57:50.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.671+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=VUTYGWIZBBPD type=del size=2873527 2024-09-14T10:57:50.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.671+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_X0RT8UF3D0JC.2~3VF20FJFC8G3.0 size=410446 2024-09-14T10:57:50.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.675+0000 7fdf8f02c8c0 1 < canceled multipart upload key=X0RT8UF3D0JC upload=3VF20FJFC8G3 tag=ORTXOMUE1741 type=write size=1459022 2024-09-14T10:57:50.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.679+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=JEK8CZD8AMJO type=del size=319069 2024-09-14T10:57:50.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.683+0000 7fdf8f02c8c0 1 < canceled operation key=XUT55FR490EO tag=ZR37FSIRRN6U type=del size=3395184 2024-09-14T10:57:50.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.691+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~YCOKE39369N6.0 size=1048576 2024-09-14T10:57:50.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.691+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~YCOKE39369N6.1 size=671243 2024-09-14T10:57:50.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.691+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=YCOKE39369N6 tag=J91T49YWZM2I type=write size=2768395 2024-09-14T10:57:50.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.695+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=DKYMUWF9JCPO type=del 2024-09-14T10:57:50.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.699+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=P4TJZNLGRK9T type=del size=3361901 2024-09-14T10:57:50.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.703+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~HSBEZQWY8YCK.0 size=684573 2024-09-14T10:57:50.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.711+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=HSBEZQWY8YCK tag=HX35CDJW8OL4 type=write size=1733149 2024-09-14T10:57:50.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.715+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=IYF6GY97YRMB type=del size=4187390 2024-09-14T10:57:50.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.719+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~4YXZ5D9XGLZN.0 size=1048576 2024-09-14T10:57:50.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~4YXZ5D9XGLZN.1 size=1048576 2024-09-14T10:57:50.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~4YXZ5D9XGLZN.2 size=888093 2024-09-14T10:57:50.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.731+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=4YXZ5D9XGLZN tag=VA1546L16VWL type=write size=4033821 2024-09-14T10:57:50.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.735+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=VRK9SGH9Q9B0 type=del size=1149503 2024-09-14T10:57:50.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.739+0000 7fdf8f02c8c0 1 < suggested update operation key=3QSOKUSZ57QM tag=BQUP4UC1T418 type=del size=281430 2024-09-14T10:57:50.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.747+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~TNESZASPUR4R.0 size=4775 2024-09-14T10:57:50.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.747+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=TNESZASPUR4R tag=5V6TSROZT3SU type=write size=1053351 2024-09-14T10:57:50.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.751+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~NKOU8WE3IXDY.0 size=1048576 2024-09-14T10:57:50.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.759+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~NKOU8WE3IXDY.1 size=463169 2024-09-14T10:57:50.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.763+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=NKOU8WE3IXDY tag=4H2B76QXJ7WW type=write size=2560321 2024-09-14T10:57:50.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.767+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=ASM1MCVTTU00 type=del size=4182334 2024-09-14T10:57:50.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.771+0000 7fdf8f02c8c0 1 < completed delete operation key=XUT55FR490EO tag=X4N42R2AABRA type=del 2024-09-14T10:57:50.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.775+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=2K14I49HYWZ6 type=del size=2086150 2024-09-14T10:57:50.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.779+0000 7fdf8f02c8c0 1 < canceled operation key=APDKRWHOUH9T tag=0KS9W0K7S1HY type=del size=3144306 2024-09-14T10:57:50.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.783+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=01YZETC81K04 type=del size=2601815 2024-09-14T10:57:50.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.787+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~PG14EKG8VOXX.0 size=1048576 2024-09-14T10:57:50.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.791+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~PG14EKG8VOXX.1 size=39827 2024-09-14T10:57:50.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.795+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=PG14EKG8VOXX tag=C0EAZ30ND02T type=write size=2136979 2024-09-14T10:57:50.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.799+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=BH386EG9VDKR type=write size=935571 2024-09-14T10:57:50.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.803+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=45Y3YKN26CUE type=del 2024-09-14T10:57:50.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.811+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~FU5B83OTNMTQ.0 size=139175 2024-09-14T10:57:50.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.811+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=FU5B83OTNMTQ tag=18NRWCLEJT08 type=write size=1187751 2024-09-14T10:57:50.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~9ZD2J91LD43Y.0 size=1048576 2024-09-14T10:57:50.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.819+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~9ZD2J91LD43Y.1 size=207406 2024-09-14T10:57:50.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.823+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=9ZD2J91LD43Y tag=DLWRDCZVM3VE type=write size=2304558 2024-09-14T10:57:50.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~7M0MPI98I3ZO.0 size=480528 2024-09-14T10:57:50.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.831+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=7M0MPI98I3ZO tag=B1MQWVTQDAME type=write size=1529104 2024-09-14T10:57:50.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.835+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~U5ABV05YSDNG.0 size=1048576 2024-09-14T10:57:50.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.839+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~U5ABV05YSDNG.1 size=145932 2024-09-14T10:57:50.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.843+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=U5ABV05YSDNG tag=WIL9QPZW8STC type=write size=2243084 2024-09-14T10:57:50.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.847+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=INL5T6VV16CM type=del size=3176659 2024-09-14T10:57:50.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.851+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~A5E4D7H1K4OM.0 size=421354 2024-09-14T10:57:50.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.859+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=A5E4D7H1K4OM tag=EJR3EPNV5P1S type=write size=1469930 2024-09-14T10:57:50.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.863+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~OB4037E9DR1K.0 size=1048576 2024-09-14T10:57:50.864 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.867+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~OB4037E9DR1K.1 size=504961 2024-09-14T10:57:50.864 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.867+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=OB4037E9DR1K tag=IWTB1ZO0ZQH3 type=write size=2602113 2024-09-14T10:57:50.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.871+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=AYKJE0KQJXIV type=del 2024-09-14T10:57:50.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.875+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=0Y4Z8QUTMFAW type=del size=2337540 2024-09-14T10:57:50.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.879+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=VUTYGWIZBBPD type=del 2024-09-14T10:57:50.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.887+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~9C54QPUVYBFA.0 size=1048576 2024-09-14T10:57:50.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~9C54QPUVYBFA.1 size=788760 2024-09-14T10:57:50.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.891+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=9C54QPUVYBFA tag=1SCQ4S9RWG8X type=write size=2885912 2024-09-14T10:57:50.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.895+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=JEK8CZD8AMJO type=del 2024-09-14T10:57:50.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.899+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~466COITMSRIW.0 size=1048576 2024-09-14T10:57:50.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.903+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~466COITMSRIW.1 size=944568 2024-09-14T10:57:50.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.903+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=466COITMSRIW tag=KXZKBILIQ7EF type=write size=3041720 2024-09-14T10:57:50.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.907+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~YCOKE39369N6.0 size=1048576 2024-09-14T10:57:50.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.907+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~YCOKE39369N6.1 size=671243 2024-09-14T10:57:50.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.915+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=YCOKE39369N6 tag=J91T49YWZM2I type=write size=2768395 2024-09-14T10:57:50.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.919+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=7VFLNGD4K4EK type=del size=2933917 2024-09-14T10:57:50.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.923+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=P4TJZNLGRK9T type=del 2024-09-14T10:57:50.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.927+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=T4M0VDHZSDWZ type=del size=672191 2024-09-14T10:57:50.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.935+0000 7fdf8f02c8c0 1 < suggested remove operation key=STB3W5URFJEZ tag=IYF6GY97YRMB type=del 2024-09-14T10:57:50.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.939+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=U83TXML3DIYM type=del size=4041865 2024-09-14T10:57:50.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.943+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=VRK9SGH9Q9B0 type=del 2024-09-14T10:57:50.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.947+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~9BPO9CTAQKSV.0 size=1048576 2024-09-14T10:57:50.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.951+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~9BPO9CTAQKSV.1 size=265037 2024-09-14T10:57:50.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.951+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=9BPO9CTAQKSV tag=ZTJT2NHNGV2O type=write size=2362189 2024-09-14T10:57:50.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.951+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LMNGCUFR187I.2~TNESZASPUR4R.0 size=4775 2024-09-14T10:57:50.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.959+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LMNGCUFR187I upload=TNESZASPUR4R tag=5V6TSROZT3SU type=write size=1053351 2024-09-14T10:57:50.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.963+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=MJYRZY3Q87QR type=del size=578709 2024-09-14T10:57:50.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.967+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=ASM1MCVTTU00 type=del 2024-09-14T10:57:50.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.971+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=NSA8GAYA0KB4 type=del size=687240 2024-09-14T10:57:50.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.975+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=2K14I49HYWZ6 type=del 2024-09-14T10:57:50.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.979+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=PU01GJ9228YV type=del size=1468143 2024-09-14T10:57:50.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.983+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=01YZETC81K04 type=del 2024-09-14T10:57:50.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.991+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~IZVSQPRKRRW0.0 size=1048576 2024-09-14T10:57:50.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.995+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~IZVSQPRKRRW0.1 size=857379 2024-09-14T10:57:50.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.995+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=IZVSQPRKRRW0 tag=4ZFFT594ZI6Q type=write size=2954531 2024-09-14T10:57:50.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:50.999+0000 7fdf8f02c8c0 1 < completed write operation key=TZZ05IIMZJ4J tag=BH386EG9VDKR type=write size=935571 2024-09-14T10:57:51.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.003+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~USREJY3RY7YE.0 size=1048576 2024-09-14T10:57:51.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.007+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~USREJY3RY7YE.1 size=125623 2024-09-14T10:57:51.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.007+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=USREJY3RY7YE tag=GY281XZ0AYVW type=write size=2222775 2024-09-14T10:57:51.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.011+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~FU5B83OTNMTQ.0 size=139175 2024-09-14T10:57:51.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.019+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=FU5B83OTNMTQ tag=18NRWCLEJT08 type=write size=1187751 2024-09-14T10:57:51.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.027+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~LFJJU4U0QYOJ.0 size=1048576 2024-09-14T10:57:51.024 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.027+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~LFJJU4U0QYOJ.1 size=1048576 2024-09-14T10:57:51.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.031+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~LFJJU4U0QYOJ.2 size=145797 2024-09-14T10:57:51.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.031+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=LFJJU4U0QYOJ tag=6NERHOE1X8HJ type=write size=3291525 2024-09-14T10:57:51.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.035+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~7M0MPI98I3ZO.0 size=480528 2024-09-14T10:57:51.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.039+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=7M0MPI98I3ZO tag=B1MQWVTQDAME type=write size=1529104 2024-09-14T10:57:51.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.043+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=ZKCB8HISTWXC type=del size=1404990 2024-09-14T10:57:51.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.047+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=INL5T6VV16CM type=del 2024-09-14T10:57:51.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.055+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~DWZ67AQB170M.0 size=925240 2024-09-14T10:57:51.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.055+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=DWZ67AQB170M tag=VB0Q0RL5A21Y type=write size=1973816 2024-09-14T10:57:51.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.059+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~OB4037E9DR1K.0 size=1048576 2024-09-14T10:57:51.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.063+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~OB4037E9DR1K.1 size=504961 2024-09-14T10:57:51.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.067+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=OB4037E9DR1K tag=IWTB1ZO0ZQH3 type=write size=2602113 2024-09-14T10:57:51.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.075+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~3Y5BMLM4NBVC.0 size=848056 2024-09-14T10:57:51.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.075+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=3Y5BMLM4NBVC tag=Z5MJM1GNHU44 type=write size=1896632 2024-09-14T10:57:51.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.083+0000 7fdf8f02c8c0 1 < suggested update operation key=HCGZ1MY5SKW9 tag=0Y4Z8QUTMFAW type=del size=2337540 2024-09-14T10:57:51.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.087+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=619HTQ71SSUH type=del size=2859213 2024-09-14T10:57:51.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.091+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~9C54QPUVYBFA.0 size=1048576 2024-09-14T10:57:51.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.095+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~9C54QPUVYBFA.1 size=788760 2024-09-14T10:57:51.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.099+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=9C54QPUVYBFA tag=1SCQ4S9RWG8X type=write size=2885912 2024-09-14T10:57:51.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.111+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~86ZWCU8FA2BM.0 size=1048576 2024-09-14T10:57:51.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.111+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~86ZWCU8FA2BM.1 size=1048576 2024-09-14T10:57:51.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.115+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~86ZWCU8FA2BM.2 size=657554 2024-09-14T10:57:51.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.115+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=86ZWCU8FA2BM tag=2QYRBTD4DTED type=write size=3803282 2024-09-14T10:57:51.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.119+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~466COITMSRIW.0 size=1048576 2024-09-14T10:57:51.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.123+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~466COITMSRIW.1 size=944568 2024-09-14T10:57:51.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.127+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=466COITMSRIW tag=KXZKBILIQ7EF type=write size=3041720 2024-09-14T10:57:51.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.131+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=QNB5FVJEZW31 type=del size=28353 2024-09-14T10:57:51.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.139+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=7VFLNGD4K4EK type=del 2024-09-14T10:57:51.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.143+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~TSTYJZ90C9U0.0 size=1048576 2024-09-14T10:57:51.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.147+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~TSTYJZ90C9U0.1 size=1027110 2024-09-14T10:57:51.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.147+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=TSTYJZ90C9U0 tag=ID1IH9V1G9EU type=write size=3124262 2024-09-14T10:57:51.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.151+0000 7fdf8f02c8c0 1 < completed delete operation key=STHEUJ6VDPQB tag=T4M0VDHZSDWZ type=del 2024-09-14T10:57:51.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.155+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=5YHE2TCY48Z9 type=del size=2366664 2024-09-14T10:57:51.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.159+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=U83TXML3DIYM type=del 2024-09-14T10:57:51.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.167+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~RFSERK19DDO7.0 size=584696 2024-09-14T10:57:51.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.167+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=RFSERK19DDO7 tag=9HPB8G8NIELT type=write size=1633272 2024-09-14T10:57:51.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.171+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~9BPO9CTAQKSV.0 size=1048576 2024-09-14T10:57:51.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.171+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3CYCJJIQ210M.2~9BPO9CTAQKSV.1 size=265037 2024-09-14T10:57:51.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.175+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3CYCJJIQ210M upload=9BPO9CTAQKSV tag=ZTJT2NHNGV2O type=write size=2362189 2024-09-14T10:57:51.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.179+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=7F660OX497HK type=del size=2662360 2024-09-14T10:57:51.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.183+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=MJYRZY3Q87QR type=del 2024-09-14T10:57:51.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.187+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=55FQ876HDR9D type=del size=381525 2024-09-14T10:57:51.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.191+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=NSA8GAYA0KB4 type=del 2024-09-14T10:57:51.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.195+0000 7fdf8f02c8c0 1 > prepared operation key=XUT55FR490EO tag=B74H1E7ZSHQB type=write size=921987 2024-09-14T10:57:51.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.203+0000 7fdf8f02c8c0 1 < suggested remove operation key=YU9DAJA242Q7 tag=PU01GJ9228YV type=del 2024-09-14T10:57:51.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.207+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=U5QBEMEFE3R3 type=del size=3134898 2024-09-14T10:57:51.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.211+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~IZVSQPRKRRW0.0 size=1048576 2024-09-14T10:57:51.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.215+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~IZVSQPRKRRW0.1 size=857379 2024-09-14T10:57:51.217 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.219+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=IZVSQPRKRRW0 tag=4ZFFT594ZI6Q type=write size=2954531 2024-09-14T10:57:51.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.223+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=C13D9YA3Z266 type=write size=773816 2024-09-14T10:57:51.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.227+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~USREJY3RY7YE.0 size=1048576 2024-09-14T10:57:51.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.227+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_APDKRWHOUH9T.2~USREJY3RY7YE.1 size=125623 2024-09-14T10:57:51.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.235+0000 7fdf8f02c8c0 1 < canceled multipart upload key=APDKRWHOUH9T upload=USREJY3RY7YE tag=GY281XZ0AYVW type=write size=2222775 2024-09-14T10:57:51.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.239+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=C1MNDIWCF5E6 type=del size=1098431 2024-09-14T10:57:51.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.243+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~LFJJU4U0QYOJ.0 size=1048576 2024-09-14T10:57:51.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.247+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~LFJJU4U0QYOJ.1 size=1048576 2024-09-14T10:57:51.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.251+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~LFJJU4U0QYOJ.2 size=145797 2024-09-14T10:57:51.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.255+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=LFJJU4U0QYOJ tag=6NERHOE1X8HJ type=write size=3291525 2024-09-14T10:57:51.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.263+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~XQJRLX4RTHHY.0 size=821080 2024-09-14T10:57:51.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.263+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=XQJRLX4RTHHY tag=QS7N4U7VEUCJ type=write size=1869656 2024-09-14T10:57:51.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.267+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=YU9DAJA242Q7 tag=ZKCB8HISTWXC type=del size=1404990: (2) No such file or directory 2024-09-14T10:57:51.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.271+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~HLGFGJE1ABK5.0 size=1048576 2024-09-14T10:57:51.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.275+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~HLGFGJE1ABK5.1 size=1048576 2024-09-14T10:57:51.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.279+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~HLGFGJE1ABK5.2 size=1039194 2024-09-14T10:57:51.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.279+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=HLGFGJE1ABK5 tag=JAR7TA343FMO type=write size=4184922 2024-09-14T10:57:51.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.283+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~DWZ67AQB170M.0 size=925240 2024-09-14T10:57:51.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.291+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=DWZ67AQB170M tag=VB0Q0RL5A21Y type=write size=1973816 2024-09-14T10:57:51.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.299+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~GTXB22EVL6T3.0 size=1048576 2024-09-14T10:57:51.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.299+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~GTXB22EVL6T3.1 size=476475 2024-09-14T10:57:51.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.299+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=GTXB22EVL6T3 tag=YXA8OW8VI8P8 type=write size=2573627 2024-09-14T10:57:51.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.303+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~3Y5BMLM4NBVC.0 size=848056 2024-09-14T10:57:51.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.311+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=3Y5BMLM4NBVC tag=Z5MJM1GNHU44 type=write size=1896632 2024-09-14T10:57:51.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.315+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=VHCLX2SQEC80 type=del size=3230716 2024-09-14T10:57:51.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.315+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=619HTQ71SSUH type=del 2024-09-14T10:57:51.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.323+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~I4IIAGNHQMXH.0 size=289266 2024-09-14T10:57:51.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.323+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=I4IIAGNHQMXH tag=JYIENFSC30TR type=write size=1337842 2024-09-14T10:57:51.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.327+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~86ZWCU8FA2BM.0 size=1048576 2024-09-14T10:57:51.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.331+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~86ZWCU8FA2BM.1 size=1048576 2024-09-14T10:57:51.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.331+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~86ZWCU8FA2BM.2 size=657554 2024-09-14T10:57:51.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.339+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=86ZWCU8FA2BM tag=2QYRBTD4DTED type=write size=3803282 2024-09-14T10:57:51.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~TF2TX5ZN6H5V.0 size=1048576 2024-09-14T10:57:51.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.347+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~TF2TX5ZN6H5V.1 size=453349 2024-09-14T10:57:51.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.347+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=TF2TX5ZN6H5V tag=KFRYUMLH4Z99 type=write size=2550501 2024-09-14T10:57:51.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.355+0000 7fdf8f02c8c0 1 < suggested update operation key=LFLY0V3FRRW5 tag=QNB5FVJEZW31 type=del size=28353 2024-09-14T10:57:51.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.359+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=9ZBSH86RI59Q type=del size=2093780 2024-09-14T10:57:51.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.363+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~TSTYJZ90C9U0.0 size=1048576 2024-09-14T10:57:51.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.367+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~TSTYJZ90C9U0.1 size=1027110 2024-09-14T10:57:51.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.375+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=TSTYJZ90C9U0 tag=ID1IH9V1G9EU type=write size=3124262 2024-09-14T10:57:51.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.379+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=RXEFVLJNJPNA type=del size=2675106 2024-09-14T10:57:51.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.383+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=5YHE2TCY48Z9 type=del 2024-09-14T10:57:51.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.383+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=51WXBW0MJ6XX type=del size=356698 2024-09-14T10:57:51.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.387+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~RFSERK19DDO7.0 size=584696 2024-09-14T10:57:51.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.395+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=RFSERK19DDO7 tag=9HPB8G8NIELT type=write size=1633272 2024-09-14T10:57:51.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.399+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=BZWNB1H5EK1Q type=del size=1789364 2024-09-14T10:57:51.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.407+0000 7fdf8f02c8c0 1 < suggested update operation key=STHEUJ6VDPQB tag=7F660OX497HK type=del size=2662360 2024-09-14T10:57:51.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.415+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~OVTH0UBB2XOX.0 size=1048576 2024-09-14T10:57:51.412 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.415+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~OVTH0UBB2XOX.1 size=1041835 2024-09-14T10:57:51.412 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.415+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=OVTH0UBB2XOX tag=O7HH3A5EID5U type=write size=3138987 2024-09-14T10:57:51.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.419+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=55FQ876HDR9D type=del 2024-09-14T10:57:51.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.427+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~0HCWUUZYWZCK.0 size=1048576 2024-09-14T10:57:51.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.431+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~0HCWUUZYWZCK.1 size=1048576 2024-09-14T10:57:51.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.431+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~0HCWUUZYWZCK.2 size=478922 2024-09-14T10:57:51.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.431+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=0HCWUUZYWZCK tag=V71VK64STHOO type=write size=3624650 2024-09-14T10:57:51.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.435+0000 7fdf8f02c8c0 1 < completed write operation key=XUT55FR490EO tag=B74H1E7ZSHQB type=write size=921987 2024-09-14T10:57:51.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.439+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=YTNQ4ZSIOZPC type=del size=521261 2024-09-14T10:57:51.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.443+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=U5QBEMEFE3R3 type=del 2024-09-14T10:57:51.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.447+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=K3HFXA4MOXGS type=write size=677559 2024-09-14T10:57:51.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.451+0000 7fdf8f02c8c0 1 < completed write operation key=LCEH2YXNSOGT tag=C13D9YA3Z266 type=write size=773816 2024-09-14T10:57:51.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.455+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=DJKJVDT8J3XJ type=write size=996106 2024-09-14T10:57:51.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.459+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=C1MNDIWCF5E6 type=del 2024-09-14T10:57:51.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.467+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=CZ7BROE8BSWC type=del size=3713825 2024-09-14T10:57:51.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.471+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~XQJRLX4RTHHY.0 size=821080 2024-09-14T10:57:51.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.479+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=XQJRLX4RTHHY tag=QS7N4U7VEUCJ type=write size=1869656 2024-09-14T10:57:51.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.483+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=N7OP9MLF34EA type=del size=686925 2024-09-14T10:57:51.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.487+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~HLGFGJE1ABK5.0 size=1048576 2024-09-14T10:57:51.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.487+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~HLGFGJE1ABK5.1 size=1048576 2024-09-14T10:57:51.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.491+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~HLGFGJE1ABK5.2 size=1039194 2024-09-14T10:57:51.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.499+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=HLGFGJE1ABK5 tag=JAR7TA343FMO type=write size=4184922 2024-09-14T10:57:51.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.507+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~SH7D3REUYVZO.0 size=1048576 2024-09-14T10:57:51.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.507+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~SH7D3REUYVZO.1 size=889910 2024-09-14T10:57:51.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.507+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=SH7D3REUYVZO tag=Y89PBZAJ7EAI type=write size=2987062 2024-09-14T10:57:51.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.511+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STHEUJ6VDPQB.2~GTXB22EVL6T3.0 size=1048576 2024-09-14T10:57:51.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.511+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~GTXB22EVL6T3.1 size=476475 2024-09-14T10:57:51.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.519+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STHEUJ6VDPQB upload=GTXB22EVL6T3 tag=YXA8OW8VI8P8 type=write size=2573627 2024-09-14T10:57:51.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.527+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~4TDCZMPCWSPL.0 size=1048576 2024-09-14T10:57:51.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.531+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~4TDCZMPCWSPL.1 size=763017 2024-09-14T10:57:51.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.531+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=4TDCZMPCWSPL tag=OQY7CIAQ244O type=write size=2860169 2024-09-14T10:57:51.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.535+0000 7fdf8f02c8c0 -1 < failed to complete operation key=LFLY0V3FRRW5 tag=VHCLX2SQEC80 type=del size=3230716: (22) Invalid argument 2024-09-14T10:57:51.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.539+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=8U4VC6210APT type=del size=2142060 2024-09-14T10:57:51.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.543+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~I4IIAGNHQMXH.0 size=289266 2024-09-14T10:57:51.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.547+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=I4IIAGNHQMXH tag=JYIENFSC30TR type=write size=1337842 2024-09-14T10:57:51.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.551+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=E3N8S6NJAFEH type=del size=1301651 2024-09-14T10:57:51.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.555+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~TF2TX5ZN6H5V.0 size=1048576 2024-09-14T10:57:51.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.559+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~TF2TX5ZN6H5V.1 size=453349 2024-09-14T10:57:51.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.563+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=TF2TX5ZN6H5V tag=KFRYUMLH4Z99 type=write size=2550501 2024-09-14T10:57:51.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.567+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=5Y51MSIHW4ZL type=del size=1655560 2024-09-14T10:57:51.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.571+0000 7fdf8f02c8c0 1 < canceled operation key=9IDBODZBQRJR tag=9ZBSH86RI59Q type=del size=2093780 2024-09-14T10:57:51.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.579+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~4WIQJHPCSYHI.0 size=518813 2024-09-14T10:57:51.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.579+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=4WIQJHPCSYHI tag=71NRGCB7EKK3 type=write size=1567389 2024-09-14T10:57:51.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.583+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=RXEFVLJNJPNA type=del 2024-09-14T10:57:51.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.587+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=16IVZDN8KHPS type=del size=2722413 2024-09-14T10:57:51.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.591+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=51WXBW0MJ6XX type=del 2024-09-14T10:57:51.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.591+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=K0M1NHVKD4KL type=del size=337363 2024-09-14T10:57:51.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.599+0000 7fdf8f02c8c0 1 < suggested remove operation key=49O8DPTGA65S tag=BZWNB1H5EK1Q type=del 2024-09-14T10:57:51.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.603+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=W71G889GR082 type=del size=1714743 2024-09-14T10:57:51.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.607+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~OVTH0UBB2XOX.0 size=1048576 2024-09-14T10:57:51.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.607+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~OVTH0UBB2XOX.1 size=1041835 2024-09-14T10:57:51.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.615+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=OVTH0UBB2XOX tag=O7HH3A5EID5U type=write size=3138987 2024-09-14T10:57:51.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.619+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~0BFD5FHFKA3P.0 size=90506 2024-09-14T10:57:51.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.619+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=0BFD5FHFKA3P tag=RBF6PY00UT56 type=write size=1139082 2024-09-14T10:57:51.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.623+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~0HCWUUZYWZCK.0 size=1048576 2024-09-14T10:57:51.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.627+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~0HCWUUZYWZCK.1 size=1048576 2024-09-14T10:57:51.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.631+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~0HCWUUZYWZCK.2 size=478922 2024-09-14T10:57:51.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.635+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=0HCWUUZYWZCK tag=V71VK64STHOO type=write size=3624650 2024-09-14T10:57:51.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.643+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~AG42HBDASAGF.0 size=1048576 2024-09-14T10:57:51.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.647+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~AG42HBDASAGF.1 size=614128 2024-09-14T10:57:51.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.647+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=AG42HBDASAGF tag=6VQTZJR0TEEG type=write size=2711280 2024-09-14T10:57:51.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.655+0000 7fdf8f02c8c0 1 < suggested update operation key=YU9DAJA242Q7 tag=YTNQ4ZSIOZPC type=del size=521261 2024-09-14T10:57:51.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.659+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=PN8JHUWBK286 type=del size=843800 2024-09-14T10:57:51.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.659+0000 7fdf8f02c8c0 1 < completed write operation key=0QJLAH0EPKVD tag=K3HFXA4MOXGS type=write size=677559 2024-09-14T10:57:51.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.667+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~CL40SS8WTBA3.0 size=1048576 2024-09-14T10:57:51.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.671+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~CL40SS8WTBA3.1 size=621589 2024-09-14T10:57:51.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.671+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=CL40SS8WTBA3 tag=XW0GQQDLLXWP type=write size=2718741 2024-09-14T10:57:51.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.675+0000 7fdf8f02c8c0 1 < completed write operation key=OFY1G5R28CK6 tag=DJKJVDT8J3XJ type=write size=996106 2024-09-14T10:57:51.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.679+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=6IR9QJ60X8M8 type=del size=3678445 2024-09-14T10:57:51.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.687+0000 7fdf8f02c8c0 1 < suggested update operation key=APDKRWHOUH9T tag=CZ7BROE8BSWC type=del size=3713825 2024-09-14T10:57:51.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.691+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~S8SIJRSXGB5Y.0 size=1048576 2024-09-14T10:57:51.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.695+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~S8SIJRSXGB5Y.1 size=905655 2024-09-14T10:57:51.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.695+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=S8SIJRSXGB5Y tag=0W02QY2IZ8KH type=write size=3002807 2024-09-14T10:57:51.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.699+0000 7fdf8f02c8c0 1 < canceled operation key=0QJLAH0EPKVD tag=N7OP9MLF34EA type=del size=686925 2024-09-14T10:57:51.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.703+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=D6N2D2I8LMMX type=del size=3170873 2024-09-14T10:57:51.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.707+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~SH7D3REUYVZO.0 size=1048576 2024-09-14T10:57:51.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.711+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~SH7D3REUYVZO.1 size=889910 2024-09-14T10:57:51.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.715+0000 7fdf8f02c8c0 1 < completed multipart upload key=LCEH2YXNSOGT upload=SH7D3REUYVZO tag=Y89PBZAJ7EAI type=write size=2987062 2024-09-14T10:57:51.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.719+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=4F0X4X3WY4G2 type=del size=1040721 2024-09-14T10:57:51.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.723+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~4TDCZMPCWSPL.0 size=1048576 2024-09-14T10:57:51.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.727+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~4TDCZMPCWSPL.1 size=763017 2024-09-14T10:57:51.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.731+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=4TDCZMPCWSPL tag=OQY7CIAQ244O type=write size=2860169 2024-09-14T10:57:51.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.735+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=GMQ804YDBHRC type=del size=3961886 2024-09-14T10:57:51.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.739+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=8U4VC6210APT type=del 2024-09-14T10:57:51.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.743+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=V210WBG1PPH8 type=write size=554033 2024-09-14T10:57:51.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.747+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=E3N8S6NJAFEH type=del 2024-09-14T10:57:51.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.751+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=B5H9YM76DZ2R type=del size=2404703 2024-09-14T10:57:51.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.755+0000 7fdf8f02c8c0 -1 < failed to complete operation key=49O8DPTGA65S tag=5Y51MSIHW4ZL type=del size=1655560: (22) Invalid argument 2024-09-14T10:57:51.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.759+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=HQO16R6ACY2K type=write size=213466 2024-09-14T10:57:51.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.763+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~4WIQJHPCSYHI.0 size=518813 2024-09-14T10:57:51.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.771+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=4WIQJHPCSYHI tag=71NRGCB7EKK3 type=write size=1567389 2024-09-14T10:57:51.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.775+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=ARDUBTQMZ7FT type=del size=2850123 2024-09-14T10:57:51.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.779+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=16IVZDN8KHPS type=del 2024-09-14T10:57:51.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.783+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~A4P29CD7BPEE.0 size=1048576 2024-09-14T10:57:51.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.787+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~A4P29CD7BPEE.1 size=1048576 2024-09-14T10:57:51.787 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.791+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~A4P29CD7BPEE.2 size=479373 2024-09-14T10:57:51.787 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.791+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=A4P29CD7BPEE tag=E31GL7ADHWDW type=write size=3625101 2024-09-14T10:57:51.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.795+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=K0M1NHVKD4KL type=del 2024-09-14T10:57:51.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.803+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~4RU8U76JMPV6.0 size=666675 2024-09-14T10:57:51.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.803+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=4RU8U76JMPV6 tag=CIMTVKHW1NWX type=write size=1715251 2024-09-14T10:57:51.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.807+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=W71G889GR082 type=del 2024-09-14T10:57:51.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.811+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=E3IZKWPYTL47 type=del size=1157055 2024-09-14T10:57:51.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~0BFD5FHFKA3P.0 size=90506 2024-09-14T10:57:51.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.823+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=0BFD5FHFKA3P tag=RBF6PY00UT56 type=write size=1139082 2024-09-14T10:57:51.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.827+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=OA1VZVRFO9IL type=del size=1885290 2024-09-14T10:57:51.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.831+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~AG42HBDASAGF.0 size=1048576 2024-09-14T10:57:51.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.835+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~AG42HBDASAGF.1 size=614128 2024-09-14T10:57:51.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.843+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=AG42HBDASAGF tag=6VQTZJR0TEEG type=write size=2711280 2024-09-14T10:57:51.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.847+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=96NP5GK40N0Q type=del size=170145 2024-09-14T10:57:51.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.851+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=PN8JHUWBK286 type=del 2024-09-14T10:57:51.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.855+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=9T573GR6XNBA type=del size=2441196 2024-09-14T10:57:51.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.855+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STHEUJ6VDPQB.2~CL40SS8WTBA3.0 size=1048576 2024-09-14T10:57:51.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.859+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~CL40SS8WTBA3.1 size=621589 2024-09-14T10:57:51.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.863+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STHEUJ6VDPQB upload=CL40SS8WTBA3 tag=XW0GQQDLLXWP type=write size=2718741 2024-09-14T10:57:51.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.871+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~B7G4SG38JH0R.0 size=1048576 2024-09-14T10:57:51.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.871+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~B7G4SG38JH0R.1 size=1048576 2024-09-14T10:57:51.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.875+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~B7G4SG38JH0R.2 size=289015 2024-09-14T10:57:51.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.875+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=B7G4SG38JH0R tag=TTP3ICTM5OQP type=write size=3434743 2024-09-14T10:57:51.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.879+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=6IR9QJ60X8M8 type=del 2024-09-14T10:57:51.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.883+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=47KXCRZG216Z type=del size=1885899 2024-09-14T10:57:51.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.887+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~S8SIJRSXGB5Y.0 size=1048576 2024-09-14T10:57:51.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.887+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~S8SIJRSXGB5Y.1 size=905655 2024-09-14T10:57:51.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.895+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=S8SIJRSXGB5Y tag=0W02QY2IZ8KH type=write size=3002807 2024-09-14T10:57:51.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.899+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=ZPMRWBH6ES76 type=del size=1492808 2024-09-14T10:57:51.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.907+0000 7fdf8f02c8c0 1 < suggested update operation key=X1BN3054IKNS tag=D6N2D2I8LMMX type=del size=3170873 2024-09-14T10:57:51.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.911+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=GQMY2RUGOHA1 type=write size=363593 2024-09-14T10:57:51.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.919+0000 7fdf8f02c8c0 1 < suggested update operation key=0QJLAH0EPKVD tag=4F0X4X3WY4G2 type=del size=1040721 2024-09-14T10:57:51.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~29VWODB37IMK.0 size=1048576 2024-09-14T10:57:51.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.927+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~29VWODB37IMK.1 size=114885 2024-09-14T10:57:51.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.927+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=29VWODB37IMK tag=ZR71SY5RFXEN type=write size=2212037 2024-09-14T10:57:51.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.931+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=GMQ804YDBHRC type=del 2024-09-14T10:57:51.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.935+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=32CEGB0KEM5N type=del size=117268 2024-09-14T10:57:51.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.939+0000 7fdf8f02c8c0 1 < completed write operation key=3T0H42SC1ETB tag=V210WBG1PPH8 type=write size=554033 2024-09-14T10:57:51.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.943+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=E80INCTA9M92 type=del size=318302 2024-09-14T10:57:51.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.947+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=B5H9YM76DZ2R type=del 2024-09-14T10:57:51.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.955+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~7ZEPM13LVNQV.0 size=1048576 2024-09-14T10:57:51.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.959+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~7ZEPM13LVNQV.1 size=1048576 2024-09-14T10:57:51.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.959+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~7ZEPM13LVNQV.2 size=715302 2024-09-14T10:57:51.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.959+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=7ZEPM13LVNQV tag=7B4Y0B5DUECM type=write size=3861030 2024-09-14T10:57:51.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.963+0000 7fdf8f02c8c0 1 < completed write operation key=KVZEUYUSV5JI tag=HQO16R6ACY2K type=write size=213466 2024-09-14T10:57:51.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.967+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=DVUH7SXBI60B type=del size=3266290 2024-09-14T10:57:51.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.971+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=ARDUBTQMZ7FT type=del 2024-09-14T10:57:51.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.979+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=WF2KDF070914 type=del size=1498438 2024-09-14T10:57:51.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.983+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~A4P29CD7BPEE.0 size=1048576 2024-09-14T10:57:51.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.983+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~A4P29CD7BPEE.1 size=1048576 2024-09-14T10:57:51.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.987+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~A4P29CD7BPEE.2 size=479373 2024-09-14T10:57:51.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.995+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=A4P29CD7BPEE tag=E31GL7ADHWDW type=write size=3625101 2024-09-14T10:57:51.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:51.999+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=Z228E34DO391 type=del size=994255 2024-09-14T10:57:51.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.003+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~4RU8U76JMPV6.0 size=666675 2024-09-14T10:57:52.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.007+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=4RU8U76JMPV6 tag=CIMTVKHW1NWX type=write size=1715251 2024-09-14T10:57:52.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.011+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=TCYYQ6J024V7 type=del size=3705462 2024-09-14T10:57:52.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.019+0000 7fdf8f02c8c0 1 < suggested update operation key=1E72V12EPEH3 tag=E3IZKWPYTL47 type=del size=1157055 2024-09-14T10:57:52.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.023+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=OM60RRW0PUIN type=del size=82193 2024-09-14T10:57:52.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.027+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=OA1VZVRFO9IL type=del 2024-09-14T10:57:52.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.027+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=86MH8S4FBG3U type=write size=379090 2024-09-14T10:57:52.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.031+0000 7fdf8f02c8c0 1 < canceled operation key=HCGZ1MY5SKW9 tag=96NP5GK40N0Q type=del size=170145 2024-09-14T10:57:52.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.035+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=VMNKABQ3AETX type=write size=47763 2024-09-14T10:57:52.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.039+0000 7fdf8f02c8c0 1 < canceled operation key=6VNI8FMHZ0FN tag=9T573GR6XNBA type=del size=2441196 2024-09-14T10:57:52.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.047+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~1Y4Y8JHJXHTU.0 size=1048576 2024-09-14T10:57:52.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.051+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~1Y4Y8JHJXHTU.1 size=658890 2024-09-14T10:57:52.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.051+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=1Y4Y8JHJXHTU tag=XQ5113HBD05A type=write size=2756042 2024-09-14T10:57:52.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.055+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~B7G4SG38JH0R.0 size=1048576 2024-09-14T10:57:52.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.055+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3QSOKUSZ57QM.2~B7G4SG38JH0R.1 size=1048576 2024-09-14T10:57:52.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.055+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3QSOKUSZ57QM.2~B7G4SG38JH0R.2 size=289015 2024-09-14T10:57:52.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.059+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3QSOKUSZ57QM upload=B7G4SG38JH0R tag=TTP3ICTM5OQP type=write size=3434743 2024-09-14T10:57:52.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.063+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=UOJZ7Q8D2VH3 type=del size=91553 2024-09-14T10:57:52.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.071+0000 7fdf8f02c8c0 1 < suggested update operation key=9IDBODZBQRJR tag=47KXCRZG216Z type=del size=1885899 2024-09-14T10:57:52.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.075+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=G0N8EIOYVNWN type=write size=234013 2024-09-14T10:57:52.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.079+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=ZPMRWBH6ES76 type=del 2024-09-14T10:57:52.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.087+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~AG5KQYXRRK3S.0 size=1048576 2024-09-14T10:57:52.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.091+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~AG5KQYXRRK3S.1 size=1048576 2024-09-14T10:57:52.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.091+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~AG5KQYXRRK3S.2 size=466367 2024-09-14T10:57:52.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.091+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=AG5KQYXRRK3S tag=TPO8GY1UCIWF type=write size=3612095 2024-09-14T10:57:52.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.095+0000 7fdf8f02c8c0 1 < completed write operation key=KVZEUYUSV5JI tag=GQMY2RUGOHA1 type=write size=363593 2024-09-14T10:57:52.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.103+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=3QDP5O2S3LU6 type=del size=1480992 2024-09-14T10:57:52.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.107+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~29VWODB37IMK.0 size=1048576 2024-09-14T10:57:52.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.107+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~29VWODB37IMK.1 size=114885 2024-09-14T10:57:52.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.115+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=29VWODB37IMK tag=ZR71SY5RFXEN type=write size=2212037 2024-09-14T10:57:52.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.119+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=CDEZD9TUCUCM type=del size=4124174 2024-09-14T10:57:52.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.123+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=32CEGB0KEM5N type=del 2024-09-14T10:57:52.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.131+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~NM6K4CMDZJD7.0 size=1048576 2024-09-14T10:57:52.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.131+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~NM6K4CMDZJD7.1 size=1048576 2024-09-14T10:57:52.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.135+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~NM6K4CMDZJD7.2 size=192169 2024-09-14T10:57:52.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.135+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=NM6K4CMDZJD7 tag=GSTKW1DYWR1H type=write size=3337897 2024-09-14T10:57:52.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.143+0000 7fdf8f02c8c0 1 < suggested update operation key=9IDBODZBQRJR tag=E80INCTA9M92 type=del size=318302 2024-09-14T10:57:52.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~P6LFZYJC4KYY.0 size=1048576 2024-09-14T10:57:52.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.151+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~P6LFZYJC4KYY.1 size=288179 2024-09-14T10:57:52.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.151+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=P6LFZYJC4KYY tag=Q42KVI1BTNVX type=write size=2385331 2024-09-14T10:57:52.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.155+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~7ZEPM13LVNQV.0 size=1048576 2024-09-14T10:57:52.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.159+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~7ZEPM13LVNQV.1 size=1048576 2024-09-14T10:57:52.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.163+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~7ZEPM13LVNQV.2 size=715302 2024-09-14T10:57:52.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.167+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=7ZEPM13LVNQV tag=7B4Y0B5DUECM type=write size=3861030 2024-09-14T10:57:52.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.175+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=WW07B0OQY3J8 type=write size=617142 2024-09-14T10:57:52.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.183+0000 7fdf8f02c8c0 1 < suggested update operation key=L1ERJ0JSRDMG tag=DVUH7SXBI60B type=del size=3266290 2024-09-14T10:57:52.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.187+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=VHTXCONC65MB type=del size=1291529 2024-09-14T10:57:52.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.191+0000 7fdf8f02c8c0 1 < suggested update operation key=X1BN3054IKNS tag=WF2KDF070914 type=del size=1498438 2024-09-14T10:57:52.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.199+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~R31NJ33L4GKN.0 size=1048576 2024-09-14T10:57:52.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.203+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~R31NJ33L4GKN.1 size=1048576 2024-09-14T10:57:52.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.207+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~R31NJ33L4GKN.2 size=986289 2024-09-14T10:57:52.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.207+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=R31NJ33L4GKN tag=8N30OU700KNN type=write size=4132017 2024-09-14T10:57:52.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.207+0000 7fdf8f02c8c0 1 < canceled operation key=APDKRWHOUH9T tag=Z228E34DO391 type=del size=994255 2024-09-14T10:57:52.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.211+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=2IDKOEQ7NPER type=write size=16825 2024-09-14T10:57:52.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.219+0000 7fdf8f02c8c0 1 < suggested remove operation key=HCGZ1MY5SKW9 tag=TCYYQ6J024V7 type=del 2024-09-14T10:57:52.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.227+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~4X2DB34EWCPR.0 size=1048576 2024-09-14T10:57:52.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.227+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~4X2DB34EWCPR.1 size=512279 2024-09-14T10:57:52.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.227+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=4X2DB34EWCPR tag=JV53VODB5GN3 type=write size=2609431 2024-09-14T10:57:52.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.231+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=OM60RRW0PUIN type=del 2024-09-14T10:57:52.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.235+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=XOI6ABR1BVN0 type=del size=1468933 2024-09-14T10:57:52.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.239+0000 7fdf8f02c8c0 1 < completed write operation key=ZF6IDD8B3CFO tag=86MH8S4FBG3U type=write size=379090 2024-09-14T10:57:52.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.247+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~UH60207R96MS.0 size=1048576 2024-09-14T10:57:52.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.247+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~UH60207R96MS.1 size=1048576 2024-09-14T10:57:52.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.251+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~UH60207R96MS.2 size=371190 2024-09-14T10:57:52.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.251+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=UH60207R96MS tag=7AGTLNNJ81RV type=write size=3516918 2024-09-14T10:57:52.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.259+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=VMNKABQ3AETX type=write size=47763 2024-09-14T10:57:52.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.267+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~204KX7UJH2OT.0 size=1048576 2024-09-14T10:57:52.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.267+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~204KX7UJH2OT.1 size=1048576 2024-09-14T10:57:52.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.271+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~204KX7UJH2OT.2 size=441705 2024-09-14T10:57:52.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.271+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=204KX7UJH2OT tag=BXD3T7KUXQGL type=write size=3587433 2024-09-14T10:57:52.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.275+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~1Y4Y8JHJXHTU.0 size=1048576 2024-09-14T10:57:52.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.279+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~1Y4Y8JHJXHTU.1 size=658890 2024-09-14T10:57:52.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.283+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=1Y4Y8JHJXHTU tag=XQ5113HBD05A type=write size=2756042 2024-09-14T10:57:52.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.287+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=XDTU2PNQKO7N type=del size=1395986 2024-09-14T10:57:52.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.291+0000 7fdf8f02c8c0 1 < completed delete operation key=Y32RWGISRBMT tag=UOJZ7Q8D2VH3 type=del 2024-09-14T10:57:52.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.295+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=UPH8H0OQC6OM type=del size=3194943 2024-09-14T10:57:52.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.299+0000 7fdf8f02c8c0 1 < completed write operation key=STHEUJ6VDPQB tag=G0N8EIOYVNWN type=write size=234013 2024-09-14T10:57:52.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.303+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=Z0B2FG4JKU0V type=del size=2482519 2024-09-14T10:57:52.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.307+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~AG5KQYXRRK3S.0 size=1048576 2024-09-14T10:57:52.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.307+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~AG5KQYXRRK3S.1 size=1048576 2024-09-14T10:57:52.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.311+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~AG5KQYXRRK3S.2 size=466367 2024-09-14T10:57:52.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.319+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=AG5KQYXRRK3S tag=TPO8GY1UCIWF type=write size=3612095 2024-09-14T10:57:52.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.319+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=9HIL58LXVOAI type=del size=2091792 2024-09-14T10:57:52.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.323+0000 7fdf8f02c8c0 -1 < failed to complete operation key=9IDBODZBQRJR tag=3QDP5O2S3LU6 type=del size=1480992: (22) Invalid argument 2024-09-14T10:57:52.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.331+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~A0A2NJZWQF9E.0 size=1048576 2024-09-14T10:57:52.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.335+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~A0A2NJZWQF9E.1 size=658546 2024-09-14T10:57:52.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.335+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=A0A2NJZWQF9E tag=6ZO7RMXJLKU2 type=write size=2755698 2024-09-14T10:57:52.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.339+0000 7fdf8f02c8c0 -1 < failed to complete operation key=HCGZ1MY5SKW9 tag=CDEZD9TUCUCM type=del size=4124174: (22) Invalid argument 2024-09-14T10:57:52.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.343+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~S4WBHAKF238T.0 size=566222 2024-09-14T10:57:52.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.343+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=S4WBHAKF238T tag=F673FP5210JR type=write size=1614798 2024-09-14T10:57:52.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.347+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_3QSOKUSZ57QM.2~NM6K4CMDZJD7.0 size=1048576 2024-09-14T10:57:52.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.351+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~NM6K4CMDZJD7.1 size=1048576 2024-09-14T10:57:52.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.351+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~NM6K4CMDZJD7.2 size=192169 2024-09-14T10:57:52.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.359+0000 7fdf8f02c8c0 1 < canceled multipart upload key=3QSOKUSZ57QM upload=NM6K4CMDZJD7 tag=GSTKW1DYWR1H type=write size=3337897 2024-09-14T10:57:52.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.363+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=QP6UO85UV2E3 type=del size=3205320 2024-09-14T10:57:52.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.367+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~P6LFZYJC4KYY.0 size=1048576 2024-09-14T10:57:52.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.367+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_0QJLAH0EPKVD.2~P6LFZYJC4KYY.1 size=288179 2024-09-14T10:57:52.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.371+0000 7fdf8f02c8c0 1 < canceled multipart upload key=0QJLAH0EPKVD upload=P6LFZYJC4KYY tag=Q42KVI1BTNVX type=write size=2385331 2024-09-14T10:57:52.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.375+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~FZY9WEUFNFFU.0 size=1048576 2024-09-14T10:57:52.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.379+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~FZY9WEUFNFFU.1 size=898913 2024-09-14T10:57:52.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.379+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=FZY9WEUFNFFU tag=H7IAXWGYN793 type=write size=2996065 2024-09-14T10:57:52.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.383+0000 7fdf8f02c8c0 1 < canceled operation key=6VNI8FMHZ0FN tag=WW07B0OQY3J8 type=write size=617142 2024-09-14T10:57:52.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.387+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=AT659D5601BN type=del size=581942 2024-09-14T10:57:52.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.391+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=VHTXCONC65MB type=del 2024-09-14T10:57:52.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.399+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~I6EW5RJ8U8XM.0 size=1048576 2024-09-14T10:57:52.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.399+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~I6EW5RJ8U8XM.1 size=878560 2024-09-14T10:57:52.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.399+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=I6EW5RJ8U8XM tag=3VB3VLOP44IR type=write size=2975712 2024-09-14T10:57:52.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.403+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~R31NJ33L4GKN.0 size=1048576 2024-09-14T10:57:52.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.407+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~R31NJ33L4GKN.1 size=1048576 2024-09-14T10:57:52.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.411+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~R31NJ33L4GKN.2 size=986289 2024-09-14T10:57:52.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.415+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=R31NJ33L4GKN tag=8N30OU700KNN type=write size=4132017 2024-09-14T10:57:52.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.423+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~3JI7Q5OVFDC9.0 size=591240 2024-09-14T10:57:52.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.423+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=3JI7Q5OVFDC9 tag=0O6SN5JP6QP6 type=write size=1639816 2024-09-14T10:57:52.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.427+0000 7fdf8f02c8c0 1 < canceled operation key=ZSBCGOXXJ0D5 tag=2IDKOEQ7NPER type=write size=16825 2024-09-14T10:57:52.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.427+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=Q3NNES1ECTY3 type=del size=4010295 2024-09-14T10:57:52.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.431+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~4X2DB34EWCPR.0 size=1048576 2024-09-14T10:57:52.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.435+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~4X2DB34EWCPR.1 size=512279 2024-09-14T10:57:52.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.443+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=4X2DB34EWCPR tag=JV53VODB5GN3 type=write size=2609431 2024-09-14T10:57:52.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.447+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=GDX2FK61V9UH type=write size=647812 2024-09-14T10:57:52.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.451+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=XOI6ABR1BVN0 type=del 2024-09-14T10:57:52.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.455+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=JKUYIZ4KSK02 type=del size=3171471 2024-09-14T10:57:52.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.459+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~UH60207R96MS.0 size=1048576 2024-09-14T10:57:52.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.463+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~UH60207R96MS.1 size=1048576 2024-09-14T10:57:52.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.467+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~UH60207R96MS.2 size=371190 2024-09-14T10:57:52.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.471+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=UH60207R96MS tag=7AGTLNNJ81RV type=write size=3516918 2024-09-14T10:57:52.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.475+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=G3BD3TW7324E type=del size=2997646 2024-09-14T10:57:52.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.479+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~204KX7UJH2OT.0 size=1048576 2024-09-14T10:57:52.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.483+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~204KX7UJH2OT.1 size=1048576 2024-09-14T10:57:52.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.487+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~204KX7UJH2OT.2 size=441705 2024-09-14T10:57:52.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.495+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=204KX7UJH2OT tag=BXD3T7KUXQGL type=write size=3587433 2024-09-14T10:57:52.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.499+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=3H3P5380ZVFH type=del size=2249685 2024-09-14T10:57:52.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.507+0000 7fdf8f02c8c0 1 < suggested update operation key=ZSBCGOXXJ0D5 tag=XDTU2PNQKO7N type=del size=1395986 2024-09-14T10:57:52.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.515+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~AKLXTLN22B0N.0 size=1048576 2024-09-14T10:57:52.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.519+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~AKLXTLN22B0N.1 size=1013428 2024-09-14T10:57:52.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.519+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=AKLXTLN22B0N tag=DB042FZ9L2XE type=write size=3110580 2024-09-14T10:57:52.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.523+0000 7fdf8f02c8c0 1 < canceled operation key=82N2FPU7LKTG tag=UPH8H0OQC6OM type=del size=3194943 2024-09-14T10:57:52.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.527+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=QMZGUGTTUWN3 type=del size=219506 2024-09-14T10:57:52.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.531+0000 7fdf8f02c8c0 -1 < failed to complete operation key=ZSBCGOXXJ0D5 tag=Z0B2FG4JKU0V type=del size=2482519: (22) Invalid argument 2024-09-14T10:57:52.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.539+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~83892T1HSSYB.0 size=1048576 2024-09-14T10:57:52.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.539+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~83892T1HSSYB.1 size=501540 2024-09-14T10:57:52.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.539+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=83892T1HSSYB tag=IYSFN11YO5W0 type=write size=2598692 2024-09-14T10:57:52.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.543+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=9HIL58LXVOAI type=del 2024-09-14T10:57:52.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.547+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=0RN8OBIZS4A0 type=del size=2109830 2024-09-14T10:57:52.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.551+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~A0A2NJZWQF9E.0 size=1048576 2024-09-14T10:57:52.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.555+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~A0A2NJZWQF9E.1 size=658546 2024-09-14T10:57:52.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.559+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=A0A2NJZWQF9E tag=6ZO7RMXJLKU2 type=write size=2755698 2024-09-14T10:57:52.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.567+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~T8O58EGMP36F.0 size=1048576 2024-09-14T10:57:52.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~T8O58EGMP36F.1 size=1048576 2024-09-14T10:57:52.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.571+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~T8O58EGMP36F.2 size=304949 2024-09-14T10:57:52.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.571+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=T8O58EGMP36F tag=R7OFPJJ0ZOO6 type=write size=3450677 2024-09-14T10:57:52.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.575+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~S4WBHAKF238T.0 size=566222 2024-09-14T10:57:52.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.583+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=S4WBHAKF238T tag=F673FP5210JR type=write size=1614798 2024-09-14T10:57:52.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.587+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=7QZ88F3J4MDQ type=del size=1091189 2024-09-14T10:57:52.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.591+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=QP6UO85UV2E3 type=del 2024-09-14T10:57:52.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.595+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=X3D59IN71ROK type=del size=3576688 2024-09-14T10:57:52.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.599+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~FZY9WEUFNFFU.0 size=1048576 2024-09-14T10:57:52.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.603+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~FZY9WEUFNFFU.1 size=898913 2024-09-14T10:57:52.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.607+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=FZY9WEUFNFFU tag=H7IAXWGYN793 type=write size=2996065 2024-09-14T10:57:52.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.615+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~RX4DC74EE0P1.0 size=1048576 2024-09-14T10:57:52.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.619+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~RX4DC74EE0P1.1 size=1048576 2024-09-14T10:57:52.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.619+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~RX4DC74EE0P1.2 size=942507 2024-09-14T10:57:52.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.619+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=RX4DC74EE0P1 tag=V0AK7J3JI406 type=write size=4088235 2024-09-14T10:57:52.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.623+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=AT659D5601BN type=del 2024-09-14T10:57:52.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.631+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~DAR7Y3D2CEG4.0 size=1048576 2024-09-14T10:57:52.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.635+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~DAR7Y3D2CEG4.1 size=784290 2024-09-14T10:57:52.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.635+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=DAR7Y3D2CEG4 tag=OGJDF5SEQ525 type=write size=2881442 2024-09-14T10:57:52.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.639+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~I6EW5RJ8U8XM.0 size=1048576 2024-09-14T10:57:52.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.643+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~I6EW5RJ8U8XM.1 size=878560 2024-09-14T10:57:52.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.647+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=I6EW5RJ8U8XM tag=3VB3VLOP44IR type=write size=2975712 2024-09-14T10:57:52.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.655+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~FW2RTDS3EFZ1.0 size=336952 2024-09-14T10:57:52.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.655+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=FW2RTDS3EFZ1 tag=4FKDTYPQ07CY type=write size=1385528 2024-09-14T10:57:52.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.659+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~3JI7Q5OVFDC9.0 size=591240 2024-09-14T10:57:52.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.663+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=3JI7Q5OVFDC9 tag=0O6SN5JP6QP6 type=write size=1639816 2024-09-14T10:57:52.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.667+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=HF7NJZM3ZO5R type=del size=3495082 2024-09-14T10:57:52.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.671+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=Q3NNES1ECTY3 type=del 2024-09-14T10:57:52.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.675+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=K7BSDJPDWNJE type=del size=3653579 2024-09-14T10:57:52.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.679+0000 7fdf8f02c8c0 1 < completed write operation key=X1BN3054IKNS tag=GDX2FK61V9UH type=write size=647812 2024-09-14T10:57:52.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.683+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=B50L58WNAYMC type=write size=475557 2024-09-14T10:57:52.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.687+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=JKUYIZ4KSK02 type=del 2024-09-14T10:57:52.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.691+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=B63UQUEEEXAF type=del size=1423362 2024-09-14T10:57:52.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.695+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=G3BD3TW7324E type=del 2024-09-14T10:57:52.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.699+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=R24QCOG9KQJX type=del size=2712027 2024-09-14T10:57:52.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.707+0000 7fdf8f02c8c0 1 < suggested update operation key=WA7HE8ZJ1W1M tag=3H3P5380ZVFH type=del size=2249685 2024-09-14T10:57:52.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.711+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=80J7PIEQKBKR type=del size=608592 2024-09-14T10:57:52.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.715+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~AKLXTLN22B0N.0 size=1048576 2024-09-14T10:57:52.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.715+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~AKLXTLN22B0N.1 size=1013428 2024-09-14T10:57:52.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.723+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=AKLXTLN22B0N tag=DB042FZ9L2XE type=write size=3110580 2024-09-14T10:57:52.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.727+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=M5RLFYV7RGKD type=del size=4065962 2024-09-14T10:57:52.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.731+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=QMZGUGTTUWN3 type=del 2024-09-14T10:57:52.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.735+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=7JVTRQUF1A3M type=del size=2556759 2024-09-14T10:57:52.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.739+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~83892T1HSSYB.0 size=1048576 2024-09-14T10:57:52.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.739+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~83892T1HSSYB.1 size=501540 2024-09-14T10:57:52.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.747+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=83892T1HSSYB tag=IYSFN11YO5W0 type=write size=2598692 2024-09-14T10:57:52.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.751+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=A8WXL9C27ZEK type=del size=2438774 2024-09-14T10:57:52.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.755+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=0RN8OBIZS4A0 type=del 2024-09-14T10:57:52.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.759+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=13CBAP0IU73Q type=del size=2461323 2024-09-14T10:57:52.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.763+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~T8O58EGMP36F.0 size=1048576 2024-09-14T10:57:52.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.763+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~T8O58EGMP36F.1 size=1048576 2024-09-14T10:57:52.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.767+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~T8O58EGMP36F.2 size=304949 2024-09-14T10:57:52.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.775+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=T8O58EGMP36F tag=R7OFPJJ0ZOO6 type=write size=3450677 2024-09-14T10:57:52.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.779+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~VE6JODXPFSV4.0 size=1035854 2024-09-14T10:57:52.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.779+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=VE6JODXPFSV4 tag=8XGG26QX646Q type=write size=2084430 2024-09-14T10:57:52.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.787+0000 7fdf8f02c8c0 1 < suggested remove operation key=0QJLAH0EPKVD tag=7QZ88F3J4MDQ type=del 2024-09-14T10:57:52.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.795+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~9OGJ4FYE4KW9.0 size=1048576 2024-09-14T10:57:52.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.799+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~9OGJ4FYE4KW9.1 size=791499 2024-09-14T10:57:52.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.799+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=9OGJ4FYE4KW9 tag=UD40JR9TRK80 type=write size=2888651 2024-09-14T10:57:52.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.803+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=X3D59IN71ROK type=del 2024-09-14T10:57:52.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.811+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~DE7D63RI7UY8.0 size=296680 2024-09-14T10:57:52.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.811+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=DE7D63RI7UY8 tag=LRU371WNJ5V2 type=write size=1345256 2024-09-14T10:57:52.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.811+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_6VNI8FMHZ0FN.2~RX4DC74EE0P1.0 size=1048576 2024-09-14T10:57:52.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~RX4DC74EE0P1.1 size=1048576 2024-09-14T10:57:52.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.815+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~RX4DC74EE0P1.2 size=942507 2024-09-14T10:57:52.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.823+0000 7fdf8f02c8c0 1 < canceled multipart upload key=6VNI8FMHZ0FN upload=RX4DC74EE0P1 tag=V0AK7J3JI406 type=write size=4088235 2024-09-14T10:57:52.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~18POMJVY0O31.0 size=1048576 2024-09-14T10:57:52.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.831+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~18POMJVY0O31.1 size=1048576 2024-09-14T10:57:52.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.835+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~18POMJVY0O31.2 size=1004884 2024-09-14T10:57:52.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.835+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=18POMJVY0O31 tag=DR6XX3DNOT54 type=write size=4150612 2024-09-14T10:57:52.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.839+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~DAR7Y3D2CEG4.0 size=1048576 2024-09-14T10:57:52.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.843+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STHEUJ6VDPQB.2~DAR7Y3D2CEG4.1 size=784290 2024-09-14T10:57:52.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.847+0000 7fdf8f02c8c0 1 < completed multipart upload key=STHEUJ6VDPQB upload=DAR7Y3D2CEG4 tag=OGJDF5SEQ525 type=write size=2881442 2024-09-14T10:57:52.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.855+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~TC2PNR0E2SS2.0 size=443452 2024-09-14T10:57:52.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.855+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=TC2PNR0E2SS2 tag=TDNEUCBFEB09 type=write size=1492028 2024-09-14T10:57:52.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.855+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_TZZ05IIMZJ4J.2~FW2RTDS3EFZ1.0 size=336952 2024-09-14T10:57:52.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.867+0000 7fdf8f02c8c0 1 < canceled multipart upload key=TZZ05IIMZJ4J upload=FW2RTDS3EFZ1 tag=4FKDTYPQ07CY type=write size=1385528 2024-09-14T10:57:52.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.867+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=C0NKXDVK4H2H type=del size=3766718 2024-09-14T10:57:52.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.875+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=HF7NJZM3ZO5R type=del size=3495082 2024-09-14T10:57:52.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.879+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=5PFGV9EM1P02 type=del size=1733169 2024-09-14T10:57:52.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.883+0000 7fdf8f02c8c0 -1 < failed to complete operation key=K3KJ7HDQF6ZH tag=K7BSDJPDWNJE type=del size=3653579: (22) Invalid argument 2024-09-14T10:57:52.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~7VK0EIZI2K4R.0 size=1048576 2024-09-14T10:57:52.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.891+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~7VK0EIZI2K4R.1 size=1048576 2024-09-14T10:57:52.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.895+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~7VK0EIZI2K4R.2 size=472104 2024-09-14T10:57:52.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.895+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=7VK0EIZI2K4R tag=CHZSKTJ3VBGT type=write size=3617832 2024-09-14T10:57:52.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.899+0000 7fdf8f02c8c0 -1 < failed to complete operation key=K3KJ7HDQF6ZH tag=B50L58WNAYMC type=write size=475557: (22) Invalid argument 2024-09-14T10:57:52.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.903+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=GAYRCRRVL9OA type=write size=869938 2024-09-14T10:57:52.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.911+0000 7fdf8f02c8c0 1 < suggested update operation key=WA7HE8ZJ1W1M tag=B63UQUEEEXAF type=del size=1423362 2024-09-14T10:57:52.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.919+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~2LMVAMV29UOZ.0 size=1048576 2024-09-14T10:57:52.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.919+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~2LMVAMV29UOZ.1 size=1048576 2024-09-14T10:57:52.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.923+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~2LMVAMV29UOZ.2 size=611063 2024-09-14T10:57:52.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.923+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=2LMVAMV29UOZ tag=VHQ7KWBD9KLT type=write size=3756791 2024-09-14T10:57:52.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.926+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=R24QCOG9KQJX type=del 2024-09-14T10:57:52.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.930+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=9TFTXCS0GSAO type=del size=508913 2024-09-14T10:57:52.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.938+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=80J7PIEQKBKR type=del 2024-09-14T10:57:52.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.942+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=AL4GFNMMGL17 type=write size=642653 2024-09-14T10:57:52.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.950+0000 7fdf8f02c8c0 1 < suggested update operation key=WA7HE8ZJ1W1M tag=M5RLFYV7RGKD type=del size=4065962 2024-09-14T10:57:52.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.954+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=VSANJFYV7CTW type=del size=3059139 2024-09-14T10:57:52.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.958+0000 7fdf8f02c8c0 -1 < failed to complete operation key=9IDBODZBQRJR tag=7JVTRQUF1A3M type=del size=2556759: (22) Invalid argument 2024-09-14T10:57:52.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.962+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=ZPSATIWWR1CI type=write size=501770 2024-09-14T10:57:52.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.966+0000 7fdf8f02c8c0 -1 < failed to complete operation key=0QJLAH0EPKVD tag=A8WXL9C27ZEK type=del size=2438774: (22) Invalid argument 2024-09-14T10:57:52.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.970+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~05GE2HIH494V.0 size=1048576 2024-09-14T10:57:52.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.974+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~05GE2HIH494V.1 size=1048576 2024-09-14T10:57:52.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.978+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~05GE2HIH494V.2 size=608612 2024-09-14T10:57:52.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.978+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=05GE2HIH494V tag=4KTEZ72V3W1Z type=write size=3754340 2024-09-14T10:57:52.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.982+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=13CBAP0IU73Q type=del 2024-09-14T10:57:52.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.986+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=GP0U707H8X7C type=del size=2952452 2024-09-14T10:57:52.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.990+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~VE6JODXPFSV4.0 size=1035854 2024-09-14T10:57:52.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:52.994+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=VE6JODXPFSV4 tag=8XGG26QX646Q type=write size=2084430 2024-09-14T10:57:52.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.002+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~W6WGNKUMP9A2.0 size=1048576 2024-09-14T10:57:53.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.006+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~W6WGNKUMP9A2.1 size=828863 2024-09-14T10:57:53.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.006+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=W6WGNKUMP9A2 tag=FU96V77BTUYT type=write size=2926015 2024-09-14T10:57:53.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.010+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~9OGJ4FYE4KW9.0 size=1048576 2024-09-14T10:57:53.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.010+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STB3W5URFJEZ.2~9OGJ4FYE4KW9.1 size=791499 2024-09-14T10:57:53.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.014+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STB3W5URFJEZ upload=9OGJ4FYE4KW9 tag=UD40JR9TRK80 type=write size=2888651 2024-09-14T10:57:53.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.018+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=Y9B2RZ6O0QK6 type=del size=1018185 2024-09-14T10:57:53.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.018+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_OFY1G5R28CK6.2~DE7D63RI7UY8.0 size=296680 2024-09-14T10:57:53.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.026+0000 7fdf8f02c8c0 1 < canceled multipart upload key=OFY1G5R28CK6 upload=DE7D63RI7UY8 tag=LRU371WNJ5V2 type=write size=1345256 2024-09-14T10:57:53.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.034+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~95U5J3XHADE6.0 size=1048576 2024-09-14T10:57:53.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.034+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~95U5J3XHADE6.1 size=1048576 2024-09-14T10:57:53.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.038+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~95U5J3XHADE6.2 size=253822 2024-09-14T10:57:53.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.038+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=95U5J3XHADE6 tag=OM5RDHSGGXCD type=write size=3399550 2024-09-14T10:57:53.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.042+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~18POMJVY0O31.0 size=1048576 2024-09-14T10:57:53.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.046+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~18POMJVY0O31.1 size=1048576 2024-09-14T10:57:53.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.050+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~18POMJVY0O31.2 size=1004884 2024-09-14T10:57:53.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.054+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=18POMJVY0O31 tag=DR6XX3DNOT54 type=write size=4150612 2024-09-14T10:57:53.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.058+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=HA9KBPOBE4BH type=del size=3542361 2024-09-14T10:57:53.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.062+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~TC2PNR0E2SS2.0 size=443452 2024-09-14T10:57:53.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.070+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=TC2PNR0E2SS2 tag=TDNEUCBFEB09 type=write size=1492028 2024-09-14T10:57:53.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.074+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=GLG2HENJ3EKR type=write size=827485 2024-09-14T10:57:53.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.078+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=C0NKXDVK4H2H type=del 2024-09-14T10:57:53.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.082+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~NSN91SCEM4IP.0 size=1048576 2024-09-14T10:57:53.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.086+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~NSN91SCEM4IP.1 size=567004 2024-09-14T10:57:53.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.086+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=NSN91SCEM4IP tag=WX9APL7T8T4P type=write size=2664156 2024-09-14T10:57:53.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.090+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=5PFGV9EM1P02 type=del 2024-09-14T10:57:53.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.094+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=OFP8UQ2672DZ type=del size=1359 2024-09-14T10:57:53.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.098+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~7VK0EIZI2K4R.0 size=1048576 2024-09-14T10:57:53.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.102+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~7VK0EIZI2K4R.1 size=1048576 2024-09-14T10:57:53.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.102+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~7VK0EIZI2K4R.2 size=472104 2024-09-14T10:57:53.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.110+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=7VK0EIZI2K4R tag=CHZSKTJ3VBGT type=write size=3617832 2024-09-14T10:57:53.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.114+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=2LEW5OKBIIK9 type=del size=3719162 2024-09-14T10:57:53.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.118+0000 7fdf8f02c8c0 1 < completed write operation key=3CYCJJIQ210M tag=GAYRCRRVL9OA type=write size=869938 2024-09-14T10:57:53.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.122+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=0PZUY7D7SQ82 type=del size=3980746 2024-09-14T10:57:53.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.122+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~2LMVAMV29UOZ.0 size=1048576 2024-09-14T10:57:53.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.122+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~2LMVAMV29UOZ.1 size=1048576 2024-09-14T10:57:53.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.122+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~2LMVAMV29UOZ.2 size=611063 2024-09-14T10:57:53.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.130+0000 7fdf8f02c8c0 1 < canceled multipart upload key=XUT55FR490EO upload=2LMVAMV29UOZ tag=VHQ7KWBD9KLT type=write size=3756791 2024-09-14T10:57:53.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.130+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=3X77SAO3ROEA type=write size=346267 2024-09-14T10:57:53.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.134+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=9TFTXCS0GSAO type=del 2024-09-14T10:57:53.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.142+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~VOFF9EBMDLGJ.0 size=1048576 2024-09-14T10:57:53.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.146+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~VOFF9EBMDLGJ.1 size=416434 2024-09-14T10:57:53.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.146+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=VOFF9EBMDLGJ tag=DFV1JPT9JBM5 type=write size=2513586 2024-09-14T10:57:53.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.150+0000 7fdf8f02c8c0 1 < completed write operation key=MNBXQTJBS1QS tag=AL4GFNMMGL17 type=write size=642653 2024-09-14T10:57:53.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.158+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~EN772YZ2GV87.0 size=1048576 2024-09-14T10:57:53.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.162+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~EN772YZ2GV87.1 size=229399 2024-09-14T10:57:53.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.162+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=EN772YZ2GV87 tag=GC3SQWF11BYE type=write size=2326551 2024-09-14T10:57:53.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.166+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=VSANJFYV7CTW type=del 2024-09-14T10:57:53.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.170+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=FRSKZPD422NW type=write size=316220 2024-09-14T10:57:53.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.174+0000 7fdf8f02c8c0 1 < completed write operation key=3T0H42SC1ETB tag=ZPSATIWWR1CI type=write size=501770 2024-09-14T10:57:53.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.182+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=2K1XX5LSCSJD type=write size=977227 2024-09-14T10:57:53.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.186+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~05GE2HIH494V.0 size=1048576 2024-09-14T10:57:53.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.190+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~05GE2HIH494V.1 size=1048576 2024-09-14T10:57:53.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.190+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~05GE2HIH494V.2 size=608612 2024-09-14T10:57:53.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.198+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=05GE2HIH494V tag=4KTEZ72V3W1Z type=write size=3754340 2024-09-14T10:57:53.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.202+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=9ID6BFKTZ2FC type=write size=238543 2024-09-14T10:57:53.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.206+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=GP0U707H8X7C type=del 2024-09-14T10:57:53.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.210+0000 7fdf8f02c8c0 1 > prepared operation key=Y32RWGISRBMT tag=SIHC4AMN9VCC type=write size=205768 2024-09-14T10:57:53.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.214+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~W6WGNKUMP9A2.0 size=1048576 2024-09-14T10:57:53.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.222+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~W6WGNKUMP9A2.1 size=828863 2024-09-14T10:57:53.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.230+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=W6WGNKUMP9A2 tag=FU96V77BTUYT type=write size=2926015 2024-09-14T10:57:53.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.234+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=7CQFTK5XFV8R type=del size=1881223 2024-09-14T10:57:53.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.238+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=Y9B2RZ6O0QK6 type=del 2024-09-14T10:57:53.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.242+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=DHCAVL214UNV type=del size=2623597 2024-09-14T10:57:53.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.246+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~95U5J3XHADE6.0 size=1048576 2024-09-14T10:57:53.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.250+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~95U5J3XHADE6.1 size=1048576 2024-09-14T10:57:53.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.250+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~95U5J3XHADE6.2 size=253822 2024-09-14T10:57:53.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.258+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=95U5J3XHADE6 tag=OM5RDHSGGXCD type=write size=3399550 2024-09-14T10:57:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.262+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=0UYY91Z7AEE5 type=del size=2667138 2024-09-14T10:57:53.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.266+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=HA9KBPOBE4BH type=del 2024-09-14T10:57:53.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.270+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=DA9JV85R0ENT type=write size=585449 2024-09-14T10:57:53.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.274+0000 7fdf8f02c8c0 1 < completed write operation key=3T0H42SC1ETB tag=GLG2HENJ3EKR type=write size=827485 2024-09-14T10:57:53.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.278+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=FMZ9GU7ZG55O type=del size=881706 2024-09-14T10:57:53.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.282+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~NSN91SCEM4IP.0 size=1048576 2024-09-14T10:57:53.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.282+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~NSN91SCEM4IP.1 size=567004 2024-09-14T10:57:53.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.290+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=NSN91SCEM4IP tag=WX9APL7T8T4P type=write size=2664156 2024-09-14T10:57:53.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.294+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=4P3IE6ZNP4O0 type=del size=2839215 2024-09-14T10:57:53.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.298+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=OFP8UQ2672DZ type=del 2024-09-14T10:57:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.302+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=9RD0TF15VAG5 type=write size=711841 2024-09-14T10:57:53.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.306+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=2LEW5OKBIIK9 type=del 2024-09-14T10:57:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.310+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=17ATGR3WEG07 type=del size=2494607 2024-09-14T10:57:53.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.314+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=0PZUY7D7SQ82 type=del 2024-09-14T10:57:53.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.318+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=18YWQYUT0KDX type=del size=3611622 2024-09-14T10:57:53.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.322+0000 7fdf8f02c8c0 1 < completed write operation key=6VNI8FMHZ0FN tag=3X77SAO3ROEA type=write size=346267 2024-09-14T10:57:53.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.326+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=HWCXLZTUG6WQ type=del size=3629372 2024-09-14T10:57:53.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.330+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~VOFF9EBMDLGJ.0 size=1048576 2024-09-14T10:57:53.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.334+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~VOFF9EBMDLGJ.1 size=416434 2024-09-14T10:57:53.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.338+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=VOFF9EBMDLGJ tag=DFV1JPT9JBM5 type=write size=2513586 2024-09-14T10:57:53.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.346+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~YALRVJXTKRJJ.0 size=1048576 2024-09-14T10:57:53.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.350+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~YALRVJXTKRJJ.1 size=1048576 2024-09-14T10:57:53.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.354+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_6VNI8FMHZ0FN.2~YALRVJXTKRJJ.2 size=906713 2024-09-14T10:57:53.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.354+0000 7fdf8f02c8c0 1 > prepared multipart upload key=6VNI8FMHZ0FN upload=YALRVJXTKRJJ tag=6W4HOQOE09B0 type=write size=4052441 2024-09-14T10:57:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.358+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~EN772YZ2GV87.0 size=1048576 2024-09-14T10:57:53.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.362+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~EN772YZ2GV87.1 size=229399 2024-09-14T10:57:53.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.366+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=EN772YZ2GV87 tag=GC3SQWF11BYE type=write size=2326551 2024-09-14T10:57:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.374+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~NXDGXJ0JKXB2.0 size=1048576 2024-09-14T10:57:53.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.378+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~NXDGXJ0JKXB2.1 size=1048576 2024-09-14T10:57:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.382+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~NXDGXJ0JKXB2.2 size=538874 2024-09-14T10:57:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.382+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=NXDGXJ0JKXB2 tag=3VR8HM8TTI6S type=write size=3684602 2024-09-14T10:57:53.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.386+0000 7fdf8f02c8c0 1 < completed write operation key=9IDBODZBQRJR tag=FRSKZPD422NW type=write size=316220 2024-09-14T10:57:53.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.390+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=1KU7K699JOWP type=del size=3761411 2024-09-14T10:57:53.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.394+0000 7fdf8f02c8c0 1 < completed write operation key=ZF6IDD8B3CFO tag=2K1XX5LSCSJD type=write size=977227 2024-09-14T10:57:53.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.398+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=3HVV3R0QYQOD type=del size=1383741 2024-09-14T10:57:53.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.402+0000 7fdf8f02c8c0 1 < completed write operation key=LFLY0V3FRRW5 tag=9ID6BFKTZ2FC type=write size=238543 2024-09-14T10:57:53.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.406+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=UQYJ024WM02A type=del size=3400828 2024-09-14T10:57:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.410+0000 7fdf8f02c8c0 1 < completed write operation key=Y32RWGISRBMT tag=SIHC4AMN9VCC type=write size=205768 2024-09-14T10:57:53.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.414+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=QQAOFV7LB093 type=del size=1759814 2024-09-14T10:57:53.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.418+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=7CQFTK5XFV8R type=del 2024-09-14T10:57:53.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.422+0000 7fdf8f02c8c0 1 > prepared operation key=5VZCCFRUAQJ7 tag=RCWEEJ1KXF4T type=del size=3140469 2024-09-14T10:57:53.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.426+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=DHCAVL214UNV type=del 2024-09-14T10:57:53.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.430+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~8911ZLRPSS9U.0 size=401422 2024-09-14T10:57:53.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.430+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=8911ZLRPSS9U tag=GP1BJRFYI1RU type=write size=1449998 2024-09-14T10:57:53.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.438+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=0UYY91Z7AEE5 type=del 2024-09-14T10:57:53.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.442+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~VDS2BG4K8YCJ.0 size=799758 2024-09-14T10:57:53.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.442+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=VDS2BG4K8YCJ tag=ZNMDCW2UOMEE type=write size=1848334 2024-09-14T10:57:53.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.446+0000 7fdf8f02c8c0 1 < completed write operation key=3CYCJJIQ210M tag=DA9JV85R0ENT type=write size=585449 2024-09-14T10:57:53.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.454+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~XBZND0A7WQH9.0 size=1048576 2024-09-14T10:57:53.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.458+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~XBZND0A7WQH9.1 size=126236 2024-09-14T10:57:53.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.458+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=XBZND0A7WQH9 tag=DBSCR8ULIKY3 type=write size=2223388 2024-09-14T10:57:53.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.462+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=FMZ9GU7ZG55O type=del 2024-09-14T10:57:53.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.466+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=CO0HAMHUPO8A type=del size=3556512 2024-09-14T10:57:53.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.470+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=4P3IE6ZNP4O0 type=del 2024-09-14T10:57:53.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.478+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~M158FIHW6YPA.0 size=980605 2024-09-14T10:57:53.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.478+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=M158FIHW6YPA tag=QTQYPYZPFEDY type=write size=2029181 2024-09-14T10:57:53.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.486+0000 7fdf8f02c8c0 1 < suggested remove operation key=LFLY0V3FRRW5 tag=9RD0TF15VAG5 type=write 2024-09-14T10:57:53.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.490+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=GPCQIQK47CJ6 type=del size=582838 2024-09-14T10:57:53.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.494+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=17ATGR3WEG07 type=del 2024-09-14T10:57:53.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.498+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~FOY4VTFLKXTD.0 size=1048576 2024-09-14T10:57:53.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.502+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~FOY4VTFLKXTD.1 size=1048576 2024-09-14T10:57:53.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.506+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~FOY4VTFLKXTD.2 size=586941 2024-09-14T10:57:53.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.506+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=FOY4VTFLKXTD tag=14DW1O96TPBE type=write size=3732669 2024-09-14T10:57:53.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.510+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=18YWQYUT0KDX type=del 2024-09-14T10:57:53.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.514+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=BMBD5AZ0WIC9 type=del size=2368793 2024-09-14T10:57:53.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.518+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=HWCXLZTUG6WQ type=del 2024-09-14T10:57:53.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.522+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~WMHZG93JI5CS.0 size=1048576 2024-09-14T10:57:53.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.526+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~WMHZG93JI5CS.1 size=1048576 2024-09-14T10:57:53.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.530+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~WMHZG93JI5CS.2 size=652396 2024-09-14T10:57:53.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.530+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=WMHZG93JI5CS tag=KUBRVP5Q164F type=write size=3798124 2024-09-14T10:57:53.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.534+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~YALRVJXTKRJJ.0 size=1048576 2024-09-14T10:57:53.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.534+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~YALRVJXTKRJJ.1 size=1048576 2024-09-14T10:57:53.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.538+0000 7fdf8f02c8c0 1 < completed part key=_multipart_6VNI8FMHZ0FN.2~YALRVJXTKRJJ.2 size=906713 2024-09-14T10:57:53.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.546+0000 7fdf8f02c8c0 1 < completed multipart upload key=6VNI8FMHZ0FN upload=YALRVJXTKRJJ tag=6W4HOQOE09B0 type=write size=4052441 2024-09-14T10:57:53.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.550+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=8CSKHCWTI41Q type=del size=544326 2024-09-14T10:57:53.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.554+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~NXDGXJ0JKXB2.0 size=1048576 2024-09-14T10:57:53.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.554+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~NXDGXJ0JKXB2.1 size=1048576 2024-09-14T10:57:53.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.558+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~NXDGXJ0JKXB2.2 size=538874 2024-09-14T10:57:53.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.562+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=NXDGXJ0JKXB2 tag=3VR8HM8TTI6S type=write size=3684602 2024-09-14T10:57:53.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.570+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~WYFHXB9CIDDQ.0 size=114731 2024-09-14T10:57:53.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.570+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=WYFHXB9CIDDQ tag=W5KUZ4HF4L0O type=write size=1163307 2024-09-14T10:57:53.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.578+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=1KU7K699JOWP type=del 2024-09-14T10:57:53.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.590+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~W10AVVBJDIW3.0 size=1048576 2024-09-14T10:57:53.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.590+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~W10AVVBJDIW3.1 size=636659 2024-09-14T10:57:53.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.590+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=W10AVVBJDIW3 tag=EYTD9VBUQ28A type=write size=2733811 2024-09-14T10:57:53.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.598+0000 7fdf8f02c8c0 1 < suggested remove operation key=TZZ05IIMZJ4J tag=3HVV3R0QYQOD type=del 2024-09-14T10:57:53.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.602+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=G8ODA0DXRVSZ type=del size=3564964 2024-09-14T10:57:53.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.610+0000 7fdf8f02c8c0 1 < suggested remove operation key=82N2FPU7LKTG tag=UQYJ024WM02A type=del 2024-09-14T10:57:53.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.614+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=PN7WHYYXDVEE type=del size=50168 2024-09-14T10:57:53.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.618+0000 7fdf8f02c8c0 -1 < failed to complete operation key=82N2FPU7LKTG tag=QQAOFV7LB093 type=del size=1759814: (22) Invalid argument 2024-09-14T10:57:53.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.626+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~5IGOR3W1K83X.0 size=1048576 2024-09-14T10:57:53.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.630+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~5IGOR3W1K83X.1 size=78695 2024-09-14T10:57:53.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.630+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=5IGOR3W1K83X tag=FN5U3Q6XXAI5 type=write size=2175847 2024-09-14T10:57:53.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.630+0000 7fdf8f02c8c0 1 < completed delete operation key=5VZCCFRUAQJ7 tag=RCWEEJ1KXF4T type=del 2024-09-14T10:57:53.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.638+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~D4JUFISF9R8G.0 size=1048576 2024-09-14T10:57:53.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.642+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~D4JUFISF9R8G.1 size=1048576 2024-09-14T10:57:53.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.646+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_TZZ05IIMZJ4J.2~D4JUFISF9R8G.2 size=179735 2024-09-14T10:57:53.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.646+0000 7fdf8f02c8c0 1 > prepared multipart upload key=TZZ05IIMZJ4J upload=D4JUFISF9R8G tag=ZJTJ3ODY0SI2 type=write size=3325463 2024-09-14T10:57:53.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.650+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~8911ZLRPSS9U.0 size=401422 2024-09-14T10:57:53.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.654+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=8911ZLRPSS9U tag=GP1BJRFYI1RU type=write size=1449998 2024-09-14T10:57:53.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.658+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=2RH8C0ZVYXJR type=write size=563522 2024-09-14T10:57:53.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.662+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~VDS2BG4K8YCJ.0 size=799758 2024-09-14T10:57:53.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.670+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=VDS2BG4K8YCJ tag=ZNMDCW2UOMEE type=write size=1848334 2024-09-14T10:57:53.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.670+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=ZKIP7XLFF8ZT type=write size=36481 2024-09-14T10:57:53.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.674+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~XBZND0A7WQH9.0 size=1048576 2024-09-14T10:57:53.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.678+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~XBZND0A7WQH9.1 size=126236 2024-09-14T10:57:53.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.686+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=XBZND0A7WQH9 tag=DBSCR8ULIKY3 type=write size=2223388 2024-09-14T10:57:53.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.690+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~YH4M6H6RZJ4T.0 size=1048576 2024-09-14T10:57:53.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.694+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~YH4M6H6RZJ4T.1 size=1048576 2024-09-14T10:57:53.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.698+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~YH4M6H6RZJ4T.2 size=449606 2024-09-14T10:57:53.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.698+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=YH4M6H6RZJ4T tag=4R6I7P565CE4 type=write size=3595334 2024-09-14T10:57:53.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.702+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=CO0HAMHUPO8A type=del 2024-09-14T10:57:53.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.706+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~N2R9XIVGTE5T.0 size=1048576 2024-09-14T10:57:53.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.710+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~N2R9XIVGTE5T.1 size=1048576 2024-09-14T10:57:53.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.714+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3CYCJJIQ210M.2~N2R9XIVGTE5T.2 size=156083 2024-09-14T10:57:53.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.714+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3CYCJJIQ210M upload=N2R9XIVGTE5T tag=51Q0HXMQNKAC type=write size=3301811 2024-09-14T10:57:53.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.718+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~M158FIHW6YPA.0 size=980605 2024-09-14T10:57:53.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.722+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=M158FIHW6YPA tag=QTQYPYZPFEDY type=write size=2029181 2024-09-14T10:57:53.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.730+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~C0GGQOF1ZJVG.0 size=566996 2024-09-14T10:57:53.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.730+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=C0GGQOF1ZJVG tag=NLEEAECL35SF type=write size=1615572 2024-09-14T10:57:53.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.738+0000 7fdf8f02c8c0 1 < suggested update operation key=3QSOKUSZ57QM tag=GPCQIQK47CJ6 type=del size=582838 2024-09-14T10:57:53.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.742+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=2NKAWM6N9BV6 type=write size=462498 2024-09-14T10:57:53.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.746+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~FOY4VTFLKXTD.0 size=1048576 2024-09-14T10:57:53.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.750+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~FOY4VTFLKXTD.1 size=1048576 2024-09-14T10:57:53.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.754+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~FOY4VTFLKXTD.2 size=586941 2024-09-14T10:57:53.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.758+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=FOY4VTFLKXTD tag=14DW1O96TPBE type=write size=3732669 2024-09-14T10:57:53.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.762+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=OQ265VSUYJE4 type=write size=739794 2024-09-14T10:57:53.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.766+0000 7fdf8f02c8c0 1 < completed delete operation key=9IDBODZBQRJR tag=BMBD5AZ0WIC9 type=del 2024-09-14T10:57:53.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.770+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=77EADUT0FN6J type=del size=1911635 2024-09-14T10:57:53.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.774+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~WMHZG93JI5CS.0 size=1048576 2024-09-14T10:57:53.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.778+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~WMHZG93JI5CS.1 size=1048576 2024-09-14T10:57:53.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.782+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~WMHZG93JI5CS.2 size=652396 2024-09-14T10:57:53.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.786+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=WMHZG93JI5CS tag=KUBRVP5Q164F type=write size=3798124 2024-09-14T10:57:53.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.794+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~54C2Y3YA2R1P.0 size=1048576 2024-09-14T10:57:53.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.798+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~54C2Y3YA2R1P.1 size=900487 2024-09-14T10:57:53.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.798+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=54C2Y3YA2R1P tag=HA6UO0MV3CUY type=write size=2997639 2024-09-14T10:57:53.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.802+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=8CSKHCWTI41Q type=del 2024-09-14T10:57:53.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.806+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=ED3J1KO9P53T type=write size=618884 2024-09-14T10:57:53.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.806+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_X0RT8UF3D0JC.2~WYFHXB9CIDDQ.0 size=114731 2024-09-14T10:57:53.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.810+0000 7fdf8f02c8c0 1 < canceled multipart upload key=X0RT8UF3D0JC upload=WYFHXB9CIDDQ tag=W5KUZ4HF4L0O type=write size=1163307 2024-09-14T10:57:53.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.818+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~PM4PX2KOEHJA.0 size=1048576 2024-09-14T10:57:53.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.822+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~PM4PX2KOEHJA.1 size=1048576 2024-09-14T10:57:53.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.826+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~PM4PX2KOEHJA.2 size=147141 2024-09-14T10:57:53.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.826+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=PM4PX2KOEHJA tag=U4SITIC5A5OI type=write size=3292869 2024-09-14T10:57:53.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.826+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_K3KJ7HDQF6ZH.2~W10AVVBJDIW3.0 size=1048576 2024-09-14T10:57:53.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.830+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~W10AVVBJDIW3.1 size=636659 2024-09-14T10:57:53.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.834+0000 7fdf8f02c8c0 1 < canceled multipart upload key=K3KJ7HDQF6ZH upload=W10AVVBJDIW3 tag=EYTD9VBUQ28A type=write size=2733811 2024-09-14T10:57:53.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.842+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~D14SKJZVZZ87.0 size=1048576 2024-09-14T10:57:53.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.842+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~D14SKJZVZZ87.1 size=157948 2024-09-14T10:57:53.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.842+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=D14SKJZVZZ87 tag=0B374WNNATMW type=write size=2255100 2024-09-14T10:57:53.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.850+0000 7fdf8f02c8c0 1 < completed delete operation key=0QJLAH0EPKVD tag=G8ODA0DXRVSZ type=del 2024-09-14T10:57:53.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.854+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=2EH1RYED04TX type=write size=636270 2024-09-14T10:57:53.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.858+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=PN7WHYYXDVEE type=del 2024-09-14T10:57:53.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.866+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MQPWLJ0G5653.0 size=1048576 2024-09-14T10:57:53.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.870+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~MQPWLJ0G5653.1 size=329505 2024-09-14T10:57:53.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.870+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=MQPWLJ0G5653 tag=NG67JZCDIAXD type=write size=2426657 2024-09-14T10:57:53.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.874+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~5IGOR3W1K83X.0 size=1048576 2024-09-14T10:57:53.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.878+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~5IGOR3W1K83X.1 size=78695 2024-09-14T10:57:53.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.886+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=5IGOR3W1K83X tag=FN5U3Q6XXAI5 type=write size=2175847 2024-09-14T10:57:53.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.890+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=NOY114CG3TLX type=write size=94797 2024-09-14T10:57:53.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.894+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~D4JUFISF9R8G.0 size=1048576 2024-09-14T10:57:53.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.898+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~D4JUFISF9R8G.1 size=1048576 2024-09-14T10:57:53.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.898+0000 7fdf8f02c8c0 1 < completed part key=_multipart_TZZ05IIMZJ4J.2~D4JUFISF9R8G.2 size=179735 2024-09-14T10:57:53.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.906+0000 7fdf8f02c8c0 1 < completed multipart upload key=TZZ05IIMZJ4J upload=D4JUFISF9R8G tag=ZJTJ3ODY0SI2 type=write size=3325463 2024-09-14T10:57:53.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.910+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=DJRU0OB34YLM type=del size=1435550 2024-09-14T10:57:53.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.918+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=2RH8C0ZVYXJR type=write size=563522 2024-09-14T10:57:53.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.922+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=TQGJW3E1T8FW type=write size=208329 2024-09-14T10:57:53.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.930+0000 7fdf8f02c8c0 1 < suggested update operation key=K3KJ7HDQF6ZH tag=ZKIP7XLFF8ZT type=write size=36481 2024-09-14T10:57:53.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.934+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=MNANNHNJID05 type=del size=1482667 2024-09-14T10:57:53.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.938+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~YH4M6H6RZJ4T.0 size=1048576 2024-09-14T10:57:53.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.938+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_304ZNF4OC1ML.2~YH4M6H6RZJ4T.1 size=1048576 2024-09-14T10:57:53.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.946+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~YH4M6H6RZJ4T.2 size=449606 2024-09-14T10:57:53.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.954+0000 7fdf8f02c8c0 1 < canceled multipart upload key=304ZNF4OC1ML upload=YH4M6H6RZJ4T tag=4R6I7P565CE4 type=write size=3595334 2024-09-14T10:57:53.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.958+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=K7277P9FECQZ type=del size=3104492 2024-09-14T10:57:53.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.962+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~N2R9XIVGTE5T.0 size=1048576 2024-09-14T10:57:53.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.966+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~N2R9XIVGTE5T.1 size=1048576 2024-09-14T10:57:53.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.966+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3CYCJJIQ210M.2~N2R9XIVGTE5T.2 size=156083 2024-09-14T10:57:53.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.974+0000 7fdf8f02c8c0 1 < completed multipart upload key=3CYCJJIQ210M upload=N2R9XIVGTE5T tag=51Q0HXMQNKAC type=write size=3301811 2024-09-14T10:57:53.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.978+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=FJQV5FPQZTMU type=write size=958309 2024-09-14T10:57:53.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.982+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~C0GGQOF1ZJVG.0 size=566996 2024-09-14T10:57:53.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.986+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=C0GGQOF1ZJVG tag=NLEEAECL35SF type=write size=1615572 2024-09-14T10:57:53.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.994+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~83QOCS3GH9GA.0 size=1048576 2024-09-14T10:57:53.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:53.998+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~83QOCS3GH9GA.1 size=1048576 2024-09-14T10:57:53.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.002+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~83QOCS3GH9GA.2 size=1000940 2024-09-14T10:57:53.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.002+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=83QOCS3GH9GA tag=TAWUB0HP4JBR type=write size=4146668 2024-09-14T10:57:54.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.006+0000 7fdf8f02c8c0 1 < completed write operation key=9IDBODZBQRJR tag=2NKAWM6N9BV6 type=write size=462498 2024-09-14T10:57:54.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.010+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=YB9MS6AF0ZWU type=del size=2172844 2024-09-14T10:57:54.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.014+0000 7fdf8f02c8c0 1 < completed write operation key=3T0H42SC1ETB tag=OQ265VSUYJE4 type=write size=739794 2024-09-14T10:57:54.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.018+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=BNAONF3AZ92C type=del size=3033482 2024-09-14T10:57:54.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.022+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=77EADUT0FN6J type=del 2024-09-14T10:57:54.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.030+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~5X3MB0DZY5PY.0 size=241809 2024-09-14T10:57:54.026 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.030+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=5X3MB0DZY5PY tag=H4ELT0D310HN type=write size=1290385 2024-09-14T10:57:54.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.030+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~54C2Y3YA2R1P.0 size=1048576 2024-09-14T10:57:54.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.034+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~54C2Y3YA2R1P.1 size=900487 2024-09-14T10:57:54.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.042+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=54C2Y3YA2R1P tag=HA6UO0MV3CUY type=write size=2997639 2024-09-14T10:57:54.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.046+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~DDVNDVQ3LCN7.0 size=1048576 2024-09-14T10:57:54.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.050+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~DDVNDVQ3LCN7.1 size=1048576 2024-09-14T10:57:54.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.054+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_5VZCCFRUAQJ7.2~DDVNDVQ3LCN7.2 size=410541 2024-09-14T10:57:54.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.054+0000 7fdf8f02c8c0 1 > prepared multipart upload key=5VZCCFRUAQJ7 upload=DDVNDVQ3LCN7 tag=TCFJU93XEV3Z type=write size=3556269 2024-09-14T10:57:54.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.058+0000 7fdf8f02c8c0 1 < completed write operation key=82N2FPU7LKTG tag=ED3J1KO9P53T type=write size=618884 2024-09-14T10:57:54.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.066+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~0NMRWJKZ9EOT.0 size=190024 2024-09-14T10:57:54.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.066+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=0NMRWJKZ9EOT tag=2DMP8FYS33Z0 type=write size=1238600 2024-09-14T10:57:54.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.066+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~PM4PX2KOEHJA.0 size=1048576 2024-09-14T10:57:54.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.070+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~PM4PX2KOEHJA.1 size=1048576 2024-09-14T10:57:54.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.074+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~PM4PX2KOEHJA.2 size=147141 2024-09-14T10:57:54.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.082+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=PM4PX2KOEHJA tag=U4SITIC5A5OI type=write size=3292869 2024-09-14T10:57:54.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.086+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=3FK8P7G05L3Q type=del size=1193387 2024-09-14T10:57:54.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.090+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~D14SKJZVZZ87.0 size=1048576 2024-09-14T10:57:54.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.090+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~D14SKJZVZZ87.1 size=157948 2024-09-14T10:57:54.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.098+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=D14SKJZVZZ87 tag=0B374WNNATMW type=write size=2255100 2024-09-14T10:57:54.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.106+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~50H6QS8275QE.0 size=1048576 2024-09-14T10:57:54.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.110+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STB3W5URFJEZ.2~50H6QS8275QE.1 size=561685 2024-09-14T10:57:54.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.110+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STB3W5URFJEZ upload=50H6QS8275QE tag=XRSG5OTEGTJC type=write size=2658837 2024-09-14T10:57:54.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.114+0000 7fdf8f02c8c0 -1 < failed to complete operation key=LMNGCUFR187I tag=2EH1RYED04TX type=write size=636270: (22) Invalid argument 2024-09-14T10:57:54.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.118+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=QPT4L7A35CM9 type=del size=1718591 2024-09-14T10:57:54.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.122+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MQPWLJ0G5653.0 size=1048576 2024-09-14T10:57:54.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.126+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~MQPWLJ0G5653.1 size=329505 2024-09-14T10:57:54.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.130+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=MQPWLJ0G5653 tag=NG67JZCDIAXD type=write size=2426657 2024-09-14T10:57:54.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.138+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~E9OCL24ZZA7T.0 size=1048576 2024-09-14T10:57:54.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.142+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~E9OCL24ZZA7T.1 size=1048576 2024-09-14T10:57:54.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.142+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~E9OCL24ZZA7T.2 size=973917 2024-09-14T10:57:54.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.142+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=E9OCL24ZZA7T tag=MVWDND3KR268 type=write size=4119645 2024-09-14T10:57:54.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.150+0000 7fdf8f02c8c0 1 < completed write operation key=6VNI8FMHZ0FN tag=NOY114CG3TLX type=write size=94797 2024-09-14T10:57:54.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.154+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=PT85UN2B53WE type=del size=2989045 2024-09-14T10:57:54.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.158+0000 7fdf8f02c8c0 1 < canceled operation key=MNBXQTJBS1QS tag=DJRU0OB34YLM type=del size=1435550 2024-09-14T10:57:54.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.162+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~E5S5ZA4HJWQR.0 size=258731 2024-09-14T10:57:54.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.162+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=E5S5ZA4HJWQR tag=XM01SOCLH4DB type=write size=1307307 2024-09-14T10:57:54.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.170+0000 7fdf8f02c8c0 1 < suggested remove operation key=304ZNF4OC1ML tag=TQGJW3E1T8FW type=write 2024-09-14T10:57:54.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.178+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~2OLI0FRRNO0J.0 size=734242 2024-09-14T10:57:54.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.178+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=2OLI0FRRNO0J tag=W7Q0C19GWVHN type=write size=1782818 2024-09-14T10:57:54.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.182+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=MNANNHNJID05 type=del 2024-09-14T10:57:54.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.186+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=SWAHFKSQGOBM type=del size=613356 2024-09-14T10:57:54.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.190+0000 7fdf8f02c8c0 1 < completed delete operation key=3CYCJJIQ210M tag=K7277P9FECQZ type=del 2024-09-14T10:57:54.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.198+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~B96OD1JY7SG8.0 size=294527 2024-09-14T10:57:54.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.198+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=B96OD1JY7SG8 tag=ZAD6JI2BD1Q1 type=write size=1343103 2024-09-14T10:57:54.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.202+0000 7fdf8f02c8c0 1 < completed write operation key=X1BN3054IKNS tag=FJQV5FPQZTMU type=write size=958309 2024-09-14T10:57:54.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.206+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=E9OT60V2B40M type=del size=3305816 2024-09-14T10:57:54.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.210+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~83QOCS3GH9GA.0 size=1048576 2024-09-14T10:57:54.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.214+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~83QOCS3GH9GA.1 size=1048576 2024-09-14T10:57:54.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.214+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~83QOCS3GH9GA.2 size=1000940 2024-09-14T10:57:54.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.222+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=83QOCS3GH9GA tag=TAWUB0HP4JBR type=write size=4146668 2024-09-14T10:57:54.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.226+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=OTQP9GAL31O4 type=del size=2650019 2024-09-14T10:57:54.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.234+0000 7fdf8f02c8c0 1 < suggested update operation key=MNBXQTJBS1QS tag=YB9MS6AF0ZWU type=del size=2172844 2024-09-14T10:57:54.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.242+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~L8DTTX6UD3ZW.0 size=297876 2024-09-14T10:57:54.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.242+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=L8DTTX6UD3ZW tag=ER724S6C679K type=write size=1346452 2024-09-14T10:57:54.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.242+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=BNAONF3AZ92C type=del 2024-09-14T10:57:54.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.246+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=MVKG03KI3J6Q type=del size=2361999 2024-09-14T10:57:54.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.250+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~5X3MB0DZY5PY.0 size=241809 2024-09-14T10:57:54.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.258+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=5X3MB0DZY5PY tag=H4ELT0D310HN type=write size=1290385 2024-09-14T10:57:54.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.262+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=S8CH11O5K395 type=del size=2905430 2024-09-14T10:57:54.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.266+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~DDVNDVQ3LCN7.0 size=1048576 2024-09-14T10:57:54.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.270+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~DDVNDVQ3LCN7.1 size=1048576 2024-09-14T10:57:54.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.274+0000 7fdf8f02c8c0 1 < completed part key=_multipart_5VZCCFRUAQJ7.2~DDVNDVQ3LCN7.2 size=410541 2024-09-14T10:57:54.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.278+0000 7fdf8f02c8c0 1 < completed multipart upload key=5VZCCFRUAQJ7 upload=DDVNDVQ3LCN7 tag=TCFJU93XEV3Z type=write size=3556269 2024-09-14T10:57:54.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.286+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~F612BDRGS64C.0 size=1048576 2024-09-14T10:57:54.284 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.286+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~F612BDRGS64C.1 size=1048576 2024-09-14T10:57:54.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.290+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~F612BDRGS64C.2 size=1017257 2024-09-14T10:57:54.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.290+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=F612BDRGS64C tag=MEG42BK56CZ3 type=write size=4162985 2024-09-14T10:57:54.291 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.294+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~0NMRWJKZ9EOT.0 size=190024 2024-09-14T10:57:54.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.306+0000 7fdf8f02c8c0 1 < completed multipart upload key=STB3W5URFJEZ upload=0NMRWJKZ9EOT tag=2DMP8FYS33Z0 type=write size=1238600 2024-09-14T10:57:54.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.314+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~5BK4IJEPS018.0 size=1048576 2024-09-14T10:57:54.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.314+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~5BK4IJEPS018.1 size=1048576 2024-09-14T10:57:54.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.318+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~5BK4IJEPS018.2 size=147920 2024-09-14T10:57:54.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.318+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=5BK4IJEPS018 tag=QO3ZGZJSN9D7 type=write size=3293648 2024-09-14T10:57:54.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.326+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=3FK8P7G05L3Q type=del 2024-09-14T10:57:54.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.334+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~AYRDZBBQRLPT.0 size=1048576 2024-09-14T10:57:54.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.334+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~AYRDZBBQRLPT.1 size=1048576 2024-09-14T10:57:54.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.338+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~AYRDZBBQRLPT.2 size=1021900 2024-09-14T10:57:54.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.338+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=AYRDZBBQRLPT tag=HMXGZ3WHXLTL type=write size=4167628 2024-09-14T10:57:54.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.342+0000 7fdf8f02c8c0 1 < completed part key=_multipart_STB3W5URFJEZ.2~50H6QS8275QE.0 size=1048576 2024-09-14T10:57:54.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.342+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_STB3W5URFJEZ.2~50H6QS8275QE.1 size=561685 2024-09-14T10:57:54.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.346+0000 7fdf8f02c8c0 1 < canceled multipart upload key=STB3W5URFJEZ upload=50H6QS8275QE tag=XRSG5OTEGTJC type=write size=2658837 2024-09-14T10:57:54.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.350+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=TLWE3OW1WBGA type=del size=2754580 2024-09-14T10:57:54.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.354+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=QPT4L7A35CM9 type=del 2024-09-14T10:57:54.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.362+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~J345JRPCVIAR.0 size=1048576 2024-09-14T10:57:54.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.362+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~J345JRPCVIAR.1 size=1048576 2024-09-14T10:57:54.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.366+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~J345JRPCVIAR.2 size=170759 2024-09-14T10:57:54.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.366+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=J345JRPCVIAR tag=DKSKT3PYIFDK type=write size=3316487 2024-09-14T10:57:54.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.370+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~E9OCL24ZZA7T.0 size=1048576 2024-09-14T10:57:54.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.374+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~E9OCL24ZZA7T.1 size=1048576 2024-09-14T10:57:54.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.378+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~E9OCL24ZZA7T.2 size=973917 2024-09-14T10:57:54.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.382+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=E9OCL24ZZA7T tag=MVWDND3KR268 type=write size=4119645 2024-09-14T10:57:54.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.386+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=H2NCAPB70LK8 type=del size=3383940 2024-09-14T10:57:54.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.390+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=PT85UN2B53WE type=del 2024-09-14T10:57:54.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.394+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=CZV39YA6VUKJ type=del size=1802805 2024-09-14T10:57:54.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.398+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~E5S5ZA4HJWQR.0 size=258731 2024-09-14T10:57:54.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.402+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=E5S5ZA4HJWQR tag=XM01SOCLH4DB type=write size=1307307 2024-09-14T10:57:54.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.406+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=NC57YVB3GT7X type=del size=1001900 2024-09-14T10:57:54.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.410+0000 7fdf8f02c8c0 1 < completed part key=_multipart_OFY1G5R28CK6.2~2OLI0FRRNO0J.0 size=734242 2024-09-14T10:57:54.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.418+0000 7fdf8f02c8c0 1 < completed multipart upload key=OFY1G5R28CK6 upload=2OLI0FRRNO0J tag=W7Q0C19GWVHN type=write size=1782818 2024-09-14T10:57:54.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.422+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=BWCAJVWLI20Q type=write size=938524 2024-09-14T10:57:54.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.426+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=SWAHFKSQGOBM type=del 2024-09-14T10:57:54.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.430+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=1J52R76Q7U8I type=write size=509136 2024-09-14T10:57:54.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.434+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~B96OD1JY7SG8.0 size=294527 2024-09-14T10:57:54.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.438+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=B96OD1JY7SG8 tag=ZAD6JI2BD1Q1 type=write size=1343103 2024-09-14T10:57:54.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.442+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=Z5ZIK3NBFJNP type=del size=804618 2024-09-14T10:57:54.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.446+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=E9OT60V2B40M type=del 2024-09-14T10:57:54.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.450+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=SXJ7HC6GOWIG type=write size=374505 2024-09-14T10:57:54.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.454+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=OTQP9GAL31O4 type=del 2024-09-14T10:57:54.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.458+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=3NPHRGGN9O3O type=del size=3544847 2024-09-14T10:57:54.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.462+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~L8DTTX6UD3ZW.0 size=297876 2024-09-14T10:57:54.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.470+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=L8DTTX6UD3ZW tag=ER724S6C679K type=write size=1346452 2024-09-14T10:57:54.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.474+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=DCE3LGP66S9Q type=write size=576687 2024-09-14T10:57:54.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.478+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=MVKG03KI3J6Q type=del 2024-09-14T10:57:54.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.486+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~GE8OMND0LUB1.0 size=1048576 2024-09-14T10:57:54.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.486+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~GE8OMND0LUB1.1 size=1048576 2024-09-14T10:57:54.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.490+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_Y32RWGISRBMT.2~GE8OMND0LUB1.2 size=155207 2024-09-14T10:57:54.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.490+0000 7fdf8f02c8c0 1 > prepared multipart upload key=Y32RWGISRBMT upload=GE8OMND0LUB1 tag=VS0C57I39HJN type=write size=3300935 2024-09-14T10:57:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.494+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=S8CH11O5K395 type=del 2024-09-14T10:57:54.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.498+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=GH01260IXBB4 type=del size=1697143 2024-09-14T10:57:54.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.502+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~F612BDRGS64C.0 size=1048576 2024-09-14T10:57:54.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.506+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~F612BDRGS64C.1 size=1048576 2024-09-14T10:57:54.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.510+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~F612BDRGS64C.2 size=1017257 2024-09-14T10:57:54.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.514+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=F612BDRGS64C tag=MEG42BK56CZ3 type=write size=4162985 2024-09-14T10:57:54.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.518+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=3GFNVLW9IIIM type=write size=777419 2024-09-14T10:57:54.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.522+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~5BK4IJEPS018.0 size=1048576 2024-09-14T10:57:54.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.526+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~5BK4IJEPS018.1 size=1048576 2024-09-14T10:57:54.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.526+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~5BK4IJEPS018.2 size=147920 2024-09-14T10:57:54.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.534+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=5BK4IJEPS018 tag=QO3ZGZJSN9D7 type=write size=3293648 2024-09-14T10:57:54.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.538+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=8TJ4NC368HE0 type=del size=3234585 2024-09-14T10:57:54.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.542+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~AYRDZBBQRLPT.0 size=1048576 2024-09-14T10:57:54.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.546+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~AYRDZBBQRLPT.1 size=1048576 2024-09-14T10:57:54.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.546+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~AYRDZBBQRLPT.2 size=1021900 2024-09-14T10:57:54.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.554+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=AYRDZBBQRLPT tag=HMXGZ3WHXLTL type=write size=4167628 2024-09-14T10:57:54.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.558+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=754N64H6LQXM type=del size=3043285 2024-09-14T10:57:54.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.562+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=TLWE3OW1WBGA type=del 2024-09-14T10:57:54.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.566+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=6BY11DXD53BM type=del size=1582135 2024-09-14T10:57:54.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.570+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~J345JRPCVIAR.0 size=1048576 2024-09-14T10:57:54.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.570+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~J345JRPCVIAR.1 size=1048576 2024-09-14T10:57:54.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.574+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~J345JRPCVIAR.2 size=170759 2024-09-14T10:57:54.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.582+0000 7fdf8f02c8c0 1 < completed multipart upload key=HCGZ1MY5SKW9 upload=J345JRPCVIAR tag=DKSKT3PYIFDK type=write size=3316487 2024-09-14T10:57:54.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.586+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=O34NUB1HUV5F type=del size=2771944 2024-09-14T10:57:54.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.590+0000 7fdf8f02c8c0 1 < completed delete operation key=3T0H42SC1ETB tag=H2NCAPB70LK8 type=del 2024-09-14T10:57:54.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.594+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~6NDTU1JG1MLS.0 size=1048576 2024-09-14T10:57:54.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.598+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~6NDTU1JG1MLS.1 size=633443 2024-09-14T10:57:54.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.598+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=6NDTU1JG1MLS tag=M1EGBV6EI4LF type=write size=2730595 2024-09-14T10:57:54.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.602+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=CZV39YA6VUKJ type=del 2024-09-14T10:57:54.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.606+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=C8DQO33O0HE7 type=del size=1907587 2024-09-14T10:57:54.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.610+0000 7fdf8f02c8c0 1 < completed delete operation key=82N2FPU7LKTG tag=NC57YVB3GT7X type=del 2024-09-14T10:57:54.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.614+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=C02PJGKD3CUN type=del size=3313825 2024-09-14T10:57:54.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.618+0000 7fdf8f02c8c0 1 < completed write operation key=X0RT8UF3D0JC tag=BWCAJVWLI20Q type=write size=938524 2024-09-14T10:57:54.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.622+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~NVP5JN654OF5.0 size=1048576 2024-09-14T10:57:54.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.626+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_1E72V12EPEH3.2~NVP5JN654OF5.1 size=92487 2024-09-14T10:57:54.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.626+0000 7fdf8f02c8c0 1 > prepared multipart upload key=1E72V12EPEH3 upload=NVP5JN654OF5 tag=D3I7XUCFYZ89 type=write size=2189639 2024-09-14T10:57:54.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.630+0000 7fdf8f02c8c0 1 < completed write operation key=0QJLAH0EPKVD tag=1J52R76Q7U8I type=write size=509136 2024-09-14T10:57:54.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.638+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~LHA7XOU4UOQK.0 size=799018 2024-09-14T10:57:54.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.638+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=LHA7XOU4UOQK tag=PJHNFRWQTF9J type=write size=1847594 2024-09-14T10:57:54.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.642+0000 7fdf8f02c8c0 1 < canceled operation key=STB3W5URFJEZ tag=Z5ZIK3NBFJNP type=del size=804618 2024-09-14T10:57:54.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.650+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=54279YDHR7P1 type=write size=426367 2024-09-14T10:57:54.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.658+0000 7fdf8f02c8c0 1 < suggested update operation key=STB3W5URFJEZ tag=SXJ7HC6GOWIG type=write size=374505 2024-09-14T10:57:54.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.662+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=9O9N3OMFZEKI type=del size=2864519 2024-09-14T10:57:54.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.666+0000 7fdf8f02c8c0 1 < completed delete operation key=WA7HE8ZJ1W1M tag=3NPHRGGN9O3O type=del 2024-09-14T10:57:54.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.674+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~OVI5VW1ZQHJT.0 size=246339 2024-09-14T10:57:54.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.674+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=OVI5VW1ZQHJT tag=VHN7FS7ABFXW type=write size=1294915 2024-09-14T10:57:54.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.678+0000 7fdf8f02c8c0 1 < completed write operation key=1E72V12EPEH3 tag=DCE3LGP66S9Q type=write size=576687 2024-09-14T10:57:54.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.682+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~08RIMB701JKI.0 size=1048576 2024-09-14T10:57:54.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.686+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~08RIMB701JKI.1 size=487181 2024-09-14T10:57:54.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.686+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=08RIMB701JKI tag=7MNM8L56WHNQ type=write size=2584333 2024-09-14T10:57:54.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.690+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~GE8OMND0LUB1.0 size=1048576 2024-09-14T10:57:54.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.694+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~GE8OMND0LUB1.1 size=1048576 2024-09-14T10:57:54.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.694+0000 7fdf8f02c8c0 1 < completed part key=_multipart_Y32RWGISRBMT.2~GE8OMND0LUB1.2 size=155207 2024-09-14T10:57:54.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.702+0000 7fdf8f02c8c0 1 < completed multipart upload key=Y32RWGISRBMT upload=GE8OMND0LUB1 tag=VS0C57I39HJN type=write size=3300935 2024-09-14T10:57:54.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.706+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=3BYWAGMHF431 type=del size=2820329 2024-09-14T10:57:54.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.714+0000 7fdf8f02c8c0 1 < suggested remove operation key=304ZNF4OC1ML tag=GH01260IXBB4 type=del 2024-09-14T10:57:54.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.718+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~Q5Y8KZQQSPH8.0 size=1048576 2024-09-14T10:57:54.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.722+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~Q5Y8KZQQSPH8.1 size=1048576 2024-09-14T10:57:54.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.726+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~Q5Y8KZQQSPH8.2 size=119925 2024-09-14T10:57:54.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.726+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=Q5Y8KZQQSPH8 tag=HHIS99IWW12P type=write size=3265653 2024-09-14T10:57:54.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.734+0000 7fdf8f02c8c0 1 < suggested remove operation key=WA7HE8ZJ1W1M tag=3GFNVLW9IIIM type=write 2024-09-14T10:57:54.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.738+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~458EXGEA34LS.0 size=1048576 2024-09-14T10:57:54.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.742+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~458EXGEA34LS.1 size=723251 2024-09-14T10:57:54.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.742+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=458EXGEA34LS tag=0W9J0AJPLNNP type=write size=2820403 2024-09-14T10:57:54.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.746+0000 7fdf8f02c8c0 1 < completed delete operation key=K3KJ7HDQF6ZH tag=8TJ4NC368HE0 type=del 2024-09-14T10:57:54.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.754+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~1B1RACEGBBGB.0 size=627879 2024-09-14T10:57:54.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.754+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=1B1RACEGBBGB tag=JIY0WGJWJYVL type=write size=1676455 2024-09-14T10:57:54.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.758+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=754N64H6LQXM type=del 2024-09-14T10:57:54.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.762+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=6PQ5WK174N7J type=del size=2517667 2024-09-14T10:57:54.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.766+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=6BY11DXD53BM type=del 2024-09-14T10:57:54.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.766+0000 7fdf8f02c8c0 1 > prepared operation key=STHEUJ6VDPQB tag=HSIPOHQFWA04 type=write size=745993 2024-09-14T10:57:54.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.770+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=O34NUB1HUV5F type=del 2024-09-14T10:57:54.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.778+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~J7AZYC1T2QHG.0 size=1048576 2024-09-14T10:57:54.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.782+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~J7AZYC1T2QHG.1 size=1048576 2024-09-14T10:57:54.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.786+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~J7AZYC1T2QHG.2 size=282293 2024-09-14T10:57:54.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.786+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=J7AZYC1T2QHG tag=14WRH69DHYLM type=write size=3428021 2024-09-14T10:57:54.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.790+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~6NDTU1JG1MLS.0 size=1048576 2024-09-14T10:57:54.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.794+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~6NDTU1JG1MLS.1 size=633443 2024-09-14T10:57:54.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.798+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=6NDTU1JG1MLS tag=M1EGBV6EI4LF type=write size=2730595 2024-09-14T10:57:54.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.802+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=RTNNSAXFXPZI type=write size=863417 2024-09-14T10:57:54.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.806+0000 7fdf8f02c8c0 1 < canceled operation key=L1ERJ0JSRDMG tag=C8DQO33O0HE7 type=del size=1907587 2024-09-14T10:57:54.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.810+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=LDDLOY8BP493 type=del size=379113 2024-09-14T10:57:54.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.810+0000 7fdf8f02c8c0 -1 < no bi entry to suggest for operation key=304ZNF4OC1ML tag=C02PJGKD3CUN type=del size=3313825: (2) No such file or directory 2024-09-14T10:57:54.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.814+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=2PHYEBK6NLAZ type=del size=2879129 2024-09-14T10:57:54.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.818+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~NVP5JN654OF5.0 size=1048576 2024-09-14T10:57:54.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.822+0000 7fdf8f02c8c0 1 < completed part key=_multipart_1E72V12EPEH3.2~NVP5JN654OF5.1 size=92487 2024-09-14T10:57:54.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.830+0000 7fdf8f02c8c0 1 < completed multipart upload key=1E72V12EPEH3 upload=NVP5JN654OF5 tag=D3I7XUCFYZ89 type=write size=2189639 2024-09-14T10:57:54.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.830+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=2LFEBG3QXAEA type=del size=2565700 2024-09-14T10:57:54.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.834+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~LHA7XOU4UOQK.0 size=799018 2024-09-14T10:57:54.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.842+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=LHA7XOU4UOQK tag=PJHNFRWQTF9J type=write size=1847594 2024-09-14T10:57:54.845 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.846+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~RGAOB35PAALD.0 size=1048576 2024-09-14T10:57:54.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.850+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~RGAOB35PAALD.1 size=1048576 2024-09-14T10:57:54.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.854+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LCEH2YXNSOGT.2~RGAOB35PAALD.2 size=787880 2024-09-14T10:57:54.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.854+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LCEH2YXNSOGT upload=RGAOB35PAALD tag=W4S4V90F6T90 type=write size=3933608 2024-09-14T10:57:54.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.858+0000 7fdf8f02c8c0 1 < completed write operation key=3QSOKUSZ57QM tag=54279YDHR7P1 type=write size=426367 2024-09-14T10:57:54.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.866+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~I3PY0ROKCOCS.0 size=1048576 2024-09-14T10:57:54.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.866+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~I3PY0ROKCOCS.1 size=1048576 2024-09-14T10:57:54.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.870+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~I3PY0ROKCOCS.2 size=246979 2024-09-14T10:57:54.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.870+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=I3PY0ROKCOCS tag=4O4DRXDWHD9K type=write size=3392707 2024-09-14T10:57:54.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.874+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=9O9N3OMFZEKI type=del 2024-09-14T10:57:54.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.882+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~NDDXXSCOTYCK.0 size=959026 2024-09-14T10:57:54.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.882+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=NDDXXSCOTYCK tag=LGBS13AK50PS type=write size=2007602 2024-09-14T10:57:54.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.886+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~OVI5VW1ZQHJT.0 size=246339 2024-09-14T10:57:54.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.890+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=OVI5VW1ZQHJT tag=VHN7FS7ABFXW type=write size=1294915 2024-09-14T10:57:54.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.898+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~U96G9B71V3IC.0 size=89570 2024-09-14T10:57:54.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.898+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=U96G9B71V3IC tag=KGOPTGRDM9R4 type=write size=1138146 2024-09-14T10:57:54.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.902+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~08RIMB701JKI.0 size=1048576 2024-09-14T10:57:54.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.906+0000 7fdf8f02c8c0 1 < completed part key=_multipart_K3KJ7HDQF6ZH.2~08RIMB701JKI.1 size=487181 2024-09-14T10:57:54.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.910+0000 7fdf8f02c8c0 1 < completed multipart upload key=K3KJ7HDQF6ZH upload=08RIMB701JKI tag=7MNM8L56WHNQ type=write size=2584333 2024-09-14T10:57:54.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.914+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=Y9OAEWQFHKXM type=del size=4020139 2024-09-14T10:57:54.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.918+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=3BYWAGMHF431 type=del 2024-09-14T10:57:54.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.922+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=KW2Q63ZHMCG7 type=del size=2340713 2024-09-14T10:57:54.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.926+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~Q5Y8KZQQSPH8.0 size=1048576 2024-09-14T10:57:54.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.926+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_XUT55FR490EO.2~Q5Y8KZQQSPH8.1 size=1048576 2024-09-14T10:57:54.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.930+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~Q5Y8KZQQSPH8.2 size=119925 2024-09-14T10:57:54.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.934+0000 7fdf8f02c8c0 1 < canceled multipart upload key=XUT55FR490EO upload=Q5Y8KZQQSPH8 tag=HHIS99IWW12P type=write size=3265653 2024-09-14T10:57:54.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.942+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_9IDBODZBQRJR.2~F9VMV5XEPXOL.0 size=501461 2024-09-14T10:57:54.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.942+0000 7fdf8f02c8c0 1 > prepared multipart upload key=9IDBODZBQRJR upload=F9VMV5XEPXOL tag=0R9DNL02MHP2 type=write size=1550037 2024-09-14T10:57:54.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.942+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_HCGZ1MY5SKW9.2~458EXGEA34LS.0 size=1048576 2024-09-14T10:57:54.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.946+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~458EXGEA34LS.1 size=723251 2024-09-14T10:57:54.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.954+0000 7fdf8f02c8c0 1 < canceled multipart upload key=HCGZ1MY5SKW9 upload=458EXGEA34LS tag=0W9J0AJPLNNP type=write size=2820403 2024-09-14T10:57:54.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.958+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=KNG8YUU6CYTU type=del size=2126810 2024-09-14T10:57:54.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.962+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~1B1RACEGBBGB.0 size=627879 2024-09-14T10:57:54.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.966+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=1B1RACEGBBGB tag=JIY0WGJWJYVL type=write size=1676455 2024-09-14T10:57:54.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.974+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~Z2NKMGR7JKZ6.0 size=517005 2024-09-14T10:57:54.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.974+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=Z2NKMGR7JKZ6 tag=6DRGRCXIMIQF type=write size=1565581 2024-09-14T10:57:54.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.982+0000 7fdf8f02c8c0 1 < suggested update operation key=9IDBODZBQRJR tag=6PQ5WK174N7J type=del size=2517667 2024-09-14T10:57:54.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.986+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=PVUU57BMFVUA type=del size=573474 2024-09-14T10:57:54.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.990+0000 7fdf8f02c8c0 1 < completed write operation key=STHEUJ6VDPQB tag=HSIPOHQFWA04 type=write size=745993 2024-09-14T10:57:54.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.994+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=FHVBXAQRUA5L type=del size=3504656 2024-09-14T10:57:54.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:54.994+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_X1BN3054IKNS.2~J7AZYC1T2QHG.0 size=1048576 2024-09-14T10:57:54.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.002+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~J7AZYC1T2QHG.1 size=1048576 2024-09-14T10:57:55.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.006+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~J7AZYC1T2QHG.2 size=282293 2024-09-14T10:57:55.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.010+0000 7fdf8f02c8c0 1 < canceled multipart upload key=X1BN3054IKNS upload=J7AZYC1T2QHG tag=14WRH69DHYLM type=write size=3428021 2024-09-14T10:57:55.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.014+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=STYMQMZETA2L type=del size=2852834 2024-09-14T10:57:55.019 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.022+0000 7fdf8f02c8c0 1 < suggested remove operation key=X1BN3054IKNS tag=RTNNSAXFXPZI type=write 2024-09-14T10:57:55.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.026+0000 7fdf8f02c8c0 1 > prepared operation key=X0RT8UF3D0JC tag=6AFHR1Z7WKIC type=del size=1808359 2024-09-14T10:57:55.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.034+0000 7fdf8f02c8c0 1 < suggested update operation key=82N2FPU7LKTG tag=LDDLOY8BP493 type=del size=379113 2024-09-14T10:57:55.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.038+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=3QR2XJNCIIAB type=write size=649456 2024-09-14T10:57:55.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.042+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=2PHYEBK6NLAZ type=del 2024-09-14T10:57:55.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.046+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=KV992N0IFSJU type=del size=37829 2024-09-14T10:57:55.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.054+0000 7fdf8f02c8c0 1 < suggested remove operation key=LMNGCUFR187I tag=2LFEBG3QXAEA type=del 2024-09-14T10:57:55.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.054+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=WF233OXAQ0U9 type=del size=1035331 2024-09-14T10:57:55.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.058+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~RGAOB35PAALD.0 size=1048576 2024-09-14T10:57:55.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.062+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LCEH2YXNSOGT.2~RGAOB35PAALD.1 size=1048576 2024-09-14T10:57:55.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.062+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_LCEH2YXNSOGT.2~RGAOB35PAALD.2 size=787880 2024-09-14T10:57:55.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.070+0000 7fdf8f02c8c0 1 < canceled multipart upload key=LCEH2YXNSOGT upload=RGAOB35PAALD tag=W4S4V90F6T90 type=write size=3933608 2024-09-14T10:57:55.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.074+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~BK2BP030J9PW.0 size=1048576 2024-09-14T10:57:55.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.078+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~BK2BP030J9PW.1 size=1048576 2024-09-14T10:57:55.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.082+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~BK2BP030J9PW.2 size=991384 2024-09-14T10:57:55.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.082+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=BK2BP030J9PW tag=6LNW3QXJN6J7 type=write size=4137112 2024-09-14T10:57:55.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.086+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~I3PY0ROKCOCS.0 size=1048576 2024-09-14T10:57:55.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.090+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~I3PY0ROKCOCS.1 size=1048576 2024-09-14T10:57:55.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.090+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LMNGCUFR187I.2~I3PY0ROKCOCS.2 size=246979 2024-09-14T10:57:55.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.098+0000 7fdf8f02c8c0 1 < completed multipart upload key=LMNGCUFR187I upload=I3PY0ROKCOCS tag=4O4DRXDWHD9K type=write size=3392707 2024-09-14T10:57:55.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.106+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~S40UO41J23U7.0 size=1048576 2024-09-14T10:57:55.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.106+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~S40UO41J23U7.1 size=1048576 2024-09-14T10:57:55.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.110+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_HCGZ1MY5SKW9.2~S40UO41J23U7.2 size=719374 2024-09-14T10:57:55.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.110+0000 7fdf8f02c8c0 1 > prepared multipart upload key=HCGZ1MY5SKW9 upload=S40UO41J23U7 tag=004FQDUTJFE5 type=write size=3865102 2024-09-14T10:57:55.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.114+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~NDDXXSCOTYCK.0 size=959026 2024-09-14T10:57:55.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.118+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=NDDXXSCOTYCK tag=LGBS13AK50PS type=write size=2007602 2024-09-14T10:57:55.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.122+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=UB2KU1LTQKN6 type=del size=2062330 2024-09-14T10:57:55.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.126+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~U96G9B71V3IC.0 size=89570 2024-09-14T10:57:55.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.134+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=U96G9B71V3IC tag=KGOPTGRDM9R4 type=write size=1138146 2024-09-14T10:57:55.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.142+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~7CNNNOSDM4AM.0 size=1048576 2024-09-14T10:57:55.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.142+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~7CNNNOSDM4AM.1 size=1048576 2024-09-14T10:57:55.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.146+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_82N2FPU7LKTG.2~7CNNNOSDM4AM.2 size=179721 2024-09-14T10:57:55.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.146+0000 7fdf8f02c8c0 1 > prepared multipart upload key=82N2FPU7LKTG upload=7CNNNOSDM4AM tag=57LHBOTJUUKQ type=write size=3325449 2024-09-14T10:57:55.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.150+0000 7fdf8f02c8c0 1 < completed delete operation key=6VNI8FMHZ0FN tag=Y9OAEWQFHKXM type=del 2024-09-14T10:57:55.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.158+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~Y0DRVYCQK0MJ.0 size=1048576 2024-09-14T10:57:55.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.158+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_WA7HE8ZJ1W1M.2~Y0DRVYCQK0MJ.1 size=731153 2024-09-14T10:57:55.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.158+0000 7fdf8f02c8c0 1 > prepared multipart upload key=WA7HE8ZJ1W1M upload=Y0DRVYCQK0MJ tag=A4DQPJ6O3WQR type=write size=2828305 2024-09-14T10:57:55.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.166+0000 7fdf8f02c8c0 1 < suggested update operation key=LMNGCUFR187I tag=KW2Q63ZHMCG7 type=del size=2340713 2024-09-14T10:57:55.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.174+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~GAMSADGF2T90.0 size=1048576 2024-09-14T10:57:55.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.178+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~GAMSADGF2T90.1 size=431412 2024-09-14T10:57:55.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.178+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=GAMSADGF2T90 tag=M9AKTYMFCR26 type=write size=2528564 2024-09-14T10:57:55.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.182+0000 7fdf8f02c8c0 1 < completed part key=_multipart_9IDBODZBQRJR.2~F9VMV5XEPXOL.0 size=501461 2024-09-14T10:57:55.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.186+0000 7fdf8f02c8c0 1 < completed multipart upload key=9IDBODZBQRJR upload=F9VMV5XEPXOL tag=0R9DNL02MHP2 type=write size=1550037 2024-09-14T10:57:55.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.194+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~BHTWF0IA5MRF.0 size=816478 2024-09-14T10:57:55.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.194+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=BHTWF0IA5MRF tag=H3ARB6DL90PZ type=write size=1865054 2024-09-14T10:57:55.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.198+0000 7fdf8f02c8c0 1 < completed delete operation key=ZSBCGOXXJ0D5 tag=KNG8YUU6CYTU type=del 2024-09-14T10:57:55.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.202+0000 7fdf8f02c8c0 1 > prepared operation key=OFY1G5R28CK6 tag=51VGXYJCU1SP type=del size=2968349 2024-09-14T10:57:55.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.206+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~Z2NKMGR7JKZ6.0 size=517005 2024-09-14T10:57:55.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.210+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=Z2NKMGR7JKZ6 tag=6DRGRCXIMIQF type=write size=1565581 2024-09-14T10:57:55.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.218+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~SBO7IH9Q7KO4.0 size=1048576 2024-09-14T10:57:55.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.222+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~SBO7IH9Q7KO4.1 size=1048576 2024-09-14T10:57:55.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.226+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~SBO7IH9Q7KO4.2 size=196539 2024-09-14T10:57:55.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.226+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=SBO7IH9Q7KO4 tag=QQZBC46TH2XR type=write size=3342267 2024-09-14T10:57:55.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.230+0000 7fdf8f02c8c0 -1 < failed to complete operation key=LMNGCUFR187I tag=PVUU57BMFVUA type=del size=573474: (22) Invalid argument 2024-09-14T10:57:55.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.234+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~V37NODXI6UZW.0 size=1048576 2024-09-14T10:57:55.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.238+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~V37NODXI6UZW.1 size=1048576 2024-09-14T10:57:55.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.242+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~V37NODXI6UZW.2 size=445178 2024-09-14T10:57:55.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.242+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=V37NODXI6UZW tag=KOF7F9PXE0S0 type=write size=3590906 2024-09-14T10:57:55.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.246+0000 7fdf8f02c8c0 -1 < failed to complete operation key=82N2FPU7LKTG tag=FHVBXAQRUA5L type=del size=3504656: (22) Invalid argument 2024-09-14T10:57:55.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.250+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=PUC55DQ9W3PX type=del size=2131463 2024-09-14T10:57:55.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.254+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=STYMQMZETA2L type=del 2024-09-14T10:57:55.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.258+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=NK5NC22JG3I4 type=del size=2723864 2024-09-14T10:57:55.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.262+0000 7fdf8f02c8c0 1 < completed delete operation key=X0RT8UF3D0JC tag=6AFHR1Z7WKIC type=del 2024-09-14T10:57:55.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.266+0000 7fdf8f02c8c0 1 > prepared operation key=K3KJ7HDQF6ZH tag=AIVMA9GAUNT9 type=write size=329766 2024-09-14T10:57:55.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.270+0000 7fdf8f02c8c0 1 < completed write operation key=3T0H42SC1ETB tag=3QR2XJNCIIAB type=write size=649456 2024-09-14T10:57:55.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.274+0000 7fdf8f02c8c0 1 > prepared operation key=MNBXQTJBS1QS tag=WVOSOYIU5TSN type=del size=2248663 2024-09-14T10:57:55.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.278+0000 7fdf8f02c8c0 1 < canceled operation key=STB3W5URFJEZ tag=KV992N0IFSJU type=del size=37829 2024-09-14T10:57:55.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.286+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~DP3EOQSOD6KA.0 size=98432 2024-09-14T10:57:55.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.286+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=DP3EOQSOD6KA tag=Y0YW41VPZ1OW type=write size=1147008 2024-09-14T10:57:55.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.294+0000 7fdf8f02c8c0 1 < suggested update operation key=82N2FPU7LKTG tag=WF233OXAQ0U9 type=del size=1035331 2024-09-14T10:57:55.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.298+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=MM5FM82Z1Z8L type=del size=644003 2024-09-14T10:57:55.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.302+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~BK2BP030J9PW.0 size=1048576 2024-09-14T10:57:55.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.302+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~BK2BP030J9PW.1 size=1048576 2024-09-14T10:57:55.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.306+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~BK2BP030J9PW.2 size=991384 2024-09-14T10:57:55.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.314+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=BK2BP030J9PW tag=6LNW3QXJN6J7 type=write size=4137112 2024-09-14T10:57:55.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.318+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~K7NA96LRVNXH.0 size=1048576 2024-09-14T10:57:55.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.322+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~K7NA96LRVNXH.1 size=735619 2024-09-14T10:57:55.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.322+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=K7NA96LRVNXH tag=57UCHQFEN2MI type=write size=2832771 2024-09-14T10:57:55.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.322+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_HCGZ1MY5SKW9.2~S40UO41J23U7.0 size=1048576 2024-09-14T10:57:55.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.326+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~S40UO41J23U7.1 size=1048576 2024-09-14T10:57:55.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.330+0000 7fdf8f02c8c0 1 < completed part key=_multipart_HCGZ1MY5SKW9.2~S40UO41J23U7.2 size=719374 2024-09-14T10:57:55.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.334+0000 7fdf8f02c8c0 1 < canceled multipart upload key=HCGZ1MY5SKW9 upload=S40UO41J23U7 tag=004FQDUTJFE5 type=write size=3865102 2024-09-14T10:57:55.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.342+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~L3IN13KBO9FZ.0 size=1048576 2024-09-14T10:57:55.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.350+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~L3IN13KBO9FZ.1 size=1048576 2024-09-14T10:57:55.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.350+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~L3IN13KBO9FZ.2 size=529292 2024-09-14T10:57:55.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.350+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=L3IN13KBO9FZ tag=85RBRE0V28IV type=write size=3675020 2024-09-14T10:57:55.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.354+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=UB2KU1LTQKN6 type=del 2024-09-14T10:57:55.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.358+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=0QQWXZ58SAG4 type=del size=620533 2024-09-14T10:57:55.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.362+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~7CNNNOSDM4AM.0 size=1048576 2024-09-14T10:57:55.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.366+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~7CNNNOSDM4AM.1 size=1048576 2024-09-14T10:57:55.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.366+0000 7fdf8f02c8c0 1 < completed part key=_multipart_82N2FPU7LKTG.2~7CNNNOSDM4AM.2 size=179721 2024-09-14T10:57:55.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.374+0000 7fdf8f02c8c0 1 < completed multipart upload key=82N2FPU7LKTG upload=7CNNNOSDM4AM tag=57LHBOTJUUKQ type=write size=3325449 2024-09-14T10:57:55.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.378+0000 7fdf8f02c8c0 1 > prepared operation key=APDKRWHOUH9T tag=S9DRV559HYIY type=del size=634253 2024-09-14T10:57:55.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.382+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~Y0DRVYCQK0MJ.0 size=1048576 2024-09-14T10:57:55.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.386+0000 7fdf8f02c8c0 1 < completed part key=_multipart_WA7HE8ZJ1W1M.2~Y0DRVYCQK0MJ.1 size=731153 2024-09-14T10:57:55.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.394+0000 7fdf8f02c8c0 1 < completed multipart upload key=WA7HE8ZJ1W1M upload=Y0DRVYCQK0MJ tag=A4DQPJ6O3WQR type=write size=2828305 2024-09-14T10:57:55.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.398+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_KVZEUYUSV5JI.2~HTKR5M5ZM8W4.0 size=921878 2024-09-14T10:57:55.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.398+0000 7fdf8f02c8c0 1 > prepared multipart upload key=KVZEUYUSV5JI upload=HTKR5M5ZM8W4 tag=L2I6YBOEUY2N type=write size=1970454 2024-09-14T10:57:55.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.402+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~GAMSADGF2T90.0 size=1048576 2024-09-14T10:57:55.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.402+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~GAMSADGF2T90.1 size=431412 2024-09-14T10:57:55.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.406+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=GAMSADGF2T90 tag=M9AKTYMFCR26 type=write size=2528564 2024-09-14T10:57:55.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.410+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=V9EKE67J0AVH type=del size=2692675 2024-09-14T10:57:55.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.414+0000 7fdf8f02c8c0 1 < completed part key=_multipart_0QJLAH0EPKVD.2~BHTWF0IA5MRF.0 size=816478 2024-09-14T10:57:55.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.418+0000 7fdf8f02c8c0 1 < completed multipart upload key=0QJLAH0EPKVD upload=BHTWF0IA5MRF tag=H3ARB6DL90PZ type=write size=1865054 2024-09-14T10:57:55.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.422+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~11EKA7EVT4EV.0 size=1048576 2024-09-14T10:57:55.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.426+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~11EKA7EVT4EV.1 size=42907 2024-09-14T10:57:55.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.426+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=11EKA7EVT4EV tag=U1OJUJ1H4Y6H type=write size=2140059 2024-09-14T10:57:55.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.426+0000 7fdf8f02c8c0 1 < completed delete operation key=OFY1G5R28CK6 tag=51VGXYJCU1SP type=del 2024-09-14T10:57:55.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.434+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_49O8DPTGA65S.2~J59D43TSTC2D.0 size=245551 2024-09-14T10:57:55.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.434+0000 7fdf8f02c8c0 1 > prepared multipart upload key=49O8DPTGA65S upload=J59D43TSTC2D tag=YQ1Q8MF00NEK type=write size=1294127 2024-09-14T10:57:55.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.434+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~SBO7IH9Q7KO4.0 size=1048576 2024-09-14T10:57:55.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.438+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~SBO7IH9Q7KO4.1 size=1048576 2024-09-14T10:57:55.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.442+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~SBO7IH9Q7KO4.2 size=196539 2024-09-14T10:57:55.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.446+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=SBO7IH9Q7KO4 tag=QQZBC46TH2XR type=write size=3342267 2024-09-14T10:57:55.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.450+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~Z0UTRH69JJ2H.0 size=1048576 2024-09-14T10:57:55.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.454+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~Z0UTRH69JJ2H.1 size=638716 2024-09-14T10:57:55.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.454+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=Z0UTRH69JJ2H tag=FD56KZINH3PY type=write size=2735868 2024-09-14T10:57:55.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.454+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~V37NODXI6UZW.0 size=1048576 2024-09-14T10:57:55.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.458+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~V37NODXI6UZW.1 size=1048576 2024-09-14T10:57:55.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.462+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~V37NODXI6UZW.2 size=445178 2024-09-14T10:57:55.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.466+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=V37NODXI6UZW tag=KOF7F9PXE0S0 type=write size=3590906 2024-09-14T10:57:55.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.466+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=A3L2354JB5D2 type=del size=4183946 2024-09-14T10:57:55.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.470+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=PUC55DQ9W3PX type=del 2024-09-14T10:57:55.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.470+0000 7fdf8f02c8c0 1 > prepared operation key=YU9DAJA242Q7 tag=F5SH6EN4WNP0 type=del size=3514543 2024-09-14T10:57:55.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.474+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=NK5NC22JG3I4 type=del 2024-09-14T10:57:55.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.478+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=RC1APHR3YNZY type=write size=474718 2024-09-14T10:57:55.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.482+0000 7fdf8f02c8c0 1 < completed write operation key=K3KJ7HDQF6ZH tag=AIVMA9GAUNT9 type=write size=329766 2024-09-14T10:57:55.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.486+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=SXSFA926XE5I type=write size=20154 2024-09-14T10:57:55.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.486+0000 7fdf8f02c8c0 1 < completed delete operation key=MNBXQTJBS1QS tag=WVOSOYIU5TSN type=del 2024-09-14T10:57:55.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.490+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=TD2OE4WD3A6T type=del size=3160125 2024-09-14T10:57:55.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.494+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~DP3EOQSOD6KA.0 size=98432 2024-09-14T10:57:55.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.498+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=DP3EOQSOD6KA tag=Y0YW41VPZ1OW type=write size=1147008 2024-09-14T10:57:55.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.502+0000 7fdf8f02c8c0 1 > prepared operation key=LCEH2YXNSOGT tag=T2N01N9GK7YO type=del size=128216 2024-09-14T10:57:55.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.506+0000 7fdf8f02c8c0 1 < completed delete operation key=LMNGCUFR187I tag=MM5FM82Z1Z8L type=del 2024-09-14T10:57:55.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.510+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~UY0QCFKW1OOR.0 size=1048576 2024-09-14T10:57:55.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.514+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X0RT8UF3D0JC.2~UY0QCFKW1OOR.1 size=424347 2024-09-14T10:57:55.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.514+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X0RT8UF3D0JC upload=UY0QCFKW1OOR tag=41DRZHJK2SW1 type=write size=2521499 2024-09-14T10:57:55.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.518+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~K7NA96LRVNXH.0 size=1048576 2024-09-14T10:57:55.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.518+0000 7fdf8f02c8c0 1 < completed part key=_multipart_XUT55FR490EO.2~K7NA96LRVNXH.1 size=735619 2024-09-14T10:57:55.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.526+0000 7fdf8f02c8c0 1 < completed multipart upload key=XUT55FR490EO upload=K7NA96LRVNXH tag=57UCHQFEN2MI type=write size=2832771 2024-09-14T10:57:55.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.530+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~0QPQBWAPV568.0 size=1048576 2024-09-14T10:57:55.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.534+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~0QPQBWAPV568.1 size=1048576 2024-09-14T10:57:55.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.538+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_304ZNF4OC1ML.2~0QPQBWAPV568.2 size=375063 2024-09-14T10:57:55.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.538+0000 7fdf8f02c8c0 1 > prepared multipart upload key=304ZNF4OC1ML upload=0QPQBWAPV568 tag=LUJ29WPLPGQG type=write size=3520791 2024-09-14T10:57:55.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.538+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~L3IN13KBO9FZ.0 size=1048576 2024-09-14T10:57:55.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.538+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_APDKRWHOUH9T.2~L3IN13KBO9FZ.1 size=1048576 2024-09-14T10:57:55.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.542+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~L3IN13KBO9FZ.2 size=529292 2024-09-14T10:57:55.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.550+0000 7fdf8f02c8c0 1 < canceled multipart upload key=APDKRWHOUH9T upload=L3IN13KBO9FZ tag=85RBRE0V28IV type=write size=3675020 2024-09-14T10:57:55.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.554+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~BNFRDK9JI5J1.0 size=1048576 2024-09-14T10:57:55.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.558+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~BNFRDK9JI5J1.1 size=373722 2024-09-14T10:57:55.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.558+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=BNFRDK9JI5J1 tag=KNOA9TGELRI3 type=write size=2470874 2024-09-14T10:57:55.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.562+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=0QQWXZ58SAG4 type=del 2024-09-14T10:57:55.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.566+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=TF26HTSLZX9X type=del size=2085304 2024-09-14T10:57:55.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.566+0000 7fdf8f02c8c0 1 < completed delete operation key=APDKRWHOUH9T tag=S9DRV559HYIY type=del 2024-09-14T10:57:55.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.570+0000 7fdf8f02c8c0 1 > prepared operation key=X1BN3054IKNS tag=4WFP2RV8SEEB type=del size=4017855 2024-09-14T10:57:55.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.574+0000 7fdf8f02c8c0 1 < completed part key=_multipart_KVZEUYUSV5JI.2~HTKR5M5ZM8W4.0 size=921878 2024-09-14T10:57:55.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.578+0000 7fdf8f02c8c0 1 < completed multipart upload key=KVZEUYUSV5JI upload=HTKR5M5ZM8W4 tag=L2I6YBOEUY2N type=write size=1970454 2024-09-14T10:57:55.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.586+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~B8LSLOFRNVG5.0 size=1048576 2024-09-14T10:57:55.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.590+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~B8LSLOFRNVG5.1 size=1048576 2024-09-14T10:57:55.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.594+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_X1BN3054IKNS.2~B8LSLOFRNVG5.2 size=345227 2024-09-14T10:57:55.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.594+0000 7fdf8f02c8c0 1 > prepared multipart upload key=X1BN3054IKNS upload=B8LSLOFRNVG5 tag=1PJ65WH2WZZ0 type=write size=3490955 2024-09-14T10:57:55.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.598+0000 7fdf8f02c8c0 1 < suggested remove operation key=KVZEUYUSV5JI tag=V9EKE67J0AVH type=del 2024-09-14T10:57:55.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.602+0000 7fdf8f02c8c0 1 > prepared operation key=KVZEUYUSV5JI tag=04VG9W8QTS9W type=del size=2954943 2024-09-14T10:57:55.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.606+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~11EKA7EVT4EV.0 size=1048576 2024-09-14T10:57:55.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.610+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZSBCGOXXJ0D5.2~11EKA7EVT4EV.1 size=42907 2024-09-14T10:57:55.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.618+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZSBCGOXXJ0D5 upload=11EKA7EVT4EV tag=U1OJUJ1H4Y6H type=write size=2140059 2024-09-14T10:57:55.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.618+0000 7fdf8f02c8c0 1 > prepared operation key=3T0H42SC1ETB tag=AFAGGVCWW208 type=del size=1034278 2024-09-14T10:57:55.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.622+0000 7fdf8f02c8c0 1 < completed part key=_multipart_49O8DPTGA65S.2~J59D43TSTC2D.0 size=245551 2024-09-14T10:57:55.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.630+0000 7fdf8f02c8c0 1 < completed multipart upload key=49O8DPTGA65S upload=J59D43TSTC2D tag=YQ1Q8MF00NEK type=write size=1294127 2024-09-14T10:57:55.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.634+0000 7fdf8f02c8c0 1 > prepared operation key=82N2FPU7LKTG tag=4FLYX83Q0WQ3 type=del size=3298065 2024-09-14T10:57:55.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.638+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~Z0UTRH69JJ2H.0 size=1048576 2024-09-14T10:57:55.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.642+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~Z0UTRH69JJ2H.1 size=638716 2024-09-14T10:57:55.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.650+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=Z0UTRH69JJ2H tag=FD56KZINH3PY type=write size=2735868 2024-09-14T10:57:55.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.654+0000 7fdf8f02c8c0 1 > prepared operation key=LFLY0V3FRRW5 tag=SS81899FBN5O type=del size=50340 2024-09-14T10:57:55.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.658+0000 7fdf8f02c8c0 1 < completed delete operation key=HCGZ1MY5SKW9 tag=A3L2354JB5D2 type=del 2024-09-14T10:57:55.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.662+0000 7fdf8f02c8c0 1 > prepared operation key=49O8DPTGA65S tag=TPP2V865MFCV type=del size=218894 2024-09-14T10:57:55.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.666+0000 7fdf8f02c8c0 1 < completed delete operation key=YU9DAJA242Q7 tag=F5SH6EN4WNP0 type=del 2024-09-14T10:57:55.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.670+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~ASPPLQ4UK61Y.0 size=1048576 2024-09-14T10:57:55.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.674+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~ASPPLQ4UK61Y.1 size=1048576 2024-09-14T10:57:55.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.678+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3QSOKUSZ57QM.2~ASPPLQ4UK61Y.2 size=526047 2024-09-14T10:57:55.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.678+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3QSOKUSZ57QM upload=ASPPLQ4UK61Y tag=I9035V8FDXG0 type=write size=3671775 2024-09-14T10:57:55.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.682+0000 7fdf8f02c8c0 1 < completed write operation key=6VNI8FMHZ0FN tag=RC1APHR3YNZY type=write size=474718 2024-09-14T10:57:55.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.682+0000 7fdf8f02c8c0 1 > prepared operation key=L1ERJ0JSRDMG tag=UDG0NM61D8CW type=write size=298934 2024-09-14T10:57:55.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.686+0000 7fdf8f02c8c0 1 < completed write operation key=ZF6IDD8B3CFO tag=SXSFA926XE5I type=write size=20154 2024-09-14T10:57:55.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.690+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=3GSPMJZM0KGE type=del size=946248 2024-09-14T10:57:55.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.694+0000 7fdf8f02c8c0 1 < completed delete operation key=1E72V12EPEH3 tag=TD2OE4WD3A6T type=del 2024-09-14T10:57:55.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.698+0000 7fdf8f02c8c0 1 > prepared operation key=304ZNF4OC1ML tag=UCY1WNY1UIGU type=del size=426762 2024-09-14T10:57:55.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.702+0000 7fdf8f02c8c0 1 < completed delete operation key=LCEH2YXNSOGT tag=T2N01N9GK7YO type=del 2024-09-14T10:57:55.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.706+0000 7fdf8f02c8c0 1 > prepared operation key=9IDBODZBQRJR tag=YM45V0SZ6S7Q type=del size=1235188 2024-09-14T10:57:55.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.710+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~UY0QCFKW1OOR.0 size=1048576 2024-09-14T10:57:55.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.714+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X0RT8UF3D0JC.2~UY0QCFKW1OOR.1 size=424347 2024-09-14T10:57:55.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.718+0000 7fdf8f02c8c0 1 < completed multipart upload key=X0RT8UF3D0JC upload=UY0QCFKW1OOR tag=41DRZHJK2SW1 type=write size=2521499 2024-09-14T10:57:55.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.726+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~LWZRZVHUSRSC.0 size=1048576 2024-09-14T10:57:55.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.726+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LFLY0V3FRRW5.2~LWZRZVHUSRSC.1 size=793920 2024-09-14T10:57:55.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.726+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LFLY0V3FRRW5 upload=LWZRZVHUSRSC tag=N2TL8TD31MY7 type=write size=2891072 2024-09-14T10:57:55.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.730+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~0QPQBWAPV568.0 size=1048576 2024-09-14T10:57:55.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.734+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~0QPQBWAPV568.1 size=1048576 2024-09-14T10:57:55.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.738+0000 7fdf8f02c8c0 1 < completed part key=_multipart_304ZNF4OC1ML.2~0QPQBWAPV568.2 size=375063 2024-09-14T10:57:55.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.742+0000 7fdf8f02c8c0 1 < completed multipart upload key=304ZNF4OC1ML upload=0QPQBWAPV568 tag=LUJ29WPLPGQG type=write size=3520791 2024-09-14T10:57:55.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.746+0000 7fdf8f02c8c0 1 > prepared operation key=HCGZ1MY5SKW9 tag=IC3U0L9OQO34 type=del size=976422 2024-09-14T10:57:55.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.750+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~BNFRDK9JI5J1.0 size=1048576 2024-09-14T10:57:55.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.754+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~BNFRDK9JI5J1.1 size=373722 2024-09-14T10:57:55.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.758+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=BNFRDK9JI5J1 tag=KNOA9TGELRI3 type=write size=2470874 2024-09-14T10:57:55.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.762+0000 7fdf8f02c8c0 1 > prepared operation key=3QSOKUSZ57QM tag=4Q47KN2ZGLGP type=del size=674734 2024-09-14T10:57:55.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.766+0000 7fdf8f02c8c0 1 < completed delete operation key=L1ERJ0JSRDMG tag=TF26HTSLZX9X type=del 2024-09-14T10:57:55.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.770+0000 7fdf8f02c8c0 1 > prepared operation key=WA7HE8ZJ1W1M tag=55RYA89L003F type=write size=680036 2024-09-14T10:57:55.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.774+0000 7fdf8f02c8c0 1 < completed delete operation key=X1BN3054IKNS tag=4WFP2RV8SEEB type=del 2024-09-14T10:57:55.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.778+0000 7fdf8f02c8c0 1 > prepared operation key=TZZ05IIMZJ4J tag=D71B088K9DM5 type=del size=2979589 2024-09-14T10:57:55.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.782+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~B8LSLOFRNVG5.0 size=1048576 2024-09-14T10:57:55.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.786+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~B8LSLOFRNVG5.1 size=1048576 2024-09-14T10:57:55.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.790+0000 7fdf8f02c8c0 1 < completed part key=_multipart_X1BN3054IKNS.2~B8LSLOFRNVG5.2 size=345227 2024-09-14T10:57:55.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.798+0000 7fdf8f02c8c0 1 < completed multipart upload key=X1BN3054IKNS upload=B8LSLOFRNVG5 tag=1PJ65WH2WZZ0 type=write size=3490955 2024-09-14T10:57:55.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.806+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~2U3P2E973179.0 size=1048576 2024-09-14T10:57:55.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.810+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~2U3P2E973179.1 size=126100 2024-09-14T10:57:55.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.810+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=2U3P2E973179 tag=XPJL0L0NUJKU type=write size=2223252 2024-09-14T10:57:55.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.814+0000 7fdf8f02c8c0 1 < completed delete operation key=KVZEUYUSV5JI tag=04VG9W8QTS9W type=del 2024-09-14T10:57:55.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.818+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~FAK6TURAUAMA.0 size=1048576 2024-09-14T10:57:55.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.822+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_YU9DAJA242Q7.2~FAK6TURAUAMA.1 size=944938 2024-09-14T10:57:55.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.822+0000 7fdf8f02c8c0 1 > prepared multipart upload key=YU9DAJA242Q7 upload=FAK6TURAUAMA tag=L2PNWVIN761H type=write size=3042090 2024-09-14T10:57:55.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.830+0000 7fdf8f02c8c0 1 < suggested update operation key=3T0H42SC1ETB tag=AFAGGVCWW208 type=del size=1034278 2024-09-14T10:57:55.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.838+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZSBCGOXXJ0D5.2~SGMUW2WGAUCP.0 size=233474 2024-09-14T10:57:55.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.838+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZSBCGOXXJ0D5 upload=SGMUW2WGAUCP tag=743466W8MLV3 type=write size=1282050 2024-09-14T10:57:55.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.846+0000 7fdf8f02c8c0 1 < suggested remove operation key=82N2FPU7LKTG tag=4FLYX83Q0WQ3 type=del 2024-09-14T10:57:55.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.854+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~B5CRJXV0VHN3.0 size=1048576 2024-09-14T10:57:55.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.854+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_3T0H42SC1ETB.2~B5CRJXV0VHN3.1 size=397155 2024-09-14T10:57:55.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.854+0000 7fdf8f02c8c0 1 > prepared multipart upload key=3T0H42SC1ETB upload=B5CRJXV0VHN3 tag=W7E4NSLIFNYU type=write size=2494307 2024-09-14T10:57:55.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.858+0000 7fdf8f02c8c0 1 < completed delete operation key=LFLY0V3FRRW5 tag=SS81899FBN5O type=del 2024-09-14T10:57:55.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.866+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_MNBXQTJBS1QS.2~K93QMJOTDSVE.0 size=327542 2024-09-14T10:57:55.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.866+0000 7fdf8f02c8c0 1 > prepared multipart upload key=MNBXQTJBS1QS upload=K93QMJOTDSVE tag=P2M7Y9Z59BJ9 type=write size=1376118 2024-09-14T10:57:55.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.870+0000 7fdf8f02c8c0 1 < completed delete operation key=49O8DPTGA65S tag=TPP2V865MFCV type=del 2024-09-14T10:57:55.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.878+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~6W9OZSUQS1MU.0 size=1048576 2024-09-14T10:57:55.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.878+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_APDKRWHOUH9T.2~6W9OZSUQS1MU.1 size=600434 2024-09-14T10:57:55.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.878+0000 7fdf8f02c8c0 1 > prepared multipart upload key=APDKRWHOUH9T upload=6W9OZSUQS1MU tag=NOKUAISIQ8K5 type=write size=2697586 2024-09-14T10:57:55.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.882+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~ASPPLQ4UK61Y.0 size=1048576 2024-09-14T10:57:55.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.886+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~ASPPLQ4UK61Y.1 size=1048576 2024-09-14T10:57:55.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.890+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3QSOKUSZ57QM.2~ASPPLQ4UK61Y.2 size=526047 2024-09-14T10:57:55.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.898+0000 7fdf8f02c8c0 1 < completed multipart upload key=3QSOKUSZ57QM upload=ASPPLQ4UK61Y tag=I9035V8FDXG0 type=write size=3671775 2024-09-14T10:57:55.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.902+0000 7fdf8f02c8c0 1 > prepared operation key=6VNI8FMHZ0FN tag=KHN1XCAASCXA type=del size=1907765 2024-09-14T10:57:55.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.906+0000 7fdf8f02c8c0 1 < completed write operation key=L1ERJ0JSRDMG tag=UDG0NM61D8CW type=write size=298934 2024-09-14T10:57:55.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.914+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~58YEPUA4B7Q7.0 size=1048576 2024-09-14T10:57:55.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.918+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_ZF6IDD8B3CFO.2~58YEPUA4B7Q7.1 size=123885 2024-09-14T10:57:55.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.918+0000 7fdf8f02c8c0 1 > prepared multipart upload key=ZF6IDD8B3CFO upload=58YEPUA4B7Q7 tag=K9CSBJW5PBB1 type=write size=2221037 2024-09-14T10:57:55.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.922+0000 7fdf8f02c8c0 1 < completed delete operation key=ZF6IDD8B3CFO tag=3GSPMJZM0KGE type=del 2024-09-14T10:57:55.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.926+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=VR4KS5BF0LDP type=write size=538532 2024-09-14T10:57:55.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.930+0000 7fdf8f02c8c0 1 < completed delete operation key=304ZNF4OC1ML tag=UCY1WNY1UIGU type=del 2024-09-14T10:57:55.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.934+0000 7fdf8f02c8c0 1 > prepared operation key=STB3W5URFJEZ tag=EG2RJU13413O type=del size=3752483 2024-09-14T10:57:55.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.942+0000 7fdf8f02c8c0 1 < suggested remove operation key=9IDBODZBQRJR tag=YM45V0SZ6S7Q type=del 2024-09-14T10:57:55.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.950+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~E0FSKVLFLIGP.0 size=1048576 2024-09-14T10:57:55.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.950+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_L1ERJ0JSRDMG.2~E0FSKVLFLIGP.1 size=16689 2024-09-14T10:57:55.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.950+0000 7fdf8f02c8c0 1 > prepared multipart upload key=L1ERJ0JSRDMG upload=E0FSKVLFLIGP tag=YK9WLAUSJBO4 type=write size=2113841 2024-09-14T10:57:55.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.954+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~LWZRZVHUSRSC.0 size=1048576 2024-09-14T10:57:55.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.958+0000 7fdf8f02c8c0 1 < completed part key=_multipart_LFLY0V3FRRW5.2~LWZRZVHUSRSC.1 size=793920 2024-09-14T10:57:55.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.962+0000 7fdf8f02c8c0 1 < completed multipart upload key=LFLY0V3FRRW5 upload=LWZRZVHUSRSC tag=N2TL8TD31MY7 type=write size=2891072 2024-09-14T10:57:55.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.966+0000 7fdf8f02c8c0 1 > prepared operation key=ZSBCGOXXJ0D5 tag=3ZYGJQ5UAOEP type=del size=1356262 2024-09-14T10:57:55.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.970+0000 7fdf8f02c8c0 1 < canceled operation key=HCGZ1MY5SKW9 tag=IC3U0L9OQO34 type=del size=976422 2024-09-14T10:57:55.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.974+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=QT6AX2NDSNOA type=del size=4122238 2024-09-14T10:57:55.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.978+0000 7fdf8f02c8c0 1 < completed delete operation key=3QSOKUSZ57QM tag=4Q47KN2ZGLGP type=del 2024-09-14T10:57:55.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.986+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~0D1LRSWZIXI7.0 size=1048576 2024-09-14T10:57:55.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.990+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~0D1LRSWZIXI7.1 size=1048576 2024-09-14T10:57:55.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.994+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_STHEUJ6VDPQB.2~0D1LRSWZIXI7.2 size=715673 2024-09-14T10:57:55.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.994+0000 7fdf8f02c8c0 1 > prepared multipart upload key=STHEUJ6VDPQB upload=0D1LRSWZIXI7 tag=6G1YXH1FJ7EE type=write size=3861401 2024-09-14T10:57:55.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:55.998+0000 7fdf8f02c8c0 1 < completed write operation key=WA7HE8ZJ1W1M tag=55RYA89L003F type=write size=680036 2024-09-14T10:57:56.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.010+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~6CTNGXGLHHL1.0 size=1048576 2024-09-14T10:57:56.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.010+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_XUT55FR490EO.2~6CTNGXGLHHL1.1 size=399714 2024-09-14T10:57:56.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.010+0000 7fdf8f02c8c0 1 > prepared multipart upload key=XUT55FR490EO upload=6CTNGXGLHHL1 tag=J8DL139WIJBI type=write size=2496866 2024-09-14T10:57:56.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.014+0000 7fdf8f02c8c0 1 < completed delete operation key=TZZ05IIMZJ4J tag=D71B088K9DM5 type=del 2024-09-14T10:57:56.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.018+0000 7fdf8f02c8c0 1 > prepared operation key=ZF6IDD8B3CFO tag=CYBRGLF9HIT2 type=del size=756722 2024-09-14T10:57:56.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.022+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~2U3P2E973179.0 size=1048576 2024-09-14T10:57:56.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.026+0000 7fdf8f02c8c0 1 < completed part key=_multipart_L1ERJ0JSRDMG.2~2U3P2E973179.1 size=126100 2024-09-14T10:57:56.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.034+0000 7fdf8f02c8c0 1 < completed multipart upload key=L1ERJ0JSRDMG upload=2U3P2E973179 tag=XPJL0L0NUJKU type=write size=2223252 2024-09-14T10:57:56.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.038+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~33FO7WWRDNN4.0 size=1048576 2024-09-14T10:57:56.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.042+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_LMNGCUFR187I.2~33FO7WWRDNN4.1 size=563410 2024-09-14T10:57:56.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.042+0000 7fdf8f02c8c0 1 > prepared multipart upload key=LMNGCUFR187I upload=33FO7WWRDNN4 tag=JHFKES51PMI2 type=write size=2660562 2024-09-14T10:57:56.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.046+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~FAK6TURAUAMA.0 size=1048576 2024-09-14T10:57:56.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.050+0000 7fdf8f02c8c0 1 < completed part key=_multipart_YU9DAJA242Q7.2~FAK6TURAUAMA.1 size=944938 2024-09-14T10:57:56.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.058+0000 7fdf8f02c8c0 1 < completed multipart upload key=YU9DAJA242Q7 upload=FAK6TURAUAMA tag=L2PNWVIN761H type=write size=3042090 2024-09-14T10:57:56.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.062+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~TWTAWK84E8XZ.0 size=1048576 2024-09-14T10:57:56.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.066+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_K3KJ7HDQF6ZH.2~TWTAWK84E8XZ.1 size=20999 2024-09-14T10:57:56.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.066+0000 7fdf8f02c8c0 1 > prepared multipart upload key=K3KJ7HDQF6ZH upload=TWTAWK84E8XZ tag=0OTQ3R6EVLGB type=write size=2118151 2024-09-14T10:57:56.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.066+0000 7fdf8f02c8c0 1 < canceled part key=_multipart_ZSBCGOXXJ0D5.2~SGMUW2WGAUCP.0 size=233474 2024-09-14T10:57:56.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.074+0000 7fdf8f02c8c0 1 < canceled multipart upload key=ZSBCGOXXJ0D5 upload=SGMUW2WGAUCP tag=743466W8MLV3 type=write size=1282050 2024-09-14T10:57:56.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.078+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=AMKEVJ2ZQYKD type=del size=1035742 2024-09-14T10:57:56.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.082+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~B5CRJXV0VHN3.0 size=1048576 2024-09-14T10:57:56.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.086+0000 7fdf8f02c8c0 1 < completed part key=_multipart_3T0H42SC1ETB.2~B5CRJXV0VHN3.1 size=397155 2024-09-14T10:57:56.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.090+0000 7fdf8f02c8c0 1 < completed multipart upload key=3T0H42SC1ETB upload=B5CRJXV0VHN3 tag=W7E4NSLIFNYU type=write size=2494307 2024-09-14T10:57:56.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.094+0000 7fdf8f02c8c0 1 > prepared operation key=0QJLAH0EPKVD tag=HN5Z6XBWSCEL type=del size=748372 2024-09-14T10:57:56.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.098+0000 7fdf8f02c8c0 1 < completed part key=_multipart_MNBXQTJBS1QS.2~K93QMJOTDSVE.0 size=327542 2024-09-14T10:57:56.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.106+0000 7fdf8f02c8c0 1 < completed multipart upload key=MNBXQTJBS1QS upload=K93QMJOTDSVE tag=P2M7Y9Z59BJ9 type=write size=1376118 2024-09-14T10:57:56.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.110+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=5AW56HUSMY58 type=del size=1289175 2024-09-14T10:57:56.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.114+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~6W9OZSUQS1MU.0 size=1048576 2024-09-14T10:57:56.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.114+0000 7fdf8f02c8c0 1 < completed part key=_multipart_APDKRWHOUH9T.2~6W9OZSUQS1MU.1 size=600434 2024-09-14T10:57:56.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.122+0000 7fdf8f02c8c0 1 < completed multipart upload key=APDKRWHOUH9T upload=6W9OZSUQS1MU tag=NOKUAISIQ8K5 type=write size=2697586 2024-09-14T10:57:56.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.126+0000 7fdf8f02c8c0 1 > prepared operation key=LMNGCUFR187I tag=79SQMG60181G type=del size=899684 2024-09-14T10:57:56.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.130+0000 7fdf8f02c8c0 1 < canceled operation key=6VNI8FMHZ0FN tag=KHN1XCAASCXA type=del size=1907765 2024-09-14T10:57:56.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.138+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_0QJLAH0EPKVD.2~BWKWKOO7EYAO.0 size=740799 2024-09-14T10:57:56.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.138+0000 7fdf8f02c8c0 1 > prepared multipart upload key=0QJLAH0EPKVD upload=BWKWKOO7EYAO tag=V0JQKDJA9MN7 type=write size=1789375 2024-09-14T10:57:56.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.142+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~58YEPUA4B7Q7.0 size=1048576 2024-09-14T10:57:56.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.146+0000 7fdf8f02c8c0 1 < completed part key=_multipart_ZF6IDD8B3CFO.2~58YEPUA4B7Q7.1 size=123885 2024-09-14T10:57:56.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.150+0000 7fdf8f02c8c0 1 < completed multipart upload key=ZF6IDD8B3CFO upload=58YEPUA4B7Q7 tag=K9CSBJW5PBB1 type=write size=2221037 2024-09-14T10:57:56.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.154+0000 7fdf8f02c8c0 1 > prepared operation key=3CYCJJIQ210M tag=UY6U8IVD7C7C type=del size=2988944 2024-09-14T10:57:56.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.158+0000 7fdf8f02c8c0 1 < completed write operation key=ZSBCGOXXJ0D5 tag=VR4KS5BF0LDP type=write size=538532 2024-09-14T10:57:56.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.162+0000 7fdf8f02c8c0 1 > prepared operation key=1E72V12EPEH3 tag=37T8F96FDP7P type=del size=858568 2024-09-14T10:57:56.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.166+0000 7fdf8f02c8c0 1 < completed delete operation key=STB3W5URFJEZ tag=EG2RJU13413O type=del 2024-09-14T10:57:56.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.174+0000 7fdf8f02c8c0 1 > prepared part key=_multipart_OFY1G5R28CK6.2~658AO6CTK6CC.0 size=421830 2024-09-14T10:57:56.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:57:56.174+0000 7fdf8f02c8c0 1 > prepared multipart upload key=OFY1G5R28CK6 upload=658AO6CTK6CC tag=RWLRF7YVPM04 type=write size=1470406 2024-09-14T10:57:56.170 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] cls_rgw_stats.simulate (28522 ms) 2024-09-14T10:57:56.170 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 1 test from cls_rgw_stats (28522 ms total) 2024-09-14T10:57:56.170 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:57:56.170 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:57:56.559 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 1 test from 1 test suite ran. (30804 ms total) 2024-09-14T10:57:56.560 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 1 test. 2024-09-14T10:57:56.569 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:57:56.569 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:57:56.630 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T10:57:56.631 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T10:57:56.631 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T10:57:56.697 INFO:tasks.workunit.client.0.smithi148.stdout:Running main() from gmock_main.cc 2024-09-14T10:57:56.697 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T10:57:56.697 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:57:58.612 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 31 tests from CmpOmap 2024-09-14T10:57:58.613 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T10:57:58.644 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (32 ms) 2024-09-14T10:57:58.644 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T10:57:58.649 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (5 ms) 2024-09-14T10:57:58.649 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T10:57:58.652 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (4 ms) 2024-09-14T10:57:58.652 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T10:57:58.659 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (6 ms) 2024-09-14T10:57:58.659 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T10:57:58.667 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_str (9 ms) 2024-09-14T10:57:58.668 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T10:57:58.687 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_u64 (19 ms) 2024-09-14T10:57:58.687 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T10:57:58.693 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (6 ms) 2024-09-14T10:57:58.693 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T10:57:58.699 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (7 ms) 2024-09-14T10:57:58.699 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T10:57:58.706 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (7 ms) 2024-09-14T10:57:58.707 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T10:57:58.713 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (7 ms) 2024-09-14T10:57:58.713 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T10:57:58.715 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-14T10:57:58.715 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T10:57:58.717 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-14T10:57:58.717 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T10:57:58.730 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (13 ms) 2024-09-14T10:57:58.730 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T10:57:58.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (18 ms) 2024-09-14T10:57:58.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T10:57:58.766 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (18 ms) 2024-09-14T10:57:58.766 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T10:57:58.789 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (23 ms) 2024-09-14T10:57:58.789 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T10:57:58.811 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_str (22 ms) 2024-09-14T10:57:58.811 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T10:57:58.832 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (20 ms) 2024-09-14T10:57:58.833 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T10:57:58.837 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (6 ms) 2024-09-14T10:57:58.837 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T10:57:58.843 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-14T10:57:58.844 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T10:57:58.846 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-14T10:57:58.846 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T10:57:58.848 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-14T10:57:58.848 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T10:57:58.867 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (19 ms) 2024-09-14T10:57:58.867 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T10:57:58.886 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (19 ms) 2024-09-14T10:57:58.886 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T10:57:58.907 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (21 ms) 2024-09-14T10:57:58.907 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T10:57:58.927 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (20 ms) 2024-09-14T10:57:58.927 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T10:57:58.932 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-14T10:57:58.932 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T10:57:58.940 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (8 ms) 2024-09-14T10:57:58.941 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T10:57:58.943 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (2 ms) 2024-09-14T10:57:58.943 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T10:57:58.945 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-14T10:57:58.945 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T10:57:58.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (25 ms) 2024-09-14T10:57:58.971 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 31 tests from CmpOmap (358 ms total) 2024-09-14T10:57:58.971 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:57:58.971 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:57:59.621 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 31 tests from 1 test suite ran. (2920 ms total) 2024-09-14T10:57:59.621 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 31 tests. 2024-09-14T10:57:59.624 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:57:59.624 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:57:59.678 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T10:57:59.679 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T10:57:59.679 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T10:57:59.743 INFO:tasks.workunit.client.0.smithi148.stdout:Running main() from gmock_main.cc 2024-09-14T10:57:59.744 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:57:59.744 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:57:59.744 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T10:57:59.744 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T10:58:02.646 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2902 ms) 2024-09-14T10:58:02.646 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T10:58:05.697 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3052 ms) 2024-09-14T10:58:05.698 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T10:58:08.747 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.Reserve (3048 ms) 2024-09-14T10:58:08.747 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T10:58:11.766 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3020 ms) 2024-09-14T10:58:11.766 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T10:58:15.835 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.Commit (4069 ms) 2024-09-14T10:58:15.835 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T10:58:19.901 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.Stats (4065 ms) 2024-09-14T10:58:19.901 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T10:58:24.493 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4592 ms) 2024-09-14T10:58:24.493 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T10:58:27.537 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.Abort (3042 ms) 2024-09-14T10:58:27.537 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T10:58:30.580 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.ReserveError (3045 ms) 2024-09-14T10:58:30.580 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T10:58:33.591 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.CommitError (3011 ms) 2024-09-14T10:58:33.591 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T10:58:36.661 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.AbortError (3068 ms) 2024-09-14T10:58:36.661 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T10:58:39.713 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3050 ms) 2024-09-14T10:58:39.713 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T10:58:42.759 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3048 ms) 2024-09-14T10:58:42.760 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T10:58:45.814 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3058 ms) 2024-09-14T10:58:45.814 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T10:58:48.817 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3003 ms) 2024-09-14T10:58:48.818 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T10:58:51.884 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3067 ms) 2024-09-14T10:58:51.884 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T10:58:54.887 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3003 ms) 2024-09-14T10:58:54.887 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T10:58:57.938 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.Cleanup (3051 ms) 2024-09-14T10:58:57.938 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T10:59:12.302 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.MultiProducer (14363 ms) 2024-09-14T10:59:12.302 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T10:59:16.446 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (4144 ms) 2024-09-14T10:59:16.447 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T10:59:29.613 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13167 ms) 2024-09-14T10:59:29.613 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T10:59:35.869 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6257 ms) 2024-09-14T10:59:35.870 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T10:59:43.618 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (7748 ms) 2024-09-14T10:59:43.618 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T10:59:51.624 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (8001 ms) 2024-09-14T10:59:51.624 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 24 tests from TestCls2PCQueue (111876 ms total) 2024-09-14T10:59:51.624 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:59:51.624 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:51.624 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 24 tests from 1 test suite ran. (111876 ms total) 2024-09-14T10:59:51.624 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 24 tests. 2024-09-14T10:59:51.628 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:59:51.628 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:59:51.688 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T10:59:51.689 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T10:59:51.690 DEBUG:teuthology.orchestra.run.smithi148:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T10:59:51.759 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:51.760 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:51.760 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:59:51.760 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:59:53.663 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 4 tests from ClsAccount 2024-09-14T10:59:53.663 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsAccount.add 2024-09-14T10:59:53.686 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsAccount.add (23 ms) 2024-09-14T10:59:53.686 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsAccount.get 2024-09-14T10:59:53.697 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsAccount.get (11 ms) 2024-09-14T10:59:53.697 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsAccount.rm 2024-09-14T10:59:53.714 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsAccount.rm (17 ms) 2024-09-14T10:59:53.714 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] ClsAccount.list 2024-09-14T10:59:53.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] ClsAccount.list (34 ms) 2024-09-14T10:59:53.748 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 4 tests from ClsAccount (85 ms total) 2024-09-14T10:59:53.748 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:59:53.748 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:54.671 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 4 tests from 1 test suite ran. (2910 ms total) 2024-09-14T10:59:54.671 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 4 tests. 2024-09-14T10:59:54.678 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:59:54.678 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:59:54.733 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T10:59:54.734 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T10:59:54.734 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T10:59:54.812 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:54.813 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:54.813 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T10:59:54.813 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:59:56.705 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T10:59:56.705 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T10:59:56.717 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] rgw_gc_log.init_existing_queue (13 ms) 2024-09-14T10:59:56.717 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T10:59:56.724 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] rgw_gc_log.init_existing_omap (7 ms) 2024-09-14T10:59:56.724 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T10:59:56.729 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (5 ms) 2024-09-14T10:59:56.729 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T10:59:56.731 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T10:59:56.731 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T10:59:56.737 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-09-14T10:59:56.737 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T10:59:56.740 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-14T10:59:56.740 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 6 tests from rgw_gc_log (36 ms total) 2024-09-14T10:59:56.740 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:59:56.740 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:57.703 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 6 tests from 1 test suite ran. (2889 ms total) 2024-09-14T10:59:57.703 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 6 tests. 2024-09-14T10:59:57.707 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:59:57.707 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:59:57.760 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T10:59:57.761 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T10:59:57.761 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:Running main() from gmock_main.cc 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns= i= 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.844 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns= i= 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns= i= 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout: "obj1": { 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.845 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "obj2": { 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.846 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.847 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3": { 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.848 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3-2": { 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.849 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.850 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns=ns i= 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns=ns i= 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns=ns i= 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout: "obj1": { 2024-09-14T10:59:57.851 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.852 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "obj2": { 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.853 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.854 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3": { 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.855 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.856 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3-2": { 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.857 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns= i=v1 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.858 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns= i=v1 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns= i=v1 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "obj1": { 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.859 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: "obj2": { 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.860 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.861 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3": { 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.862 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3-2": { 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.863 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.864 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: _obj[v1] 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout: "obj1": { 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.865 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.866 INFO:tasks.workunit.client.0.smithi148.stdout: "obj2": { 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.867 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3": { 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.868 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3-2": { 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.869 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_obj", 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.870 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns= i= 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns= i= 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns= i= 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.871 INFO:tasks.workunit.client.0.smithi148.stdout: "obj1": { 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.872 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "obj2": { 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.873 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3": { 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.874 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.875 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3-2": { 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.876 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.877 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns=ns i= 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns=ns i= 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns=ns i= 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout: "obj1": { 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.878 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.879 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "obj2": { 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.880 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3": { 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.881 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3-2": { 2024-09-14T10:59:57.882 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.883 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns= i=v1 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns= i=v1 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.884 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns= i=v1 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "obj1": { 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.885 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "obj2": { 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.886 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3": { 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.887 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.888 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3-2": { 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.889 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.890 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout:parsed: obj[v1] 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "obj1": { 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.891 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "obj2": { 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3": { 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.894 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "obj3-2": { 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.895 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "obj", 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "v1", 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.896 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.897 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.898 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker_myobj", 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.899 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.900 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.901 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.902 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.903 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker_myobj", 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.904 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.905 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.906 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.907 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.908 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.909 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.910 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.911 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.912 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.913 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.914 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.915 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.916 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.917 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.918 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.919 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.920 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.921 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.922 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.923 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.924 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.925 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.927 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.928 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.929 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.930 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.931 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.932 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.933 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.934 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.935 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker___myobj", 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj" 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.936 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.937 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.938 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.939 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker___myobj", 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj" 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.940 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.941 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.942 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.943 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.944 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.945 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.946 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.947 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.948 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:59:57.949 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.950 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.951 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.952 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.953 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj" 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.954 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.955 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.956 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.957 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.958 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj" 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.959 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.960 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.961 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.962 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.963 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.964 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.966 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.970 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker___myobj_", 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj_" 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.972 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.973 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.974 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.975 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker___myobj_", 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj_" 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.977 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.978 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.979 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.980 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.981 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.982 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.983 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.984 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.985 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.986 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.987 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.988 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.989 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj_" 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.990 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.991 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.992 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.993 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:59:57.994 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj_" 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.995 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.996 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:57.997 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:57.998 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": "default-placement.data", 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:57.999 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "test", 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": "", 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": "" 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.000 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.001 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "obj": { 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.002 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.003 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.004 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.005 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker_myobj", 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.006 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.007 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker_myobj 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker_myobj", 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.008 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:58.009 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker_myobj 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.010 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.011 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.012 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.013 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.014 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.015 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.016 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.017 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.018 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.019 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.020 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.021 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "myobj", 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker___myobj", 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj" 2024-09-14T10:59:58.022 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.023 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker___myobj 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker___myobj", 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj" 2024-09-14T10:59:58.024 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.025 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker___myobj 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.026 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.027 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.028 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.029 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj" 2024-09-14T10:59:58.030 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.031 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:59:58.032 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj" 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.033 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.034 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.035 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.036 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.037 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj", 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.038 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker___myobj_", 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj_" 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.039 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.040 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker___myobj_", 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj_" 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.041 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.042 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.042 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.044 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.044 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.044 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.044 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.044 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.045 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.046 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.047 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.048 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "", 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj_" 2024-09-14T10:59:58.049 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.050 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "marker__myobj_" 2024-09-14T10:59:58.051 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.052 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "" 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj": { 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.053 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj": { 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.054 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: "raw_obj2": { 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: "pool": ".data-pool", 2024-09-14T10:59:58.055 INFO:tasks.workunit.client.0.smithi148.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "loc": "" 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "new_obj2": { 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket": { 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "ebtest", 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "marker": "marker", 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_id": "bucket-id", 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "tenant": "", 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "explicit_placement": { 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "data_pool": ".data-pool", 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "data_extra_pool": "", 2024-09-14T10:59:58.056 INFO:tasks.workunit.client.0.smithi148.stdout: "index_pool": ".index-pool" 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: "key": { 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: "name": "_myobj_", 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: "instance": "inst", 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: "ns": "ns" 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 4 tests from TestRGWObj (2 ms total) 2024-09-14T10:59:58.057 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:59:58.058 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:58.058 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-14T10:59:58.058 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 4 tests. 2024-09-14T10:59:58.058 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:59:58.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:59:58.073 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T10:59:58.074 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T10:59:58.074 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T10:59:58.177 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:58.177 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:58.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.237+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 realm 2024-09-14T10:59:58.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:58.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:58.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:58.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.241+0000 7f4cc9d279c0 20 searching for the correct realm 2024-09-14T10:59:58.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.249+0000 7f4cc702c640 0 -- 172.21.15.148:0/2026400597 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f4cc00671a0 msgr2=0x7f4cc005c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:58.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.473+0000 7f4cc802e640 0 -- 172.21.15.148:0/2026400597 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x555bdca9b720 msgr2=0x555bdca9db10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:58.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.485+0000 7f4cc9d279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:58.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.485+0000 7f4cc9d279c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T10:59:58.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.485+0000 7f4cc9d279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:58.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.485+0000 7f4cc9d279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:58.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.485+0000 7f4cc9d279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:58.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.485+0000 7f4cc9d279c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T10:59:58.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.485+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:58.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 zone default found 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 4 Realm: () 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 zonegroup default 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.489+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.493+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.493+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.493+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.493+0000 7f4cc9d279c0 20 started sync module instance, tier type = 2024-09-14T10:59:58.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.493+0000 7f4cc9d279c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T10:59:58.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 20 add_watcher() i=0 2024-09-14T10:59:58.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 20 add_watcher() i=1 2024-09-14T10:59:58.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 20 add_watcher() i=2 2024-09-14T10:59:58.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 20 add_watcher() i=3 2024-09-14T10:59:58.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 20 add_watcher() i=4 2024-09-14T10:59:58.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 20 add_watcher() i=5 2024-09-14T10:59:58.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 20 add_watcher() i=6 2024-09-14T10:59:58.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 20 add_watcher() i=7 2024-09-14T10:59:58.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.517+0000 7f4cc9d279c0 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:58.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.521+0000 7f4b7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:58.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:58.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:58.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 5 note: GC not initialized 2024-09-14T10:59:58.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4b7cfe1640 20 reqs_thread_entry: start 2024-09-14T10:59:58.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 init_complete bucket index max shards: 11 2024-09-14T10:59:58.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 Filter name: none 2024-09-14T10:59:58.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4af67fc640 20 reqs_thread_entry: start 2024-09-14T10:59:58.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T10:59:58.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T10:59:58.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:59:58.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T10:59:58.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T10:59:58.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:59:58.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 10 cache get: name=default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= : miss 2024-09-14T10:59:58.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.525+0000 7f4cc9d279c0 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4cc9d279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4cc9d279c0 10 cache put: name=default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= info.flags=0x0 2024-09-14T10:59:58.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4cc9d279c0 10 adding default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= to cache LRU end 2024-09-14T10:59:58.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4cc9d279c0 10 cache get: name=default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= : hit (negative entry) 2024-09-14T10:59:58.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4cc9d279c0 10 cache get: name=default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= : hit (negative entry) 2024-09-14T10:59:58.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4cc9d279c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T10:59:58.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4cc9d279c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:59:58.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4cc9d279c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T10:59:58.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4ba6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660482 cookie 93853032564016 notifier 5351 bl.length()=697 2024-09-14T10:59:58.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4ba6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T10:59:58.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.529+0000 7f4ba6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:59:58.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.537+0000 7f4cc9d279c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T10:59:58.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.537+0000 7f4cc9d279c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:59:58.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.537+0000 7f4cc9d279c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T10:59:58.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.537+0000 7f4ba6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660480 cookie 93853032561248 notifier 5351 bl.length()=194 2024-09-14T10:59:58.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.537+0000 7f4ba6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T10:59:58.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.537+0000 7f4ba6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:59:58.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.545+0000 7f4cc9d279c0 10 cache put: name=default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= info.flags=0x7 2024-09-14T10:59:58.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.545+0000 7f4cc9d279c0 10 moving default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= to cache LRU end 2024-09-14T10:59:58.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.545+0000 7f4cc9d279c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:t5rUt0XiFOMBHrtEfEF2DKp3e9c=, ofs0, ns] 2024-09-14T10:59:58.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.545+0000 7f4ba6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660482 cookie 93853032562304 notifier 5351 bl.length()=203 2024-09-14T10:59:58.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.545+0000 7f4ba6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= info.flags=0x7 2024-09-14T10:59:58.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.545+0000 7f4ba6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= to cache LRU end 2024-09-14T10:59:58.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.549+0000 7f4ba67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660483 cookie 93853032562304 notifier 5351 bl.length()=203 2024-09-14T10:59:58.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.549+0000 7f4ba67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= info.flags=0x7 2024-09-14T10:59:58.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.549+0000 7f4ba67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+t5rUt0XiFOMBHrtEfEF2DKp3e9c= to cache LRU end 2024-09-14T10:59:58.546 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T10:59:58.546 INFO:tasks.workunit.client.0.smithi148.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T10:59:58.546 INFO:tasks.workunit.client.0.smithi148.stdout: "display_name": "librgw test user", 2024-09-14T10:59:58.546 INFO:tasks.workunit.client.0.smithi148.stdout: "email": "librgw@example.com", 2024-09-14T10:59:58.546 INFO:tasks.workunit.client.0.smithi148.stdout: "suspended": 0, 2024-09-14T10:59:58.546 INFO:tasks.workunit.client.0.smithi148.stdout: "max_buckets": 1000, 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "subusers": [], 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "keys": [ 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: { 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "user": "ceph-test-librgw-file", 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "access_key": "t5rUt0XiFOMBHrtEfEF2DKp3e9c=", 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "secret_key": "zm6JL5/A8gVOW94b3IAi/j4/GXnVpMyXCL1X6JQAGEn0Svf4cl3T9Q==", 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "active": true, 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "create_date": "2024-09-14T10:59:58.534571Z" 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: ], 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "swift_keys": [], 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "caps": [], 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T10:59:58.547 INFO:tasks.workunit.client.0.smithi148.stdout: "default_placement": "", 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "default_storage_class": "", 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "placement_tags": [], 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_quota": { 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "enabled": false, 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "check_on_raw": false, 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size": -1, 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size_kb": 0, 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "max_objects": -1 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "user_quota": { 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "enabled": false, 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "check_on_raw": false, 2024-09-14T10:59:58.548 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size": -1, 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size_kb": 0, 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "max_objects": -1 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "temp_url_keys": [], 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "type": "rgw", 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "mfa_ids": [], 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "account_id": "", 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "path": "/", 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "create_date": "2024-09-14T10:59:58.534533Z", 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "tags": [], 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: "group_ids": [] 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T10:59:58.549 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T10:59:58.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.553+0000 7f4b7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:58.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.557+0000 7f4cc9d279c0 20 remove_watcher() i=0 2024-09-14T10:59:58.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.557+0000 7f4cc9d279c0 2 removed watcher, disabling cache 2024-09-14T10:59:58.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.557+0000 7f4cc9d279c0 20 remove_watcher() i=1 2024-09-14T10:59:58.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.561+0000 7f4cc9d279c0 20 remove_watcher() i=2 2024-09-14T10:59:58.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.561+0000 7f4cc9d279c0 20 remove_watcher() i=3 2024-09-14T10:59:58.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.565+0000 7f4cc9d279c0 20 remove_watcher() i=4 2024-09-14T10:59:58.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.565+0000 7f4cc9d279c0 20 remove_watcher() i=5 2024-09-14T10:59:58.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.569+0000 7f4cc9d279c0 20 remove_watcher() i=6 2024-09-14T10:59:58.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T10:59:58.573+0000 7f4cc9d279c0 20 remove_watcher() i=7 2024-09-14T10:59:58.584 INFO:tasks.workunit.client.0.smithi148.stdout:phase 1.1 2024-09-14T10:59:58.605 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:59:58.605 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T10:59:58.605 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 24 tests from LibRGW 2024-09-14T10:59:58.605 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:59:58.618 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:58.618 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:59.761 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (1156 ms) 2024-09-14T10:59:59.762 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T10:59:59.764 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-14T10:59:59.764 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:59:59.764 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T10:59:59.764 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T10:59:59.786 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T10:59:59.794 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/f1 2024-09-14T10:59:59.803 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/f2 2024-09-14T10:59:59.809 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T10:59:59.816 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T10:59:59.821 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T10:59:59.827 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T10:59:59.834 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T10:59:59.841 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T10:59:59.848 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T10:59:59.857 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T10:59:59.862 INFO:tasks.workunit.client.0.smithi148.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T10:59:59.870 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETUP_HIER1 (106 ms) 2024-09-14T10:59:59.870 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:00:00.147 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETUP_DIRS1 (277 ms) 2024-09-14T11:00:00.148 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:00:00.148 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:00:00.148 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:00:00.181 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (33 ms) 2024-09-14T11:00:00.181 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:00:00.269 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (89 ms) 2024-09-14T11:00:00.269 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:00:00.269 INFO:tasks.workunit.client.0.smithi148.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:00:00.282 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (13 ms) 2024-09-14T11:00:00.282 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:00:00.283 INFO:tasks.workunit.client.0.smithi148.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:00:00.297 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (15 ms) 2024-09-14T11:00:00.297 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:00:00.297 INFO:tasks.workunit.client.0.smithi148.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:00:00.297 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:00:00.297 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:00:00.298 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:00:00.299 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:00:00.299 INFO:tasks.workunit.client.0.smithi148.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:00:00.299 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:00:00.302 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:00:00.302 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:00:00.307 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:00:00.307 INFO:tasks.workunit.client.0.smithi148.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:00:00.307 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:00:00.310 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:00:00.310 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:00:00.313 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:00:00.313 INFO:tasks.workunit.client.0.smithi148.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:00:00.313 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:00:00.315 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:00:00.315 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:00:00.319 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:00:00.319 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READ_DIRS1 (22 ms) 2024-09-14T11:00:00.319 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:00:00.516 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READF_SETUP1 (196 ms) 2024-09-14T11:00:00.516 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:00:00.516 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:00:00.517 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:00:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:00:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:00:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:00:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:00:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:00:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:00:00.518 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:00:00.532 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:00:00.533 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:00:00.539 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:00:00.542 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:00:00.548 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:00:00.549 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:00:00.550 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:00:00.550 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:00:00.551 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:00:00.552 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:00:00.553 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:00:00.557 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:00:00.557 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:00:00.557 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:00:00.557 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:00:00.557 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:00:00.557 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.HIER1 (42 ms) 2024-09-14T11:00:00.557 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:00:00.558 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:00:00.559 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:00:00.559 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:00:00.559 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:00:00.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:00:00.561+0000 7f891fe1da80 -1 shutting down 2024-09-14T11:00:00.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:00:00.561+0000 7f87f9b6f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58391, si_uid : 1000, si_addr0x3e80000e417, si_status0 2024-09-14T11:00:29.646 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (29089 ms) 2024-09-14T11:00:29.646 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 24 tests from LibRGW (31041 ms total) 2024-09-14T11:00:29.646 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:00:29.647 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:00:29.647 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 24 tests from 1 test suite ran. (31041 ms total) 2024-09-14T11:00:29.647 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 24 tests. 2024-09-14T11:00:29.658 INFO:tasks.workunit.client.0.smithi148.stdout:phase 1.2 2024-09-14T11:00:29.681 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:00:29.681 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:00:29.681 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:00:29.681 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:00:29.691 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:29.691 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:29.969 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (288 ms) 2024-09-14T11:00:29.969 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:00:29.971 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:00:29.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:00:29.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:00:29.974 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:00:29.974 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:00:29.974 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:00:29.974 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:00:29.974 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:00:29.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:00:29.977+0000 7f33daa6aa80 -1 shutting down 2024-09-14T11:00:29.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:00:29.981+0000 7f32b47bc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59036, si_uid : 1000, si_addr0x3e80000e69c, si_status0 2024-09-14T11:01:00.187 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (30215 ms) 2024-09-14T11:01:00.187 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 24 tests from LibRGW (30505 ms total) 2024-09-14T11:01:00.187 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:01:00.187 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:01:00.187 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 24 tests from 1 test suite ran. (30505 ms total) 2024-09-14T11:01:00.187 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 24 tests. 2024-09-14T11:01:00.198 INFO:tasks.workunit.client.0.smithi148.stdout:phase 1.3 2024-09-14T11:01:00.224 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:01:00.224 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:01:00.224 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:01:00.224 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:01:00.237 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:00.237 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:00.776 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (552 ms) 2024-09-14T11:01:00.776 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:01:00.777 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:01:00.778 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:01:00.778 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:01:00.778 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:01:00.788 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETUP_HIER1 (10 ms) 2024-09-14T11:01:00.788 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:01:00.909 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETUP_DIRS1 (121 ms) 2024-09-14T11:01:00.909 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:01:00.909 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:01:00.909 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:01:00.910 INFO:tasks.workunit.client.0.smithi148.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:01:00.911 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:01:00.913 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:01:00.913 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:01:00.915 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:01:00.915 INFO:tasks.workunit.client.0.smithi148.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:01:00.915 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:01:00.917 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:01:00.917 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:01:00.920 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:01:00.920 INFO:tasks.workunit.client.0.smithi148.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:01:00.920 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:01:00.922 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:01:00.922 INFO:tasks.workunit.client.0.smithi148.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:01:00.925 INFO:tasks.workunit.client.0.smithi148.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:01:00.926 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READ_DIRS1 (17 ms) 2024-09-14T11:01:00.926 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:01:00.926 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:01:00.926 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:01:00.926 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:01:00.926 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:01:00.927 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:01:00.927 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:01:00.927 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:01:00.927 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:01:00.927 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:01:00.927 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:01:00.928 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:01:00.942 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:01:00.943 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:01:00.950 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:01:00.952 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:01:00.959 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:01:00.961 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:01:00.962 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:01:00.963 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:01:00.964 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:01:00.965 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:01:00.967 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:01:00.971 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.HIER1 (45 ms) 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:01:00.972 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:01:00.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:01:00.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-14T11:01:00.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:01:00.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:01:00.973 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:01:00.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:01:00.980+0000 7f4759ab9a80 -1 shutting down 2024-09-14T11:01:00.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:01:00.980+0000 7f463380b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59681, si_uid : 1000, si_addr0x3e80000e921, si_status0 2024-09-14T11:01:30.832 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (29860 ms) 2024-09-14T11:01:30.833 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 24 tests from LibRGW (30608 ms total) 2024-09-14T11:01:30.833 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:01:30.833 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:01:30.833 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 24 tests from 1 test suite ran. (30608 ms total) 2024-09-14T11:01:30.833 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 24 tests. 2024-09-14T11:01:30.847 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2.1 2024-09-14T11:01:30.871 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:01:30.871 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:01:30.871 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:01:30.871 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:01:30.882 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:30.882 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:31.194 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (323 ms) 2024-09-14T11:01:31.194 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:01:31.195 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:01:31.195 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:01:31.216 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKET (21 ms) 2024-09-14T11:01:31.216 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:01:31.216 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:01:31.217 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:01:31.239 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave0 2024-09-14T11:01:31.254 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave1 2024-09-14T11:01:31.275 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave2 2024-09-14T11:01:31.299 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave3 2024-09-14T11:01:31.321 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave4 2024-09-14T11:01:31.345 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave5 2024-09-14T11:01:31.368 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave6 2024-09-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave7 2024-09-14T11:01:31.419 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave8 2024-09-14T11:01:31.445 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave9 2024-09-14T11:01:31.446 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (229 ms) 2024-09-14T11:01:31.446 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:01:32.280 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (834 ms) 2024-09-14T11:01:32.280 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:01:32.280 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:01:32.280 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:01:32.280 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:01:32.280 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:01:32.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:01:32.288+0000 7f9db22ffa80 -1 shutting down 2024-09-14T11:01:32.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:01:32.288+0000 7f9c8c051640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60326, si_uid : 1000, si_addr0x3e80000eba6, si_status0 2024-09-14T11:02:01.245 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (28965 ms) 2024-09-14T11:02:01.246 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 9 tests from LibRGW (30374 ms total) 2024-09-14T11:02:01.246 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:02:01.246 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:02:01.246 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 9 tests from 1 test suite ran. (30374 ms total) 2024-09-14T11:02:01.246 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 9 tests. 2024-09-14T11:02:01.254 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2.2 2024-09-14T11:02:01.275 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:02:01.275 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:02:01.275 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:02:01.275 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:02:01.286 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:01.286 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:01.589 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (314 ms) 2024-09-14T11:02:01.589 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:02:01.591 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:02:01.591 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:02:01.591 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:02:01.591 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:02:01.651 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_BUCKET (60 ms) 2024-09-14T11:02:01.651 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:02:01.671 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave0 2024-09-14T11:02:01.692 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave1 2024-09-14T11:02:01.714 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave2 2024-09-14T11:02:01.734 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave3 2024-09-14T11:02:01.758 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave4 2024-09-14T11:02:01.782 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave5 2024-09-14T11:02:01.804 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave6 2024-09-14T11:02:01.829 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave7 2024-09-14T11:02:01.858 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave8 2024-09-14T11:02:01.883 INFO:tasks.workunit.client.0.smithi148.stdout:created: sorrydave9 2024-09-14T11:02:01.883 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (232 ms) 2024-09-14T11:02:01.884 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:02:02.658 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (775 ms) 2024-09-14T11:02:02.658 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:02:02.658 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:02:02.658 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:02:02.659 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:02:02.659 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:02:02.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:02:02.663+0000 7f08270efa80 -1 shutting down 2024-09-14T11:02:02.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:02:02.667+0000 7f0700e41640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60971, si_uid : 1000, si_addr0x3e80000ee2b, si_status0 2024-09-14T11:02:31.949 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (29290 ms) 2024-09-14T11:02:31.949 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 9 tests from LibRGW (30673 ms total) 2024-09-14T11:02:31.949 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:02:31.949 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:02:31.949 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 9 tests from 1 test suite ran. (30673 ms total) 2024-09-14T11:02:31.949 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 9 tests. 2024-09-14T11:02:31.962 INFO:tasks.workunit.client.0.smithi148.stdout:phase 3.1 2024-09-14T11:02:32.305 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:02:32.305 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:02:32.305 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:02:32.305 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:02:32.315 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:32.315 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:33.050 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (745 ms) 2024-09-14T11:02:33.050 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:02:33.051 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:02:33.051 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:02:33.071 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKET (19 ms) 2024-09-14T11:02:33.071 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:02:33.077 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-14T11:02:33.077 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:02:33.080 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-14T11:02:33.080 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:02:33.142 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LARGE1 (62 ms) 2024-09-14T11:02:33.142 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:02:33.199 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LARGE2 (57 ms) 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:02:33.200 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:02:33.201 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:02:33.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:02:33.207+0000 7f260ba38a80 -1 shutting down 2024-09-14T11:02:33.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:02:33.207+0000 7f24e578a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61616, si_uid : 1000, si_addr0x3e80000f0b0, si_status0 2024-09-14T11:03:03.246 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (30047 ms) 2024-09-14T11:03:03.247 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 13 tests from LibRGW (30941 ms total) 2024-09-14T11:03:03.247 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:03:03.247 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:03:03.247 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 13 tests from 1 test suite ran. (30941 ms total) 2024-09-14T11:03:03.247 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 13 tests. 2024-09-14T11:03:03.265 INFO:tasks.workunit.client.0.smithi148.stdout:phase 3.2 2024-09-14T11:03:03.607 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:03:03.607 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:03:03.607 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:03:03.607 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:03:03.616 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:03.616 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:03.886 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (279 ms) 2024-09-14T11:03:03.886 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:03:03.887 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:03:03.887 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:03:03.887 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:03:03.887 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:03:03.897 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-14T11:03:03.897 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:03:03.902 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (5 ms) 2024-09-14T11:03:03.902 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:03:03.960 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LARGE1 (58 ms) 2024-09-14T11:03:03.960 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:03:03.961 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:03:03.961 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:03:03.961 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:03:03.961 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:03:03.969 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-09-14T11:03:03.969 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:03:04.020 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_BUCKET (51 ms) 2024-09-14T11:03:04.020 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:03:04.020 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:03:04.020 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:03:04.020 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:03:04.020 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:03:04.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:03:04.026+0000 7f8c7ca8ba80 -1 shutting down 2024-09-14T11:03:04.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:03:04.026+0000 7f8b567dd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62265, si_uid : 1000, si_addr0x3e80000f339, si_status0 2024-09-14T11:03:34.213 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (30189 ms) 2024-09-14T11:03:34.214 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 13 tests from LibRGW (30602 ms total) 2024-09-14T11:03:34.214 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:03:34.214 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:03:34.214 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 13 tests from 1 test suite ran. (30602 ms total) 2024-09-14T11:03:34.214 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 13 tests. 2024-09-14T11:03:34.221 INFO:tasks.workunit.client.0.smithi148.stdout:phase 4.1 2024-09-14T11:03:34.242 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:03:34.242 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:03:34.242 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:03:34.242 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:03:34.242 INFO:tasks.workunit.client.0.smithi148.stdout:read i1: 64001 2024-09-14T11:03:34.242 INFO:tasks.workunit.client.0.smithi148.stdout:read s1: blunderbuss 2024-09-14T11:03:34.242 INFO:tasks.workunit.client.0.smithi148.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:03:34.242 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:03:34.255 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:34.255 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:34.546 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (305 ms) 2024-09-14T11:03:34.546 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:03:34.547 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:03:34.547 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:03:34.582 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (34 ms) 2024-09-14T11:03:34.582 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_0 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_1 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_2 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_3 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_4 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_5 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_6 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_7 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_8 2024-09-14T11:03:36.049 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_9 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_10 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_11 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_12 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_13 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_14 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_15 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_16 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_17 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_18 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_19 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_20 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_21 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_22 2024-09-14T11:03:36.050 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_23 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_24 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_25 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_26 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_27 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_28 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_29 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_30 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_31 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_32 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_33 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_34 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_35 2024-09-14T11:03:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_36 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_37 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_38 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_39 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_40 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_41 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_42 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_43 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_44 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_45 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_46 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_47 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_48 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_49 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_50 2024-09-14T11:03:36.052 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_51 2024-09-14T11:03:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_52 2024-09-14T11:03:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_53 2024-09-14T11:03:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_54 2024-09-14T11:03:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_55 2024-09-14T11:03:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_56 2024-09-14T11:03:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_57 2024-09-14T11:03:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_58 2024-09-14T11:03:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_59 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_60 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_61 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_62 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_63 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_64 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_65 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_66 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_67 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_68 2024-09-14T11:03:36.054 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_69 2024-09-14T11:03:36.055 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_70 2024-09-14T11:03:36.055 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_71 2024-09-14T11:03:36.055 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_72 2024-09-14T11:03:36.055 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_73 2024-09-14T11:03:36.055 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_74 2024-09-14T11:03:36.055 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_75 2024-09-14T11:03:36.055 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_76 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_77 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_78 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_79 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_80 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_81 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_82 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_83 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_84 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_85 2024-09-14T11:03:36.056 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_86 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_87 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_88 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_89 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_90 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_91 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_92 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_93 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_94 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_95 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_96 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_97 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_98 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:created: dmarker:f_99 2024-09-14T11:03:36.057 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1467 ms) 2024-09-14T11:03:36.058 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:03:36.117 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:03:36.117 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:03:36.117 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:03:36.117 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:03:36.117 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:03:36.118 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:03:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:03:36.120 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:03:36.120 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:03:36.120 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:03:36.121 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:03:36.122 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:03:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:03:36.124 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:03:36.125 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:03:36.126 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:03:36.127 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:03:36.127 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:03:36.127 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_READDIR (67 ms) 2024-09-14T11:03:36.127 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:03:36.128 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:03:36.129 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:03:36.130 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:03:36.130 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:03:36.130 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:03:36.130 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:03:36.130 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:03:36.130 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:03:36.131 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:03:36.132 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:03:36.133 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:03:36.133 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:03:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:03:36.135 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:03:36.135 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:03:36.135 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:03:36.135 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:03:36.135 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:03:36.135 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:03:36.135 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:03:36.135 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:03:36.136 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:03:36.137 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:03:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-14T11:03:36.139 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:03:36.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:03:36.126+0000 7f9164a02a80 -1 shutting down 2024-09-14T11:03:36.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:03:36.130+0000 7f903e754640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62911, si_uid : 1000, si_addr0x3e80000f5bf, si_status0 2024-09-14T11:04:04.848 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (28726 ms) 2024-09-14T11:04:04.848 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 11 tests from LibRGW (30606 ms total) 2024-09-14T11:04:04.848 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:04:04.849 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:04:04.849 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 11 tests from 1 test suite ran. (30606 ms total) 2024-09-14T11:04:04.849 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 11 tests. 2024-09-14T11:04:04.862 INFO:tasks.workunit.client.0.smithi148.stdout:phase 4.2 2024-09-14T11:04:04.886 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:04:04.886 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:04:04.886 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:04:04.886 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:04:04.886 INFO:tasks.workunit.client.0.smithi148.stdout:read i1: 64001 2024-09-14T11:04:04.887 INFO:tasks.workunit.client.0.smithi148.stdout:read s1: blunderbuss 2024-09-14T11:04:04.887 INFO:tasks.workunit.client.0.smithi148.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:04:04.887 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:04:04.896 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:04.896 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:05.447 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (562 ms) 2024-09-14T11:04:05.448 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:04:05.449 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:04:05.449 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:04:05.465 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-09-14T11:04:05.465 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:04:05.466 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:04:05.466 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:04:05.466 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:04:05.466 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:04:05.470 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:04:05.471 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:04:05.472 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:04:05.473 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:04:05.474 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:04:05.475 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:04:05.476 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:04:05.476 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:04:05.476 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:04:05.476 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:04:05.477 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:04:05.478 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:04:05.479 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:04:05.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:04:05.477+0000 7f2b4aab5a80 -1 shutting down 2024-09-14T11:04:05.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:04:05.477+0000 7f2a24807640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63558, si_uid : 1000, si_addr0x3e80000f846, si_status0 2024-09-14T11:04:35.555 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (30085 ms) 2024-09-14T11:04:35.555 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 11 tests from LibRGW (30669 ms total) 2024-09-14T11:04:35.555 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:04:35.555 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:04:35.555 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 11 tests from 1 test suite ran. (30669 ms total) 2024-09-14T11:04:35.555 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 11 tests. 2024-09-14T11:04:35.568 INFO:tasks.workunit.client.0.smithi148.stdout:phase 5.1 2024-09-14T11:04:35.602 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:04:35.602 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:04:35.602 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:04:35.602 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:04:35.613 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:35.613 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:36.177 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (576 ms) 2024-09-14T11:04:36.178 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:04:36.179 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:04:36.179 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:04:36.199 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKET (20 ms) 2024-09-14T11:04:36.199 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:04:36.206 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-14T11:04:36.206 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:04:36.206 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:04:36.206 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:04:36.209 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-14T11:04:36.209 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:04:36.209 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:04:36.209 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:04:36.220 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.PUT_OBJECT (11 ms) 2024-09-14T11:04:36.220 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:04:36.224 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-09-14T11:04:36.224 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:04:36.224 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:04:36.224 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:04:36.225 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:04:36.226 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:04:36.226 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:04:36.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:04:36.233+0000 7f590c0e2a80 -1 shutting down 2024-09-14T11:04:36.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:04:36.237+0000 7f57e5e34640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64203, si_uid : 1000, si_addr0x3e80000facb, si_status0 2024-09-14T11:05:06.363 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (30138 ms) 2024-09-14T11:05:06.364 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 19 tests from LibRGW (30761 ms total) 2024-09-14T11:05:06.364 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:05:06.364 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:05:06.364 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 19 tests from 1 test suite ran. (30761 ms total) 2024-09-14T11:05:06.364 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 19 tests. 2024-09-14T11:05:06.376 INFO:tasks.workunit.client.0.smithi148.stdout:phase 5.2 2024-09-14T11:05:06.410 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:05:06.410 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:05:06.410 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:05:06.410 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:05:06.419 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:06.419 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:06.736 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (326 ms) 2024-09-14T11:05:06.736 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:05:06.737 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:05:06.737 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:05:06.737 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:05:06.737 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:05:06.747 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-14T11:05:06.747 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:05:06.747 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:05:06.748 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:05:06.749 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:05:06.749 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:05:06.749 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:05:06.749 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:05:06.749 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:05:06.749 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:05:06.757 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-14T11:05:06.757 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:05:06.808 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.DELETE_BUCKET (51 ms) 2024-09-14T11:05:06.808 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:05:06.808 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:05:06.808 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:05:06.809 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:05:06.809 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:05:06.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:05:06.816+0000 7f72b36aaa80 -1 shutting down 2024-09-14T11:05:06.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:05:06.820+0000 7f718d3fc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64853, si_uid : 1000, si_addr0x3e80000fd55, si_status0 2024-09-14T11:05:36.899 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (30090 ms) 2024-09-14T11:05:36.900 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 19 tests from LibRGW (30488 ms total) 2024-09-14T11:05:36.900 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:05:36.900 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:05:36.900 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 19 tests from 1 test suite ran. (30488 ms total) 2024-09-14T11:05:36.900 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 19 tests. 2024-09-14T11:05:36.913 INFO:tasks.workunit.client.0.smithi148.stdout:phase 6.1 2024-09-14T11:05:36.935 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:05:36.936 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment set-up. 2024-09-14T11:05:36.936 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:05:36.936 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:05:36.944 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:36.944 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:37.499 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.INIT (564 ms) 2024-09-14T11:05:37.500 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:05:37.501 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:05:37.501 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:05:37.536 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CREATE_BUCKETS (35 ms) 2024-09-14T11:05:37.536 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:05:37.549 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (14 ms) 2024-09-14T11:05:37.549 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:05:37.597 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.TOPDIR_RENAME (48 ms) 2024-09-14T11:05:37.597 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:05:37.646 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SUBDIR_RENAME (48 ms) 2024-09-14T11:05:37.646 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:05:37.702 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (56 ms) 2024-09-14T11:05:37.702 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:05:37.703 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:05:37.703 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:05:37.703 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:05:37.703 INFO:tasks.workunit.client.0.smithi148.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:05:37.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:05:37.711+0000 7fc955a56a80 -1 shutting down 2024-09-14T11:05:37.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:05:37.711+0000 7fc82f7a8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65498, si_uid : 1000, si_addr0x3e80000ffda, si_status0 2024-09-14T11:06:07.872 INFO:tasks.workunit.client.0.smithi148.stdout:[ OK ] LibRGW.SHUTDOWN (30169 ms) 2024-09-14T11:06:07.873 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] 10 tests from LibRGW (30935 ms total) 2024-09-14T11:06:07.873 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:06:07.873 INFO:tasks.workunit.client.0.smithi148.stdout:[----------] Global test environment tear-down 2024-09-14T11:06:07.873 INFO:tasks.workunit.client.0.smithi148.stdout:[==========] 10 tests from 1 test suite ran. (30935 ms total) 2024-09-14T11:06:07.873 INFO:tasks.workunit.client.0.smithi148.stdout:[ PASSED ] 10 tests. 2024-09-14T11:06:07.887 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:06:07.887 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:06:07.901 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:06:07.903 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:06:07.903 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:06:07.951 INFO:tasks.workunit.client.0.smithi148.stderr:+ [ -z ] 2024-09-14T11:06:07.951 INFO:tasks.workunit.client.0.smithi148.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:06:07.951 INFO:tasks.workunit.client.0.smithi148.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:06:07.951 INFO:tasks.workunit.client.0.smithi148.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-14T11:06:07.992 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:07.992 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:08.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.041+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.041+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.041+0000 7fb9c1a319c0 20 realm 2024-09-14T11:06:08.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.041+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:08.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:08.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:08.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.045+0000 7fb9c1a319c0 20 searching for the correct realm 2024-09-14T11:06:08.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.053+0000 7fb9bed36640 0 -- 172.21.15.148:0/1102146661 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fb9a8025040 msgr2=0x7fb9a800b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:08.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.057+0000 7fb9bfd38640 0 -- 172.21.15.148:0/1102146661 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x558101364650 msgr2=0x558101366a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:08.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:08.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:06:08.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:08.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:08.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:08.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:06:08.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:08.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:08.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 zone default found 2024-09-14T11:06:08.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 4 Realm: () 2024-09-14T11:06:08.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:06:08.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:06:08.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:08.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 zonegroup default 2024-09-14T11:06:08.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.065+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.069+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.069+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.069+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.069+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.069+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.069+0000 7fb9c1a319c0 20 started sync module instance, tier type = 2024-09-14T11:06:08.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.069+0000 7fb9c1a319c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:06:08.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.085+0000 7fb9c1a319c0 20 add_watcher() i=0 2024-09-14T11:06:08.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.085+0000 7fb9c1a319c0 20 add_watcher() i=1 2024-09-14T11:06:08.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.085+0000 7fb9c1a319c0 20 add_watcher() i=2 2024-09-14T11:06:08.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.085+0000 7fb9c1a319c0 20 add_watcher() i=3 2024-09-14T11:06:08.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.085+0000 7fb9c1a319c0 20 add_watcher() i=4 2024-09-14T11:06:08.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.085+0000 7fb9c1a319c0 20 add_watcher() i=5 2024-09-14T11:06:08.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.085+0000 7fb9c1a319c0 20 add_watcher() i=6 2024-09-14T11:06:08.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.089+0000 7fb9c1a319c0 20 add_watcher() i=7 2024-09-14T11:06:08.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.089+0000 7fb9c1a319c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:08.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb874fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:08.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:08.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 5 note: GC not initialized 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb7ef7fe640 20 reqs_thread_entry: start 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 init_complete bucket index max shards: 11 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 Filter name: none 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb7ed7fa640 20 reqs_thread_entry: start 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:06:08.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:06:08.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:06:08.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:06:08.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:06:08.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:06:08.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.093+0000 7fb9c1a319c0 20 rados->read ofs=0 len=0 2024-09-14T11:06:08.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.097+0000 7fb9c1a319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:08.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.097+0000 7fb9c1a319c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:06:08.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.097+0000 7fb9c1a319c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:06:08.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.097+0000 7fb9c1a319c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:06:08.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.097+0000 7fb9c1a319c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:06:08.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.097+0000 7fb9c1a319c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:06:08.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.097+0000 7fb9c1a319c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:06:08.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.097+0000 7fb9c1a319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:06:08.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.101+0000 7fb8a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660545 cookie 94012559555136 notifier 5856 bl.length()=677 2024-09-14T11:06:08.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.101+0000 7fb8a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:06:08.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.101+0000 7fb8a1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:06:08.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.105+0000 7fb9c1a319c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:06:08.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.105+0000 7fb9c1a319c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:06:08.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.105+0000 7fb9c1a319c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:06:08.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.105+0000 7fb8a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660489 cookie 94012559539808 notifier 5856 bl.length()=187 2024-09-14T11:06:08.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.105+0000 7fb8a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:06:08.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.105+0000 7fb8a17fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:06:08.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.109+0000 7fb9c1a319c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:06:08.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.109+0000 7fb9c1a319c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:06:08.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.109+0000 7fb9c1a319c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:06:08.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.109+0000 7fb8a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660490 cookie 94012559539808 notifier 5856 bl.length()=197 2024-09-14T11:06:08.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.109+0000 7fb8a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:06:08.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.109+0000 7fb8a17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "display_name": "maven test user", 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "email": "sigv4@example.com", 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "suspended": 0, 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "subusers": [], 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "keys": [ 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: { 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "user": "ceph-test-maven", 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:06:08.107 INFO:tasks.workunit.client.0.smithi148.stdout: "active": true, 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "create_date": "2024-09-14T11:06:08.102354Z" 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: ], 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "swift_keys": [], 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "caps": [], 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "default_placement": "", 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "placement_tags": [], 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_quota": { 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "enabled": false, 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size": -1, 2024-09-14T11:06:08.108 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "max_objects": -1 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "user_quota": { 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "enabled": false, 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size": -1, 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "max_objects": -1 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "type": "rgw", 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:06:08.109 INFO:tasks.workunit.client.0.smithi148.stdout: "account_id": "", 2024-09-14T11:06:08.110 INFO:tasks.workunit.client.0.smithi148.stdout: "path": "/", 2024-09-14T11:06:08.110 INFO:tasks.workunit.client.0.smithi148.stdout: "create_date": "2024-09-14T11:06:08.102329Z", 2024-09-14T11:06:08.110 INFO:tasks.workunit.client.0.smithi148.stdout: "tags": [], 2024-09-14T11:06:08.110 INFO:tasks.workunit.client.0.smithi148.stdout: "group_ids": [] 2024-09-14T11:06:08.110 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T11:06:08.110 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:06:08.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.113+0000 7fb874fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:08.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.117+0000 7fb9c1a319c0 20 remove_watcher() i=0 2024-09-14T11:06:08.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.117+0000 7fb9c1a319c0 2 removed watcher, disabling cache 2024-09-14T11:06:08.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.117+0000 7fb9c1a319c0 20 remove_watcher() i=1 2024-09-14T11:06:08.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.121+0000 7fb9c1a319c0 20 remove_watcher() i=2 2024-09-14T11:06:08.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.121+0000 7fb9c1a319c0 20 remove_watcher() i=3 2024-09-14T11:06:08.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.125+0000 7fb9c1a319c0 20 remove_watcher() i=4 2024-09-14T11:06:08.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.125+0000 7fb9c1a319c0 20 remove_watcher() i=5 2024-09-14T11:06:08.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.129+0000 7fb9c1a319c0 20 remove_watcher() i=6 2024-09-14T11:06:08.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:06:08.133+0000 7fb9c1a319c0 20 remove_watcher() i=7 2024-09-14T11:06:08.142 INFO:tasks.workunit.client.0.smithi148.stderr:+ [ -z ] 2024-09-14T11:06:08.142 INFO:tasks.workunit.client.0.smithi148.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-14T11:06:08.142 INFO:tasks.workunit.client.0.smithi148.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:06:08.143 INFO:tasks.workunit.client.0.smithi148.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi148.front.sepia.ceph.com:443 2024-09-14T11:06:08.143 INFO:tasks.workunit.client.0.smithi148.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-14T11:06:08.143 INFO:tasks.workunit.client.0.smithi148.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:06:08.143 INFO:tasks.workunit.client.0.smithi148.stderr:+ ./mvnw clean package 2024-09-14T11:06:08.149 INFO:tasks.workunit.client.0.smithi148.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:06:10.671 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Scanning for projects... 2024-09-14T11:06:10.804 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:06:10.914 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 50 kB/s) 2024-09-14T11:06:10.931 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:06:10.965 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 27/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 34/83 kB Progress (1): 36/83 kB Progress (1): 37/83 kB Progress (1): 38/83 kB Progress (1): 40/83 kB Progress (1): 41/83 kB Progress (1): 43/83 kB Progress (1): 44/83 kB Progress (1): 45/83 kB Progress (1): 47/83 kB Progress (1): 48/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-09-14T11:06:10.980 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:06:11.000 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.8 MB/s) 2024-09-14T11:06:11.039 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:11.039 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:06:11.039 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:06:11.039 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] from pom.xml 2024-09-14T11:06:11.039 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:06:11.043 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:06:11.059 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-14T11:06:11.066 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:06:11.081 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-14T11:06:11.085 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:06:11.101 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-14T11:06:11.109 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:06:11.124 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-14T11:06:11.137 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:06:11.153 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-14T11:06:11.161 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:06:11.176 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T11:06:11.179 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:06:11.194 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T11:06:11.201 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:06:11.214 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15/48 kB Progress (1): 31/48 kB Progress (1): 48/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-14T11:06:11.221 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:06:11.238 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-09-14T11:06:11.248 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:06:11.265 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.7 MB/s) 2024-09-14T11:06:11.274 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:06:11.290 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 577 kB/s) 2024-09-14T11:06:11.300 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:06:11.316 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 0.3/66 kB Progress (1): 17/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-14T11:06:11.325 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:06:11.340 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-14T11:06:11.343 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:06:11.358 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-14T11:06:11.363 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:06:11.382 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-14T11:06:11.386 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:06:11.402 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-14T11:06:11.411 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:06:11.427 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-14T11:06:11.433 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:06:11.449 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-14T11:06:11.461 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:06:11.477 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 423 kB/s) 2024-09-14T11:06:11.480 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:06:11.496 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-14T11:06:11.499 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:06:11.516 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-14T11:06:11.520 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:06:11.537 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-14T11:06:11.546 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:06:11.562 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-14T11:06:11.585 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:06:11.600 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-14T11:06:11.603 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:06:11.619 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-14T11:06:11.629 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:06:11.647 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-14T11:06:11.663 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:06:11.679 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-14T11:06:11.682 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:06:11.698 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-14T11:06:11.700 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:06:11.715 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-14T11:06:11.724 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:06:11.741 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 202 kB/s) 2024-09-14T11:06:11.749 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:06:11.765 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-14T11:06:11.771 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:06:11.787 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-14T11:06:11.792 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:06:11.807 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-14T11:06:11.814 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:06:11.830 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-14T11:06:11.837 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:06:11.852 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-14T11:06:11.857 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:06:11.873 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 72 kB/s) 2024-09-14T11:06:11.877 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:06:11.892 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-14T11:06:11.895 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:06:11.912 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 812 kB/s) 2024-09-14T11:06:11.919 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:06:11.937 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 204 kB/s) 2024-09-14T11:06:11.948 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:06:11.966 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-14T11:06:11.974 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:06:11.991 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 171 kB/s) 2024-09-14T11:06:12.000 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:06:12.016 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 436 kB/s) 2024-09-14T11:06:12.028 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:06:12.048 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 273 kB/s) 2024-09-14T11:06:12.056 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:06:12.073 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-14T11:06:12.086 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:06:12.104 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 231 kB/s) 2024-09-14T11:06:12.108 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:06:12.124 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-14T11:06:12.132 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:06:12.148 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-09-14T11:06:12.156 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:06:12.173 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-14T11:06:12.181 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:06:12.198 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-14T11:06:12.206 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:06:12.223 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-14T11:06:12.233 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:06:12.249 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 255 kB/s) 2024-09-14T11:06:12.253 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:06:12.270 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-14T11:06:12.279 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:06:12.296 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-14T11:06:12.300 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:06:12.317 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-14T11:06:12.322 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:06:12.340 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 310 kB/s) 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 776 kB/s) 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-09-14T11:06:12.566 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:06:12.582 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-09-14T11:06:12.592 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:06:12.608 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 965 kB/s) 2024-09-14T11:06:12.613 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:06:12.633 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.2 MB/s) 2024-09-14T11:06:12.643 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:06:12.660 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-09-14T11:06:12.668 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:06:12.686 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-14T11:06:12.692 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:06:12.712 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15/78 kB Progress (1): 31/78 kB Progress (1): 48/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-09-14T11:06:12.726 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:06:12.742 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 240 kB/s) 2024-09-14T11:06:12.747 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:06:12.763 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 863 kB/s) 2024-09-14T11:06:12.769 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:06:12.785 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-14T11:06:12.791 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:06:12.807 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 199 kB/s) 2024-09-14T11:06:12.813 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:06:12.829 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 120 kB/s) 2024-09-14T11:06:12.833 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:06:12.849 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 177 kB/s) 2024-09-14T11:06:12.855 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:06:12.870 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 95 kB/s) 2024-09-14T11:06:12.875 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:06:12.891 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 188 kB/s) 2024-09-14T11:06:12.897 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:06:12.913 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-14T11:06:12.918 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:06:12.934 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-09-14T11:06:12.940 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:06:12.958 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 57 kB/s) 2024-09-14T11:06:12.966 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:06:12.983 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-09-14T11:06:12.989 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:06:13.005 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-14T11:06:13.010 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:06:13.026 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-09-14T11:06:13.031 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:06:13.047 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-14T11:06:13.053 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:06:13.069 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-14T11:06:13.074 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:06:13.090 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-14T11:06:13.152 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:06:13.272 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 27 MB/s) 2024-09-14T11:06:13.274 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:06:13.274 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:06:13.274 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:06:13.275 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:06:13.275 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:06:13.305 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/49 kB Progress (1): 33/49 kB Progress (1): 49/49 kB Progress (1): 49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 1.6 MB/s) 2024-09-14T11:06:13.305 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:06:13.323 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (2): 2.8/16 kB | 16 kB Progress (3): 2.8/16 kB | 16 kB | 1.4/71 kB Progress (3): 4.1/16 kB | 16 kB | 1.4/71 kB Progress (3): 4.1/16 kB | 16 kB | 2.8/71 kB Progress (3): 5.5/16 kB | 16 kB | 2.8/71 kB Progress (3): 5.5/16 kB | 16 kB | 4.1/71 kB Progress (3): 6.9/16 kB | 16 kB | 4.1/71 kB Progress (3): 6.9/16 kB | 16 kB | 5.5/71 kB Progress (3): 8.3/16 kB | 16 kB | 5.5/71 kB Progress (3): 8.3/16 kB | 16 kB | 6.9/71 kB Progress (3): 9.7/16 kB | 16 kB | 6.9/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 356 kB/s) 2024-09-14T11:06:13.324 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 11/16 kB | 6.9/71 kB Progress (2): 11/16 kB | 8.3/71 kB Progress (2): 12/16 kB | 8.3/71 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:06:13.324 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 12/16 kB | 9.7/71 kB Progress (2): 14/16 kB | 9.7/71 kB Progress (2): 14/16 kB | 11/71 kB Progress (2): 15/16 kB | 11/71 kB Progress (2): 15/16 kB | 12/71 kB Progress (2): 16 kB | 12/71 kB Progress (2): 16 kB | 14/71 kB Progress (2): 16 kB | 15/71 kB Progress (2): 16 kB | 16/71 kB Progress (2): 16 kB | 18/71 kB Progress (2): 16 kB | 19/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 329 kB/s) 2024-09-14T11:06:13.324 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:06:13.337 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 21/71 kB Progress (1): 22/71 kB Progress (1): 23/71 kB Progress (1): 25/71 kB Progress (1): 26/71 kB Progress (1): 27/71 kB Progress (1): 29/71 kB Progress (1): 30/71 kB Progress (1): 32/71 kB Progress (1): 33/71 kB Progress (1): 34/71 kB Progress (1): 36/71 kB Progress (1): 37/71 kB Progress (1): 38/71 kB Progress (1): 40/71 kB Progress (1): 41/71 kB Progress (1): 43/71 kB Progress (1): 43/71 kB Progress (1): 59/71 kB Progress (1): 71 kB Progress (2): 71 kB | 1.4/782 kB Progress (2): 71 kB | 2.8/782 kB Progress (2): 71 kB | 4.1/782 kB Progress (2): 71 kB | 5.5/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.1 MB/s) 2024-09-14T11:06:13.337 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.9/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:06:13.337 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.3/782 kB Progress (1): 9.7/782 kB Progress (2): 9.7/782 kB | 11 kB Progress (2): 11/782 kB | 11 kB Progress (2): 12/782 kB | 11 kB Progress (2): 14/782 kB | 11 kB Progress (2): 15/782 kB | 11 kB Progress (2): 16/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 183 kB/s) 2024-09-14T11:06:13.337 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:06:13.348 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 33/782 kB Progress (2): 33/782 kB | 1.4/35 kB Progress (2): 33/782 kB | 2.8/35 kB Progress (3): 33/782 kB | 2.8/35 kB | 1.4/98 kB Progress (3): 33/782 kB | 4.1/35 kB | 1.4/98 kB Progress (3): 33/782 kB | 4.1/35 kB | 2.8/98 kB Progress (3): 33/782 kB | 5.5/35 kB | 2.8/98 kB Progress (3): 33/782 kB | 5.5/35 kB | 4.1/98 kB Progress (3): 33/782 kB | 6.9/35 kB | 4.1/98 kB Progress (3): 33/782 kB | 6.9/35 kB | 5.5/98 kB Progress (3): 33/782 kB | 8.3/35 kB | 5.5/98 kB Progress (3): 33/782 kB | 8.3/35 kB | 6.9/98 kB Progress (3): 33/782 kB | 9.7/35 kB | 6.9/98 kB Progress (3): 33/782 kB | 9.7/35 kB | 8.3/98 kB Progress (3): 33/782 kB | 11/35 kB | 8.3/98 kB Progress (3): 33/782 kB | 11/35 kB | 9.7/98 kB Progress (3): 33/782 kB | 12/35 kB | 9.7/98 kB Progress (3): 33/782 kB | 12/35 kB | 11/98 kB Progress (3): 33/782 kB | 14/35 kB | 11/98 kB Progress (3): 33/782 kB | 14/35 kB | 12/98 kB Progress (3): 33/782 kB | 15/35 kB | 12/98 kB Progress (3): 33/782 kB | 15/35 kB | 14/98 kB Progress (3): 33/782 kB | 17/35 kB | 14/98 kB Progress (3): 33/782 kB | 17/35 kB | 15/98 kB Progress (3): 33/782 kB | 18/35 kB | 15/98 kB Progress (3): 33/782 kB | 18/35 kB | 16/98 kB Progress (3): 33/782 kB | 19/35 kB | 16/98 kB Progress (3): 33/782 kB | 19/35 kB | 18/98 kB Progress (3): 33/782 kB | 21/35 kB | 18/98 kB Progress (3): 33/782 kB | 21/35 kB | 19/98 kB Progress (3): 33/782 kB | 21/35 kB | 21/98 kB Progress (3): 33/782 kB | 22/35 kB | 21/98 kB Progress (3): 33/782 kB | 23/35 kB | 21/98 kB Progress (3): 33/782 kB | 25/35 kB | 21/98 kB Progress (3): 33/782 kB | 26/35 kB | 21/98 kB Progress (3): 33/782 kB | 26/35 kB | 22/98 kB Progress (3): 33/782 kB | 26/35 kB | 23/98 kB Progress (3): 33/782 kB | 26/35 kB | 25/98 kB Progress (3): 33/782 kB | 26/35 kB | 26/98 kB Progress (3): 33/782 kB | 28/35 kB | 26/98 kB Progress (3): 33/782 kB | 29/35 kB | 26/98 kB Progress (3): 33/782 kB | 30/35 kB | 26/98 kB Progress (3): 33/782 kB | 30/35 kB | 27/98 kB Progress (3): 33/782 kB | 32/35 kB | 27/98 kB Progress (3): 33/782 kB | 32/35 kB | 29/98 kB Progress (3): 33/782 kB | 32/35 kB | 30/98 kB Progress (3): 33/782 kB | 32/35 kB | 32/98 kB Progress (3): 49/782 kB | 32/35 kB | 32/98 kB Progress (3): 49/782 kB | 33/35 kB | 32/98 kB Progress (3): 49/782 kB | 34/35 kB | 32/98 kB Progress (3): 49/782 kB | 35 kB | 32/98 kB Progress (3): 49/782 kB | 35 kB | 33/98 kB Progress (3): 49/782 kB | 35 kB | 34/98 kB Progress (3): 49/782 kB | 35 kB | 36/98 kB Progress (3): 49/782 kB | 35 kB | 37/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 469 kB/s) 2024-09-14T11:06:13.348 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:06:13.352 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 49/782 kB | 38/98 kB Progress (2): 65/782 kB | 38/98 kB Progress (3): 65/782 kB | 38/98 kB | 16/205 kB Progress (3): 82/782 kB | 38/98 kB | 16/205 kB Progress (3): 82/782 kB | 38/98 kB | 33/205 kB Progress (3): 82/782 kB | 38/98 kB | 49/205 kB Progress (4): 82/782 kB | 38/98 kB | 49/205 kB | 16/30 kB Progress (4): 82/782 kB | 38/98 kB | 65/205 kB | 16/30 kB Progress (4): 82/782 kB | 38/98 kB | 81/205 kB | 16/30 kB Progress (4): 82/782 kB | 38/98 kB | 81/205 kB | 30 kB Progress (4): 82/782 kB | 38/98 kB | 98/205 kB | 30 kB Progress (4): 82/782 kB | 38/98 kB | 114/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 392 kB/s) 2024-09-14T11:06:13.352 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 82/782 kB | 38/98 kB | 131/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:06:13.355 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 82/782 kB | 38/98 kB | 147/205 kB Progress (3): 82/782 kB | 38/98 kB | 163/205 kB Progress (3): 82/782 kB | 38/98 kB | 180/205 kB Progress (3): 82/782 kB | 38/98 kB | 196/205 kB Progress (3): 82/782 kB | 38/98 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.6 MB/s) 2024-09-14T11:06:13.355 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:06:13.367 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 82/782 kB | 40/98 kB Progress (2): 82/782 kB | 41/98 kB Progress (2): 82/782 kB | 42/98 kB Progress (2): 82/782 kB | 44/98 kB Progress (2): 82/782 kB | 45/98 kB Progress (2): 82/782 kB | 46/98 kB Progress (2): 82/782 kB | 48/98 kB Progress (2): 82/782 kB | 49/98 kB Progress (2): 82/782 kB | 50/98 kB Progress (2): 82/782 kB | 52/98 kB Progress (2): 82/782 kB | 53/98 kB Progress (2): 82/782 kB | 55/98 kB Progress (2): 82/782 kB | 56/98 kB Progress (2): 82/782 kB | 57/98 kB Progress (2): 82/782 kB | 59/98 kB Progress (2): 82/782 kB | 60/98 kB Progress (2): 82/782 kB | 61/98 kB Progress (2): 82/782 kB | 63/98 kB Progress (2): 98/782 kB | 63/98 kB Progress (2): 98/782 kB | 79/98 kB Progress (2): 115/782 kB | 79/98 kB Progress (2): 115/782 kB | 95/98 kB Progress (2): 131/782 kB | 95/98 kB Progress (2): 147/782 kB | 95/98 kB Progress (2): 164/782 kB | 95/98 kB Progress (3): 164/782 kB | 95/98 kB | 1.4/81 kB Progress (3): 164/782 kB | 95/98 kB | 2.8/81 kB Progress (3): 164/782 kB | 95/98 kB | 4.1/81 kB Progress (3): 164/782 kB | 95/98 kB | 5.5/81 kB Progress (3): 164/782 kB | 95/98 kB | 6.9/81 kB Progress (3): 164/782 kB | 95/98 kB | 8.3/81 kB Progress (3): 164/782 kB | 95/98 kB | 9.7/81 kB Progress (3): 164/782 kB | 95/98 kB | 11/81 kB Progress (3): 180/782 kB | 95/98 kB | 11/81 kB Progress (3): 180/782 kB | 95/98 kB | 12/81 kB Progress (3): 180/782 kB | 95/98 kB | 14/81 kB Progress (3): 180/782 kB | 95/98 kB | 15/81 kB Progress (3): 180/782 kB | 95/98 kB | 16/81 kB Progress (3): 197/782 kB | 95/98 kB | 16/81 kB Progress (3): 197/782 kB | 95/98 kB | 33/81 kB Progress (3): 213/782 kB | 95/98 kB | 33/81 kB Progress (3): 213/782 kB | 95/98 kB | 49/81 kB Progress (3): 213/782 kB | 98 kB | 49/81 kB Progress (4): 213/782 kB | 98 kB | 49/81 kB | 16/798 kB Progress (4): 213/782 kB | 98 kB | 49/81 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.0 MB/s) 2024-09-14T11:06:13.367 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:06:13.368 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 213/782 kB | 49/81 kB | 49/798 kB Progress (4): 213/782 kB | 49/81 kB | 49/798 kB | 13 kB Progress (4): 213/782 kB | 49/81 kB | 62/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 144 kB/s) 2024-09-14T11:06:13.369 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:06:13.376 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 213/782 kB | 49/81 kB | 78/798 kB Progress (3): 229/782 kB | 49/81 kB | 78/798 kB Progress (3): 246/782 kB | 49/81 kB | 78/798 kB Progress (3): 262/782 kB | 49/81 kB | 78/798 kB Progress (3): 262/782 kB | 49/81 kB | 95/798 kB Progress (3): 262/782 kB | 49/81 kB | 111/798 kB Progress (3): 278/782 kB | 49/81 kB | 111/798 kB Progress (3): 295/782 kB | 49/81 kB | 111/798 kB Progress (3): 311/782 kB | 49/81 kB | 111/798 kB Progress (3): 328/782 kB | 49/81 kB | 111/798 kB Progress (3): 344/782 kB | 49/81 kB | 111/798 kB Progress (3): 360/782 kB | 49/81 kB | 111/798 kB Progress (3): 360/782 kB | 64/81 kB | 111/798 kB Progress (3): 377/782 kB | 64/81 kB | 111/798 kB Progress (3): 393/782 kB | 64/81 kB | 111/798 kB Progress (3): 393/782 kB | 80/81 kB | 111/798 kB Progress (3): 410/782 kB | 80/81 kB | 111/798 kB Progress (3): 410/782 kB | 81 kB | 111/798 kB Progress (3): 426/782 kB | 81 kB | 111/798 kB Progress (3): 442/782 kB | 81 kB | 111/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 805 kB/s) 2024-09-14T11:06:13.376 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:06:13.386 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 459/782 kB | 111/798 kB Progress (2): 475/782 kB | 111/798 kB Progress (2): 491/782 kB | 111/798 kB Progress (2): 491/782 kB | 128/798 kB Progress (2): 491/782 kB | 144/798 kB Progress (2): 491/782 kB | 160/798 kB Progress (2): 491/782 kB | 177/798 kB Progress (2): 491/782 kB | 193/798 kB Progress (3): 491/782 kB | 193/798 kB | 16/182 kB Progress (3): 491/782 kB | 193/798 kB | 33/182 kB Progress (3): 491/782 kB | 209/798 kB | 33/182 kB Progress (3): 508/782 kB | 209/798 kB | 33/182 kB Progress (3): 508/782 kB | 226/798 kB | 33/182 kB Progress (3): 508/782 kB | 226/798 kB | 49/182 kB Progress (3): 524/782 kB | 226/798 kB | 49/182 kB Progress (3): 541/782 kB | 226/798 kB | 49/182 kB Progress (3): 541/782 kB | 242/798 kB | 49/182 kB Progress (3): 557/782 kB | 242/798 kB | 49/182 kB Progress (4): 557/782 kB | 242/798 kB | 49/182 kB | 16/151 kB Progress (4): 557/782 kB | 259/798 kB | 49/182 kB | 16/151 kB Progress (4): 557/782 kB | 259/798 kB | 62/182 kB | 16/151 kB Progress (4): 557/782 kB | 259/798 kB | 62/182 kB | 33/151 kB Progress (4): 557/782 kB | 275/798 kB | 62/182 kB | 33/151 kB Progress (4): 573/782 kB | 275/798 kB | 62/182 kB | 33/151 kB Progress (4): 573/782 kB | 275/798 kB | 78/182 kB | 33/151 kB Progress (4): 573/782 kB | 275/798 kB | 78/182 kB | 49/151 kB Progress (4): 590/782 kB | 275/798 kB | 78/182 kB | 49/151 kB Progress (4): 590/782 kB | 291/798 kB | 78/182 kB | 49/151 kB Progress (4): 590/782 kB | 291/798 kB | 78/182 kB | 62/151 kB Progress (4): 606/782 kB | 291/798 kB | 78/182 kB | 62/151 kB Progress (4): 606/782 kB | 291/798 kB | 94/182 kB | 62/151 kB Progress (4): 606/782 kB | 291/798 kB | 94/182 kB | 79/151 kB Progress (4): 606/782 kB | 308/798 kB | 94/182 kB | 79/151 kB Progress (4): 623/782 kB | 308/798 kB | 94/182 kB | 79/151 kB Progress (4): 623/782 kB | 308/798 kB | 94/182 kB | 95/151 kB Progress (4): 639/782 kB | 308/798 kB | 94/182 kB | 95/151 kB Progress (4): 639/782 kB | 308/798 kB | 94/182 kB | 111/151 kB Progress (4): 639/782 kB | 324/798 kB | 94/182 kB | 111/151 kB Progress (4): 655/782 kB | 324/798 kB | 94/182 kB | 111/151 kB Progress (4): 655/782 kB | 324/798 kB | 111/182 kB | 111/151 kB Progress (4): 655/782 kB | 324/798 kB | 111/182 kB | 128/151 kB Progress (4): 672/782 kB | 324/798 kB | 111/182 kB | 128/151 kB Progress (4): 672/782 kB | 341/798 kB | 111/182 kB | 128/151 kB Progress (4): 672/782 kB | 341/798 kB | 111/182 kB | 144/151 kB Progress (4): 688/782 kB | 341/798 kB | 111/182 kB | 144/151 kB Progress (4): 688/782 kB | 341/798 kB | 111/182 kB | 151 kB Progress (4): 704/782 kB | 341/798 kB | 111/182 kB | 151 kB Progress (4): 704/782 kB | 341/798 kB | 127/182 kB | 151 kB Progress (4): 721/782 kB | 341/798 kB | 127/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-14T11:06:13.387 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:06:13.387 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 737/782 kB | 341/798 kB | 127/182 kB Progress (3): 754/782 kB | 341/798 kB | 127/182 kB Progress (3): 770/782 kB | 341/798 kB | 127/182 kB Progress (3): 782 kB | 341/798 kB | 127/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 7.0 MB/s) 2024-09-14T11:06:13.387 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:06:13.391 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 357/798 kB | 127/182 kB Progress (2): 373/798 kB | 127/182 kB Progress (2): 390/798 kB | 127/182 kB Progress (3): 390/798 kB | 127/182 kB | 16/27 kB Progress (3): 406/798 kB | 127/182 kB | 16/27 kB Progress (3): 406/798 kB | 127/182 kB | 27 kB Progress (3): 422/798 kB | 127/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 237 kB/s) 2024-09-14T11:06:13.392 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:06:13.393 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 439/798 kB | 127/182 kB Progress (2): 439/798 kB | 143/182 kB Progress (2): 439/798 kB | 160/182 kB Progress (2): 455/798 kB | 160/182 kB Progress (2): 472/798 kB | 160/182 kB Progress (2): 472/798 kB | 176/182 kB Progress (2): 472/798 kB | 182 kB Progress (2): 488/798 kB | 182 kB Progress (2): 504/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-14T11:06:13.393 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:06:13.400 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 521/798 kB Progress (1): 537/798 kB Progress (1): 554/798 kB Progress (1): 570/798 kB Progress (1): 586/798 kB Progress (1): 603/798 kB Progress (1): 619/798 kB Progress (1): 635/798 kB Progress (1): 652/798 kB Progress (1): 668/798 kB Progress (1): 685/798 kB Progress (1): 701/798 kB Progress (1): 717/798 kB Progress (1): 734/798 kB Progress (1): 750/798 kB Progress (2): 750/798 kB | 16/30 kB Progress (2): 750/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 242 kB/s) 2024-09-14T11:06:13.400 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:06:13.402 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 766/798 kB Progress (2): 766/798 kB | 16/385 kB Progress (2): 766/798 kB | 33/385 kB Progress (2): 783/798 kB | 33/385 kB Progress (2): 783/798 kB | 49/385 kB Progress (2): 798 kB | 49/385 kB Progress (2): 798 kB | 65/385 kB Progress (2): 798 kB | 82/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.3 MB/s) 2024-09-14T11:06:13.403 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 98/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:06:13.407 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (1): 278/385 kB Progress (1): 295/385 kB Progress (1): 311/385 kB Progress (2): 311/385 kB | 13 kB Progress (2): 327/385 kB | 13 kB Progress (2): 344/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 101 kB/s) 2024-09-14T11:06:13.407 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 360/385 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:06:13.408 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 360/385 kB | 16/75 kB Progress (2): 376/385 kB | 16/75 kB Progress (2): 376/385 kB | 33/75 kB Progress (2): 385 kB | 33/75 kB Progress (2): 385 kB | 49/75 kB Progress (2): 385 kB | 61/75 kB Progress (2): 385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.9 MB/s) 2024-09-14T11:06:13.408 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:06:13.408 INFO:tasks.workunit.client.0.smithi148.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 569 kB/s) 2024-09-14T11:06:13.408 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:06:13.444 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 66/780 kB Progress (1): 82/780 kB Progress (1): 98/780 kB Progress (1): 115/780 kB Progress (2): 115/780 kB | 16/329 kB Progress (2): 131/780 kB | 16/329 kB Progress (2): 131/780 kB | 33/329 kB Progress (2): 147/780 kB | 33/329 kB Progress (2): 147/780 kB | 49/329 kB Progress (2): 164/780 kB | 49/329 kB Progress (2): 164/780 kB | 62/329 kB Progress (2): 180/780 kB | 62/329 kB Progress (2): 197/780 kB | 62/329 kB Progress (2): 197/780 kB | 78/329 kB Progress (2): 213/780 kB | 78/329 kB Progress (2): 213/780 kB | 94/329 kB Progress (2): 229/780 kB | 94/329 kB Progress (2): 229/780 kB | 111/329 kB Progress (2): 246/780 kB | 111/329 kB Progress (2): 246/780 kB | 127/329 kB Progress (2): 262/780 kB | 127/329 kB Progress (2): 262/780 kB | 144/329 kB Progress (2): 279/780 kB | 144/329 kB Progress (2): 279/780 kB | 160/329 kB Progress (2): 295/780 kB | 160/329 kB Progress (2): 295/780 kB | 176/329 kB Progress (2): 311/780 kB | 176/329 kB Progress (2): 311/780 kB | 193/329 kB Progress (2): 328/780 kB | 193/329 kB Progress (2): 328/780 kB | 209/329 kB Progress (2): 344/780 kB | 209/329 kB Progress (2): 360/780 kB | 209/329 kB Progress (2): 360/780 kB | 226/329 kB Progress (2): 377/780 kB | 226/329 kB Progress (2): 377/780 kB | 242/329 kB Progress (2): 393/780 kB | 242/329 kB Progress (2): 393/780 kB | 258/329 kB Progress (3): 393/780 kB | 258/329 kB | 16/501 kB Progress (3): 410/780 kB | 258/329 kB | 16/501 kB Progress (3): 426/780 kB | 258/329 kB | 16/501 kB Progress (3): 426/780 kB | 258/329 kB | 33/501 kB Progress (3): 426/780 kB | 275/329 kB | 33/501 kB Progress (3): 442/780 kB | 275/329 kB | 33/501 kB Progress (3): 442/780 kB | 275/329 kB | 49/501 kB Progress (3): 442/780 kB | 291/329 kB | 49/501 kB Progress (4): 442/780 kB | 291/329 kB | 49/501 kB | 16/41 kB Progress (5): 442/780 kB | 291/329 kB | 49/501 kB | 16/41 kB | 16/354 kB Progress (5): 459/780 kB | 291/329 kB | 49/501 kB | 16/41 kB | 16/354 kB Progress (5): 459/780 kB | 291/329 kB | 62/501 kB | 16/41 kB | 16/354 kB Progress (5): 459/780 kB | 307/329 kB | 62/501 kB | 16/41 kB | 16/354 kB Progress (5): 459/780 kB | 307/329 kB | 62/501 kB | 32/41 kB | 16/354 kB Progress (5): 459/780 kB | 307/329 kB | 62/501 kB | 32/41 kB | 32/354 kB Progress (5): 475/780 kB | 307/329 kB | 62/501 kB | 32/41 kB | 32/354 kB Progress (5): 475/780 kB | 307/329 kB | 78/501 kB | 32/41 kB | 32/354 kB Progress (5): 475/780 kB | 307/329 kB | 78/501 kB | 41 kB | 32/354 kB Progress (5): 475/780 kB | 324/329 kB | 78/501 kB | 41 kB | 32/354 kB Progress (5): 475/780 kB | 324/329 kB | 78/501 kB | 41 kB | 49/354 kB Progress (5): 492/780 kB | 324/329 kB | 78/501 kB | 41 kB | 49/354 kB Progress (5): 492/780 kB | 329 kB | 78/501 kB | 41 kB | 49/354 kB Progress (5): 492/780 kB | 329 kB | 94/501 kB | 41 kB | 49/354 kB Progress (5): 492/780 kB | 329 kB | 94/501 kB | 41 kB | 65/354 kB Progress (5): 508/780 kB | 329 kB | 94/501 kB | 41 kB | 65/354 kB Progress (5): 508/780 kB | 329 kB | 111/501 kB | 41 kB | 65/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 248 kB/s) 2024-09-14T11:06:13.444 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:06:13.448 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (4): 508/780 kB | 329 kB | 111/501 kB | 81/354 kB Progress (4): 524/780 kB | 329 kB | 111/501 kB | 81/354 kB Progress (4): 524/780 kB | 329 kB | 127/501 kB | 81/354 kB Progress (4): 524/780 kB | 329 kB | 127/501 kB | 98/354 kB Progress (4): 524/780 kB | 329 kB | 144/501 kB | 98/354 kB Progress (4): 541/780 kB | 329 kB | 144/501 kB | 98/354 kB Progress (4): 541/780 kB | 329 kB | 160/501 kB | 98/354 kB Progress (4): 541/780 kB | 329 kB | 160/501 kB | 114/354 kB Progress (4): 557/780 kB | 329 kB | 160/501 kB | 114/354 kB Progress (4): 557/780 kB | 329 kB | 176/501 kB | 114/354 kB Progress (4): 557/780 kB | 329 kB | 176/501 kB | 130/354 kB Progress (4): 557/780 kB | 329 kB | 193/501 kB | 130/354 kB Progress (4): 573/780 kB | 329 kB | 193/501 kB | 130/354 kB Progress (4): 573/780 kB | 329 kB | 193/501 kB | 147/354 kB Progress (4): 573/780 kB | 329 kB | 209/501 kB | 147/354 kB Progress (4): 590/780 kB | 329 kB | 209/501 kB | 147/354 kB Progress (4): 590/780 kB | 329 kB | 226/501 kB | 147/354 kB Progress (4): 590/780 kB | 329 kB | 226/501 kB | 163/354 kB Progress (4): 606/780 kB | 329 kB | 226/501 kB | 163/354 kB Progress (4): 606/780 kB | 329 kB | 242/501 kB | 163/354 kB Progress (4): 606/780 kB | 329 kB | 242/501 kB | 180/354 kB Progress (4): 623/780 kB | 329 kB | 242/501 kB | 180/354 kB Progress (4): 623/780 kB | 329 kB | 258/501 kB | 180/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-09-14T11:06:13.449 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 623/780 kB | 258/501 kB | 196/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:06:13.451 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 639/780 kB | 258/501 kB | 196/354 kB Progress (3): 639/780 kB | 275/501 kB | 196/354 kB Progress (3): 639/780 kB | 275/501 kB | 212/354 kB Progress (3): 655/780 kB | 275/501 kB | 212/354 kB Progress (3): 655/780 kB | 291/501 kB | 212/354 kB Progress (3): 655/780 kB | 291/501 kB | 229/354 kB Progress (3): 672/780 kB | 291/501 kB | 229/354 kB Progress (3): 672/780 kB | 307/501 kB | 229/354 kB Progress (3): 672/780 kB | 307/501 kB | 245/354 kB Progress (3): 688/780 kB | 307/501 kB | 245/354 kB Progress (3): 688/780 kB | 324/501 kB | 245/354 kB Progress (3): 688/780 kB | 324/501 kB | 262/354 kB Progress (3): 705/780 kB | 324/501 kB | 262/354 kB Progress (3): 705/780 kB | 340/501 kB | 262/354 kB Progress (3): 705/780 kB | 340/501 kB | 278/354 kB Progress (3): 721/780 kB | 340/501 kB | 278/354 kB Progress (3): 721/780 kB | 357/501 kB | 278/354 kB Progress (3): 721/780 kB | 357/501 kB | 294/354 kB Progress (3): 737/780 kB | 357/501 kB | 294/354 kB Progress (3): 737/780 kB | 373/501 kB | 294/354 kB Progress (3): 737/780 kB | 373/501 kB | 311/354 kB Progress (3): 754/780 kB | 373/501 kB | 311/354 kB Progress (3): 754/780 kB | 389/501 kB | 311/354 kB Progress (3): 754/780 kB | 389/501 kB | 327/354 kB Progress (3): 754/780 kB | 406/501 kB | 327/354 kB Progress (3): 770/780 kB | 406/501 kB | 327/354 kB Progress (3): 770/780 kB | 406/501 kB | 343/354 kB Progress (3): 770/780 kB | 422/501 kB | 343/354 kB Progress (3): 780 kB | 422/501 kB | 343/354 kB Progress (3): 780 kB | 422/501 kB | 354 kB Progress (3): 780 kB | 439/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.5 MB/s) 2024-09-14T11:06:13.451 INFO:tasks.workunit.client.0.smithi148.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.0 MB/s) 2024-09-14T11:06:13.451 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:06:13.451 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:06:13.454 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 455/501 kB Progress (1): 471/501 kB Progress (1): 488/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-09-14T11:06:13.455 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:06:13.458 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 35 kB/s) 2024-09-14T11:06:13.458 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:06:13.465 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 62/586 kB Progress (1): 78/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (1): 160/586 kB Progress (1): 176/586 kB Progress (1): 193/586 kB Progress (1): 209/586 kB Progress (1): 226/586 kB Progress (1): 242/586 kB Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (2): 275/586 kB | 14 kB Progress (2): 291/586 kB | 14 kB Progress (2): 308/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 76 kB/s) 2024-09-14T11:06:13.466 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:06:13.471 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (1): 357/586 kB Progress (2): 357/586 kB | 15/211 kB Progress (2): 373/586 kB | 15/211 kB Progress (2): 373/586 kB | 31/211 kB Progress (2): 389/586 kB | 31/211 kB Progress (2): 389/586 kB | 48/211 kB Progress (2): 406/586 kB | 48/211 kB Progress (2): 406/586 kB | 64/211 kB Progress (2): 422/586 kB | 64/211 kB Progress (2): 422/586 kB | 81/211 kB Progress (2): 439/586 kB | 81/211 kB Progress (2): 439/586 kB | 97/211 kB Progress (2): 455/586 kB | 97/211 kB Progress (2): 455/586 kB | 113/211 kB Progress (2): 455/586 kB | 130/211 kB Progress (2): 471/586 kB | 130/211 kB Progress (3): 471/586 kB | 130/211 kB | 16/106 kB Progress (3): 471/586 kB | 146/211 kB | 16/106 kB Progress (3): 488/586 kB | 146/211 kB | 16/106 kB Progress (3): 488/586 kB | 146/211 kB | 33/106 kB Progress (3): 488/586 kB | 162/211 kB | 33/106 kB Progress (3): 488/586 kB | 162/211 kB | 49/106 kB Progress (3): 504/586 kB | 162/211 kB | 49/106 kB Progress (3): 504/586 kB | 179/211 kB | 49/106 kB Progress (3): 504/586 kB | 179/211 kB | 65/106 kB Progress (3): 521/586 kB | 179/211 kB | 65/106 kB Progress (3): 521/586 kB | 179/211 kB | 81/106 kB Progress (3): 537/586 kB | 179/211 kB | 81/106 kB Progress (3): 537/586 kB | 195/211 kB | 81/106 kB Progress (3): 537/586 kB | 195/211 kB | 98/106 kB Progress (3): 553/586 kB | 195/211 kB | 98/106 kB Progress (3): 553/586 kB | 195/211 kB | 106 kB Progress (3): 553/586 kB | 211 kB | 106 kB Progress (3): 570/586 kB | 211 kB | 106 kB Progress (3): 586 kB | 211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 553 kB/s) 2024-09-14T11:06:13.471 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:06:13.471 INFO:tasks.workunit.client.0.smithi148.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-14T11:06:13.471 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:06:13.471 INFO:tasks.workunit.client.0.smithi148.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.0 MB/s) 2024-09-14T11:06:13.471 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:06:13.473 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 35 kB/s) 2024-09-14T11:06:13.473 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:06:13.485 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 63/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (1): 161/245 kB Progress (1): 177/245 kB Progress (1): 194/245 kB Progress (1): 210/245 kB Progress (1): 226/245 kB Progress (1): 243/245 kB Progress (1): 245 kB Progress (2): 245 kB | 16/205 kB Progress (3): 245 kB | 16/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-14T11:06:13.485 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:06:13.486 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 33/205 kB | 15 kB Progress (2): 49/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 74 kB/s) 2024-09-14T11:06:13.486 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:06:13.487 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 65/205 kB Progress (2): 65/205 kB | 16/16 kB Progress (2): 65/205 kB | 16 kB Progress (2): 81/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 79 kB/s) 2024-09-14T11:06:13.487 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 98/205 kB Progress (2): 98/205 kB | 6.4 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:06:13.487 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 114/205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 31 kB/s) 2024-09-14T11:06:13.487 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:06:13.489 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 130/205 kB Progress (1): 147/205 kB Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 971 kB/s) 2024-09-14T11:06:13.500 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/23 kB Progress (2): 16/23 kB | 16/24 kB Progress (2): 23 kB | 16/24 kB Progress (2): 23 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 109 kB/s) 2024-09-14T11:06:13.500 INFO:tasks.workunit.client.0.smithi148.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 102 kB/s) 2024-09-14T11:06:13.501 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 78 kB/s) 2024-09-14T11:06:13.505 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 813 kB/s) 2024-09-14T11:06:13.524 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:13.525 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:06:13.531 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:06:13.545 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 416 kB/s) 2024-09-14T11:06:13.547 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:06:13.562 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-14T11:06:13.564 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:06:13.578 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 3.1 MB/s) 2024-09-14T11:06:13.582 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:06:13.597 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-14T11:06:13.603 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:06:13.619 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.6 MB/s) 2024-09-14T11:06:13.620 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:06:13.640 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 80/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-09-14T11:06:13.706 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:13.706 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:06:13.709 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:06:13.724 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:06:13.725 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:06:13.739 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:06:13.742 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:06:13.756 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-14T11:06:13.759 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:06:13.772 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:06:13.776 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:06:13.789 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:06:13.792 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:06:13.805 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-14T11:06:13.809 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:06:13.823 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-14T11:06:13.825 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:06:13.839 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:06:13.841 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:06:13.855 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.1 MB/s) 2024-09-14T11:06:13.857 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:06:13.871 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T11:06:13.873 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:06:13.888 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-14T11:06:13.890 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:06:13.905 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-14T11:06:13.908 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:06:13.923 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-14T11:06:13.927 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:06:13.942 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.3 MB/s) 2024-09-14T11:06:13.949 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:06:13.964 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-14T11:06:13.967 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:06:13.982 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-14T11:06:13.990 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:06:14.005 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-14T11:06:14.012 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:06:14.031 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 38/85 kB Progress (1): 54/85 kB Progress (1): 71/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.5 MB/s) 2024-09-14T11:06:14.031 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:06:14.031 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:06:14.031 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:06:14.032 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:06:14.032 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:06:14.049 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/269 kB Progress (3): 2.5 kB | 16/269 kB | 16/55 kB Progress (4): 2.5 kB | 16/269 kB | 16/55 kB | 16/41 kB Progress (5): 2.5 kB | 16/269 kB | 16/55 kB | 16/41 kB | 8.5 kB Progress (5): 2.5 kB | 33/269 kB | 16/55 kB | 16/41 kB | 8.5 kB Progress (5): 2.5 kB | 33/269 kB | 33/55 kB | 16/41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-14T11:06:14.049 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (4): 33/269 kB | 33/55 kB | 33/41 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:06:14.049 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (4): 49/269 kB | 33/55 kB | 33/41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-14T11:06:14.049 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 49/269 kB | 33/55 kB | 41 kB Progress (3): 49/269 kB | 49/55 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:06:14.049 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 65/269 kB | 49/55 kB | 41 kB Progress (3): 65/269 kB | 55 kB | 41 kB Progress (3): 82/269 kB | 55 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.6 MB/s) 2024-09-14T11:06:14.049 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 98/269 kB | 55 kB Progress (2): 114/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.1 MB/s) 2024-09-14T11:06:14.051 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 196/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 13 MB/s) 2024-09-14T11:06:14.068 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15/327 kB Progress (1): 31/327 kB Progress (1): 48/327 kB Progress (2): 48/327 kB | 16/587 kB Progress (2): 64/327 kB | 16/587 kB Progress (2): 64/327 kB | 33/587 kB Progress (2): 77/327 kB | 33/587 kB Progress (2): 77/327 kB | 49/587 kB Progress (2): 77/327 kB | 66/587 kB Progress (2): 93/327 kB | 66/587 kB Progress (2): 93/327 kB | 82/587 kB Progress (2): 110/327 kB | 82/587 kB Progress (2): 110/327 kB | 98/587 kB Progress (2): 110/327 kB | 115/587 kB Progress (2): 126/327 kB | 115/587 kB Progress (2): 126/327 kB | 131/587 kB Progress (2): 143/327 kB | 131/587 kB Progress (2): 143/327 kB | 147/587 kB Progress (2): 143/327 kB | 164/587 kB Progress (2): 159/327 kB | 164/587 kB Progress (2): 159/327 kB | 180/587 kB Progress (2): 175/327 kB | 180/587 kB Progress (2): 175/327 kB | 197/587 kB Progress (2): 175/327 kB | 213/587 kB Progress (2): 192/327 kB | 213/587 kB Progress (2): 192/327 kB | 229/587 kB Progress (2): 208/327 kB | 229/587 kB Progress (2): 208/327 kB | 246/587 kB Progress (2): 208/327 kB | 262/587 kB Progress (2): 225/327 kB | 262/587 kB Progress (2): 225/327 kB | 279/587 kB Progress (2): 241/327 kB | 279/587 kB Progress (2): 241/327 kB | 295/587 kB Progress (2): 241/327 kB | 311/587 kB Progress (2): 257/327 kB | 311/587 kB Progress (2): 257/327 kB | 328/587 kB Progress (2): 274/327 kB | 328/587 kB Progress (2): 274/327 kB | 344/587 kB Progress (2): 274/327 kB | 360/587 kB Progress (2): 290/327 kB | 360/587 kB Progress (2): 290/327 kB | 377/587 kB Progress (2): 306/327 kB | 377/587 kB Progress (2): 306/327 kB | 393/587 kB Progress (2): 306/327 kB | 410/587 kB Progress (2): 323/327 kB | 410/587 kB Progress (2): 327 kB | 410/587 kB Progress (2): 327 kB | 426/587 kB Progress (2): 327 kB | 442/587 kB Progress (2): 327 kB | 459/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.1 MB/s) 2024-09-14T11:06:14.071 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 475/587 kB Progress (1): 492/587 kB Progress (1): 508/587 kB Progress (1): 524/587 kB Progress (1): 541/587 kB Progress (1): 557/587 kB Progress (1): 573/587 kB Progress (1): 585/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-14T11:06:14.110 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:06:14.111 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:14.111 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:06:14.115 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:06:14.130 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:06:14.132 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:06:14.149 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 374 kB/s) 2024-09-14T11:06:14.152 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:06:14.166 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-14T11:06:14.168 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:06:14.182 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-14T11:06:14.185 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:06:14.199 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-14T11:06:14.201 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:06:14.215 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-14T11:06:14.217 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:06:14.232 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:06:14.235 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:06:14.250 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:06:14.267 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-14T11:06:14.270 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:06:14.285 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-14T11:06:14.287 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:06:14.301 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-14T11:06:14.304 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:06:14.318 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-14T11:06:14.320 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:06:14.336 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-14T11:06:14.338 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:06:14.353 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-14T11:06:14.355 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:06:14.370 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-14T11:06:14.372 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:06:14.389 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-09-14T11:06:14.394 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:06:14.409 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-14T11:06:14.414 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:06:14.429 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:06:14.436 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:06:14.452 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-14T11:06:14.455 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:06:14.470 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:06:14.474 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:06:14.490 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-14T11:06:14.497 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:06:14.513 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-14T11:06:14.516 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:06:14.532 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-14T11:06:14.542 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:06:14.557 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-14T11:06:14.558 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:06:14.558 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:06:14.558 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:06:14.559 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:06:14.559 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:06:14.574 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/27 kB Progress (3): 4.2 kB | 16/27 kB | 16/55 kB Progress (4): 4.2 kB | 16/27 kB | 16/55 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-09-14T11:06:14.574 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:06:14.577 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 16/27 kB | 33/55 kB | 16/334 kB Progress (4): 16/27 kB | 33/55 kB | 16/334 kB | 16/122 kB Progress (4): 16/27 kB | 33/55 kB | 33/334 kB | 16/122 kB Progress (4): 27 kB | 33/55 kB | 33/334 kB | 16/122 kB Progress (4): 27 kB | 49/55 kB | 33/334 kB | 16/122 kB Progress (4): 27 kB | 55 kB | 33/334 kB | 16/122 kB Progress (4): 27 kB | 55 kB | 33/334 kB | 33/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-14T11:06:14.577 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:06:14.577 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 55 kB | 49/334 kB | 33/122 kB Progress (3): 55 kB | 49/334 kB | 49/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.0 MB/s) 2024-09-14T11:06:14.577 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:06:14.577 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 65/334 kB | 49/122 kB Progress (2): 65/334 kB | 64/122 kB Progress (2): 82/334 kB | 64/122 kB Progress (2): 82/334 kB | 80/122 kB Progress (2): 82/334 kB | 96/122 kB Progress (2): 98/334 kB | 96/122 kB Progress (2): 98/334 kB | 113/122 kB Progress (2): 98/334 kB | 122 kB Progress (2): 114/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-14T11:06:14.581 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-14T11:06:14.589 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (2): 49/267 kB | 4.7 kB Progress (2): 66/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 155 kB/s) 2024-09-14T11:06:14.589 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 66/267 kB | 16/23 kB Progress (2): 82/267 kB | 16/23 kB Progress (2): 82/267 kB | 23 kB Progress (2): 98/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-14T11:06:14.593 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 112/267 kB Progress (1): 129/267 kB Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.6 MB/s) 2024-09-14T11:06:14.724 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:06:14.726 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:06:15.999 INFO:tasks.workunit.client.0.smithi148.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:06:15.999 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:15.999 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:06:16.003 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:06:16.003 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:16.003 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:06:16.011 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:06:16.011 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:06:16.241 INFO:tasks.workunit.client.0.smithi148.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:06:16.241 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:16.241 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:06:16.246 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:06:16.260 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-14T11:06:16.264 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:06:16.279 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-14T11:06:16.284 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:06:16.299 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-14T11:06:16.303 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:06:16.319 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 254 kB/s) 2024-09-14T11:06:16.324 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:06:16.339 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T11:06:16.344 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:06:16.359 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-14T11:06:16.363 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:06:16.377 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:06:16.381 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:06:16.395 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-14T11:06:16.398 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:06:16.413 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-09-14T11:06:16.417 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:06:16.432 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-14T11:06:16.436 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:06:16.450 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T11:06:16.454 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:06:16.469 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-14T11:06:16.470 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:06:16.485 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-14T11:06:16.487 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:06:16.502 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-14T11:06:16.505 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:06:16.520 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-14T11:06:16.524 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 577 kB/s) 2024-09-14T11:06:16.540 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:06:16.555 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-14T11:06:16.559 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:06:16.573 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-14T11:06:16.577 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:06:16.591 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T11:06:16.595 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:06:16.610 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-14T11:06:16.613 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:06:16.628 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-14T11:06:16.630 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:06:16.644 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:06:16.646 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:06:16.660 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-14T11:06:16.662 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:06:16.676 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-14T11:06:16.678 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:06:16.692 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-14T11:06:16.696 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:06:16.710 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-14T11:06:16.713 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:06:16.727 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 453 kB/s) 2024-09-14T11:06:16.729 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:06:16.743 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-14T11:06:16.747 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:06:16.760 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-14T11:06:16.763 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:06:16.778 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-14T11:06:16.784 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:06:16.799 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 189 kB/s) 2024-09-14T11:06:16.807 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:06:16.824 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-09-14T11:06:16.829 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 906 kB/s) 2024-09-14T11:06:16.850 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:06:16.866 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-14T11:06:16.869 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:06:16.883 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 319 kB/s) 2024-09-14T11:06:16.888 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:06:16.904 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-14T11:06:16.908 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:06:16.924 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.0 MB/s) 2024-09-14T11:06:16.931 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:06:16.947 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.1 MB/s) 2024-09-14T11:06:16.951 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:06:16.967 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-14T11:06:16.974 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:06:16.989 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-09-14T11:06:16.992 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:06:17.008 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 300 kB/s) 2024-09-14T11:06:17.014 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:06:17.029 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 494 kB/s) 2024-09-14T11:06:17.035 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:06:17.051 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 187 kB/s) 2024-09-14T11:06:17.058 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:06:17.074 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-14T11:06:17.081 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:06:17.097 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 128 kB/s) 2024-09-14T11:06:17.102 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:06:17.117 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 232 kB/s) 2024-09-14T11:06:17.123 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:06:17.139 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 684 kB/s) 2024-09-14T11:06:17.143 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:06:17.158 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 842 kB/s) 2024-09-14T11:06:17.162 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:06:17.178 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-14T11:06:17.183 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:06:17.199 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-14T11:06:17.202 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:06:17.218 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 407 kB/s) 2024-09-14T11:06:17.221 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:06:17.240 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 408 kB/s) 2024-09-14T11:06:17.243 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:06:17.258 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-14T11:06:17.263 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-09-14T11:06:17.287 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:06:17.303 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.3 MB/s) 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 177 kB/s) 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-14T11:06:17.438 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:06:17.454 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-14T11:06:17.466 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:06:17.494 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-09-14T11:06:17.494 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:06:17.495 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:06:17.495 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:06:17.496 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:06:17.496 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:06:17.513 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 64/171 kB Progress (1): 81/171 kB Progress (2): 81/171 kB | 14 kB Progress (2): 97/171 kB | 14 kB Progress (3): 97/171 kB | 14 kB | 16/26 kB Progress (3): 113/171 kB | 14 kB | 16/26 kB Progress (4): 113/171 kB | 14 kB | 16/26 kB | 8.2 kB Progress (4): 113/171 kB | 14 kB | 26 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-09-14T11:06:17.513 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 130/171 kB | 26 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:06:17.513 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (4): 130/171 kB | 26 kB | 8.2 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-14T11:06:17.513 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 146/171 kB | 26 kB | 16/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:06:17.513 INFO:tasks.workunit.client.0.smithi148.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-14T11:06:17.513 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:06:17.514 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 163/171 kB | 16/118 kB Progress (2): 163/171 kB | 33/118 kB Progress (2): 171 kB | 33/118 kB Progress (2): 171 kB | 49/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.5 MB/s) 2024-09-14T11:06:17.514 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:06:17.516 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 66/118 kB Progress (1): 82/118 kB Progress (1): 97/118 kB Progress (1): 113/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-14T11:06:17.516 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:06:17.529 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/146 kB Progress (2): 33/136 kB | 16/146 kB Progress (2): 33/136 kB | 33/146 kB Progress (3): 33/136 kB | 33/146 kB | 16/61 kB Progress (3): 49/136 kB | 33/146 kB | 16/61 kB Progress (3): 49/136 kB | 49/146 kB | 16/61 kB Progress (3): 49/136 kB | 49/146 kB | 33/61 kB Progress (4): 49/136 kB | 49/146 kB | 33/61 kB | 16/501 kB Progress (4): 65/136 kB | 49/146 kB | 33/61 kB | 16/501 kB Progress (4): 65/136 kB | 62/146 kB | 33/61 kB | 16/501 kB Progress (4): 65/136 kB | 62/146 kB | 49/61 kB | 16/501 kB Progress (4): 65/136 kB | 62/146 kB | 49/61 kB | 33/501 kB Progress (4): 65/136 kB | 62/146 kB | 61 kB | 33/501 kB Progress (4): 81/136 kB | 62/146 kB | 61 kB | 33/501 kB Progress (4): 81/136 kB | 79/146 kB | 61 kB | 33/501 kB Progress (4): 81/136 kB | 79/146 kB | 61 kB | 49/501 kB Progress (4): 98/136 kB | 79/146 kB | 61 kB | 49/501 kB Progress (4): 98/136 kB | 95/146 kB | 61 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-14T11:06:17.529 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:06:17.530 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 98/136 kB | 95/146 kB | 65/501 kB Progress (3): 114/136 kB | 95/146 kB | 65/501 kB Progress (3): 114/136 kB | 112/146 kB | 65/501 kB Progress (3): 114/136 kB | 112/146 kB | 81/501 kB Progress (3): 114/136 kB | 128/146 kB | 81/501 kB Progress (3): 130/136 kB | 128/146 kB | 81/501 kB Progress (3): 130/136 kB | 128/146 kB | 97/501 kB Progress (3): 136 kB | 128/146 kB | 97/501 kB Progress (3): 136 kB | 144/146 kB | 97/501 kB Progress (3): 136 kB | 146 kB | 97/501 kB Progress (3): 136 kB | 146 kB | 114/501 kB Progress (4): 136 kB | 146 kB | 114/501 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.0 MB/s) 2024-09-14T11:06:17.530 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:06:17.530 INFO:tasks.workunit.client.0.smithi148.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.3 MB/s) 2024-09-14T11:06:17.532 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 130/501 kB | 16/58 kB Progress (2): 130/501 kB | 33/58 kB Progress (2): 147/501 kB | 33/58 kB Progress (2): 163/501 kB | 33/58 kB Progress (2): 163/501 kB | 49/58 kB Progress (2): 179/501 kB | 49/58 kB Progress (2): 179/501 kB | 58 kB Progress (2): 196/501 kB | 58 kB Progress (2): 212/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-14T11:06:17.539 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 261/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-14T11:06:17.545 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/124 kB Progress (1): 32/124 kB Progress (1): 49/124 kB Progress (1): 65/124 kB Progress (1): 81/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (2): 114/124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-14T11:06:17.582 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 28 MB/s) 2024-09-14T11:06:17.737 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:17.738 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:06:17.742 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:06:17.757 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 280 kB/s) 2024-09-14T11:06:17.759 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:06:17.773 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:06:17.775 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:06:17.791 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.8 MB/s) 2024-09-14T11:06:17.794 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:06:17.809 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-14T11:06:17.813 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:06:17.827 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-14T11:06:17.830 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:06:17.845 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-14T11:06:17.851 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:06:17.866 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.0/6.0 kB Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 376 kB/s) 2024-09-14T11:06:17.872 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:06:17.887 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 391 kB/s) 2024-09-14T11:06:17.892 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:06:17.910 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.1 MB/s) 2024-09-14T11:06:17.918 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:06:17.933 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-14T11:06:17.938 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:06:17.953 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-14T11:06:17.957 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:06:17.972 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 514 kB/s) 2024-09-14T11:06:17.977 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:06:17.993 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.5 MB/s) 2024-09-14T11:06:18.009 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:06:18.026 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 15/36 kB Progress (1): 31/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.0 MB/s) 2024-09-14T11:06:18.027 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:06:18.027 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:06:18.028 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:06:18.028 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:06:18.028 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:06:18.047 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 0/1.0 MB Progress (2): 0/1.0 MB | 16/26 kB Progress (3): 0/1.0 MB | 16/26 kB | 16/211 kB Progress (3): 0/1.0 MB | 16/26 kB | 16/211 kB Progress (4): 0/1.0 MB | 16/26 kB | 16/211 kB | 16/58 kB Progress (4): 0/1.0 MB | 16/26 kB | 33/211 kB | 16/58 kB Progress (4): 0/1.0 MB | 16/26 kB | 33/211 kB | 16/58 kB Progress (5): 0/1.0 MB | 16/26 kB | 33/211 kB | 16/58 kB | 16/79 kB Progress (5): 0/1.0 MB | 16/26 kB | 33/211 kB | 33/58 kB | 16/79 kB Progress (5): 0/1.0 MB | 26 kB | 33/211 kB | 33/58 kB | 16/79 kB Progress (5): 0.1/1.0 MB | 26 kB | 33/211 kB | 33/58 kB | 16/79 kB Progress (5): 0.1/1.0 MB | 26 kB | 49/211 kB | 33/58 kB | 16/79 kB Progress (5): 0.1/1.0 MB | 26 kB | 49/211 kB | 33/58 kB | 33/79 kB Progress (5): 0.1/1.0 MB | 26 kB | 49/211 kB | 49/58 kB | 33/79 kB Progress (5): 0.1/1.0 MB | 26 kB | 49/211 kB | 49/58 kB | 33/79 kB Progress (5): 0.1/1.0 MB | 26 kB | 66/211 kB | 49/58 kB | 33/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.3 MB/s) 2024-09-14T11:06:18.047 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (4): 0.1/1.0 MB | 66/211 kB | 58 kB | 33/79 kB Progress (4): 0.1/1.0 MB | 66/211 kB | 58 kB | 49/79 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:06:18.048 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (4): 0.1/1.0 MB | 66/211 kB | 58 kB | 49/79 kB Progress (4): 0.1/1.0 MB | 82/211 kB | 58 kB | 49/79 kB Progress (4): 0.1/1.0 MB | 82/211 kB | 58 kB | 49/79 kB Progress (4): 0.1/1.0 MB | 82/211 kB | 58 kB | 66/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.9 MB/s) 2024-09-14T11:06:18.048 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:06:18.049 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 0.1/1.0 MB | 98/211 kB | 66/79 kB Progress (3): 0.1/1.0 MB | 98/211 kB | 66/79 kB Progress (3): 0.1/1.0 MB | 98/211 kB | 79 kB Progress (3): 0.1/1.0 MB | 112/211 kB | 79 kB Progress (3): 0.1/1.0 MB | 112/211 kB | 79 kB Progress (3): 0.1/1.0 MB | 128/211 kB | 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 3.6 MB/s) 2024-09-14T11:06:18.050 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 0.2/1.0 MB | 128/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.2/1.0 MB | 177/211 kB Progress (2): 0.2/1.0 MB | 177/211 kB Progress (2): 0.2/1.0 MB | 194/211 kB Progress (2): 0.2/1.0 MB | 194/211 kB Progress (2): 0.2/1.0 MB | 210/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.2 MB/s) 2024-09-14T11:06:18.064 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/267 kB Progress (3): 0.7/1.0 MB | 16/267 kB | 16/116 kB Progress (3): 0.7/1.0 MB | 33/267 kB | 16/116 kB Progress (3): 0.8/1.0 MB | 33/267 kB | 16/116 kB Progress (3): 0.8/1.0 MB | 33/267 kB | 33/116 kB Progress (3): 0.8/1.0 MB | 49/267 kB | 33/116 kB Progress (3): 0.8/1.0 MB | 49/267 kB | 33/116 kB Progress (3): 0.8/1.0 MB | 49/267 kB | 49/116 kB Progress (3): 0.8/1.0 MB | 66/267 kB | 49/116 kB Progress (3): 0.8/1.0 MB | 66/267 kB | 49/116 kB Progress (3): 0.8/1.0 MB | 82/267 kB | 49/116 kB Progress (3): 0.8/1.0 MB | 82/267 kB | 66/116 kB Progress (3): 0.8/1.0 MB | 98/267 kB | 66/116 kB Progress (3): 0.8/1.0 MB | 98/267 kB | 66/116 kB Progress (3): 0.8/1.0 MB | 98/267 kB | 82/116 kB Progress (3): 0.8/1.0 MB | 112/267 kB | 82/116 kB Progress (3): 0.8/1.0 MB | 112/267 kB | 82/116 kB Progress (3): 0.8/1.0 MB | 112/267 kB | 98/116 kB Progress (3): 0.8/1.0 MB | 128/267 kB | 98/116 kB Progress (3): 0.8/1.0 MB | 145/267 kB | 98/116 kB Progress (3): 0.8/1.0 MB | 145/267 kB | 115/116 kB Progress (3): 0.8/1.0 MB | 145/267 kB | 115/116 kB Progress (3): 0.8/1.0 MB | 145/267 kB | 116 kB Progress (3): 0.8/1.0 MB | 161/267 kB | 116 kB Progress (3): 0.9/1.0 MB | 161/267 kB | 116 kB Progress (3): 0.9/1.0 MB | 178/267 kB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.3 MB/s) 2024-09-14T11:06:18.065 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 0.9/1.0 MB | 194/267 kB Progress (2): 0.9/1.0 MB | 194/267 kB Progress (2): 0.9/1.0 MB | 210/267 kB Progress (2): 0.9/1.0 MB | 210/267 kB Progress (2): 0.9/1.0 MB | 227/267 kB Progress (2): 0.9/1.0 MB | 243/267 kB Progress (2): 0.9/1.0 MB | 243/267 kB Progress (2): 0.9/1.0 MB | 260/267 kB Progress (2): 0.9/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.2 MB/s) 2024-09-14T11:06:18.068 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 25 MB/s) 2024-09-14T11:06:18.243 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:06:18.272 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:06:18.272 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:06:18.272 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:06:18.273 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Total time: 7.646 s 2024-09-14T11:06:18.273 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Finished at: 2024-09-14T11:06:18Z 2024-09-14T11:06:18.273 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:06:18.313 INFO:tasks.workunit.client.0.smithi148.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:06:18.318 INFO:tasks.workunit.client.0.smithi148.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:06:19.483 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Scanning for projects... 2024-09-14T11:06:19.565 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:19.565 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:06:19.565 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:06:19.565 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] from pom.xml 2024-09-14T11:06:19.565 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:06:19.837 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:19.837 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:06:19.972 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:06:19.973 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:19.973 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:06:20.073 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:06:20.073 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:20.073 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:06:20.075 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:06:20.075 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:20.075 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:06:20.080 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:06:20.080 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:20.080 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:06:20.284 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:06:20.489 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:06:20.679 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-14T11:06:20.688 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:06:20.705 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-14T11:06:20.710 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:06:20.727 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T11:06:20.732 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:06:20.748 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 178 kB/s) 2024-09-14T11:06:20.751 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:06:20.767 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-14T11:06:20.769 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:06:20.784 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 112 kB/s) 2024-09-14T11:06:20.787 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:06:20.803 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-14T11:06:20.808 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:06:20.831 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.2/27 kB Progress (1): 9.6/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-14T11:06:20.831 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:06:20.831 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:06:20.832 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:06:20.835 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:06:20.836 INFO:tasks.workunit.client.0.smithi148.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:06:20.877 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 61/169 kB Progress (1): 78/169 kB Progress (1): 94/169 kB Progress (1): 111/169 kB Progress (1): 127/169 kB Progress (1): 143/169 kB Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.6 MB/s) 2024-09-14T11:06:20.894 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 1.4/189 kB Progress (2): 1.4/189 kB | 1.4/103 kB Progress (2): 2.8/189 kB | 1.4/103 kB Progress (3): 2.8/189 kB | 1.4/103 kB | 1.4/7.7 kB Progress (3): 4.1/189 kB | 1.4/103 kB | 1.4/7.7 kB Progress (4): 4.1/189 kB | 1.4/103 kB | 1.4/7.7 kB | 1.4/18 kB Progress (4): 4.1/189 kB | 2.8/103 kB | 1.4/7.7 kB | 1.4/18 kB Progress (4): 4.1/189 kB | 2.8/103 kB | 1.4/7.7 kB | 2.8/18 kB Progress (4): 5.5/189 kB | 2.8/103 kB | 1.4/7.7 kB | 2.8/18 kB Progress (4): 5.5/189 kB | 2.8/103 kB | 2.8/7.7 kB | 2.8/18 kB Progress (4): 6.9/189 kB | 2.8/103 kB | 2.8/7.7 kB | 2.8/18 kB Progress (4): 6.9/189 kB | 2.8/103 kB | 2.8/7.7 kB | 4.1/18 kB Progress (4): 6.9/189 kB | 4.1/103 kB | 2.8/7.7 kB | 4.1/18 kB Progress (4): 6.9/189 kB | 4.1/103 kB | 2.8/7.7 kB | 5.5/18 kB Progress (4): 8.3/189 kB | 4.1/103 kB | 2.8/7.7 kB | 5.5/18 kB Progress (4): 8.3/189 kB | 4.1/103 kB | 4.1/7.7 kB | 5.5/18 kB Progress (4): 9.7/189 kB | 4.1/103 kB | 4.1/7.7 kB | 5.5/18 kB Progress (4): 9.7/189 kB | 4.1/103 kB | 4.1/7.7 kB | 6.9/18 kB Progress (4): 9.7/189 kB | 5.5/103 kB | 4.1/7.7 kB | 6.9/18 kB Progress (4): 9.7/189 kB | 5.5/103 kB | 4.1/7.7 kB | 8.3/18 kB Progress (4): 11/189 kB | 5.5/103 kB | 4.1/7.7 kB | 8.3/18 kB Progress (4): 11/189 kB | 5.5/103 kB | 5.5/7.7 kB | 8.3/18 kB Progress (4): 12/189 kB | 5.5/103 kB | 5.5/7.7 kB | 8.3/18 kB Progress (4): 12/189 kB | 5.5/103 kB | 5.5/7.7 kB | 9.7/18 kB Progress (4): 12/189 kB | 6.9/103 kB | 5.5/7.7 kB | 9.7/18 kB Progress (4): 12/189 kB | 6.9/103 kB | 5.5/7.7 kB | 11/18 kB Progress (4): 14/189 kB | 6.9/103 kB | 5.5/7.7 kB | 11/18 kB Progress (4): 14/189 kB | 6.9/103 kB | 6.9/7.7 kB | 11/18 kB Progress (4): 15/189 kB | 6.9/103 kB | 6.9/7.7 kB | 11/18 kB Progress (4): 15/189 kB | 6.9/103 kB | 6.9/7.7 kB | 12/18 kB Progress (4): 15/189 kB | 8.3/103 kB | 6.9/7.7 kB | 12/18 kB Progress (4): 15/189 kB | 8.3/103 kB | 6.9/7.7 kB | 14/18 kB Progress (4): 16/189 kB | 8.3/103 kB | 6.9/7.7 kB | 14/18 kB Progress (4): 16/189 kB | 8.3/103 kB | 7.7 kB | 14/18 kB Progress (4): 16/189 kB | 8.3/103 kB | 7.7 kB | 15/18 kB Progress (4): 16/189 kB | 9.7/103 kB | 7.7 kB | 15/18 kB Progress (4): 16/189 kB | 9.7/103 kB | 7.7 kB | 17/18 kB Progress (4): 33/189 kB | 9.7/103 kB | 7.7 kB | 17/18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 121 kB/s) 2024-09-14T11:06:20.895 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (3): 33/189 kB | 9.7/103 kB | 18 kB Progress (3): 33/189 kB | 11/103 kB | 18 kB Progress (3): 49/189 kB | 11/103 kB | 18 kB Progress (3): 49/189 kB | 12/103 kB | 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 266 kB/s) 2024-09-14T11:06:20.916 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (2): 49/189 kB | 14/103 kB Progress (2): 49/189 kB | 15/103 kB Progress (2): 49/189 kB | 16/103 kB Progress (2): 66/189 kB | 16/103 kB Progress (2): 66/189 kB | 18/103 kB Progress (2): 66/189 kB | 19/103 kB Progress (2): 66/189 kB | 21/103 kB Progress (2): 66/189 kB | 22/103 kB Progress (2): 66/189 kB | 23/103 kB Progress (2): 66/189 kB | 25/103 kB Progress (2): 66/189 kB | 26/103 kB Progress (2): 66/189 kB | 27/103 kB Progress (2): 66/189 kB | 29/103 kB Progress (2): 66/189 kB | 30/103 kB Progress (2): 66/189 kB | 32/103 kB Progress (2): 66/189 kB | 33/103 kB Progress (2): 66/189 kB | 34/103 kB Progress (2): 66/189 kB | 36/103 kB Progress (2): 66/189 kB | 37/103 kB Progress (2): 66/189 kB | 38/103 kB Progress (2): 66/189 kB | 40/103 kB Progress (2): 66/189 kB | 41/103 kB Progress (2): 66/189 kB | 43/103 kB Progress (2): 66/189 kB | 44/103 kB Progress (2): 66/189 kB | 45/103 kB Progress (2): 66/189 kB | 47/103 kB Progress (2): 66/189 kB | 48/103 kB Progress (2): 66/189 kB | 49/103 kB Progress (2): 66/189 kB | 51/103 kB Progress (2): 66/189 kB | 52/103 kB Progress (2): 66/189 kB | 54/103 kB Progress (2): 66/189 kB | 55/103 kB Progress (2): 66/189 kB | 56/103 kB Progress (2): 66/189 kB | 58/103 kB Progress (2): 66/189 kB | 59/103 kB Progress (2): 66/189 kB | 61/103 kB Progress (2): 66/189 kB | 62/103 kB Progress (2): 66/189 kB | 62/103 kB Progress (2): 79/189 kB | 62/103 kB Progress (2): 79/189 kB | 79/103 kB Progress (2): 96/189 kB | 79/103 kB Progress (2): 112/189 kB | 79/103 kB Progress (2): 128/189 kB | 79/103 kB Progress (2): 145/189 kB | 79/103 kB Progress (2): 145/189 kB | 95/103 kB Progress (2): 145/189 kB | 103 kB Progress (2): 161/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-14T11:06:20.918 INFO:tasks.workunit.client.0.smithi148.stdout:Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-14T11:06:20.932 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:06:20.932 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:06:20.932 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] T E S T S 2024-09-14T11:06:20.933 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:06:21.543 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:06:21.614 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjects.java: starting test run: 2024-09-14T11:06:21.614 INFO:tasks.workunit.client.0.smithi148.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:06:21.614 INFO:tasks.workunit.client.0.smithi148.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:06:21.614 INFO:tasks.workunit.client.0.smithi148.stdout: EndpointUrl=https://smithi148.front.sepia.ceph.com:443 2024-09-14T11:06:21.615 INFO:tasks.workunit.client.0.smithi148.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:06:21.812 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Environment Variables Read 2024-09-14T11:06:22.113 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:06:22.113 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Generating File 2024-09-14T11:06:22.113 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: File Generated 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Generating File 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: File Generated 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Generating File 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: File Generated 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Generating File 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: File Generated 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Generating File 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: File Generated 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Generating File 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: File Generated 2024-09-14T11:06:22.114 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Generated Big Files 2024-09-14T11:06:22.717 INFO:tasks.workunit.client.0.smithi148.stdout:HeadBucketResponse() 2024-09-14T11:06:22.717 INFO:tasks.workunit.client.0.smithi148.stdout:sheik is ready 2024-09-14T11:06:22.717 INFO:tasks.workunit.client.0.smithi148.stdout:DEBUG: Test Bucket Created 2024-09-14T11:06:22.817 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:06:23.219 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:06:23.419 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:06:23.720 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:06:24.221 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:06:24.522 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:06:25.023 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:06:25.424 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:06:26.326 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:06:27.629 INFO:tasks.workunit.client.0.smithi148.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:06:33.843 INFO:tasks.workunit.client.0.smithi148.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:06:40.456 INFO:tasks.workunit.client.0.smithi148.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:07:47.083 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-0b 2024-09-14T11:07:47.084 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-8b 2024-09-14T11:07:47.084 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-200b 2024-09-14T11:07:47.085 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-21983b 2024-09-14T11:07:47.086 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-5519b 2024-09-14T11:07:47.088 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-204329b 2024-09-14T11:07:47.089 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-256k 2024-09-14T11:07:47.090 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-1m 2024-09-14T11:07:47.091 INFO:tasks.workunit.client.0.smithi148.stdout:arg: file-1038757b 2024-09-14T11:07:47.155 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:07:47.355 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:47.456 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:07:47.556 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:47.656 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:07:47.856 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:47.957 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:07:48.157 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:48.257 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:07:48.457 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:48.558 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:07:48.960 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:49.158 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:07:49.459 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:49.659 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:07:50.460 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:50.760 INFO:tasks.workunit.client.0.smithi148.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:07:51.662 INFO:tasks.workunit.client.0.smithi148.stdout:PutObjectResponse 2024-09-14T11:07:51.962 INFO:tasks.workunit.client.0.smithi148.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:07:56.768 INFO:tasks.workunit.client.0.smithi148.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:08:05.779 INFO:tasks.workunit.client.0.smithi148.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:09:31.915 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 190.3 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:09:31.948 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:09:31.948 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Results: 2024-09-14T11:09:31.948 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:09:31.949 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:09:31.949 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] 2024-09-14T11:09:31.950 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:09:31.950 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:09:31.951 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:09:31.951 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Total time: 03:12 min 2024-09-14T11:09:31.951 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] Finished at: 2024-09-14T11:09:31Z 2024-09-14T11:09:31.952 INFO:tasks.workunit.client.0.smithi148.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:09:31.971 INFO:tasks.workunit.client.0.smithi148.stderr:+ exit 2024-09-14T11:09:31.971 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:09:31.971 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:09:32.026 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:09:32.027 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:09:32.390 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:32.390 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:09:32.404 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:09:32.404 DEBUG:teuthology.orchestra.run.smithi148:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:09:32.449 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:09:32.449 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:09:32.459 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:09:32.459 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:09:32.459 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:09:32.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:09:32.497 INFO:teuthology.orchestra.run.smithi148.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:09:32.498 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:09:32.545 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:09:32.545 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:09:32.593 INFO:tasks.workunit:timeout=3h 2024-09-14T11:09:32.593 INFO:tasks.workunit:cleanup=True 2024-09-14T11:09:32.594 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:09:32.643 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:10:26.161 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:10:26.161 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:10:26.161 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:10:26.161 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:10:26.162 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-09-14T11:10:26.163 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:10:26.163 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:10:26.163 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:10:26.163 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:10:26.163 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:10:26.207 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:10:26.209 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:10:26.210 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:10:26.264 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:10:26.319 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:10:26.366 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:10:26.368 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:10:26.368 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:10:26.410 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:10:26.413 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T11:10:26.413 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:10:26.462 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:10:26.463 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:10:26.463 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:10:26.517 INFO:tasks.workunit.client.0.smithi148.stdout:INFO: fully qualified domain name: smithi148.front.sepia.ceph.com 2024-09-14T11:10:26.517 INFO:tasks.workunit.client.0.smithi148.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:10:26.517 INFO:tasks.workunit.client.0.smithi148.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:10:29.744 INFO:tasks.workunit.client.0.smithi148.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:10:29.943 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting pip 2024-09-14T11:10:29.949 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:10:29.983 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: pip 2024-09-14T11:10:29.983 INFO:tasks.workunit.client.0.smithi148.stdout: Attempting uninstall: pip 2024-09-14T11:10:29.983 INFO:tasks.workunit.client.0.smithi148.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:10:30.243 INFO:tasks.workunit.client.0.smithi148.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:10:30.249 INFO:tasks.workunit.client.0.smithi148.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:10:30.984 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed pip-24.2 2024-09-14T11:10:32.021 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting boto3 2024-09-14T11:10:32.022 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:10:32.574 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:10:32.575 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:10:32.624 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:10:32.625 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:10:32.670 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:10:32.672 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:10:32.727 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:10:32.729 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:10:32.838 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:10:32.839 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:10:33.027 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:10:33.028 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:10:33.032 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:10:33.033 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:10:33.043 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:10:33.044 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:10:33.045 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:10:33.046 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:10:33.047 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:10:33.115 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:10:34.133 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:10:34.492 INFO:tasks.workunit.client.0.smithi148.stdout:INFO: creating user 2024-09-14T11:10:34.628 INFO:tasks.workunit.client.0.smithi148.stdout:{ 2024-09-14T11:10:34.628 INFO:tasks.workunit.client.0.smithi148.stdout: "user_id": "testid", 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "display_name": "M. Tester", 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "email": "tester@ceph.com", 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "suspended": 0, 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "subusers": [], 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "keys": [ 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: { 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "user": "testid", 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "active": true, 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: "create_date": "2024-09-14T11:10:34.623740Z" 2024-09-14T11:10:34.629 INFO:tasks.workunit.client.0.smithi148.stdout: } 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: ], 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "swift_keys": [], 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "caps": [], 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "default_placement": "", 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "placement_tags": [], 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "bucket_quota": { 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "enabled": false, 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size": -1, 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:10:34.630 INFO:tasks.workunit.client.0.smithi148.stdout: "max_objects": -1 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "user_quota": { 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "enabled": false, 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size": -1, 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "max_objects": -1 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: }, 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "type": "rgw", 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "account_id": "", 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "path": "/", 2024-09-14T11:10:34.631 INFO:tasks.workunit.client.0.smithi148.stdout: "create_date": "2024-09-14T11:10:34.623727Z", 2024-09-14T11:10:34.632 INFO:tasks.workunit.client.0.smithi148.stdout: "tags": [], 2024-09-14T11:10:34.632 INFO:tasks.workunit.client.0.smithi148.stdout: "group_ids": [] 2024-09-14T11:10:34.632 INFO:tasks.workunit.client.0.smithi148.stdout:} 2024-09-14T11:10:34.632 INFO:tasks.workunit.client.0.smithi148.stdout: 2024-09-14T11:10:36.802 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:36.802 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:36.949 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:36.950 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:37.054 INFO:tasks.workunit.client.0.smithi148.stderr:5+0 records in 2024-09-14T11:10:37.055 INFO:tasks.workunit.client.0.smithi148.stderr:5+0 records out 2024-09-14T11:10:37.055 INFO:tasks.workunit.client.0.smithi148.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0230835 s, 227 MB/s 2024-09-14T11:10:37.060 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:37.060 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:37.208 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:37.208 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:39.358 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.359 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:41.668 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:41.668 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:43.899 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:43.899 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:46.176 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:46.176 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:48.383 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:48.383 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:50.638 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:50.638 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:52.861 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:52.862 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:55.144 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:55.145 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:57.334 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:57.334 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:10:59.670 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:59.670 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:11:01.904 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:11:01.904 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:11:04.150 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:11:04.150 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:11:06.394 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:11:06.395 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:bucket nams is reupload-bkt-105471 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:endpoint is https://smithi148.front.sepia.ceph.com:443 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:start UploadId=2~RQApJ2QUlS52XMpk3AJ0-iViR2iB9HY 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:phase 1 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:phase 1 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 2} 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.606 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.607 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.607 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.607 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.607 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.607 INFO:tasks.workunit.client.0.smithi148.stdout:phase 2 uploaded part {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1} 2024-09-14T11:11:06.607 INFO:tasks.workunit.client.0.smithi148.stdout:aborting multipart upload, parts=[{'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 1}, {'ETag': '"435b25c9444c89f37e7bd2d67fc56452"', 'PartNumber': 2}] 2024-09-14T11:11:07.957 INFO:tasks.workunit.client.0.smithi148.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:11:08.041 INFO:tasks.workunit.client.0.smithi148.stdout:rados ls: 2024-09-14T11:11:08.060 INFO:tasks.workunit.client.0.smithi148.stdout:== PASSED == 2024-09-14T11:11:08.061 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:11:08.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:11:08.113 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:11:08.194 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:11:08.622 DEBUG:teuthology.parallel:result is None 2024-09-14T11:11:08.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:08.634 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:08.634 DEBUG:teuthology.orchestra.run.smithi148:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:08.686 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:08.687 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:11:08.708 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:11:08.708 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:11:08.709 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:11:08.709 DEBUG:teuthology.orchestra.run.smithi148:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:11:08.734 INFO:teuthology.orchestra.run.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:11:08.791 INFO:teuthology.orchestra.run.smithi148.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:11:08.792 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:11:08.794 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:11:08.794 DEBUG:teuthology.orchestra.run.smithi148:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:11:08.843 INFO:teuthology.orchestra.run.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:11:09.028 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:11:09.028 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:11:09.029 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key WLPRBXUIJTLFWRANGYRT --secret JuJgT+CYhxoQORYQso3/ofGzUapSIUaz/14VM5L1tVzt/wJKJPNVCQ== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:11:09.118 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:09.118 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:09.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.163+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.163+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.163+0000 7fdcec9d89c0 20 realm 2024-09-14T11:11:09.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.163+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.163+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.163+0000 7fdcec9d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:09.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.163+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.167+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.167+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.167+0000 7fdcec9d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:09.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.167+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.167+0000 7fdcec9d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:09.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.167+0000 7fdcec9d89c0 20 searching for the correct realm 2024-09-14T11:11:09.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.175+0000 7fdcea4de640 0 -- 172.21.15.148:0/1940042167 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fdce40a9070 msgr2=0x7fdce4109150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:09.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.179+0000 7fdcea4de640 0 -- 172.21.15.148:0/1940042167 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fdcdc03e910 msgr2=0x7fdcdc0303f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:09.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:11:09.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:09.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:09.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:09.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:11:09.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:09.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:09.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 zone default found 2024-09-14T11:11:09.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 4 Realm: () 2024-09-14T11:11:09.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:11:09.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:11:09.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:09.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 zonegroup default 2024-09-14T11:11:09.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.187+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.191+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.191+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.191+0000 7fdcec9d89c0 20 started sync module instance, tier type = 2024-09-14T11:11:09.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.191+0000 7fdcec9d89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:11:09.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.207+0000 7fdcec9d89c0 20 add_watcher() i=0 2024-09-14T11:11:09.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.207+0000 7fdcec9d89c0 20 add_watcher() i=1 2024-09-14T11:11:09.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.207+0000 7fdcec9d89c0 20 add_watcher() i=2 2024-09-14T11:11:09.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.207+0000 7fdcec9d89c0 20 add_watcher() i=3 2024-09-14T11:11:09.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.207+0000 7fdcec9d89c0 20 add_watcher() i=4 2024-09-14T11:11:09.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.207+0000 7fdcec9d89c0 20 add_watcher() i=5 2024-09-14T11:11:09.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.207+0000 7fdcec9d89c0 20 add_watcher() i=6 2024-09-14T11:11:09.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.211+0000 7fdcec9d89c0 20 add_watcher() i=7 2024-09-14T11:11:09.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.211+0000 7fdcec9d89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:09.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdba0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:09.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:09.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:09.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 5 note: GC not initialized 2024-09-14T11:11:09.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdb1b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:09.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:11:09.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 20 Filter name: none 2024-09-14T11:11:09.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdb197fa640 20 reqs_thread_entry: start 2024-09-14T11:11:09.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:11:09.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:11:09.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:11:09.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:11:09.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.215+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:11:09.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:11:09.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 cache get: name=default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT : miss 2024-09-14T11:11:09.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 cache put: name=default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT info.flags=0x0 2024-09-14T11:11:09.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 adding default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT to cache LRU end 2024-09-14T11:11:09.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 cache get: name=default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT : hit (negative entry) 2024-09-14T11:11:09.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 cache get: name=default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT : hit (negative entry) 2024-09-14T11:11:09.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:11:09.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:11:09.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdcec9d89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:11:09.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdbcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562419 cookie 94233924434080 notifier 5681 bl.length()=675 2024-09-14T11:11:09.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdbcdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:11:09.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.219+0000 7fdbcdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:11:09.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.223+0000 7fdcec9d89c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:11:09.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.223+0000 7fdcec9d89c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:11:09.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.223+0000 7fdcec9d89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:11:09.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdbcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562379 cookie 94233924430304 notifier 5681 bl.length()=202 2024-09-14T11:11:09.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdbcdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:11:09.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdbcdffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:11:09.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdcec9d89c0 10 cache put: name=default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT info.flags=0x7 2024-09-14T11:11:09.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdcec9d89c0 10 moving default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT to cache LRU end 2024-09-14T11:11:09.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdcec9d89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:WLPRBXUIJTLFWRANGYRT, ofs0, ns] 2024-09-14T11:11:09.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdbcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562420 cookie 94233924434080 notifier 5681 bl.length()=190 2024-09-14T11:11:09.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdbcdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT info.flags=0x7 2024-09-14T11:11:09.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.227+0000 7fdbcdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WLPRBXUIJTLFWRANGYRT to cache LRU end 2024-09-14T11:11:09.228 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:11:09.228 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:11:09.228 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:11:09.228 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:11:09.228 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:11:09.228 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:11:09.228 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:11:09.228 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "ragweed.client.0", 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "WLPRBXUIJTLFWRANGYRT", 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "JuJgT+CYhxoQORYQso3/ofGzUapSIUaz/14VM5L1tVzt/wJKJPNVCQ==", 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:11:09.222458Z" 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:11:09.229 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:11:09.230 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "rgw", 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "", 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:11:09.222422Z", 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:11:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.231+0000 7fdba0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.235+0000 7fdcec9d89c0 20 remove_watcher() i=0 2024-09-14T11:11:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.235+0000 7fdcec9d89c0 2 removed watcher, disabling cache 2024-09-14T11:11:09.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.239+0000 7fdcec9d89c0 20 remove_watcher() i=1 2024-09-14T11:11:09.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.239+0000 7fdcec9d89c0 20 remove_watcher() i=2 2024-09-14T11:11:09.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.243+0000 7fdcec9d89c0 20 remove_watcher() i=3 2024-09-14T11:11:09.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.243+0000 7fdcec9d89c0 20 remove_watcher() i=4 2024-09-14T11:11:09.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.247+0000 7fdcec9d89c0 20 remove_watcher() i=5 2024-09-14T11:11:09.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.251+0000 7fdcec9d89c0 20 remove_watcher() i=6 2024-09-14T11:11:09.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.251+0000 7fdcec9d89c0 20 remove_watcher() i=7 2024-09-14T11:11:09.267 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:11:09.267 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key RTOTXXGVKKHFMEMAPYYI --secret BsMP7ydmQUZRPa6I0UTQPaqYg/t/rCoR2YY6KNijnL4YtycIWQMKLw== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:11:09.312 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:09.312 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:09.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.355+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 realm 2024-09-14T11:11:09.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:09.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:09.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:09.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.359+0000 7f4c4c6a89c0 20 searching for the correct realm 2024-09-14T11:11:09.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.363+0000 7f4c4a1ae640 0 -- 172.21.15.148:0/187337729 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f4c3c0e0040 msgr2=0x7f4c3c0d2920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:09.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.371+0000 7f4c4a1ae640 0 -- 172.21.15.148:0/187337729 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f4c44020040 msgr2=0x7f4c44064a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:09.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:09.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:11:09.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:09.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:09.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:09.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:11:09.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:09.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:09.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 zone default found 2024-09-14T11:11:09.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 4 Realm: () 2024-09-14T11:11:09.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:11:09.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:11:09.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:09.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 zonegroup default 2024-09-14T11:11:09.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.590+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.594+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.594+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.594+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.594+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.594+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.594+0000 7f4c4c6a89c0 20 started sync module instance, tier type = 2024-09-14T11:11:09.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.594+0000 7f4c4c6a89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:11:09.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 20 add_watcher() i=0 2024-09-14T11:11:09.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 20 add_watcher() i=1 2024-09-14T11:11:09.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 20 add_watcher() i=2 2024-09-14T11:11:09.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 20 add_watcher() i=3 2024-09-14T11:11:09.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 20 add_watcher() i=4 2024-09-14T11:11:09.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 20 add_watcher() i=5 2024-09-14T11:11:09.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 20 add_watcher() i=6 2024-09-14T11:11:09.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 20 add_watcher() i=7 2024-09-14T11:11:09.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.618+0000 7f4c4c6a89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:09.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.622+0000 7f4b00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:09.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.622+0000 7f4c4c6a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:09.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.622+0000 7f4c4c6a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:09.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.622+0000 7f4c4c6a89c0 5 note: GC not initialized 2024-09-14T11:11:09.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.622+0000 7f4a7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:09.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:11:09.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 20 Filter name: none 2024-09-14T11:11:09.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4a797fa640 20 reqs_thread_entry: start 2024-09-14T11:11:09.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:11:09.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:11:09.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:11:09.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:11:09.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:11:09.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:11:09.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 cache get: name=default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI : miss 2024-09-14T11:11:09.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 cache put: name=default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI info.flags=0x0 2024-09-14T11:11:09.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 adding default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI to cache LRU end 2024-09-14T11:11:09.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 cache get: name=default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI : hit (negative entry) 2024-09-14T11:11:09.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.626+0000 7f4c4c6a89c0 10 cache get: name=default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI : hit (negative entry) 2024-09-14T11:11:09.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.630+0000 7f4c4c6a89c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:11:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.630+0000 7f4c4c6a89c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:11:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.630+0000 7f4c4c6a89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:11:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.630+0000 7f4b2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562380 cookie 94771349709488 notifier 5994 bl.length()=675 2024-09-14T11:11:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.630+0000 7f4b2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:11:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.630+0000 7f4b2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:11:09.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.634+0000 7f4c4c6a89c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:11:09.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.634+0000 7f4c4c6a89c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:11:09.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.634+0000 7f4c4c6a89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:11:09.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.634+0000 7f4b2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562421 cookie 94771349715920 notifier 5994 bl.length()=202 2024-09-14T11:11:09.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.634+0000 7f4b2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:11:09.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.634+0000 7f4b2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:11:09.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.638+0000 7f4c4c6a89c0 10 cache put: name=default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI info.flags=0x7 2024-09-14T11:11:09.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.638+0000 7f4c4c6a89c0 10 moving default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI to cache LRU end 2024-09-14T11:11:09.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.638+0000 7f4c4c6a89c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:RTOTXXGVKKHFMEMAPYYI, ofs0, ns] 2024-09-14T11:11:09.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.638+0000 7f4b2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562384 cookie 94771349704976 notifier 5994 bl.length()=190 2024-09-14T11:11:09.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.638+0000 7f4b2d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI info.flags=0x7 2024-09-14T11:11:09.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.638+0000 7f4b2d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RTOTXXGVKKHFMEMAPYYI to cache LRU end 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:11:09.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "sysuser.client.0", 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "RTOTXXGVKKHFMEMAPYYI", 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "BsMP7ydmQUZRPa6I0UTQPaqYg/t/rCoR2YY6KNijnL4YtycIWQMKLw==", 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:11:09.632332Z" 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "system": true, 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:11:09.640 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:11:09.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "rgw", 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "", 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:11:09.632287Z", 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:11:09.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.642+0000 7f4b00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:09.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.646+0000 7f4c4c6a89c0 20 remove_watcher() i=0 2024-09-14T11:11:09.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.646+0000 7f4c4c6a89c0 2 removed watcher, disabling cache 2024-09-14T11:11:09.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.650+0000 7f4c4c6a89c0 20 remove_watcher() i=1 2024-09-14T11:11:09.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.650+0000 7f4c4c6a89c0 20 remove_watcher() i=2 2024-09-14T11:11:09.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.654+0000 7f4c4c6a89c0 20 remove_watcher() i=3 2024-09-14T11:11:09.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.658+0000 7f4c4c6a89c0 20 remove_watcher() i=4 2024-09-14T11:11:09.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.658+0000 7f4c4c6a89c0 20 remove_watcher() i=5 2024-09-14T11:11:09.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.662+0000 7f4c4c6a89c0 20 remove_watcher() i=6 2024-09-14T11:11:09.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:11:09.662+0000 7f4c4c6a89c0 20 remove_watcher() i=7 2024-09-14T11:11:09.677 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:11:09.678 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T11:11:09.678 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:11:09.683 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:11:09.684 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T11:11:09.684 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:11:09.734 DEBUG:teuthology.orchestra.run.smithi148:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:11:09.924 INFO:teuthology.orchestra.run.smithi148.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:11:10.109 INFO:teuthology.orchestra.run.smithi148.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:11:10.705 INFO:teuthology.orchestra.run.smithi148.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:11:13.485 INFO:teuthology.orchestra.run.smithi148.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:11:17.820 INFO:teuthology.orchestra.run.smithi148.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=d5bd3af82e4db8540d6a4e039e80de12511f6a4a35b7cd543ef51b3e1589ddff,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-14T11:11:17.820 INFO:teuthology.orchestra.run.smithi148.stdout:py run-test-pre: PYTHONHASHSEED='639110390' 2024-09-14T11:11:17.820 INFO:teuthology.orchestra.run.smithi148.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:11:17.993 INFO:teuthology.orchestra.run.smithi148.stdout:============================= test session starts ============================== 2024-09-14T11:11:17.993 INFO:teuthology.orchestra.run.smithi148.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:11:17.993 INFO:teuthology.orchestra.run.smithi148.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:11:17.993 INFO:teuthology.orchestra.run.smithi148.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-14T11:11:18.146 INFO:teuthology.orchestra.run.smithi148.stdout:collecting ... collected 9 items 2024-09-14T11:11:18.146 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:11:29.526 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:11:41.441 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:11:51.337 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:12:03.487 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:12:17.439 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:12:42.526 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:13:06.762 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:13:30.044 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout:=============================== warnings summary =============================== 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout: import imp 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-14T11:14:13.978 INFO:teuthology.orchestra.run.smithi148.stdout:=================== 9 passed, 1 warning in 175.98s (0:02:55) =================== 2024-09-14T11:14:14.031 INFO:teuthology.orchestra.run.smithi148.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:14:14.032 INFO:teuthology.orchestra.run.smithi148.stdout: py: commands succeeded 2024-09-14T11:14:14.032 INFO:teuthology.orchestra.run.smithi148.stdout: congratulations :) 2024-09-14T11:14:14.054 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:14:14.054 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:14:14.060 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:14:14.138 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:14.138 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:14.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.181+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 realm 2024-09-14T11:14:14.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:14.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:14.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.185+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.189+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:14.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.189+0000 7feaa02679c0 20 searching for the correct realm 2024-09-14T11:14:14.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.193+0000 7fea9e56e640 0 -- 172.21.15.148:0/2329078274 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x56442670a730 msgr2=0x56442670cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:14.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.201+0000 7fea9dd6d640 0 -- 172.21.15.148:0/2329078274 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x56442670ea60 msgr2=0x564426710e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:14.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.205+0000 7feaa02679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:14.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.205+0000 7feaa02679c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:14:14.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.205+0000 7feaa02679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:14.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.205+0000 7feaa02679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:14.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.205+0000 7feaa02679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:14.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.205+0000 7feaa02679c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:14:14.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.205+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:14.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 zone default found 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 4 Realm: () 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 zonegroup default 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 started sync module instance, tier type = 2024-09-14T11:14:14.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.209+0000 7feaa02679c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:14:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.229+0000 7feaa02679c0 20 add_watcher() i=0 2024-09-14T11:14:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.229+0000 7feaa02679c0 20 add_watcher() i=1 2024-09-14T11:14:14.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.229+0000 7feaa02679c0 20 add_watcher() i=2 2024-09-14T11:14:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.229+0000 7feaa02679c0 20 add_watcher() i=3 2024-09-14T11:14:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.229+0000 7feaa02679c0 20 add_watcher() i=4 2024-09-14T11:14:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.229+0000 7feaa02679c0 20 add_watcher() i=5 2024-09-14T11:14:14.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.229+0000 7feaa02679c0 20 add_watcher() i=6 2024-09-14T11:14:14.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.233+0000 7feaa02679c0 20 add_watcher() i=7 2024-09-14T11:14:14.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.233+0000 7feaa02679c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:14.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.233+0000 7fe94f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:14.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.237+0000 7feaa02679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:14.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.237+0000 7feaa02679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:14.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7fe94e7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:14.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7feaa02679c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:14.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7feaa02679c0 20 Filter name: none 2024-09-14T11:14:14.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7fe8bffff640 20 reqs_thread_entry: start 2024-09-14T11:14:14.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:14:14.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:14:14.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:14:14.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7feaa02679c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:14:14.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.313+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5 : miss 2024-09-14T11:14:14.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:14:14.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5 info.flags=0x17 2024-09-14T11:14:14.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5 to cache LRU end 2024-09-14T11:14:14.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:14.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5 2024-09-14T11:14:14.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:14:14.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:14:14.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.317+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:14:14.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.321+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:14:14.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.321+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:14:14.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.321+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:14:14.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.321+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:14:14.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.325+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:14:14.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.325+0000 7feaa02679c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:14:14.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.325+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea98021b00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5644267c6388 s->prefetch_data=0 2024-09-14T11:14:14.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.325+0000 7feaa02679c0 10 manifest: total_size = 7832 2024-09-14T11:14:14.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.325+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4697125000417946295 2024-09-14T11:14:14.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.325+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea98021b00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5644267c6388 s->prefetch_data=0 2024-09-14T11:14:14.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.325+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x5644267c6388 2024-09-14T11:14:14.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.325+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.1 2024-09-14T11:14:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.329+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.329+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=7832 stripe_ofs=7832 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.329+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4697125000417946295 2024-09-14T11:14:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.329+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.329+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.qVBief0ys_qernkEHs6K5VY3XNxRmAl_0 2024-09-14T11:14:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.329+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:14:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.329+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.329+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4697125000417946295 2024-09-14T11:14:14.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.333+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:14:14.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.333+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea98021b00 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.333+0000 7feaa02679c0 10 manifest: total_size = 7511 2024-09-14T11:14:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.333+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11181740963281416411 2024-09-14T11:14:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.333+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea98021b00 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.333+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674fdb8 2024-09-14T11:14:14.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.333+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.2 2024-09-14T11:14:14.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.337+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.337+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=7511 stripe_ofs=7511 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.337+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11181740963281416411 2024-09-14T11:14:14.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.337+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.337+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.woE28IVV5XShrXLEM2TPksgx9P6BwCs_0 2024-09-14T11:14:14.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.337+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:14.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.337+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.337+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11181740963281416411 2024-09-14T11:14:14.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.341+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:14:14.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.341+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267473a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.341+0000 7feaa02679c0 10 manifest: total_size = 15949 2024-09-14T11:14:14.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.341+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8878319571142396253 2024-09-14T11:14:14.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.341+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267473a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.341+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674fdb8 2024-09-14T11:14:14.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.341+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.2 2024-09-14T11:14:14.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=15949 stripe_ofs=15949 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8878319571142396253 2024-09-14T11:14:14.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.g6mctPykQiIEUntADNdrWFEmKJzxoE8_0 2024-09-14T11:14:14.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:14:14.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8878319571142396253 2024-09-14T11:14:14.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.345+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:14:14.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.349+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674a490 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.349+0000 7feaa02679c0 10 manifest: total_size = 7692 2024-09-14T11:14:14.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.349+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12656125943045276704 2024-09-14T11:14:14.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.349+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674a490 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.349+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674fdb8 2024-09-14T11:14:14.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.349+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.3 2024-09-14T11:14:14.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=7692 stripe_ofs=7692 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12656125943045276704 2024-09-14T11:14:14.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.-uUCEgeMRuAsZBChpBYztgbnDjZ26Sd_0 2024-09-14T11:14:14.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:14.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12656125943045276704 2024-09-14T11:14:14.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c75f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 10 manifest: total_size = 5007 2024-09-14T11:14:14.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17066200296014327533 2024-09-14T11:14:14.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c75f0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674fdb8 2024-09-14T11:14:14.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.357+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.4 2024-09-14T11:14:14.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.361+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:14:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.365+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.365+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5007 stripe_ofs=5007 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.365+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17066200296014327533 2024-09-14T11:14:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.365+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.365+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.1DHYqCTn0z8DWMg8Cgq3EEMKgg_IBum_0 2024-09-14T11:14:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.365+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.365+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.365+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17066200296014327533 2024-09-14T11:14:14.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.369+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:14:14.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.369+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c78c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.369+0000 7feaa02679c0 10 manifest: total_size = 4985 2024-09-14T11:14:14.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.369+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4861743451553125415 2024-09-14T11:14:14.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.369+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c78c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.369+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674fdb8 2024-09-14T11:14:14.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.369+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.4 2024-09-14T11:14:14.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.373+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.373+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4985 stripe_ofs=4985 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.373+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4861743451553125415 2024-09-14T11:14:14.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.373+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.373+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.BoI2USrSwOnlJpoJIH9kHbGSF9HICmj_0 2024-09-14T11:14:14.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.373+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:14:14.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.373+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.373+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4861743451553125415 2024-09-14T11:14:14.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.377+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:14:14.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.377+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129a80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.381+0000 7feaa02679c0 10 manifest: total_size = 7538 2024-09-14T11:14:14.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.381+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.398117509001952339 2024-09-14T11:14:14.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.381+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129a80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.381+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674fdb8 2024-09-14T11:14:14.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.381+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.5 2024-09-14T11:14:14.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.385+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.385+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=7538 stripe_ofs=7538 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.385+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.398117509001952339 2024-09-14T11:14:14.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.385+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.385+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.qtk-eY9msYfchr0ymwvQu7AJjK7jnC-_0 2024-09-14T11:14:14.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.385+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-14T11:14:14.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.385+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.385+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.398117509001952339 2024-09-14T11:14:14.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.389+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129d00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.389+0000 7feaa02679c0 10 manifest: total_size = 14228 2024-09-14T11:14:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.389+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13075471219146370121 2024-09-14T11:14:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.389+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129d00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.389+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674fdb8 2024-09-14T11:14:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.389+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.7 2024-09-14T11:14:14.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.389+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:14:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.393+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.393+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=14228 stripe_ofs=14228 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.393+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13075471219146370121 2024-09-14T11:14:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.393+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.393+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.-G50GJ2NDzqYqI0WlvNkz9ErDBpoOlA_0 2024-09-14T11:14:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.393+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.393+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.393+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13075471219146370121 2024-09-14T11:14:14.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.397+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:14:14.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.397+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129a80 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.401+0000 7feaa02679c0 10 manifest: total_size = 8744 2024-09-14T11:14:14.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.401+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14115770325078838470 2024-09-14T11:14:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.401+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129a80 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56442674fdb8 s->prefetch_data=0 2024-09-14T11:14:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.401+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674fdb8 2024-09-14T11:14:14.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.401+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5.8 2024-09-14T11:14:14.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.405+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.405+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=8744 stripe_ofs=8744 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.405+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14115770325078838470 2024-09-14T11:14:14.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.405+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.405+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.cqOD0THUbljgvM44KrgsT5WkTljvqYe_0 2024-09-14T11:14:14.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.405+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:14.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.405+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.405+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14115770325078838470 2024-09-14T11:14:14.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.409+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:14:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.409+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:14.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.409+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.409+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.409+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.409+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.409+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:14.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.409+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:14.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.417+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:14:14.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.417+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.417+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:14:14.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.417+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:14:14.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.417+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:14:14.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.417+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:14:14.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.417+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:14:14.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.417+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94850702703664 notifier 5723 bl.length()=162 2024-09-14T11:14:14.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.425+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5 from cache 2024-09-14T11:14:14.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.425+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5, ofs0, ns] 2024-09-14T11:14:14.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.425+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94850702686368 notifier 5723 bl.length()=219 2024-09-14T11:14:14.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.433+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5 : miss 2024-09-14T11:14:14.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.433+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.433+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.433+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5 info.flags=0x0 2024-09-14T11:14:14.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.433+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5 to cache LRU end 2024-09-14T11:14:14.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.437+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12 : miss 2024-09-14T11:14:14.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.437+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.441+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:14:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.441+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12 info.flags=0x17 2024-09-14T11:14:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.441+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12 to cache LRU end 2024-09-14T11:14:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.441+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.441+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.441+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12 2024-09-14T11:14:14.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.449+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:14:14.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.449+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267474e0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x564426753468 s->prefetch_data=0 2024-09-14T11:14:14.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.449+0000 7feaa02679c0 10 manifest: total_size = 1667 2024-09-14T11:14:14.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.449+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7977657990621562064 2024-09-14T11:14:14.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.449+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267474e0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x564426753468 s->prefetch_data=0 2024-09-14T11:14:14.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.449+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426753468 2024-09-14T11:14:14.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.449+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12.10 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=516 2024-09-14T11:14:14.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4191756 part_ofs=1548 rule->part_size=119 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7977657990621562064 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12__multipart_foo.2~MkohyRXQHGWZaoA8vnUmyLmrNuTDv3f.1 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12__multipart_foo.2~MkohyRXQHGWZaoA8vnUmyLmrNuTDv3f.2 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12__multipart_foo.2~MkohyRXQHGWZaoA8vnUmyLmrNuTDv3f.3 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12__multipart_foo.2~MkohyRXQHGWZaoA8vnUmyLmrNuTDv3f.4 2024-09-14T11:14:14.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:14:14.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7977657990621562064 2024-09-14T11:14:14.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.457+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:14:14.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.461+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:14.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.461+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:14.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.461+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:14.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.461+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:14.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.461+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:14.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.461+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:14.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.461+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:14.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.465+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:14:14.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.465+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.469+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:14:14.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.469+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:14:14.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.469+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:14:14.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.469+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:14:14.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.469+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:14:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.469+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366207 cookie 94850702684160 notifier 5723 bl.length()=191 2024-09-14T11:14:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.477+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12 from cache 2024-09-14T11:14:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.477+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12, ofs0, ns] 2024-09-14T11:14:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.477+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94850702684160 notifier 5723 bl.length()=249 2024-09-14T11:14:14.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.489+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12 : miss 2024-09-14T11:14:14.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.489+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.489+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.489+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12 info.flags=0x0 2024-09-14T11:14:14.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.489+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12 to cache LRU end 2024-09-14T11:14:14.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.493+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13 : miss 2024-09-14T11:14:14.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.493+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.493+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.493+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13 info.flags=0x17 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.493+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13 to cache LRU end 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.493+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.493+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:14.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.493+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.505+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:14:14.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.505+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9002c450 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.505+0000 7feaa02679c0 10 manifest: total_size = 26078 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.505+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13659632832106902055 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.505+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9002c450 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.505+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426749338 2024-09-14T11:14:14.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.505+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13.10 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7671 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7670 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-14T11:14:14.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4197879 part_ofs=7671 rule->part_size=7670 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=7670 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4205549 part_ofs=15341 rule->part_size=7670 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=23011 stripe_ofs=23011 part_ofs=23011 rule->part_size=3067 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4213219 part_ofs=23011 rule->part_size=3067 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=26078 stripe_ofs=26078 part_ofs=26078 rule->part_size=3067 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13659632832106902055 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13__multipart_foo.2~tG4sqIMbSP9rZGaXK4W7SU1zaQMw4FC.1 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13__multipart_foo.2~tG4sqIMbSP9rZGaXK4W7SU1zaQMw4FC.2 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:14:14.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13__multipart_foo.2~tG4sqIMbSP9rZGaXK4W7SU1zaQMw4FC.3 2024-09-14T11:14:14.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:14:14.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13__multipart_foo.2~tG4sqIMbSP9rZGaXK4W7SU1zaQMw4FC.4 2024-09-14T11:14:14.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:14:14.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.513+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13659632832106902055 2024-09-14T11:14:14.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.517+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:14.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.517+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:14.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.517+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:14:14.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.517+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:14.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.517+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:14.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.517+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:14.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.517+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:14.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.517+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:14.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.521+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:14:14.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.521+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.525+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:14:14.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.525+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:14:14.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.525+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:14:14.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.525+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:14:14.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.525+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:14:14.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.525+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366162 cookie 94850702704720 notifier 5723 bl.length()=198 2024-09-14T11:14:14.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.533+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13 from cache 2024-09-14T11:14:14.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.533+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13, ofs0, ns] 2024-09-14T11:14:14.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.533+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94850702749504 notifier 5723 bl.length()=256 2024-09-14T11:14:14.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.545+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13 : miss 2024-09-14T11:14:14.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.545+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.545+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.545+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13 info.flags=0x0 2024-09-14T11:14:14.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.545+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13 to cache LRU end 2024-09-14T11:14:14.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.549+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11 : miss 2024-09-14T11:14:14.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.549+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.553+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:14:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.553+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11 info.flags=0x17 2024-09-14T11:14:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.553+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11 to cache LRU end 2024-09-14T11:14:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.553+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.553+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:14.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.553+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11 2024-09-14T11:14:14.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.561+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo[svTUH9UXjEVr362w5xTQq2.7M0AOCYo] 2024-09-14T11:14:14.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.561+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11.10 2024-09-14T11:14:14.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.561+0000 7feaa02679c0 20 get_obj_state: octx=0x564426750750 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56442674e8e8 s->prefetch_data=0 2024-09-14T11:14:14.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.561+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to xa32lyw06tpmi2yzjo9ecgiu9znbpn5r 2024-09-14T11:14:14.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.561+0000 7feaa02679c0 20 get_obj_state_impl: setting s->olh_tag to f5nuppmy0i7j910foswp7og27b53mrn5 2024-09-14T11:14:14.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.561+0000 7feaa02679c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=f5nuppmy0i7j910foswp7og27b53mrn5 2024-09-14T11:14:14.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.565+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11.10 2024-09-14T11:14:14.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.569+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11.10 2024-09-14T11:14:14.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.569+0000 7feaa02679c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:14:14.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.569+0000 7feaa02679c0 20 olh_log_entry: epoch=3 op=3 key=foo[svTUH9UXjEVr362w5xTQq2.7M0AOCYo] 2024-09-14T11:14:14.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.569+0000 7feaa02679c0 20 get_obj_state: octx=0x564426750750 obj=test-client.0-r-test-multipart-index-versioning.1:_:svTUH9UXjEVr362w5xTQq2.7M0AOCYo_foo state=0x564426761468 s->prefetch_data=0 2024-09-14T11:14:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.569+0000 7feaa02679c0 10 manifest: total_size = 1667 2024-09-14T11:14:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.569+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5958111588833853344 2024-09-14T11:14:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.569+0000 7feaa02679c0 20 get_obj_state: octx=0x564426750750 obj=test-client.0-r-test-multipart-index-versioning.1:_:svTUH9UXjEVr362w5xTQq2.7M0AOCYo_foo state=0x564426761468 s->prefetch_data=0 2024-09-14T11:14:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.569+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426761468 2024-09-14T11:14:14.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.573+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11.10 2024-09-14T11:14:14.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:14:14.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-14T11:14:14.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:14:14.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:14:14.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-14T11:14:14.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-14T11:14:14.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:14:14.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=516 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4191756 part_ofs=1548 rule->part_size=119 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5958111588833853344 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11__multipart_foo.2~6LSid9q-93L3neYMw03FQtZWtz-0Xot.1 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11__multipart_foo.2~6LSid9q-93L3neYMw03FQtZWtz-0Xot.2 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11__multipart_foo.2~6LSid9q-93L3neYMw03FQtZWtz-0Xot.3 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:14:14.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11__multipart_foo.2~6LSid9q-93L3neYMw03FQtZWtz-0Xot.4 2024-09-14T11:14:14.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:14:14.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.577+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5958111588833853344 2024-09-14T11:14:14.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.581+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo[svTUH9UXjEVr362w5xTQq2.7M0AOCYo] 2024-09-14T11:14:14.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.585+0000 7feaa02679c0 20 get_obj_state: octx=0x564426750750 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56442674e8e8 s->prefetch_data=0 2024-09-14T11:14:14.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.589+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11.10 2024-09-14T11:14:14.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.593+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11.10 2024-09-14T11:14:14.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.593+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:14.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.593+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:14.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.593+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:14.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.593+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:14.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.593+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:14.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.593+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:14.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.593+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:14.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.601+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:14:14.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.601+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.601+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:14:14.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.601+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:14:14.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.601+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:14:14.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.605+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:14:14.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.605+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:14:14.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.605+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 94850702704720 notifier 5723 bl.length()=193 2024-09-14T11:14:14.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.609+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11 from cache 2024-09-14T11:14:14.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.609+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11, ofs0, ns] 2024-09-14T11:14:14.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.609+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 94850702690144 notifier 5723 bl.length()=251 2024-09-14T11:14:14.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.621+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11 : miss 2024-09-14T11:14:14.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.621+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.621+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.621+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11 info.flags=0x0 2024-09-14T11:14:14.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.621+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11 to cache LRU end 2024-09-14T11:14:14.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.625+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10 : miss 2024-09-14T11:14:14.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.625+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.625+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=449 2024-09-14T11:14:14.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.625+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10 info.flags=0x17 2024-09-14T11:14:14.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.625+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10 to cache LRU end 2024-09-14T11:14:14.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.625+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.625+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:14.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.625+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10 2024-09-14T11:14:14.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.637+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:14:14.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.637+0000 7feaa02679c0 20 get_obj_state: octx=0x564426751cd0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x56442674e728 s->prefetch_data=0 2024-09-14T11:14:14.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.637+0000 7feaa02679c0 10 manifest: total_size = 886297 2024-09-14T11:14:14.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.637+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3480511152999843423 2024-09-14T11:14:14.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.637+0000 7feaa02679c0 20 get_obj_state: octx=0x564426751cd0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x56442674e728 s->prefetch_data=0 2024-09-14T11:14:14.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.637+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442674e728 2024-09-14T11:14:14.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.637+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10.10 2024-09-14T11:14:14.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:14:14.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-14T11:14:14.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:14:14.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3480511152999843423 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10__multipart_foo.2~iHDC-6vVg8Zu4QNqWj-Eo4aj-601IqY.1 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:14:14.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10__multipart_foo.2~iHDC-6vVg8Zu4QNqWj-Eo4aj-601IqY.2 2024-09-14T11:14:14.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:14:14.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10__multipart_foo.2~iHDC-6vVg8Zu4QNqWj-Eo4aj-601IqY.3 2024-09-14T11:14:14.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:14:14.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10__multipart_foo.2~iHDC-6vVg8Zu4QNqWj-Eo4aj-601IqY.4 2024-09-14T11:14:14.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:14:14.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.641+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3480511152999843423 2024-09-14T11:14:14.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.645+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:14:14.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.645+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:14.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.645+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:14.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.649+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:14.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.649+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:14.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.649+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:14.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.649+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:14.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.649+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:14.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.653+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:14:14.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.653+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.653+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=227 2024-09-14T11:14:14.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.653+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:14:14.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.653+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:14:14.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.657+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:14:14.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.657+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:14:14.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.657+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 94850702690144 notifier 5723 bl.length()=183 2024-09-14T11:14:14.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.661+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10 from cache 2024-09-14T11:14:14.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.661+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10, ofs0, ns] 2024-09-14T11:14:14.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.661+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94850702704720 notifier 5723 bl.length()=241 2024-09-14T11:14:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.669+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10 : miss 2024-09-14T11:14:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.669+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.673+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.673+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10 info.flags=0x0 2024-09-14T11:14:14.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.673+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10 to cache LRU end 2024-09-14T11:14:14.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.677+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16 : miss 2024-09-14T11:14:14.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.677+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.677+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:14:14.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.677+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16 info.flags=0x17 2024-09-14T11:14:14.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.677+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16 to cache LRU end 2024-09-14T11:14:14.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.677+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.677+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:14.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.677+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16 2024-09-14T11:14:14.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.681+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:14:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.681+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:14:14.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.681+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:14:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.685+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:14:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.685+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:14:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.685+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:14:14.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.685+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:14:14.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.685+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:14:14.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.685+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:14:14.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:14:14.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:14:14.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:14:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 20 get_obj_state: octx=0x564426726460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 10 manifest: total_size = 27197 2024-09-14T11:14:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _tYJBdzO6WMXvydnpci1yQ8BCVZ5H7mK 2024-09-14T11:14:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 20 get_obj_state: octx=0x564426726460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.689+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.0 2024-09-14T11:14:14.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.697+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.697+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.697+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _tYJBdzO6WMXvydnpci1yQ8BCVZ5H7mK 2024-09-14T11:14:14.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.697+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.697+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.NPxMJfUf0qtMuFg6sLxGkzMGuVvVHS2_0 2024-09-14T11:14:14.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.697+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:14:14.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.697+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.697+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _tYJBdzO6WMXvydnpci1yQ8BCVZ5H7mK 2024-09-14T11:14:14.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.701+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:14:14.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.701+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.701+0000 7feaa02679c0 10 manifest: total_size = 5242880 2024-09-14T11:14:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.701+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _uDtu_hrRjZM5r2a1P47Jy9ZZj2jbDks 2024-09-14T11:14:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.701+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.701+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.701+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.2 2024-09-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _uDtu_hrRjZM5r2a1P47Jy9ZZj2jbDks 2024-09-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.BvKk86B6FqTHEhQd-CBAbUtVAiIxakW_0 2024-09-14T11:14:14.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:14:14.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.BvKk86B6FqTHEhQd-CBAbUtVAiIxakW_1 2024-09-14T11:14:14.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:14:14.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.705+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _uDtu_hrRjZM5r2a1P47Jy9ZZj2jbDks 2024-09-14T11:14:14.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.709+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:14:14.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.713+0000 7feaa02679c0 20 get_obj_state: octx=0x564426726460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.713+0000 7feaa02679c0 10 manifest: total_size = 5242880 2024-09-14T11:14:14.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.713+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9879573244746104132 2024-09-14T11:14:14.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.713+0000 7feaa02679c0 20 get_obj_state: octx=0x564426726460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.713+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.713+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.3 2024-09-14T11:14:14.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9879573244746104132 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.AXkVt1u_h0yZQ_lunzd1Y3Y_JRajXR6_0 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.AXkVt1u_h0yZQ_lunzd1Y3Y_JRajXR6_1 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.717+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9879573244746104132 2024-09-14T11:14:14.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.721+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:14:14.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.721+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129d00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.725+0000 7feaa02679c0 10 manifest: total_size = 5242880 2024-09-14T11:14:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.725+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _r_oxyOktsEkqUctj04Yei9vKDVXQBjy 2024-09-14T11:14:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.725+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129d00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.725+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.725+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.5 2024-09-14T11:14:14.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _r_oxyOktsEkqUctj04Yei9vKDVXQBjy 2024-09-14T11:14:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.ZE49U_wOdKeQEUCu005zpAAZGDcEDL4_0 2024-09-14T11:14:14.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:14:14.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.ZE49U_wOdKeQEUCu005zpAAZGDcEDL4_1 2024-09-14T11:14:14.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:14:14.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.729+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _r_oxyOktsEkqUctj04Yei9vKDVXQBjy 2024-09-14T11:14:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.733+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:14:14.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.733+0000 7feaa02679c0 20 get_obj_state: octx=0x564426766050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.737+0000 7feaa02679c0 10 manifest: total_size = 5242880 2024-09-14T11:14:14.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.737+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _WsVPCnR9KiEk_zKh2cQHVx28mym_Bsx 2024-09-14T11:14:14.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.737+0000 7feaa02679c0 20 get_obj_state: octx=0x564426766050 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.737+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.737+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.5 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _WsVPCnR9KiEk_zKh2cQHVx28mym_Bsx 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.prMX6cN9FtYHvGHw3dzvFwkn1sHPnIx_0 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.prMX6cN9FtYHvGHw3dzvFwkn1sHPnIx_1 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.741+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _WsVPCnR9KiEk_zKh2cQHVx28mym_Bsx 2024-09-14T11:14:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.745+0000 7feaa02679c0 20 get_obj_state: octx=0x564426726460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.745+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:14:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.745+0000 7feaa02679c0 10 manifest: total_size = 27197 2024-09-14T11:14:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.745+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6762856165430810081 2024-09-14T11:14:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.745+0000 7feaa02679c0 20 get_obj_state: octx=0x564426726460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.745+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.745+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.5 2024-09-14T11:14:14.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6762856165430810081 2024-09-14T11:14:14.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.lLY922J-lf7tolNZ1NkrDTj6qSLXNaR_0 2024-09-14T11:14:14.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:14:14.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6762856165430810081 2024-09-14T11:14:14.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.753+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129d00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.757+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:14:14.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.757+0000 7feaa02679c0 10 manifest: total_size = 5242880 2024-09-14T11:14:14.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.757+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _2k2iCVPPTQ4Ojo0QxgO6eY5bBhkNpKJ 2024-09-14T11:14:14.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.757+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129d00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.757+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.757+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.7 2024-09-14T11:14:14.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _2k2iCVPPTQ4Ojo0QxgO6eY5bBhkNpKJ 2024-09-14T11:14:14.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.Cb3P82SVKTmJ_4qKFWsTXH-IdXFZC_U_0 2024-09-14T11:14:14.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:14:14.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.Cb3P82SVKTmJ_4qKFWsTXH-IdXFZC_U_1 2024-09-14T11:14:14.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:14:14.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.761+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _2k2iCVPPTQ4Ojo0QxgO6eY5bBhkNpKJ 2024-09-14T11:14:14.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.765+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:14:14.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.769+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.769+0000 7feaa02679c0 10 manifest: total_size = 5242880 2024-09-14T11:14:14.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.769+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34448434876270737 2024-09-14T11:14:14.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.769+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.769+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.769+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.7 2024-09-14T11:14:14.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34448434876270737 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.PzBaaSWxhmj3fFfBtFOJdmVKG1pc6W2_0 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.PzBaaSWxhmj3fFfBtFOJdmVKG1pc6W2_1 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 576 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34448434876270737 2024-09-14T11:14:14.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.777+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:14:14.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.781+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.781+0000 7feaa02679c0 10 manifest: total_size = 27197 2024-09-14T11:14:14.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.781+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7730537985925706351 2024-09-14T11:14:14.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.781+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.781+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.781+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.7 2024-09-14T11:14:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.785+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.785+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.785+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7730537985925706351 2024-09-14T11:14:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.785+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.785+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.lLY922J-lf7tolNZ1NkrDTj6qSLXNaR_0 2024-09-14T11:14:14.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.785+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:14:14.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.785+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.785+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7730537985925706351 2024-09-14T11:14:14.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.789+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:14:14.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.789+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674aba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.789+0000 7feaa02679c0 10 manifest: total_size = 5242880 2024-09-14T11:14:14.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.789+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10148464894653361768 2024-09-14T11:14:14.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.789+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674aba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.789+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.793+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.8 2024-09-14T11:14:14.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10148464894653361768 2024-09-14T11:14:14.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.PzBaaSWxhmj3fFfBtFOJdmVKG1pc6W2_0 2024-09-14T11:14:14.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:14:14.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.PzBaaSWxhmj3fFfBtFOJdmVKG1pc6W2_1 2024-09-14T11:14:14.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:14:14.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.797+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10148464894653361768 2024-09-14T11:14:14.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.801+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:14:14.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.801+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.801+0000 7feaa02679c0 10 manifest: total_size = 27197 2024-09-14T11:14:14.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.801+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _UWVq-gA8Hzp3S3IB0-AgR9eZ2wjYVhY 2024-09-14T11:14:14.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.801+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.801+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.801+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.8 2024-09-14T11:14:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _UWVq-gA8Hzp3S3IB0-AgR9eZ2wjYVhY 2024-09-14T11:14:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.ckEgHc3olCDAgxOnFXmmZtLUPeiWuEA_0 2024-09-14T11:14:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:14:14.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _UWVq-gA8Hzp3S3IB0-AgR9eZ2wjYVhY 2024-09-14T11:14:14.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.809+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:14:14.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.813+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea900ab550 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.813+0000 7feaa02679c0 10 manifest: total_size = 5242880 2024-09-14T11:14:14.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.813+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12760863878095421656 2024-09-14T11:14:14.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.813+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea900ab550 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.813+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.813+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16.9 2024-09-14T11:14:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12760863878095421656 2024-09-14T11:14:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.AXkVt1u_h0yZQ_lunzd1Y3Y_JRajXR6_0 2024-09-14T11:14:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:14:14.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.AXkVt1u_h0yZQ_lunzd1Y3Y_JRajXR6_1 2024-09-14T11:14:14.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:14:14.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.817+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12760863878095421656 2024-09-14T11:14:14.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.821+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:14:14.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.821+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:14.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.821+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:14.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.825+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:14.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.825+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:14.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.825+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:14.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.825+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:14.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.825+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:14.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.829+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:14:14.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.829+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.829+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:14:14.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.829+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:14:14.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.829+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:14:14.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.833+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:14:14.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.833+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:14:14.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.833+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94850702704720 notifier 5723 bl.length()=189 2024-09-14T11:14:14.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.841+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16 from cache 2024-09-14T11:14:14.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.841+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16, ofs0, ns] 2024-09-14T11:14:14.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.841+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 94850702690144 notifier 5723 bl.length()=247 2024-09-14T11:14:14.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.853+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16 : miss 2024-09-14T11:14:14.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.853+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.853+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.853+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16 info.flags=0x0 2024-09-14T11:14:14.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.853+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16 to cache LRU end 2024-09-14T11:14:14.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.857+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17 : miss 2024-09-14T11:14:14.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.857+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.861+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:14:14.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.861+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17 info.flags=0x17 2024-09-14T11:14:14.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.861+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17 to cache LRU end 2024-09-14T11:14:14.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.861+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.861+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:14.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.861+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17 2024-09-14T11:14:14.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.861+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:14:14.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.861+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:14:14.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.865+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:14:14.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.865+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:14:14.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.865+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:14:14.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.865+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:14:14.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.869+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:14:14.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.869+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:14:14.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.869+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:14:14.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.869+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:14:14.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.869+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:14:14.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.869+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:14:14.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.873+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267264e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.873+0000 7feaa02679c0 10 manifest: total_size = 45360 2024-09-14T11:14:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.873+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _C6tGa-AonH7-s6jaAd9EG5MyVy-Wns- 2024-09-14T11:14:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.873+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267264e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.873+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.873+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.0 2024-09-14T11:14:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _C6tGa-AonH7-s6jaAd9EG5MyVy-Wns- 2024-09-14T11:14:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.4WIGJNExebA6cBY5UQtlzK_Dw7Cl493_0 2024-09-14T11:14:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:14:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _C6tGa-AonH7-s6jaAd9EG5MyVy-Wns- 2024-09-14T11:14:14.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.881+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:14:14.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.885+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.885+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.885+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _G5zUxW-1_VLOoIWfbD1-Nyo9plR4ls3 2024-09-14T11:14:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.885+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.885+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.885+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.2 2024-09-14T11:14:14.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _G5zUxW-1_VLOoIWfbD1-Nyo9plR4ls3 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.ur4tV1qlkwrqrv5mpt0zESXhYaP-zWE_0 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.ur4tV1qlkwrqrv5mpt0zESXhYaP-zWE_1 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.ur4tV1qlkwrqrv5mpt0zESXhYaP-zWE_2 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.889+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _G5zUxW-1_VLOoIWfbD1-Nyo9plR4ls3 2024-09-14T11:14:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.893+0000 7feaa02679c0 20 get_obj_state: octx=0x56442675f8f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.893+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:14:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.893+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.893+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14929186970218127588 2024-09-14T11:14:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.893+0000 7feaa02679c0 20 get_obj_state: octx=0x56442675f8f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.893+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.893+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.3 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14929186970218127588 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.1 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.1_1 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.2 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:14:14.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.2_1 2024-09-14T11:14:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:14:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.3 2024-09-14T11:14:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:14:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.901+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14929186970218127588 2024-09-14T11:14:14.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.905+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:14:14.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.905+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.905+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.905+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _Wxsh5ToD8e7vVSKrE5TweMnUrc0ZT0J 2024-09-14T11:14:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.905+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.905+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.905+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.5 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Wxsh5ToD8e7vVSKrE5TweMnUrc0ZT0J 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.H4JZa8ve6y81GhJe5aVwwhb0p3m50Ft_0 2024-09-14T11:14:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:14:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.H4JZa8ve6y81GhJe5aVwwhb0p3m50Ft_1 2024-09-14T11:14:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:14:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.H4JZa8ve6y81GhJe5aVwwhb0p3m50Ft_2 2024-09-14T11:14:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:14:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.913+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _Wxsh5ToD8e7vVSKrE5TweMnUrc0ZT0J 2024-09-14T11:14:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.917+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:14:14.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.917+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.917+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.917+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _a9pABYjvxoN0rM2prVdjKELcW3aClvV 2024-09-14T11:14:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.917+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.917+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.917+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.5 2024-09-14T11:14:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _a9pABYjvxoN0rM2prVdjKELcW3aClvV 2024-09-14T11:14:14.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.W_lVNzEHzu1H3KrstiGJ-_e4fuie-Ga_0 2024-09-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.W_lVNzEHzu1H3KrstiGJ-_e4fuie-Ga_1 2024-09-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.W_lVNzEHzu1H3KrstiGJ-_e4fuie-Ga_2 2024-09-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.925+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _a9pABYjvxoN0rM2prVdjKELcW3aClvV 2024-09-14T11:14:14.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.929+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:14:14.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.929+0000 7feaa02679c0 20 get_obj_state: octx=0x564426766dc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.929+0000 7feaa02679c0 10 manifest: total_size = 45360 2024-09-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.929+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14902690946417348978 2024-09-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.929+0000 7feaa02679c0 20 get_obj_state: octx=0x564426766dc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.929+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.929+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.5 2024-09-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-14T11:14:14.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=4134 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14902690946417348978 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.1 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.2 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.3 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.937+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14902690946417348978 2024-09-14T11:14:14.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.941+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:14:14.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.941+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.941+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:14.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.941+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _FChYZ-XKIbQ4h5eUD_V48YcuDsD-7nW 2024-09-14T11:14:14.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.941+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.941+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.941+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.7 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _FChYZ-XKIbQ4h5eUD_V48YcuDsD-7nW 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.K_OBBnRneU4kKVTFblkoXpPAXgZ4BIF_0 2024-09-14T11:14:14.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:14:14.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.K_OBBnRneU4kKVTFblkoXpPAXgZ4BIF_1 2024-09-14T11:14:14.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:14:14.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.K_OBBnRneU4kKVTFblkoXpPAXgZ4BIF_2 2024-09-14T11:14:14.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-14T11:14:14.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _FChYZ-XKIbQ4h5eUD_V48YcuDsD-7nW 2024-09-14T11:14:14.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.949+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:14:14.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.953+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9000ef60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.953+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:14.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.953+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11057588561122233998 2024-09-14T11:14:14.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.953+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9000ef60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.953+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.953+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.7 2024-09-14T11:14:14.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:14:14.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11057588561122233998 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.1 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.1_1 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.2 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.2_1 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.3 2024-09-14T11:14:14.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:14:14.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11057588561122233998 2024-09-14T11:14:14.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.961+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:14:14.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.965+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c780 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.965+0000 7feaa02679c0 10 manifest: total_size = 45360 2024-09-14T11:14:14.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.965+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8047559534101065952 2024-09-14T11:14:14.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.965+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c780 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.965+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.965+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.7 2024-09-14T11:14:14.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=4134 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8047559534101065952 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.1 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:14:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.2 2024-09-14T11:14:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:14:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.3 2024-09-14T11:14:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:14:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8047559534101065952 2024-09-14T11:14:14.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.973+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:14:14.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.977+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.977+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:14.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.977+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18313887031868918260 2024-09-14T11:14:14.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.977+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea940a3fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.977+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.977+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.8 2024-09-14T11:14:14.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:14.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18313887031868918260 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.1 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.1_1 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.2 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.2_1 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.3 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.985+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18313887031868918260 2024-09-14T11:14:14.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.989+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:14:14.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.989+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9000ef60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.989+0000 7feaa02679c0 10 manifest: total_size = 45360 2024-09-14T11:14:14.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.989+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to _wtVVswVT0h2AS07qxVRU2Vyc07CQC9c 2024-09-14T11:14:14.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.989+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9000ef60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.989+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.989+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.8 2024-09-14T11:14:14.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.997+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:14.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.997+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-14T11:14:14.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.997+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: _wtVVswVT0h2AS07qxVRU2Vyc07CQC9c 2024-09-14T11:14:14.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.997+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:14.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.997+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.Ju2FfzdXzjxCDvazc0SnryGeB2vb_RQ_0 2024-09-14T11:14:14.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.997+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:14:14.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.997+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:14.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:14.997+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _wtVVswVT0h2AS07qxVRU2Vyc07CQC9c 2024-09-14T11:14:14.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.001+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:14:14.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.001+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267471b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.001+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.001+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5295374377413549310 2024-09-14T11:14:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.001+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267471b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.001+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:14.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.001+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17.9 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5295374377413549310 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.1 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.1_1 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.2 2024-09-14T11:14:15.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-14T11:14:15.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.2_1 2024-09-14T11:14:15.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-14T11:14:15.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.3 2024-09-14T11:14:15.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-14T11:14:15.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.009+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5295374377413549310 2024-09-14T11:14:15.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.013+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:14:15.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.013+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:15.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.013+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:15.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.013+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:15.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.013+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:15.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.013+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:15.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.013+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:15.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.013+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:15.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.017+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:14:15.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.017+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.021+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:14:15.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.021+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:14:15.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.021+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:14:15.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.021+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:14:15.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.021+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:14:15.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.025+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94850702688576 notifier 5723 bl.length()=199 2024-09-14T11:14:15.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.029+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17 from cache 2024-09-14T11:14:15.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.029+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17, ofs0, ns] 2024-09-14T11:14:15.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.033+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94850702755328 notifier 5723 bl.length()=257 2024-09-14T11:14:15.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.041+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17 : miss 2024-09-14T11:14:15.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.041+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.041+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.041+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17 info.flags=0x0 2024-09-14T11:14:15.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.041+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17 to cache LRU end 2024-09-14T11:14:15.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.049+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15 : miss 2024-09-14T11:14:15.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.049+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.049+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:14:15.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.049+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15 info.flags=0x17 2024-09-14T11:14:15.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.049+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15 to cache LRU end 2024-09-14T11:14:15.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.049+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:15.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.049+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:15.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.049+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15 2024-09-14T11:14:15.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.053+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:14:15.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.053+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:14:15.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.057+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:14:15.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.061+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c7ea0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:15.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.061+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:15.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.061+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14350530418834185496 2024-09-14T11:14:15.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.061+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c7ea0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:15.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.061+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:15.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.061+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15.3 2024-09-14T11:14:15.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:14:15.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14350530418834185496 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.1 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__shadow_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.1_1 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.2 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__shadow_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.2_1 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.3 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:14:15.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.069+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14350530418834185496 2024-09-14T11:14:15.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.073+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:14:15.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.073+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b6a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:15.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.073+0000 7feaa02679c0 10 manifest: total_size = 541681 2024-09-14T11:14:15.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.073+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5748058358941756678 2024-09-14T11:14:15.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.073+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9001b6a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:15.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.073+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:15.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.073+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15.5 2024-09-14T11:14:15.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:14:15.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-14T11:14:15.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:14:15.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:14:15.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-14T11:14:15.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=49187 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5748058358941756678 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-STANDARD.2~Yhcxtp2WN74l8HZfNktf7Bm256YhsBb.1 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-STANDARD.2~Yhcxtp2WN74l8HZfNktf7Bm256YhsBb.2 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-STANDARD.2~Yhcxtp2WN74l8HZfNktf7Bm256YhsBb.3 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5748058358941756678 2024-09-14T11:14:15.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.081+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:14:15.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.085+0000 7feaa02679c0 20 get_obj_state: octx=0x564426759940 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:15.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.085+0000 7feaa02679c0 10 manifest: total_size = 11534336 2024-09-14T11:14:15.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.085+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.514564239297707319 2024-09-14T11:14:15.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.085+0000 7feaa02679c0 20 get_obj_state: octx=0x564426759940 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x564426758fc8 s->prefetch_data=0 2024-09-14T11:14:15.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.085+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426758fc8 2024-09-14T11:14:15.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.085+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15.7 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:15.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.514564239297707319 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.1 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__shadow_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.1_1 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 643 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.2 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 916 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__shadow_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.2_1 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1187 2024-09-14T11:14:15.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.3 2024-09-14T11:14:15.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1460 2024-09-14T11:14:15.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.093+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.514564239297707319 2024-09-14T11:14:15.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.097+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:15.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.097+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:15.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.097+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:14:15.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.097+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:15.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.097+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:15.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.097+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:15.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.097+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:15.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.097+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.105+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:14:15.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.105+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.105+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:14:15.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.105+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:14:15.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.105+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:14:15.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.109+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:14:15.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.109+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:14:15.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.109+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 94850702686368 notifier 5723 bl.length()=194 2024-09-14T11:14:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.113+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15 from cache 2024-09-14T11:14:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.113+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15, ofs0, ns] 2024-09-14T11:14:15.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.117+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94850702755328 notifier 5723 bl.length()=252 2024-09-14T11:14:15.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.125+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15 : miss 2024-09-14T11:14:15.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.125+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.125+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.125+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15 info.flags=0x0 2024-09-14T11:14:15.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.125+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15 to cache LRU end 2024-09-14T11:14:15.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.133+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14 : miss 2024-09-14T11:14:15.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.133+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.133+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:14:15.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.133+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14 info.flags=0x17 2024-09-14T11:14:15.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.133+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14 to cache LRU end 2024-09-14T11:14:15.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.133+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:15.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.133+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:15.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.133+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14 2024-09-14T11:14:15.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.137+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:14:15.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.141+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:14:15.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.141+0000 7feaa02679c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:14:15.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.149+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674ff70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.149+0000 7feaa02679c0 10 manifest: total_size = 10485760 2024-09-14T11:14:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.149+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7609004533584140900 2024-09-14T11:14:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.149+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674ff70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.149+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426749338 2024-09-14T11:14:15.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.149+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14.3 2024-09-14T11:14:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7609004533584140900 2024-09-14T11:14:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.m-2MC78ZvGMZG5A6r6o7v73YD-CHOwX_0 2024-09-14T11:14:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:14:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.m-2MC78ZvGMZG5A6r6o7v73YD-CHOwX_1 2024-09-14T11:14:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:14:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.m-2MC78ZvGMZG5A6r6o7v73YD-CHOwX_2 2024-09-14T11:14:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-09-14T11:14:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.153+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7609004533584140900 2024-09-14T11:14:15.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.157+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:14:15.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.157+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129d00 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.161+0000 7feaa02679c0 10 manifest: total_size = 10485760 2024-09-14T11:14:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.161+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5868799392206116523 2024-09-14T11:14:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.161+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea94129d00 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.161+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426749338 2024-09-14T11:14:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.161+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14.5 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5868799392206116523 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.BUjubPseM41N-OQvXDVALbZueNCTYE1_0 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.BUjubPseM41N-OQvXDVALbZueNCTYE1_1 2024-09-14T11:14:15.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-14T11:14:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.BUjubPseM41N-OQvXDVALbZueNCTYE1_2 2024-09-14T11:14:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 790 2024-09-14T11:14:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.165+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5868799392206116523 2024-09-14T11:14:15.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.169+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:14:15.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.169+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9000ef60 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.173+0000 7feaa02679c0 10 manifest: total_size = 10485760 2024-09-14T11:14:15.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.173+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17649240887968320807 2024-09-14T11:14:15.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.173+0000 7feaa02679c0 20 get_obj_state: octx=0x7fea9000ef60 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.173+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426749338 2024-09-14T11:14:15.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.173+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14.7 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17649240887968320807 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.baLOh-pZxq38pgRTkp4Yo0bKkmLXBEz_0 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.baLOh-pZxq38pgRTkp4Yo0bKkmLXBEz_1 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:14:15.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.baLOh-pZxq38pgRTkp4Yo0bKkmLXBEz_2 2024-09-14T11:14:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-14T11:14:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.177+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17649240887968320807 2024-09-14T11:14:15.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.181+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:14:15.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.185+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:15.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.185+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.185+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.185+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.185+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.185+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:15.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.185+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:15.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.189+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:14:15.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.189+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.189+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:14:15.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.193+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:14:15.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.193+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:14:15.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.193+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:14:15.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.193+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:14:15.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.193+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94850702704720 notifier 5723 bl.length()=184 2024-09-14T11:14:15.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.201+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14 from cache 2024-09-14T11:14:15.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.201+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14, ofs0, ns] 2024-09-14T11:14:15.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.201+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366225 cookie 94850702749504 notifier 5723 bl.length()=242 2024-09-14T11:14:15.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.213+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14 : miss 2024-09-14T11:14:15.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.213+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.213+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.213+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14 info.flags=0x0 2024-09-14T11:14:15.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.213+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14 to cache LRU end 2024-09-14T11:14:15.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.217+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7 : miss 2024-09-14T11:14:15.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.217+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.221+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:14:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.221+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7 info.flags=0x17 2024-09-14T11:14:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.221+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7 to cache LRU end 2024-09-14T11:14:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.221+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.221+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:15.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.221+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7 2024-09-14T11:14:15.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.221+0000 7feaa02679c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:14:15.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.225+0000 7feaa02679c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:14:15.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.225+0000 7feaa02679c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:14:15.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.229+0000 7feaa02679c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:14:15.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.233+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6b40 obj=test-client.0-r-test-small-obj-data.1:___ state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.233+0000 7feaa02679c0 10 manifest: total_size = 0 2024-09-14T11:14:15.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.233+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10161511436651227216 2024-09-14T11:14:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.233+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6b40 obj=test-client.0-r-test-small-obj-data.1:___ state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.233+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426749338 2024-09-14T11:14:15.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.233+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7.2 2024-09-14T11:14:15.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.241+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6b40 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.241+0000 7feaa02679c0 10 manifest: total_size = 0 2024-09-14T11:14:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.241+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17269959146243299689 2024-09-14T11:14:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.241+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6b40 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.241+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426749338 2024-09-14T11:14:15.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.241+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7.3 2024-09-14T11:14:15.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.241+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:14:15.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.249+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6b40 obj=test-client.0-r-test-small-obj-data.1:__ state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.249+0000 7feaa02679c0 10 manifest: total_size = 0 2024-09-14T11:14:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.249+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16352822970898741321 2024-09-14T11:14:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.249+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6b40 obj=test-client.0-r-test-small-obj-data.1:__ state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.249+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426749338 2024-09-14T11:14:15.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.249+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7.6 2024-09-14T11:14:15.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.249+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:14:15.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.257+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6b40 obj=test-client.0-r-test-small-obj-data.1:obj state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.257+0000 7feaa02679c0 10 manifest: total_size = 0 2024-09-14T11:14:15.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.257+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14768971468394488315 2024-09-14T11:14:15.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.257+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6b40 obj=test-client.0-r-test-small-obj-data.1:obj state=0x564426749338 s->prefetch_data=0 2024-09-14T11:14:15.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.257+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426749338 2024-09-14T11:14:15.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.257+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7.8 2024-09-14T11:14:15.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.257+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:14:15.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.265+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:15.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.265+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:15.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.265+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:14:15.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.269+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:15.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.269+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:15.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.269+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:15.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.269+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:15.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.269+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.273+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:14:15.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.273+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.273+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:14:15.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.273+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:14:15.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.273+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:14:15.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.277+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:14:15.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.277+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:14:15.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.277+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 94850702684160 notifier 5723 bl.length()=181 2024-09-14T11:14:15.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.285+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7 from cache 2024-09-14T11:14:15.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.285+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7, ofs0, ns] 2024-09-14T11:14:15.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.285+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94850702703664 notifier 5723 bl.length()=238 2024-09-14T11:14:15.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.293+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7 : miss 2024-09-14T11:14:15.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.293+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.297+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.297+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7 info.flags=0x0 2024-09-14T11:14:15.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.297+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7 to cache LRU end 2024-09-14T11:14:15.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.301+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8 : miss 2024-09-14T11:14:15.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.301+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.301+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:14:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.301+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8 info.flags=0x17 2024-09-14T11:14:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.301+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8 to cache LRU end 2024-09-14T11:14:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.301+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.301+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.301+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8 2024-09-14T11:14:15.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.305+0000 7feaa02679c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:14:15.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.309+0000 7feaa02679c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:14:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.309+0000 7feaa02679c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:14:15.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.313+0000 7feaa02679c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:14:15.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.313+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c4a0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.317+0000 7feaa02679c0 10 manifest: total_size = 38 2024-09-14T11:14:15.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.317+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16400865766548469606 2024-09-14T11:14:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.317+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c4a0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.317+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442676a9c8 2024-09-14T11:14:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.317+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8.2 2024-09-14T11:14:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.321+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.321+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.321+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16400865766548469606 2024-09-14T11:14:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.321+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.321+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8__shadow_.9Sn2Q-a_7CfC8veHWbCTuRcpQP_Naiq_0 2024-09-14T11:14:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.321+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.321+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.321+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16400865766548469606 2024-09-14T11:14:15.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.325+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c4a0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.325+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:14:15.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.325+0000 7feaa02679c0 10 manifest: total_size = 24595 2024-09-14T11:14:15.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.325+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15840348603879529001 2024-09-14T11:14:15.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.325+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c4a0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.325+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442676a9c8 2024-09-14T11:14:15.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.325+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8.3 2024-09-14T11:14:15.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.333+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.333+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.333+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15840348603879529001 2024-09-14T11:14:15.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.333+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.333+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8__shadow_.oQ-bt0YE4SIoGGyGxgBvVtbMEdqDen5_0 2024-09-14T11:14:15.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.333+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:15.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.333+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.333+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15840348603879529001 2024-09-14T11:14:15.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.337+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:14:15.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.337+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c4a0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.337+0000 7feaa02679c0 10 manifest: total_size = 527 2024-09-14T11:14:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.337+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18364270164922475387 2024-09-14T11:14:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.337+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c4a0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.337+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442676a9c8 2024-09-14T11:14:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.337+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8.6 2024-09-14T11:14:15.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.345+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.345+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18364270164922475387 2024-09-14T11:14:15.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8__shadow_.ViJVqyKi7MyyaQ0MAQuPoha4lZt_x3b_0 2024-09-14T11:14:15.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:15.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.345+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18364270164922475387 2024-09-14T11:14:15.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.349+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:14:15.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.349+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c4a0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.349+0000 7feaa02679c0 10 manifest: total_size = 2078 2024-09-14T11:14:15.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.349+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10488872789335850728 2024-09-14T11:14:15.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.349+0000 7feaa02679c0 20 get_obj_state: octx=0x56442674c4a0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.349+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442676a9c8 2024-09-14T11:14:15.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.349+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8.8 2024-09-14T11:14:15.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.357+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.357+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10488872789335850728 2024-09-14T11:14:15.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8__shadow_.pdj-Z-ylmNV-ykT65yF1NpNjTBHhjHI_0 2024-09-14T11:14:15.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:15.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.357+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10488872789335850728 2024-09-14T11:14:15.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.361+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:14:15.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.361+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:15.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.361+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:15.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.361+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:15.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.361+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:15.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.361+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:15.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.361+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:15.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.361+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:15.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.369+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:14:15.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.369+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.369+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:14:15.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.369+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:14:15.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.369+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:14:15.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.373+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:14:15.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.373+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:14:15.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.373+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366213 cookie 94850702684160 notifier 5723 bl.length()=181 2024-09-14T11:14:15.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.381+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8 from cache 2024-09-14T11:14:15.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.381+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8, ofs0, ns] 2024-09-14T11:14:15.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.381+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94850702703664 notifier 5723 bl.length()=238 2024-09-14T11:14:15.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.389+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8 : miss 2024-09-14T11:14:15.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.389+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.389+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.389+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8 info.flags=0x0 2024-09-14T11:14:15.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.389+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8 to cache LRU end 2024-09-14T11:14:15.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.397+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9 : miss 2024-09-14T11:14:15.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.397+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.397+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:14:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.397+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9 info.flags=0x17 2024-09-14T11:14:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.397+0000 7feaa02679c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9 to cache LRU end 2024-09-14T11:14:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.397+0000 7feaa02679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.397+0000 7feaa02679c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:14:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.397+0000 7feaa02679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9 2024-09-14T11:14:15.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.401+0000 7feaa02679c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:14:15.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.401+0000 7feaa02679c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:14:15.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.405+0000 7feaa02679c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:14:15.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.405+0000 7feaa02679c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:14:15.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.409+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6ed0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.409+0000 7feaa02679c0 10 manifest: total_size = 55 2024-09-14T11:14:15.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.409+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15384382919533868011 2024-09-14T11:14:15.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.409+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6ed0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.409+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442676a9c8 2024-09-14T11:14:15.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.409+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9.2 2024-09-14T11:14:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.417+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.417+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.417+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15384382919533868011 2024-09-14T11:14:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.417+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.417+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9__shadow_.HxnTGi8NdNv2bCqm3aDqCJqdxK7sCBD_0 2024-09-14T11:14:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.417+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.417+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.417+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15384382919533868011 2024-09-14T11:14:15.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.421+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6ed0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.421+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:14:15.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.421+0000 7feaa02679c0 10 manifest: total_size = 49187 2024-09-14T11:14:15.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.421+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15768360671367264880 2024-09-14T11:14:15.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.421+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6ed0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x56442676a9c8 s->prefetch_data=0 2024-09-14T11:14:15.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.421+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x56442676a9c8 2024-09-14T11:14:15.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.421+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9.3 2024-09-14T11:14:15.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.425+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.425+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.425+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15768360671367264880 2024-09-14T11:14:15.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.425+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.425+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9__shadow_.m1pXUlDJkjCjy4Tavskwa3iSCjVGNiY_0 2024-09-14T11:14:15.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.425+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:14:15.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.425+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.425+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15768360671367264880 2024-09-14T11:14:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.429+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:14:15.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.429+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6ed0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x564426767648 s->prefetch_data=0 2024-09-14T11:14:15.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.433+0000 7feaa02679c0 10 manifest: total_size = 1035 2024-09-14T11:14:15.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.433+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.695504664546882749 2024-09-14T11:14:15.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.433+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6ed0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x564426767648 s->prefetch_data=0 2024-09-14T11:14:15.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.433+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426767648 2024-09-14T11:14:15.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.433+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9.6 2024-09-14T11:14:15.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.437+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.437+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.437+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.695504664546882749 2024-09-14T11:14:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.437+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.437+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9__shadow_.-_Qg9UY95HoJ5083-5FpgjEQ4VJMW8z_0 2024-09-14T11:14:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.437+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-14T11:14:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.437+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.437+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.695504664546882749 2024-09-14T11:14:15.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.441+0000 7fe980ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:14:15.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.441+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6ed0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x564426754898 s->prefetch_data=0 2024-09-14T11:14:15.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.441+0000 7feaa02679c0 10 manifest: total_size = 4134 2024-09-14T11:14:15.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.441+0000 7feaa02679c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5395723102860052709 2024-09-14T11:14:15.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.441+0000 7feaa02679c0 20 get_obj_state: octx=0x5644267c6ed0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x564426754898 s->prefetch_data=0 2024-09-14T11:14:15.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.441+0000 7feaa02679c0 20 prepare_atomic_modification: state is not atomic. state=0x564426754898 2024-09-14T11:14:15.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.441+0000 7feaa02679c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9.8 2024-09-14T11:14:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.449+0000 7feaa02679c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:14:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.449+0000 7feaa02679c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-14T11:14:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.449+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5395723102860052709 2024-09-14T11:14:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.449+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:14:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.449+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9__shadow_.ccaQ98QIRy1euSl2h_-gdhqLIgL31n8_0 2024-09-14T11:14:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.449+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:14:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.449+0000 7feaa02679c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:14:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.449+0000 7feaa02679c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5395723102860052709 2024-09-14T11:14:15.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.453+0000 7feaa02679c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:14:15.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.453+0000 7feaa02679c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:14:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.453+0000 7fe9817fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:14:15.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.453+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:14:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.453+0000 7feaa02679c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:14:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.453+0000 7feaa02679c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:14:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.453+0000 7feaa02679c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:14:15.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.453+0000 7feaa02679c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:14:15.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.461+0000 7feaa02679c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:14:15.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.461+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.461+0000 7feaa02679c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:14:15.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.461+0000 7feaa02679c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:14:15.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.461+0000 7feaa02679c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:14:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.465+0000 7feaa02679c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:14:15.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.465+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:14:15.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.465+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366214 cookie 94850702684160 notifier 5723 bl.length()=181 2024-09-14T11:14:15.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.469+0000 7feaa02679c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9 from cache 2024-09-14T11:14:15.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.469+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9, ofs0, ns] 2024-09-14T11:14:15.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.469+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94850702703664 notifier 5723 bl.length()=238 2024-09-14T11:14:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.481+0000 7feaa02679c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9 : miss 2024-09-14T11:14:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.481+0000 7feaa02679c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.481+0000 7feaa02679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.481+0000 7feaa02679c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9 info.flags=0x0 2024-09-14T11:14:15.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.481+0000 7feaa02679c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9 to cache LRU end 2024-09-14T11:14:15.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.485+0000 7feaa02679c0 10 removing key index: WLPRBXUIJTLFWRANGYRT 2024-09-14T11:14:15.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.489+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:WLPRBXUIJTLFWRANGYRT, ofs0, ns] 2024-09-14T11:14:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.489+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94850702690144 notifier 5723 bl.length()=170 2024-09-14T11:14:15.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.493+0000 7feaa02679c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:14:15.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.493+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:14:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.497+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94850702704720 notifier 5723 bl.length()=182 2024-09-14T11:14:15.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.497+0000 7feaa02679c0 10 removing user buckets index 2024-09-14T11:14:15.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.501+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:14:15.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.501+0000 7fe980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366226 cookie 94850702686368 notifier 5723 bl.length()=173 2024-09-14T11:14:15.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.505+0000 7feaa02679c0 10 removing user index: ragweed.client.0 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.509+0000 7feaa02679c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:14:15.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.509+0000 7feaa02679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:14:15.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.509+0000 7fe9817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 94850702690144 notifier 5723 bl.length()=165 2024-09-14T11:14:15.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.517+0000 7fe94f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.525+0000 7feaa02679c0 20 remove_watcher() i=0 2024-09-14T11:14:15.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.525+0000 7feaa02679c0 2 removed watcher, disabling cache 2024-09-14T11:14:15.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.525+0000 7feaa02679c0 20 remove_watcher() i=1 2024-09-14T11:14:15.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.529+0000 7feaa02679c0 20 remove_watcher() i=2 2024-09-14T11:14:15.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.529+0000 7feaa02679c0 20 remove_watcher() i=3 2024-09-14T11:14:15.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.533+0000 7feaa02679c0 20 remove_watcher() i=4 2024-09-14T11:14:15.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.537+0000 7feaa02679c0 20 remove_watcher() i=5 2024-09-14T11:14:15.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.537+0000 7feaa02679c0 20 remove_watcher() i=6 2024-09-14T11:14:15.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.541+0000 7feaa02679c0 20 remove_watcher() i=7 2024-09-14T11:14:15.559 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:14:15.639 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.639 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.685+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.685+0000 7f76234c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.685+0000 7f76234c09c0 20 realm 2024-09-14T11:14:15.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.685+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.685+0000 7f76234c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.685+0000 7f76234c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:15.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.685+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.689+0000 7f76234c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.689+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.689+0000 7f76234c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.689+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.689+0000 7f76234c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:15.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.689+0000 7f76234c09c0 20 searching for the correct realm 2024-09-14T11:14:15.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.693+0000 7f76207c5640 0 -- 172.21.15.148:0/3361398007 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f761005f3b0 msgr2=0x7f7610073110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.701+0000 7f76207c5640 0 -- 172.21.15.148:0/3361398007 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5576d4d36d80 msgr2=0x5576d4d39240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:15.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:14:15.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:15.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:15.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:15.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:14:15.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:15.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 zone default found 2024-09-14T11:14:15.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 4 Realm: () 2024-09-14T11:14:15.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:14:15.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:14:15.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:15.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 zonegroup default 2024-09-14T11:14:15.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.709+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.713+0000 7f76234c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.713+0000 7f76234c09c0 20 started sync module instance, tier type = 2024-09-14T11:14:15.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.713+0000 7f76234c09c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:14:15.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.729+0000 7f76234c09c0 20 add_watcher() i=0 2024-09-14T11:14:15.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.729+0000 7f76234c09c0 20 add_watcher() i=1 2024-09-14T11:14:15.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.729+0000 7f76234c09c0 20 add_watcher() i=2 2024-09-14T11:14:15.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.729+0000 7f76234c09c0 20 add_watcher() i=3 2024-09-14T11:14:15.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.729+0000 7f76234c09c0 20 add_watcher() i=4 2024-09-14T11:14:15.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.729+0000 7f76234c09c0 20 add_watcher() i=5 2024-09-14T11:14:15.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.729+0000 7f76234c09c0 20 add_watcher() i=6 2024-09-14T11:14:15.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.733+0000 7f76234c09c0 20 add_watcher() i=7 2024-09-14T11:14:15.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.733+0000 7f76234c09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:15.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.737+0000 7f74d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.737+0000 7f76234c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:15.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.737+0000 7f76234c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f74d67e4640 20 reqs_thread_entry: start 2024-09-14T11:14:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:14:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 20 Filter name: none 2024-09-14T11:14:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f74cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:14:15.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:14:15.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:14:15.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:14:15.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:15.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 10 removing key index: RTOTXXGVKKHFMEMAPYYI 2024-09-14T11:14:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.817+0000 7f76234c09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:RTOTXXGVKKHFMEMAPYYI, ofs0, ns] 2024-09-14T11:14:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.821+0000 7f74f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 93968865133648 notifier 6045 bl.length()=170 2024-09-14T11:14:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.821+0000 7f76234c09c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:14:15.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.825+0000 7f76234c09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:14:15.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.825+0000 7f74f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 93968865197856 notifier 6045 bl.length()=182 2024-09-14T11:14:15.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.825+0000 7f76234c09c0 10 removing user buckets index 2024-09-14T11:14:15.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.829+0000 7f76234c09c0 10 removing user index: sysuser.client.0 2024-09-14T11:14:15.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.829+0000 7f76234c09c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:14:15.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.829+0000 7f76234c09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:14:15.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.829+0000 7f74f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 93968865196800 notifier 6045 bl.length()=165 2024-09-14T11:14:15.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.833+0000 7f74d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.837+0000 7f76234c09c0 20 remove_watcher() i=0 2024-09-14T11:14:15.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.837+0000 7f76234c09c0 2 removed watcher, disabling cache 2024-09-14T11:14:15.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.841+0000 7f76234c09c0 20 remove_watcher() i=1 2024-09-14T11:14:15.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.841+0000 7f76234c09c0 20 remove_watcher() i=2 2024-09-14T11:14:15.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.845+0000 7f76234c09c0 20 remove_watcher() i=3 2024-09-14T11:14:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.845+0000 7f76234c09c0 20 remove_watcher() i=4 2024-09-14T11:14:15.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.849+0000 7f76234c09c0 20 remove_watcher() i=5 2024-09-14T11:14:15.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.849+0000 7f76234c09c0 20 remove_watcher() i=6 2024-09-14T11:14:15.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:14:15.853+0000 7f76234c09c0 20 remove_watcher() i=7 2024-09-14T11:14:15.866 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:14:15.866 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:14:15.958 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:14:15.968 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:14:15.968 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:14:15.968 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:15.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:14:15.974 INFO:teuthology.orchestra.run.smithi148.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:14:15.975 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:16.020 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:16.020 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:14:16.069 INFO:tasks.workunit:timeout=3h 2024-09-14T11:14:16.069 INFO:tasks.workunit:cleanup=True 2024-09-14T11:14:16.069 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:14:16.121 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:15:11.195 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:11.197 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:15:11.198 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:15:11.245 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:15:11.248 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:15:11.248 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:15:11.305 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:15:11.358 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:15:11.402 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:15:11.404 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:15:11.404 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:15:11.449 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:15:11.453 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T11:15:11.453 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:15:11.499 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:15:11.500 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:15:11.501 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:15:11.552 INFO:tasks.workunit.client.0.smithi148.stderr:+ ulimit -c 0 2024-09-14T11:15:11.552 INFO:tasks.workunit.client.0.smithi148.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:15:11.553 INFO:tasks.workunit.client.0.smithi148.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:15:11.553 INFO:tasks.workunit.client.0.smithi148.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:15:14.461 INFO:tasks.workunit.client.0.smithi148.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ deactivate nondestructive 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ hash -r 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi148.stderr:++ export VIRTUAL_ENV 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ export PATH 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -z '' ']' 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ PS1='(rgw) ' 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ export PS1 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:++ hash -r 2024-09-14T11:15:14.463 INFO:tasks.workunit.client.0.smithi148.stderr:+ pip install pip --upgrade 2024-09-14T11:15:14.858 INFO:tasks.workunit.client.0.smithi148.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:15:15.058 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting pip 2024-09-14T11:15:15.064 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:15:15.099 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: pip 2024-09-14T11:15:15.099 INFO:tasks.workunit.client.0.smithi148.stdout: Attempting uninstall: pip 2024-09-14T11:15:15.100 INFO:tasks.workunit.client.0.smithi148.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:15:15.359 INFO:tasks.workunit.client.0.smithi148.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:15:15.365 INFO:tasks.workunit.client.0.smithi148.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:15:16.112 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed pip-24.2 2024-09-14T11:15:16.173 INFO:tasks.workunit.client.0.smithi148.stderr:+ pip install boto3 2024-09-14T11:15:17.145 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting boto3 2024-09-14T11:15:17.146 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:15:17.705 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:15:17.706 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:15:17.753 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:15:17.754 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:15:17.799 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:15:17.800 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:15:17.851 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:15:17.852 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:15:17.953 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:15:17.954 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:15:18.206 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:15:18.207 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:15:18.211 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:15:18.212 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:15:18.222 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:15:18.223 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:15:18.224 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:15:18.226 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:15:18.227 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:15:18.295 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:15:19.312 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:15:19.506 INFO:tasks.workunit.client.0.smithi148.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:15:19.650 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:15:19.688 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:19.688 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:19.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.731+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:19.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 realm 2024-09-14T11:15:19.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:19.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:19.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:19.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:19.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:19.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.735+0000 7ff099be49c0 20 searching for the correct realm 2024-09-14T11:15:19.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.743+0000 7ff097eeb640 0 -- 172.21.15.148:0/226701305 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x559911142050 msgr2=0x5599111444e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:19.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.751+0000 7ff0976ea640 0 -- 172.21.15.148:0/226701305 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5599111461b0 msgr2=0x559911148650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:19.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:19.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:19.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:19.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:19.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:19.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:19.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:19.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:19.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:19.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 zone default found 2024-09-14T11:15:19.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 4 Realm: () 2024-09-14T11:15:19.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:19.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:19.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:19.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 zonegroup default 2024-09-14T11:15:19.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.755+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.759+0000 7ff099be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:19.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.759+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.759+0000 7ff099be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:19.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.759+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.759+0000 7ff099be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:19.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.759+0000 7ff099be49c0 20 started sync module instance, tier type = 2024-09-14T11:15:19.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.759+0000 7ff099be49c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:19.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 20 add_watcher() i=0 2024-09-14T11:15:19.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 20 add_watcher() i=1 2024-09-14T11:15:19.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 20 add_watcher() i=2 2024-09-14T11:15:19.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 20 add_watcher() i=3 2024-09-14T11:15:19.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 20 add_watcher() i=4 2024-09-14T11:15:19.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 20 add_watcher() i=5 2024-09-14T11:15:19.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 20 add_watcher() i=6 2024-09-14T11:15:19.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 20 add_watcher() i=7 2024-09-14T11:15:19.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.779+0000 7ff099be49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:19.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7fef4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:19.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:19.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:19.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 5 note: GC not initialized 2024-09-14T11:15:19.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7fef4cfe1640 20 reqs_thread_entry: start 2024-09-14T11:15:19.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:19.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 20 Filter name: none 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7feec67fc640 20 reqs_thread_entry: start 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.783+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 20 rados_obj.operate() r=0 bl.length=22 2024-09-14T11:15:19.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-14T11:15:19.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:15:19.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-14T11:15:19.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:19.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T11:15:19.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-14T11:15:19.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-14T11:15:19.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:19.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-14T11:15:19.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7ff099be49c0 20 get_user_info_from_index found 0 xattrs 2024-09-14T11:15:19.785 INFO:tasks.workunit.client.0.smithi148.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-14T11:15:19.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.787+0000 7fef4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:19.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.791+0000 7ff099be49c0 20 remove_watcher() i=0 2024-09-14T11:15:19.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.791+0000 7ff099be49c0 2 removed watcher, disabling cache 2024-09-14T11:15:19.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.791+0000 7ff099be49c0 20 remove_watcher() i=1 2024-09-14T11:15:19.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.795+0000 7ff099be49c0 20 remove_watcher() i=2 2024-09-14T11:15:19.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.795+0000 7ff099be49c0 20 remove_watcher() i=3 2024-09-14T11:15:19.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.799+0000 7ff099be49c0 20 remove_watcher() i=4 2024-09-14T11:15:19.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.799+0000 7ff099be49c0 20 remove_watcher() i=5 2024-09-14T11:15:19.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.803+0000 7ff099be49c0 20 remove_watcher() i=6 2024-09-14T11:15:19.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:19.807+0000 7ff099be49c0 20 remove_watcher() i=7 2024-09-14T11:15:38.079 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:38.079 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:38.183 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:38.183 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:38.316 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:38.317 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:38.451 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:38.452 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:38.535 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:38.535 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:38.631 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:38.631 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:38.720 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard add 2024-09-14T11:15:38.720 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:38.721 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:15:38.753 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:38.753 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:38.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.799+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 realm 2024-09-14T11:15:38.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:38.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:38.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.803+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.807+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:38.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.807+0000 7fbbb2c4f9c0 20 searching for the correct realm 2024-09-14T11:15:38.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.811+0000 7fbbaff54640 0 -- 172.21.15.148:0/168906240 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fbba801f040 msgr2=0x7fbba8014940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:38.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.815+0000 7fbbb0755640 0 -- 172.21.15.148:0/168906240 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fbba8041950 msgr2=0x7fbba801f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:38.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:38.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:38.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:38.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:38.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:38.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:38.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:38.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.823+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:38.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 zone default found 2024-09-14T11:15:38.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 4 Realm: () 2024-09-14T11:15:38.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:38.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:38.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:38.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 zonegroup default 2024-09-14T11:15:38.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 started sync module instance, tier type = 2024-09-14T11:15:38.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.827+0000 7fbbb2c4f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:38.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 20 add_watcher() i=0 2024-09-14T11:15:38.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 20 add_watcher() i=1 2024-09-14T11:15:38.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 20 add_watcher() i=2 2024-09-14T11:15:38.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 20 add_watcher() i=3 2024-09-14T11:15:38.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 20 add_watcher() i=4 2024-09-14T11:15:38.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 20 add_watcher() i=5 2024-09-14T11:15:38.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 20 add_watcher() i=6 2024-09-14T11:15:38.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 20 add_watcher() i=7 2024-09-14T11:15:38.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.847+0000 7fbbb2c4f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:38.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fba66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:38.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fbbb2c4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:38.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fbbb2c4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:38.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fbbb2c4f9c0 5 note: GC not initialized 2024-09-14T11:15:38.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fba65fdb640 20 reqs_thread_entry: start 2024-09-14T11:15:38.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fbbb2c4f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:38.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fbbb2c4f9c0 20 Filter name: none 2024-09-14T11:15:38.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fb9d77fe640 20 reqs_thread_entry: start 2024-09-14T11:15:38.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.851+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:38.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:38.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:38.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:38.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:38.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.855+0000 7fbbb2c4f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:38.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.859+0000 7fba66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:38.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.863+0000 7fbbb2c4f9c0 20 remove_watcher() i=0 2024-09-14T11:15:38.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.863+0000 7fbbb2c4f9c0 2 removed watcher, disabling cache 2024-09-14T11:15:38.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.867+0000 7fbbb2c4f9c0 20 remove_watcher() i=1 2024-09-14T11:15:38.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.871+0000 7fbbb2c4f9c0 20 remove_watcher() i=2 2024-09-14T11:15:38.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.871+0000 7fbbb2c4f9c0 20 remove_watcher() i=3 2024-09-14T11:15:38.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.875+0000 7fbbb2c4f9c0 20 remove_watcher() i=4 2024-09-14T11:15:38.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.875+0000 7fbbb2c4f9c0 20 remove_watcher() i=5 2024-09-14T11:15:38.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.879+0000 7fbbb2c4f9c0 20 remove_watcher() i=6 2024-09-14T11:15:38.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.879+0000 7fbbb2c4f9c0 20 remove_watcher() i=7 2024-09-14T11:15:38.893 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:38.893 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:38.893 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: a-bucket id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:15:38.894 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:38.894 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:15:38.924 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:38.924 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:38.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 20 realm 2024-09-14T11:15:38.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:38.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.971+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.975+0000 7f0c5dcae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:38.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.975+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.975+0000 7f0c5dcae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:38.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.975+0000 7f0c5dcae9c0 20 searching for the correct realm 2024-09-14T11:15:38.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.979+0000 7f0c5bfb5640 0 -- 172.21.15.148:0/932864461 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5616664eae30 msgr2=0x5616664ed2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:38.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.987+0000 7f0c5b7b4640 0 -- 172.21.15.148:0/932864461 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5616664ef1a0 msgr2=0x5616664f1590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:38.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:38.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:38.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:38.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:38.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:38.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:38.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:38.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 zone default found 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 4 Realm: () 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 zonegroup default 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:38.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:38.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 started sync module instance, tier type = 2024-09-14T11:15:38.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:38.995+0000 7f0c5dcae9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:39.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.015+0000 7f0c5dcae9c0 20 add_watcher() i=0 2024-09-14T11:15:39.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.015+0000 7f0c5dcae9c0 20 add_watcher() i=1 2024-09-14T11:15:39.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.015+0000 7f0c5dcae9c0 20 add_watcher() i=2 2024-09-14T11:15:39.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.015+0000 7f0c5dcae9c0 20 add_watcher() i=3 2024-09-14T11:15:39.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.015+0000 7f0c5dcae9c0 20 add_watcher() i=4 2024-09-14T11:15:39.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.015+0000 7f0c5dcae9c0 20 add_watcher() i=5 2024-09-14T11:15:39.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.015+0000 7f0c5dcae9c0 20 add_watcher() i=6 2024-09-14T11:15:39.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.019+0000 7f0c5dcae9c0 20 add_watcher() i=7 2024-09-14T11:15:39.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.019+0000 7f0c5dcae9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 5 note: GC not initialized 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0b10fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 20 Filter name: none 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0a8a7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:39.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:39.021 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:39.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.023+0000 7f0c5dcae9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:15:39.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.027+0000 7f0b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:39.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.031+0000 7f0c5dcae9c0 20 remove_watcher() i=0 2024-09-14T11:15:39.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.031+0000 7f0c5dcae9c0 2 removed watcher, disabling cache 2024-09-14T11:15:39.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.035+0000 7f0c5dcae9c0 20 remove_watcher() i=1 2024-09-14T11:15:39.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.035+0000 7f0c5dcae9c0 20 remove_watcher() i=2 2024-09-14T11:15:39.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.039+0000 7f0c5dcae9c0 20 remove_watcher() i=3 2024-09-14T11:15:39.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.039+0000 7f0c5dcae9c0 20 remove_watcher() i=4 2024-09-14T11:15:39.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.043+0000 7f0c5dcae9c0 20 remove_watcher() i=5 2024-09-14T11:15:39.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.043+0000 7f0c5dcae9c0 20 remove_watcher() i=6 2024-09-14T11:15:39.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.047+0000 7f0c5dcae9c0 20 remove_watcher() i=7 2024-09-14T11:15:39.060 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshard list 2024-09-14T11:15:39.085 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:39.085 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:39.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.131+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.135+0000 7fa2e61119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.135+0000 7fa2e61119c0 20 realm 2024-09-14T11:15:39.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.135+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.135+0000 7fa2e61119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.135+0000 7fa2e61119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:39.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.135+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.135+0000 7fa2e61119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.135+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.139+0000 7fa2e61119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:39.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.139+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.139+0000 7fa2e61119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:39.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.139+0000 7fa2e61119c0 20 searching for the correct realm 2024-09-14T11:15:39.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.143+0000 7fa2e3416640 0 -- 172.21.15.148:0/3029165372 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fa2dc069050 msgr2=0x7fa2dc060fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:39.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.151+0000 7fa2e4418640 0 -- 172.21.15.148:0/3029165372 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x558711a37330 msgr2=0x558711a39720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:39.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.155+0000 7fa2e61119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:39.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.155+0000 7fa2e61119c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:39.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.155+0000 7fa2e61119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:39.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.155+0000 7fa2e61119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:39.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.155+0000 7fa2e61119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:39.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.155+0000 7fa2e61119c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:39.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.155+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 zone default found 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 4 Realm: () 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 zonegroup default 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 started sync module instance, tier type = 2024-09-14T11:15:39.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.159+0000 7fa2e61119c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:39.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 20 add_watcher() i=0 2024-09-14T11:15:39.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 20 add_watcher() i=1 2024-09-14T11:15:39.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 20 add_watcher() i=2 2024-09-14T11:15:39.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 20 add_watcher() i=3 2024-09-14T11:15:39.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 20 add_watcher() i=4 2024-09-14T11:15:39.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 20 add_watcher() i=5 2024-09-14T11:15:39.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 20 add_watcher() i=6 2024-09-14T11:15:39.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 20 add_watcher() i=7 2024-09-14T11:15:39.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.179+0000 7fa2e61119c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:39.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.183+0000 7fa199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:39.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.183+0000 7fa2e61119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:39.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.183+0000 7fa2e61119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:39.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.183+0000 7fa2e61119c0 5 note: GC not initialized 2024-09-14T11:15:39.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.183+0000 7fa198fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:39.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.183+0000 7fa2e61119c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:39.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.183+0000 7fa2e61119c0 20 Filter name: none 2024-09-14T11:15:39.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.183+0000 7fa1127fc640 20 reqs_thread_entry: start 2024-09-14T11:15:39.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.195+0000 7fa199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.199+0000 7fa2e61119c0 20 remove_watcher() i=0 2024-09-14T11:15:39.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.199+0000 7fa2e61119c0 2 removed watcher, disabling cache 2024-09-14T11:15:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.203+0000 7fa2e61119c0 20 remove_watcher() i=1 2024-09-14T11:15:39.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.203+0000 7fa2e61119c0 20 remove_watcher() i=2 2024-09-14T11:15:39.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.207+0000 7fa2e61119c0 20 remove_watcher() i=3 2024-09-14T11:15:39.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.207+0000 7fa2e61119c0 20 remove_watcher() i=4 2024-09-14T11:15:39.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.211+0000 7fa2e61119c0 20 remove_watcher() i=5 2024-09-14T11:15:39.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.215+0000 7fa2e61119c0 20 remove_watcher() i=6 2024-09-14T11:15:39.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.215+0000 7fa2e61119c0 20 remove_watcher() i=7 2024-09-14T11:15:39.229 INFO:tasks.workunit.client.0.smithi148.stderr:bucket name a-bucket 2024-09-14T11:15:39.229 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard process 2024-09-14T11:15:39.229 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:39.229 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshard process 2024-09-14T11:15:39.254 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:39.254 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:39.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.299+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 realm 2024-09-14T11:15:39.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:39.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:39.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:39.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.303+0000 7efdfa7db9c0 20 searching for the correct realm 2024-09-14T11:15:39.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.311+0000 7efdf7ae0640 0 -- 172.21.15.148:0/3579157515 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7efdf0061dc0 msgr2=0x7efdf0060830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:39.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.315+0000 7efdf7ae0640 0 -- 172.21.15.148:0/3579157515 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5627ba29c160 msgr2=0x5627ba29e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:39.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:39.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:39.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:39.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:39.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:39.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:39.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.323+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:39.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:39.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 zone default found 2024-09-14T11:15:39.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 4 Realm: () 2024-09-14T11:15:39.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:39.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:39.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:39.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 zonegroup default 2024-09-14T11:15:39.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:39.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 started sync module instance, tier type = 2024-09-14T11:15:39.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.327+0000 7efdfa7db9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 20 add_watcher() i=0 2024-09-14T11:15:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 20 add_watcher() i=1 2024-09-14T11:15:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 20 add_watcher() i=2 2024-09-14T11:15:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 20 add_watcher() i=3 2024-09-14T11:15:39.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 20 add_watcher() i=4 2024-09-14T11:15:39.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 20 add_watcher() i=5 2024-09-14T11:15:39.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 20 add_watcher() i=6 2024-09-14T11:15:39.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 20 add_watcher() i=7 2024-09-14T11:15:39.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.347+0000 7efdfa7db9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:39.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.351+0000 7efcaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:39.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.355+0000 7efdfa7db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:39.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.355+0000 7efdfa7db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:39.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.355+0000 7efdfa7db9c0 5 note: GC not initialized 2024-09-14T11:15:39.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.355+0000 7efcadfdb640 20 reqs_thread_entry: start 2024-09-14T11:15:39.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.355+0000 7efdfa7db9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:39.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.355+0000 7efdfa7db9c0 20 Filter name: none 2024-09-14T11:15:39.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.355+0000 7efc1f7fe640 20 reqs_thread_entry: start 2024-09-14T11:15:39.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.355+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000000 2024-09-14T11:15:39.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.359+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:15:39.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.359+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000001 2024-09-14T11:15:39.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.363+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:15:39.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.363+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000002 2024-09-14T11:15:39.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.371+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:15:39.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.371+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000003 2024-09-14T11:15:39.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.375+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:15:39.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.375+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000004 2024-09-14T11:15:39.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.379+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:15:39.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.379+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000005 2024-09-14T11:15:39.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.387+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:15:39.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.387+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000006 2024-09-14T11:15:39.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.387+0000 7efdfa7db9c0 20 process_entry resharding a-bucket 2024-09-14T11:15:39.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.387+0000 7efdfa7db9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:39.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.387+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:39.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:15:39.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:39.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:15:39.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:39.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:39.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:39.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:39.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:39.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:39.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.391+0000 7efdfa7db9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:15:39.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.407+0000 7efdfa7db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:39.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.407+0000 7efdfa7db9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:39.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.407+0000 7efdfa7db9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:39.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.407+0000 7efdfa7db9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:15:39.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.407+0000 7efccf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94728627018864 notifier 6141 bl.length()=911 2024-09-14T11:15:39.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.407+0000 7efccf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:39.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.407+0000 7efccf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:39.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.407+0000 7efccf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:39.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.411+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:15:39.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.411+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:15:39.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.411+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:15:39.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.411+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:15:39.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.0 2024-09-14T11:15:39.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.0 2024-09-14T11:15:39.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.1 2024-09-14T11:15:39.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.1 2024-09-14T11:15:39.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.2 2024-09-14T11:15:39.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.2 2024-09-14T11:15:39.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.3 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.3 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.4 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.4 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.5 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.5 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.6 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.6 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.7 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.7 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.8 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.8 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.9 2024-09-14T11:15:39.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.9 2024-09-14T11:15:39.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.10 2024-09-14T11:15:39.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.10 2024-09-14T11:15:39.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.11 2024-09-14T11:15:39.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.11 2024-09-14T11:15:39.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.0 2024-09-14T11:15:39.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1 2024-09-14T11:15:39.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.423+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2 2024-09-14T11:15:39.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.427+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3 2024-09-14T11:15:39.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.427+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.4 2024-09-14T11:15:39.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.427+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.5 2024-09-14T11:15:39.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.427+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.6 2024-09-14T11:15:39.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.427+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.7 2024-09-14T11:15:39.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.431+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.8 2024-09-14T11:15:39.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.431+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.9 2024-09-14T11:15:39.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.431+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.10 2024-09-14T11:15:39.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.431+0000 7efdfa7db9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:39.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.431+0000 7efdfa7db9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:15:39.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.435+0000 7efdfa7db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:39.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.435+0000 7efdfa7db9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:39.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.435+0000 7efdfa7db9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:39.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.435+0000 7efdfa7db9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:15:39.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.435+0000 7efcceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94728627018864 notifier 6141 bl.length()=911 2024-09-14T11:15:39.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.435+0000 7efcceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:39.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.435+0000 7efcceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:39.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.435+0000 7efcceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:39.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.439+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:15:39.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.439+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:15:39.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.439+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:15:39.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.439+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:15:39.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.447+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.0 2024-09-14T11:15:39.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.447+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1 2024-09-14T11:15:39.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.447+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2 2024-09-14T11:15:39.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.447+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3 2024-09-14T11:15:39.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.447+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.4 2024-09-14T11:15:39.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.451+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.5 2024-09-14T11:15:39.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.451+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.6 2024-09-14T11:15:39.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.451+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.7 2024-09-14T11:15:39.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.451+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.8 2024-09-14T11:15:39.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.451+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.9 2024-09-14T11:15:39.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.451+0000 7efdfa7db9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.10 2024-09-14T11:15:39.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.451+0000 7efdfa7db9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:39.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.451+0000 7efdfa7db9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:15:39.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.455+0000 7efdfa7db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:39.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.455+0000 7efdfa7db9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:39.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.455+0000 7efdfa7db9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:39.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.455+0000 7efdfa7db9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:15:39.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.455+0000 7efccf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94728627018864 notifier 6141 bl.length()=879 2024-09-14T11:15:39.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.455+0000 7efccf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:39.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.455+0000 7efccf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:39.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.455+0000 7efccf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:39.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.459+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:15:39.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.459+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:15:39.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.459+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:15:39.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.459+0000 7efdfa7db9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:15:39.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.463+0000 7efdfa7db9c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:15:39.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.467+0000 7efdfa7db9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:15:39.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.471+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:15:39.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.471+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000007 2024-09-14T11:15:39.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.475+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:15:39.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.475+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000008 2024-09-14T11:15:39.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.479+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:15:39.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.479+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000009 2024-09-14T11:15:39.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.483+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:15:39.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.483+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000010 2024-09-14T11:15:39.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.491+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:15:39.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.491+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000011 2024-09-14T11:15:39.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.495+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:15:39.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.495+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000012 2024-09-14T11:15:39.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.499+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:15:39.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.499+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000013 2024-09-14T11:15:39.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.503+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:15:39.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.503+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000014 2024-09-14T11:15:39.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.511+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:15:39.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.511+0000 7efdfa7db9c0 20 processing logshard = reshard.0000000015 2024-09-14T11:15:39.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.515+0000 7efdfa7db9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:15:39.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.519+0000 7efcaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:39.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.523+0000 7efdfa7db9c0 20 remove_watcher() i=0 2024-09-14T11:15:39.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.523+0000 7efdfa7db9c0 2 removed watcher, disabling cache 2024-09-14T11:15:39.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.523+0000 7efdfa7db9c0 20 remove_watcher() i=1 2024-09-14T11:15:39.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.527+0000 7efdfa7db9c0 20 remove_watcher() i=2 2024-09-14T11:15:39.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.531+0000 7efdfa7db9c0 20 remove_watcher() i=3 2024-09-14T11:15:39.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.531+0000 7efdfa7db9c0 20 remove_watcher() i=4 2024-09-14T11:15:39.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.535+0000 7efdfa7db9c0 20 remove_watcher() i=5 2024-09-14T11:15:39.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.535+0000 7efdfa7db9c0 20 remove_watcher() i=6 2024-09-14T11:15:39.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:39.539+0000 7efdfa7db9c0 20 remove_watcher() i=7 2024-09-14T11:15:44.562 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:15:44.595 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:44.604 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:44.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.643+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.643+0000 7f0a77f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.643+0000 7f0a77f539c0 20 realm 2024-09-14T11:15:44.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.643+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.643+0000 7f0a77f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.643+0000 7f0a77f539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:44.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.643+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.647+0000 7f0a77f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.647+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.647+0000 7f0a77f539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:44.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.647+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.647+0000 7f0a77f539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:44.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.647+0000 7f0a77f539c0 20 searching for the correct realm 2024-09-14T11:15:44.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.651+0000 7f0a75258640 0 -- 172.21.15.148:0/2695891873 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f0a7002b920 msgr2=0x7f0a7000e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:44.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.863+0000 7f0a7625a640 0 -- 172.21.15.148:0/2695891873 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x561f1a679be0 msgr2=0x561f1a67c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:44.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:44.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:44.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:44.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:44.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:44.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:44.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:44.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 zone default found 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 4 Realm: () 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 zonegroup default 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.879+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.883+0000 7f0a77f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.883+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.883+0000 7f0a77f539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:44.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.883+0000 7f0a77f539c0 20 started sync module instance, tier type = 2024-09-14T11:15:44.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.883+0000 7f0a77f539c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:44.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.903+0000 7f0a77f539c0 20 add_watcher() i=0 2024-09-14T11:15:44.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.903+0000 7f0a77f539c0 20 add_watcher() i=1 2024-09-14T11:15:44.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.903+0000 7f0a77f539c0 20 add_watcher() i=2 2024-09-14T11:15:44.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.903+0000 7f0a77f539c0 20 add_watcher() i=3 2024-09-14T11:15:44.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.903+0000 7f0a77f539c0 20 add_watcher() i=4 2024-09-14T11:15:44.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.903+0000 7f0a77f539c0 20 add_watcher() i=5 2024-09-14T11:15:44.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.903+0000 7f0a77f539c0 20 add_watcher() i=6 2024-09-14T11:15:44.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.907+0000 7f0a77f539c0 20 add_watcher() i=7 2024-09-14T11:15:44.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.907+0000 7f0a77f539c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:44.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.911+0000 7f0927fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:44.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.911+0000 7f0a77f539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:44.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.911+0000 7f0a77f539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:44.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.911+0000 7f0a77f539c0 5 note: GC not initialized 2024-09-14T11:15:44.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0926ffd640 20 reqs_thread_entry: start 2024-09-14T11:15:44.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:44.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 Filter name: none 2024-09-14T11:15:44.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0924ff9640 20 reqs_thread_entry: start 2024-09-14T11:15:44.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:44.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:44.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:44.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:44.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.915+0000 7f0a77f539c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.919+0000 7f0a77f539c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.919+0000 7f0a77f539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:44.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.923+0000 7f0927fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:44.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.927+0000 7f0a77f539c0 20 remove_watcher() i=0 2024-09-14T11:15:44.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.927+0000 7f0a77f539c0 2 removed watcher, disabling cache 2024-09-14T11:15:44.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.927+0000 7f0a77f539c0 20 remove_watcher() i=1 2024-09-14T11:15:44.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.931+0000 7f0a77f539c0 20 remove_watcher() i=2 2024-09-14T11:15:44.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.931+0000 7f0a77f539c0 20 remove_watcher() i=3 2024-09-14T11:15:44.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.935+0000 7f0a77f539c0 20 remove_watcher() i=4 2024-09-14T11:15:44.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.935+0000 7f0a77f539c0 20 remove_watcher() i=5 2024-09-14T11:15:44.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.939+0000 7f0a77f539c0 20 remove_watcher() i=6 2024-09-14T11:15:44.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:44.943+0000 7f0a77f539c0 20 remove_watcher() i=7 2024-09-14T11:15:44.954 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:44.954 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:44.954 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: a-bucket id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:15:44.954 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:44.954 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard add non empty bucket 2024-09-14T11:15:44.954 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:44.959 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:44.959 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:45.009 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:45.009 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:45.064 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:45.065 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:45.169 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:45.169 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:45.268 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:45.269 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:45.371 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:45.371 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:45.475 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:45.475 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:45.570 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:45.664 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:15:45.696 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:45.697 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:45.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.743+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:45.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:45.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 20 realm 2024-09-14T11:15:45.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:45.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:45.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:45.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:45.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:45.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:45.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.747+0000 7f38ab34c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:45.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.751+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:45.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.751+0000 7f38ab34c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:45.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.751+0000 7f38ab34c9c0 20 searching for the correct realm 2024-09-14T11:15:45.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.751+0000 7f38a8e52640 0 -- 172.21.15.148:0/131591347 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f3898068020 msgr2=0x7f3898045b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:45.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:45.967+0000 7f38a8e52640 0 -- 172.21.15.148:0/131591347 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x5560dd8a1b50 msgr2=0x7f38a00c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:46.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.183+0000 7f38ab34c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:46.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.183+0000 7f38ab34c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:46.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.183+0000 7f38ab34c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:46.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.183+0000 7f38ab34c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:46.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.183+0000 7f38ab34c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:46.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.183+0000 7f38ab34c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:46.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.183+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:46.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:46.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 zone default found 2024-09-14T11:15:46.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 4 Realm: () 2024-09-14T11:15:46.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:46.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:46.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:46.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 zonegroup default 2024-09-14T11:15:46.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.187+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.191+0000 7f38ab34c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.191+0000 7f38ab34c9c0 20 started sync module instance, tier type = 2024-09-14T11:15:46.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.191+0000 7f38ab34c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:46.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.211+0000 7f38ab34c9c0 20 add_watcher() i=0 2024-09-14T11:15:46.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.211+0000 7f38ab34c9c0 20 add_watcher() i=1 2024-09-14T11:15:46.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.211+0000 7f38ab34c9c0 20 add_watcher() i=2 2024-09-14T11:15:46.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.211+0000 7f38ab34c9c0 20 add_watcher() i=3 2024-09-14T11:15:46.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.211+0000 7f38ab34c9c0 20 add_watcher() i=4 2024-09-14T11:15:46.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.211+0000 7f38ab34c9c0 20 add_watcher() i=5 2024-09-14T11:15:46.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.211+0000 7f38ab34c9c0 20 add_watcher() i=6 2024-09-14T11:15:46.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.215+0000 7f38ab34c9c0 20 add_watcher() i=7 2024-09-14T11:15:46.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.215+0000 7f38ab34c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:46.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.219+0000 7f375efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:46.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:46.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:46.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 5 note: GC not initialized 2024-09-14T11:15:46.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f375dfe3640 20 reqs_thread_entry: start 2024-09-14T11:15:46.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:46.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 Filter name: none 2024-09-14T11:15:46.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f36cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:15:46.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:46.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:46.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:46.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:46.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.223+0000 7f38ab34c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.227+0000 7f38ab34c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:46.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.227+0000 7f38ab34c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:46.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.231+0000 7f375efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:46.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.235+0000 7f38ab34c9c0 20 remove_watcher() i=0 2024-09-14T11:15:46.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.235+0000 7f38ab34c9c0 2 removed watcher, disabling cache 2024-09-14T11:15:46.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.235+0000 7f38ab34c9c0 20 remove_watcher() i=1 2024-09-14T11:15:46.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.239+0000 7f38ab34c9c0 20 remove_watcher() i=2 2024-09-14T11:15:46.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.239+0000 7f38ab34c9c0 20 remove_watcher() i=3 2024-09-14T11:15:46.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.243+0000 7f38ab34c9c0 20 remove_watcher() i=4 2024-09-14T11:15:46.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.243+0000 7f38ab34c9c0 20 remove_watcher() i=5 2024-09-14T11:15:46.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.247+0000 7f38ab34c9c0 20 remove_watcher() i=6 2024-09-14T11:15:46.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.251+0000 7f38ab34c9c0 20 remove_watcher() i=7 2024-09-14T11:15:46.264 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:46.264 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:46.264 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: a-bucket id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:15:46.264 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:46.264 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:15:46.297 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:46.297 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:46.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.343+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 realm 2024-09-14T11:15:46.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:46.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:46.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:46.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.347+0000 7fe13367f9c0 20 searching for the correct realm 2024-09-14T11:15:46.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.355+0000 7fe130984640 0 -- 172.21.15.148:0/4088996417 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55739019cd30 msgr2=0x55739019f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:46.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.359+0000 7fe131185640 0 -- 172.21.15.148:0/4088996417 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fe12c01e130 msgr2=0x7fe12c06c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 zone default found 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 4 Realm: () 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 zonegroup default 2024-09-14T11:15:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.367+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.371+0000 7fe13367f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.371+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.371+0000 7fe13367f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.371+0000 7fe13367f9c0 20 started sync module instance, tier type = 2024-09-14T11:15:46.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.371+0000 7fe13367f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:46.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.387+0000 7fe13367f9c0 20 add_watcher() i=0 2024-09-14T11:15:46.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.387+0000 7fe13367f9c0 20 add_watcher() i=1 2024-09-14T11:15:46.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.387+0000 7fe13367f9c0 20 add_watcher() i=2 2024-09-14T11:15:46.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.387+0000 7fe13367f9c0 20 add_watcher() i=3 2024-09-14T11:15:46.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.387+0000 7fe13367f9c0 20 add_watcher() i=4 2024-09-14T11:15:46.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.387+0000 7fe13367f9c0 20 add_watcher() i=5 2024-09-14T11:15:46.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.387+0000 7fe13367f9c0 20 add_watcher() i=6 2024-09-14T11:15:46.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.391+0000 7fe13367f9c0 20 add_watcher() i=7 2024-09-14T11:15:46.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.391+0000 7fe13367f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:46.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fdfe77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:46.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:46.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:46.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 5 note: GC not initialized 2024-09-14T11:15:46.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fdfe67e4640 20 reqs_thread_entry: start 2024-09-14T11:15:46.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:46.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 20 Filter name: none 2024-09-14T11:15:46.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fdf57fff640 20 reqs_thread_entry: start 2024-09-14T11:15:46.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:46.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.395+0000 7fe13367f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.399+0000 7fe13367f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.399+0000 7fe13367f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.399+0000 7fe13367f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.399+0000 7fe13367f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.399+0000 7fe13367f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:46.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.399+0000 7fe13367f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:15:46.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.403+0000 7fdfe77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:46.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.407+0000 7fe13367f9c0 20 remove_watcher() i=0 2024-09-14T11:15:46.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.407+0000 7fe13367f9c0 2 removed watcher, disabling cache 2024-09-14T11:15:46.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.407+0000 7fe13367f9c0 20 remove_watcher() i=1 2024-09-14T11:15:46.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.411+0000 7fe13367f9c0 20 remove_watcher() i=2 2024-09-14T11:15:46.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.411+0000 7fe13367f9c0 20 remove_watcher() i=3 2024-09-14T11:15:46.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.415+0000 7fe13367f9c0 20 remove_watcher() i=4 2024-09-14T11:15:46.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.415+0000 7fe13367f9c0 20 remove_watcher() i=5 2024-09-14T11:15:46.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.419+0000 7fe13367f9c0 20 remove_watcher() i=6 2024-09-14T11:15:46.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.423+0000 7fe13367f9c0 20 remove_watcher() i=7 2024-09-14T11:15:46.433 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshard list 2024-09-14T11:15:46.457 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:46.458 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:46.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.503+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.503+0000 7fce719159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.503+0000 7fce719159c0 20 realm 2024-09-14T11:15:46.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.503+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:46.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:46.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:46.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.507+0000 7fce719159c0 20 searching for the correct realm 2024-09-14T11:15:46.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.515+0000 7fce6ec1a640 0 -- 172.21.15.148:0/1113120430 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fce6806bc90 msgr2=0x7fce68063ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:46.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.519+0000 7fce6fc1c640 0 -- 172.21.15.148:0/1113120430 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x563b5d58cfe0 msgr2=0x563b5d58f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:46.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:46.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:46.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:46.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:46.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:46.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:46.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:46.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:46.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 zone default found 2024-09-14T11:15:46.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 4 Realm: () 2024-09-14T11:15:46.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:46.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:46.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:46.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 zonegroup default 2024-09-14T11:15:46.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 started sync module instance, tier type = 2024-09-14T11:15:46.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.527+0000 7fce719159c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:46.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.547+0000 7fce719159c0 20 add_watcher() i=0 2024-09-14T11:15:46.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.547+0000 7fce719159c0 20 add_watcher() i=1 2024-09-14T11:15:46.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.547+0000 7fce719159c0 20 add_watcher() i=2 2024-09-14T11:15:46.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.547+0000 7fce719159c0 20 add_watcher() i=3 2024-09-14T11:15:46.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.547+0000 7fce719159c0 20 add_watcher() i=4 2024-09-14T11:15:46.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.547+0000 7fce719159c0 20 add_watcher() i=5 2024-09-14T11:15:46.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.547+0000 7fce719159c0 20 add_watcher() i=6 2024-09-14T11:15:46.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.551+0000 7fce719159c0 20 add_watcher() i=7 2024-09-14T11:15:46.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.551+0000 7fce719159c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:46.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.555+0000 7fcd25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:46.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.555+0000 7fce719159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:46.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.555+0000 7fce719159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:46.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.555+0000 7fce719159c0 5 note: GC not initialized 2024-09-14T11:15:46.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.555+0000 7fcd24fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:46.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.555+0000 7fce719159c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:46.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.555+0000 7fce719159c0 20 Filter name: none 2024-09-14T11:15:46.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.555+0000 7fcc9e7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:46.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.563+0000 7fcd25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:46.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.571+0000 7fce719159c0 20 remove_watcher() i=0 2024-09-14T11:15:46.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.571+0000 7fce719159c0 2 removed watcher, disabling cache 2024-09-14T11:15:46.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.571+0000 7fce719159c0 20 remove_watcher() i=1 2024-09-14T11:15:46.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.575+0000 7fce719159c0 20 remove_watcher() i=2 2024-09-14T11:15:46.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.575+0000 7fce719159c0 20 remove_watcher() i=3 2024-09-14T11:15:46.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.579+0000 7fce719159c0 20 remove_watcher() i=4 2024-09-14T11:15:46.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.579+0000 7fce719159c0 20 remove_watcher() i=5 2024-09-14T11:15:46.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.583+0000 7fce719159c0 20 remove_watcher() i=6 2024-09-14T11:15:46.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.583+0000 7fce719159c0 20 remove_watcher() i=7 2024-09-14T11:15:46.596 INFO:tasks.workunit.client.0.smithi148.stderr:bucket name a-bucket 2024-09-14T11:15:46.597 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard process non empty bucket 2024-09-14T11:15:46.597 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:46.597 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshard process 2024-09-14T11:15:46.622 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:46.622 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:46.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.667+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 realm 2024-09-14T11:15:46.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:46.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:46.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:46.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.671+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:46.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.675+0000 7ff597a4c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:46.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.675+0000 7ff597a4c9c0 20 searching for the correct realm 2024-09-14T11:15:46.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.675+0000 7ff595552640 0 -- 172.21.15.148:0/982586342 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7ff588056060 msgr2=0x7ff588002590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:46.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:46.887+0000 7ff595552640 0 -- 172.21.15.148:0/982586342 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x5641925c7e70 msgr2=0x7ff590126970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:47.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:47.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:47.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:47.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:47.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:47.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:47.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:47.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.103+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:47.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 zone default found 2024-09-14T11:15:47.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 4 Realm: () 2024-09-14T11:15:47.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:47.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:47.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:47.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 zonegroup default 2024-09-14T11:15:47.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 started sync module instance, tier type = 2024-09-14T11:15:47.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.107+0000 7ff597a4c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:47.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 20 add_watcher() i=0 2024-09-14T11:15:47.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 20 add_watcher() i=1 2024-09-14T11:15:47.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 20 add_watcher() i=2 2024-09-14T11:15:47.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 20 add_watcher() i=3 2024-09-14T11:15:47.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 20 add_watcher() i=4 2024-09-14T11:15:47.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 20 add_watcher() i=5 2024-09-14T11:15:47.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 20 add_watcher() i=6 2024-09-14T11:15:47.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 20 add_watcher() i=7 2024-09-14T11:15:47.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.131+0000 7ff597a4c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:47.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.135+0000 7ff44bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:47.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.135+0000 7ff597a4c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:47.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.135+0000 7ff597a4c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:47.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.135+0000 7ff597a4c9c0 5 note: GC not initialized 2024-09-14T11:15:47.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.139+0000 7ff44afe5640 20 reqs_thread_entry: start 2024-09-14T11:15:47.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.139+0000 7ff597a4c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:47.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.139+0000 7ff597a4c9c0 20 Filter name: none 2024-09-14T11:15:47.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.139+0000 7ff448fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:47.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.139+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000000 2024-09-14T11:15:47.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.143+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:15:47.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.143+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000001 2024-09-14T11:15:47.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.147+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:15:47.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.147+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000002 2024-09-14T11:15:47.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.155+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:15:47.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.155+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000003 2024-09-14T11:15:47.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.159+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:15:47.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.159+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000004 2024-09-14T11:15:47.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.163+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:15:47.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.163+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000005 2024-09-14T11:15:47.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.167+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:15:47.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.167+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000006 2024-09-14T11:15:47.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.171+0000 7ff597a4c9c0 20 process_entry resharding a-bucket 2024-09-14T11:15:47.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.171+0000 7ff597a4c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:15:47.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.171+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.171+0000 7ff597a4c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:47.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.171+0000 7ff597a4c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:15:47.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.171+0000 7ff597a4c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:15:47.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.171+0000 7ff597a4c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:15:47.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.171+0000 7ff597a4c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.175+0000 7ff597a4c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:47.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.175+0000 7ff597a4c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:47.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.175+0000 7ff597a4c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:47.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.175+0000 7ff597a4c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:47.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.175+0000 7ff597a4c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:47.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.175+0000 7ff597a4c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:15:47.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff597a4c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:47.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff597a4c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:47.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff597a4c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:47.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff597a4c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:15:47.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff467fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 94839630181120 notifier 6237 bl.length()=911 2024-09-14T11:15:47.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff467fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:47.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff467fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:47.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff467fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:47.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:15:47.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:15:47.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:15:47.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.191+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:15:47.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:15:47.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:15:47.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:15:47.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:15:47.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.0 2024-09-14T11:15:47.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.0 2024-09-14T11:15:47.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.1 2024-09-14T11:15:47.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.1 2024-09-14T11:15:47.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.2 2024-09-14T11:15:47.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.2 2024-09-14T11:15:47.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.3 2024-09-14T11:15:47.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.207+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.3 2024-09-14T11:15:47.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.211+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.4 2024-09-14T11:15:47.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.211+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.4 2024-09-14T11:15:47.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.211+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.5 2024-09-14T11:15:47.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.211+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.5 2024-09-14T11:15:47.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.211+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.6 2024-09-14T11:15:47.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.211+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.6 2024-09-14T11:15:47.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.211+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.7 2024-09-14T11:15:47.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.211+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.7 2024-09-14T11:15:47.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.215+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.8 2024-09-14T11:15:47.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.215+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.8 2024-09-14T11:15:47.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.215+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.9 2024-09-14T11:15:47.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.215+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.9 2024-09-14T11:15:47.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.215+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.10 2024-09-14T11:15:47.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.215+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.10 2024-09-14T11:15:47.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.219+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.11 2024-09-14T11:15:47.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.219+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.11 2024-09-14T11:15:47.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.223+0000 7ff597a4c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:47.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.223+0000 7ff597a4c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:15:47.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.227+0000 7ff597a4c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:47.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.227+0000 7ff597a4c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:47.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.227+0000 7ff597a4c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:47.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.227+0000 7ff597a4c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:15:47.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.227+0000 7ff478ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94839630181120 notifier 6237 bl.length()=911 2024-09-14T11:15:47.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.227+0000 7ff478ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:47.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.227+0000 7ff478ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:47.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.227+0000 7ff478ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:47.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.231+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:15:47.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.231+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:15:47.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.231+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:15:47.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.231+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:15:47.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.235+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.0 2024-09-14T11:15:47.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.235+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.0 2024-09-14T11:15:47.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.1 2024-09-14T11:15:47.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.1 2024-09-14T11:15:47.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.2 2024-09-14T11:15:47.236 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.2 2024-09-14T11:15:47.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.3 2024-09-14T11:15:47.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.3 2024-09-14T11:15:47.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.4 2024-09-14T11:15:47.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.4 2024-09-14T11:15:47.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.5 2024-09-14T11:15:47.238 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.239+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.5 2024-09-14T11:15:47.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.6 2024-09-14T11:15:47.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.6 2024-09-14T11:15:47.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.7 2024-09-14T11:15:47.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.7 2024-09-14T11:15:47.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.8 2024-09-14T11:15:47.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.8 2024-09-14T11:15:47.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.9 2024-09-14T11:15:47.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.9 2024-09-14T11:15:47.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.10 2024-09-14T11:15:47.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.243+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.10 2024-09-14T11:15:47.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.247+0000 7ff597a4c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.11 2024-09-14T11:15:47.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.247+0000 7ff597a4c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.1.11 2024-09-14T11:15:47.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.247+0000 7ff597a4c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:47.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.247+0000 7ff597a4c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:15:47.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.251+0000 7ff597a4c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:47.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.251+0000 7ff597a4c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:47.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.251+0000 7ff597a4c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:47.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.251+0000 7ff597a4c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:15:47.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.251+0000 7ff467fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366225 cookie 94839630181120 notifier 6237 bl.length()=879 2024-09-14T11:15:47.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.251+0000 7ff467fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:15:47.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.251+0000 7ff467fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:15:47.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.251+0000 7ff467fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:15:47.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.255+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:15:47.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.255+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:15:47.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.255+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:15:47.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.255+0000 7ff597a4c9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:15:47.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.259+0000 7ff597a4c9c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:15:47.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.263+0000 7ff597a4c9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:15:47.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.267+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:15:47.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.267+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000007 2024-09-14T11:15:47.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.275+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:15:47.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.275+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000008 2024-09-14T11:15:47.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.279+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:15:47.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.279+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000009 2024-09-14T11:15:47.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.283+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:15:47.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.283+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000010 2024-09-14T11:15:47.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.295+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:15:47.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.295+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000011 2024-09-14T11:15:47.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.299+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:15:47.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.299+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000012 2024-09-14T11:15:47.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.303+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:15:47.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.303+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000013 2024-09-14T11:15:47.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.307+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:15:47.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.307+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000014 2024-09-14T11:15:47.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.315+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:15:47.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.315+0000 7ff597a4c9c0 20 processing logshard = reshard.0000000015 2024-09-14T11:15:47.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.319+0000 7ff597a4c9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:15:47.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.319+0000 7ff44bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:47.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.323+0000 7ff597a4c9c0 20 remove_watcher() i=0 2024-09-14T11:15:47.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.323+0000 7ff597a4c9c0 2 removed watcher, disabling cache 2024-09-14T11:15:47.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.327+0000 7ff597a4c9c0 20 remove_watcher() i=1 2024-09-14T11:15:47.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.331+0000 7ff597a4c9c0 20 remove_watcher() i=2 2024-09-14T11:15:47.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.331+0000 7ff597a4c9c0 20 remove_watcher() i=3 2024-09-14T11:15:47.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.335+0000 7ff597a4c9c0 20 remove_watcher() i=4 2024-09-14T11:15:47.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.335+0000 7ff597a4c9c0 20 remove_watcher() i=5 2024-09-14T11:15:47.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.339+0000 7ff597a4c9c0 20 remove_watcher() i=6 2024-09-14T11:15:47.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.343+0000 7ff597a4c9c0 20 remove_watcher() i=7 2024-09-14T11:15:47.358 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:15:47.389 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:47.390 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:47.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.439+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 realm 2024-09-14T11:15:47.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:47.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:47.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.443+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.447+0000 7f636646b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:47.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.447+0000 7f636646b9c0 20 searching for the correct realm 2024-09-14T11:15:47.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.451+0000 7f6364772640 0 -- 172.21.15.148:0/1929457177 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x558243f6ccc0 msgr2=0x558243f6f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:47.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.459+0000 7f6363f71640 0 -- 172.21.15.148:0/1929457177 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x558243f70f00 msgr2=0x558243f732f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:47.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.463+0000 7f636646b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:47.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.463+0000 7f636646b9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:47.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.463+0000 7f636646b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:47.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.463+0000 7f636646b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:47.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.463+0000 7f636646b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:47.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.463+0000 7f636646b9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:47.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.463+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:47.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:47.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 zone default found 2024-09-14T11:15:47.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 4 Realm: () 2024-09-14T11:15:47.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:47.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:47.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:47.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 zonegroup default 2024-09-14T11:15:47.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:47.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 started sync module instance, tier type = 2024-09-14T11:15:47.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.467+0000 7f636646b9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:47.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.487+0000 7f636646b9c0 20 add_watcher() i=0 2024-09-14T11:15:47.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.487+0000 7f636646b9c0 20 add_watcher() i=1 2024-09-14T11:15:47.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.487+0000 7f636646b9c0 20 add_watcher() i=2 2024-09-14T11:15:47.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.487+0000 7f636646b9c0 20 add_watcher() i=3 2024-09-14T11:15:47.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.487+0000 7f636646b9c0 20 add_watcher() i=4 2024-09-14T11:15:47.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.487+0000 7f636646b9c0 20 add_watcher() i=5 2024-09-14T11:15:47.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.487+0000 7f636646b9c0 20 add_watcher() i=6 2024-09-14T11:15:47.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.491+0000 7f636646b9c0 20 add_watcher() i=7 2024-09-14T11:15:47.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.491+0000 7f636646b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:47.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.491+0000 7f6219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:47.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.491+0000 7f636646b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:47.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.491+0000 7f636646b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:47.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.491+0000 7f636646b9c0 5 note: GC not initialized 2024-09-14T11:15:47.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f6218fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:47.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:47.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 Filter name: none 2024-09-14T11:15:47.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f61927fc640 20 reqs_thread_entry: start 2024-09-14T11:15:47.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:47.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:47.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:47.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:15:47.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:47.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:15:47.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.495+0000 7f636646b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:47.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.499+0000 7f6219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:47.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.503+0000 7f636646b9c0 20 remove_watcher() i=0 2024-09-14T11:15:47.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.503+0000 7f636646b9c0 2 removed watcher, disabling cache 2024-09-14T11:15:47.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.503+0000 7f636646b9c0 20 remove_watcher() i=1 2024-09-14T11:15:47.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.507+0000 7f636646b9c0 20 remove_watcher() i=2 2024-09-14T11:15:47.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.507+0000 7f636646b9c0 20 remove_watcher() i=3 2024-09-14T11:15:47.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.511+0000 7f636646b9c0 20 remove_watcher() i=4 2024-09-14T11:15:47.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.515+0000 7f636646b9c0 20 remove_watcher() i=5 2024-09-14T11:15:47.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.515+0000 7f636646b9c0 20 remove_watcher() i=6 2024-09-14T11:15:47.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:47.519+0000 7f636646b9c0 20 remove_watcher() i=7 2024-09-14T11:15:47.530 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:47.530 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:47.530 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: a-bucket id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:15:47.530 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:47.530 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:15:47.530 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:47.531 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:47.531 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:47.613 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:47.613 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:47.687 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:47.687 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:47.796 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:47.796 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:47.892 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:47.892 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:47.995 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:47.996 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.096 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.096 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.198 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.198 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.306 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.306 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.403 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.403 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.511 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.511 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.614 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.614 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.690 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.690 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.796 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.796 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.887 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.887 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:48.988 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:48.988 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:49.091 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:49.092 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:49.189 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:49.189 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:49.275 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:49.276 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:49.380 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:49.380 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:49.478 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:49.478 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:49.566 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:49.567 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:15:49.702 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:49.702 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:49.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.747+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.751+0000 7fd7132159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.751+0000 7fd7132159c0 20 realm 2024-09-14T11:15:49.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.751+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.751+0000 7fd7132159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.751+0000 7fd7132159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:49.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.751+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.751+0000 7fd7132159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.751+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.755+0000 7fd7132159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:49.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.755+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.755+0000 7fd7132159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:49.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.755+0000 7fd7132159c0 20 searching for the correct realm 2024-09-14T11:15:49.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.759+0000 7fd71051a640 0 -- 172.21.15.148:0/553470962 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x559165491d30 msgr2=0x559165494120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:49.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.767+0000 7fd710d1b640 0 -- 172.21.15.148:0/553470962 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fd708011950 msgr2=0x7fd70806a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:49.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:49.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:49.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:49.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:49.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:49.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:49.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:49.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:49.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 zone default found 2024-09-14T11:15:49.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 4 Realm: () 2024-09-14T11:15:49.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:49.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:49.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:49.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 zonegroup default 2024-09-14T11:15:49.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.775+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.779+0000 7fd7132159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.779+0000 7fd7132159c0 20 started sync module instance, tier type = 2024-09-14T11:15:49.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.779+0000 7fd7132159c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:49.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.795+0000 7fd7132159c0 20 add_watcher() i=0 2024-09-14T11:15:49.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.795+0000 7fd7132159c0 20 add_watcher() i=1 2024-09-14T11:15:49.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.795+0000 7fd7132159c0 20 add_watcher() i=2 2024-09-14T11:15:49.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.795+0000 7fd7132159c0 20 add_watcher() i=3 2024-09-14T11:15:49.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.795+0000 7fd7132159c0 20 add_watcher() i=4 2024-09-14T11:15:49.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.795+0000 7fd7132159c0 20 add_watcher() i=5 2024-09-14T11:15:49.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.795+0000 7fd7132159c0 20 add_watcher() i=6 2024-09-14T11:15:49.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.799+0000 7fd7132159c0 20 add_watcher() i=7 2024-09-14T11:15:49.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.799+0000 7fd7132159c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:49.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd5c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:49.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:49.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:49.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 5 note: GC not initialized 2024-09-14T11:15:49.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd5c5fe3640 20 reqs_thread_entry: start 2024-09-14T11:15:49.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:49.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 Filter name: none 2024-09-14T11:15:49.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd5377fe640 20 reqs_thread_entry: start 2024-09-14T11:15:49.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:49.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:49.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:49.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.803+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.807+0000 7fd7132159c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:49.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.807+0000 7fd7132159c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.807+0000 7fd7132159c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:49.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.807+0000 7fd7132159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:49.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.807+0000 7fd5c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:49.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.811+0000 7fd7132159c0 20 remove_watcher() i=0 2024-09-14T11:15:49.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.811+0000 7fd7132159c0 2 removed watcher, disabling cache 2024-09-14T11:15:49.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.815+0000 7fd7132159c0 20 remove_watcher() i=1 2024-09-14T11:15:49.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.815+0000 7fd7132159c0 20 remove_watcher() i=2 2024-09-14T11:15:49.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.819+0000 7fd7132159c0 20 remove_watcher() i=3 2024-09-14T11:15:49.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.819+0000 7fd7132159c0 20 remove_watcher() i=4 2024-09-14T11:15:49.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.823+0000 7fd7132159c0 20 remove_watcher() i=5 2024-09-14T11:15:49.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.823+0000 7fd7132159c0 20 remove_watcher() i=6 2024-09-14T11:15:49.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.827+0000 7fd7132159c0 20 remove_watcher() i=7 2024-09-14T11:15:49.840 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:49.840 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:49.840 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-init-index id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:15:49.840 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:49.840 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:15:49.872 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:49.872 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:49.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.915+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 realm 2024-09-14T11:15:49.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:49.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:49.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.919+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.923+0000 7f3db260b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:49.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.923+0000 7f3db260b9c0 20 searching for the correct realm 2024-09-14T11:15:49.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.927+0000 7f3db0111640 0 -- 172.21.15.148:0/2968565301 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f3da00da060 msgr2=0x7f3da00fda90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:49.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.935+0000 7f3db0111640 0 -- 172.21.15.148:0/2968565301 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f3da8070e20 msgr2=0x7f3da805c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:49.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:49.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:49.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:49.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:49.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:49.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:49.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.939+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 zone default found 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 4 Realm: () 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 zonegroup default 2024-09-14T11:15:49.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 started sync module instance, tier type = 2024-09-14T11:15:49.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.943+0000 7f3db260b9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:49.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 20 add_watcher() i=0 2024-09-14T11:15:49.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 20 add_watcher() i=1 2024-09-14T11:15:49.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 20 add_watcher() i=2 2024-09-14T11:15:49.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 20 add_watcher() i=3 2024-09-14T11:15:49.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 20 add_watcher() i=4 2024-09-14T11:15:49.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 20 add_watcher() i=5 2024-09-14T11:15:49.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 20 add_watcher() i=6 2024-09-14T11:15:49.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 20 add_watcher() i=7 2024-09-14T11:15:49.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.963+0000 7f3db260b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:49.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.967+0000 7f3c66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:49.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.967+0000 7f3db260b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:49.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.967+0000 7f3db260b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:49.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.967+0000 7f3db260b9c0 5 note: GC not initialized 2024-09-14T11:15:49.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.967+0000 7f3c65fdb640 20 reqs_thread_entry: start 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.967+0000 7f3db260b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.967+0000 7f3db260b9c0 20 Filter name: none 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3bd77fe640 20 reqs_thread_entry: start 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 : miss 2024-09-14T11:15:49.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:49.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 info.flags=0x17 2024-09-14T11:15:49.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 to cache LRU end 2024-09-14T11:15:49.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:49.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 2024-09-14T11:15:49.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 -1 Injecting error=-5 at location=init_index 2024-09-14T11:15:49.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.971+0000 7f3db260b9c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:15:49.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.975+0000 7f3c66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:49.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.979+0000 7f3db260b9c0 20 remove_watcher() i=0 2024-09-14T11:15:49.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.979+0000 7f3db260b9c0 2 removed watcher, disabling cache 2024-09-14T11:15:49.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.983+0000 7f3db260b9c0 20 remove_watcher() i=1 2024-09-14T11:15:49.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.983+0000 7f3db260b9c0 20 remove_watcher() i=2 2024-09-14T11:15:49.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.987+0000 7f3db260b9c0 20 remove_watcher() i=3 2024-09-14T11:15:49.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.987+0000 7f3db260b9c0 20 remove_watcher() i=4 2024-09-14T11:15:49.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.987+0000 7f3db260b9c0 20 remove_watcher() i=5 2024-09-14T11:15:49.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.991+0000 7f3db260b9c0 20 remove_watcher() i=6 2024-09-14T11:15:49.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:49.995+0000 7f3db260b9c0 20 remove_watcher() i=7 2024-09-14T11:15:50.007 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:15:50.036 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:50.036 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:50.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 20 realm 2024-09-14T11:15:50.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:50.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.083+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.087+0000 7fa9095299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:50.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.087+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.087+0000 7fa9095299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:50.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.087+0000 7fa9095299c0 20 searching for the correct realm 2024-09-14T11:15:50.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.091+0000 7fa90682e640 0 -- 172.21.15.148:0/1982542938 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fa90002a060 msgr2=0x7fa90005fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:50.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.099+0000 7fa90682e640 0 -- 172.21.15.148:0/1982542938 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55a203f2e7d0 msgr2=0x55a203f30c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:50.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:50.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:50.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:50.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:50.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:50.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:50.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.103+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:50.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:50.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 zone default found 2024-09-14T11:15:50.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 4 Realm: () 2024-09-14T11:15:50.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:50.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:50.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:50.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 zonegroup default 2024-09-14T11:15:50.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 started sync module instance, tier type = 2024-09-14T11:15:50.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.107+0000 7fa9095299c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:50.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 20 add_watcher() i=0 2024-09-14T11:15:50.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 20 add_watcher() i=1 2024-09-14T11:15:50.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 20 add_watcher() i=2 2024-09-14T11:15:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 20 add_watcher() i=3 2024-09-14T11:15:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 20 add_watcher() i=4 2024-09-14T11:15:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 20 add_watcher() i=5 2024-09-14T11:15:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 20 add_watcher() i=6 2024-09-14T11:15:50.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 20 add_watcher() i=7 2024-09-14T11:15:50.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.123+0000 7fa9095299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:50.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa7bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:50.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:50.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:50.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 5 note: GC not initialized 2024-09-14T11:15:50.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa7bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:15:50.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:50.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 Filter name: none 2024-09-14T11:15:50.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa7367fc640 20 reqs_thread_entry: start 2024-09-14T11:15:50.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:50.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:50.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:50.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:50.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:50.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.127+0000 7fa9095299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:50.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.131+0000 7fa7bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:50.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.135+0000 7fa9095299c0 20 remove_watcher() i=0 2024-09-14T11:15:50.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.135+0000 7fa9095299c0 2 removed watcher, disabling cache 2024-09-14T11:15:50.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.135+0000 7fa9095299c0 20 remove_watcher() i=1 2024-09-14T11:15:50.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.139+0000 7fa9095299c0 20 remove_watcher() i=2 2024-09-14T11:15:50.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.139+0000 7fa9095299c0 20 remove_watcher() i=3 2024-09-14T11:15:50.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.139+0000 7fa9095299c0 20 remove_watcher() i=4 2024-09-14T11:15:50.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.143+0000 7fa9095299c0 20 remove_watcher() i=5 2024-09-14T11:15:50.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.143+0000 7fa9095299c0 20 remove_watcher() i=6 2024-09-14T11:15:50.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.147+0000 7fa9095299c0 20 remove_watcher() i=7 2024-09-14T11:15:50.158 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:50.158 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:50.158 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-init-index id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:15:50.158 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:50.160 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:50.160 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:50.202 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:50.203 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:50.261 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:15:50.296 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:50.296 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:50.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 20 realm 2024-09-14T11:15:50.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:50.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.343+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.347+0000 7fc00f8e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:50.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.347+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.347+0000 7fc00f8e59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:50.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.347+0000 7fc00f8e59c0 20 searching for the correct realm 2024-09-14T11:15:50.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.351+0000 7fc00cbea640 0 -- 172.21.15.148:0/1510307339 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x565496124e90 msgr2=0x565496127280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:50.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.359+0000 7fc00d3eb640 0 -- 172.21.15.148:0/1510307339 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc00803e960 msgr2=0x7fc00803d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:50.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:50.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:50.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:50.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:50.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:50.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:50.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.363+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:50.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:50.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 zone default found 2024-09-14T11:15:50.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 4 Realm: () 2024-09-14T11:15:50.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:50.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:50.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:50.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 zonegroup default 2024-09-14T11:15:50.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 started sync module instance, tier type = 2024-09-14T11:15:50.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.367+0000 7fc00f8e59c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:50.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.387+0000 7fc00f8e59c0 20 add_watcher() i=0 2024-09-14T11:15:50.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.387+0000 7fc00f8e59c0 20 add_watcher() i=1 2024-09-14T11:15:50.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.387+0000 7fc00f8e59c0 20 add_watcher() i=2 2024-09-14T11:15:50.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.387+0000 7fc00f8e59c0 20 add_watcher() i=3 2024-09-14T11:15:50.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.387+0000 7fc00f8e59c0 20 add_watcher() i=4 2024-09-14T11:15:50.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.387+0000 7fc00f8e59c0 20 add_watcher() i=5 2024-09-14T11:15:50.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.387+0000 7fc00f8e59c0 20 add_watcher() i=6 2024-09-14T11:15:50.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.391+0000 7fc00f8e59c0 20 add_watcher() i=7 2024-09-14T11:15:50.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.391+0000 7fc00f8e59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:50.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fbec37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 5 note: GC not initialized 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fbec27e4640 20 reqs_thread_entry: start 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 20 Filter name: none 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fbe33fff640 20 reqs_thread_entry: start 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:15:50.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:50.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:15:50.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:15:50.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 : miss 2024-09-14T11:15:50.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:50.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 info.flags=0x17 2024-09-14T11:15:50.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 to cache LRU end 2024-09-14T11:15:50.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:50.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:50.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.395+0000 7fc00f8e59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 2024-09-14T11:15:50.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fc00f8e59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 info.flags=0x17 2024-09-14T11:15:50.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fc00f8e59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 to cache LRU end 2024-09-14T11:15:50.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fc00f8e59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:50.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fc00f8e59c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20, ofs0, ns] 2024-09-14T11:15:50.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fbedffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94921295060448 notifier 5993 bl.length()=995 2024-09-14T11:15:50.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fbedffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 info.flags=0x17 2024-09-14T11:15:50.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fbedffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 to cache LRU end 2024-09-14T11:15:50.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fbedffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:50.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): orig_sources= new_sources= 2024-09-14T11:15:50.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): potential sources added=[] removed=[] 2024-09-14T11:15:50.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): orig_dests= new_dests= 2024-09-14T11:15:50.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.407+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): potential dests added=[] removed=[] 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.0 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.0 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.1 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.1 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.2 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.2 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.3 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.3 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.4 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.4 2024-09-14T11:15:50.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.5 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.5 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.6 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.6 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.7 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.7 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.8 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.8 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.9 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.9 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.10 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.10 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.11 2024-09-14T11:15:50.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1.11 2024-09-14T11:15:50.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.0 2024-09-14T11:15:50.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1 2024-09-14T11:15:50.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.2 2024-09-14T11:15:50.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.419+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.3 2024-09-14T11:15:50.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.423+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.4 2024-09-14T11:15:50.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.423+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.5 2024-09-14T11:15:50.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.423+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.6 2024-09-14T11:15:50.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.423+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.7 2024-09-14T11:15:50.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.423+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.8 2024-09-14T11:15:50.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.423+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.9 2024-09-14T11:15:50.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.427+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.10 2024-09-14T11:15:50.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fc00f8e59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:50.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fc00f8e59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 2024-09-14T11:15:50.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fc00f8e59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 info.flags=0x17 2024-09-14T11:15:50.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fc00f8e59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 to cache LRU end 2024-09-14T11:15:50.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fc00f8e59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:50.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fc00f8e59c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20, ofs0, ns] 2024-09-14T11:15:50.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fbedffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94921295060448 notifier 5993 bl.length()=995 2024-09-14T11:15:50.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fbedffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 info.flags=0x17 2024-09-14T11:15:50.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fbedffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 to cache LRU end 2024-09-14T11:15:50.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.435+0000 7fbedffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:50.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.439+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): orig_sources= new_sources= 2024-09-14T11:15:50.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.439+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): potential sources added=[] removed=[] 2024-09-14T11:15:50.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.439+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): orig_dests= new_dests= 2024-09-14T11:15:50.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.439+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): potential dests added=[] removed=[] 2024-09-14T11:15:50.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.443+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.0 2024-09-14T11:15:50.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.443+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.1 2024-09-14T11:15:50.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.447+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.2 2024-09-14T11:15:50.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.447+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.3 2024-09-14T11:15:50.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.447+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.4 2024-09-14T11:15:50.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.447+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.5 2024-09-14T11:15:50.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.447+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.6 2024-09-14T11:15:50.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.447+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.7 2024-09-14T11:15:50.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.447+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.8 2024-09-14T11:15:50.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.451+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.9 2024-09-14T11:15:50.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.451+0000 7fc00f8e59c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20.10 2024-09-14T11:15:50.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.451+0000 7fc00f8e59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:50.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.451+0000 7fc00f8e59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 2024-09-14T11:15:50.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.451+0000 7fc00f8e59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 info.flags=0x17 2024-09-14T11:15:50.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.451+0000 7fc00f8e59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 to cache LRU end 2024-09-14T11:15:50.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.451+0000 7fc00f8e59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:50.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.451+0000 7fc00f8e59c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20, ofs0, ns] 2024-09-14T11:15:50.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.455+0000 7fbef0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94921295060448 notifier 5993 bl.length()=963 2024-09-14T11:15:50.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.455+0000 7fbef0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 info.flags=0x17 2024-09-14T11:15:50.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.455+0000 7fbef0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 to cache LRU end 2024-09-14T11:15:50.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.455+0000 7fbef0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:50.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.455+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): orig_sources= new_sources= 2024-09-14T11:15:50.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.455+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): potential sources added=[] removed=[] 2024-09-14T11:15:50.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.455+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): orig_dests= new_dests= 2024-09-14T11:15:50.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.455+0000 7fc00f8e59c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20]): potential dests added=[] removed=[] 2024-09-14T11:15:50.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.459+0000 7fc00f8e59c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:15:50.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.463+0000 7fbec37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:50.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.471+0000 7fc00f8e59c0 20 remove_watcher() i=0 2024-09-14T11:15:50.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.471+0000 7fc00f8e59c0 2 removed watcher, disabling cache 2024-09-14T11:15:50.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.471+0000 7fc00f8e59c0 20 remove_watcher() i=1 2024-09-14T11:15:50.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.475+0000 7fc00f8e59c0 20 remove_watcher() i=2 2024-09-14T11:15:50.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.479+0000 7fc00f8e59c0 20 remove_watcher() i=3 2024-09-14T11:15:50.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.479+0000 7fc00f8e59c0 20 remove_watcher() i=4 2024-09-14T11:15:50.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.483+0000 7fc00f8e59c0 20 remove_watcher() i=5 2024-09-14T11:15:50.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.487+0000 7fc00f8e59c0 20 remove_watcher() i=6 2024-09-14T11:15:50.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.491+0000 7fc00f8e59c0 20 remove_watcher() i=7 2024-09-14T11:15:50.505 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:15:50.534 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:50.534 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:50.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.579+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 realm 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:50.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:50.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.583+0000 7fc24e97a9c0 20 searching for the correct realm 2024-09-14T11:15:50.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.591+0000 7fc24c480640 0 -- 172.21.15.148:0/2803251890 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fc23c008050 msgr2=0x7fc23c055940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:50.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.595+0000 7fc24c480640 0 -- 172.21.15.148:0/2803251890 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc24408c510 msgr2=0x7fc24405c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:50.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:50.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:50.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 zone default found 2024-09-14T11:15:50.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 4 Realm: () 2024-09-14T11:15:50.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:50.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:50.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:50.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 zonegroup default 2024-09-14T11:15:50.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.603+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.607+0000 7fc24e97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.607+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.607+0000 7fc24e97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.607+0000 7fc24e97a9c0 20 started sync module instance, tier type = 2024-09-14T11:15:50.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.607+0000 7fc24e97a9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.635+0000 7fc24e97a9c0 20 add_watcher() i=0 2024-09-14T11:15:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.635+0000 7fc24e97a9c0 20 add_watcher() i=1 2024-09-14T11:15:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.635+0000 7fc24e97a9c0 20 add_watcher() i=2 2024-09-14T11:15:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.635+0000 7fc24e97a9c0 20 add_watcher() i=3 2024-09-14T11:15:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.635+0000 7fc24e97a9c0 20 add_watcher() i=4 2024-09-14T11:15:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.635+0000 7fc24e97a9c0 20 add_watcher() i=5 2024-09-14T11:15:50.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.635+0000 7fc24e97a9c0 20 add_watcher() i=6 2024-09-14T11:15:50.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.639+0000 7fc24e97a9c0 20 add_watcher() i=7 2024-09-14T11:15:50.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.639+0000 7fc24e97a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:50.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.639+0000 7fc1027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.639+0000 7fc24e97a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.639+0000 7fc24e97a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.639+0000 7fc24e97a9c0 5 note: GC not initialized 2024-09-14T11:15:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc1017e2640 20 reqs_thread_entry: start 2024-09-14T11:15:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:50.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 Filter name: none 2024-09-14T11:15:50.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc072ffd640 20 reqs_thread_entry: start 2024-09-14T11:15:50.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:50.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:50.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:50.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:50.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:50.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.643+0000 7fc24e97a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:50.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.647+0000 7fc1027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:50.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.651+0000 7fc24e97a9c0 20 remove_watcher() i=0 2024-09-14T11:15:50.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.651+0000 7fc24e97a9c0 2 removed watcher, disabling cache 2024-09-14T11:15:50.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.651+0000 7fc24e97a9c0 20 remove_watcher() i=1 2024-09-14T11:15:50.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.655+0000 7fc24e97a9c0 20 remove_watcher() i=2 2024-09-14T11:15:50.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.655+0000 7fc24e97a9c0 20 remove_watcher() i=3 2024-09-14T11:15:50.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.659+0000 7fc24e97a9c0 20 remove_watcher() i=4 2024-09-14T11:15:50.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.659+0000 7fc24e97a9c0 20 remove_watcher() i=5 2024-09-14T11:15:50.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.663+0000 7fc24e97a9c0 20 remove_watcher() i=6 2024-09-14T11:15:50.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:50.663+0000 7fc24e97a9c0 20 remove_watcher() i=7 2024-09-14T11:15:50.676 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:50.676 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:50.677 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-init-index id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:15:50.677 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:50.678 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:50.678 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:50.702 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:50.703 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:51.183 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:51.183 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:51.581 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:15:51.582 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:51.585 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:51.585 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:51.721 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:51.721 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:51.806 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:51.806 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:51.905 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:51.905 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.009 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.010 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.107 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.107 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.204 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.205 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.301 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.301 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.403 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.403 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.506 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.506 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.601 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.601 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.700 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.700 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.802 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.802 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:52.903 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:52.903 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.007 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:53.007 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.109 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:53.109 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.211 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:53.212 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.310 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.414 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:53.415 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.514 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:53.514 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.594 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:53.594 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.700 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:53.700 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:53.798 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:15:53.829 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:53.829 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:53.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.875+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:53.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 realm 2024-09-14T11:15:53.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:53.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:53.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:53.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:53.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:53.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.879+0000 7fa27d9d79c0 20 searching for the correct realm 2024-09-14T11:15:53.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.887+0000 7fa27acdc640 0 -- 172.21.15.148:0/4066848615 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fa26c0c8430 msgr2=0x7fa26c0c88b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:53.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.891+0000 7fa27bcde640 0 -- 172.21.15.148:0/4066848615 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5600898f5110 msgr2=0x5600898f7500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:53.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:53.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:53.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:53.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:53.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:53.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:53.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.899+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 zone default found 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 4 Realm: () 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:53.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:53.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:53.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 zonegroup default 2024-09-14T11:15:53.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:53.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:53.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:53.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 started sync module instance, tier type = 2024-09-14T11:15:53.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.903+0000 7fa27d9d79c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:53.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 20 add_watcher() i=0 2024-09-14T11:15:53.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 20 add_watcher() i=1 2024-09-14T11:15:53.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 20 add_watcher() i=2 2024-09-14T11:15:53.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 20 add_watcher() i=3 2024-09-14T11:15:53.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 20 add_watcher() i=4 2024-09-14T11:15:53.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 20 add_watcher() i=5 2024-09-14T11:15:53.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 20 add_watcher() i=6 2024-09-14T11:15:53.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 20 add_watcher() i=7 2024-09-14T11:15:53.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.923+0000 7fa27d9d79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:53.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:53.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa27d9d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:53.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa27d9d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:53.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa27d9d79c0 5 note: GC not initialized 2024-09-14T11:15:53.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa130fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:53.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa27d9d79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:53.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa27d9d79c0 20 Filter name: none 2024-09-14T11:15:53.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa0aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:53.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.927+0000 7fa27d9d79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:53.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.931+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.931+0000 7fa27d9d79c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:53.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.931+0000 7fa27d9d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:53.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.931+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.931+0000 7fa27d9d79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:53.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.931+0000 7fa27d9d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:53.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.931+0000 7fa27d9d79c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:53.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.931+0000 7fa27d9d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:53.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.935+0000 7fa131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:53.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.939+0000 7fa27d9d79c0 20 remove_watcher() i=0 2024-09-14T11:15:53.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.939+0000 7fa27d9d79c0 2 removed watcher, disabling cache 2024-09-14T11:15:53.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.939+0000 7fa27d9d79c0 20 remove_watcher() i=1 2024-09-14T11:15:53.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.943+0000 7fa27d9d79c0 20 remove_watcher() i=2 2024-09-14T11:15:53.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.943+0000 7fa27d9d79c0 20 remove_watcher() i=3 2024-09-14T11:15:53.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.947+0000 7fa27d9d79c0 20 remove_watcher() i=4 2024-09-14T11:15:53.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.947+0000 7fa27d9d79c0 20 remove_watcher() i=5 2024-09-14T11:15:53.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.951+0000 7fa27d9d79c0 20 remove_watcher() i=6 2024-09-14T11:15:53.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:53.951+0000 7fa27d9d79c0 20 remove_watcher() i=7 2024-09-14T11:15:53.965 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:53.965 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:53.965 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-init-index id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:15:53.965 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:53.965 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:15:54.001 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:54.001 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:54.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.047+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:54.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 realm 2024-09-14T11:15:54.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:54.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:54.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:54.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:54.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:54.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.051+0000 7f70894fc9c0 20 searching for the correct realm 2024-09-14T11:15:54.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.055+0000 7f7087002640 0 -- 172.21.15.148:0/977864136 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f7078054b10 msgr2=0x7f707803bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:54.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.267+0000 7f7087002640 0 -- 172.21.15.148:0/977864136 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55a719ef58a0 msgr2=0x7f708002e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:54.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:54.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:54.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:54.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:54.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:54.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:54.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:54.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:54.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.491+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 zone default found 2024-09-14T11:15:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 4 Realm: () 2024-09-14T11:15:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 zonegroup default 2024-09-14T11:15:54.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:54.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:54.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:54.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 started sync module instance, tier type = 2024-09-14T11:15:54.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.495+0000 7f70894fc9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:54.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.515+0000 7f70894fc9c0 20 add_watcher() i=0 2024-09-14T11:15:54.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.515+0000 7f70894fc9c0 20 add_watcher() i=1 2024-09-14T11:15:54.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.515+0000 7f70894fc9c0 20 add_watcher() i=2 2024-09-14T11:15:54.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.515+0000 7f70894fc9c0 20 add_watcher() i=3 2024-09-14T11:15:54.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.515+0000 7f70894fc9c0 20 add_watcher() i=4 2024-09-14T11:15:54.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.515+0000 7f70894fc9c0 20 add_watcher() i=5 2024-09-14T11:15:54.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.519+0000 7f70894fc9c0 20 add_watcher() i=6 2024-09-14T11:15:54.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.519+0000 7f70894fc9c0 20 add_watcher() i=7 2024-09-14T11:15:54.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.519+0000 7f70894fc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:54.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.523+0000 7f6f3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:54.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.523+0000 7f70894fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:54.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.523+0000 7f70894fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:54.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 5 note: GC not initialized 2024-09-14T11:15:54.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f6eb7fff640 20 reqs_thread_entry: start 2024-09-14T11:15:54.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:54.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 20 Filter name: none 2024-09-14T11:15:54.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f6eb5ffb640 20 reqs_thread_entry: start 2024-09-14T11:15:54.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:15:54.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:54.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:15:54.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:15:54.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 : miss 2024-09-14T11:15:54.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:54.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:54.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 info.flags=0x17 2024-09-14T11:15:54.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 to cache LRU end 2024-09-14T11:15:54.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:54.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:54.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.527+0000 7f70894fc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 2024-09-14T11:15:54.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.531+0000 7f70894fc9c0 -1 Injecting error=-95 at location=init_index 2024-09-14T11:15:54.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.531+0000 7f70894fc9c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:15:54.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.539+0000 7f70894fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 info.flags=0x17 2024-09-14T11:15:54.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.539+0000 7f70894fc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 to cache LRU end 2024-09-14T11:15:54.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.539+0000 7f70894fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:54.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.539+0000 7f70894fc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21, ofs0, ns] 2024-09-14T11:15:54.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.539+0000 7f6f6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94176185380416 notifier 6378 bl.length()=995 2024-09-14T11:15:54.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.539+0000 7f6f6a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 info.flags=0x17 2024-09-14T11:15:54.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.539+0000 7f6f6a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 to cache LRU end 2024-09-14T11:15:54.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.539+0000 7f6f6a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:54.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.543+0000 7f70894fc9c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21]): orig_sources= new_sources= 2024-09-14T11:15:54.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.543+0000 7f70894fc9c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21]): potential sources added=[] removed=[] 2024-09-14T11:15:54.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.543+0000 7f70894fc9c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21]): orig_dests= new_dests= 2024-09-14T11:15:54.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.543+0000 7f70894fc9c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21]): potential dests added=[] removed=[] 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.0 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.0 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.1 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.1 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.2 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.2 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.3 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.3 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.4 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.4 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.5 2024-09-14T11:15:54.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.5 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.6 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.6 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.7 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.7 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.8 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.8 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.9 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.9 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.10 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.10 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.11 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1.11 2024-09-14T11:15:54.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.547+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.0 2024-09-14T11:15:54.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.551+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.1 2024-09-14T11:15:54.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.551+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.2 2024-09-14T11:15:54.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.551+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.3 2024-09-14T11:15:54.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.551+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.4 2024-09-14T11:15:54.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.555+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.5 2024-09-14T11:15:54.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.555+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.6 2024-09-14T11:15:54.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.555+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.7 2024-09-14T11:15:54.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.555+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.8 2024-09-14T11:15:54.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.559+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.9 2024-09-14T11:15:54.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.559+0000 7f70894fc9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21.10 2024-09-14T11:15:54.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f70894fc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:54.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f70894fc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 2024-09-14T11:15:54.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f70894fc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 info.flags=0x17 2024-09-14T11:15:54.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f70894fc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 to cache LRU end 2024-09-14T11:15:54.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f70894fc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:54.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f70894fc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21, ofs0, ns] 2024-09-14T11:15:54.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f6f6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94176185380416 notifier 6378 bl.length()=963 2024-09-14T11:15:54.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f6f6a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 info.flags=0x17 2024-09-14T11:15:54.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f6f6a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 to cache LRU end 2024-09-14T11:15:54.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.567+0000 7f6f6a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:54.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.571+0000 7f70894fc9c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21]): orig_sources= new_sources= 2024-09-14T11:15:54.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.571+0000 7f70894fc9c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21]): potential sources added=[] removed=[] 2024-09-14T11:15:54.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.571+0000 7f70894fc9c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21]): orig_dests= new_dests= 2024-09-14T11:15:54.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.571+0000 7f70894fc9c0 20 handle_bi_update(): bucket=:error-at-init-index[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21]): potential dests added=[] removed=[] 2024-09-14T11:15:54.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.575+0000 7f70894fc9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:15:54.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.579+0000 7f6f3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:54.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.583+0000 7f70894fc9c0 20 remove_watcher() i=0 2024-09-14T11:15:54.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.583+0000 7f70894fc9c0 2 removed watcher, disabling cache 2024-09-14T11:15:54.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.587+0000 7f70894fc9c0 20 remove_watcher() i=1 2024-09-14T11:15:54.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.587+0000 7f70894fc9c0 20 remove_watcher() i=2 2024-09-14T11:15:54.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.591+0000 7f70894fc9c0 20 remove_watcher() i=3 2024-09-14T11:15:54.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.591+0000 7f70894fc9c0 20 remove_watcher() i=4 2024-09-14T11:15:54.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.595+0000 7f70894fc9c0 20 remove_watcher() i=5 2024-09-14T11:15:54.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.599+0000 7f70894fc9c0 20 remove_watcher() i=6 2024-09-14T11:15:54.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:54.599+0000 7f70894fc9c0 20 remove_watcher() i=7 2024-09-14T11:15:54.624 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:15:54.656 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:54.656 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:55.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.115+0000 7f4773890640 0 --2- 172.21.15.148:0/2134470879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55563da86e70 0x55563da7c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:15:55.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.119+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 realm 2024-09-14T11:15:55.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:55.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:55.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.123+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.127+0000 7f4775d8a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:55.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.127+0000 7f4775d8a9c0 20 searching for the correct realm 2024-09-14T11:15:55.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.127+0000 7f4774091640 0 -- 172.21.15.148:0/2134470879 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55563da9e380 msgr2=0x55563daa0790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:55.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.135+0000 7f4773890640 0 -- 172.21.15.148:0/2134470879 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55563daa25d0 msgr2=0x55563daa49c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:55.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:55.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:55.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:55.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:55.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:55.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:55.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:55.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:55.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 zone default found 2024-09-14T11:15:55.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 4 Realm: () 2024-09-14T11:15:55.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:55.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:55.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:55.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 zonegroup default 2024-09-14T11:15:55.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:55.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 started sync module instance, tier type = 2024-09-14T11:15:55.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.147+0000 7f4775d8a9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:55.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.167+0000 7f4775d8a9c0 20 add_watcher() i=0 2024-09-14T11:15:55.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.167+0000 7f4775d8a9c0 20 add_watcher() i=1 2024-09-14T11:15:55.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.167+0000 7f4775d8a9c0 20 add_watcher() i=2 2024-09-14T11:15:55.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.167+0000 7f4775d8a9c0 20 add_watcher() i=3 2024-09-14T11:15:55.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.167+0000 7f4775d8a9c0 20 add_watcher() i=4 2024-09-14T11:15:55.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.167+0000 7f4775d8a9c0 20 add_watcher() i=5 2024-09-14T11:15:55.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.167+0000 7f4775d8a9c0 20 add_watcher() i=6 2024-09-14T11:15:55.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.171+0000 7f4775d8a9c0 20 add_watcher() i=7 2024-09-14T11:15:55.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.171+0000 7f4775d8a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:55.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f462a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:55.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:55.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:55.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 5 note: GC not initialized 2024-09-14T11:15:55.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f46297e2640 20 reqs_thread_entry: start 2024-09-14T11:15:55.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:55.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 Filter name: none 2024-09-14T11:15:55.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4622ffd640 20 reqs_thread_entry: start 2024-09-14T11:15:55.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:55.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:55.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:55.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:15:55.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:55.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:15:55.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.175+0000 7f4775d8a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:55.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.179+0000 7f462a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:55.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.183+0000 7f4775d8a9c0 20 remove_watcher() i=0 2024-09-14T11:15:55.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.183+0000 7f4775d8a9c0 2 removed watcher, disabling cache 2024-09-14T11:15:55.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.187+0000 7f4775d8a9c0 20 remove_watcher() i=1 2024-09-14T11:15:55.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.187+0000 7f4775d8a9c0 20 remove_watcher() i=2 2024-09-14T11:15:55.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.191+0000 7f4775d8a9c0 20 remove_watcher() i=3 2024-09-14T11:15:55.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.191+0000 7f4775d8a9c0 20 remove_watcher() i=4 2024-09-14T11:15:55.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.195+0000 7f4775d8a9c0 20 remove_watcher() i=5 2024-09-14T11:15:55.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.195+0000 7f4775d8a9c0 20 remove_watcher() i=6 2024-09-14T11:15:55.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:55.199+0000 7f4775d8a9c0 20 remove_watcher() i=7 2024-09-14T11:15:55.212 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:55.212 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:55.212 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-init-index id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:15:55.212 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:55.213 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:55.213 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:55.235 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:55.235 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:55.855 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:55.855 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:56.234 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:15:56.235 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:56.238 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:56.238 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:56.364 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:56.364 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:56.451 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:56.558 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:56.558 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:56.656 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:56.657 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:56.755 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:56.756 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:56.855 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:56.856 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:56.959 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:56.960 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.056 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.057 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.158 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.158 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.264 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.265 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.367 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.367 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.471 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.471 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.575 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.575 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.676 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.676 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.775 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.775 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.879 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.879 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:57.978 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:57.978 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:58.081 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:58.181 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:58.181 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:58.279 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:58.279 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:58.381 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:58.381 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:58.483 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:15:58.517 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:58.517 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:58.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.567+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.567+0000 7f8de70fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.567+0000 7f8de70fc9c0 20 realm 2024-09-14T11:15:58.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.567+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:58.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:58.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:58.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.571+0000 7f8de70fc9c0 20 searching for the correct realm 2024-09-14T11:15:58.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.579+0000 7f8ddc401640 0 -- 172.21.15.148:0/1300646996 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f8de00b4410 msgr2=0x7f8de00b4870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:58.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.791+0000 7f8de5403640 0 -- 172.21.15.148:0/1300646996 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x564a4f6430e0 msgr2=0x564a4f6454d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:58.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.803+0000 7f8de70fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:58.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.803+0000 7f8de70fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:58.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.803+0000 7f8de70fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:58.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.803+0000 7f8de70fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:58.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.803+0000 7f8de70fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:58.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.803+0000 7f8de70fc9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:58.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.803+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:58.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:58.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 zone default found 2024-09-14T11:15:58.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 4 Realm: () 2024-09-14T11:15:58.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:58.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:58.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:58.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 zonegroup default 2024-09-14T11:15:58.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.807+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.811+0000 7f8de70fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.811+0000 7f8de70fc9c0 20 started sync module instance, tier type = 2024-09-14T11:15:58.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.811+0000 7f8de70fc9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:58.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.831+0000 7f8de70fc9c0 20 add_watcher() i=0 2024-09-14T11:15:58.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.831+0000 7f8de70fc9c0 20 add_watcher() i=1 2024-09-14T11:15:58.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.831+0000 7f8de70fc9c0 20 add_watcher() i=2 2024-09-14T11:15:58.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.831+0000 7f8de70fc9c0 20 add_watcher() i=3 2024-09-14T11:15:58.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.831+0000 7f8de70fc9c0 20 add_watcher() i=4 2024-09-14T11:15:58.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.831+0000 7f8de70fc9c0 20 add_watcher() i=5 2024-09-14T11:15:58.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.831+0000 7f8de70fc9c0 20 add_watcher() i=6 2024-09-14T11:15:58.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.835+0000 7f8de70fc9c0 20 add_watcher() i=7 2024-09-14T11:15:58.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.835+0000 7f8de70fc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:58.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.839+0000 7f8c9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:58.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.839+0000 7f8de70fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:58.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.839+0000 7f8de70fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:58.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.839+0000 7f8de70fc9c0 5 note: GC not initialized 2024-09-14T11:15:58.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.839+0000 7f8c99fe3640 20 reqs_thread_entry: start 2024-09-14T11:15:58.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.839+0000 7f8de70fc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:58.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.839+0000 7f8de70fc9c0 20 Filter name: none 2024-09-14T11:15:58.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8c0b7fe640 20 reqs_thread_entry: start 2024-09-14T11:15:58.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8de70fc9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:15:58.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8de70fc9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:15:58.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8de70fc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:58.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8de70fc9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:15:58.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.843+0000 7f8de70fc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.847+0000 7f8de70fc9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:15:58.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.847+0000 7f8de70fc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:58.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.847+0000 7f8c9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:58.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.851+0000 7f8de70fc9c0 20 remove_watcher() i=0 2024-09-14T11:15:58.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.851+0000 7f8de70fc9c0 2 removed watcher, disabling cache 2024-09-14T11:15:58.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.855+0000 7f8de70fc9c0 20 remove_watcher() i=1 2024-09-14T11:15:58.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.859+0000 7f8de70fc9c0 20 remove_watcher() i=2 2024-09-14T11:15:58.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.859+0000 7f8de70fc9c0 20 remove_watcher() i=3 2024-09-14T11:15:58.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.863+0000 7f8de70fc9c0 20 remove_watcher() i=4 2024-09-14T11:15:58.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.863+0000 7f8de70fc9c0 20 remove_watcher() i=5 2024-09-14T11:15:58.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.867+0000 7f8de70fc9c0 20 remove_watcher() i=6 2024-09-14T11:15:58.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.871+0000 7f8de70fc9c0 20 remove_watcher() i=7 2024-09-14T11:15:58.882 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:58.882 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:58.882 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-init-indext id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:15:58.882 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:58.883 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:15:58.914 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:58.914 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:58.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 realm 2024-09-14T11:15:58.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.959+0000 7fc4e51a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:58.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:58.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:58.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 searching for the correct realm 2024-09-14T11:15:58.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.971+0000 7fc4e24aa640 0 -- 172.21.15.148:0/1255321630 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5635ccf924b0 msgr2=0x5635ccf948a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:58.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.975+0000 7fc4e2cab640 0 -- 172.21.15.148:0/1255321630 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc4dc037040 msgr2=0x7fc4dc017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:58.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:58.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:58.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:58.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:58.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:58.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:58.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:58.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:58.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 zone default found 2024-09-14T11:15:58.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 Realm: () 2024-09-14T11:15:58.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:58.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:58.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:58.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 zonegroup default 2024-09-14T11:15:58.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 started sync module instance, tier type = 2024-09-14T11:15:58.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:59.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=0 2024-09-14T11:15:59.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=1 2024-09-14T11:15:59.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=2 2024-09-14T11:15:59.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=3 2024-09-14T11:15:59.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=4 2024-09-14T11:15:59.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=5 2024-09-14T11:15:59.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=6 2024-09-14T11:15:59.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.007+0000 7fc4e51a59c0 20 add_watcher() i=7 2024-09-14T11:15:59.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.007+0000 7fc4e51a59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:59.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc3997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:59.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:59.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 note: GC not initialized 2024-09-14T11:15:59.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc313fff640 20 reqs_thread_entry: start 2024-09-14T11:15:59.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:59.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 Filter name: none 2024-09-14T11:15:59.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc311ffb640 20 reqs_thread_entry: start 2024-09-14T11:15:59.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc4e51a59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:15:59.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:15:59.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:15:59.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:15:59.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 : miss 2024-09-14T11:15:59.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:15:59.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:15:59.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:15:59.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:59.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:59.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 2024-09-14T11:15:59.013 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4e51a59c0 time 2024-09-14T11:15:59.020570+0000 2024-09-14T11:15:59.014 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:59.015 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:59.015 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4e8a7f2eb] 2024-09-14T11:15:59.015 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4e8a7f49f] 2024-09-14T11:15:59.015 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635ca1b5c01] 2024-09-14T11:15:59.015 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x14226e2) [0x5635cac136e2] 2024-09-14T11:15:59.015 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5635ca1caecd] 2024-09-14T11:15:59.015 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4e78e5d90] 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.019+0000 7fc4e51a59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4e51a59c0 time 2024-09-14T11:15:59.020570+0000 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4e8a7f2eb] 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4e8a7f49f] 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635ca1b5c01] 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x14226e2) [0x5635cac136e2] 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5635ca1caecd] 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:15:59.016 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4e78e5d90] 2024-09-14T11:15:59.017 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:15:59.017 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:15:59.017 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.017 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:15:59.017 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc4e51a59c0 thread_name:radosgw-admin 2024-09-14T11:15:59.027 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:59.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4e78fe520] 2024-09-14T11:15:59.027 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:15:59.027 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:15:59.027 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4e8a7f345] 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4e8a7f49f] 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635ca1b5c01] 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x14226e2) [0x5635cac136e2] 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5635ca1caecd] 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4e78e5d90] 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.019+0000 7fc4e51a59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc4e51a59c0 thread_name:radosgw-admin 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.028 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4e78fe520] 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4e8a7f345] 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4e8a7f49f] 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635ca1b5c01] 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x14226e2) [0x5635cac136e2] 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5635ca1caecd] 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4e78e5d90] 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:59.029 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccd2eb20 auth_method 0 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:15:58.939+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request con 0x5635ccea7b60 auth_method 0 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:15:58.939+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.030 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:15:58.939+0000 7fc4e34ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:15:58.939+0000 7fc4e34ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_done global_id 6080 payload 274 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 1 monclient: found mon.noname-c 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: dump: 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.031 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: dump: 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.032 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6080 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 4 set_mon_vals no callback set 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: shutdown 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) unregister_commands rotate-key 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: build_initial_monmap 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: monmap: 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:15:59.033 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding auth protocol: cephx 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding auth protocol: cephx 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding auth protocol: cephx 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.034 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 librados: starting msgr at 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 librados: starting objecter 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command objecter_requests hook 0x5635ccea59c0 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 librados: setting wanted keys 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 librados: calling monclient init 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: init 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding auth protocol: cephx 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding auth protocol: cephx 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding auth protocol: cephx 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.036 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command rotate-key hook 0x5635ccea15b8 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-c con 0x5635ccd2eb20 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-a con 0x5635ccd2f740 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-b con 0x5635ccea7b60 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.037 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): authenticate will time out at 2618.003118s 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccd2eb20 auth_method 0 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request con 0x5635ccd2f740 auth_method 0 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_done global_id 6083 payload 824 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 1 monclient: found mon.noname-c 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: dump: 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: dump: 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.040 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6083 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 4 set_mon_vals no callback set 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:15:58.943+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.041 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:15:58.943+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:15:58.943+0000 7fc4e51a59c0 1 librados: init done 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:15:58.943+0000 7fc3cf606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:15:58.943+0000 7fc3cf606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:15:58.943+0000 7fc3cf606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:15:58.943+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x7fc3c80718a0 auth_method 0 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:15:58.943+0000 7fc4e34ac640 10 monclient: get_auth_request con 0x5635ccec9910 auth_method 0 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:15:58.947+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x5635cceec280 auth_method 0 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:15:58.947+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x5635ccef0630 auth_method 0 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 10 monclient: build_initial_monmap 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 10 monclient: monmap: 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding auth protocol: cephx 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding auth protocol: cephx 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding auth protocol: cephx 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.043 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command objecter_requests cmddesc objecter_requests hook 0x5635ccef8f30 EEXIST 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 10 monclient: init 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding auth protocol: cephx 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding auth protocol: cephx 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding auth protocol: cephx 2024-09-14T11:15:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command rotate-key cmddesc rotate-key hook 0x5635ccef3d10 EEXIST 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-c con 0x5635ccf1d0e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-a con 0x5635ccf1ca10 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-b con 0x5635ccf1b3f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): authenticate will time out at 2618.012228s 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request con 0x5635ccf1ca10 auth_method 0 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.046 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccf1d0e0 auth_method 0 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:15:58.951+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request con 0x5635ccf1b3f0 auth_method 0 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:15:58.951+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:15:58.951+0000 7fc4e34ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:15:58.951+0000 7fc4e34ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_done global_id 6435 payload 824 2024-09-14T11:15:59.047 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 1 monclient: found mon.noname-a 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: dump: 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.048 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: dump: 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.049 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6435 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:15:58.951+0000 7fc4e14a8640 4 set_mon_vals no callback set 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:15:58.951+0000 7fc3cce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:15:58.951+0000 7fc3cce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:15:58.951+0000 7fc3cce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x7fc3bc0717e0 auth_method 0 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: get_monmap_and_config 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: build_initial_monmap 2024-09-14T11:15:59.050 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: monmap: 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding auth protocol: cephx 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding auth protocol: cephx 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding auth protocol: cephx 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.051 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: init 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding auth protocol: cephx 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding auth protocol: cephx 2024-09-14T11:15:59.052 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding auth protocol: cephx 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.053 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command rotate-key cmddesc rotate-key hook 0x7ffea13a7258 EEXIST 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-a con 0x5635ccf6ae00 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-b con 0x5635ccf6b1e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-c con 0x5635ccf6c6a0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): authenticate will time out at 2618.016511s 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccf6ae00 auth_method 0 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.054 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request con 0x5635ccf6c6a0 auth_method 0 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_done global_id 6438 payload 274 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 1 monclient: found mon.noname-a 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.055 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: dump: 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6438 2024-09-14T11:15:59.056 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 4 set_mon_vals no callback set 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: dump: 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.057 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: shutdown 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: build_initial_monmap 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: monmap: 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding auth protocol: cephx 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding auth protocol: cephx 2024-09-14T11:15:59.058 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding auth protocol: cephx 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.059 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: starting msgr at 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: starting objecter 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command objecter_requests cmddesc objecter_requests hook 0x5635ccf1bff0 EEXIST 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: setting wanted keys 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: calling monclient init 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: init 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding auth protocol: cephx 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding auth protocol: cephx 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding auth protocol: cephx 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.060 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command rotate-key cmddesc rotate-key hook 0x5635ccf1f048 EEXIST 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-c con 0x5635ccf6ae00 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:15:59.061 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-a con 0x5635ccf6c6a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-b con 0x5635ccf5c2a0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): authenticate will time out at 2618.019047s 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request con 0x5635ccf6c6a0 auth_method 0 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccf6ae00 auth_method 0 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.062 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_done global_id 6441 payload 824 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 1 monclient: found mon.noname-a 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: dump: 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.063 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: dump: 2024-09-14T11:15:59.064 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6441 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 4 set_mon_vals no callback set 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.065 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: init done 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cr dump hook 0x5635ccf61f88 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:15:58.959+0000 7fc3c4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:15:58.959+0000 7fc3c4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:15:58.959+0000 7fc3c4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:15:58.959+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x7fc3ac0718a0 auth_method 0 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:15:58.959+0000 7fc4e34ac640 10 monclient: get_auth_request con 0x5635ccf8a9b0 auth_method 0 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 realm 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:59.066 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:15:58.963+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x5635ccf8ed70 auth_method 0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:15:58.963+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x5635ccf924b0 auth_method 0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 searching for the correct realm 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:15:58.963+0000 7fc4e34ac640 10 monclient: get_auth_request con 0x5635ccf97250 auth_method 0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:15:58.967+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x7fc4d4073030 auth_method 0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:15:58.967+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x7fc4dc026040 auth_method 0 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:15:58.971+0000 7fc4e24aa640 0 -- 172.21.15.148:0/1255321630 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5635ccf924b0 msgr2=0x5635ccf948a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:59.067 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:15:58.971+0000 7fc3c4ff9640 1 client.6441.objecter ms_handle_reset 0x5635ccf924b0 session 0x5635ccf8e610 osd.2 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:15:58.971+0000 7fc3c4ff9640 10 monclient: _renew_subs 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:15:58.971+0000 7fc3c4ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:15:58.971+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x7fc3ac081b40 auth_method 0 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:15:58.971+0000 7fc4e34ac640 10 monclient: get_auth_request con 0x7fc4d4023070 auth_method 0 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:15:58.971+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x7fc4dc037040 auth_method 0 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:15:58.975+0000 7fc4e2cab640 0 -- 172.21.15.148:0/1255321630 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc4dc037040 msgr2=0x7fc4dc017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:15:58.975+0000 7fc3c4ff9640 1 client.6441.objecter ms_handle_reset 0x7fc4dc037040 session 0x7fc4dc027e80 osd.3 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:15:58.975+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x5635ccf924b0 auth_method 0 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:59.068 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 zone default found 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 Realm: () 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 zonegroup default 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.069 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 started sync module instance, tier type = 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=0 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=1 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=2 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=3 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=4 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=5 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=6 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:15:59.007+0000 7fc4e51a59c0 20 add_watcher() i=7 2024-09-14T11:15:59.070 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:15:59.007+0000 7fc4e51a59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding auth protocol: cephx 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding auth protocol: cephx 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding auth protocol: cephx 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.071 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:15:59.011+0000 7fc3997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cache list hook 0x5635ccf5c6a0 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cache inspect hook 0x5635ccf5c6a0 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cache erase hook 0x5635ccf5c6a0 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cache zap hook 0x5635ccf5c6a0 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 note: GC not initialized 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:15:59.011+0000 7fc313fff640 20 reqs_thread_entry: start 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command sync trace show hook 0x7fc4d8004650 2024-09-14T11:15:59.072 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command sync trace history hook 0x7fc4d8004650 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command sync trace active hook 0x7fc4d8004650 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command sync trace active_short hook 0x7fc4d8004650 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 Filter name: none 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:15:59.011+0000 7fc311ffb640 20 reqs_thread_entry: start 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 : miss 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:15:59.073 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:15:59.019+0000 7fc4e51a59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4e51a59c0 time 2024-09-14T11:15:59.020570+0000 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4e8a7f2eb] 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4e8a7f49f] 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635ca1b5c01] 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x14226e2) [0x5635cac136e2] 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5635ca1caecd] 2024-09-14T11:15:59.074 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4e78e5d90] 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:15:59.019+0000 7fc4e51a59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc4e51a59c0 thread_name:radosgw-admin 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4e78fe520] 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4e8a7f345] 2024-09-14T11:15:59.075 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4e8a7f49f] 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635ca1b5c01] 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x14226e2) [0x5635cac136e2] 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5635ca1caecd] 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4e78e5d90] 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:15:59.076 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:15:59.077 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:15:59.078 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:15:59.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:15:59.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:15:59.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:15:59.082 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc311ffb640 / http_manager 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc313fff640 / http_manager 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3997e2640 / rgw_dt_lg_renew 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3c4ff9640 / ms_dispatch 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3c67fc640 / io_context_pool 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3cce01640 / ms_dispatch 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3cf606640 / ms_dispatch 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3d0e09640 / io_context_pool 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e14a8640 / io_context_pool 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e24aa640 / msgr-worker-2 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e2cab640 / msgr-worker-1 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e34ac640 / msgr-worker-0 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e51a59c0 / radosgw-admin 2024-09-14T11:15:59.083 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.84477.log 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccd2eb20 auth_method 0 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.084 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:15:58.939+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request con 0x5635ccea7b60 auth_method 0 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:15:58.939+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:15:58.939+0000 7fc4e34ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:15:58.939+0000 7fc4e34ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_done global_id 6080 payload 274 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 1 monclient: found mon.noname-c 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: dump: 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.085 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 10 monclient: dump: 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.086 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6080 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 4 set_mon_vals no callback set 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: shutdown 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) unregister_commands rotate-key 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: build_initial_monmap 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: monmap: 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:59.087 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding auth protocol: cephx 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding auth protocol: cephx 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding auth protocol: cephx 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.088 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: crc 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea7210) adding con mode: secure 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 librados: starting msgr at 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 librados: starting objecter 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command objecter_requests hook 0x5635ccea59c0 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 librados: setting wanted keys 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 1 librados: calling monclient init 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: init 2024-09-14T11:15:59.089 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding auth protocol: cephx 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding auth protocol: cephx 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding auth protocol: cephx 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: crc 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccea1470) adding con mode: secure 2024-09-14T11:15:59.090 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command rotate-key hook 0x5635ccea15b8 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-c con 0x5635ccd2eb20 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-a con 0x5635ccd2f740 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-b con 0x5635ccea7b60 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient(hunting): authenticate will time out at 2618.003118s 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccd2eb20 auth_method 0 2024-09-14T11:15:59.091 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request con 0x5635ccd2f740 auth_method 0 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:15:58.939+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_done global_id 6083 payload 824 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.092 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 1 monclient: found mon.noname-c 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:15:58.939+0000 7fc4e2cab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: dump: 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.093 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:15:58.939+0000 7fc3cf606640 10 monclient: dump: 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.094 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6083 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:15:58.939+0000 7fc3d0e09640 4 set_mon_vals no callback set 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:15:58.939+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:15:58.943+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:15:58.943+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:15:58.943+0000 7fc4e51a59c0 1 librados: init done 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:15:58.943+0000 7fc3cf606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:15:58.943+0000 7fc3cf606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:15:58.943+0000 7fc3cf606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:15:58.943+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x7fc3c80718a0 auth_method 0 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:15:58.943+0000 7fc4e34ac640 10 monclient: get_auth_request con 0x5635ccec9910 auth_method 0 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:15:58.947+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x5635cceec280 auth_method 0 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:15:58.947+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x5635ccef0630 auth_method 0 2024-09-14T11:15:59.095 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 10 monclient: build_initial_monmap 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 10 monclient: monmap: 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding auth protocol: cephx 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding auth protocol: cephx 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding auth protocol: cephx 2024-09-14T11:15:59.096 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: crc 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef55b0) adding con mode: secure 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.097 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command objecter_requests cmddesc objecter_requests hook 0x5635ccef8f30 EEXIST 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 10 monclient: init 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding auth protocol: cephx 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding auth protocol: cephx 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding auth protocol: cephx 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.098 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: crc 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccef3bc8) adding con mode: secure 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:15:58.947+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command rotate-key cmddesc rotate-key hook 0x5635ccef3d10 EEXIST 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-c con 0x5635ccf1d0e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-a con 0x5635ccf1ca10 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-b con 0x5635ccf1b3f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:15:59.099 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient(hunting): authenticate will time out at 2618.012228s 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request con 0x5635ccf1ca10 auth_method 0 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccf1d0e0 auth_method 0 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.100 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:15:58.951+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request con 0x5635ccf1b3f0 auth_method 0 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:15:58.951+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:15:58.951+0000 7fc4e34ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:15:58.951+0000 7fc4e34ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_done global_id 6435 payload 824 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 1 monclient: found mon.noname-a 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:15:58.951+0000 7fc4e24aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: dump: 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.101 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:15:58.951+0000 7fc3cce01640 10 monclient: dump: 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.102 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6435 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:15:58.951+0000 7fc4e14a8640 4 set_mon_vals no callback set 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:15:58.951+0000 7fc3cce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:59.103 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:15:58.951+0000 7fc3cce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:15:58.951+0000 7fc3cce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:15:58.951+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x7fc3bc0717e0 auth_method 0 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: get_monmap_and_config 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: build_initial_monmap 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: monmap: 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:15:59.104 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding auth protocol: cephx 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding auth protocol: cephx 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding auth protocol: cephx 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.105 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: crc 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c810) adding con mode: secure 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 10 monclient: init 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding auth protocol: cephx 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding auth protocol: cephx 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding auth protocol: cephx 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.106 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: crc 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:15:58.951+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a7110) adding con mode: secure 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command rotate-key cmddesc rotate-key hook 0x7ffea13a7258 EEXIST 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-a con 0x5635ccf6ae00 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-b con 0x5635ccf6b1e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-c con 0x5635ccf6c6a0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): authenticate will time out at 2618.016511s 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccf6ae00 auth_method 0 2024-09-14T11:15:59.107 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request con 0x5635ccf6c6a0 auth_method 0 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:15:58.955+0000 7fc4e34ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_done global_id 6438 payload 274 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.108 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 1 monclient: found mon.noname-a 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: dump: 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.109 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6438 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: get_monmap_and_config success 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 4 set_mon_vals no callback set 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 10 monclient: dump: 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.110 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: shutdown 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: build_initial_monmap 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 build_initial for_mkfs: 0 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: monmap: 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.111 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding auth protocol: cephx 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding auth protocol: cephx 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding auth protocol: cephx 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.112 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: crc 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf3c7c0) adding con mode: secure 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: starting msgr at 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: starting objecter 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command objecter_requests cmddesc objecter_requests hook 0x5635ccf1bff0 EEXIST 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: setting wanted keys 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: calling monclient init 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: init 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding auth protocol: cephx 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding auth protocol: cephx 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding auth protocol: cephx 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.113 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: crc 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 AuthRegistry(0x5635ccf1ef00) adding con mode: secure 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command rotate-key cmddesc rotate-key hook 0x5635ccf1f048 EEXIST 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _reopen_session rank -1 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-c con 0x5635ccf6ae00 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-a con 0x5635ccf6c6a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:15:59.114 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): picked mon.noname-b con 0x5635ccf5c2a0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): _renew_subs 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient(hunting): authenticate will time out at 2618.019047s 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request con 0x5635ccf6c6a0 auth_method 0 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request con 0x5635ccf6ae00 auth_method 0 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.115 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:15:58.955+0000 7fc4e2cab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient(hunting): handle_auth_done global_id 6441 payload 824 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient: _finish_hunting 0 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 1 monclient: found mon.noname-a 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:15:58.955+0000 7fc4e24aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: dump: 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.116 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:15:58.955+0000 7fc3c4ff9640 10 monclient: dump: 2024-09-14T11:15:59.117 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 monclient: authenticate success, global_id 6441 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:15:58.955+0000 7fc3c67fc640 4 set_mon_vals no callback set 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.118 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _renew_subs 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 1 librados: init done 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:15:58.955+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cr dump hook 0x5635ccf61f88 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:15:58.959+0000 7fc3c4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:15:58.959+0000 7fc3c4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:15:58.959+0000 7fc3c4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:15:58.959+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x7fc3ac0718a0 auth_method 0 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:15:58.959+0000 7fc4e34ac640 10 monclient: get_auth_request con 0x5635ccf8a9b0 auth_method 0 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 realm 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:59.119 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:15:58.959+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:15:58.963+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x5635ccf8ed70 auth_method 0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:15:58.963+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x5635ccf924b0 auth_method 0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:15:58.963+0000 7fc4e51a59c0 20 searching for the correct realm 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:15:58.963+0000 7fc4e34ac640 10 monclient: get_auth_request con 0x5635ccf97250 auth_method 0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:15:58.967+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x7fc4d4073030 auth_method 0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:15:58.967+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x7fc4dc026040 auth_method 0 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:15:58.971+0000 7fc4e24aa640 0 -- 172.21.15.148:0/1255321630 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5635ccf924b0 msgr2=0x5635ccf948a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:15:58.971+0000 7fc3c4ff9640 1 client.6441.objecter ms_handle_reset 0x5635ccf924b0 session 0x5635ccf8e610 osd.2 2024-09-14T11:15:59.120 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:15:58.971+0000 7fc3c4ff9640 10 monclient: _renew_subs 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:15:58.971+0000 7fc3c4ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:15:58.971+0000 7fc4e24aa640 10 monclient: get_auth_request con 0x7fc3ac081b40 auth_method 0 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:15:58.971+0000 7fc4e34ac640 10 monclient: get_auth_request con 0x7fc4d4023070 auth_method 0 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:15:58.971+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x7fc4dc037040 auth_method 0 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:15:58.975+0000 7fc4e2cab640 0 -- 172.21.15.148:0/1255321630 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc4dc037040 msgr2=0x7fc4dc017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:15:58.975+0000 7fc3c4ff9640 1 client.6441.objecter ms_handle_reset 0x7fc4dc037040 session 0x7fc4dc027e80 osd.3 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:15:58.975+0000 7fc4e2cab640 10 monclient: get_auth_request con 0x5635ccf924b0 auth_method 0 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:59.121 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 zone default found 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 Realm: () 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 zonegroup default 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.122 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 started sync module instance, tier type = 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:15:58.983+0000 7fc4e51a59c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=0 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=1 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=2 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=3 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=4 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=5 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:15:59.003+0000 7fc4e51a59c0 20 add_watcher() i=6 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:15:59.007+0000 7fc4e51a59c0 20 add_watcher() i=7 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:15:59.007+0000 7fc4e51a59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding auth protocol: cephx 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding auth protocol: cephx 2024-09-14T11:15:59.123 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding auth protocol: cephx 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: crc 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 AuthRegistry(0x7ffea13a75f0) adding con mode: secure 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:15:59.011+0000 7fc3997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:59.124 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cache list hook 0x5635ccf5c6a0 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cache inspect hook 0x5635ccf5c6a0 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cache erase hook 0x5635ccf5c6a0 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command cache zap hook 0x5635ccf5c6a0 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 note: GC not initialized 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:15:59.011+0000 7fc313fff640 20 reqs_thread_entry: start 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command sync trace show hook 0x7fc4d8004650 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command sync trace history hook 0x7fc4d8004650 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command sync trace active hook 0x7fc4d8004650 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 5 asok(0x5635ccc95d90) register_command sync trace active_short hook 0x7fc4d8004650 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 Filter name: none 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:15:59.011+0000 7fc311ffb640 20 reqs_thread_entry: start 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:15:59.125 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:15:59.011+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 : miss 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:15:59.015+0000 7fc4e51a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:15:59.019+0000 7fc4e51a59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4e51a59c0 time 2024-09-14T11:15:59.020570+0000 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.126 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4e8a7f2eb] 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4e8a7f49f] 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635ca1b5c01] 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x14226e2) [0x5635cac136e2] 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5635ca1caecd] 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4e78e5d90] 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:15:59.019+0000 7fc4e51a59c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc4e51a59c0 thread_name:radosgw-admin 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.127 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4e78fe520] 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4e8a7f345] 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4e8a7f49f] 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635ca1b5c01] 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x14226e2) [0x5635cac136e2] 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5635ca1caecd] 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4e78e5d90] 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:59.128 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:15:59.129 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:15:59.130 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:15:59.131 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:15:59.132 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:15:59.133 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:15:59.134 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc311ffb640 / http_manager 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc313fff640 / http_manager 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3997e2640 / rgw_dt_lg_renew 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3c4ff9640 / ms_dispatch 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3c67fc640 / io_context_pool 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3cce01640 / ms_dispatch 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3cf606640 / ms_dispatch 2024-09-14T11:15:59.135 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3d0e09640 / io_context_pool 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e14a8640 / io_context_pool 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e24aa640 / msgr-worker-2 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e2cab640 / msgr-worker-1 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e34ac640 / msgr-worker-0 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4e51a59c0 / radosgw-admin 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:15:59.023038Z_01a53561-2858-4fec-b625-244a26a016dc/log 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:15:59.136 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.095+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.099+0000 7f10a606d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.099+0000 7f10a606d9c0 20 realm 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.099+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.099+0000 7f10a606d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.099+0000 7f10a606d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.099+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.099+0000 7f10a606d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.099+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.103+0000 7f10a606d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.103+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.103+0000 7f10a606d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:59.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.103+0000 7f10a606d9c0 20 searching for the correct realm 2024-09-14T11:15:59.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.107+0000 7f10a3b73640 0 -- 172.21.15.148:0/516883936 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f10940b3bb0 msgr2=0x7f10940b4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:59.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.111+0000 7f10a3b73640 0 -- 172.21.15.148:0/516883936 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55d6d6d28290 msgr2=0x7f109c0830d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:59.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:59.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:15:59.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:59.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:59.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:59.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:15:59.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:59.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 zone default found 2024-09-14T11:15:59.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 4 Realm: () 2024-09-14T11:15:59.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:15:59.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:15:59.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:59.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 zonegroup default 2024-09-14T11:15:59.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.331+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.335+0000 7f10a606d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.335+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.335+0000 7f10a606d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.335+0000 7f10a606d9c0 20 started sync module instance, tier type = 2024-09-14T11:15:59.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.335+0000 7f10a606d9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:15:59.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.359+0000 7f10a606d9c0 20 add_watcher() i=0 2024-09-14T11:15:59.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.359+0000 7f10a606d9c0 20 add_watcher() i=1 2024-09-14T11:15:59.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.359+0000 7f10a606d9c0 20 add_watcher() i=2 2024-09-14T11:15:59.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.359+0000 7f10a606d9c0 20 add_watcher() i=3 2024-09-14T11:15:59.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.359+0000 7f10a606d9c0 20 add_watcher() i=4 2024-09-14T11:15:59.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.359+0000 7f10a606d9c0 20 add_watcher() i=5 2024-09-14T11:15:59.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.359+0000 7f10a606d9c0 20 add_watcher() i=6 2024-09-14T11:15:59.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.363+0000 7f10a606d9c0 20 add_watcher() i=7 2024-09-14T11:15:59.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.363+0000 7f10a606d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:59.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f0f59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f10a606d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:59.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f10a606d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:59.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f10a606d9c0 5 note: GC not initialized 2024-09-14T11:15:59.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f0f58fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:59.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f10a606d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:15:59.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f10a606d9c0 20 Filter name: none 2024-09-14T11:15:59.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f0ed27fc640 20 reqs_thread_entry: start 2024-09-14T11:15:59.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.367+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:15:59.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:15:59.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.371+0000 7f10a606d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:59.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.375+0000 7f0f59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.379+0000 7f10a606d9c0 20 remove_watcher() i=0 2024-09-14T11:15:59.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.379+0000 7f10a606d9c0 2 removed watcher, disabling cache 2024-09-14T11:15:59.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.379+0000 7f10a606d9c0 20 remove_watcher() i=1 2024-09-14T11:15:59.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.383+0000 7f10a606d9c0 20 remove_watcher() i=2 2024-09-14T11:15:59.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.383+0000 7f10a606d9c0 20 remove_watcher() i=3 2024-09-14T11:15:59.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.387+0000 7f10a606d9c0 20 remove_watcher() i=4 2024-09-14T11:15:59.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.391+0000 7f10a606d9c0 20 remove_watcher() i=5 2024-09-14T11:15:59.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.391+0000 7f10a606d9c0 20 remove_watcher() i=6 2024-09-14T11:15:59.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.395+0000 7f10a606d9c0 20 remove_watcher() i=7 2024-09-14T11:15:59.408 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:15:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-init-indext id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:15:59.408 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:15:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:59.409 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:59.463 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:15:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:15:59.529 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:15:59.565 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:59.565 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:59.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.611+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 realm 2024-09-14T11:15:59.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:59.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.615+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.619+0000 7f85e912c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:59.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.619+0000 7f85e912c9c0 20 searching for the correct realm 2024-09-14T11:15:59.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.619+0000 7f85e6c32640 0 -- 172.21.15.148:0/3013158932 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f85d80ec040 msgr2=0x7f85d80fb940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:59.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:15:59.831+0000 7f85e6c32640 0 -- 172.21.15.148:0/3013158932 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f85e0067d10 msgr2=0x7f85e0074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:00.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.047+0000 7f85e912c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:00.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.047+0000 7f85e912c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:00.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.047+0000 7f85e912c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:00.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.047+0000 7f85e912c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:00.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.047+0000 7f85e912c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:00.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.047+0000 7f85e912c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:00.047 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.047+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:00.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 zone default found 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 4 Realm: () 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 zonegroup default 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 started sync module instance, tier type = 2024-09-14T11:16:00.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.051+0000 7f85e912c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:00.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.075+0000 7f85e912c9c0 20 add_watcher() i=0 2024-09-14T11:16:00.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.075+0000 7f85e912c9c0 20 add_watcher() i=1 2024-09-14T11:16:00.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.075+0000 7f85e912c9c0 20 add_watcher() i=2 2024-09-14T11:16:00.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.075+0000 7f85e912c9c0 20 add_watcher() i=3 2024-09-14T11:16:00.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.075+0000 7f85e912c9c0 20 add_watcher() i=4 2024-09-14T11:16:00.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.075+0000 7f85e912c9c0 20 add_watcher() i=5 2024-09-14T11:16:00.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.075+0000 7f85e912c9c0 20 add_watcher() i=6 2024-09-14T11:16:00.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.079+0000 7f85e912c9c0 20 add_watcher() i=7 2024-09-14T11:16:00.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.079+0000 7f85e912c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:00.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f849d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:00.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f85e912c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:00.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f85e912c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:00.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f85e912c9c0 5 note: GC not initialized 2024-09-14T11:16:00.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f8417fff640 20 reqs_thread_entry: start 2024-09-14T11:16:00.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f85e912c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:00.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f85e912c9c0 20 Filter name: none 2024-09-14T11:16:00.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f8415ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:00.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f85e912c9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:16:00.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.083+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:16:00.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:16:00.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:16:00.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 : miss 2024-09-14T11:16:00.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:16:00.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:16:00.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:16:00.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:00.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:00.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 2024-09-14T11:16:00.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.087+0000 7f85e912c9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to be held by another RGW process; skipping for now 2024-09-14T11:16:00.087 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.091+0000 7f849d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:00.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.095+0000 7f85e912c9c0 20 remove_watcher() i=0 2024-09-14T11:16:00.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.095+0000 7f85e912c9c0 2 removed watcher, disabling cache 2024-09-14T11:16:00.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.095+0000 7f85e912c9c0 20 remove_watcher() i=1 2024-09-14T11:16:00.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.099+0000 7f85e912c9c0 20 remove_watcher() i=2 2024-09-14T11:16:00.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.099+0000 7f85e912c9c0 20 remove_watcher() i=3 2024-09-14T11:16:00.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.103+0000 7f85e912c9c0 20 remove_watcher() i=4 2024-09-14T11:16:00.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.103+0000 7f85e912c9c0 20 remove_watcher() i=5 2024-09-14T11:16:00.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.107+0000 7f85e912c9c0 20 remove_watcher() i=6 2024-09-14T11:16:00.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:00.111+0000 7f85e912c9c0 20 remove_watcher() i=7 2024-09-14T11:16:00.130 INFO:tasks.workunit.client.0.smithi148.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:16:30.161 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:16:30.198 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:30.198 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:30.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.242+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 realm 2024-09-14T11:16:30.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:30.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:30.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.246+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.250+0000 7f22f4fc69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:30.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.250+0000 7f22f4fc69c0 20 searching for the correct realm 2024-09-14T11:16:30.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.254+0000 7f22f22cb640 0 -- 172.21.15.148:0/910730216 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f22ec02b430 msgr2=0x7f22ec02b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:30.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.470+0000 7f22f2acc640 0 -- 172.21.15.148:0/910730216 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f22ec0463f0 msgr2=0x7f22ec046870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:30.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:30.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:30.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:30.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:30.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 zone default found 2024-09-14T11:16:30.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 4 Realm: () 2024-09-14T11:16:30.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:30.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:30.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:30.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 zonegroup default 2024-09-14T11:16:30.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.482+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.486+0000 7f22f4fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.486+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.486+0000 7f22f4fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.486+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.486+0000 7f22f4fc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.486+0000 7f22f4fc69c0 20 started sync module instance, tier type = 2024-09-14T11:16:30.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.486+0000 7f22f4fc69c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:30.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.506+0000 7f22f4fc69c0 20 add_watcher() i=0 2024-09-14T11:16:30.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.506+0000 7f22f4fc69c0 20 add_watcher() i=1 2024-09-14T11:16:30.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.506+0000 7f22f4fc69c0 20 add_watcher() i=2 2024-09-14T11:16:30.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.506+0000 7f22f4fc69c0 20 add_watcher() i=3 2024-09-14T11:16:30.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.506+0000 7f22f4fc69c0 20 add_watcher() i=4 2024-09-14T11:16:30.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.506+0000 7f22f4fc69c0 20 add_watcher() i=5 2024-09-14T11:16:30.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.506+0000 7f22f4fc69c0 20 add_watcher() i=6 2024-09-14T11:16:30.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.510+0000 7f22f4fc69c0 20 add_watcher() i=7 2024-09-14T11:16:30.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.510+0000 7f22f4fc69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:30.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.514+0000 7f21a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:30.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.514+0000 7f22f4fc69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:30.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.514+0000 7f22f4fc69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:30.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.514+0000 7f22f4fc69c0 5 note: GC not initialized 2024-09-14T11:16:30.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.514+0000 7f2123fff640 20 reqs_thread_entry: start 2024-09-14T11:16:30.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.514+0000 7f22f4fc69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:30.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.514+0000 7f22f4fc69c0 20 Filter name: none 2024-09-14T11:16:30.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f2121ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:30.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:16:30.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:16:30.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:16:30.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:16:30.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 : miss 2024-09-14T11:16:30.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:16:30.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:16:30.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:16:30.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:30.517 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:30.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.518+0000 7f22f4fc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 2024-09-14T11:16:30.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.530+0000 7f22f4fc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:16:30.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.530+0000 7f22f4fc69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:16:30.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.530+0000 7f22f4fc69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:30.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.530+0000 7f22f4fc69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22, ofs0, ns] 2024-09-14T11:16:30.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.530+0000 7f21d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94211839880336 notifier 6498 bl.length()=997 2024-09-14T11:16:30.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.530+0000 7f21d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:16:30.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.530+0000 7f21d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:16:30.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.530+0000 7f21d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:30.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.534+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): orig_sources= new_sources= 2024-09-14T11:16:30.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.534+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): potential sources added=[] removed=[] 2024-09-14T11:16:30.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.534+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): orig_dests= new_dests= 2024-09-14T11:16:30.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.534+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): potential dests added=[] removed=[] 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.0 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.0 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.1 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.1 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.2 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.2 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.3 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.3 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.4 2024-09-14T11:16:30.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.4 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.5 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.5 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.6 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.6 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.7 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.7 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.8 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.8 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.9 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.9 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.10 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.10 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.11 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1.11 2024-09-14T11:16:30.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.542+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.0 2024-09-14T11:16:30.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.546+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1 2024-09-14T11:16:30.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.546+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.2 2024-09-14T11:16:30.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.546+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.3 2024-09-14T11:16:30.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.546+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.4 2024-09-14T11:16:30.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.546+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.5 2024-09-14T11:16:30.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.550+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.6 2024-09-14T11:16:30.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.550+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.7 2024-09-14T11:16:30.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.550+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.8 2024-09-14T11:16:30.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.550+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.9 2024-09-14T11:16:30.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.550+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.10 2024-09-14T11:16:30.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.558+0000 7f22f4fc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:30.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.558+0000 7f22f4fc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 2024-09-14T11:16:30.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.562+0000 7f22f4fc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:16:30.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.562+0000 7f22f4fc69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:16:30.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.562+0000 7f22f4fc69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:30.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.562+0000 7f22f4fc69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22, ofs0, ns] 2024-09-14T11:16:30.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.562+0000 7f21d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94211839880336 notifier 6498 bl.length()=997 2024-09-14T11:16:30.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.562+0000 7f21d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:16:30.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.562+0000 7f21d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:16:30.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.562+0000 7f21d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:30.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.566+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): orig_sources= new_sources= 2024-09-14T11:16:30.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.566+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): potential sources added=[] removed=[] 2024-09-14T11:16:30.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.566+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): orig_dests= new_dests= 2024-09-14T11:16:30.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.566+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): potential dests added=[] removed=[] 2024-09-14T11:16:30.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.570+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.0 2024-09-14T11:16:30.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.570+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.1 2024-09-14T11:16:30.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.570+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.2 2024-09-14T11:16:30.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.570+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.3 2024-09-14T11:16:30.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.574+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.4 2024-09-14T11:16:30.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.574+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.5 2024-09-14T11:16:30.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.574+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.6 2024-09-14T11:16:30.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.574+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.7 2024-09-14T11:16:30.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.574+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.8 2024-09-14T11:16:30.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.574+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.9 2024-09-14T11:16:30.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.578+0000 7f22f4fc69c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22.10 2024-09-14T11:16:30.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.578+0000 7f22f4fc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:30.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.578+0000 7f22f4fc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 2024-09-14T11:16:30.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.578+0000 7f22f4fc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:16:30.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.578+0000 7f22f4fc69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:16:30.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.578+0000 7f22f4fc69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:30.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.578+0000 7f22f4fc69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22, ofs0, ns] 2024-09-14T11:16:30.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.582+0000 7f21d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94211839880336 notifier 6498 bl.length()=965 2024-09-14T11:16:30.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.582+0000 7f21d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 info.flags=0x17 2024-09-14T11:16:30.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.582+0000 7f21d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 to cache LRU end 2024-09-14T11:16:30.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.582+0000 7f21d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.582+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): orig_sources= new_sources= 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.582+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): potential sources added=[] removed=[] 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.582+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): orig_dests= new_dests= 2024-09-14T11:16:30.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.582+0000 7f22f4fc69c0 20 handle_bi_update(): bucket=:abort-at-init-indext[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22]): potential dests added=[] removed=[] 2024-09-14T11:16:30.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.590+0000 7f22f4fc69c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:16:30.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.594+0000 7f21a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:30.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.598+0000 7f22f4fc69c0 20 remove_watcher() i=0 2024-09-14T11:16:30.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.598+0000 7f22f4fc69c0 2 removed watcher, disabling cache 2024-09-14T11:16:30.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.598+0000 7f22f4fc69c0 20 remove_watcher() i=1 2024-09-14T11:16:30.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.602+0000 7f22f4fc69c0 20 remove_watcher() i=2 2024-09-14T11:16:30.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.602+0000 7f22f4fc69c0 20 remove_watcher() i=3 2024-09-14T11:16:30.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.606+0000 7f22f4fc69c0 20 remove_watcher() i=4 2024-09-14T11:16:30.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.606+0000 7f22f4fc69c0 20 remove_watcher() i=5 2024-09-14T11:16:30.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.610+0000 7f22f4fc69c0 20 remove_watcher() i=6 2024-09-14T11:16:30.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.614+0000 7f22f4fc69c0 20 remove_watcher() i=7 2024-09-14T11:16:30.630 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:16:30.660 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:30.661 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:30.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.902+0000 7f47f3ad2640 0 --2- 172.21.15.148:0/1907676975 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x559c90cb3990 0x559c90cc8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:16:30.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 20 realm 2024-09-14T11:16:30.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:30.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.918+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.922+0000 7f47f67cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:30.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.922+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:30.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.922+0000 7f47f67cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:30.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.922+0000 7f47f67cd9c0 20 searching for the correct realm 2024-09-14T11:16:30.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:30.926+0000 7f47f42d3640 0 -- 172.21.15.148:0/2159252160 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f47e40bd570 msgr2=0x7f47e40f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:31.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.142+0000 7f47f42d3640 0 -- 172.21.15.148:0/2159252160 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f47ec019480 msgr2=0x7f47ec00f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:31.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:31.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:31.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:31.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:31.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:31.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:31.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:31.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:31.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 zone default found 2024-09-14T11:16:31.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 4 Realm: () 2024-09-14T11:16:31.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:31.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:31.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:31.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 zonegroup default 2024-09-14T11:16:31.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.362+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.366+0000 7f47f67cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.366+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.366+0000 7f47f67cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.366+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.366+0000 7f47f67cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:31.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.366+0000 7f47f67cd9c0 20 started sync module instance, tier type = 2024-09-14T11:16:31.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.366+0000 7f47f67cd9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:31.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 20 add_watcher() i=0 2024-09-14T11:16:31.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 20 add_watcher() i=1 2024-09-14T11:16:31.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 20 add_watcher() i=2 2024-09-14T11:16:31.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 20 add_watcher() i=3 2024-09-14T11:16:31.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 20 add_watcher() i=4 2024-09-14T11:16:31.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 20 add_watcher() i=5 2024-09-14T11:16:31.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 20 add_watcher() i=6 2024-09-14T11:16:31.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 20 add_watcher() i=7 2024-09-14T11:16:31.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.390+0000 7f47f67cd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:31.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f46aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:31.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f47f67cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:31.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f47f67cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:31.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f47f67cd9c0 5 note: GC not initialized 2024-09-14T11:16:31.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f46a9fdb640 20 reqs_thread_entry: start 2024-09-14T11:16:31.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f47f67cd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:31.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f47f67cd9c0 20 Filter name: none 2024-09-14T11:16:31.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f461b7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:31.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f47f67cd9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:16:31.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.398+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.402+0000 7f47f67cd9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:16:31.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.402+0000 7f47f67cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:31.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.402+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.402+0000 7f47f67cd9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:16:31.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.402+0000 7f47f67cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:31.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.402+0000 7f47f67cd9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:16:31.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.402+0000 7f47f67cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:31.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.406+0000 7f46aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:31.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.410+0000 7f47f67cd9c0 20 remove_watcher() i=0 2024-09-14T11:16:31.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.410+0000 7f47f67cd9c0 2 removed watcher, disabling cache 2024-09-14T11:16:31.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.410+0000 7f47f67cd9c0 20 remove_watcher() i=1 2024-09-14T11:16:31.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.414+0000 7f47f67cd9c0 20 remove_watcher() i=2 2024-09-14T11:16:31.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.414+0000 7f47f67cd9c0 20 remove_watcher() i=3 2024-09-14T11:16:31.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.418+0000 7f47f67cd9c0 20 remove_watcher() i=4 2024-09-14T11:16:31.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.422+0000 7f47f67cd9c0 20 remove_watcher() i=5 2024-09-14T11:16:31.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.422+0000 7f47f67cd9c0 20 remove_watcher() i=6 2024-09-14T11:16:31.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:31.426+0000 7f47f67cd9c0 20 remove_watcher() i=7 2024-09-14T11:16:31.438 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:31.438 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:16:31.438 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-init-indext id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:16:31.438 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:31.439 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:31.440 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:31.470 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:31.471 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:32.039 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:32.039 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:32.428 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:16:32.428 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:32.431 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:32.431 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:32.572 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:32.573 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:32.663 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:32.663 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:32.773 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:32.773 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:32.875 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:32.876 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:32.978 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:32.978 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.083 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.083 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.181 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.181 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.283 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.284 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.390 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.390 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.490 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.490 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.596 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.596 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.693 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.693 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.794 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.794 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:33.897 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:33.898 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:34.001 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:34.001 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:34.104 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:34.104 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:34.209 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:34.209 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:34.310 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:34.310 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:34.415 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:34.415 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:34.512 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:34.512 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:34.620 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:34.620 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:34.718 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:16:34.752 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:34.753 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:34.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.798+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 realm 2024-09-14T11:16:34.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:34.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:34.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.802+0000 7fbaa26789c0 20 searching for the correct realm 2024-09-14T11:16:34.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:34.810+0000 7fba9f97d640 0 -- 172.21.15.148:0/3430146746 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fba980df060 msgr2=0x7fba981308f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.022+0000 7fba9f97d640 0 -- 172.21.15.148:0/3430146746 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55ff70c9f7b0 msgr2=0x55ff70ca1ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.034+0000 7fbaa26789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.034+0000 7fbaa26789c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.034+0000 7fbaa26789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.034+0000 7fbaa26789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.034+0000 7fbaa26789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.034+0000 7fbaa26789c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.034+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:35.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 zone default found 2024-09-14T11:16:35.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 4 Realm: () 2024-09-14T11:16:35.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:35.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:35.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:35.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 zonegroup default 2024-09-14T11:16:35.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.038+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.042+0000 7fbaa26789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.042+0000 7fbaa26789c0 20 started sync module instance, tier type = 2024-09-14T11:16:35.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.042+0000 7fbaa26789c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:35.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 20 add_watcher() i=0 2024-09-14T11:16:35.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 20 add_watcher() i=1 2024-09-14T11:16:35.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 20 add_watcher() i=2 2024-09-14T11:16:35.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 20 add_watcher() i=3 2024-09-14T11:16:35.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 20 add_watcher() i=4 2024-09-14T11:16:35.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 20 add_watcher() i=5 2024-09-14T11:16:35.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 20 add_watcher() i=6 2024-09-14T11:16:35.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 20 add_watcher() i=7 2024-09-14T11:16:35.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.066+0000 7fbaa26789c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:35.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.070+0000 7fb9567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fbaa26789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:35.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fbaa26789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:35.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fbaa26789c0 5 note: GC not initialized 2024-09-14T11:16:35.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fb9557e2640 20 reqs_thread_entry: start 2024-09-14T11:16:35.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fbaa26789c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:35.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fbaa26789c0 20 Filter name: none 2024-09-14T11:16:35.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fb8c6ffd640 20 reqs_thread_entry: start 2024-09-14T11:16:35.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fbaa26789c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:35.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.074+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.078+0000 7fbaa26789c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.078+0000 7fbaa26789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.078+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.078+0000 7fbaa26789c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:35.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.078+0000 7fbaa26789c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.078+0000 7fbaa26789c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:35.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.078+0000 7fbaa26789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:35.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.082+0000 7fb9567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.086+0000 7fbaa26789c0 20 remove_watcher() i=0 2024-09-14T11:16:35.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.086+0000 7fbaa26789c0 2 removed watcher, disabling cache 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.090+0000 7fbaa26789c0 20 remove_watcher() i=1 2024-09-14T11:16:35.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.094+0000 7fbaa26789c0 20 remove_watcher() i=2 2024-09-14T11:16:35.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.094+0000 7fbaa26789c0 20 remove_watcher() i=3 2024-09-14T11:16:35.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.098+0000 7fbaa26789c0 20 remove_watcher() i=4 2024-09-14T11:16:35.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.098+0000 7fbaa26789c0 20 remove_watcher() i=5 2024-09-14T11:16:35.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.102+0000 7fbaa26789c0 20 remove_watcher() i=6 2024-09-14T11:16:35.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.106+0000 7fbaa26789c0 20 remove_watcher() i=7 2024-09-14T11:16:35.120 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:35.120 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:16:35.120 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-set-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:16:35.120 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:35.120 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:16:35.154 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:35.154 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:35.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.198+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 realm 2024-09-14T11:16:35.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:35.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:35.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.202+0000 7fe2948cb9c0 20 searching for the correct realm 2024-09-14T11:16:35.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.210+0000 7fe291bd0640 0 -- 172.21.15.148:0/4235995013 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x56006b6045f0 msgr2=0x56006b606a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.218+0000 7fe2923d1640 0 -- 172.21.15.148:0/4235995013 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x56006b608830 msgr2=0x56006b60ac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.222 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.222+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 zone default found 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 4 Realm: () 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 zonegroup default 2024-09-14T11:16:35.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 started sync module instance, tier type = 2024-09-14T11:16:35.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.226+0000 7fe2948cb9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:35.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.246+0000 7fe2948cb9c0 20 add_watcher() i=0 2024-09-14T11:16:35.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.246+0000 7fe2948cb9c0 20 add_watcher() i=1 2024-09-14T11:16:35.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.246+0000 7fe2948cb9c0 20 add_watcher() i=2 2024-09-14T11:16:35.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.246+0000 7fe2948cb9c0 20 add_watcher() i=3 2024-09-14T11:16:35.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.246+0000 7fe2948cb9c0 20 add_watcher() i=4 2024-09-14T11:16:35.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.246+0000 7fe2948cb9c0 20 add_watcher() i=5 2024-09-14T11:16:35.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.246+0000 7fe2948cb9c0 20 add_watcher() i=6 2024-09-14T11:16:35.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.250+0000 7fe2948cb9c0 20 add_watcher() i=7 2024-09-14T11:16:35.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.250+0000 7fe2948cb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.250+0000 7fe148fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.250+0000 7fe2948cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.250+0000 7fe2948cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.250+0000 7fe2948cb9c0 5 note: GC not initialized 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe0c37fe640 20 reqs_thread_entry: start 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 20 Filter name: none 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe0c17fa640 20 reqs_thread_entry: start 2024-09-14T11:16:35.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:35.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:16:35.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:16:35.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 : miss 2024-09-14T11:16:35.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:35.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 info.flags=0x17 2024-09-14T11:16:35.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 to cache LRU end 2024-09-14T11:16:35.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:35.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:35.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.254+0000 7fe2948cb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 2024-09-14T11:16:35.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.262+0000 7fe2948cb9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:16:35.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.262+0000 7fe2948cb9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:16:35.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.266+0000 7fe148fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.270+0000 7fe2948cb9c0 20 remove_watcher() i=0 2024-09-14T11:16:35.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.270+0000 7fe2948cb9c0 2 removed watcher, disabling cache 2024-09-14T11:16:35.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.274+0000 7fe2948cb9c0 20 remove_watcher() i=1 2024-09-14T11:16:35.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.274+0000 7fe2948cb9c0 20 remove_watcher() i=2 2024-09-14T11:16:35.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.278+0000 7fe2948cb9c0 20 remove_watcher() i=3 2024-09-14T11:16:35.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.278+0000 7fe2948cb9c0 20 remove_watcher() i=4 2024-09-14T11:16:35.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.282+0000 7fe2948cb9c0 20 remove_watcher() i=5 2024-09-14T11:16:35.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.282+0000 7fe2948cb9c0 20 remove_watcher() i=6 2024-09-14T11:16:35.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.286+0000 7fe2948cb9c0 20 remove_watcher() i=7 2024-09-14T11:16:35.298 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:16:35.325 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:35.325 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:35.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.366+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 realm 2024-09-14T11:16:35.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:35.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.370+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.374+0000 7f92a636e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:35.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.374+0000 7f92a636e9c0 20 searching for the correct realm 2024-09-14T11:16:35.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.378+0000 7f92a3673640 0 -- 172.21.15.148:0/2004265254 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5589f1681d80 msgr2=0x5589f16841f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.386+0000 7f92a3e74640 0 -- 172.21.15.148:0/2004265254 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5589f1685ee0 msgr2=0x5589f16883a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:35.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:35.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:35.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:35.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:35.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:35.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:35.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 zone default found 2024-09-14T11:16:35.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 4 Realm: () 2024-09-14T11:16:35.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:35.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:35.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:35.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 zonegroup default 2024-09-14T11:16:35.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 started sync module instance, tier type = 2024-09-14T11:16:35.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.394+0000 7f92a636e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:35.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.418+0000 7f92a636e9c0 20 add_watcher() i=0 2024-09-14T11:16:35.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.418+0000 7f92a636e9c0 20 add_watcher() i=1 2024-09-14T11:16:35.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.418+0000 7f92a636e9c0 20 add_watcher() i=2 2024-09-14T11:16:35.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.418+0000 7f92a636e9c0 20 add_watcher() i=3 2024-09-14T11:16:35.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.418+0000 7f92a636e9c0 20 add_watcher() i=4 2024-09-14T11:16:35.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.418+0000 7f92a636e9c0 20 add_watcher() i=5 2024-09-14T11:16:35.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.418+0000 7f92a636e9c0 20 add_watcher() i=6 2024-09-14T11:16:35.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.422+0000 7f92a636e9c0 20 add_watcher() i=7 2024-09-14T11:16:35.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.422+0000 7f92a636e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:35.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f9159fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:35.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:35.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 5 note: GC not initialized 2024-09-14T11:16:35.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f9158fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:35.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:35.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 Filter name: none 2024-09-14T11:16:35.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f90d27fc640 20 reqs_thread_entry: start 2024-09-14T11:16:35.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:35.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:35.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:35.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:35.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.426+0000 7f92a636e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.430+0000 7f92a636e9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:35.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.430+0000 7f92a636e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:35.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.430+0000 7f9159fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.434+0000 7f92a636e9c0 20 remove_watcher() i=0 2024-09-14T11:16:35.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.434+0000 7f92a636e9c0 2 removed watcher, disabling cache 2024-09-14T11:16:35.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.438+0000 7f92a636e9c0 20 remove_watcher() i=1 2024-09-14T11:16:35.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.438+0000 7f92a636e9c0 20 remove_watcher() i=2 2024-09-14T11:16:35.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.442+0000 7f92a636e9c0 20 remove_watcher() i=3 2024-09-14T11:16:35.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.442+0000 7f92a636e9c0 20 remove_watcher() i=4 2024-09-14T11:16:35.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.446+0000 7f92a636e9c0 20 remove_watcher() i=5 2024-09-14T11:16:35.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.446+0000 7f92a636e9c0 20 remove_watcher() i=6 2024-09-14T11:16:35.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.450+0000 7f92a636e9c0 20 remove_watcher() i=7 2024-09-14T11:16:35.462 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:35.462 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:16:35.462 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-set-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:16:35.462 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:35.463 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:35.463 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:35.506 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:35.506 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:35.564 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:16:35.599 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:35.599 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:35.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.642+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 realm 2024-09-14T11:16:35.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:35.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.646+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.650+0000 7f4a97ac89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:35.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.650+0000 7f4a97ac89c0 20 searching for the correct realm 2024-09-14T11:16:35.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.654+0000 7f4a94dcd640 0 -- 172.21.15.148:0/1821408093 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f4a90105d00 msgr2=0x7f4a900fb580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.870+0000 7f4a95dcf640 0 -- 172.21.15.148:0/1821408093 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x564892f4d5c0 msgr2=0x564892f4fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:35.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:35.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:35.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:35.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:35.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:35.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:35.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 zone default found 2024-09-14T11:16:35.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 4 Realm: () 2024-09-14T11:16:35.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:35.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:35.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:35.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 zonegroup default 2024-09-14T11:16:35.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.882+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.886+0000 7f4a97ac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.886+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.886+0000 7f4a97ac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.886+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.886+0000 7f4a97ac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.886+0000 7f4a97ac89c0 20 started sync module instance, tier type = 2024-09-14T11:16:35.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.886+0000 7f4a97ac89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:35.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 20 add_watcher() i=0 2024-09-14T11:16:35.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 20 add_watcher() i=1 2024-09-14T11:16:35.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 20 add_watcher() i=2 2024-09-14T11:16:35.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 20 add_watcher() i=3 2024-09-14T11:16:35.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 20 add_watcher() i=4 2024-09-14T11:16:35.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 20 add_watcher() i=5 2024-09-14T11:16:35.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 20 add_watcher() i=6 2024-09-14T11:16:35.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 20 add_watcher() i=7 2024-09-14T11:16:35.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.910+0000 7f4a97ac89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:35.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.914+0000 7f494bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.914+0000 7f4a97ac89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:35.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.914+0000 7f4a97ac89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:35.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 5 note: GC not initialized 2024-09-14T11:16:35.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f494afe5640 20 reqs_thread_entry: start 2024-09-14T11:16:35.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:35.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 20 Filter name: none 2024-09-14T11:16:35.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:16:35.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4948fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:35.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:35.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:16:35.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:16:35.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 : miss 2024-09-14T11:16:35.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 info.flags=0x17 2024-09-14T11:16:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 to cache LRU end 2024-09-14T11:16:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:35.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.918+0000 7f4a97ac89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 2024-09-14T11:16:35.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.926+0000 7f4a97ac89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 info.flags=0x17 2024-09-14T11:16:35.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.926+0000 7f4a97ac89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 to cache LRU end 2024-09-14T11:16:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.926+0000 7f4a97ac89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.926+0000 7f4a97ac89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23, ofs0, ns] 2024-09-14T11:16:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.930+0000 7f4967fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366229 cookie 94869703161040 notifier 6221 bl.length()=1009 2024-09-14T11:16:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.930+0000 7f4967fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 info.flags=0x17 2024-09-14T11:16:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.930+0000 7f4967fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 to cache LRU end 2024-09-14T11:16:35.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.930+0000 7f4967fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:35.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.930+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): orig_sources= new_sources= 2024-09-14T11:16:35.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.930+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): potential sources added=[] removed=[] 2024-09-14T11:16:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.930+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): orig_dests= new_dests= 2024-09-14T11:16:35.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.930+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): potential dests added=[] removed=[] 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.0 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.0 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.1 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.1 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.2 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.2 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.3 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.3 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.4 2024-09-14T11:16:35.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.4 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.5 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.5 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.6 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.6 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.7 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.7 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.8 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.8 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.9 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.9 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.10 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.10 2024-09-14T11:16:35.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.11 2024-09-14T11:16:35.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1.11 2024-09-14T11:16:35.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.0 2024-09-14T11:16:35.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.938+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1 2024-09-14T11:16:35.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.942+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.2 2024-09-14T11:16:35.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.942+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.3 2024-09-14T11:16:35.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.942+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.4 2024-09-14T11:16:35.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.942+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.5 2024-09-14T11:16:35.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.946+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.6 2024-09-14T11:16:35.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.946+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.7 2024-09-14T11:16:35.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.946+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.8 2024-09-14T11:16:35.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.946+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.9 2024-09-14T11:16:35.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.946+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.10 2024-09-14T11:16:35.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4a97ac89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:35.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4a97ac89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 2024-09-14T11:16:35.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4a97ac89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 info.flags=0x17 2024-09-14T11:16:35.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4a97ac89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 to cache LRU end 2024-09-14T11:16:35.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4a97ac89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:35.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4a97ac89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23, ofs0, ns] 2024-09-14T11:16:35.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4978ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366230 cookie 94869703161040 notifier 6221 bl.length()=1009 2024-09-14T11:16:35.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4978ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 info.flags=0x17 2024-09-14T11:16:35.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4978ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 to cache LRU end 2024-09-14T11:16:35.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.954+0000 7f4978ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:35.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.958+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): orig_sources= new_sources= 2024-09-14T11:16:35.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.958+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): potential sources added=[] removed=[] 2024-09-14T11:16:35.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.958+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): orig_dests= new_dests= 2024-09-14T11:16:35.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.958+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): potential dests added=[] removed=[] 2024-09-14T11:16:35.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.966+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.0 2024-09-14T11:16:35.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.966+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.1 2024-09-14T11:16:35.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.966+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.2 2024-09-14T11:16:35.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.966+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.3 2024-09-14T11:16:35.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.966+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.4 2024-09-14T11:16:35.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.966+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.5 2024-09-14T11:16:35.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.970+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.6 2024-09-14T11:16:35.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.970+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.7 2024-09-14T11:16:35.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.970+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.8 2024-09-14T11:16:35.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.970+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.9 2024-09-14T11:16:35.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.970+0000 7f4a97ac89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23.10 2024-09-14T11:16:35.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4a97ac89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:35.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4a97ac89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 2024-09-14T11:16:35.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4a97ac89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 info.flags=0x17 2024-09-14T11:16:35.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4a97ac89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 to cache LRU end 2024-09-14T11:16:35.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4a97ac89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:35.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4a97ac89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23, ofs0, ns] 2024-09-14T11:16:35.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4978ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366231 cookie 94869703161040 notifier 6221 bl.length()=977 2024-09-14T11:16:35.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4978ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 info.flags=0x17 2024-09-14T11:16:35.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4978ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 to cache LRU end 2024-09-14T11:16:35.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.974+0000 7f4978ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:35.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.978+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): orig_sources= new_sources= 2024-09-14T11:16:35.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.978+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): potential sources added=[] removed=[] 2024-09-14T11:16:35.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.978+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): orig_dests= new_dests= 2024-09-14T11:16:35.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.978+0000 7f4a97ac89c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23]): potential dests added=[] removed=[] 2024-09-14T11:16:35.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.982+0000 7f4a97ac89c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:16:35.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.986+0000 7f494bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.990+0000 7f4a97ac89c0 20 remove_watcher() i=0 2024-09-14T11:16:35.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.990+0000 7f4a97ac89c0 2 removed watcher, disabling cache 2024-09-14T11:16:35.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.990+0000 7f4a97ac89c0 20 remove_watcher() i=1 2024-09-14T11:16:35.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.994+0000 7f4a97ac89c0 20 remove_watcher() i=2 2024-09-14T11:16:35.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.994+0000 7f4a97ac89c0 20 remove_watcher() i=3 2024-09-14T11:16:35.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.998+0000 7f4a97ac89c0 20 remove_watcher() i=4 2024-09-14T11:16:35.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:35.998+0000 7f4a97ac89c0 20 remove_watcher() i=5 2024-09-14T11:16:36.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.002+0000 7f4a97ac89c0 20 remove_watcher() i=6 2024-09-14T11:16:36.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.006+0000 7f4a97ac89c0 20 remove_watcher() i=7 2024-09-14T11:16:36.024 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.098+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.098+0000 7fea15c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.098+0000 7fea15c999c0 20 realm 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.098+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.098+0000 7fea15c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.098+0000 7fea15c999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.098+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.102+0000 7fea15c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.102+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.102+0000 7fea15c999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.102+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.102+0000 7fea15c999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.102+0000 7fea15c999c0 20 searching for the correct realm 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.110+0000 7fea12f9e640 0 -- 172.21.15.148:0/2136199011 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fea0c022040 msgr2=0x7fea0c034940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.114+0000 7fea13fa0640 0 -- 172.21.15.148:0/2136199011 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55cbe367aa60 msgr2=0x55cbe367cf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 zone default found 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 4 Realm: () 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 zonegroup default 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.122+0000 7fea15c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.126+0000 7fea15c999c0 20 started sync module instance, tier type = 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.126+0000 7fea15c999c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.142+0000 7fea15c999c0 20 add_watcher() i=0 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.142+0000 7fea15c999c0 20 add_watcher() i=1 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.142+0000 7fea15c999c0 20 add_watcher() i=2 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.142+0000 7fea15c999c0 20 add_watcher() i=3 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.142+0000 7fea15c999c0 20 add_watcher() i=4 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.142+0000 7fea15c999c0 20 add_watcher() i=5 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.142+0000 7fea15c999c0 20 add_watcher() i=6 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.146+0000 7fea15c999c0 20 add_watcher() i=7 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.146+0000 7fea15c999c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.146+0000 7fe8c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.146+0000 7fea15c999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.146+0000 7fea15c999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.146+0000 7fea15c999c0 5 note: GC not initialized 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fe8c8fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 Filter name: none 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fe8427fc640 20 reqs_thread_entry: start 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.150+0000 7fea15c999c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.154+0000 7fea15c999c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.154+0000 7fea15c999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.154+0000 7fe8c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.158+0000 7fea15c999c0 20 remove_watcher() i=0 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.158+0000 7fea15c999c0 2 removed watcher, disabling cache 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.162+0000 7fea15c999c0 20 remove_watcher() i=1 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.162+0000 7fea15c999c0 20 remove_watcher() i=2 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.166+0000 7fea15c999c0 20 remove_watcher() i=3 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.166+0000 7fea15c999c0 20 remove_watcher() i=4 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.170+0000 7fea15c999c0 20 remove_watcher() i=5 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.170+0000 7fea15c999c0 20 remove_watcher() i=6 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:36.174+0000 7fea15c999c0 20 remove_watcher() i=7 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-set-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:36.188 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:36.188 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:36.212 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:36.212 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:36.731 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:36.731 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.105 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:16:37.106 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:37.107 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.107 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.245 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.246 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.334 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.334 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.434 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.434 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.535 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.535 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.636 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.636 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.731 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.731 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.833 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.833 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:37.931 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:37.931 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.034 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.035 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.142 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.142 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.244 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.244 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.349 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.349 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.450 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.450 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.551 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.551 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.659 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.659 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.757 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.757 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.864 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.864 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:38.962 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:38.963 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:39.066 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:39.066 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:39.165 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:39.165 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:39.263 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:39.263 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:39.361 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:16:39.393 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:39.393 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:39.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.442+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.442+0000 7fa2446a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.442+0000 7fa2446a89c0 20 realm 2024-09-14T11:16:39.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.442+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:39.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:39.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:39.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.446+0000 7fa2446a89c0 20 searching for the correct realm 2024-09-14T11:16:39.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.454+0000 7fa23bfff640 0 -- 172.21.15.148:0/3270454602 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fa23c0f9bf0 msgr2=0x7fa23c0f8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:39.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.458+0000 7fa2429af640 0 -- 172.21.15.148:0/3270454602 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x562bf5da58b0 msgr2=0x562bf5da7d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:39.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:39.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:39.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:39.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:39.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:39.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:39.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:39.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 zone default found 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 4 Realm: () 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 zonegroup default 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 started sync module instance, tier type = 2024-09-14T11:16:39.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.466+0000 7fa2446a89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:39.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 20 add_watcher() i=0 2024-09-14T11:16:39.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 20 add_watcher() i=1 2024-09-14T11:16:39.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 20 add_watcher() i=2 2024-09-14T11:16:39.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 20 add_watcher() i=3 2024-09-14T11:16:39.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 20 add_watcher() i=4 2024-09-14T11:16:39.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 20 add_watcher() i=5 2024-09-14T11:16:39.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 20 add_watcher() i=6 2024-09-14T11:16:39.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 20 add_watcher() i=7 2024-09-14T11:16:39.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.486+0000 7fa2446a89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:39.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.490+0000 7fa0f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:39.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.490+0000 7fa2446a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:39.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.490+0000 7fa2446a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:39.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.490+0000 7fa2446a89c0 5 note: GC not initialized 2024-09-14T11:16:39.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.490+0000 7fa0737fe640 20 reqs_thread_entry: start 2024-09-14T11:16:39.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:39.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 Filter name: none 2024-09-14T11:16:39.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa0717fa640 20 reqs_thread_entry: start 2024-09-14T11:16:39.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:39.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:39.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:39.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:39.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.494+0000 7fa2446a89c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.498+0000 7fa2446a89c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:39.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.498+0000 7fa2446a89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:39.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.498+0000 7fa0f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:39.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.502+0000 7fa2446a89c0 20 remove_watcher() i=0 2024-09-14T11:16:39.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.502+0000 7fa2446a89c0 2 removed watcher, disabling cache 2024-09-14T11:16:39.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.506+0000 7fa2446a89c0 20 remove_watcher() i=1 2024-09-14T11:16:39.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.510+0000 7fa2446a89c0 20 remove_watcher() i=2 2024-09-14T11:16:39.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.510+0000 7fa2446a89c0 20 remove_watcher() i=3 2024-09-14T11:16:39.511 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.514+0000 7fa2446a89c0 20 remove_watcher() i=4 2024-09-14T11:16:39.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.514+0000 7fa2446a89c0 20 remove_watcher() i=5 2024-09-14T11:16:39.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.518+0000 7fa2446a89c0 20 remove_watcher() i=6 2024-09-14T11:16:39.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.518+0000 7fa2446a89c0 20 remove_watcher() i=7 2024-09-14T11:16:39.533 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:39.533 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:16:39.533 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-set-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:16:39.533 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:39.533 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:16:39.568 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:39.568 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:39.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 20 realm 2024-09-14T11:16:39.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:39.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.614+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.618+0000 7f64e36549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:39.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.618+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.618+0000 7f64e36549c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:39.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.618+0000 7f64e36549c0 20 searching for the correct realm 2024-09-14T11:16:39.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.622+0000 7f64e0959640 0 -- 172.21.15.148:0/2300118868 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f64dc0d5910 msgr2=0x7f64dc0c0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:39.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.630+0000 7f64e195b640 0 -- 172.21.15.148:0/2300118868 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55ddcf4b9c70 msgr2=0x55ddcf4bc130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:39.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.634+0000 7f64e36549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:39.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.634+0000 7f64e36549c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:39.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.634+0000 7f64e36549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:39.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.634+0000 7f64e36549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:39.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.634+0000 7f64e36549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:39.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.634+0000 7f64e36549c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:39.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.634+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:39.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:39.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 zone default found 2024-09-14T11:16:39.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 4 Realm: () 2024-09-14T11:16:39.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:39.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:39.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:39.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 zonegroup default 2024-09-14T11:16:39.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 started sync module instance, tier type = 2024-09-14T11:16:39.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.638+0000 7f64e36549c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:39.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 20 add_watcher() i=0 2024-09-14T11:16:39.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 20 add_watcher() i=1 2024-09-14T11:16:39.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 20 add_watcher() i=2 2024-09-14T11:16:39.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 20 add_watcher() i=3 2024-09-14T11:16:39.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 20 add_watcher() i=4 2024-09-14T11:16:39.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 20 add_watcher() i=5 2024-09-14T11:16:39.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 20 add_watcher() i=6 2024-09-14T11:16:39.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 20 add_watcher() i=7 2024-09-14T11:16:39.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.658+0000 7f64e36549c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:39.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f6397fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:39.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f64e36549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:39.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f64e36549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:39.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f64e36549c0 5 note: GC not initialized 2024-09-14T11:16:39.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f6396fe5640 20 reqs_thread_entry: start 2024-09-14T11:16:39.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f64e36549c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:39.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f64e36549c0 20 Filter name: none 2024-09-14T11:16:39.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f6394fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f64e36549c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:16:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.662+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:16:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:16:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 : miss 2024-09-14T11:16:39.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:39.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 info.flags=0x17 2024-09-14T11:16:39.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 to cache LRU end 2024-09-14T11:16:39.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:39.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:39.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.666+0000 7f64e36549c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 2024-09-14T11:16:39.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.674+0000 7f64e36549c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:16:39.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f64e36549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 info.flags=0x17 2024-09-14T11:16:39.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f64e36549c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 to cache LRU end 2024-09-14T11:16:39.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f64e36549c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:39.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f64e36549c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24, ofs0, ns] 2024-09-14T11:16:39.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f63c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366234 cookie 94411153977072 notifier 6645 bl.length()=1009 2024-09-14T11:16:39.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f63c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 info.flags=0x17 2024-09-14T11:16:39.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f63c4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 to cache LRU end 2024-09-14T11:16:39.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f63c4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:39.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): orig_sources= new_sources= 2024-09-14T11:16:39.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): potential sources added=[] removed=[] 2024-09-14T11:16:39.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): orig_dests= new_dests= 2024-09-14T11:16:39.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.678+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): potential dests added=[] removed=[] 2024-09-14T11:16:39.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.0 2024-09-14T11:16:39.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.0 2024-09-14T11:16:39.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.1 2024-09-14T11:16:39.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.1 2024-09-14T11:16:39.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.2 2024-09-14T11:16:39.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.2 2024-09-14T11:16:39.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.3 2024-09-14T11:16:39.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.3 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.4 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.4 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.5 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.5 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.6 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.6 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.7 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.7 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.8 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.8 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.9 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.9 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.10 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.10 2024-09-14T11:16:39.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.11 2024-09-14T11:16:39.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1.11 2024-09-14T11:16:39.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.0 2024-09-14T11:16:39.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1 2024-09-14T11:16:39.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.2 2024-09-14T11:16:39.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.3 2024-09-14T11:16:39.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.690+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.4 2024-09-14T11:16:39.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.694+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.5 2024-09-14T11:16:39.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.694+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.6 2024-09-14T11:16:39.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.694+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.7 2024-09-14T11:16:39.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.694+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.8 2024-09-14T11:16:39.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.694+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.9 2024-09-14T11:16:39.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.698+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.10 2024-09-14T11:16:39.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f64e36549c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:39.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f64e36549c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 2024-09-14T11:16:39.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f64e36549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 info.flags=0x17 2024-09-14T11:16:39.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f64e36549c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 to cache LRU end 2024-09-14T11:16:39.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f64e36549c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:39.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f64e36549c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24, ofs0, ns] 2024-09-14T11:16:39.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f63b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366235 cookie 94411153977072 notifier 6645 bl.length()=1009 2024-09-14T11:16:39.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f63b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 info.flags=0x17 2024-09-14T11:16:39.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f63b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 to cache LRU end 2024-09-14T11:16:39.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.706+0000 7f63b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:39.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.710+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): orig_sources= new_sources= 2024-09-14T11:16:39.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.710+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): potential sources added=[] removed=[] 2024-09-14T11:16:39.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.710+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): orig_dests= new_dests= 2024-09-14T11:16:39.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.710+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): potential dests added=[] removed=[] 2024-09-14T11:16:39.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.714+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.0 2024-09-14T11:16:39.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.714+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.1 2024-09-14T11:16:39.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.718+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.2 2024-09-14T11:16:39.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.718+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.3 2024-09-14T11:16:39.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.718+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.4 2024-09-14T11:16:39.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.718+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.5 2024-09-14T11:16:39.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.718+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.6 2024-09-14T11:16:39.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.718+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.7 2024-09-14T11:16:39.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.718+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.8 2024-09-14T11:16:39.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.722+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.9 2024-09-14T11:16:39.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.722+0000 7f64e36549c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24.10 2024-09-14T11:16:39.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.722+0000 7f64e36549c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:39.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.722+0000 7f64e36549c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 2024-09-14T11:16:39.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.726+0000 7f64e36549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 info.flags=0x17 2024-09-14T11:16:39.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.726+0000 7f64e36549c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 to cache LRU end 2024-09-14T11:16:39.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.726+0000 7f64e36549c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:39.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.726+0000 7f64e36549c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24, ofs0, ns] 2024-09-14T11:16:39.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.726+0000 7f63c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94411153977072 notifier 6645 bl.length()=977 2024-09-14T11:16:39.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.726+0000 7f63c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 info.flags=0x17 2024-09-14T11:16:39.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.726+0000 7f63c4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 to cache LRU end 2024-09-14T11:16:39.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.726+0000 7f63c4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:39.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.730+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): orig_sources= new_sources= 2024-09-14T11:16:39.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.730+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): potential sources added=[] removed=[] 2024-09-14T11:16:39.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.730+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): orig_dests= new_dests= 2024-09-14T11:16:39.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.730+0000 7f64e36549c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24]): potential dests added=[] removed=[] 2024-09-14T11:16:39.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.734+0000 7f64e36549c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:16:39.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.738+0000 7f6397fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:39.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.742+0000 7f64e36549c0 20 remove_watcher() i=0 2024-09-14T11:16:39.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.742+0000 7f64e36549c0 2 removed watcher, disabling cache 2024-09-14T11:16:39.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.742+0000 7f64e36549c0 20 remove_watcher() i=1 2024-09-14T11:16:39.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.746+0000 7f64e36549c0 20 remove_watcher() i=2 2024-09-14T11:16:39.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.746+0000 7f64e36549c0 20 remove_watcher() i=3 2024-09-14T11:16:39.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.750+0000 7f64e36549c0 20 remove_watcher() i=4 2024-09-14T11:16:39.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.754+0000 7f64e36549c0 20 remove_watcher() i=5 2024-09-14T11:16:39.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.754+0000 7f64e36549c0 20 remove_watcher() i=6 2024-09-14T11:16:39.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.758+0000 7f64e36549c0 20 remove_watcher() i=7 2024-09-14T11:16:39.773 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:16:39.803 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:39.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 20 realm 2024-09-14T11:16:39.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:39.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.850+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.854+0000 7f408aad19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:39.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.854+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.854+0000 7f408aad19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:39.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.854+0000 7f408aad19c0 20 searching for the correct realm 2024-09-14T11:16:39.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.858+0000 7f4087dd6640 0 -- 172.21.15.148:0/1748728286 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x560a940d1270 msgr2=0x560a940d3660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:39.864 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.866+0000 7f40885d7640 0 -- 172.21.15.148:0/1748728286 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f4080016400 msgr2=0x7f4080016880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:39.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.870+0000 7f408aad19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:39.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.870+0000 7f408aad19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:39.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.870+0000 7f408aad19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:39.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.870+0000 7f408aad19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:39.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.870+0000 7f408aad19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:39.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.870+0000 7f408aad19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:39.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.870+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:39.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:39.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 zone default found 2024-09-14T11:16:39.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 4 Realm: () 2024-09-14T11:16:39.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:39.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:39.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:39.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 zonegroup default 2024-09-14T11:16:39.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:39.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 started sync module instance, tier type = 2024-09-14T11:16:39.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.874+0000 7f408aad19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:39.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.894+0000 7f408aad19c0 20 add_watcher() i=0 2024-09-14T11:16:39.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.894+0000 7f408aad19c0 20 add_watcher() i=1 2024-09-14T11:16:39.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.894+0000 7f408aad19c0 20 add_watcher() i=2 2024-09-14T11:16:39.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.894+0000 7f408aad19c0 20 add_watcher() i=3 2024-09-14T11:16:39.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.894+0000 7f408aad19c0 20 add_watcher() i=4 2024-09-14T11:16:39.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.894+0000 7f408aad19c0 20 add_watcher() i=5 2024-09-14T11:16:39.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.894+0000 7f408aad19c0 20 add_watcher() i=6 2024-09-14T11:16:39.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.898+0000 7f408aad19c0 20 add_watcher() i=7 2024-09-14T11:16:39.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.898+0000 7f408aad19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:39.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.898+0000 7f3f3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.898+0000 7f408aad19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.898+0000 7f408aad19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.898+0000 7f408aad19c0 5 note: GC not initialized 2024-09-14T11:16:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f3f3dfdb640 20 reqs_thread_entry: start 2024-09-14T11:16:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 Filter name: none 2024-09-14T11:16:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f3eaf7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:39.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:39.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:39.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:39.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.902+0000 7f408aad19c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:39.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.906+0000 7f408aad19c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:39.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.906+0000 7f408aad19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:39.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.910+0000 7f3f3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:39.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.914+0000 7f408aad19c0 20 remove_watcher() i=0 2024-09-14T11:16:39.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.914+0000 7f408aad19c0 2 removed watcher, disabling cache 2024-09-14T11:16:39.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.914+0000 7f408aad19c0 20 remove_watcher() i=1 2024-09-14T11:16:39.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.918+0000 7f408aad19c0 20 remove_watcher() i=2 2024-09-14T11:16:39.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.918+0000 7f408aad19c0 20 remove_watcher() i=3 2024-09-14T11:16:39.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.918+0000 7f408aad19c0 20 remove_watcher() i=4 2024-09-14T11:16:39.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.922+0000 7f408aad19c0 20 remove_watcher() i=5 2024-09-14T11:16:39.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.926+0000 7f408aad19c0 20 remove_watcher() i=6 2024-09-14T11:16:39.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:39.926+0000 7f408aad19c0 20 remove_watcher() i=7 2024-09-14T11:16:39.940 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:39.940 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:16:39.940 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-set-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:16:39.940 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:39.942 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:39.942 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:39.964 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:39.964 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:40.499 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:40.499 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:40.874 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:16:40.874 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:40.877 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:40.877 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.015 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.016 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.107 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.107 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.215 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.215 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.318 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.318 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.421 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.422 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.533 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.533 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.638 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.638 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.734 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.734 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.836 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.836 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:41.937 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:41.937 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.041 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.041 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.147 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.147 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.243 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.244 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.355 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.355 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.460 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.460 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.556 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.557 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.660 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.660 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.762 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.762 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.867 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.867 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:42.969 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:42.969 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:43.069 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:43.070 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:43.171 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:16:43.204 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:43.204 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:43.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.250+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 realm 2024-09-14T11:16:43.251 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:43.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:43.254 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.254+0000 7f20dad129c0 20 searching for the correct realm 2024-09-14T11:16:43.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.262+0000 7f20d8017640 0 -- 172.21.15.148:0/1496349668 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f20c81210b0 msgr2=0x7f20c80faa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.266+0000 7f20d9019640 0 -- 172.21.15.148:0/1496349668 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55c4f353b0d0 msgr2=0x55c4f353d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:43.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:43.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:43.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:43.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:43.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:43.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.274+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 zone default found 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 4 Realm: () 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:43.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 zonegroup default 2024-09-14T11:16:43.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 started sync module instance, tier type = 2024-09-14T11:16:43.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.278+0000 7f20dad129c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:43.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 20 add_watcher() i=0 2024-09-14T11:16:43.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 20 add_watcher() i=1 2024-09-14T11:16:43.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 20 add_watcher() i=2 2024-09-14T11:16:43.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 20 add_watcher() i=3 2024-09-14T11:16:43.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 20 add_watcher() i=4 2024-09-14T11:16:43.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 20 add_watcher() i=5 2024-09-14T11:16:43.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 20 add_watcher() i=6 2024-09-14T11:16:43.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 20 add_watcher() i=7 2024-09-14T11:16:43.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.298+0000 7f20dad129c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:43.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.302+0000 7f1f8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.302+0000 7f20dad129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:43.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.302+0000 7f20dad129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:43.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.302+0000 7f20dad129c0 5 note: GC not initialized 2024-09-14T11:16:43.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.302+0000 7f1f8dfe3640 20 reqs_thread_entry: start 2024-09-14T11:16:43.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.302+0000 7f20dad129c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:43.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 Filter name: none 2024-09-14T11:16:43.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f1eff7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:43.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:43.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:43.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:43.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:43.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:43.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.306+0000 7f20dad129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:43.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.310+0000 7f1f8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.314+0000 7f20dad129c0 20 remove_watcher() i=0 2024-09-14T11:16:43.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.314+0000 7f20dad129c0 2 removed watcher, disabling cache 2024-09-14T11:16:43.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.318+0000 7f20dad129c0 20 remove_watcher() i=1 2024-09-14T11:16:43.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.318+0000 7f20dad129c0 20 remove_watcher() i=2 2024-09-14T11:16:43.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.318+0000 7f20dad129c0 20 remove_watcher() i=3 2024-09-14T11:16:43.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.322+0000 7f20dad129c0 20 remove_watcher() i=4 2024-09-14T11:16:43.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.322+0000 7f20dad129c0 20 remove_watcher() i=5 2024-09-14T11:16:43.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.326+0000 7f20dad129c0 20 remove_watcher() i=6 2024-09-14T11:16:43.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.330+0000 7f20dad129c0 20 remove_watcher() i=7 2024-09-14T11:16:43.341 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.342 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:16:43.342 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-set-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:16:43.342 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.342 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:16:43.375 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:43.375 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:43.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.418+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 realm 2024-09-14T11:16:43.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:43.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.426+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:43.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.426+0000 7fbd9528e9c0 20 searching for the correct realm 2024-09-14T11:16:43.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.430+0000 7fbd93595640 0 -- 172.21.15.148:0/1751036024 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5630baa7d830 msgr2=0x5630baa7fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.438+0000 7fbd93595640 0 -- 172.21.15.148:0/1751036024 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x5630baa8a0f0 msgr2=0x5630baa8c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:43.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:43.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:43.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:43.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:43.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:43.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 zone default found 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 Realm: () 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 zonegroup default 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 started sync module instance, tier type = 2024-09-14T11:16:43.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:43.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=0 2024-09-14T11:16:43.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=1 2024-09-14T11:16:43.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=2 2024-09-14T11:16:43.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=3 2024-09-14T11:16:43.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=4 2024-09-14T11:16:43.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=5 2024-09-14T11:16:43.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=6 2024-09-14T11:16:43.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.470+0000 7fbd9528e9c0 20 add_watcher() i=7 2024-09-14T11:16:43.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.470+0000 7fbd9528e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:43.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbc497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:43.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:43.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 note: GC not initialized 2024-09-14T11:16:43.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbbc3fff640 20 reqs_thread_entry: start 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 Filter name: none 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbbc1ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 : miss 2024-09-14T11:16:43.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:43.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:16:43.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:16:43.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:43.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:43.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 2024-09-14T11:16:43.482 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbd9528e9c0 time 2024-09-14T11:16:43.488804+0000 2024-09-14T11:16:43.482 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:43.483 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:43.483 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fbd98b682eb] 2024-09-14T11:16:43.483 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbd98b6849f] 2024-09-14T11:16:43.483 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630b91f1c01] 2024-09-14T11:16:43.483 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x1422828) [0x5630b9c4f828] 2024-09-14T11:16:43.483 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5630b9206ecd] 2024-09-14T11:16:43.483 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:16:43.483 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbd979ced90] 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.486+0000 7fbd9528e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbd9528e9c0 time 2024-09-14T11:16:43.488804+0000 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fbd98b682eb] 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbd98b6849f] 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630b91f1c01] 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x1422828) [0x5630b9c4f828] 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5630b9206ecd] 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:16:43.484 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbd979ced90] 2024-09-14T11:16:43.485 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:16:43.485 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:16:43.485 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.485 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:16:43.485 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fbd9528e9c0 thread_name:radosgw-admin 2024-09-14T11:16:43.502 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbd979e7520] 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fbd98b68345] 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbd98b6849f] 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630b91f1c01] 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x1422828) [0x5630b9c4f828] 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5630b9206ecd] 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbd979ced90] 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:16:43.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.486+0000 7fbd9528e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fbd9528e9c0 thread_name:radosgw-admin 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbd979e7520] 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fbd98b68345] 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbd98b6849f] 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630b91f1c01] 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x1422828) [0x5630b9c4f828] 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5630b9206ecd] 2024-09-14T11:16:43.504 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbd979ced90] 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.462131s 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): get_auth_request con 0x5630ba84df50 auth_method 0 2024-09-14T11:16:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630ba8d99f0 auth_method 0 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): handle_auth_done global_id 6693 payload 274 2024-09-14T11:16:43.506 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:16:43.398+0000 7fbd92d94640 1 monclient: found mon.noname-a 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: dump: 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.507 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: dump: 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.508 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6693 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 4 set_mon_vals no callback set 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient: shutdown 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) unregister_commands rotate-key 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: build_initial_monmap 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:16:43.509 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: monmap: 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.510 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding auth protocol: cephx 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding auth protocol: cephx 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding auth protocol: cephx 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.511 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: starting msgr at 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: starting objecter 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command objecter_requests hook 0x5630ba99a440 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: setting wanted keys 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: calling monclient init 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: init 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding auth protocol: cephx 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding auth protocol: cephx 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding auth protocol: cephx 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.512 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command rotate-key hook 0x5630ba994838 2024-09-14T11:16:43.513 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-a con 0x5630ba84df50 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-c con 0x5630ba8d99f0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-b con 0x5630ba8e04b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.465226s 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): get_auth_request con 0x5630ba84df50 auth_method 0 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.514 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630ba8d99f0 auth_method 0 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): handle_auth_done global_id 6311 payload 824 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:16:43.402+0000 7fbd92593640 1 monclient: found mon.noname-c 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:16:43.515 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: dump: 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.516 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: dump: 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.517 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6311 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:16:43.402+0000 7fbc80e09640 4 set_mon_vals no callback set 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: init done 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:16:43.406+0000 7fbc7f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:16:43.406+0000 7fbc7f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:16:43.406+0000 7fbc7f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:16:43.406+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbc780718a0 auth_method 0 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:16:43.406+0000 7fbd93595640 10 monclient: get_auth_request con 0x5630ba9c19c0 auth_method 0 2024-09-14T11:16:43.518 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:16:43.406+0000 7fbd92d94640 10 monclient: get_auth_request con 0x5630ba9df0b0 auth_method 0 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:16:43.406+0000 7fbd92593640 10 monclient: get_auth_request con 0x5630ba9e3410 auth_method 0 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: build_initial_monmap 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: monmap: 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:16:43.519 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding auth protocol: cephx 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding auth protocol: cephx 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding auth protocol: cephx 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.520 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command objecter_requests cmddesc objecter_requests hook 0x5630ba9ebc60 EEXIST 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: init 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding auth protocol: cephx 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding auth protocol: cephx 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding auth protocol: cephx 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.521 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command rotate-key cmddesc rotate-key hook 0x5630ba9e6aa0 EEXIST 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:16:43.522 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-c con 0x5630baa0fe10 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-a con 0x5630baa0f740 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-b con 0x5630baa0e120 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.474539s 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630baa0f740 auth_method 0 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): get_auth_request con 0x5630baa0fe10 auth_method 0 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.523 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): handle_auth_done global_id 6699 payload 824 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:16:43.410+0000 7fbd92593640 1 monclient: found mon.noname-a 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: dump: 2024-09-14T11:16:43.524 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.525 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: dump: 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6699 2024-09-14T11:16:43.526 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:16:43.410+0000 7fbd93d96640 4 set_mon_vals no callback set 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:16:43.414+0000 7fbc7ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:16:43.414+0000 7fbc7ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:16:43.414+0000 7fbc7ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:16:43.414+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbc6c0717e0 auth_method 0 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: get_monmap_and_config 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: build_initial_monmap 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: monmap: 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:16:43.527 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding auth protocol: cephx 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding auth protocol: cephx 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding auth protocol: cephx 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.528 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: init 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding auth protocol: cephx 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding auth protocol: cephx 2024-09-14T11:16:43.529 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding auth protocol: cephx 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.530 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command rotate-key cmddesc rotate-key hook 0x7fffbcf86498 EEXIST 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-b con 0x5630baa63e20 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-c con 0x5630baa33840 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-a con 0x5630baa5f5f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.478457s 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): get_auth_request con 0x5630baa5f5f0 auth_method 0 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.531 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630baa33840 auth_method 0 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): handle_auth_done global_id 6702 payload 274 2024-09-14T11:16:43.532 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:16:43.414+0000 7fbd93595640 1 monclient: found mon.noname-a 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: dump: 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.533 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: dump: 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.534 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6702 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 4 set_mon_vals no callback set 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: shutdown 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: build_initial_monmap 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: monmap: 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:16:43.535 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding auth protocol: cephx 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding auth protocol: cephx 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding auth protocol: cephx 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.536 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: starting msgr at 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: starting objecter 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command objecter_requests cmddesc objecter_requests hook 0x5630baa0f380 EEXIST 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: setting wanted keys 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: calling monclient init 2024-09-14T11:16:43.537 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: init 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding auth protocol: cephx 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding auth protocol: cephx 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding auth protocol: cephx 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.538 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command rotate-key cmddesc rotate-key hook 0x5630baa11d78 EEXIST 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-c con 0x5630baa33840 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-a con 0x5630baa5f5f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-b con 0x5630baa63e20 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.481116s 2024-09-14T11:16:43.539 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630baa5f5f0 auth_method 0 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): get_auth_request con 0x5630baa33840 auth_method 0 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): handle_auth_done global_id 6705 payload 824 2024-09-14T11:16:43.540 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:16:43.418+0000 7fbd92593640 1 monclient: found mon.noname-a 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: dump: 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.541 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: dump: 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.542 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:16:43.418+0000 7fbc767fc640 4 set_mon_vals no callback set 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6705 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: init done 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cr dump hook 0x5630baa5fdc8 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.543 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:16:43.422+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbc5c0718a0 auth_method 0 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:16:43.422+0000 7fbd93595640 10 monclient: get_auth_request con 0x5630baa7d830 auth_method 0 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 realm 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.544 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:16:43.422+0000 7fbd92d94640 10 monclient: get_auth_request con 0x5630baa81af0 auth_method 0 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:16:43.422+0000 7fbd92593640 10 monclient: get_auth_request con 0x5630baa85330 auth_method 0 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:16:43.426+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:16:43.426+0000 7fbd9528e9c0 20 searching for the correct realm 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:16:43.426+0000 7fbd93595640 10 monclient: get_auth_request con 0x5630baa8a0f0 auth_method 0 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:16:43.426+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbd84046070 auth_method 0 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:16:43.430+0000 7fbd92593640 10 monclient: get_auth_request con 0x7fbd8c0b0070 auth_method 0 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:16:43.430+0000 7fbd93595640 0 -- 172.21.15.148:0/1751036024 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5630baa7d830 msgr2=0x5630baa7fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:16:43.430+0000 7fbc74ff9640 1 client.6705.objecter ms_handle_reset 0x5630baa7d830 session 0x5630baa7d1b0 osd.6 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:16:43.430+0000 7fbc74ff9640 10 monclient: _renew_subs 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:16:43.430+0000 7fbc74ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:16:43.430+0000 7fbd93595640 10 monclient: get_auth_request con 0x7fbc5c081b40 auth_method 0 2024-09-14T11:16:43.545 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:16:43.434+0000 7fbd93595640 10 monclient: get_auth_request con 0x7fbd84027040 auth_method 0 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:16:43.434+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbd8c0cf400 auth_method 0 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:16:43.438+0000 7fbd93595640 0 -- 172.21.15.148:0/1751036024 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x5630baa8a0f0 msgr2=0x5630baa8c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:16:43.438+0000 7fbc74ff9640 1 client.6705.objecter ms_handle_reset 0x5630baa8a0f0 session 0x5630baa89a70 osd.4 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:16:43.438+0000 7fbd93595640 10 monclient: get_auth_request con 0x5630baa7d830 auth_method 0 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.546 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 zone default found 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 Realm: () 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 zonegroup default 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.547 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 started sync module instance, tier type = 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=0 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=1 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=2 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=3 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=4 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=5 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=6 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:16:43.470+0000 7fbd9528e9c0 20 add_watcher() i=7 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:16:43.470+0000 7fbd9528e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding auth protocol: cephx 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding auth protocol: cephx 2024-09-14T11:16:43.548 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding auth protocol: cephx 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:16:43.474+0000 7fbc497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.549 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cache list hook 0x5630baa590c0 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cache inspect hook 0x5630baa590c0 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cache erase hook 0x5630baa590c0 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cache zap hook 0x5630baa590c0 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 note: GC not initialized 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:16:43.474+0000 7fbbc3fff640 20 reqs_thread_entry: start 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command sync trace show hook 0x7fbd880043b0 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command sync trace history hook 0x7fbd880043b0 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command sync trace active hook 0x7fbd880043b0 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command sync trace active_short hook 0x7fbd880043b0 2024-09-14T11:16:43.550 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 Filter name: none 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:16:43.474+0000 7fbbc1ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 : miss 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:43.551 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:16:43.486+0000 7fbd9528e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbd9528e9c0 time 2024-09-14T11:16:43.488804+0000 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fbd98b682eb] 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbd98b6849f] 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630b91f1c01] 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x1422828) [0x5630b9c4f828] 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5630b9206ecd] 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbd979ced90] 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:16:43.552 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:16:43.486+0000 7fbd9528e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fbd9528e9c0 thread_name:radosgw-admin 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbd979e7520] 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fbd98b68345] 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbd98b6849f] 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630b91f1c01] 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x1422828) [0x5630b9c4f828] 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5630b9206ecd] 2024-09-14T11:16:43.553 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbd979ced90] 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:16:43.554 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:16:43.555 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:16:43.556 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:16:43.557 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:16:43.558 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:16:43.559 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:16:43.560 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbbc1ffb640 / http_manager 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbbc3fff640 / http_manager 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc497e2640 / rgw_dt_lg_renew 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc74ff9640 / ms_dispatch 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc767fc640 / io_context_pool 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc7ce01640 / ms_dispatch 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc7f606640 / ms_dispatch 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc80e09640 / io_context_pool 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd92593640 / msgr-worker-2 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd92d94640 / msgr-worker-1 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd93595640 / msgr-worker-0 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd93d96640 / io_context_pool 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd9528e9c0 / radosgw-admin 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:16:43.561 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.92739.log 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.462131s 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): get_auth_request con 0x5630ba84df50 auth_method 0 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630ba8d99f0 auth_method 0 2024-09-14T11:16:43.562 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:16:43.398+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient(hunting): handle_auth_done global_id 6693 payload 274 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:16:43.398+0000 7fbd92d94640 1 monclient: found mon.noname-a 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:16:43.398+0000 7fbd92d94640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.563 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: dump: 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.564 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:16:43.398+0000 7fbc80e09640 10 monclient: dump: 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6693 2024-09-14T11:16:43.565 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 4 set_mon_vals no callback set 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 10 monclient: shutdown 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:16:43.398+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) unregister_commands rotate-key 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: build_initial_monmap 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: monmap: 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:16:43.566 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding auth protocol: cephx 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding auth protocol: cephx 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding auth protocol: cephx 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.567 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: crc 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9998c0) adding con mode: secure 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: starting msgr at 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: starting objecter 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command objecter_requests hook 0x5630ba99a440 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: setting wanted keys 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: calling monclient init 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: init 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding auth protocol: cephx 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding auth protocol: cephx 2024-09-14T11:16:43.568 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding auth protocol: cephx 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: crc 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9946f0) adding con mode: secure 2024-09-14T11:16:43.569 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command rotate-key hook 0x5630ba994838 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-a con 0x5630ba84df50 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-c con 0x5630ba8d99f0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-b con 0x5630ba8e04b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.465226s 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): get_auth_request con 0x5630ba84df50 auth_method 0 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.570 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630ba8d99f0 auth_method 0 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:16:43.402+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient(hunting): handle_auth_done global_id 6311 payload 824 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:16:43.402+0000 7fbd92593640 1 monclient: found mon.noname-c 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:16:43.402+0000 7fbd92593640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:16:43.571 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: dump: 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.572 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:16:43.402+0000 7fbc7f606640 10 monclient: dump: 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.573 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6311 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:16:43.402+0000 7fbc80e09640 4 set_mon_vals no callback set 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:16:43.402+0000 7fbd9528e9c0 1 librados: init done 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:16:43.406+0000 7fbc7f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:16:43.406+0000 7fbc7f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:16:43.406+0000 7fbc7f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:16:43.406+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbc780718a0 auth_method 0 2024-09-14T11:16:43.574 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:16:43.406+0000 7fbd93595640 10 monclient: get_auth_request con 0x5630ba9c19c0 auth_method 0 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:16:43.406+0000 7fbd92d94640 10 monclient: get_auth_request con 0x5630ba9df0b0 auth_method 0 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:16:43.406+0000 7fbd92593640 10 monclient: get_auth_request con 0x5630ba9e3410 auth_method 0 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: build_initial_monmap 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: monmap: 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:16:43.575 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding auth protocol: cephx 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding auth protocol: cephx 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding auth protocol: cephx 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.576 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: crc 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e82d0) adding con mode: secure 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command objecter_requests cmddesc objecter_requests hook 0x5630ba9ebc60 EEXIST 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: init 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding auth protocol: cephx 2024-09-14T11:16:43.577 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding auth protocol: cephx 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding auth protocol: cephx 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: crc 2024-09-14T11:16:43.578 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 AuthRegistry(0x5630ba9e6958) adding con mode: secure 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command rotate-key cmddesc rotate-key hook 0x5630ba9e6aa0 EEXIST 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-c con 0x5630baa0fe10 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-a con 0x5630baa0f740 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-b con 0x5630baa0e120 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.474539s 2024-09-14T11:16:43.579 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630baa0f740 auth_method 0 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): get_auth_request con 0x5630baa0fe10 auth_method 0 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:16:43.410+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.580 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient(hunting): handle_auth_done global_id 6699 payload 824 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:16:43.410+0000 7fbd92593640 1 monclient: found mon.noname-a 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:16:43.410+0000 7fbd92593640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: dump: 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.581 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:16:43.410+0000 7fbc7ce01640 10 monclient: dump: 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.582 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6699 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:16:43.410+0000 7fbd93d96640 4 set_mon_vals no callback set 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:16:43.410+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:16:43.414+0000 7fbc7ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:16:43.414+0000 7fbc7ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.583 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:16:43.414+0000 7fbc7ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:16:43.414+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbc6c0717e0 auth_method 0 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: get_monmap_and_config 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: build_initial_monmap 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: monmap: 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:16:43.584 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding auth protocol: cephx 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding auth protocol: cephx 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding auth protocol: cephx 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.585 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: crc 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa2f770) adding con mode: secure 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: init 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding auth protocol: cephx 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding auth protocol: cephx 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding auth protocol: cephx 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.586 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: crc 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86350) adding con mode: secure 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command rotate-key cmddesc rotate-key hook 0x7fffbcf86498 EEXIST 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-b con 0x5630baa63e20 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-c con 0x5630baa33840 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-a con 0x5630baa5f5f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:16:43.587 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.478457s 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): get_auth_request con 0x5630baa5f5f0 auth_method 0 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630baa33840 auth_method 0 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.588 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:16:43.414+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient(hunting): handle_auth_done global_id 6702 payload 274 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:16:43.414+0000 7fbd93595640 1 monclient: found mon.noname-a 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:16:43.414+0000 7fbd93595640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: dump: 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.589 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:43.590 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:16:43.414+0000 7fbc767fc640 10 monclient: dump: 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6702 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 4 set_mon_vals no callback set 2024-09-14T11:16:43.591 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:16:43.414+0000 7fbd9528e9c0 10 monclient: shutdown 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: build_initial_monmap 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: monmap: 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:16:43.592 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding auth protocol: cephx 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding auth protocol: cephx 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding auth protocol: cephx 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.593 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: crc 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa5df80) adding con mode: secure 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: starting msgr at 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: starting objecter 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command objecter_requests cmddesc objecter_requests hook 0x5630baa0f380 EEXIST 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: setting wanted keys 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: calling monclient init 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: init 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding auth protocol: cephx 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding auth protocol: cephx 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding auth protocol: cephx 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.594 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: crc 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 AuthRegistry(0x5630baa11c30) adding con mode: secure 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command rotate-key cmddesc rotate-key hook 0x5630baa11d78 EEXIST 2024-09-14T11:16:43.595 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-c con 0x5630baa33840 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-a con 0x5630baa5f5f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): picked mon.noname-b con 0x5630baa63e20 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient(hunting): authenticate will time out at 2662.481116s 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): get_auth_request con 0x5630baa5f5f0 auth_method 0 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.596 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): get_auth_request con 0x5630baa33840 auth_method 0 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:16:43.418+0000 7fbd92d94640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient(hunting): handle_auth_done global_id 6705 payload 824 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient: _finish_hunting 0 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:16:43.418+0000 7fbd92593640 1 monclient: found mon.noname-a 2024-09-14T11:16:43.597 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:16:43.418+0000 7fbd92593640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: dump: 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: _finish_auth 0 2024-09-14T11:16:43.598 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 10 monclient: dump: 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:16:43.599 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:16:43.418+0000 7fbc767fc640 4 set_mon_vals no callback set 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 monclient: authenticate success, global_id 6705 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _renew_subs 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 1 librados: init done 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cr dump hook 0x5630baa5fdc8 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:16:43.418+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:16:43.418+0000 7fbc74ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:16:43.422+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbc5c0718a0 auth_method 0 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:16:43.422+0000 7fbd93595640 10 monclient: get_auth_request con 0x5630baa7d830 auth_method 0 2024-09-14T11:16:43.600 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 realm 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:16:43.422+0000 7fbd92d94640 10 monclient: get_auth_request con 0x5630baa81af0 auth_method 0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:16:43.422+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:16:43.422+0000 7fbd92593640 10 monclient: get_auth_request con 0x5630baa85330 auth_method 0 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:16:43.426+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:16:43.426+0000 7fbd9528e9c0 20 searching for the correct realm 2024-09-14T11:16:43.601 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:16:43.426+0000 7fbd93595640 10 monclient: get_auth_request con 0x5630baa8a0f0 auth_method 0 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:16:43.426+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbd84046070 auth_method 0 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:16:43.430+0000 7fbd92593640 10 monclient: get_auth_request con 0x7fbd8c0b0070 auth_method 0 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:16:43.430+0000 7fbd93595640 0 -- 172.21.15.148:0/1751036024 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5630baa7d830 msgr2=0x5630baa7fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:16:43.430+0000 7fbc74ff9640 1 client.6705.objecter ms_handle_reset 0x5630baa7d830 session 0x5630baa7d1b0 osd.6 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:16:43.430+0000 7fbc74ff9640 10 monclient: _renew_subs 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:16:43.430+0000 7fbc74ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:16:43.430+0000 7fbd93595640 10 monclient: get_auth_request con 0x7fbc5c081b40 auth_method 0 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:16:43.434+0000 7fbd93595640 10 monclient: get_auth_request con 0x7fbd84027040 auth_method 0 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:16:43.434+0000 7fbd92d94640 10 monclient: get_auth_request con 0x7fbd8c0cf400 auth_method 0 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:16:43.438+0000 7fbd93595640 0 -- 172.21.15.148:0/1751036024 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x5630baa8a0f0 msgr2=0x5630baa8c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:16:43.438+0000 7fbc74ff9640 1 client.6705.objecter ms_handle_reset 0x5630baa8a0f0 session 0x5630baa89a70 osd.4 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:16:43.438+0000 7fbd93595640 10 monclient: get_auth_request con 0x5630baa7d830 auth_method 0 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:43.602 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:43.603 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 zone default found 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 Realm: () 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 zonegroup default 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:16:43.446+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 started sync module instance, tier type = 2024-09-14T11:16:43.604 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:16:43.450+0000 7fbd9528e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=0 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=1 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=2 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=3 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=4 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=5 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:16:43.466+0000 7fbd9528e9c0 20 add_watcher() i=6 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:16:43.470+0000 7fbd9528e9c0 20 add_watcher() i=7 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:16:43.470+0000 7fbd9528e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding auth protocol: cephx 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding auth protocol: cephx 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding auth protocol: cephx 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.605 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:16:43.474+0000 7fbc497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: crc 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 AuthRegistry(0x7fffbcf86830) adding con mode: secure 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cache list hook 0x5630baa590c0 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cache inspect hook 0x5630baa590c0 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cache erase hook 0x5630baa590c0 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command cache zap hook 0x5630baa590c0 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 note: GC not initialized 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:16:43.474+0000 7fbbc3fff640 20 reqs_thread_entry: start 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command sync trace show hook 0x7fbd880043b0 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command sync trace history hook 0x7fbd880043b0 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command sync trace active hook 0x7fbd880043b0 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 5 asok(0x5630ba788d90) register_command sync trace active_short hook 0x7fbd880043b0 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 Filter name: none 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:16:43.474+0000 7fbbc1ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:16:43.607 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 : miss 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:16:43.474+0000 7fbd9528e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:16:43.486+0000 7fbd9528e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbd9528e9c0 time 2024-09-14T11:16:43.488804+0000 2024-09-14T11:16:43.608 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fbd98b682eb] 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbd98b6849f] 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630b91f1c01] 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x1422828) [0x5630b9c4f828] 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5630b9206ecd] 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbd979ced90] 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.609 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:16:43.486+0000 7fbd9528e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fbd9528e9c0 thread_name:radosgw-admin 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbd979e7520] 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fbd98b68345] 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbd98b6849f] 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5630b91f1c01] 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x1422828) [0x5630b9c4f828] 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5630b9206ecd] 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbd979ced90] 2024-09-14T11:16:43.610 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:16:43.611 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:16:43.612 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:16:43.613 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:16:43.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:16:43.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:16:43.616 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:16:43.617 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbbc1ffb640 / http_manager 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbbc3fff640 / http_manager 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc497e2640 / rgw_dt_lg_renew 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc74ff9640 / ms_dispatch 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc767fc640 / io_context_pool 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc7ce01640 / ms_dispatch 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc7f606640 / ms_dispatch 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbc80e09640 / io_context_pool 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd92593640 / msgr-worker-2 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd92d94640 / msgr-worker-1 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd93595640 / msgr-worker-0 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd93d96640 / io_context_pool 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: 7fbd9528e9c0 / radosgw-admin 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:16:43.618 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:16:43.619 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:16:43.491302Z_bf8cf154-6ceb-4bfc-baaf-43c0e76078e9/log 2024-09-14T11:16:43.619 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:16:43.619 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:16:43.619 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.566+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 realm 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.570+0000 7fc7affb29c0 20 searching for the correct realm 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.578+0000 7fc7adab8640 0 -- 172.21.15.148:0/1814001743 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fc7a004e040 msgr2=0x7fc7a004e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.582+0000 7fc7adab8640 0 -- 172.21.15.148:0/1814001743 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc7a8076a50 msgr2=0x7fc7a804fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.590+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 zone default found 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 4 Realm: () 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 zonegroup default 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 started sync module instance, tier type = 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.594+0000 7fc7affb29c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.614+0000 7fc7affb29c0 20 add_watcher() i=0 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.614+0000 7fc7affb29c0 20 add_watcher() i=1 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.614+0000 7fc7affb29c0 20 add_watcher() i=2 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.614+0000 7fc7affb29c0 20 add_watcher() i=3 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.614+0000 7fc7affb29c0 20 add_watcher() i=4 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.614+0000 7fc7affb29c0 20 add_watcher() i=5 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.614+0000 7fc7affb29c0 20 add_watcher() i=6 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.618+0000 7fc7affb29c0 20 add_watcher() i=7 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.618+0000 7fc7affb29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:43.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.618+0000 7fc65f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 5 note: GC not initialized 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc65e7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 Filter name: none 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc5cffff640 20 reqs_thread_entry: start 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:43.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:43.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.622+0000 7fc7affb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:43.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.626+0000 7fc65f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.630+0000 7fc7affb29c0 20 remove_watcher() i=0 2024-09-14T11:16:43.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.630+0000 7fc7affb29c0 2 removed watcher, disabling cache 2024-09-14T11:16:43.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.630+0000 7fc7affb29c0 20 remove_watcher() i=1 2024-09-14T11:16:43.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.634+0000 7fc7affb29c0 20 remove_watcher() i=2 2024-09-14T11:16:43.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.634+0000 7fc7affb29c0 20 remove_watcher() i=3 2024-09-14T11:16:43.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.638+0000 7fc7affb29c0 20 remove_watcher() i=4 2024-09-14T11:16:43.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.638+0000 7fc7affb29c0 20 remove_watcher() i=5 2024-09-14T11:16:43.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.642+0000 7fc7affb29c0 20 remove_watcher() i=6 2024-09-14T11:16:43.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.646+0000 7fc7affb29c0 20 remove_watcher() i=7 2024-09-14T11:16:43.656 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.657 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:16:43.657 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-set-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:16:43.657 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:16:43.658 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:43.658 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:43.704 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:16:43.704 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:16:43.768 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:16:43.804 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:43.804 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:43.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.850+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 realm 2024-09-14T11:16:43.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:43.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:43.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.854+0000 7f1174dd79c0 20 searching for the correct realm 2024-09-14T11:16:43.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.862+0000 7f11720dc640 0 -- 172.21.15.148:0/841387845 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5565ce2e5960 msgr2=0x5565ce2e7d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.866+0000 7f11728dd640 0 -- 172.21.15.148:0/841387845 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f116c066090 msgr2=0x7f116c065a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:43.871 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:43.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:16:43.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:43.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:43.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:43.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:16:43.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:43.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:43.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 zone default found 2024-09-14T11:16:43.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 4 Realm: () 2024-09-14T11:16:43.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:16:43.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:16:43.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:43.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 zonegroup default 2024-09-14T11:16:43.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.874+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.878+0000 7f1174dd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:43.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.878+0000 7f1174dd79c0 20 started sync module instance, tier type = 2024-09-14T11:16:43.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.878+0000 7f1174dd79c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:16:43.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.894+0000 7f1174dd79c0 20 add_watcher() i=0 2024-09-14T11:16:43.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.894+0000 7f1174dd79c0 20 add_watcher() i=1 2024-09-14T11:16:43.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.894+0000 7f1174dd79c0 20 add_watcher() i=2 2024-09-14T11:16:43.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.894+0000 7f1174dd79c0 20 add_watcher() i=3 2024-09-14T11:16:43.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.894+0000 7f1174dd79c0 20 add_watcher() i=4 2024-09-14T11:16:43.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.894+0000 7f1174dd79c0 20 add_watcher() i=5 2024-09-14T11:16:43.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.894+0000 7f1174dd79c0 20 add_watcher() i=6 2024-09-14T11:16:43.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.898+0000 7f1174dd79c0 20 add_watcher() i=7 2024-09-14T11:16:43.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.898+0000 7f1174dd79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:43.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f10297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:43.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:43.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 5 note: GC not initialized 2024-09-14T11:16:43.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f0fa3fff640 20 reqs_thread_entry: start 2024-09-14T11:16:43.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:16:43.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 20 Filter name: none 2024-09-14T11:16:43.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f0fa1ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:43.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:16:43.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 : miss 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 20 rados->read ofs=0 len=0 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:16:43.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:43.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:16:43.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.902+0000 7f1174dd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 2024-09-14T11:16:43.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.906+0000 7f1174dd79c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to be held by another RGW process; skipping for now 2024-09-14T11:16:43.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.906+0000 7f10297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:43.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.910+0000 7f1174dd79c0 20 remove_watcher() i=0 2024-09-14T11:16:43.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.910+0000 7f1174dd79c0 2 removed watcher, disabling cache 2024-09-14T11:16:43.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.914+0000 7f1174dd79c0 20 remove_watcher() i=1 2024-09-14T11:16:43.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.914+0000 7f1174dd79c0 20 remove_watcher() i=2 2024-09-14T11:16:43.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.918+0000 7f1174dd79c0 20 remove_watcher() i=3 2024-09-14T11:16:43.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.918+0000 7f1174dd79c0 20 remove_watcher() i=4 2024-09-14T11:16:43.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.922+0000 7f1174dd79c0 20 remove_watcher() i=5 2024-09-14T11:16:43.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.926+0000 7f1174dd79c0 20 remove_watcher() i=6 2024-09-14T11:16:43.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:16:43.926+0000 7f1174dd79c0 20 remove_watcher() i=7 2024-09-14T11:16:43.939 INFO:tasks.workunit.client.0.smithi148.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:17:13.964 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:14.001 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:14.001 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:14.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.049+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 realm 2024-09-14T11:17:14.048 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:14.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:14.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.053+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.057+0000 7f2fb9e809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:14.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.057+0000 7f2fb9e809c0 20 searching for the correct realm 2024-09-14T11:17:14.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.061+0000 7f2fb8187640 0 -- 172.21.15.148:0/1598272620 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55c94b519a60 msgr2=0x55c94b51bed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:14.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.069+0000 7f2fb7986640 0 -- 172.21.15.148:0/1598272620 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55c94b51dcd0 msgr2=0x55c94b5200e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:14.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:14.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 zone default found 2024-09-14T11:17:14.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 4 Realm: () 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 zonegroup default 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 started sync module instance, tier type = 2024-09-14T11:17:14.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.077+0000 7f2fb9e809c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:14.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.097+0000 7f2fb9e809c0 20 add_watcher() i=0 2024-09-14T11:17:14.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.097+0000 7f2fb9e809c0 20 add_watcher() i=1 2024-09-14T11:17:14.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.097+0000 7f2fb9e809c0 20 add_watcher() i=2 2024-09-14T11:17:14.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.097+0000 7f2fb9e809c0 20 add_watcher() i=3 2024-09-14T11:17:14.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.097+0000 7f2fb9e809c0 20 add_watcher() i=4 2024-09-14T11:17:14.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.097+0000 7f2fb9e809c0 20 add_watcher() i=5 2024-09-14T11:17:14.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.097+0000 7f2fb9e809c0 20 add_watcher() i=6 2024-09-14T11:17:14.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.101+0000 7f2fb9e809c0 20 add_watcher() i=7 2024-09-14T11:17:14.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.101+0000 7f2fb9e809c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:14.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2e6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 5 note: GC not initialized 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2e6cfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 20 Filter name: none 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2de67fc640 20 reqs_thread_entry: start 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:14.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:17:14.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:17:14.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 : miss 2024-09-14T11:17:14.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:14.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:17:14.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:17:14.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:14.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:14.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.105+0000 7f2fb9e809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 2024-09-14T11:17:14.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.117+0000 7f2fb9e809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:17:14.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.117+0000 7f2fb9e809c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:17:14.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.117+0000 7f2fb9e809c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:14.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.117+0000 7f2fb9e809c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25, ofs0, ns] 2024-09-14T11:17:14.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.117+0000 7f2e967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366232 cookie 94323040494208 notifier 6371 bl.length()=1009 2024-09-14T11:17:14.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.117+0000 7f2e967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:17:14.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.117+0000 7f2e967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:17:14.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.117+0000 7f2e967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:14.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.121+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): orig_sources= new_sources= 2024-09-14T11:17:14.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.121+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): potential sources added=[] removed=[] 2024-09-14T11:17:14.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.121+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): orig_dests= new_dests= 2024-09-14T11:17:14.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.121+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): potential dests added=[] removed=[] 2024-09-14T11:17:14.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.0 2024-09-14T11:17:14.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.0 2024-09-14T11:17:14.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.1 2024-09-14T11:17:14.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.1 2024-09-14T11:17:14.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.2 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.2 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.3 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.3 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.4 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.4 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.5 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.5 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.6 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.6 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.7 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.7 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.8 2024-09-14T11:17:14.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.8 2024-09-14T11:17:14.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.9 2024-09-14T11:17:14.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.9 2024-09-14T11:17:14.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.10 2024-09-14T11:17:14.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.10 2024-09-14T11:17:14.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.11 2024-09-14T11:17:14.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1.11 2024-09-14T11:17:14.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.0 2024-09-14T11:17:14.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1 2024-09-14T11:17:14.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.2 2024-09-14T11:17:14.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.129+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.3 2024-09-14T11:17:14.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.133+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.4 2024-09-14T11:17:14.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.133+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.5 2024-09-14T11:17:14.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.133+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.6 2024-09-14T11:17:14.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.133+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.7 2024-09-14T11:17:14.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.133+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.8 2024-09-14T11:17:14.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.133+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.9 2024-09-14T11:17:14.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.137+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.10 2024-09-14T11:17:14.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.141+0000 7f2fb9e809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:14.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.141+0000 7f2fb9e809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 2024-09-14T11:17:14.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.145+0000 7f2fb9e809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:17:14.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.145+0000 7f2fb9e809c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:17:14.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.145+0000 7f2fb9e809c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:14.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.145+0000 7f2fb9e809c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25, ofs0, ns] 2024-09-14T11:17:14.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.145+0000 7f2e967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94323040494208 notifier 6371 bl.length()=1009 2024-09-14T11:17:14.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.145+0000 7f2e967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:17:14.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.145+0000 7f2e967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:17:14.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.145+0000 7f2e967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:14.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.149+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): orig_sources= new_sources= 2024-09-14T11:17:14.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.149+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): potential sources added=[] removed=[] 2024-09-14T11:17:14.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.149+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): orig_dests= new_dests= 2024-09-14T11:17:14.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.149+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): potential dests added=[] removed=[] 2024-09-14T11:17:14.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.149+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.0 2024-09-14T11:17:14.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.153+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.1 2024-09-14T11:17:14.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.153+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.2 2024-09-14T11:17:14.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.153+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.3 2024-09-14T11:17:14.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.153+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.4 2024-09-14T11:17:14.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.153+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.5 2024-09-14T11:17:14.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.153+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.6 2024-09-14T11:17:14.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.153+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.7 2024-09-14T11:17:14.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.157+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.8 2024-09-14T11:17:14.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.157+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.9 2024-09-14T11:17:14.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.157+0000 7f2fb9e809c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25.10 2024-09-14T11:17:14.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.157+0000 7f2fb9e809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:14.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.157+0000 7f2fb9e809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 2024-09-14T11:17:14.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.161+0000 7f2fb9e809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:17:14.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.161+0000 7f2fb9e809c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:17:14.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.161+0000 7f2fb9e809c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:14.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.161+0000 7f2fb9e809c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25, ofs0, ns] 2024-09-14T11:17:14.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.161+0000 7f2e967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366234 cookie 94323040494208 notifier 6371 bl.length()=977 2024-09-14T11:17:14.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.161+0000 7f2e967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 info.flags=0x17 2024-09-14T11:17:14.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.161+0000 7f2e967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 to cache LRU end 2024-09-14T11:17:14.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.161+0000 7f2e967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:14.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.165+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): orig_sources= new_sources= 2024-09-14T11:17:14.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.165+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): potential sources added=[] removed=[] 2024-09-14T11:17:14.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.165+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): orig_dests= new_dests= 2024-09-14T11:17:14.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.165+0000 7f2fb9e809c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25]): potential dests added=[] removed=[] 2024-09-14T11:17:14.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.169+0000 7f2fb9e809c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:14.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.173+0000 7f2e6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:14.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.177+0000 7f2fb9e809c0 20 remove_watcher() i=0 2024-09-14T11:17:14.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.177+0000 7f2fb9e809c0 2 removed watcher, disabling cache 2024-09-14T11:17:14.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.177+0000 7f2fb9e809c0 20 remove_watcher() i=1 2024-09-14T11:17:14.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.181+0000 7f2fb9e809c0 20 remove_watcher() i=2 2024-09-14T11:17:14.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.181+0000 7f2fb9e809c0 20 remove_watcher() i=3 2024-09-14T11:17:14.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.185+0000 7f2fb9e809c0 20 remove_watcher() i=4 2024-09-14T11:17:14.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.185+0000 7f2fb9e809c0 20 remove_watcher() i=5 2024-09-14T11:17:14.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.189+0000 7f2fb9e809c0 20 remove_watcher() i=6 2024-09-14T11:17:14.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.193+0000 7f2fb9e809c0 20 remove_watcher() i=7 2024-09-14T11:17:14.202 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:17:14.233 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:14.233 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:14.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.281+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 realm 2024-09-14T11:17:14.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:14.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:14.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.285+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.289+0000 7fd3a233f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:14.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.289+0000 7fd3a233f9c0 20 searching for the correct realm 2024-09-14T11:17:14.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.293+0000 7fd39fe45640 0 -- 172.21.15.148:0/128869041 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fd39003e070 msgr2=0x7fd39009ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:14.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.297+0000 7fd39fe45640 0 -- 172.21.15.148:0/128869041 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x555793b55d50 msgr2=0x555793b58140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:14.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:14.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:14.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:14.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:14.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:14.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:14.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:14.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.305+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:14.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 zone default found 2024-09-14T11:17:14.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 4 Realm: () 2024-09-14T11:17:14.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:14.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:14.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:14.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 zonegroup default 2024-09-14T11:17:14.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 started sync module instance, tier type = 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.309+0000 7fd3a233f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:14.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 20 add_watcher() i=0 2024-09-14T11:17:14.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 20 add_watcher() i=1 2024-09-14T11:17:14.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 20 add_watcher() i=2 2024-09-14T11:17:14.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 20 add_watcher() i=3 2024-09-14T11:17:14.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 20 add_watcher() i=4 2024-09-14T11:17:14.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 20 add_watcher() i=5 2024-09-14T11:17:14.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 20 add_watcher() i=6 2024-09-14T11:17:14.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 20 add_watcher() i=7 2024-09-14T11:17:14.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.329+0000 7fd3a233f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:14.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:14.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd3a233f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:14.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd3a233f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:14.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd3a233f9c0 5 note: GC not initialized 2024-09-14T11:17:14.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd254fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:14.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd3a233f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:14.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd3a233f9c0 20 Filter name: none 2024-09-14T11:17:14.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd1ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:14.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd3a233f9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:14.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.333+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.337+0000 7fd3a233f9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:14.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.337+0000 7fd3a233f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:14.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.337+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.337+0000 7fd3a233f9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:14.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.337+0000 7fd3a233f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.337+0000 7fd3a233f9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:14.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.337+0000 7fd3a233f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:14.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.341+0000 7fd255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:14.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.349+0000 7fd3a233f9c0 20 remove_watcher() i=0 2024-09-14T11:17:14.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.349+0000 7fd3a233f9c0 2 removed watcher, disabling cache 2024-09-14T11:17:14.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.349+0000 7fd3a233f9c0 20 remove_watcher() i=1 2024-09-14T11:17:14.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.349+0000 7fd3a233f9c0 20 remove_watcher() i=2 2024-09-14T11:17:14.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.353+0000 7fd3a233f9c0 20 remove_watcher() i=3 2024-09-14T11:17:14.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.357+0000 7fd3a233f9c0 20 remove_watcher() i=4 2024-09-14T11:17:14.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.357+0000 7fd3a233f9c0 20 remove_watcher() i=5 2024-09-14T11:17:14.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.361+0000 7fd3a233f9c0 20 remove_watcher() i=6 2024-09-14T11:17:14.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:14.365+0000 7fd3a233f9c0 20 remove_watcher() i=7 2024-09-14T11:17:14.373 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:14.373 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:14.373 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-set-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:17:14.373 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:14.375 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:14.375 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:14.398 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:14.399 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:14.948 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:14.948 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:15.329 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:17:15.329 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:15.331 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:15.331 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:15.470 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:15.470 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:15.563 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:15.563 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:15.674 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:15.674 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:15.772 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:15.772 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:15.876 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:15.876 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:15.979 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:15.980 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.089 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.089 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.191 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.191 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.296 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.296 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.398 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.398 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.501 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.501 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.618 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.618 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.771 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.772 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.881 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.881 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:16.985 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:16.985 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:17.085 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:17.085 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:17.182 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:17.183 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:17.275 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:17.275 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:17.359 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:17.359 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:17.459 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:17.459 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:17.560 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:17.560 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:17.663 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:17:17.697 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:17.697 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:17.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.745+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 realm 2024-09-14T11:17:17.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:17.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:17.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.749+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.753+0000 7fbb2deeb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:17.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.753+0000 7fbb2deeb9c0 20 searching for the correct realm 2024-09-14T11:17:17.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.757+0000 7fbb2c1f2640 0 -- 172.21.15.148:0/1884635464 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55ff2d249020 msgr2=0x55ff2d24b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:17.761 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.765+0000 7fbb2c1f2640 0 -- 172.21.15.148:0/1884635464 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55ff2d255810 msgr2=0x55ff2d257cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:17.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:17.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:17.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:17.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:17.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:17.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:17.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:17.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:17.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 zone default found 2024-09-14T11:17:17.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 4 Realm: () 2024-09-14T11:17:17.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:17.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:17.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:17.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 zonegroup default 2024-09-14T11:17:17.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.773+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.777+0000 7fbb2deeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.777+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.777+0000 7fbb2deeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.777+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.777+0000 7fbb2deeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.777+0000 7fbb2deeb9c0 20 started sync module instance, tier type = 2024-09-14T11:17:17.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.777+0000 7fbb2deeb9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:17.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.793+0000 7fbb2deeb9c0 20 add_watcher() i=0 2024-09-14T11:17:17.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.793+0000 7fbb2deeb9c0 20 add_watcher() i=1 2024-09-14T11:17:17.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.793+0000 7fbb2deeb9c0 20 add_watcher() i=2 2024-09-14T11:17:17.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.793+0000 7fbb2deeb9c0 20 add_watcher() i=3 2024-09-14T11:17:17.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.793+0000 7fbb2deeb9c0 20 add_watcher() i=4 2024-09-14T11:17:17.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.793+0000 7fbb2deeb9c0 20 add_watcher() i=5 2024-09-14T11:17:17.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.797+0000 7fbb2deeb9c0 20 add_watcher() i=6 2024-09-14T11:17:17.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.797+0000 7fbb2deeb9c0 20 add_watcher() i=7 2024-09-14T11:17:17.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.797+0000 7fbb2deeb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:17.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fb9e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:17.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fbb2deeb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:17.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fbb2deeb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:17.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fbb2deeb9c0 5 note: GC not initialized 2024-09-14T11:17:17.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fb9e0fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:17.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fbb2deeb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:17.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fbb2deeb9c0 20 Filter name: none 2024-09-14T11:17:17.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fb95a7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:17.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.801+0000 7fbb2deeb9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:17.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.805+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.805+0000 7fbb2deeb9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:17.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.805+0000 7fbb2deeb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:17.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.805+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.805+0000 7fbb2deeb9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:17.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.805+0000 7fbb2deeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.805+0000 7fbb2deeb9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:17.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.805+0000 7fbb2deeb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:17.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.809+0000 7fb9e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:17.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.813+0000 7fbb2deeb9c0 20 remove_watcher() i=0 2024-09-14T11:17:17.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.813+0000 7fbb2deeb9c0 2 removed watcher, disabling cache 2024-09-14T11:17:17.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.817+0000 7fbb2deeb9c0 20 remove_watcher() i=1 2024-09-14T11:17:17.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.817+0000 7fbb2deeb9c0 20 remove_watcher() i=2 2024-09-14T11:17:17.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.821+0000 7fbb2deeb9c0 20 remove_watcher() i=3 2024-09-14T11:17:17.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.821+0000 7fbb2deeb9c0 20 remove_watcher() i=4 2024-09-14T11:17:17.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.825+0000 7fbb2deeb9c0 20 remove_watcher() i=5 2024-09-14T11:17:17.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.825+0000 7fbb2deeb9c0 20 remove_watcher() i=6 2024-09-14T11:17:17.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.829+0000 7fbb2deeb9c0 20 remove_watcher() i=7 2024-09-14T11:17:17.842 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:17.842 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:17.842 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-trim-reshard-log-entries id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:17.842 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:17.842 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:17:17.880 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:17.880 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:17.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.929+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.929+0000 7f5a84f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.929+0000 7f5a84f5e9c0 20 realm 2024-09-14T11:17:17.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.929+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.929+0000 7f5a84f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.933+0000 7f5a84f5e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:17.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.933+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.933+0000 7f5a84f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.933+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.933+0000 7f5a84f5e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:17.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.933+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.933+0000 7f5a84f5e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:17.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.933+0000 7f5a84f5e9c0 20 searching for the correct realm 2024-09-14T11:17:17.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.941+0000 7f5a82a64640 0 -- 172.21.15.148:0/1227461462 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x561f390d1910 msgr2=0x561f390d3d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:17.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.945+0000 7f5a82a64640 0 -- 172.21.15.148:0/1227461462 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f5a7c0036b0 msgr2=0x7f5a7c076d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:17.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:17.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:17.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:17.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:17.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:17.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:17.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:17.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:17.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 zone default found 2024-09-14T11:17:17.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 4 Realm: () 2024-09-14T11:17:17.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:17.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:17.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:17.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 zonegroup default 2024-09-14T11:17:17.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.953+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.957+0000 7f5a84f5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.957+0000 7f5a84f5e9c0 20 started sync module instance, tier type = 2024-09-14T11:17:17.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.957+0000 7f5a84f5e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:17.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 20 add_watcher() i=0 2024-09-14T11:17:17.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 20 add_watcher() i=1 2024-09-14T11:17:17.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 20 add_watcher() i=2 2024-09-14T11:17:17.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 20 add_watcher() i=3 2024-09-14T11:17:17.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 20 add_watcher() i=4 2024-09-14T11:17:17.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 20 add_watcher() i=5 2024-09-14T11:17:17.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 20 add_watcher() i=6 2024-09-14T11:17:17.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 20 add_watcher() i=7 2024-09-14T11:17:17.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.977+0000 7f5a84f5e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:17.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f59397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:17.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:17.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:17.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 5 note: GC not initialized 2024-09-14T11:17:17.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f58b3fff640 20 reqs_thread_entry: start 2024-09-14T11:17:17.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:17.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 20 Filter name: none 2024-09-14T11:17:17.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f58b1ffb640 20 reqs_thread_entry: start 2024-09-14T11:17:17.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:17:17.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:17.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:17:17.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:17:17.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 : miss 2024-09-14T11:17:17.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.981+0000 7f5a84f5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.985+0000 7f5a84f5e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:17.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.985+0000 7f5a84f5e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:17.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.985+0000 7f5a84f5e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:17.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.985+0000 7f5a84f5e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:17.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.985+0000 7f5a84f5e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:17.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.985+0000 7f5a84f5e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 2024-09-14T11:17:17.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.993+0000 7f5a84f5e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:17.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.993+0000 7f5a84f5e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:17.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.993+0000 7f5a84f5e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:17.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.993+0000 7f5a84f5e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26, ofs0, ns] 2024-09-14T11:17:17.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.993+0000 7f5965ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366237 cookie 94692101197952 notifier 6416 bl.length()=1023 2024-09-14T11:17:17.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.993+0000 7f5965ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:17.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.993+0000 7f5965ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:17.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.993+0000 7f5965ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:17.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.997+0000 7f5a84f5e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): orig_sources= new_sources= 2024-09-14T11:17:17.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.997+0000 7f5a84f5e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): potential sources added=[] removed=[] 2024-09-14T11:17:17.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.997+0000 7f5a84f5e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): orig_dests= new_dests= 2024-09-14T11:17:17.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.997+0000 7f5a84f5e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): potential dests added=[] removed=[] 2024-09-14T11:17:17.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.997+0000 7f5a84f5e9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:17:17.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:17.997+0000 7f5a84f5e9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:17:17.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.001+0000 7f59397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:17.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.005+0000 7f5a84f5e9c0 20 remove_watcher() i=0 2024-09-14T11:17:17.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.005+0000 7f5a84f5e9c0 2 removed watcher, disabling cache 2024-09-14T11:17:18.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.005+0000 7f5a84f5e9c0 20 remove_watcher() i=1 2024-09-14T11:17:18.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.009+0000 7f5a84f5e9c0 20 remove_watcher() i=2 2024-09-14T11:17:18.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.009+0000 7f5a84f5e9c0 20 remove_watcher() i=3 2024-09-14T11:17:18.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.013+0000 7f5a84f5e9c0 20 remove_watcher() i=4 2024-09-14T11:17:18.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.013+0000 7f5a84f5e9c0 20 remove_watcher() i=5 2024-09-14T11:17:18.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.017+0000 7f5a84f5e9c0 20 remove_watcher() i=6 2024-09-14T11:17:18.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.021+0000 7f5a84f5e9c0 20 remove_watcher() i=7 2024-09-14T11:17:18.029 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:17:18.055 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:18.056 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:18.283 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.289+0000 7fe984998640 0 --2- 172.21.15.148:0/4175834792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe970002350 0x55c56df1ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:17:18.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.313+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.317+0000 7fe9876939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.317+0000 7fe9876939c0 20 realm 2024-09-14T11:17:18.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.317+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.317+0000 7fe9876939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.317+0000 7fe9876939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:18.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.317+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.317+0000 7fe9876939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.317+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.321+0000 7fe9876939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.321+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.321+0000 7fe9876939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:18.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.321+0000 7fe9876939c0 20 searching for the correct realm 2024-09-14T11:17:18.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.321+0000 7fe98599a640 0 -- 172.21.15.148:0/825514702 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55c56dfd2610 msgr2=0x55c56dfd4aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.329+0000 7fe985199640 0 -- 172.21.15.148:0/825514702 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fe9780b0070 msgr2=0x7fe9780f5c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:18.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 zone default found 2024-09-14T11:17:18.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 4 Realm: () 2024-09-14T11:17:18.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:18.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:18.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:18.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 zonegroup default 2024-09-14T11:17:18.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.341+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.345+0000 7fe9876939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.345+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.345+0000 7fe9876939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.345+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.345+0000 7fe9876939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.345+0000 7fe9876939c0 20 started sync module instance, tier type = 2024-09-14T11:17:18.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.345+0000 7fe9876939c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:18.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.361+0000 7fe9876939c0 20 add_watcher() i=0 2024-09-14T11:17:18.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.361+0000 7fe9876939c0 20 add_watcher() i=1 2024-09-14T11:17:18.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.361+0000 7fe9876939c0 20 add_watcher() i=2 2024-09-14T11:17:18.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.361+0000 7fe9876939c0 20 add_watcher() i=3 2024-09-14T11:17:18.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.361+0000 7fe9876939c0 20 add_watcher() i=4 2024-09-14T11:17:18.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.361+0000 7fe9876939c0 20 add_watcher() i=5 2024-09-14T11:17:18.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.361+0000 7fe9876939c0 20 add_watcher() i=6 2024-09-14T11:17:18.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.365+0000 7fe9876939c0 20 add_watcher() i=7 2024-09-14T11:17:18.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.365+0000 7fe9876939c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:18.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe83b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe9876939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:18.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe9876939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:18.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe9876939c0 5 note: GC not initialized 2024-09-14T11:17:18.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe83a7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:18.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe9876939c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:18.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe9876939c0 20 Filter name: none 2024-09-14T11:17:18.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe7abfff640 20 reqs_thread_entry: start 2024-09-14T11:17:18.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe9876939c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:18.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.369+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.373+0000 7fe9876939c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:17:18.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.373+0000 7fe9876939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:18.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.373+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.373+0000 7fe9876939c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:18.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.373+0000 7fe9876939c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.373+0000 7fe9876939c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:17:18.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.373+0000 7fe9876939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:18.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.377+0000 7fe83b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.381+0000 7fe9876939c0 20 remove_watcher() i=0 2024-09-14T11:17:18.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.381+0000 7fe9876939c0 2 removed watcher, disabling cache 2024-09-14T11:17:18.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.381+0000 7fe9876939c0 20 remove_watcher() i=1 2024-09-14T11:17:18.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.385+0000 7fe9876939c0 20 remove_watcher() i=2 2024-09-14T11:17:18.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.385+0000 7fe9876939c0 20 remove_watcher() i=3 2024-09-14T11:17:18.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.389+0000 7fe9876939c0 20 remove_watcher() i=4 2024-09-14T11:17:18.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.389+0000 7fe9876939c0 20 remove_watcher() i=5 2024-09-14T11:17:18.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.393+0000 7fe9876939c0 20 remove_watcher() i=6 2024-09-14T11:17:18.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.397+0000 7fe9876939c0 20 remove_watcher() i=7 2024-09-14T11:17:18.405 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:18.406 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:18.406 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-trim-reshard-log-entries id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:18.406 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:18.407 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:18.407 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:18.452 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:18.452 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:18.516 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:18.553 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:18.553 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:18.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.601+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 realm 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:18.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.605+0000 7f14cc4e49c0 20 searching for the correct realm 2024-09-14T11:17:18.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.609+0000 7f14c9fea640 0 -- 172.21.15.148:0/3057478489 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f14bc045040 msgr2=0x7f14bc02c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.617+0000 7f14c9fea640 0 -- 172.21.15.148:0/3057478489 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x5559ad7bdf40 msgr2=0x7f14c4104040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:18.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:18.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:18.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:18.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:18.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:18.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:18.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 zone default found 2024-09-14T11:17:18.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 4 Realm: () 2024-09-14T11:17:18.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:18.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:18.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:18.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 zonegroup default 2024-09-14T11:17:18.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.837+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.841+0000 7f14cc4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.841+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.841+0000 7f14cc4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.841+0000 7f14cc4e49c0 20 started sync module instance, tier type = 2024-09-14T11:17:18.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.841+0000 7f14cc4e49c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:18.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 20 add_watcher() i=0 2024-09-14T11:17:18.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 20 add_watcher() i=1 2024-09-14T11:17:18.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 20 add_watcher() i=2 2024-09-14T11:17:18.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 20 add_watcher() i=3 2024-09-14T11:17:18.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 20 add_watcher() i=4 2024-09-14T11:17:18.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 20 add_watcher() i=5 2024-09-14T11:17:18.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 20 add_watcher() i=6 2024-09-14T11:17:18.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 20 add_watcher() i=7 2024-09-14T11:17:18.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.865+0000 7f14cc4e49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:18.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.869+0000 7f137ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:18.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:18.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 5 note: GC not initialized 2024-09-14T11:17:18.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f137efe5640 20 reqs_thread_entry: start 2024-09-14T11:17:18.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:18.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 20 Filter name: none 2024-09-14T11:17:18.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f137cfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:18.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:17:18.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:18.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:17:18.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:17:18.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 : miss 2024-09-14T11:17:18.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:17:18.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:18.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:18.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:18.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.870 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.873+0000 7f14cc4e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 2024-09-14T11:17:18.872 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.877+0000 7f14cc4e49c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:17:18.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.889+0000 7f14cc4e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:18.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.889+0000 7f14cc4e49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:18.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.889+0000 7f14cc4e49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.889+0000 7f14cc4e49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26, ofs0, ns] 2024-09-14T11:17:18.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.889+0000 7f13ad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366238 cookie 93843653398080 notifier 6852 bl.length()=1023 2024-09-14T11:17:18.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.889+0000 7f13ad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:18.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.889+0000 7f13ad7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:18.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.889+0000 7f13ad7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.893+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): orig_sources= new_sources= 2024-09-14T11:17:18.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.893+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): potential sources added=[] removed=[] 2024-09-14T11:17:18.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.893+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): orig_dests= new_dests= 2024-09-14T11:17:18.889 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.893+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): potential dests added=[] removed=[] 2024-09-14T11:17:18.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.0 2024-09-14T11:17:18.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.0 2024-09-14T11:17:18.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.1 2024-09-14T11:17:18.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.1 2024-09-14T11:17:18.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.2 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.2 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.3 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.3 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.4 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.4 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.5 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.5 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.6 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.6 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.7 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.7 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.8 2024-09-14T11:17:18.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.8 2024-09-14T11:17:18.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.9 2024-09-14T11:17:18.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.9 2024-09-14T11:17:18.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.10 2024-09-14T11:17:18.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.10 2024-09-14T11:17:18.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.11 2024-09-14T11:17:18.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2.11 2024-09-14T11:17:18.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.0 2024-09-14T11:17:18.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.1 2024-09-14T11:17:18.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2 2024-09-14T11:17:18.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.3 2024-09-14T11:17:18.902 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.905+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.4 2024-09-14T11:17:18.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.909+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.5 2024-09-14T11:17:18.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.909+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.6 2024-09-14T11:17:18.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.909+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.7 2024-09-14T11:17:18.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.909+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.8 2024-09-14T11:17:18.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.913+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.9 2024-09-14T11:17:18.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.913+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.10 2024-09-14T11:17:18.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.917+0000 7f14cc4e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:18.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.917+0000 7f14cc4e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 2024-09-14T11:17:18.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.921+0000 7f14cc4e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:18.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.921+0000 7f14cc4e49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:18.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.921+0000 7f14cc4e49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.921+0000 7f14cc4e49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26, ofs0, ns] 2024-09-14T11:17:18.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.921+0000 7f13ad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366239 cookie 93843653398080 notifier 6852 bl.length()=1023 2024-09-14T11:17:18.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.921+0000 7f13ad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:18.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.921+0000 7f13ad7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:18.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.921+0000 7f13ad7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.925+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): orig_sources= new_sources= 2024-09-14T11:17:18.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.925+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): potential sources added=[] removed=[] 2024-09-14T11:17:18.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.925+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): orig_dests= new_dests= 2024-09-14T11:17:18.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.925+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): potential dests added=[] removed=[] 2024-09-14T11:17:18.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.929+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.0 2024-09-14T11:17:18.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.929+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.1 2024-09-14T11:17:18.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.933+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.2 2024-09-14T11:17:18.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.933+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.3 2024-09-14T11:17:18.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.933+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.4 2024-09-14T11:17:18.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.933+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.5 2024-09-14T11:17:18.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.933+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.6 2024-09-14T11:17:18.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.933+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.7 2024-09-14T11:17:18.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.933+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.8 2024-09-14T11:17:18.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.937+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.9 2024-09-14T11:17:18.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.937+0000 7f14cc4e49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26.10 2024-09-14T11:17:18.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.937+0000 7f14cc4e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:18.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.937+0000 7f14cc4e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 2024-09-14T11:17:18.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.941+0000 7f14cc4e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:18.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.941+0000 7f14cc4e49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:18.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.941+0000 7f14cc4e49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.941+0000 7f14cc4e49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26, ofs0, ns] 2024-09-14T11:17:18.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.941+0000 7f13ad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366240 cookie 93843653398080 notifier 6852 bl.length()=991 2024-09-14T11:17:18.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.941+0000 7f13ad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 info.flags=0x17 2024-09-14T11:17:18.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.941+0000 7f13ad7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 to cache LRU end 2024-09-14T11:17:18.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.941+0000 7f13ad7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.945+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): orig_sources= new_sources= 2024-09-14T11:17:18.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.945+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): potential sources added=[] removed=[] 2024-09-14T11:17:18.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.945+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): orig_dests= new_dests= 2024-09-14T11:17:18.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.945+0000 7f14cc4e49c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26]): potential dests added=[] removed=[] 2024-09-14T11:17:18.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.949+0000 7f14cc4e49c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:18.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.953+0000 7f137ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.957+0000 7f14cc4e49c0 20 remove_watcher() i=0 2024-09-14T11:17:18.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.957+0000 7f14cc4e49c0 2 removed watcher, disabling cache 2024-09-14T11:17:18.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.957+0000 7f14cc4e49c0 20 remove_watcher() i=1 2024-09-14T11:17:18.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.961+0000 7f14cc4e49c0 20 remove_watcher() i=2 2024-09-14T11:17:18.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.961+0000 7f14cc4e49c0 20 remove_watcher() i=3 2024-09-14T11:17:18.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.965+0000 7f14cc4e49c0 20 remove_watcher() i=4 2024-09-14T11:17:18.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.965+0000 7f14cc4e49c0 20 remove_watcher() i=5 2024-09-14T11:17:18.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.969+0000 7f14cc4e49c0 20 remove_watcher() i=6 2024-09-14T11:17:18.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:18.969+0000 7f14cc4e49c0 20 remove_watcher() i=7 2024-09-14T11:17:18.982 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:17:19.012 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:19.012 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:19.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.061+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.061+0000 7f2662e7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.061+0000 7f2662e7b9c0 20 realm 2024-09-14T11:17:19.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.061+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.061+0000 7f2662e7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.061+0000 7f2662e7b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:19.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.061+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.065+0000 7f2662e7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.065+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.065+0000 7f2662e7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:19.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.065+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.065+0000 7f2662e7b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:19.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.065+0000 7f2662e7b9c0 20 searching for the correct realm 2024-09-14T11:17:19.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.073+0000 7f2661182640 0 -- 172.21.15.148:0/381163925 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55cac8b2d9b0 msgr2=0x55cac8b2fe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:19.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.077+0000 7f2661182640 0 -- 172.21.15.148:0/381163925 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55cac8b3a230 msgr2=0x55cac8b3c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:19.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:19.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:19.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:19.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:19.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:19.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:19.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:19.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:19.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 zone default found 2024-09-14T11:17:19.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 4 Realm: () 2024-09-14T11:17:19.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:19.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:19.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:19.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 zonegroup default 2024-09-14T11:17:19.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.085+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.089+0000 7f2662e7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.089+0000 7f2662e7b9c0 20 started sync module instance, tier type = 2024-09-14T11:17:19.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.089+0000 7f2662e7b9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:19.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.105+0000 7f2662e7b9c0 20 add_watcher() i=0 2024-09-14T11:17:19.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.105+0000 7f2662e7b9c0 20 add_watcher() i=1 2024-09-14T11:17:19.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.105+0000 7f2662e7b9c0 20 add_watcher() i=2 2024-09-14T11:17:19.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.105+0000 7f2662e7b9c0 20 add_watcher() i=3 2024-09-14T11:17:19.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.105+0000 7f2662e7b9c0 20 add_watcher() i=4 2024-09-14T11:17:19.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.105+0000 7f2662e7b9c0 20 add_watcher() i=5 2024-09-14T11:17:19.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.105+0000 7f2662e7b9c0 20 add_watcher() i=6 2024-09-14T11:17:19.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.109+0000 7f2662e7b9c0 20 add_watcher() i=7 2024-09-14T11:17:19.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.109+0000 7f2662e7b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:19.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2516fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:19.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:19.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:19.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 5 note: GC not initialized 2024-09-14T11:17:19.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2515fe3640 20 reqs_thread_entry: start 2024-09-14T11:17:19.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:19.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 Filter name: none 2024-09-14T11:17:19.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f24877fe640 20 reqs_thread_entry: start 2024-09-14T11:17:19.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:19.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:19.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:19.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:19.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.113+0000 7f2662e7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.117+0000 7f2662e7b9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:19.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.117+0000 7f2662e7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:19.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.117+0000 7f2516fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:19.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.121+0000 7f2662e7b9c0 20 remove_watcher() i=0 2024-09-14T11:17:19.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.121+0000 7f2662e7b9c0 2 removed watcher, disabling cache 2024-09-14T11:17:19.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.125+0000 7f2662e7b9c0 20 remove_watcher() i=1 2024-09-14T11:17:19.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.125+0000 7f2662e7b9c0 20 remove_watcher() i=2 2024-09-14T11:17:19.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.129+0000 7f2662e7b9c0 20 remove_watcher() i=3 2024-09-14T11:17:19.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.129+0000 7f2662e7b9c0 20 remove_watcher() i=4 2024-09-14T11:17:19.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.133+0000 7f2662e7b9c0 20 remove_watcher() i=5 2024-09-14T11:17:19.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.137+0000 7f2662e7b9c0 20 remove_watcher() i=6 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:19.137+0000 7f2662e7b9c0 20 remove_watcher() i=7 2024-09-14T11:17:19.148 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:19.148 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:19.148 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-trim-reshard-log-entries id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:17:19.148 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:19.149 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:19.150 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:19.174 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:19.174 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:19.716 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:19.717 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.086 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:17:20.087 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:20.089 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.089 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.227 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.227 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.318 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.318 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.417 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.417 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.522 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.522 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.631 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.632 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.740 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.740 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.841 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.841 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:20.939 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:20.939 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.045 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.046 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.150 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.151 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.248 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.249 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.354 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.354 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.453 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.453 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.560 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.560 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.669 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.670 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.768 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.768 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.869 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.869 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:21.958 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:21.959 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:22.061 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:22.061 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:22.154 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:22.154 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:22.256 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:22.256 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:22.356 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:17:22.389 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:22.389 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:22.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.437+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 realm 2024-09-14T11:17:22.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:22.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:22.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.441+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.445+0000 7f51c2ef69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:22.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.445+0000 7f51c2ef69c0 20 searching for the correct realm 2024-09-14T11:17:22.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.449+0000 7f51c11fd640 0 -- 172.21.15.148:0/2448730999 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x56349217b7d0 msgr2=0x56349217dc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:22.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.457+0000 7f51c11fd640 0 -- 172.21.15.148:0/2448730999 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x563492187f40 msgr2=0x56349218a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:22.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:22.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:22.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:22.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:22.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:22.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:22.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:22.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:22.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 zone default found 2024-09-14T11:17:22.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 4 Realm: () 2024-09-14T11:17:22.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:22.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:22.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:22.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 zonegroup default 2024-09-14T11:17:22.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 started sync module instance, tier type = 2024-09-14T11:17:22.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.465+0000 7f51c2ef69c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:22.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.485+0000 7f51c2ef69c0 20 add_watcher() i=0 2024-09-14T11:17:22.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.485+0000 7f51c2ef69c0 20 add_watcher() i=1 2024-09-14T11:17:22.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.485+0000 7f51c2ef69c0 20 add_watcher() i=2 2024-09-14T11:17:22.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.485+0000 7f51c2ef69c0 20 add_watcher() i=3 2024-09-14T11:17:22.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.485+0000 7f51c2ef69c0 20 add_watcher() i=4 2024-09-14T11:17:22.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.485+0000 7f51c2ef69c0 20 add_watcher() i=5 2024-09-14T11:17:22.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.485+0000 7f51c2ef69c0 20 add_watcher() i=6 2024-09-14T11:17:22.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.489+0000 7f51c2ef69c0 20 add_watcher() i=7 2024-09-14T11:17:22.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.489+0000 7f51c2ef69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f5076fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f51c2ef69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f51c2ef69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f51c2ef69c0 5 note: GC not initialized 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f5075fe3640 20 reqs_thread_entry: start 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f51c2ef69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f51c2ef69c0 20 Filter name: none 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f4fe77fe640 20 reqs_thread_entry: start 2024-09-14T11:17:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.493+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:22.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:22.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:22.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:22.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:22.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.497+0000 7f51c2ef69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:22.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.501+0000 7f5076fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:22.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.505+0000 7f51c2ef69c0 20 remove_watcher() i=0 2024-09-14T11:17:22.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.505+0000 7f51c2ef69c0 2 removed watcher, disabling cache 2024-09-14T11:17:22.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.505+0000 7f51c2ef69c0 20 remove_watcher() i=1 2024-09-14T11:17:22.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.509+0000 7f51c2ef69c0 20 remove_watcher() i=2 2024-09-14T11:17:22.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.509+0000 7f51c2ef69c0 20 remove_watcher() i=3 2024-09-14T11:17:22.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.513+0000 7f51c2ef69c0 20 remove_watcher() i=4 2024-09-14T11:17:22.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.513+0000 7f51c2ef69c0 20 remove_watcher() i=5 2024-09-14T11:17:22.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.517+0000 7f51c2ef69c0 20 remove_watcher() i=6 2024-09-14T11:17:22.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.521+0000 7f51c2ef69c0 20 remove_watcher() i=7 2024-09-14T11:17:22.529 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:22.529 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:22.529 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-trim-reshard-log-entries id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:22.529 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:22.530 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:17:22.564 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:22.565 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:22.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 20 realm 2024-09-14T11:17:22.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:22.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.613+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.617+0000 7f850a2419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:22.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.617+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.617+0000 7f850a2419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:22.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.617+0000 7f850a2419c0 20 searching for the correct realm 2024-09-14T11:17:22.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.621+0000 7f8507d47640 0 -- 172.21.15.148:0/1632487065 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f84f80b8900 msgr2=0x7f84f80c13e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:22.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.629+0000 7f8507d47640 0 -- 172.21.15.148:0/1632487065 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55d3f3f50440 msgr2=0x55d3f3f52830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:22.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:22.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:22.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:22.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:22.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:22.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:22.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:22.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 zone default found 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 4 Realm: () 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 zonegroup default 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.637+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.641+0000 7f850a2419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.641+0000 7f850a2419c0 20 started sync module instance, tier type = 2024-09-14T11:17:22.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.641+0000 7f850a2419c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:22.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.657+0000 7f850a2419c0 20 add_watcher() i=0 2024-09-14T11:17:22.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.657+0000 7f850a2419c0 20 add_watcher() i=1 2024-09-14T11:17:22.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.657+0000 7f850a2419c0 20 add_watcher() i=2 2024-09-14T11:17:22.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.657+0000 7f850a2419c0 20 add_watcher() i=3 2024-09-14T11:17:22.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.657+0000 7f850a2419c0 20 add_watcher() i=4 2024-09-14T11:17:22.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.657+0000 7f850a2419c0 20 add_watcher() i=5 2024-09-14T11:17:22.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.657+0000 7f850a2419c0 20 add_watcher() i=6 2024-09-14T11:17:22.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.661+0000 7f850a2419c0 20 add_watcher() i=7 2024-09-14T11:17:22.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.661+0000 7f850a2419c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:22.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f83bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:22.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:22.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:22.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 5 note: GC not initialized 2024-09-14T11:17:22.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f83bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:22.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:22.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 20 Filter name: none 2024-09-14T11:17:22.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f83367fc640 20 reqs_thread_entry: start 2024-09-14T11:17:22.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:17:22.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 : miss 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 info.flags=0x17 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 to cache LRU end 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:22.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:22.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.665+0000 7f850a2419c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 2024-09-14T11:17:22.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 info.flags=0x17 2024-09-14T11:17:22.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 to cache LRU end 2024-09-14T11:17:22.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:22.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27, ofs0, ns] 2024-09-14T11:17:22.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f83e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94368819444288 notifier 6903 bl.length()=1023 2024-09-14T11:17:22.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f83e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 info.flags=0x17 2024-09-14T11:17:22.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f83e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 to cache LRU end 2024-09-14T11:17:22.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f83e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:22.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27]): orig_sources= new_sources= 2024-09-14T11:17:22.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27]): potential sources added=[] removed=[] 2024-09-14T11:17:22.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27]): orig_dests= new_dests= 2024-09-14T11:17:22.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27]): potential dests added=[] removed=[] 2024-09-14T11:17:22.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:17:22.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.677+0000 7f850a2419c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:17:22.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.0 2024-09-14T11:17:22.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.0 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.1 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.1 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.2 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.2 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.3 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.3 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.4 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.4 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.5 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.5 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.6 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.6 2024-09-14T11:17:22.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.7 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.7 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.8 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.8 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.9 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.9 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.10 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.10 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.11 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1.11 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.0 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.1 2024-09-14T11:17:22.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.685+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.2 2024-09-14T11:17:22.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.689+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.3 2024-09-14T11:17:22.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.689+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.4 2024-09-14T11:17:22.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.689+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.5 2024-09-14T11:17:22.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.693+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.6 2024-09-14T11:17:22.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.693+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.7 2024-09-14T11:17:22.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.693+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.8 2024-09-14T11:17:22.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.697+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.9 2024-09-14T11:17:22.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.697+0000 7f850a2419c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27.10 2024-09-14T11:17:22.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f850a2419c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:22.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f850a2419c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 2024-09-14T11:17:22.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f850a2419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 info.flags=0x17 2024-09-14T11:17:22.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f850a2419c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 to cache LRU end 2024-09-14T11:17:22.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f850a2419c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:22.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f850a2419c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27, ofs0, ns] 2024-09-14T11:17:22.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f83e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 94368819444288 notifier 6903 bl.length()=991 2024-09-14T11:17:22.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f83e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 info.flags=0x17 2024-09-14T11:17:22.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f83e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 to cache LRU end 2024-09-14T11:17:22.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.705+0000 7f83e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:22.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.709+0000 7f850a2419c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27]): orig_sources= new_sources= 2024-09-14T11:17:22.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.709+0000 7f850a2419c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27]): potential sources added=[] removed=[] 2024-09-14T11:17:22.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.709+0000 7f850a2419c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27]): orig_dests= new_dests= 2024-09-14T11:17:22.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.709+0000 7f850a2419c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27]): potential dests added=[] removed=[] 2024-09-14T11:17:22.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.717+0000 7f850a2419c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:22.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.721+0000 7f83bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:22.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.725+0000 7f850a2419c0 20 remove_watcher() i=0 2024-09-14T11:17:22.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.725+0000 7f850a2419c0 2 removed watcher, disabling cache 2024-09-14T11:17:22.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.725+0000 7f850a2419c0 20 remove_watcher() i=1 2024-09-14T11:17:22.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.729+0000 7f850a2419c0 20 remove_watcher() i=2 2024-09-14T11:17:22.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.729+0000 7f850a2419c0 20 remove_watcher() i=3 2024-09-14T11:17:22.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.733+0000 7f850a2419c0 20 remove_watcher() i=4 2024-09-14T11:17:22.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.733+0000 7f850a2419c0 20 remove_watcher() i=5 2024-09-14T11:17:22.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.737+0000 7f850a2419c0 20 remove_watcher() i=6 2024-09-14T11:17:22.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.741+0000 7f850a2419c0 20 remove_watcher() i=7 2024-09-14T11:17:22.750 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:17:22.779 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:22.779 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:22.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.825+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 realm 2024-09-14T11:17:22.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:22.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:22.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:22.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.829+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:22.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.833+0000 7efc5cac29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:22.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.833+0000 7efc5cac29c0 20 searching for the correct realm 2024-09-14T11:17:22.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.833+0000 7efc5adc9640 0 -- 172.21.15.148:0/3407433111 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55976b491960 msgr2=0x55976b493df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:22.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:22.841+0000 7efc5a5c8640 0 -- 172.21.15.148:0/3407433111 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55976b2530f0 msgr2=0x7efc54100280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:23.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:23.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:23.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:23.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:23.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:23.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:23.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:23.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.057+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:23.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 zone default found 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 4 Realm: () 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 zonegroup default 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:23.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:23.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.061+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.065+0000 7efc5cac29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:23.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.065+0000 7efc5cac29c0 20 started sync module instance, tier type = 2024-09-14T11:17:23.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.065+0000 7efc5cac29c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:23.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.085+0000 7efc5cac29c0 20 add_watcher() i=0 2024-09-14T11:17:23.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.085+0000 7efc5cac29c0 20 add_watcher() i=1 2024-09-14T11:17:23.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.085+0000 7efc5cac29c0 20 add_watcher() i=2 2024-09-14T11:17:23.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.085+0000 7efc5cac29c0 20 add_watcher() i=3 2024-09-14T11:17:23.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.085+0000 7efc5cac29c0 20 add_watcher() i=4 2024-09-14T11:17:23.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.085+0000 7efc5cac29c0 20 add_watcher() i=5 2024-09-14T11:17:23.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.085+0000 7efc5cac29c0 20 add_watcher() i=6 2024-09-14T11:17:23.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.089+0000 7efc5cac29c0 20 add_watcher() i=7 2024-09-14T11:17:23.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.089+0000 7efc5cac29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:23.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.093+0000 7efb10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:23.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.093+0000 7efc5cac29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:23.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.093+0000 7efc5cac29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:23.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.093+0000 7efc5cac29c0 5 note: GC not initialized 2024-09-14T11:17:23.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.093+0000 7efa8b7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:23.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.093+0000 7efc5cac29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:23.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 Filter name: none 2024-09-14T11:17:23.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efa897fa640 20 reqs_thread_entry: start 2024-09-14T11:17:23.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:23.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:23.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:23.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:23.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:23.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:23.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.097+0000 7efc5cac29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:23.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.101+0000 7efb10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:23.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.105+0000 7efc5cac29c0 20 remove_watcher() i=0 2024-09-14T11:17:23.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.105+0000 7efc5cac29c0 2 removed watcher, disabling cache 2024-09-14T11:17:23.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.109+0000 7efc5cac29c0 20 remove_watcher() i=1 2024-09-14T11:17:23.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.109+0000 7efc5cac29c0 20 remove_watcher() i=2 2024-09-14T11:17:23.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.113+0000 7efc5cac29c0 20 remove_watcher() i=3 2024-09-14T11:17:23.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.113+0000 7efc5cac29c0 20 remove_watcher() i=4 2024-09-14T11:17:23.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.117+0000 7efc5cac29c0 20 remove_watcher() i=5 2024-09-14T11:17:23.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.121+0000 7efc5cac29c0 20 remove_watcher() i=6 2024-09-14T11:17:23.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:23.121+0000 7efc5cac29c0 20 remove_watcher() i=7 2024-09-14T11:17:23.132 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:23.132 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:23.133 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-trim-reshard-log-entries id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:17:23.133 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:23.134 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:23.134 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:23.158 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:23.158 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:23.782 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:23.782 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:24.165 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:17:24.165 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:24.170 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:24.170 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:24.307 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:24.307 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:24.395 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:24.395 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:24.503 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:24.503 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:24.603 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:24.603 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:24.710 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:24.710 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:24.814 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:24.814 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:24.918 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:24.918 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.019 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.019 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.118 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.118 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.221 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.222 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.322 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.322 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.424 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.424 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.522 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.523 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.621 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.621 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.719 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.719 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.822 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.822 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:25.924 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:25.924 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:26.017 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:26.018 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:26.126 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:26.126 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:26.234 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:26.334 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:26.334 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:26.434 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:17:26.467 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:26.467 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:26.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.521+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.521+0000 7fa646ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.521+0000 7fa646ca09c0 20 realm 2024-09-14T11:17:26.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.521+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:26.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:26.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.525+0000 7fa646ca09c0 20 searching for the correct realm 2024-09-14T11:17:26.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.533+0000 7fa643fa5640 0 -- 172.21.15.148:0/3470692532 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x56170978b880 msgr2=0x56170978dc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.537+0000 7fa6447a6640 0 -- 172.21.15.148:0/3470692532 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fa63c105970 msgr2=0x7fa63c1160c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:26.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:26.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:26.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:26.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:26.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:26.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:26.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:26.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 zone default found 2024-09-14T11:17:26.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 4 Realm: () 2024-09-14T11:17:26.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:26.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:26.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:26.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 zonegroup default 2024-09-14T11:17:26.542 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.545+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.549+0000 7fa646ca09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.549+0000 7fa646ca09c0 20 started sync module instance, tier type = 2024-09-14T11:17:26.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.549+0000 7fa646ca09c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:26.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.565+0000 7fa646ca09c0 20 add_watcher() i=0 2024-09-14T11:17:26.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.565+0000 7fa646ca09c0 20 add_watcher() i=1 2024-09-14T11:17:26.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.565+0000 7fa646ca09c0 20 add_watcher() i=2 2024-09-14T11:17:26.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.565+0000 7fa646ca09c0 20 add_watcher() i=3 2024-09-14T11:17:26.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.565+0000 7fa646ca09c0 20 add_watcher() i=4 2024-09-14T11:17:26.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.565+0000 7fa646ca09c0 20 add_watcher() i=5 2024-09-14T11:17:26.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.565+0000 7fa646ca09c0 20 add_watcher() i=6 2024-09-14T11:17:26.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.569+0000 7fa646ca09c0 20 add_watcher() i=7 2024-09-14T11:17:26.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.569+0000 7fa646ca09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:26.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa4fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:26.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa646ca09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:26.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa646ca09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:26.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa646ca09c0 5 note: GC not initialized 2024-09-14T11:17:26.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa4f9fdb640 20 reqs_thread_entry: start 2024-09-14T11:17:26.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa646ca09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:26.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa646ca09c0 20 Filter name: none 2024-09-14T11:17:26.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa46b7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:26.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa646ca09c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:26.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.573+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.577+0000 7fa646ca09c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:26.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.577+0000 7fa646ca09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:26.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.577+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.577+0000 7fa646ca09c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:26.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.577+0000 7fa646ca09c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.577+0000 7fa646ca09c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:26.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.577+0000 7fa646ca09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:26.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.581+0000 7fa4fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:26.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.585+0000 7fa646ca09c0 20 remove_watcher() i=0 2024-09-14T11:17:26.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.585+0000 7fa646ca09c0 2 removed watcher, disabling cache 2024-09-14T11:17:26.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.589+0000 7fa646ca09c0 20 remove_watcher() i=1 2024-09-14T11:17:26.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.589+0000 7fa646ca09c0 20 remove_watcher() i=2 2024-09-14T11:17:26.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.597+0000 7fa646ca09c0 20 remove_watcher() i=3 2024-09-14T11:17:26.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.597+0000 7fa646ca09c0 20 remove_watcher() i=4 2024-09-14T11:17:26.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.601+0000 7fa646ca09c0 20 remove_watcher() i=5 2024-09-14T11:17:26.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.601+0000 7fa646ca09c0 20 remove_watcher() i=6 2024-09-14T11:17:26.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.609+0000 7fa646ca09c0 20 remove_watcher() i=7 2024-09-14T11:17:26.622 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.622 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:26.622 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-trim-reshard-log-entries id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:26.622 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.623 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:17:26.659 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:26.659 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:26.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.705+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 realm 2024-09-14T11:17:26.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:26.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:26.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.709+0000 7f816f2349c0 20 searching for the correct realm 2024-09-14T11:17:26.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.717+0000 7f816cd3a640 0 -- 172.21.15.148:0/2760897346 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x561f6331d020 msgr2=0x561f6331f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.725+0000 7f816d53b640 0 -- 172.21.15.148:0/2760897346 >> [v2:172.21.15.150:6800/2640697978,v1:172.21.15.150:6801/2640697978] conn(0x7f815c06bb20 msgr2=0x7f815c04d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:26.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:26.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:26.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:26.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:26.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:26.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:26.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 zone default found 2024-09-14T11:17:26.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 4 Realm: () 2024-09-14T11:17:26.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:26.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:26.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:26.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 zonegroup default 2024-09-14T11:17:26.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.733+0000 7f816f2349c0 20 started sync module instance, tier type = 2024-09-14T11:17:26.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.733+0000 7f816f2349c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:26.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=0 2024-09-14T11:17:26.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=1 2024-09-14T11:17:26.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=2 2024-09-14T11:17:26.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=3 2024-09-14T11:17:26.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=4 2024-09-14T11:17:26.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=5 2024-09-14T11:17:26.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=6 2024-09-14T11:17:26.759 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.765+0000 7f816f2349c0 20 add_watcher() i=7 2024-09-14T11:17:26.759 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.765+0000 7f816f2349c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:26.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.765+0000 7f8022fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:26.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:26.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:26.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 5 note: GC not initialized 2024-09-14T11:17:26.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f8021fe3640 20 reqs_thread_entry: start 2024-09-14T11:17:26.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:26.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 20 Filter name: none 2024-09-14T11:17:26.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f7f937fe640 20 reqs_thread_entry: start 2024-09-14T11:17:26.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:17:26.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 : miss 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.769+0000 7f816f2349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 2024-09-14T11:17:26.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.781+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.781+0000 7f816f2349c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.781+0000 7f816f2349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.781+0000 7f816f2349c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28, ofs0, ns] 2024-09-14T11:17:26.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366247 cookie 94692808229952 notifier 6551 bl.length()=1023 2024-09-14T11:17:26.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_sources= new_sources= 2024-09-14T11:17:26.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential sources added=[] removed=[] 2024-09-14T11:17:26.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_dests= new_dests= 2024-09-14T11:17:26.779 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f816f2349c0 time 2024-09-14T11:17:26.786594+0000 2024-09-14T11:17:26.780 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:26.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential dests added=[] removed=[] 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8172b0e2eb] 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8172b0e49f] 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f609ecc01] 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x14231ee) [0x561f6144b1ee] 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f60a01ecd] 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8171974d90] 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:17:26.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.785+0000 7f816f2349c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f816f2349c0 time 2024-09-14T11:17:26.786594+0000 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8172b0e2eb] 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8172b0e49f] 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f609ecc01] 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x14231ee) [0x561f6144b1ee] 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f60a01ecd] 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8171974d90] 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.782 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:17:26.783 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f816f2349c0 thread_name:radosgw-admin 2024-09-14T11:17:26.795 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f817198d520] 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8172b0e345] 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8172b0e49f] 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f609ecc01] 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x14231ee) [0x561f6144b1ee] 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f60a01ecd] 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8171974d90] 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:17:26.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.785+0000 7f816f2349c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f816f2349c0 thread_name:radosgw-admin 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f817198d520] 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8172b0e345] 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8172b0e49f] 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f609ecc01] 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x14231ee) [0x561f6144b1ee] 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f60a01ecd] 2024-09-14T11:17:26.797 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8171974d90] 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:17:26.685+0000 7f816d53b640 10 monclient(hunting): handle_auth_done global_id 6945 payload 274 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:17:26.685+0000 7f816d53b640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:17:26.685+0000 7f816d53b640 1 monclient: found mon.noname-a 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:17:26.685+0000 7f816d53b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: dump: 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.799 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6945 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: dump: 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.800 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: get_monmap_and_config success 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:17:26.685+0000 7f816f2349c0 4 set_mon_vals no callback set 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: shutdown 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 asok(0x561f63023d90) unregister_commands rotate-key 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: build_initial_monmap 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 build_initial for_mkfs: 0 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: monmap: 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:26.801 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding auth protocol: cephx 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding auth protocol: cephx 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding auth protocol: cephx 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.802 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:17:26.685+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 librados: starting msgr at 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 librados: starting objecter 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command objecter_requests hook 0x561f63231f80 2024-09-14T11:17:26.803 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 librados: setting wanted keys 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 librados: calling monclient init 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: init 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding auth protocol: cephx 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding auth protocol: cephx 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding auth protocol: cephx 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:17:26.685+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:17:26.685+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command rotate-key hook 0x561f6322f6b8 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: _reopen_session rank -1 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-c con 0x561f630bcb20 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-a con 0x561f630e76e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-b con 0x561f6325df00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:17:26.805 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): _renew_subs 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): authenticate will time out at 2705.747737s 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): get_auth_request con 0x561f630e76e0 auth_method 0 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): get_auth_request con 0x561f630bcb20 auth_method 0 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.806 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:17:26.689+0000 7f816c539640 10 monclient(hunting): handle_auth_done global_id 6948 payload 824 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:17:26.689+0000 7f816c539640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:17:26.689+0000 7f816c539640 1 monclient: found mon.noname-a 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:17:26.689+0000 7f816c539640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: dump: 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.807 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:17:26.689+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6948 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:17:26.689+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:17:26.689+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: dump: 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.809 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:17:26.689+0000 7f805ae0d640 4 set_mon_vals no callback set 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:17:26.689+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:17:26.689+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:17:26.689+0000 7f816f2349c0 1 librados: init done 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:17:26.689+0000 7f805960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:17:26.689+0000 7f805960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:17:26.689+0000 7f805960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:17:26.689+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f80540718a0 auth_method 0 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:17:26.689+0000 7f816d53b640 10 monclient: get_auth_request con 0x561f632573a0 auth_method 0 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:17:26.693+0000 7f816cd3a640 10 monclient: get_auth_request con 0x561f6327a530 auth_method 0 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:17:26.693+0000 7f816c539640 10 monclient: get_auth_request con 0x561f6327e9b0 auth_method 0 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:17:26.693+0000 7f816f2349c0 10 monclient: build_initial_monmap 2024-09-14T11:17:26.810 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:17:26.693+0000 7f816f2349c0 1 build_initial for_mkfs: 0 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:17:26.693+0000 7f816f2349c0 10 monclient: monmap: 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding auth protocol: cephx 2024-09-14T11:17:26.811 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding auth protocol: cephx 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding auth protocol: cephx 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:17:26.697+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command objecter_requests cmddesc objecter_requests hook 0x561f63287220 EEXIST 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: init 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding auth protocol: cephx 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding auth protocol: cephx 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding auth protocol: cephx 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.813 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:17:26.697+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:17:26.697+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command rotate-key cmddesc rotate-key hook 0x561f63281f90 EEXIST 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _reopen_session rank -1 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-a con 0x561f632ab3d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-b con 0x561f632aad00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-c con 0x561f632a96e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.814 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): _renew_subs 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): authenticate will time out at 2705.756994s 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): get_auth_request con 0x561f632a96e0 auth_method 0 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): get_auth_request con 0x561f632ab3d0 auth_method 0 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.815 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:17:26.697+0000 7f816c539640 10 monclient(hunting): get_auth_request con 0x561f632aad00 auth_method 0 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:17:26.697+0000 7f816c539640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:17:26.697+0000 7f816c539640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:17:26.697+0000 7f816c539640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): handle_auth_done global_id 6545 payload 824 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:17:26.697+0000 7f816d53b640 1 monclient: found mon.noname-c 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: dump: 2024-09-14T11:17:26.816 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6545 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.817 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: dump: 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:17:26.697+0000 7f816dd3c640 4 set_mon_vals no callback set 2024-09-14T11:17:26.818 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:17:26.697+0000 7f80527fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:17:26.697+0000 7f80527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:17:26.697+0000 7f80527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f80440717e0 auth_method 0 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: get_monmap_and_config 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: build_initial_monmap 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 build_initial for_mkfs: 0 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: monmap: 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding auth protocol: cephx 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding auth protocol: cephx 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding auth protocol: cephx 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.820 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: init 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding auth protocol: cephx 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding auth protocol: cephx 2024-09-14T11:17:26.821 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding auth protocol: cephx 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcf99445b8 EEXIST 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: _reopen_session rank -1 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-c con 0x561f632cec90 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-b con 0x561f632f92e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-a con 0x561f632fa4f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): _renew_subs 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): authenticate will time out at 2705.761296s 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): get_auth_request con 0x561f632cec90 auth_method 0 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.823 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): get_auth_request con 0x561f632fa4f0 auth_method 0 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): handle_auth_done global_id 6548 payload 274 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.824 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:17:26.701+0000 7f816cd3a640 1 monclient: found mon.noname-c 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: dump: 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.825 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6548 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: get_monmap_and_config success 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:17:26.701+0000 7f816f2349c0 4 set_mon_vals no callback set 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: dump: 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.826 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: shutdown 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: build_initial_monmap 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 build_initial for_mkfs: 0 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: monmap: 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:26.827 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding auth protocol: cephx 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding auth protocol: cephx 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding auth protocol: cephx 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.828 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 librados: starting msgr at 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 librados: starting objecter 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command objecter_requests cmddesc objecter_requests hook 0x561f632ce840 EEXIST 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 librados: setting wanted keys 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 librados: calling monclient init 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: init 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding auth protocol: cephx 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding auth protocol: cephx 2024-09-14T11:17:26.829 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding auth protocol: cephx 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command rotate-key cmddesc rotate-key hook 0x561f632ad338 EEXIST 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: _reopen_session rank -1 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-c con 0x561f632cec90 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-b con 0x561f632f92e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-a con 0x561f632fa4f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): _renew_subs 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): authenticate will time out at 2705.763845s 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): get_auth_request con 0x561f632cec90 auth_method 0 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.831 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): get_auth_request con 0x561f632fa4f0 auth_method 0 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:17:26.705+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:17:26.705+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:17:26.705+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient(hunting): handle_auth_done global_id 6551 payload 824 2024-09-14T11:17:26.832 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:17:26.705+0000 7f816cd3a640 1 monclient: found mon.noname-c 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: dump: 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.833 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: dump: 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.834 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:17:26.705+0000 7f8043fff640 4 set_mon_vals no callback set 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:17:26.705+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6551 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:17:26.705+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:17:26.705+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:17:26.705+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:17:26.705+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:17:26.705+0000 7f816f2349c0 1 librados: init done 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:17:26.705+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cr dump hook 0x561f632f4008 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:17:26.705+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:17:26.705+0000 7f80427fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:17:26.705+0000 7f80427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:17:26.705+0000 7f80427fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:17:26.705+0000 7f816c539640 10 monclient: get_auth_request con 0x7f80380718d0 auth_method 0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:17:26.709+0000 7f816d53b640 10 monclient: get_auth_request con 0x561f63318d00 auth_method 0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 realm 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:17:26.709+0000 7f816f2349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:17:26.709+0000 7f816cd3a640 10 monclient: get_auth_request con 0x561f6331d020 auth_method 0 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.836 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:17:26.709+0000 7f816c539640 10 monclient: get_auth_request con 0x561f63320740 auth_method 0 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 searching for the correct realm 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:17:26.713+0000 7f816d53b640 10 monclient: get_auth_request con 0x561f633254c0 auth_method 0 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:17:26.713+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f815c031050 auth_method 0 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:17:26.717+0000 7f816c539640 10 monclient: get_auth_request con 0x7f8164037060 auth_method 0 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:17:26.717+0000 7f816cd3a640 0 -- 172.21.15.148:0/2760897346 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x561f6331d020 msgr2=0x561f6331f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:17:26.717+0000 7f80427fc640 1 client.6551.objecter ms_handle_reset 0x561f6331d020 session 0x561f6331bec0 osd.1 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:17:26.717+0000 7f80427fc640 10 monclient: _renew_subs 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:17:26.717+0000 7f80427fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:17:26.717+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f8038081bd0 auth_method 0 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:17:26.717+0000 7f816d53b640 10 monclient: get_auth_request con 0x7f815c06bb20 auth_method 0 2024-09-14T11:17:26.837 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:17:26.721+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f8164017070 auth_method 0 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:17:26.725+0000 7f816d53b640 0 -- 172.21.15.148:0/2760897346 >> [v2:172.21.15.150:6800/2640697978,v1:172.21.15.150:6801/2640697978] conn(0x7f815c06bb20 msgr2=0x7f815c04d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:17:26.725+0000 7f80427fc640 1 client.6551.objecter ms_handle_reset 0x7f815c06bb20 session 0x7f815c074550 osd.7 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:17:26.725+0000 7f816d53b640 10 monclient: get_auth_request con 0x561f6331d020 auth_method 0 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.838 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 zone default found 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:17:26.729+0000 7f816f2349c0 4 Realm: () 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:17:26.729+0000 7f816f2349c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:17:26.729+0000 7f816f2349c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:17:26.729+0000 7f816f2349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 zonegroup default 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 started sync module instance, tier type = 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=0 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=1 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=2 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=3 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=4 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=5 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=6 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:17:26.765+0000 7f816f2349c0 20 add_watcher() i=7 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:17:26.765+0000 7f816f2349c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding auth protocol: cephx 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding auth protocol: cephx 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding auth protocol: cephx 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.840 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:17:26.765+0000 7f8022fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:17:26.769+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:26.841 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cache list hook 0x561f632cd8a0 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cache inspect hook 0x561f632cd8a0 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cache erase hook 0x561f632cd8a0 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cache zap hook 0x561f632cd8a0 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 note: GC not initialized 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:17:26.769+0000 7f8021fe3640 20 reqs_thread_entry: start 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command sync trace show hook 0x7f815c008ef0 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command sync trace history hook 0x7f815c008ef0 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command sync trace active hook 0x7f815c008ef0 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command sync trace active_short hook 0x7f815c008ef0 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 Filter name: none 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:17:26.769+0000 7f7f937fe640 20 reqs_thread_entry: start 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 : miss 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:17:26.781+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.843 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:17:26.781+0000 7f816f2349c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:17:26.781+0000 7f816f2349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:17:26.781+0000 7f816f2349c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28, ofs0, ns] 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366247 cookie 94692808229952 notifier 6551 bl.length()=1023 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_sources= new_sources= 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential sources added=[] removed=[] 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_dests= new_dests= 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential dests added=[] removed=[] 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:17:26.785+0000 7f816f2349c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f816f2349c0 time 2024-09-14T11:17:26.786594+0000 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:26.844 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8172b0e2eb] 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8172b0e49f] 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f609ecc01] 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x14231ee) [0x561f6144b1ee] 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f60a01ecd] 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8171974d90] 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:17:26.785+0000 7f816f2349c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f816f2349c0 thread_name:radosgw-admin 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:26.845 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f817198d520] 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8172b0e345] 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8172b0e49f] 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f609ecc01] 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x14231ee) [0x561f6144b1ee] 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f60a01ecd] 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8171974d90] 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:26.846 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:17:26.847 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:26.849 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:17:26.850 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:26.851 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f7f937fe640 / http_manager 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f8021fe3640 / http_manager 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f8022fe5640 / rgw_dt_lg_renew 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f80427fc640 / ms_dispatch 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f80437fe640 / io_context_pool 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f8043fff640 / io_context_pool 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f80527fc640 / ms_dispatch 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f805960a640 / ms_dispatch 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f805ae0d640 / io_context_pool 2024-09-14T11:17:26.853 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816c539640 / msgr-worker-2 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816cd3a640 / msgr-worker-1 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816d53b640 / msgr-worker-0 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816dd3c640 / io_context_pool 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816f2349c0 / radosgw-admin 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.101002.log 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:17:26.685+0000 7f816d53b640 10 monclient(hunting): handle_auth_done global_id 6945 payload 274 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:17:26.685+0000 7f816d53b640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.854 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:17:26.685+0000 7f816d53b640 1 monclient: found mon.noname-a 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:17:26.685+0000 7f816d53b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: dump: 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.855 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6945 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:17:26.685+0000 7f805ae0d640 10 monclient: dump: 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: get_monmap_and_config success 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:17:26.685+0000 7f816f2349c0 4 set_mon_vals no callback set 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: shutdown 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 asok(0x561f63023d90) unregister_commands rotate-key 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: build_initial_monmap 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 build_initial for_mkfs: 0 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: monmap: 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:26.857 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding auth protocol: cephx 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding auth protocol: cephx 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding auth protocol: cephx 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.858 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: crc 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f63234660) adding con mode: secure 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:17:26.685+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 librados: starting msgr at 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 librados: starting objecter 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command objecter_requests hook 0x561f63231f80 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 librados: setting wanted keys 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:17:26.685+0000 7f816f2349c0 1 librados: calling monclient init 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: init 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding auth protocol: cephx 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding auth protocol: cephx 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding auth protocol: cephx 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.859 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: crc 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 AuthRegistry(0x561f6322f570) adding con mode: secure 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:17:26.685+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:17:26.685+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:17:26.685+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command rotate-key hook 0x561f6322f6b8 2024-09-14T11:17:26.860 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: _reopen_session rank -1 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-c con 0x561f630bcb20 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-a con 0x561f630e76e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-b con 0x561f6325df00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): _renew_subs 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:17:26.685+0000 7f816f2349c0 10 monclient(hunting): authenticate will time out at 2705.747737s 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): get_auth_request con 0x561f630e76e0 auth_method 0 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.861 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): get_auth_request con 0x561f630bcb20 auth_method 0 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:17:26.685+0000 7f816c539640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:17:26.685+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:17:26.689+0000 7f816c539640 10 monclient(hunting): handle_auth_done global_id 6948 payload 824 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:17:26.689+0000 7f816c539640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:17:26.689+0000 7f816c539640 1 monclient: found mon.noname-a 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:17:26.689+0000 7f816c539640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: dump: 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.863 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:17:26.689+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6948 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:17:26.689+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:17:26.689+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:17:26.689+0000 7f805960a640 10 monclient: dump: 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.864 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:17:26.689+0000 7f805ae0d640 4 set_mon_vals no callback set 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:17:26.689+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:17:26.689+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:17:26.689+0000 7f816f2349c0 1 librados: init done 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:17:26.689+0000 7f805960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:17:26.689+0000 7f805960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:17:26.689+0000 7f805960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:17:26.689+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f80540718a0 auth_method 0 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:17:26.689+0000 7f816d53b640 10 monclient: get_auth_request con 0x561f632573a0 auth_method 0 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:17:26.693+0000 7f816cd3a640 10 monclient: get_auth_request con 0x561f6327a530 auth_method 0 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:17:26.693+0000 7f816c539640 10 monclient: get_auth_request con 0x561f6327e9b0 auth_method 0 2024-09-14T11:17:26.865 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:17:26.693+0000 7f816f2349c0 10 monclient: build_initial_monmap 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:17:26.693+0000 7f816f2349c0 1 build_initial for_mkfs: 0 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:17:26.693+0000 7f816f2349c0 10 monclient: monmap: 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding auth protocol: cephx 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding auth protocol: cephx 2024-09-14T11:17:26.866 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding auth protocol: cephx 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: crc 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:17:26.693+0000 7f816f2349c0 5 AuthRegistry(0x561f63283890) adding con mode: secure 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:17:26.697+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.867 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command objecter_requests cmddesc objecter_requests hook 0x561f63287220 EEXIST 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: init 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding auth protocol: cephx 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding auth protocol: cephx 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding auth protocol: cephx 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.868 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: crc 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 AuthRegistry(0x561f63281e48) adding con mode: secure 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:17:26.697+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:17:26.697+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command rotate-key cmddesc rotate-key hook 0x561f63281f90 EEXIST 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _reopen_session rank -1 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-a con 0x561f632ab3d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-b con 0x561f632aad00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-c con 0x561f632a96e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): _renew_subs 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient(hunting): authenticate will time out at 2705.756994s 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): get_auth_request con 0x561f632a96e0 auth_method 0 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): get_auth_request con 0x561f632ab3d0 auth_method 0 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.870 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:17:26.697+0000 7f816c539640 10 monclient(hunting): get_auth_request con 0x561f632aad00 auth_method 0 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:17:26.697+0000 7f816c539640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:17:26.697+0000 7f816c539640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:17:26.697+0000 7f816c539640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient(hunting): handle_auth_done global_id 6545 payload 824 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:17:26.697+0000 7f816d53b640 1 monclient: found mon.noname-c 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:17:26.697+0000 7f816d53b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: dump: 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.871 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:17:26.697+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6545 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:17:26.697+0000 7f80527fc640 10 monclient: dump: 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.873 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:17:26.697+0000 7f816dd3c640 4 set_mon_vals no callback set 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:17:26.697+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:17:26.697+0000 7f80527fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:17:26.697+0000 7f80527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:17:26.697+0000 7f80527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:17:26.697+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f80440717e0 auth_method 0 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: get_monmap_and_config 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: build_initial_monmap 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 build_initial for_mkfs: 0 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: monmap: 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:17:26.874 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding auth protocol: cephx 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding auth protocol: cephx 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding auth protocol: cephx 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.875 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: crc 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632cab50) adding con mode: secure 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: init 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding auth protocol: cephx 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding auth protocol: cephx 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding auth protocol: cephx 2024-09-14T11:17:26.876 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: crc 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944470) adding con mode: secure 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcf99445b8 EEXIST 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: _reopen_session rank -1 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-c con 0x561f632cec90 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-b con 0x561f632f92e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-a con 0x561f632fa4f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): _renew_subs 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): authenticate will time out at 2705.761296s 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): get_auth_request con 0x561f632cec90 auth_method 0 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): get_auth_request con 0x561f632fa4f0 auth_method 0 2024-09-14T11:17:26.878 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): handle_auth_done global_id 6548 payload 274 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:17:26.701+0000 7f816cd3a640 1 monclient: found mon.noname-c 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.879 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: dump: 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.880 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6548 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: get_monmap_and_config success 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:17:26.701+0000 7f816f2349c0 4 set_mon_vals no callback set 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:17:26.701+0000 7f8043fff640 10 monclient: dump: 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.881 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: shutdown 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: build_initial_monmap 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 build_initial for_mkfs: 0 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: monmap: 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:26.882 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding auth protocol: cephx 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding auth protocol: cephx 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding auth protocol: cephx 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: crc 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ef940) adding con mode: secure 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 librados: starting msgr at 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 librados: starting objecter 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command objecter_requests cmddesc objecter_requests hook 0x561f632ce840 EEXIST 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 librados: setting wanted keys 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:17:26.701+0000 7f816f2349c0 1 librados: calling monclient init 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: init 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding auth protocol: cephx 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding auth protocol: cephx 2024-09-14T11:17:26.884 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding auth protocol: cephx 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.885 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: crc 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 AuthRegistry(0x561f632ad1f0) adding con mode: secure 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:17:26.701+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:17:26.701+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command rotate-key cmddesc rotate-key hook 0x561f632ad338 EEXIST 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: _reopen_session rank -1 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-c con 0x561f632cec90 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-b con 0x561f632f92e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): picked mon.noname-a con 0x561f632fa4f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): _renew_subs 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:17:26.701+0000 7f816f2349c0 10 monclient(hunting): authenticate will time out at 2705.763845s 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): get_auth_request con 0x561f632cec90 auth_method 0 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:17:26.701+0000 7f816cd3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): get_auth_request con 0x561f632fa4f0 auth_method 0 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:17:26.701+0000 7f816d53b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.887 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:17:26.705+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:17:26.705+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:17:26.705+0000 7f816d53b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient(hunting): handle_auth_done global_id 6551 payload 824 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient: _finish_hunting 0 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:17:26.705+0000 7f816cd3a640 1 monclient: found mon.noname-c 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:17:26.705+0000 7f816cd3a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: dump: 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: _finish_auth 0 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: _check_auth_tickets 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:26.889 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:17:26.705+0000 7f80427fc640 10 monclient: dump: 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:17:26.705+0000 7f8043fff640 4 set_mon_vals no callback set 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:17:26.705+0000 7f816f2349c0 5 monclient: authenticate success, global_id 6551 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:17:26.705+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:17:26.705+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.890 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:17:26.705+0000 7f816f2349c0 10 monclient: _renew_subs 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:17:26.705+0000 7f816f2349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:17:26.705+0000 7f816f2349c0 1 librados: init done 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:17:26.705+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cr dump hook 0x561f632f4008 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:17:26.705+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:17:26.705+0000 7f80427fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:17:26.705+0000 7f80427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:17:26.705+0000 7f80427fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:17:26.705+0000 7f816c539640 10 monclient: get_auth_request con 0x7f80380718d0 auth_method 0 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:17:26.709+0000 7f816d53b640 10 monclient: get_auth_request con 0x561f63318d00 auth_method 0 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 realm 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.891 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:17:26.709+0000 7f816f2349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:17:26.709+0000 7f816cd3a640 10 monclient: get_auth_request con 0x561f6331d020 auth_method 0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:17:26.709+0000 7f816c539640 10 monclient: get_auth_request con 0x561f63320740 auth_method 0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:17:26.709+0000 7f816f2349c0 20 searching for the correct realm 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:17:26.713+0000 7f816d53b640 10 monclient: get_auth_request con 0x561f633254c0 auth_method 0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:17:26.713+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f815c031050 auth_method 0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:17:26.717+0000 7f816c539640 10 monclient: get_auth_request con 0x7f8164037060 auth_method 0 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:17:26.717+0000 7f816cd3a640 0 -- 172.21.15.148:0/2760897346 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x561f6331d020 msgr2=0x561f6331f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:17:26.717+0000 7f80427fc640 1 client.6551.objecter ms_handle_reset 0x561f6331d020 session 0x561f6331bec0 osd.1 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:17:26.717+0000 7f80427fc640 10 monclient: _renew_subs 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:17:26.717+0000 7f80427fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:17:26.717+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f8038081bd0 auth_method 0 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:17:26.717+0000 7f816d53b640 10 monclient: get_auth_request con 0x7f815c06bb20 auth_method 0 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:17:26.721+0000 7f816cd3a640 10 monclient: get_auth_request con 0x7f8164017070 auth_method 0 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:17:26.725+0000 7f816d53b640 0 -- 172.21.15.148:0/2760897346 >> [v2:172.21.15.150:6800/2640697978,v1:172.21.15.150:6801/2640697978] conn(0x7f815c06bb20 msgr2=0x7f815c04d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:17:26.725+0000 7f80427fc640 1 client.6551.objecter ms_handle_reset 0x7f815c06bb20 session 0x7f815c074550 osd.7 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:17:26.725+0000 7f816d53b640 10 monclient: get_auth_request con 0x561f6331d020 auth_method 0 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:26.893 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 zone default found 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:17:26.729+0000 7f816f2349c0 4 Realm: () 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:17:26.729+0000 7f816f2349c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:17:26.729+0000 7f816f2349c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:17:26.729+0000 7f816f2349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 zonegroup default 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:17:26.729+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.894 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 started sync module instance, tier type = 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:17:26.733+0000 7f816f2349c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=0 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=1 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=2 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=3 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=4 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=5 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:17:26.761+0000 7f816f2349c0 20 add_watcher() i=6 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:17:26.765+0000 7f816f2349c0 20 add_watcher() i=7 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:17:26.765+0000 7f816f2349c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding auth protocol: cephx 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding auth protocol: cephx 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding auth protocol: cephx 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:17:26.765+0000 7f8022fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.896 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: crc 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:17:26.765+0000 7f816f2349c0 5 AuthRegistry(0x7ffcf9944950) adding con mode: secure 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:17:26.769+0000 7f816f2349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cache list hook 0x561f632cd8a0 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cache inspect hook 0x561f632cd8a0 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cache erase hook 0x561f632cd8a0 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command cache zap hook 0x561f632cd8a0 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 note: GC not initialized 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:17:26.769+0000 7f8021fe3640 20 reqs_thread_entry: start 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command sync trace show hook 0x7f815c008ef0 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command sync trace history hook 0x7f815c008ef0 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command sync trace active hook 0x7f815c008ef0 2024-09-14T11:17:26.897 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:17:26.769+0000 7f816f2349c0 5 asok(0x561f63023d90) register_command sync trace active_short hook 0x7f815c008ef0 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 Filter name: none 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:17:26.769+0000 7f7f937fe640 20 reqs_thread_entry: start 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 : miss 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:17:26.769+0000 7f816f2349c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:17:26.769+0000 7f816f2349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:17:26.781+0000 7f816f2349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:17:26.781+0000 7f816f2349c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:17:26.781+0000 7f816f2349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:17:26.781+0000 7f816f2349c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28, ofs0, ns] 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366247 cookie 94692808229952 notifier 6551 bl.length()=1023 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:17:26.781+0000 7f80437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_sources= new_sources= 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential sources added=[] removed=[] 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_dests= new_dests= 2024-09-14T11:17:26.899 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:17:26.785+0000 7f816f2349c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential dests added=[] removed=[] 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:17:26.785+0000 7f816f2349c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f816f2349c0 time 2024-09-14T11:17:26.786594+0000 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8172b0e2eb] 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8172b0e49f] 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f609ecc01] 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x14231ee) [0x561f6144b1ee] 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f60a01ecd] 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8171974d90] 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:17:26.900 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:17:26.785+0000 7f816f2349c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f816f2349c0 thread_name:radosgw-admin 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f817198d520] 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8172b0e345] 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8172b0e49f] 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f609ecc01] 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x14231ee) [0x561f6144b1ee] 2024-09-14T11:17:26.901 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f60a01ecd] 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8171974d90] 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:17:26.902 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:17:26.903 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:17:26.905 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:17:26.906 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:26.907 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 7f7f937fe640 / http_manager 2024-09-14T11:17:26.908 INFO:tasks.workunit.client.0.smithi148.stderr: 7f8021fe3640 / http_manager 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f8022fe5640 / rgw_dt_lg_renew 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f80427fc640 / ms_dispatch 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f80437fe640 / io_context_pool 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f8043fff640 / io_context_pool 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f80527fc640 / ms_dispatch 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f805960a640 / ms_dispatch 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f805ae0d640 / io_context_pool 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816c539640 / msgr-worker-2 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816cd3a640 / msgr-worker-1 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816d53b640 / msgr-worker-0 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816dd3c640 / io_context_pool 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 7f816f2349c0 / radosgw-admin 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:17:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:17:26.910 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:17:26.789138Z_6d09364d-6cef-4ff6-9331-bbd360c1a3d1/log 2024-09-14T11:17:26.910 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:17:26.910 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:17:26.910 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.865+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.869+0000 7fef73d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.869+0000 7fef73d209c0 20 realm 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.869+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.869+0000 7fef73d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.869+0000 7fef73d209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.869+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.869+0000 7fef73d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.869+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.873+0000 7fef73d209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.873+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.873+0000 7fef73d209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.873+0000 7fef73d209c0 20 searching for the correct realm 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.877+0000 7fef72027640 0 -- 172.21.15.148:0/2145227234 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x56467520ab70 msgr2=0x56467520d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.885+0000 7fef72027640 0 -- 172.21.15.148:0/2145227234 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x564675217450 msgr2=0x564675219910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.889+0000 7fef73d209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.889+0000 7fef73d209c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.889+0000 7fef73d209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.889+0000 7fef73d209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.889+0000 7fef73d209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.889+0000 7fef73d209c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.889+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:26.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 zone default found 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 4 Realm: () 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 zonegroup default 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 started sync module instance, tier type = 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.893+0000 7fef73d209c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 20 add_watcher() i=0 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 20 add_watcher() i=1 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 20 add_watcher() i=2 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 20 add_watcher() i=3 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 20 add_watcher() i=4 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 20 add_watcher() i=5 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 20 add_watcher() i=6 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 20 add_watcher() i=7 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.917+0000 7fef73d209c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:26.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fee237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:26.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fef73d209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fef73d209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fef73d209c0 5 note: GC not initialized 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fee227fc640 20 reqs_thread_entry: start 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fef73d209c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fef73d209c0 20 Filter name: none 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fed93fff640 20 reqs_thread_entry: start 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fef73d209c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:26.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.921+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.925+0000 7fef73d209c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:17:26.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.925+0000 7fef73d209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:26.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.925+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.925+0000 7fef73d209c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:26.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.925+0000 7fef73d209c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:26.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.925+0000 7fef73d209c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:17:26.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.925+0000 7fef73d209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:26.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.929+0000 7fee237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:26.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.933+0000 7fef73d209c0 20 remove_watcher() i=0 2024-09-14T11:17:26.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.933+0000 7fef73d209c0 2 removed watcher, disabling cache 2024-09-14T11:17:26.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.933+0000 7fef73d209c0 20 remove_watcher() i=1 2024-09-14T11:17:26.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.937+0000 7fef73d209c0 20 remove_watcher() i=2 2024-09-14T11:17:26.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.937+0000 7fef73d209c0 20 remove_watcher() i=3 2024-09-14T11:17:26.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.941+0000 7fef73d209c0 20 remove_watcher() i=4 2024-09-14T11:17:26.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.941+0000 7fef73d209c0 20 remove_watcher() i=5 2024-09-14T11:17:26.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.945+0000 7fef73d209c0 20 remove_watcher() i=6 2024-09-14T11:17:26.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:26.949+0000 7fef73d209c0 20 remove_watcher() i=7 2024-09-14T11:17:26.956 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.956 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:26.956 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-trim-reshard-log-entries id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:26.956 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:26.957 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:26.957 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:26.997 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:26.998 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:27.056 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:27.092 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:27.093 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:27.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.137+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.141+0000 7fbab38b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.141+0000 7fbab38b89c0 20 realm 2024-09-14T11:17:27.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.141+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.141+0000 7fbab38b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.141+0000 7fbab38b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:27.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.141+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.141+0000 7fbab38b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.141+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.145+0000 7fbab38b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:27.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.145+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.145+0000 7fbab38b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:27.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.145+0000 7fbab38b89c0 20 searching for the correct realm 2024-09-14T11:17:27.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.153+0000 7fbab1bbf640 0 -- 172.21.15.148:0/77596841 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55f194235c80 msgr2=0x55f1942380d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:27.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.157+0000 7fbab1bbf640 0 -- 172.21.15.148:0/77596841 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55f194242410 msgr2=0x55f1942448d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:27.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.161+0000 7fbab38b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:27.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.161+0000 7fbab38b89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:27.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.161+0000 7fbab38b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:27.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.161+0000 7fbab38b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:27.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.161+0000 7fbab38b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:27.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.161+0000 7fbab38b89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:27.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.161+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 zone default found 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 4 Realm: () 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:27.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 zonegroup default 2024-09-14T11:17:27.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 started sync module instance, tier type = 2024-09-14T11:17:27.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.165+0000 7fbab38b89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:27.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 20 add_watcher() i=0 2024-09-14T11:17:27.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 20 add_watcher() i=1 2024-09-14T11:17:27.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 20 add_watcher() i=2 2024-09-14T11:17:27.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 20 add_watcher() i=3 2024-09-14T11:17:27.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 20 add_watcher() i=4 2024-09-14T11:17:27.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 20 add_watcher() i=5 2024-09-14T11:17:27.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 20 add_watcher() i=6 2024-09-14T11:17:27.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 20 add_watcher() i=7 2024-09-14T11:17:27.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.185+0000 7fbab38b89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:27.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fb967fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:27.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fbab38b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:27.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fbab38b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:27.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fbab38b89c0 5 note: GC not initialized 2024-09-14T11:17:27.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fb966fe5640 20 reqs_thread_entry: start 2024-09-14T11:17:27.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fbab38b89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:27.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fbab38b89c0 20 Filter name: none 2024-09-14T11:17:27.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fb964fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:27.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fbab38b89c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:17:27.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.189+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:27.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:17:27.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:17:27.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 : miss 2024-09-14T11:17:27.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:17:27.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:27.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:27.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:27.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:27.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 2024-09-14T11:17:27.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.193+0000 7fbab38b89c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to be held by another RGW process; skipping for now 2024-09-14T11:17:27.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.197+0000 7fb967fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:27.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.197+0000 7fbab38b89c0 20 remove_watcher() i=0 2024-09-14T11:17:27.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.197+0000 7fbab38b89c0 2 removed watcher, disabling cache 2024-09-14T11:17:27.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.201+0000 7fbab38b89c0 20 remove_watcher() i=1 2024-09-14T11:17:27.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.201+0000 7fbab38b89c0 20 remove_watcher() i=2 2024-09-14T11:17:27.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.205+0000 7fbab38b89c0 20 remove_watcher() i=3 2024-09-14T11:17:27.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.205+0000 7fbab38b89c0 20 remove_watcher() i=4 2024-09-14T11:17:27.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.209+0000 7fbab38b89c0 20 remove_watcher() i=5 2024-09-14T11:17:27.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.213+0000 7fbab38b89c0 20 remove_watcher() i=6 2024-09-14T11:17:27.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:27.213+0000 7fbab38b89c0 20 remove_watcher() i=7 2024-09-14T11:17:27.223 INFO:tasks.workunit.client.0.smithi148.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:17:57.252 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:57.288 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:57.288 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:57.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.336+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 realm 2024-09-14T11:17:57.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:57.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:57.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:57.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.340+0000 7fc0c30f49c0 20 searching for the correct realm 2024-09-14T11:17:57.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.348+0000 7fc0c13fb640 0 -- 172.21.15.148:0/3648217052 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55dc3dd3d640 msgr2=0x55dc3dd3fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:57.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.356+0000 7fc0c0bfa640 0 -- 172.21.15.148:0/3648217052 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55dc3dd41900 msgr2=0x55dc3dd43cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:57.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:57.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:57.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:57.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:57.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:57.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:57.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.360+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:57.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:57.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 zone default found 2024-09-14T11:17:57.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 4 Realm: () 2024-09-14T11:17:57.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:57.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:57.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:57.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 zonegroup default 2024-09-14T11:17:57.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 started sync module instance, tier type = 2024-09-14T11:17:57.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.364+0000 7fc0c30f49c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:57.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 20 add_watcher() i=0 2024-09-14T11:17:57.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 20 add_watcher() i=1 2024-09-14T11:17:57.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 20 add_watcher() i=2 2024-09-14T11:17:57.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 20 add_watcher() i=3 2024-09-14T11:17:57.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 20 add_watcher() i=4 2024-09-14T11:17:57.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 20 add_watcher() i=5 2024-09-14T11:17:57.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 20 add_watcher() i=6 2024-09-14T11:17:57.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 20 add_watcher() i=7 2024-09-14T11:17:57.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.384+0000 7fc0c30f49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:57.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.388+0000 7fbf777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:57.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.388+0000 7fc0c30f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:57.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.388+0000 7fc0c30f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:57.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.388+0000 7fc0c30f49c0 5 note: GC not initialized 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.388+0000 7fbf767e4640 20 reqs_thread_entry: start 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.388+0000 7fc0c30f49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.388+0000 7fc0c30f49c0 20 Filter name: none 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fbf6ffff640 20 reqs_thread_entry: start 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:17:57.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 : miss 2024-09-14T11:17:57.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:17:57.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:57.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:57.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:57.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:57.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 2024-09-14T11:17:57.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.392+0000 7fc0c30f49c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:17:57.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.412+0000 7fc0c30f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:57.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.412+0000 7fc0c30f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:57.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.412+0000 7fc0c30f49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:57.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.412+0000 7fc0c30f49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28, ofs0, ns] 2024-09-14T11:17:57.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.416+0000 7fbf977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366248 cookie 94404418533760 notifier 6602 bl.length()=1023 2024-09-14T11:17:57.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.416+0000 7fbf977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:57.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.416+0000 7fbf977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:57.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.416+0000 7fbf977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:57.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.416+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_sources= new_sources= 2024-09-14T11:17:57.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.416+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential sources added=[] removed=[] 2024-09-14T11:17:57.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.416+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_dests= new_dests= 2024-09-14T11:17:57.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.416+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential dests added=[] removed=[] 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.0 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.0 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.1 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.1 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.2 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.2 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.3 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.3 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.4 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.4 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.5 2024-09-14T11:17:57.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.5 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.6 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.6 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.7 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.7 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.8 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.8 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.9 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.9 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.10 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.10 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.11 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2.11 2024-09-14T11:17:57.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.0 2024-09-14T11:17:57.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.1 2024-09-14T11:17:57.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.432+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2 2024-09-14T11:17:57.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.436+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.3 2024-09-14T11:17:57.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.436+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.4 2024-09-14T11:17:57.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.436+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.5 2024-09-14T11:17:57.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.436+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.6 2024-09-14T11:17:57.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.440+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.7 2024-09-14T11:17:57.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.440+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.8 2024-09-14T11:17:57.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.440+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.9 2024-09-14T11:17:57.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.444+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.10 2024-09-14T11:17:57.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.448+0000 7fc0c30f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:57.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.448+0000 7fc0c30f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 2024-09-14T11:17:57.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.452+0000 7fc0c30f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:57.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.452+0000 7fc0c30f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:57.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.452+0000 7fc0c30f49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:57.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.452+0000 7fc0c30f49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28, ofs0, ns] 2024-09-14T11:17:57.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.452+0000 7fbf97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366249 cookie 94404418533760 notifier 6602 bl.length()=1023 2024-09-14T11:17:57.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.452+0000 7fbf97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:57.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.452+0000 7fbf97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:57.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.452+0000 7fbf97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:57.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.456+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_sources= new_sources= 2024-09-14T11:17:57.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.456+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential sources added=[] removed=[] 2024-09-14T11:17:57.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.456+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_dests= new_dests= 2024-09-14T11:17:57.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.456+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential dests added=[] removed=[] 2024-09-14T11:17:57.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.460+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.0 2024-09-14T11:17:57.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.460+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.1 2024-09-14T11:17:57.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.464+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.2 2024-09-14T11:17:57.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.464+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.3 2024-09-14T11:17:57.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.464+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.4 2024-09-14T11:17:57.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.464+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.5 2024-09-14T11:17:57.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.464+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.6 2024-09-14T11:17:57.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.468+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.7 2024-09-14T11:17:57.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.468+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.8 2024-09-14T11:17:57.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.468+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.9 2024-09-14T11:17:57.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.468+0000 7fc0c30f49c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28.10 2024-09-14T11:17:57.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.468+0000 7fc0c30f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:57.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.468+0000 7fc0c30f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 2024-09-14T11:17:57.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.472+0000 7fc0c30f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:57.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.472+0000 7fc0c30f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:57.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.472+0000 7fc0c30f49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:57.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.472+0000 7fc0c30f49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28, ofs0, ns] 2024-09-14T11:17:57.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.472+0000 7fbf977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 94404418533760 notifier 6602 bl.length()=991 2024-09-14T11:17:57.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.472+0000 7fbf977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 info.flags=0x17 2024-09-14T11:17:57.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.472+0000 7fbf977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 to cache LRU end 2024-09-14T11:17:57.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.472+0000 7fbf977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:57.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.476+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_sources= new_sources= 2024-09-14T11:17:57.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.476+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential sources added=[] removed=[] 2024-09-14T11:17:57.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.476+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): orig_dests= new_dests= 2024-09-14T11:17:57.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.476+0000 7fc0c30f49c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28]): potential dests added=[] removed=[] 2024-09-14T11:17:57.479 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.484+0000 7fc0c30f49c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:57.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.484+0000 7fbf777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:57.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.488+0000 7fc0c30f49c0 20 remove_watcher() i=0 2024-09-14T11:17:57.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.488+0000 7fc0c30f49c0 2 removed watcher, disabling cache 2024-09-14T11:17:57.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.492+0000 7fc0c30f49c0 20 remove_watcher() i=1 2024-09-14T11:17:57.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.492+0000 7fc0c30f49c0 20 remove_watcher() i=2 2024-09-14T11:17:57.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.496+0000 7fc0c30f49c0 20 remove_watcher() i=3 2024-09-14T11:17:57.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.496+0000 7fc0c30f49c0 20 remove_watcher() i=4 2024-09-14T11:17:57.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.500+0000 7fc0c30f49c0 20 remove_watcher() i=5 2024-09-14T11:17:57.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.500+0000 7fc0c30f49c0 20 remove_watcher() i=6 2024-09-14T11:17:57.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.504+0000 7fc0c30f49c0 20 remove_watcher() i=7 2024-09-14T11:17:57.516 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:17:57.548 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:57.548 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:57.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 20 realm 2024-09-14T11:17:57.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:57.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.596+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.600+0000 7f7b85c609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:57.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.600+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.600+0000 7f7b85c609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:57.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.600+0000 7f7b85c609c0 20 searching for the correct realm 2024-09-14T11:17:57.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.604+0000 7f7b7bfff640 0 -- 172.21.15.148:0/2961025541 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f7b7c025930 msgr2=0x7f7b7c0173f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:57.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.612+0000 7f7b83f67640 0 -- 172.21.15.148:0/2961025541 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5601c5d974b0 msgr2=0x5601c5d99970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:57.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:57.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:17:57.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:57.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:57.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:57.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:17:57.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 zone default found 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 4 Realm: () 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.616+0000 7f7b85c609c0 20 zonegroup default 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.620+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.620+0000 7f7b85c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.620+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.620+0000 7f7b85c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.620+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.620+0000 7f7b85c609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.620+0000 7f7b85c609c0 20 started sync module instance, tier type = 2024-09-14T11:17:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.620+0000 7f7b85c609c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:17:57.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.636+0000 7f7b85c609c0 20 add_watcher() i=0 2024-09-14T11:17:57.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.636+0000 7f7b85c609c0 20 add_watcher() i=1 2024-09-14T11:17:57.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.636+0000 7f7b85c609c0 20 add_watcher() i=2 2024-09-14T11:17:57.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.636+0000 7f7b85c609c0 20 add_watcher() i=3 2024-09-14T11:17:57.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.636+0000 7f7b85c609c0 20 add_watcher() i=4 2024-09-14T11:17:57.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.636+0000 7f7b85c609c0 20 add_watcher() i=5 2024-09-14T11:17:57.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.636+0000 7f7b85c609c0 20 add_watcher() i=6 2024-09-14T11:17:57.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.640+0000 7f7b85c609c0 20 add_watcher() i=7 2024-09-14T11:17:57.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.640+0000 7f7b85c609c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:57.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.640+0000 7f7a39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:57.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:57.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:57.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 5 note: GC not initialized 2024-09-14T11:17:57.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7a38fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:57.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:57.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 Filter name: none 2024-09-14T11:17:57.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f79b27fc640 20 reqs_thread_entry: start 2024-09-14T11:17:57.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:57.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:57.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:57.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:17:57.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.644+0000 7f7b85c609c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:57.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.648+0000 7f7b85c609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:57.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.648+0000 7f7a39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:57.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.652+0000 7f7b85c609c0 20 remove_watcher() i=0 2024-09-14T11:17:57.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.652+0000 7f7b85c609c0 2 removed watcher, disabling cache 2024-09-14T11:17:57.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.656+0000 7f7b85c609c0 20 remove_watcher() i=1 2024-09-14T11:17:57.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.656+0000 7f7b85c609c0 20 remove_watcher() i=2 2024-09-14T11:17:57.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.656+0000 7f7b85c609c0 20 remove_watcher() i=3 2024-09-14T11:17:57.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.660+0000 7f7b85c609c0 20 remove_watcher() i=4 2024-09-14T11:17:57.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.664+0000 7f7b85c609c0 20 remove_watcher() i=5 2024-09-14T11:17:57.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.664+0000 7f7b85c609c0 20 remove_watcher() i=6 2024-09-14T11:17:57.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:17:57.668+0000 7f7b85c609c0 20 remove_watcher() i=7 2024-09-14T11:17:57.676 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:57.677 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:17:57.677 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-trim-reshard-log-entries id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:17:57.677 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:57.678 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:57.678 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:57.702 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:57.702 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:58.198 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:58.198 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:58.592 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:17:58.593 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:17:58.595 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:58.596 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:58.741 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:58.742 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:58.936 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:58.936 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.044 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.044 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.141 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.141 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.245 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.245 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.319 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.320 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.422 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.527 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.527 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.631 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.631 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.733 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.733 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.834 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.834 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:17:59.939 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:17:59.939 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.042 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:00.042 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.139 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:00.139 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.208 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:00.208 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.312 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:00.313 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.410 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:00.411 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.516 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:00.516 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.610 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:00.611 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.709 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:00.709 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:00.798 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:18:00.831 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:00.831 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:00.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.880+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.884+0000 7fd8426199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:00.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.884+0000 7fd8426199c0 20 realm 2024-09-14T11:18:00.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.884+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.884+0000 7fd8426199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:00.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.884+0000 7fd8426199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:00.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.884+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.884+0000 7fd8426199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:00.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.884+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.888+0000 7fd8426199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:00.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.888+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.888+0000 7fd8426199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:00.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.888+0000 7fd8426199c0 20 searching for the correct realm 2024-09-14T11:18:00.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.892+0000 7fd83f91e640 0 -- 172.21.15.148:0/3214003503 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x561d3f4c8780 msgr2=0x561d3f4cab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:00.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.900+0000 7fd84011f640 0 -- 172.21.15.148:0/3214003503 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fd838033960 msgr2=0x7fd8380323e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:00.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:00.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:00.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:00.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:00.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:00.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:00.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:00.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:00.904 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:00.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 zone default found 2024-09-14T11:18:00.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 4 Realm: () 2024-09-14T11:18:00.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:00.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:00.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:00.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 zonegroup default 2024-09-14T11:18:00.905 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:00.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:00.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.908+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.912+0000 7fd8426199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:00.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.912+0000 7fd8426199c0 20 started sync module instance, tier type = 2024-09-14T11:18:00.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.912+0000 7fd8426199c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:00.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.928+0000 7fd8426199c0 20 add_watcher() i=0 2024-09-14T11:18:00.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.928+0000 7fd8426199c0 20 add_watcher() i=1 2024-09-14T11:18:00.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.928+0000 7fd8426199c0 20 add_watcher() i=2 2024-09-14T11:18:00.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.928+0000 7fd8426199c0 20 add_watcher() i=3 2024-09-14T11:18:00.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.928+0000 7fd8426199c0 20 add_watcher() i=4 2024-09-14T11:18:00.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.928+0000 7fd8426199c0 20 add_watcher() i=5 2024-09-14T11:18:00.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.928+0000 7fd8426199c0 20 add_watcher() i=6 2024-09-14T11:18:00.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.932+0000 7fd8426199c0 20 add_watcher() i=7 2024-09-14T11:18:00.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.932+0000 7fd8426199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:00.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd6f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:00.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:00.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:00.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 5 note: GC not initialized 2024-09-14T11:18:00.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd6f5fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:00.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:00.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 Filter name: none 2024-09-14T11:18:00.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd6677fe640 20 reqs_thread_entry: start 2024-09-14T11:18:00.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:00.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:00.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:00.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:00.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:00.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:00.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.936+0000 7fd8426199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:00.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.940+0000 7fd6f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:00.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.944+0000 7fd8426199c0 20 remove_watcher() i=0 2024-09-14T11:18:00.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.944+0000 7fd8426199c0 2 removed watcher, disabling cache 2024-09-14T11:18:00.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.944+0000 7fd8426199c0 20 remove_watcher() i=1 2024-09-14T11:18:00.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.948+0000 7fd8426199c0 20 remove_watcher() i=2 2024-09-14T11:18:00.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.952+0000 7fd8426199c0 20 remove_watcher() i=3 2024-09-14T11:18:00.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.952+0000 7fd8426199c0 20 remove_watcher() i=4 2024-09-14T11:18:00.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.956+0000 7fd8426199c0 20 remove_watcher() i=5 2024-09-14T11:18:00.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.956+0000 7fd8426199c0 20 remove_watcher() i=6 2024-09-14T11:18:00.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:00.960+0000 7fd8426199c0 20 remove_watcher() i=7 2024-09-14T11:18:00.972 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:00.972 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:00.972 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-block-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:00.972 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:00.973 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:18:01.005 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:01.005 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:01.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.052+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 realm 2024-09-14T11:18:01.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:01.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:01.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:01.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.056+0000 7eff845799c0 20 searching for the correct realm 2024-09-14T11:18:01.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.064+0000 7eff82880640 0 -- 172.21.15.148:0/722723011 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55fafeb81fa0 msgr2=0x55fafeb84420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:01.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.072+0000 7eff8207f640 0 -- 172.21.15.148:0/722723011 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55fafeb860f0 msgr2=0x55fafeb885b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:01.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.076+0000 7eff845799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:01.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.076+0000 7eff845799c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:01.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.076+0000 7eff845799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:01.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.076+0000 7eff845799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:01.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.076+0000 7eff845799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:01.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.076+0000 7eff845799c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:01.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.076+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:01.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:01.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 zone default found 2024-09-14T11:18:01.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 4 Realm: () 2024-09-14T11:18:01.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:01.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:01.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:01.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 zonegroup default 2024-09-14T11:18:01.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 started sync module instance, tier type = 2024-09-14T11:18:01.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.080+0000 7eff845799c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:01.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 20 add_watcher() i=0 2024-09-14T11:18:01.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 20 add_watcher() i=1 2024-09-14T11:18:01.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 20 add_watcher() i=2 2024-09-14T11:18:01.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 20 add_watcher() i=3 2024-09-14T11:18:01.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 20 add_watcher() i=4 2024-09-14T11:18:01.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 20 add_watcher() i=5 2024-09-14T11:18:01.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 20 add_watcher() i=6 2024-09-14T11:18:01.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 20 add_watcher() i=7 2024-09-14T11:18:01.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.100+0000 7eff845799c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:01.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.104+0000 7efe397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:01.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.104+0000 7eff845799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:01.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.104+0000 7eff845799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:01.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.104+0000 7eff845799c0 5 note: GC not initialized 2024-09-14T11:18:01.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.104+0000 7efe337fe640 20 reqs_thread_entry: start 2024-09-14T11:18:01.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.104+0000 7eff845799c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:01.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.104+0000 7eff845799c0 20 Filter name: none 2024-09-14T11:18:01.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.104+0000 7efe317fa640 20 reqs_thread_entry: start 2024-09-14T11:18:01.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:18:01.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:01.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 : miss 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.108+0000 7eff845799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 2024-09-14T11:18:01.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.116+0000 7eff845799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.116+0000 7eff845799c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.116+0000 7eff845799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.116+0000 7eff845799c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29, ofs0, ns] 2024-09-14T11:18:01.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.116+0000 7efe657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 94536503734000 notifier 7068 bl.length()=999 2024-09-14T11:18:01.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.116+0000 7efe657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.116+0000 7efe657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.116+0000 7efe657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.120+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_sources= new_sources= 2024-09-14T11:18:01.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.120+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential sources added=[] removed=[] 2024-09-14T11:18:01.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.120+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_dests= new_dests= 2024-09-14T11:18:01.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.120+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential dests added=[] removed=[] 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.0 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.0 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.1 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.1 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.2 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.2 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.3 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.3 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.4 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.4 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.5 2024-09-14T11:18:01.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.5 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.6 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.6 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.7 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.7 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.8 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.8 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.9 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.9 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.10 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.10 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.11 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.11 2024-09-14T11:18:01.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.128+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.0 2024-09-14T11:18:01.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.132+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1 2024-09-14T11:18:01.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.132+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.2 2024-09-14T11:18:01.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.132+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.3 2024-09-14T11:18:01.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.132+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.4 2024-09-14T11:18:01.130 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.136+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.5 2024-09-14T11:18:01.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.136+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.6 2024-09-14T11:18:01.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.136+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.7 2024-09-14T11:18:01.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.136+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.8 2024-09-14T11:18:01.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.136+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.9 2024-09-14T11:18:01.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.136+0000 7eff845799c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.10 2024-09-14T11:18:01.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.144+0000 7eff845799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:01.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.144+0000 7eff845799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 2024-09-14T11:18:01.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29, ofs0, ns] 2024-09-14T11:18:01.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7efe657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 94536503734000 notifier 7068 bl.length()=999 2024-09-14T11:18:01.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7efe657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7efe657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7efe657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_sources= new_sources= 2024-09-14T11:18:01.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential sources added=[] removed=[] 2024-09-14T11:18:01.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_dests= new_dests= 2024-09-14T11:18:01.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential dests added=[] removed=[] 2024-09-14T11:18:01.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:18:01.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.148+0000 7eff845799c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:18:01.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.160+0000 7eff845799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:01.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.160+0000 7eff845799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 2024-09-14T11:18:01.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.164+0000 7eff845799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.164+0000 7eff845799c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.164+0000 7eff845799c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.164+0000 7eff845799c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29, ofs0, ns] 2024-09-14T11:18:01.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.164+0000 7efe657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366255 cookie 94536503734000 notifier 7068 bl.length()=967 2024-09-14T11:18:01.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.164+0000 7efe657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.164+0000 7efe657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.164+0000 7efe657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.168+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_sources= new_sources= 2024-09-14T11:18:01.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.168+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential sources added=[] removed=[] 2024-09-14T11:18:01.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.168+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_dests= new_dests= 2024-09-14T11:18:01.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.168+0000 7eff845799c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential dests added=[] removed=[] 2024-09-14T11:18:01.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.172+0000 7eff845799c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:18:01.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.176+0000 7efe397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:01.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.180+0000 7eff845799c0 20 remove_watcher() i=0 2024-09-14T11:18:01.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.180+0000 7eff845799c0 2 removed watcher, disabling cache 2024-09-14T11:18:01.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.180+0000 7eff845799c0 20 remove_watcher() i=1 2024-09-14T11:18:01.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.180+0000 7eff845799c0 20 remove_watcher() i=2 2024-09-14T11:18:01.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.184+0000 7eff845799c0 20 remove_watcher() i=3 2024-09-14T11:18:01.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.188+0000 7eff845799c0 20 remove_watcher() i=4 2024-09-14T11:18:01.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.188+0000 7eff845799c0 20 remove_watcher() i=5 2024-09-14T11:18:01.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.192+0000 7eff845799c0 20 remove_watcher() i=6 2024-09-14T11:18:01.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.192+0000 7eff845799c0 20 remove_watcher() i=7 2024-09-14T11:18:01.205 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:18:01.234 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:01.235 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:01.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.280+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 realm 2024-09-14T11:18:01.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:01.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:01.281 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:01.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.284+0000 7f5f98b309c0 20 searching for the correct realm 2024-09-14T11:18:01.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.292+0000 7f5f96636640 0 -- 172.21.15.148:0/3018693758 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f5f880749d0 msgr2=0x7f5f88085190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:01.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.296+0000 7f5f96636640 0 -- 172.21.15.148:0/3018693758 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x562244446710 msgr2=0x562244448bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:01.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:01.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:01.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:01.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:01.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:01.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:01.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:01.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:01.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 zone default found 2024-09-14T11:18:01.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 4 Realm: () 2024-09-14T11:18:01.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:01.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:01.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:01.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 zonegroup default 2024-09-14T11:18:01.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.304+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.308+0000 7f5f98b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.308+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.308+0000 7f5f98b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.308+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.308+0000 7f5f98b309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.308+0000 7f5f98b309c0 20 started sync module instance, tier type = 2024-09-14T11:18:01.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.308+0000 7f5f98b309c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:01.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 20 add_watcher() i=0 2024-09-14T11:18:01.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 20 add_watcher() i=1 2024-09-14T11:18:01.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 20 add_watcher() i=2 2024-09-14T11:18:01.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 20 add_watcher() i=3 2024-09-14T11:18:01.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 20 add_watcher() i=4 2024-09-14T11:18:01.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 20 add_watcher() i=5 2024-09-14T11:18:01.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 20 add_watcher() i=6 2024-09-14T11:18:01.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 20 add_watcher() i=7 2024-09-14T11:18:01.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.328+0000 7f5f98b309c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:01.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5e4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:01.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5f98b309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:01.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5f98b309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:01.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5f98b309c0 5 note: GC not initialized 2024-09-14T11:18:01.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5dc77fe640 20 reqs_thread_entry: start 2024-09-14T11:18:01.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5f98b309c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:01.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5f98b309c0 20 Filter name: none 2024-09-14T11:18:01.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5dc57fa640 20 reqs_thread_entry: start 2024-09-14T11:18:01.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5f98b309c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:01.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.332+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.336+0000 7f5f98b309c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:01.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.336+0000 7f5f98b309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:01.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.336+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.336+0000 7f5f98b309c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:01.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.336+0000 7f5f98b309c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.336+0000 7f5f98b309c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:01.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.336+0000 7f5f98b309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:01.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.336+0000 7f5e4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:01.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.340+0000 7f5f98b309c0 20 remove_watcher() i=0 2024-09-14T11:18:01.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.340+0000 7f5f98b309c0 2 removed watcher, disabling cache 2024-09-14T11:18:01.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.344+0000 7f5f98b309c0 20 remove_watcher() i=1 2024-09-14T11:18:01.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.344+0000 7f5f98b309c0 20 remove_watcher() i=2 2024-09-14T11:18:01.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.348+0000 7f5f98b309c0 20 remove_watcher() i=3 2024-09-14T11:18:01.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.348+0000 7f5f98b309c0 20 remove_watcher() i=4 2024-09-14T11:18:01.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.352+0000 7f5f98b309c0 20 remove_watcher() i=5 2024-09-14T11:18:01.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.356+0000 7f5f98b309c0 20 remove_watcher() i=6 2024-09-14T11:18:01.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.356+0000 7f5f98b309c0 20 remove_watcher() i=7 2024-09-14T11:18:01.367 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:01.367 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:01.367 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-block-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:01.367 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:01.368 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:01.368 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:01.411 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:01.411 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:01.472 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:18:01.505 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:01.505 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:01.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.552+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.552+0000 7f6be438c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.552+0000 7f6be438c9c0 20 realm 2024-09-14T11:18:01.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.552+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.552+0000 7f6be438c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.552+0000 7f6be438c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:01.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.552+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.556+0000 7f6be438c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.556+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.556+0000 7f6be438c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:01.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.556+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.556+0000 7f6be438c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:01.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.556+0000 7f6be438c9c0 20 searching for the correct realm 2024-09-14T11:18:01.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.564+0000 7f6be1e92640 0 -- 172.21.15.148:0/3236056423 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5628e5289970 msgr2=0x5628e528bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:01.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.568+0000 7f6be1e92640 0 -- 172.21.15.148:0/3236056423 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f6bdc063ea0 msgr2=0x7f6bdc06cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:01.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:01.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:01.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:01.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:01.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:01.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:01.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:01.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 zone default found 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 4 Realm: () 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 zonegroup default 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 started sync module instance, tier type = 2024-09-14T11:18:01.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.576+0000 7f6be438c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:01.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.596+0000 7f6be438c9c0 20 add_watcher() i=0 2024-09-14T11:18:01.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.596+0000 7f6be438c9c0 20 add_watcher() i=1 2024-09-14T11:18:01.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.596+0000 7f6be438c9c0 20 add_watcher() i=2 2024-09-14T11:18:01.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.596+0000 7f6be438c9c0 20 add_watcher() i=3 2024-09-14T11:18:01.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.596+0000 7f6be438c9c0 20 add_watcher() i=4 2024-09-14T11:18:01.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.596+0000 7f6be438c9c0 20 add_watcher() i=5 2024-09-14T11:18:01.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.596+0000 7f6be438c9c0 20 add_watcher() i=6 2024-09-14T11:18:01.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.600+0000 7f6be438c9c0 20 add_watcher() i=7 2024-09-14T11:18:01.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.600+0000 7f6be438c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:01.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6a937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:01.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:01.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:01.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 5 note: GC not initialized 2024-09-14T11:18:01.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6a927fc640 20 reqs_thread_entry: start 2024-09-14T11:18:01.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:01.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 20 Filter name: none 2024-09-14T11:18:01.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6a03fff640 20 reqs_thread_entry: start 2024-09-14T11:18:01.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:18:01.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:01.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:18:01.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:18:01.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 : miss 2024-09-14T11:18:01.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:01.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:01.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.604+0000 7f6be438c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 2024-09-14T11:18:01.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.616+0000 7f6be438c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.616+0000 7f6be438c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.616+0000 7f6be438c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.616+0000 7f6be438c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29, ofs0, ns] 2024-09-14T11:18:01.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.616+0000 7f6ac4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366256 cookie 94733643387344 notifier 6680 bl.length()=999 2024-09-14T11:18:01.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.616+0000 7f6ac4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.616+0000 7f6ac4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.616+0000 7f6ac4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.620+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_sources= new_sources= 2024-09-14T11:18:01.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.620+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential sources added=[] removed=[] 2024-09-14T11:18:01.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.620+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_dests= new_dests= 2024-09-14T11:18:01.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.620+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential dests added=[] removed=[] 2024-09-14T11:18:01.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.0 2024-09-14T11:18:01.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.0 2024-09-14T11:18:01.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.1 2024-09-14T11:18:01.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.1 2024-09-14T11:18:01.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.2 2024-09-14T11:18:01.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.2 2024-09-14T11:18:01.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.3 2024-09-14T11:18:01.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.3 2024-09-14T11:18:01.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.4 2024-09-14T11:18:01.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.4 2024-09-14T11:18:01.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.5 2024-09-14T11:18:01.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.5 2024-09-14T11:18:01.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.6 2024-09-14T11:18:01.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.6 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.7 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.7 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.8 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.8 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.9 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.9 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.10 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.10 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.11 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1.11 2024-09-14T11:18:01.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.0 2024-09-14T11:18:01.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1 2024-09-14T11:18:01.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.2 2024-09-14T11:18:01.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.636+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.3 2024-09-14T11:18:01.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.640+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.4 2024-09-14T11:18:01.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.640+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.5 2024-09-14T11:18:01.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.640+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.6 2024-09-14T11:18:01.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.640+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.7 2024-09-14T11:18:01.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.640+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.8 2024-09-14T11:18:01.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.640+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.9 2024-09-14T11:18:01.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.644+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.10 2024-09-14T11:18:01.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.648+0000 7f6be438c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:01.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.648+0000 7f6be438c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 2024-09-14T11:18:01.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.652+0000 7f6be438c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.652+0000 7f6be438c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.652+0000 7f6be438c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.652+0000 7f6be438c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29, ofs0, ns] 2024-09-14T11:18:01.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.652+0000 7f6ac4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366257 cookie 94733643387344 notifier 6680 bl.length()=999 2024-09-14T11:18:01.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.652+0000 7f6ac4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.652+0000 7f6ac4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.652+0000 7f6ac4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.656+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_sources= new_sources= 2024-09-14T11:18:01.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.656+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential sources added=[] removed=[] 2024-09-14T11:18:01.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.656+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_dests= new_dests= 2024-09-14T11:18:01.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.656+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential dests added=[] removed=[] 2024-09-14T11:18:01.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.660+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.0 2024-09-14T11:18:01.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.660+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.1 2024-09-14T11:18:01.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.660+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.2 2024-09-14T11:18:01.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.660+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.3 2024-09-14T11:18:01.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.660+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.4 2024-09-14T11:18:01.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.664+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.5 2024-09-14T11:18:01.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.664+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.6 2024-09-14T11:18:01.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.664+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.7 2024-09-14T11:18:01.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.664+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.8 2024-09-14T11:18:01.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.664+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.9 2024-09-14T11:18:01.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.664+0000 7f6be438c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29.10 2024-09-14T11:18:01.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.664+0000 7f6be438c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:01.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.664+0000 7f6be438c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 2024-09-14T11:18:01.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.668+0000 7f6be438c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.668+0000 7f6be438c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.668+0000 7f6be438c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.668+0000 7f6be438c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29, ofs0, ns] 2024-09-14T11:18:01.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.668+0000 7f6ac57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366258 cookie 94733643387344 notifier 6680 bl.length()=967 2024-09-14T11:18:01.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.668+0000 7f6ac57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 info.flags=0x17 2024-09-14T11:18:01.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.668+0000 7f6ac57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 to cache LRU end 2024-09-14T11:18:01.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.668+0000 7f6ac57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:01.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.672+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_sources= new_sources= 2024-09-14T11:18:01.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.672+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential sources added=[] removed=[] 2024-09-14T11:18:01.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.672+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): orig_dests= new_dests= 2024-09-14T11:18:01.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.672+0000 7f6be438c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29]): potential dests added=[] removed=[] 2024-09-14T11:18:01.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.676+0000 7f6be438c9c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:18:01.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.676+0000 7f6a937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:01.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.680+0000 7f6be438c9c0 20 remove_watcher() i=0 2024-09-14T11:18:01.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.680+0000 7f6be438c9c0 2 removed watcher, disabling cache 2024-09-14T11:18:01.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.684+0000 7f6be438c9c0 20 remove_watcher() i=1 2024-09-14T11:18:01.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.684+0000 7f6be438c9c0 20 remove_watcher() i=2 2024-09-14T11:18:01.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.688+0000 7f6be438c9c0 20 remove_watcher() i=3 2024-09-14T11:18:01.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.688+0000 7f6be438c9c0 20 remove_watcher() i=4 2024-09-14T11:18:01.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.692+0000 7f6be438c9c0 20 remove_watcher() i=5 2024-09-14T11:18:01.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.696+0000 7f6be438c9c0 20 remove_watcher() i=6 2024-09-14T11:18:01.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.696+0000 7f6be438c9c0 20 remove_watcher() i=7 2024-09-14T11:18:01.707 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:18:01.734 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:01.734 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:01.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.984+0000 7f7c021bc640 0 --2- 172.21.15.148:0/384645240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b59a711c30 0x55b59a700410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:18:01.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.988+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 realm 2024-09-14T11:18:01.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:01.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:01.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:01.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:01.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:01.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.992+0000 7f7c04eb79c0 20 searching for the correct realm 2024-09-14T11:18:01.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:01.996+0000 7f7c029bd640 0 -- 172.21.15.148:0/384645240 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f7bf40c9020 msgr2=0x7f7bf40f8dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:02.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.004+0000 7f7c031be640 0 -- 172.21.15.148:0/384645240 >> [v2:172.21.15.150:6800/2640697978,v1:172.21.15.150:6801/2640697978] conn(0x7f7bf4100cd0 msgr2=0x7f7bf411d360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:02.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:02.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:02.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:02.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:02.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:02.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:02.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:02.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.012+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:02.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:02.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 zone default found 2024-09-14T11:18:02.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 4 Realm: () 2024-09-14T11:18:02.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:02.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:02.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:02.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 zonegroup default 2024-09-14T11:18:02.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:02.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.012 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:02.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:02.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 started sync module instance, tier type = 2024-09-14T11:18:02.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.016+0000 7f7c04eb79c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:02.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.036+0000 7f7c04eb79c0 20 add_watcher() i=0 2024-09-14T11:18:02.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.036+0000 7f7c04eb79c0 20 add_watcher() i=1 2024-09-14T11:18:02.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.036+0000 7f7c04eb79c0 20 add_watcher() i=2 2024-09-14T11:18:02.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.036+0000 7f7c04eb79c0 20 add_watcher() i=3 2024-09-14T11:18:02.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.036+0000 7f7c04eb79c0 20 add_watcher() i=4 2024-09-14T11:18:02.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.036+0000 7f7c04eb79c0 20 add_watcher() i=5 2024-09-14T11:18:02.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.036+0000 7f7c04eb79c0 20 add_watcher() i=6 2024-09-14T11:18:02.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.040+0000 7f7c04eb79c0 20 add_watcher() i=7 2024-09-14T11:18:02.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.040+0000 7f7c04eb79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:02.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7ab9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:02.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:02.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:02.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 5 note: GC not initialized 2024-09-14T11:18:02.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7ab8fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:02.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:02.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 Filter name: none 2024-09-14T11:18:02.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7ab1ffb640 20 reqs_thread_entry: start 2024-09-14T11:18:02.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:02.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:02.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:02.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:02.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:02.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:02.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.044+0000 7f7c04eb79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:02.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.048+0000 7f7ab9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:02.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.052+0000 7f7c04eb79c0 20 remove_watcher() i=0 2024-09-14T11:18:02.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.052+0000 7f7c04eb79c0 2 removed watcher, disabling cache 2024-09-14T11:18:02.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.056+0000 7f7c04eb79c0 20 remove_watcher() i=1 2024-09-14T11:18:02.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.056+0000 7f7c04eb79c0 20 remove_watcher() i=2 2024-09-14T11:18:02.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.060+0000 7f7c04eb79c0 20 remove_watcher() i=3 2024-09-14T11:18:02.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.060+0000 7f7c04eb79c0 20 remove_watcher() i=4 2024-09-14T11:18:02.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.064+0000 7f7c04eb79c0 20 remove_watcher() i=5 2024-09-14T11:18:02.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.064+0000 7f7c04eb79c0 20 remove_watcher() i=6 2024-09-14T11:18:02.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:02.068+0000 7f7c04eb79c0 20 remove_watcher() i=7 2024-09-14T11:18:02.079 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:02.079 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:02.079 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-block-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:18:02.079 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:02.081 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:02.081 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:02.104 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:02.105 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:02.631 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:02.631 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.035 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:18:03.035 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:03.038 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.038 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.190 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.190 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.279 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.279 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.387 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.387 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.483 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.483 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.588 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.588 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.688 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.688 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.792 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.792 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.893 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.893 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:03.996 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:03.997 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.100 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.100 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.205 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.205 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.307 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.307 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.407 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.408 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.505 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.505 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.612 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.612 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.715 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.715 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.819 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.819 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:04.920 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:04.920 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:05.018 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:05.018 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:05.121 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:05.121 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:05.216 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:05.216 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:05.303 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:18:05.336 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:05.337 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:05.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.384+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 realm 2024-09-14T11:18:05.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:05.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.388+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.392+0000 7fd40c9be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:05.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.392+0000 7fd40c9be9c0 20 searching for the correct realm 2024-09-14T11:18:05.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.396+0000 7fd40a4c4640 0 -- 172.21.15.148:0/3376155242 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fd3fc081020 msgr2=0x7fd3fc05def0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.404+0000 7fd40a4c4640 0 -- 172.21.15.148:0/3376155242 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x563846cac4b0 msgr2=0x563846cae8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:05.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:05.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:05.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:05.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:05.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:05.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:05.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:05.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 zone default found 2024-09-14T11:18:05.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 4 Realm: () 2024-09-14T11:18:05.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:05.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:05.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:05.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 zonegroup default 2024-09-14T11:18:05.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 started sync module instance, tier type = 2024-09-14T11:18:05.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.412+0000 7fd40c9be9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:05.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.432+0000 7fd40c9be9c0 20 add_watcher() i=0 2024-09-14T11:18:05.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.432+0000 7fd40c9be9c0 20 add_watcher() i=1 2024-09-14T11:18:05.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.432+0000 7fd40c9be9c0 20 add_watcher() i=2 2024-09-14T11:18:05.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.432+0000 7fd40c9be9c0 20 add_watcher() i=3 2024-09-14T11:18:05.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.432+0000 7fd40c9be9c0 20 add_watcher() i=4 2024-09-14T11:18:05.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.432+0000 7fd40c9be9c0 20 add_watcher() i=5 2024-09-14T11:18:05.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.432+0000 7fd40c9be9c0 20 add_watcher() i=6 2024-09-14T11:18:05.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.436+0000 7fd40c9be9c0 20 add_watcher() i=7 2024-09-14T11:18:05.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.436+0000 7fd40c9be9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:05.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd2c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd40c9be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:05.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd40c9be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:05.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd40c9be9c0 5 note: GC not initialized 2024-09-14T11:18:05.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd23b7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:05.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd40c9be9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:05.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd40c9be9c0 20 Filter name: none 2024-09-14T11:18:05.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd2397fa640 20 reqs_thread_entry: start 2024-09-14T11:18:05.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd40c9be9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:05.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.440+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.444+0000 7fd40c9be9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:05.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.444+0000 7fd40c9be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:05.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.444+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.444+0000 7fd40c9be9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:05.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.444+0000 7fd40c9be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.444+0000 7fd40c9be9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:05.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.444+0000 7fd40c9be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:05.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.448+0000 7fd2c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.452+0000 7fd40c9be9c0 20 remove_watcher() i=0 2024-09-14T11:18:05.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.452+0000 7fd40c9be9c0 2 removed watcher, disabling cache 2024-09-14T11:18:05.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.452+0000 7fd40c9be9c0 20 remove_watcher() i=1 2024-09-14T11:18:05.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.456+0000 7fd40c9be9c0 20 remove_watcher() i=2 2024-09-14T11:18:05.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.456+0000 7fd40c9be9c0 20 remove_watcher() i=3 2024-09-14T11:18:05.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.460+0000 7fd40c9be9c0 20 remove_watcher() i=4 2024-09-14T11:18:05.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.460+0000 7fd40c9be9c0 20 remove_watcher() i=5 2024-09-14T11:18:05.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.464+0000 7fd40c9be9c0 20 remove_watcher() i=6 2024-09-14T11:18:05.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.468+0000 7fd40c9be9c0 20 remove_watcher() i=7 2024-09-14T11:18:05.478 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.478 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:05.478 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-block-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:05.479 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.479 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:18:05.512 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:05.512 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:05.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.556+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 realm 2024-09-14T11:18:05.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:05.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:05.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 searching for the correct realm 2024-09-14T11:18:05.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.568+0000 7fcd10faf640 0 -- 172.21.15.148:0/1107326380 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55fe20ff17c0 msgr2=0x55fe20ff3bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:05.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.572+0000 7fcd117b0640 0 -- 172.21.15.148:0/1107326380 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fcd0c105b50 msgr2=0x7fcd0c0fd980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:05.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 zone default found 2024-09-14T11:18:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 Realm: () 2024-09-14T11:18:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:05.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:05.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 zonegroup default 2024-09-14T11:18:05.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 started sync module instance, tier type = 2024-09-14T11:18:05.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:05.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=0 2024-09-14T11:18:05.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=1 2024-09-14T11:18:05.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=2 2024-09-14T11:18:05.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=3 2024-09-14T11:18:05.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=4 2024-09-14T11:18:05.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=5 2024-09-14T11:18:05.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=6 2024-09-14T11:18:05.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=7 2024-09-14T11:18:05.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.604+0000 7fcd13caa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:05.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.608+0000 7fcbc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 note: GC not initialized 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcbc6fe5640 20 reqs_thread_entry: start 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 Filter name: none 2024-09-14T11:18:05.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcbc4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:05.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:18:05.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:05.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:18:05.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:18:05.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : miss 2024-09-14T11:18:05.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:05.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:05.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:05.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:05.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366261 cookie 94549963682256 notifier 7167 bl.length()=999 2024-09-14T11:18:05.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:05.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:05.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.0 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.0 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.1 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.1 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.2 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.2 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.3 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.3 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.4 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.4 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.5 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.5 2024-09-14T11:18:05.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.6 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.6 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.7 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.7 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.8 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.8 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.9 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.9 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.10 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.10 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.11 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.11 2024-09-14T11:18:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.0 2024-09-14T11:18:05.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1 2024-09-14T11:18:05.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2 2024-09-14T11:18:05.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.3 2024-09-14T11:18:05.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.4 2024-09-14T11:18:05.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.5 2024-09-14T11:18:05.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.6 2024-09-14T11:18:05.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.7 2024-09-14T11:18:05.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.8 2024-09-14T11:18:05.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.9 2024-09-14T11:18:05.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.10 2024-09-14T11:18:05.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:05.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:05.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:05.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94549963682256 notifier 7167 bl.length()=999 2024-09-14T11:18:05.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:05.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:05.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:05.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:05.652 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcd13caa9c0 time 2024-09-14T11:18:05.659056+0000 2024-09-14T11:18:05.652 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd175842eb] 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd1758449f] 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe1e49ec01] 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55fe1e4b329b] 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55fe1e4b4884] 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd163ead90] 2024-09-14T11:18:05.653 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.656+0000 7fcd13caa9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcd13caa9c0 time 2024-09-14T11:18:05.659056+0000 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd175842eb] 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd1758449f] 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe1e49ec01] 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55fe1e4b329b] 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55fe1e4b4884] 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd163ead90] 2024-09-14T11:18:05.654 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:18:05.655 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:18:05.655 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.655 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:18:05.655 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fcd13caa9c0 thread_name:radosgw-admin 2024-09-14T11:18:05.665 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:05.665 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd16403520] 2024-09-14T11:18:05.665 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd17584345] 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd1758449f] 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe1e49ec01] 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55fe1e4b329b] 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55fe1e4b4884] 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd163ead90] 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:18:05.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.656+0000 7fcd13caa9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fcd13caa9c0 thread_name:radosgw-admin 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd16403520] 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd17584345] 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd1758449f] 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe1e49ec01] 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55fe1e4b329b] 2024-09-14T11:18:05.667 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55fe1e4b4884] 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd163ead90] 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: secure 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: crc 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: crc 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: secure 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: crc 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: secure 2024-09-14T11:18:05.668 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: crc 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: secure 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command rotate-key hook 0x55fe20f00fd8 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fe20dbc890 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fe20dbdcc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fe20e47950 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.669 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): authenticate will time out at 2744.600790s 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): get_auth_request con 0x55fe20dbdcc0 auth_method 0 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): get_auth_request con 0x55fe20dbc890 auth_method 0 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.670 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): handle_auth_done global_id 7158 payload 824 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient: _finish_hunting 0 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:18:05.540+0000 7fcd10faf640 1 monclient: found mon.noname-a 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:18:05.540+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x55fe20e47950 auth_method 0 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: dump: 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.671 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: _finish_auth 0 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: _check_auth_tickets 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: dump: 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.672 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 monclient: authenticate success, global_id 7158 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:18:05.540+0000 7fcbff606640 4 set_mon_vals no callback set 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.673 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 1 librados: init done 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:18:05.540+0000 7fcbfde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:18:05.540+0000 7fcbfde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:18:05.540+0000 7fcbfde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcbf80718d0 auth_method 0 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:18:05.544+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x55fe20f40b90 auth_method 0 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:18:05.544+0000 7fcd117b0640 10 monclient: get_auth_request con 0x55fe20f4b9e0 auth_method 0 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:18:05.544+0000 7fcd10faf640 10 monclient: get_auth_request con 0x55fe20f4fd40 auth_method 0 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: monmap: 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:05.674 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding auth protocol: cephx 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding auth protocol: cephx 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding auth protocol: cephx 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.675 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fe20f58650 EEXIST 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: init 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding auth protocol: cephx 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding auth protocol: cephx 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding auth protocol: cephx 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.676 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command rotate-key cmddesc rotate-key hook 0x55fe20f533f0 EEXIST 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:05.677 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fe20f7c800 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fe20f7c130 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fe20f7ab10 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): authenticate will time out at 2744.609448s 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request con 0x55fe20f7ab10 auth_method 0 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.678 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): get_auth_request con 0x55fe20f7c130 auth_method 0 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:18:05.548+0000 7fcd117b0640 10 monclient(hunting): get_auth_request con 0x55fe20f7c800 auth_method 0 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:18:05.548+0000 7fcd117b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:18:05.548+0000 7fcd117b0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:18:05.548+0000 7fcd117b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_done global_id 6725 payload 824 2024-09-14T11:18:05.679 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient: _finish_hunting 0 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 1 monclient: found mon.noname-c 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: dump: 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.680 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: dump: 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.681 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 monclient: authenticate success, global_id 6725 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:18:05.548+0000 7fcd127b2640 4 set_mon_vals no callback set 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:18:05.552+0000 7fcbf6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:18:05.552+0000 7fcbf6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:18:05.552+0000 7fcbf6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:18:05.552+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcbec0717e0 auth_method 0 2024-09-14T11:18:05.682 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: get_monmap_and_config 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: monmap: 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:05.683 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding auth protocol: cephx 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding auth protocol: cephx 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding auth protocol: cephx 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.684 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: init 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding auth protocol: cephx 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding auth protocol: cephx 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding auth protocol: cephx 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.685 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd74fa3128 EEXIST 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fe20fd0540 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fe20fcb930 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fe20fcc2b0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.686 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): authenticate will time out at 2744.613866s 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): get_auth_request con 0x55fe20fcb930 auth_method 0 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request con 0x55fe20fcc2b0 auth_method 0 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.687 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): handle_auth_done global_id 7164 payload 274 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient: _finish_hunting 0 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:18:05.552+0000 7fcd10faf640 1 monclient: found mon.noname-a 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: dump: 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.688 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 monclient: authenticate success, global_id 7164 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 4 set_mon_vals no callback set 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: dump: 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.689 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: shutdown 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: monmap: 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:05.690 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding auth protocol: cephx 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding auth protocol: cephx 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding auth protocol: cephx 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.691 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 librados: starting msgr at 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 librados: starting objecter 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fe20f9f4e0 EEXIST 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 librados: setting wanted keys 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 librados: calling monclient init 2024-09-14T11:18:05.692 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: init 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding auth protocol: cephx 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding auth protocol: cephx 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding auth protocol: cephx 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.693 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command rotate-key cmddesc rotate-key hook 0x55fe20f7e768 EEXIST 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fe20fcb930 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fe20fcc2b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fe20fd0540 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): authenticate will time out at 2744.616499s 2024-09-14T11:18:05.694 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request con 0x55fe20fd0540 auth_method 0 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): get_auth_request con 0x55fe20fcc2b0 auth_method 0 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): handle_auth_done global_id 7167 payload 824 2024-09-14T11:18:05.695 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient: _finish_hunting 0 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:18:05.556+0000 7fcd10faf640 1 monclient: found mon.noname-a 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:18:05.556+0000 7fcd117b0640 10 monclient: get_auth_request con 0x55fe20fcb930 auth_method 0 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: dump: 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.696 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: dump: 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.697 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 5 monclient: authenticate success, global_id 7167 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:18:05.556+0000 7fcbf4ff9640 4 set_mon_vals no callback set 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 1 librados: init done 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cr dump hook 0x7fcd0805e048 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:05.698 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:18:05.556+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcbdc0718d0 auth_method 0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x55fe20fe9c90 auth_method 0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 realm 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:18:05.560+0000 7fcd117b0640 10 monclient: get_auth_request con 0x55fe20fedf10 auth_method 0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.699 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:18:05.560+0000 7fcd10faf640 10 monclient: get_auth_request con 0x55fe20ff17c0 auth_method 0 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 searching for the correct realm 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:18:05.560+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x55fe20ff6560 auth_method 0 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:18:05.564+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcd0403c040 auth_method 0 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:18:05.568+0000 7fcd10faf640 10 monclient: get_auth_request con 0x7fcd0c0c8070 auth_method 0 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:18:05.568+0000 7fcd10faf640 0 -- 172.21.15.148:0/1107326380 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55fe20ff17c0 msgr2=0x55fe20ff3bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:18:05.568+0000 7fcbe2ffd640 1 client.7167.objecter ms_handle_reset 0x55fe20ff17c0 session 0x55fe20fed2a0 osd.2 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:18:05.568+0000 7fcbe2ffd640 10 monclient: _renew_subs 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:18:05.568+0000 7fcbe2ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:18:05.568+0000 7fcd10faf640 10 monclient: get_auth_request con 0x7fcbdc081b70 auth_method 0 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:18:05.572+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x7fcd0402fb70 auth_method 0 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:18:05.572+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcd0c105b50 auth_method 0 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:18:05.572+0000 7fcd117b0640 0 -- 172.21.15.148:0/1107326380 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fcd0c105b50 msgr2=0x7fcd0c0fd980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.700 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:18:05.572+0000 7fcbe2ffd640 1 client.7167.objecter ms_handle_reset 0x7fcd0c105b50 session 0x7fcd0c101130 osd.3 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:18:05.572+0000 7fcd117b0640 10 monclient: get_auth_request con 0x55fe20ff17c0 auth_method 0 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:05.701 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 zone default found 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 Realm: () 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 zonegroup default 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 started sync module instance, tier type = 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:05.702 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=0 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=1 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=2 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=3 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=4 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=5 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=6 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=7 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding auth protocol: cephx 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding auth protocol: cephx 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding auth protocol: cephx 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:18:05.608+0000 7fcbc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.703 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.704 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cache list hook 0x55fe20fc7cd0 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cache inspect hook 0x55fe20fc7cd0 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cache erase hook 0x55fe20fc7cd0 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cache zap hook 0x55fe20fc7cd0 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 note: GC not initialized 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:18:05.612+0000 7fcbc6fe5640 20 reqs_thread_entry: start 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command sync trace show hook 0x7fcd0805df50 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command sync trace history hook 0x7fcd0805df50 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command sync trace active hook 0x7fcd0805df50 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command sync trace active_short hook 0x7fcd0805df50 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 Filter name: none 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:18:05.612+0000 7fcbc4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : miss 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.706 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366261 cookie 94549963682256 notifier 7167 bl.length()=999 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.0 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.0 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.1 2024-09-14T11:18:05.707 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.1 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.2 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.2 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.3 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.3 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.4 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.4 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.5 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.5 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.6 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.6 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.7 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.7 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.8 2024-09-14T11:18:05.708 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.8 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.9 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.9 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.10 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.10 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.11 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.11 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.0 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:18:05.636+0000 7fcbe2ffd640 1 client.7167.objecter ms_handle_reset 0x7fcbdc081b70 session 0x55fe20fed2a0 osd.2 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:18:05.636+0000 7fcd10faf640 10 monclient: get_auth_request con 0x7fcd0c105b50 auth_method 0 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.3 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.4 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.5 2024-09-14T11:18:05.709 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.6 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.7 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.8 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.9 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.10 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94549963682256 notifier 7167 bl.length()=999 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.710 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcd13caa9c0 time 2024-09-14T11:18:05.659056+0000 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd175842eb] 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd1758449f] 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe1e49ec01] 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55fe1e4b329b] 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55fe1e4b4884] 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd163ead90] 2024-09-14T11:18:05.711 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fcd13caa9c0 thread_name:radosgw-admin 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd16403520] 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd17584345] 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd1758449f] 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe1e49ec01] 2024-09-14T11:18:05.712 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55fe1e4b329b] 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55fe1e4b4884] 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd163ead90] 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:18:05.713 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:18:05.714 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:18:05.716 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:18:05.717 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:18:05.718 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:18:05.719 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:05.720 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:05.721 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbc4fe1640 / http_manager 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbc6fe5640 / http_manager 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbc7fe7640 / rgw_dt_lg_renew 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbe2ffd640 / ms_dispatch 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbe3fff640 / io_context_pool 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbf4ff9640 / io_context_pool 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbf6ffd640 / ms_dispatch 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbfde03640 / ms_dispatch 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbff606640 / io_context_pool 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd10faf640 / msgr-worker-2 2024-09-14T11:18:05.722 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd117b0640 / msgr-worker-1 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd11fb1640 / msgr-worker-0 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd127b2640 / io_context_pool 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd13caa9c0 / radosgw-admin 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.107492.log 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: secure 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: crc 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: crc 2024-09-14T11:18:05.723 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: secure 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: crc 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: secure 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: crc 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f00e90) adding con mode: secure 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command rotate-key hook 0x55fe20f00fd8 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fe20dbc890 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fe20dbdcc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fe20e47950 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.724 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient(hunting): authenticate will time out at 2744.600790s 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): get_auth_request con 0x55fe20dbdcc0 auth_method 0 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): get_auth_request con 0x55fe20dbc890 auth_method 0 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.725 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.726 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.726 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.726 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.726 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient(hunting): handle_auth_done global_id 7158 payload 824 2024-09-14T11:18:05.726 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient: _finish_hunting 0 2024-09-14T11:18:05.726 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:18:05.540+0000 7fcd10faf640 1 monclient: found mon.noname-a 2024-09-14T11:18:05.726 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:18:05.540+0000 7fcd10faf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.726 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:18:05.540+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x55fe20e47950 auth_method 0 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: dump: 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.727 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: _finish_auth 0 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: _check_auth_tickets 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:18:05.540+0000 7fcbfde03640 10 monclient: dump: 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.728 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 5 monclient: authenticate success, global_id 7158 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:18:05.540+0000 7fcbff606640 4 set_mon_vals no callback set 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:18:05.540+0000 7fcd13caa9c0 1 librados: init done 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:18:05.540+0000 7fcbfde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:18:05.540+0000 7fcbfde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:18:05.540+0000 7fcbfde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:18:05.540+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcbf80718d0 auth_method 0 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:18:05.544+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x55fe20f40b90 auth_method 0 2024-09-14T11:18:05.729 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:18:05.544+0000 7fcd117b0640 10 monclient: get_auth_request con 0x55fe20f4b9e0 auth_method 0 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:18:05.544+0000 7fcd10faf640 10 monclient: get_auth_request con 0x55fe20f4fd40 auth_method 0 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: monmap: 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:05.730 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding auth protocol: cephx 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding auth protocol: cephx 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding auth protocol: cephx 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.731 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: crc 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f54c80) adding con mode: secure 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fe20f58650 EEXIST 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: init 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding auth protocol: cephx 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding auth protocol: cephx 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding auth protocol: cephx 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.732 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: crc 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f532a8) adding con mode: secure 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command rotate-key cmddesc rotate-key hook 0x55fe20f533f0 EEXIST 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:05.733 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fe20f7c800 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fe20f7c130 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fe20f7ab10 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient(hunting): authenticate will time out at 2744.609448s 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request con 0x55fe20f7ab10 auth_method 0 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): get_auth_request con 0x55fe20f7c130 auth_method 0 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.734 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:18:05.548+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:18:05.548+0000 7fcd117b0640 10 monclient(hunting): get_auth_request con 0x55fe20f7c800 auth_method 0 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:18:05.548+0000 7fcd117b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:18:05.548+0000 7fcd117b0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:18:05.548+0000 7fcd117b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_done global_id 6725 payload 824 2024-09-14T11:18:05.735 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient: _finish_hunting 0 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 1 monclient: found mon.noname-c 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:18:05.548+0000 7fcd11fb1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: dump: 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.736 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:18:05.548+0000 7fcbf6ffd640 10 monclient: dump: 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.737 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 5 monclient: authenticate success, global_id 6725 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:18:05.548+0000 7fcd127b2640 4 set_mon_vals no callback set 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:18:05.548+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:18:05.552+0000 7fcbf6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:05.738 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:18:05.552+0000 7fcbf6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:18:05.552+0000 7fcbf6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:18:05.552+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcbec0717e0 auth_method 0 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: get_monmap_and_config 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: monmap: 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.739 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding auth protocol: cephx 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding auth protocol: cephx 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding auth protocol: cephx 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.740 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: crc 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f9c020) adding con mode: secure 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: init 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding auth protocol: cephx 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding auth protocol: cephx 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding auth protocol: cephx 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.741 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: crc 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa2fe0) adding con mode: secure 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd74fa3128 EEXIST 2024-09-14T11:18:05.742 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fe20fd0540 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fe20fcb930 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fe20fcc2b0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient(hunting): authenticate will time out at 2744.613866s 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): get_auth_request con 0x55fe20fcb930 auth_method 0 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.743 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request con 0x55fe20fcc2b0 auth_method 0 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:18:05.552+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient(hunting): handle_auth_done global_id 7164 payload 274 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient: _finish_hunting 0 2024-09-14T11:18:05.744 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:18:05.552+0000 7fcd10faf640 1 monclient: found mon.noname-a 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:18:05.552+0000 7fcd10faf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: dump: 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.745 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 monclient: authenticate success, global_id 7164 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 4 set_mon_vals no callback set 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:18:05.552+0000 7fcbf4ff9640 10 monclient: dump: 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.746 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: shutdown 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: monmap: 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:05.747 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding auth protocol: cephx 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding auth protocol: cephx 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding auth protocol: cephx 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.748 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: crc 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20fc2800) adding con mode: secure 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 librados: starting msgr at 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 librados: starting objecter 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fe20f9f4e0 EEXIST 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 librados: setting wanted keys 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 1 librados: calling monclient init 2024-09-14T11:18:05.749 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 10 monclient: init 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding auth protocol: cephx 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding auth protocol: cephx 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding auth protocol: cephx 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.750 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: crc 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:18:05.552+0000 7fcd13caa9c0 5 AuthRegistry(0x55fe20f7e620) adding con mode: secure 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command rotate-key cmddesc rotate-key hook 0x55fe20f7e768 EEXIST 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fe20fcb930 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fe20fcc2b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fe20fd0540 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:05.751 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient(hunting): authenticate will time out at 2744.616499s 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request con 0x55fe20fd0540 auth_method 0 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): get_auth_request con 0x55fe20fcc2b0 auth_method 0 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:05.752 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient(hunting): handle_auth_done global_id 7167 payload 824 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient: _finish_hunting 0 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:18:05.556+0000 7fcd10faf640 1 monclient: found mon.noname-a 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:18:05.556+0000 7fcd10faf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:18:05.556+0000 7fcd117b0640 10 monclient: get_auth_request con 0x55fe20fcb930 auth_method 0 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: dump: 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.753 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 10 monclient: dump: 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.754 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 5 monclient: authenticate success, global_id 7167 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:18:05.556+0000 7fcbf4ff9640 4 set_mon_vals no callback set 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _renew_subs 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 1 librados: init done 2024-09-14T11:18:05.755 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cr dump hook 0x7fcd0805e048 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:18:05.556+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:18:05.556+0000 7fcbe2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:18:05.556+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcbdc0718d0 auth_method 0 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:18:05.556+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x55fe20fe9c90 auth_method 0 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 realm 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.756 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:18:05.560+0000 7fcd117b0640 10 monclient: get_auth_request con 0x55fe20fedf10 auth_method 0 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:18:05.560+0000 7fcd10faf640 10 monclient: get_auth_request con 0x55fe20ff17c0 auth_method 0 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:18:05.560+0000 7fcd13caa9c0 20 searching for the correct realm 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:18:05.560+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x55fe20ff6560 auth_method 0 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:18:05.564+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcd0403c040 auth_method 0 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:18:05.568+0000 7fcd10faf640 10 monclient: get_auth_request con 0x7fcd0c0c8070 auth_method 0 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:18:05.568+0000 7fcd10faf640 0 -- 172.21.15.148:0/1107326380 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55fe20ff17c0 msgr2=0x55fe20ff3bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:18:05.568+0000 7fcbe2ffd640 1 client.7167.objecter ms_handle_reset 0x55fe20ff17c0 session 0x55fe20fed2a0 osd.2 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:18:05.568+0000 7fcbe2ffd640 10 monclient: _renew_subs 2024-09-14T11:18:05.757 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:18:05.568+0000 7fcbe2ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:18:05.568+0000 7fcd10faf640 10 monclient: get_auth_request con 0x7fcbdc081b70 auth_method 0 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:18:05.572+0000 7fcd11fb1640 10 monclient: get_auth_request con 0x7fcd0402fb70 auth_method 0 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:18:05.572+0000 7fcd117b0640 10 monclient: get_auth_request con 0x7fcd0c105b50 auth_method 0 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:18:05.572+0000 7fcd117b0640 0 -- 172.21.15.148:0/1107326380 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fcd0c105b50 msgr2=0x7fcd0c0fd980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:18:05.572+0000 7fcbe2ffd640 1 client.7167.objecter ms_handle_reset 0x7fcd0c105b50 session 0x7fcd0c101130 osd.3 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:18:05.572+0000 7fcd117b0640 10 monclient: get_auth_request con 0x55fe20ff17c0 auth_method 0 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:05.758 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:18:05.580+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 zone default found 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 Realm: () 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 zonegroup default 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.759 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 started sync module instance, tier type = 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:18:05.584+0000 7fcd13caa9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=0 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=1 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=2 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=3 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=4 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=5 2024-09-14T11:18:05.760 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=6 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 20 add_watcher() i=7 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:18:05.604+0000 7fcd13caa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding auth protocol: cephx 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding auth protocol: cephx 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding auth protocol: cephx 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:18:05.608+0000 7fcbc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.761 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: crc 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:18:05.608+0000 7fcd13caa9c0 5 AuthRegistry(0x7ffd74fa34c0) adding con mode: secure 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cache list hook 0x55fe20fc7cd0 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cache inspect hook 0x55fe20fc7cd0 2024-09-14T11:18:05.762 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cache erase hook 0x55fe20fc7cd0 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command cache zap hook 0x55fe20fc7cd0 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 note: GC not initialized 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:18:05.612+0000 7fcbc6fe5640 20 reqs_thread_entry: start 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command sync trace show hook 0x7fcd0805df50 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command sync trace history hook 0x7fcd0805df50 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command sync trace active hook 0x7fcd0805df50 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 5 asok(0x55fe20cf3d90) register_command sync trace active_short hook 0x7fcd0805df50 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 Filter name: none 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:18:05.612+0000 7fcbc4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:05.763 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : miss 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:18:05.612+0000 7fcd13caa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:18:05.620+0000 7fcd13caa9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:05.764 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366261 cookie 94549963682256 notifier 7167 bl.length()=999 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:18:05.624+0000 7fcbe3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:18:05.624+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.0 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.0 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.1 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.1 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.2 2024-09-14T11:18:05.765 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.2 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.3 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.3 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.4 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.4 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.5 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.5 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.6 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.6 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.7 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.7 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.8 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.8 2024-09-14T11:18:05.766 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.9 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.9 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.10 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.10 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.11 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1.11 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.0 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:18:05.636+0000 7fcbe2ffd640 1 client.7167.objecter ms_handle_reset 0x7fcbdc081b70 session 0x55fe20fed2a0 osd.2 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:18:05.636+0000 7fcd10faf640 10 monclient: get_auth_request con 0x7fcd0c105b50 auth_method 0 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:18:05.636+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.3 2024-09-14T11:18:05.767 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.4 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.5 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.6 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:18:05.640+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.7 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.8 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.9 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:18:05.644+0000 7fcd13caa9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.10 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:18:05.652+0000 7fcd13caa9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94549963682256 notifier 7167 bl.length()=999 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:05.768 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:18:05.652+0000 7fcbf4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcd13caa9c0 time 2024-09-14T11:18:05.659056+0000 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd175842eb] 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd1758449f] 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe1e49ec01] 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55fe1e4b329b] 2024-09-14T11:18:05.769 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55fe1e4b4884] 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd163ead90] 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:18:05.656+0000 7fcd13caa9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fcd13caa9c0 thread_name:radosgw-admin 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd16403520] 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd17584345] 2024-09-14T11:18:05.770 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd1758449f] 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fe1e49ec01] 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55fe1e4b329b] 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55fe1e4b4884] 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd163ead90] 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:18:05.771 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:18:05.772 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:18:05.773 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:18:05.774 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:18:05.775 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:05.776 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:18:05.777 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbc4fe1640 / http_manager 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbc6fe5640 / http_manager 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbc7fe7640 / rgw_dt_lg_renew 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbe2ffd640 / ms_dispatch 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbe3fff640 / io_context_pool 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbf4ff9640 / io_context_pool 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbf6ffd640 / ms_dispatch 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbfde03640 / ms_dispatch 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcbff606640 / io_context_pool 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd10faf640 / msgr-worker-2 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd117b0640 / msgr-worker-1 2024-09-14T11:18:05.778 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd11fb1640 / msgr-worker-0 2024-09-14T11:18:05.779 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd127b2640 / io_context_pool 2024-09-14T11:18:05.779 INFO:tasks.workunit.client.0.smithi148.stderr: 7fcd13caa9c0 / radosgw-admin 2024-09-14T11:18:05.779 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:18:05.779 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:18:05.779 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:18:05.661439Z_4bfa1b59-4f7c-46f6-a52f-67872bc8351e/log 2024-09-14T11:18:05.779 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:18:05.779 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:18:05.779 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:18:05.781 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:05.781 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.736+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 realm 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.740+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.744+0000 7f7f662459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.744+0000 7f7f662459c0 20 searching for the correct realm 2024-09-14T11:18:05.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.748+0000 7f7f6454c640 0 -- 172.21.15.148:0/1920289982 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55f6870048e0 msgr2=0x55f687006d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.752+0000 7f7f63d4b640 0 -- 172.21.15.148:0/1920289982 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55f6870048e0 msgr2=0x7f7e2c086cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.760+0000 7f7f662459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.760+0000 7f7f662459c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.760+0000 7f7f662459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.760+0000 7f7f662459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.760+0000 7f7f662459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.760+0000 7f7f662459c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 zone default found 2024-09-14T11:18:05.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 4 Realm: () 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 zonegroup default 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 started sync module instance, tier type = 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.764+0000 7f7f662459c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.784+0000 7f7f662459c0 20 add_watcher() i=0 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.784+0000 7f7f662459c0 20 add_watcher() i=1 2024-09-14T11:18:05.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.784+0000 7f7f662459c0 20 add_watcher() i=2 2024-09-14T11:18:05.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.784+0000 7f7f662459c0 20 add_watcher() i=3 2024-09-14T11:18:05.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.784+0000 7f7f662459c0 20 add_watcher() i=4 2024-09-14T11:18:05.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.784+0000 7f7f662459c0 20 add_watcher() i=5 2024-09-14T11:18:05.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.784+0000 7f7f662459c0 20 add_watcher() i=6 2024-09-14T11:18:05.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.788+0000 7f7f662459c0 20 add_watcher() i=7 2024-09-14T11:18:05.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.788+0000 7f7f662459c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:05.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.787 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:05.787 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:05.787 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 5 note: GC not initialized 2024-09-14T11:18:05.787 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7e18fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:05.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:05.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 Filter name: none 2024-09-14T11:18:05.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7d927fc640 20 reqs_thread_entry: start 2024-09-14T11:18:05.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:05.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:18:05.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:05.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:05.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.792+0000 7f7f662459c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:05.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.796+0000 7f7f662459c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:18:05.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.796+0000 7f7f662459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:05.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.796+0000 7f7e19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:05.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.800+0000 7f7f662459c0 20 remove_watcher() i=0 2024-09-14T11:18:05.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.800+0000 7f7f662459c0 2 removed watcher, disabling cache 2024-09-14T11:18:05.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.804+0000 7f7f662459c0 20 remove_watcher() i=1 2024-09-14T11:18:05.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.804+0000 7f7f662459c0 20 remove_watcher() i=2 2024-09-14T11:18:05.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.808+0000 7f7f662459c0 20 remove_watcher() i=3 2024-09-14T11:18:05.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.808+0000 7f7f662459c0 20 remove_watcher() i=4 2024-09-14T11:18:05.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.812+0000 7f7f662459c0 20 remove_watcher() i=5 2024-09-14T11:18:05.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.812+0000 7f7f662459c0 20 remove_watcher() i=6 2024-09-14T11:18:05.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:05.816+0000 7f7f662459c0 20 remove_watcher() i=7 2024-09-14T11:18:05.827 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.827 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:05.827 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-block-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:05.827 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:05.828 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:05.828 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:05.869 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:05.869 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:18:05.964 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:05.964 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:06.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.008+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 realm 2024-09-14T11:18:06.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:06.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:06.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.012+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.016+0000 7fcfe06409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:06.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.016+0000 7fcfe06409c0 20 searching for the correct realm 2024-09-14T11:18:06.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.020+0000 7fcfde947640 0 -- 172.21.15.148:0/2332011930 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55e259bf3210 msgr2=0x55e259bf56b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:06.024 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.028+0000 7fcfde146640 0 -- 172.21.15.148:0/2332011930 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55e259bf7380 msgr2=0x55e259bf9840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:06.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:06.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:06.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:06.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 zone default found 2024-09-14T11:18:06.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 4 Realm: () 2024-09-14T11:18:06.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:06.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:06.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:06.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 zonegroup default 2024-09-14T11:18:06.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:06.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 started sync module instance, tier type = 2024-09-14T11:18:06.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.036+0000 7fcfe06409c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:06.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 20 add_watcher() i=0 2024-09-14T11:18:06.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 20 add_watcher() i=1 2024-09-14T11:18:06.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 20 add_watcher() i=2 2024-09-14T11:18:06.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 20 add_watcher() i=3 2024-09-14T11:18:06.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 20 add_watcher() i=4 2024-09-14T11:18:06.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 20 add_watcher() i=5 2024-09-14T11:18:06.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 20 add_watcher() i=6 2024-09-14T11:18:06.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 20 add_watcher() i=7 2024-09-14T11:18:06.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.056+0000 7fcfe06409c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:06.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fce957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fcfe06409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fcfe06409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fcfe06409c0 5 note: GC not initialized 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fce8f7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fcfe06409c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fcfe06409c0 20 Filter name: none 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fce8d7fa640 20 reqs_thread_entry: start 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fcfe06409c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:18:06.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.060+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:06.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:18:06.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:18:06.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : miss 2024-09-14T11:18:06.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:06.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:18:06.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:06.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:06.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:06.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:06.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:06.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.064+0000 7fcfe06409c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to be held by another RGW process; skipping for now 2024-09-14T11:18:06.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.068+0000 7fce957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:06.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.072+0000 7fcfe06409c0 20 remove_watcher() i=0 2024-09-14T11:18:06.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.072+0000 7fcfe06409c0 2 removed watcher, disabling cache 2024-09-14T11:18:06.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.072+0000 7fcfe06409c0 20 remove_watcher() i=1 2024-09-14T11:18:06.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.076+0000 7fcfe06409c0 20 remove_watcher() i=2 2024-09-14T11:18:06.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.076+0000 7fcfe06409c0 20 remove_watcher() i=3 2024-09-14T11:18:06.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.080+0000 7fcfe06409c0 20 remove_watcher() i=4 2024-09-14T11:18:06.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.080+0000 7fcfe06409c0 20 remove_watcher() i=5 2024-09-14T11:18:06.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.084+0000 7fcfe06409c0 20 remove_watcher() i=6 2024-09-14T11:18:06.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:06.084+0000 7fcfe06409c0 20 remove_watcher() i=7 2024-09-14T11:18:06.095 INFO:tasks.workunit.client.0.smithi148.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:18:36.123 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:18:36.160 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:36.160 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:36.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.208+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 realm 2024-09-14T11:18:36.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:36.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:36.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.212+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.216+0000 7f56bb3119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:36.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.216+0000 7f56bb3119c0 20 searching for the correct realm 2024-09-14T11:18:36.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.216+0000 7f56b8e17640 0 -- 172.21.15.148:0/872312813 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f56a8008050 msgr2=0x7f56a805ccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:36.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.428+0000 7f56b8e17640 0 -- 172.21.15.148:0/872312813 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55b62fadd880 msgr2=0x7f56b004b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:36.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:36.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:36.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:36.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:36.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:36.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:36.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:36.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:36.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 zone default found 2024-09-14T11:18:36.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 4 Realm: () 2024-09-14T11:18:36.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:36.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:36.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:36.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 zonegroup default 2024-09-14T11:18:36.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.648+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.652+0000 7f56bb3119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.652+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.652+0000 7f56bb3119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.652+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.652+0000 7f56bb3119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.652+0000 7f56bb3119c0 20 started sync module instance, tier type = 2024-09-14T11:18:36.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.652+0000 7f56bb3119c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:36.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.676+0000 7f56bb3119c0 20 add_watcher() i=0 2024-09-14T11:18:36.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.676+0000 7f56bb3119c0 20 add_watcher() i=1 2024-09-14T11:18:36.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.676+0000 7f56bb3119c0 20 add_watcher() i=2 2024-09-14T11:18:36.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.676+0000 7f56bb3119c0 20 add_watcher() i=3 2024-09-14T11:18:36.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.676+0000 7f56bb3119c0 20 add_watcher() i=4 2024-09-14T11:18:36.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.676+0000 7f56bb3119c0 20 add_watcher() i=5 2024-09-14T11:18:36.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.676+0000 7f56bb3119c0 20 add_watcher() i=6 2024-09-14T11:18:36.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.680+0000 7f56bb3119c0 20 add_watcher() i=7 2024-09-14T11:18:36.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.680+0000 7f56bb3119c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:36.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.684+0000 7f556efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:36.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.684+0000 7f56bb3119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:36.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.684+0000 7f56bb3119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:36.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.684+0000 7f56bb3119c0 5 note: GC not initialized 2024-09-14T11:18:36.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.684+0000 7f556dfe3640 20 reqs_thread_entry: start 2024-09-14T11:18:36.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.684+0000 7f56bb3119c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:36.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.684+0000 7f56bb3119c0 20 Filter name: none 2024-09-14T11:18:36.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f54df7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:36.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:18:36.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:36.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:18:36.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:18:36.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : miss 2024-09-14T11:18:36.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:18:36.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:36.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:36.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:36.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.688+0000 7f56bb3119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:36.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.692+0000 7f56bb3119c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:18:36.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.704+0000 7f56bb3119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:36.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.704+0000 7f56bb3119c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:36.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.704+0000 7f56bb3119c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.704+0000 7f56bb3119c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:36.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.704+0000 7f558ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94240974692688 notifier 7221 bl.length()=999 2024-09-14T11:18:36.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.704+0000 7f558ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:36.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.704+0000 7f558ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:36.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.704+0000 7f558ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.708+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:36.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.708+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:36.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.708+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:36.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.708+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.0 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.0 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.1 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.1 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.2 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.2 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.3 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.3 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.4 2024-09-14T11:18:36.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.4 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.5 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.5 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.6 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.6 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.7 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.7 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.8 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.8 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.9 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.9 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.10 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.10 2024-09-14T11:18:36.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.11 2024-09-14T11:18:36.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2.11 2024-09-14T11:18:36.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.0 2024-09-14T11:18:36.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1 2024-09-14T11:18:36.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2 2024-09-14T11:18:36.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.3 2024-09-14T11:18:36.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.720+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.4 2024-09-14T11:18:36.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.724+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.5 2024-09-14T11:18:36.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.724+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.6 2024-09-14T11:18:36.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.724+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.7 2024-09-14T11:18:36.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.724+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.8 2024-09-14T11:18:36.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.728+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.9 2024-09-14T11:18:36.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.728+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.10 2024-09-14T11:18:36.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.732+0000 7f56bb3119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:36.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.732+0000 7f56bb3119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:36.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.736+0000 7f56bb3119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:36.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.736+0000 7f56bb3119c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:36.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.736+0000 7f56bb3119c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.736+0000 7f56bb3119c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:36.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.736+0000 7f558f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366264 cookie 94240974692688 notifier 7221 bl.length()=999 2024-09-14T11:18:36.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.736+0000 7f558f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:36.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.736+0000 7f558f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:36.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.736+0000 7f558f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.740+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:36.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.740+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:36.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.740+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:36.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.740+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:36.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.744+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.0 2024-09-14T11:18:36.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.744+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.1 2024-09-14T11:18:36.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.744+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.2 2024-09-14T11:18:36.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.744+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.3 2024-09-14T11:18:36.742 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.748+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.4 2024-09-14T11:18:36.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.748+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.5 2024-09-14T11:18:36.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.748+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.6 2024-09-14T11:18:36.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.748+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.7 2024-09-14T11:18:36.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.748+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.8 2024-09-14T11:18:36.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.752+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.9 2024-09-14T11:18:36.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.752+0000 7f56bb3119c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30.10 2024-09-14T11:18:36.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.752+0000 7f56bb3119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:36.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.752+0000 7f56bb3119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 2024-09-14T11:18:36.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.752+0000 7f56bb3119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:36.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.752+0000 7f56bb3119c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:36.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.752+0000 7f56bb3119c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.752+0000 7f56bb3119c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30, ofs0, ns] 2024-09-14T11:18:36.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.756+0000 7f558ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366265 cookie 94240974692688 notifier 7221 bl.length()=967 2024-09-14T11:18:36.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.756+0000 7f558ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 info.flags=0x17 2024-09-14T11:18:36.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.756+0000 7f558ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 to cache LRU end 2024-09-14T11:18:36.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.756+0000 7f558ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.756+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_sources= new_sources= 2024-09-14T11:18:36.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.756+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential sources added=[] removed=[] 2024-09-14T11:18:36.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.756+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): orig_dests= new_dests= 2024-09-14T11:18:36.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.756+0000 7f56bb3119c0 20 handle_bi_update(): bucket=:abort-at-block-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30]): potential dests added=[] removed=[] 2024-09-14T11:18:36.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.764+0000 7f56bb3119c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:18:36.762 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.764+0000 7f556efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:36.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.772+0000 7f56bb3119c0 20 remove_watcher() i=0 2024-09-14T11:18:36.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.772+0000 7f56bb3119c0 2 removed watcher, disabling cache 2024-09-14T11:18:36.769 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.772+0000 7f56bb3119c0 20 remove_watcher() i=1 2024-09-14T11:18:36.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.776+0000 7f56bb3119c0 20 remove_watcher() i=2 2024-09-14T11:18:36.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.776+0000 7f56bb3119c0 20 remove_watcher() i=3 2024-09-14T11:18:36.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.780+0000 7f56bb3119c0 20 remove_watcher() i=4 2024-09-14T11:18:36.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.780+0000 7f56bb3119c0 20 remove_watcher() i=5 2024-09-14T11:18:36.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.784+0000 7f56bb3119c0 20 remove_watcher() i=6 2024-09-14T11:18:36.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.788+0000 7f56bb3119c0 20 remove_watcher() i=7 2024-09-14T11:18:36.804 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:18:36.836 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:36.836 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:36.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.884+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 realm 2024-09-14T11:18:36.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:36.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:36.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:36.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.888+0000 7f3d4ef219c0 20 searching for the correct realm 2024-09-14T11:18:36.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.896+0000 7f3d4d228640 0 -- 172.21.15.148:0/3328734856 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5560595a1c40 msgr2=0x5560595a4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:36.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.904+0000 7f3d4ca27640 0 -- 172.21.15.148:0/3328734856 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5560595a5dd0 msgr2=0x5560595a8290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:36.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.908+0000 7f3d4ef219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:36.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.908+0000 7f3d4ef219c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:36.906 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.908+0000 7f3d4ef219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.908+0000 7f3d4ef219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.908+0000 7f3d4ef219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.908+0000 7f3d4ef219c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.908+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:36.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:36.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 zone default found 2024-09-14T11:18:36.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 4 Realm: () 2024-09-14T11:18:36.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:36.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:36.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:36.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 zonegroup default 2024-09-14T11:18:36.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 started sync module instance, tier type = 2024-09-14T11:18:36.910 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.912+0000 7f3d4ef219c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:36.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.932+0000 7f3d4ef219c0 20 add_watcher() i=0 2024-09-14T11:18:36.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.932+0000 7f3d4ef219c0 20 add_watcher() i=1 2024-09-14T11:18:36.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.932+0000 7f3d4ef219c0 20 add_watcher() i=2 2024-09-14T11:18:36.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.932+0000 7f3d4ef219c0 20 add_watcher() i=3 2024-09-14T11:18:36.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.932+0000 7f3d4ef219c0 20 add_watcher() i=4 2024-09-14T11:18:36.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.932+0000 7f3d4ef219c0 20 add_watcher() i=5 2024-09-14T11:18:36.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.932+0000 7f3d4ef219c0 20 add_watcher() i=6 2024-09-14T11:18:36.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.936+0000 7f3d4ef219c0 20 add_watcher() i=7 2024-09-14T11:18:36.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.936+0000 7f3d4ef219c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:36.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3c02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:36.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:36.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:36.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 5 note: GC not initialized 2024-09-14T11:18:36.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3c01fe3640 20 reqs_thread_entry: start 2024-09-14T11:18:36.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:36.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 Filter name: none 2024-09-14T11:18:36.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3b737fe640 20 reqs_thread_entry: start 2024-09-14T11:18:36.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:36.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:36.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:36.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.940+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.944+0000 7f3d4ef219c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:18:36.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.944+0000 7f3d4ef219c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.944+0000 7f3d4ef219c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:18:36.938 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.944+0000 7f3d4ef219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:36.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.944+0000 7f3c02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:36.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.948+0000 7f3d4ef219c0 20 remove_watcher() i=0 2024-09-14T11:18:36.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.948+0000 7f3d4ef219c0 2 removed watcher, disabling cache 2024-09-14T11:18:36.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.952+0000 7f3d4ef219c0 20 remove_watcher() i=1 2024-09-14T11:18:36.952 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.952+0000 7f3d4ef219c0 20 remove_watcher() i=2 2024-09-14T11:18:36.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.956+0000 7f3d4ef219c0 20 remove_watcher() i=3 2024-09-14T11:18:36.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.956+0000 7f3d4ef219c0 20 remove_watcher() i=4 2024-09-14T11:18:36.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.960+0000 7f3d4ef219c0 20 remove_watcher() i=5 2024-09-14T11:18:36.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.960+0000 7f3d4ef219c0 20 remove_watcher() i=6 2024-09-14T11:18:36.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:36.964+0000 7f3d4ef219c0 20 remove_watcher() i=7 2024-09-14T11:18:36.975 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:36.975 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:36.975 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-block-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:18:36.975 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:36.976 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:36.976 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:37.000 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:37.001 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:37.576 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:37.577 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:37.953 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:18:37.953 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:37.957 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:37.958 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.095 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.095 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.186 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.187 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.294 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.294 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.396 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.396 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.705 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.705 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.809 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.810 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:38.910 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:38.911 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.010 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.010 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.108 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.109 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.209 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.209 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.311 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.311 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.411 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.411 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.517 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.517 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.617 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.618 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.723 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.723 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.819 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.819 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:39.916 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:39.916 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:40.017 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:40.017 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:40.122 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:40.122 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:40.222 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:18:40.255 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:40.256 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:40.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.303+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.303+0000 7f9bd06769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.303+0000 7f9bd06769c0 20 realm 2024-09-14T11:18:40.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.303+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:40.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:40.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:40.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.307+0000 7f9bd06769c0 20 searching for the correct realm 2024-09-14T11:18:40.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.315+0000 7f9bcd97b640 0 -- 172.21.15.148:0/1490324219 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x563425ba5560 msgr2=0x563425ba7950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:40.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.319+0000 7f9bce17c640 0 -- 172.21.15.148:0/1490324219 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f9bc8105cd0 msgr2=0x7f9bc81056a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:40.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:40.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:40.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:40.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:40.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:40.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:40.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:40.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:40.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 zone default found 2024-09-14T11:18:40.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 4 Realm: () 2024-09-14T11:18:40.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:40.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:40.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:40.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 zonegroup default 2024-09-14T11:18:40.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.327+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.331+0000 7f9bd06769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.331+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.331+0000 7f9bd06769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.331+0000 7f9bd06769c0 20 started sync module instance, tier type = 2024-09-14T11:18:40.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.331+0000 7f9bd06769c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:40.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 20 add_watcher() i=0 2024-09-14T11:18:40.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 20 add_watcher() i=1 2024-09-14T11:18:40.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 20 add_watcher() i=2 2024-09-14T11:18:40.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 20 add_watcher() i=3 2024-09-14T11:18:40.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 20 add_watcher() i=4 2024-09-14T11:18:40.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 20 add_watcher() i=5 2024-09-14T11:18:40.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 20 add_watcher() i=6 2024-09-14T11:18:40.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 20 add_watcher() i=7 2024-09-14T11:18:40.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.351+0000 7f9bd06769c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:40.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9a84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:40.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9bd06769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:40.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9bd06769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:40.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9bd06769c0 5 note: GC not initialized 2024-09-14T11:18:40.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f99ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:40.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9bd06769c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:40.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9bd06769c0 20 Filter name: none 2024-09-14T11:18:40.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f99fd7fa640 20 reqs_thread_entry: start 2024-09-14T11:18:40.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9bd06769c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:40.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.355+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.359+0000 7f9bd06769c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:40.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.359+0000 7f9bd06769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:40.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.359+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.359+0000 7f9bd06769c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:40.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.359+0000 7f9bd06769c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.359+0000 7f9bd06769c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:40.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.359+0000 7f9bd06769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:40.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.363+0000 7f9a84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:40.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.367+0000 7f9bd06769c0 20 remove_watcher() i=0 2024-09-14T11:18:40.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.367+0000 7f9bd06769c0 2 removed watcher, disabling cache 2024-09-14T11:18:40.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.367+0000 7f9bd06769c0 20 remove_watcher() i=1 2024-09-14T11:18:40.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.367+0000 7f9bd06769c0 20 remove_watcher() i=2 2024-09-14T11:18:40.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.371+0000 7f9bd06769c0 20 remove_watcher() i=3 2024-09-14T11:18:40.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.371+0000 7f9bd06769c0 20 remove_watcher() i=4 2024-09-14T11:18:40.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.375+0000 7f9bd06769c0 20 remove_watcher() i=5 2024-09-14T11:18:40.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.379+0000 7f9bd06769c0 20 remove_watcher() i=6 2024-09-14T11:18:40.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.379+0000 7f9bd06769c0 20 remove_watcher() i=7 2024-09-14T11:18:40.391 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:40.392 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:40.392 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-commit-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:40.392 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:40.392 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:18:40.424 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:40.424 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:40.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.471+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.471+0000 7f735cb719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.471+0000 7f735cb719c0 20 realm 2024-09-14T11:18:40.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.471+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:40.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:40.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:40.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.475+0000 7f735cb719c0 20 searching for the correct realm 2024-09-14T11:18:40.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.483+0000 7f7353fff640 0 -- 172.21.15.148:0/4229980395 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55d9c730b7c0 msgr2=0x55d9c730dbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:40.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.487+0000 7f735a677640 0 -- 172.21.15.148:0/4229980395 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f73540de950 msgr2=0x7f73540bc3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:40.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:40.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:40.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 zone default found 2024-09-14T11:18:40.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 4 Realm: () 2024-09-14T11:18:40.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:40.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:40.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:40.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 zonegroup default 2024-09-14T11:18:40.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.495+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.499+0000 7f735cb719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.499+0000 7f735cb719c0 20 started sync module instance, tier type = 2024-09-14T11:18:40.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.499+0000 7f735cb719c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:40.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.515+0000 7f735cb719c0 20 add_watcher() i=0 2024-09-14T11:18:40.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.515+0000 7f735cb719c0 20 add_watcher() i=1 2024-09-14T11:18:40.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.515+0000 7f735cb719c0 20 add_watcher() i=2 2024-09-14T11:18:40.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.515+0000 7f735cb719c0 20 add_watcher() i=3 2024-09-14T11:18:40.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.515+0000 7f735cb719c0 20 add_watcher() i=4 2024-09-14T11:18:40.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.515+0000 7f735cb719c0 20 add_watcher() i=5 2024-09-14T11:18:40.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.515+0000 7f735cb719c0 20 add_watcher() i=6 2024-09-14T11:18:40.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.519+0000 7f735cb719c0 20 add_watcher() i=7 2024-09-14T11:18:40.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.519+0000 7f735cb719c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:40.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f7210fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:40.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:40.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:40.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 5 note: GC not initialized 2024-09-14T11:18:40.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f718b7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:40.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:40.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 20 Filter name: none 2024-09-14T11:18:40.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f71897fa640 20 reqs_thread_entry: start 2024-09-14T11:18:40.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:18:40.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 : miss 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:40.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.523+0000 7f735cb719c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 2024-09-14T11:18:40.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f735cb719c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:40.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f735cb719c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:40.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f735cb719c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:40.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f735cb719c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31, ofs0, ns] 2024-09-14T11:18:40.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f723dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94393838157264 notifier 7272 bl.length()=1015 2024-09-14T11:18:40.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f723dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:40.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f723dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:40.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f723dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:40.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f735cb719c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_sources= new_sources= 2024-09-14T11:18:40.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f735cb719c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential sources added=[] removed=[] 2024-09-14T11:18:40.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f735cb719c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_dests= new_dests= 2024-09-14T11:18:40.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.535+0000 7f735cb719c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential dests added=[] removed=[] 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.0 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.0 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.1 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.1 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.2 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.2 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.3 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.3 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.4 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.4 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.5 2024-09-14T11:18:40.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.5 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.6 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.6 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.7 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.7 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.8 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.8 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.9 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.9 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.10 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.10 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.11 2024-09-14T11:18:40.544 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1.11 2024-09-14T11:18:40.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.0 2024-09-14T11:18:40.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1 2024-09-14T11:18:40.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2 2024-09-14T11:18:40.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.547+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.3 2024-09-14T11:18:40.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.551+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.4 2024-09-14T11:18:40.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.551+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.5 2024-09-14T11:18:40.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.551+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.6 2024-09-14T11:18:40.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.551+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.7 2024-09-14T11:18:40.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.551+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.8 2024-09-14T11:18:40.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.555+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.9 2024-09-14T11:18:40.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.555+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.10 2024-09-14T11:18:40.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.559+0000 7f735cb719c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:40.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.559+0000 7f735cb719c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 2024-09-14T11:18:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f735cb719c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f735cb719c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f735cb719c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f735cb719c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31, ofs0, ns] 2024-09-14T11:18:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f723dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94393838157264 notifier 7272 bl.length()=1015 2024-09-14T11:18:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f723dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f723dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:40.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f723dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f735cb719c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_sources= new_sources= 2024-09-14T11:18:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f735cb719c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential sources added=[] removed=[] 2024-09-14T11:18:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f735cb719c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_dests= new_dests= 2024-09-14T11:18:40.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.563+0000 7f735cb719c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential dests added=[] removed=[] 2024-09-14T11:18:40.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.571+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.0 2024-09-14T11:18:40.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.571+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1 2024-09-14T11:18:40.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.571+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2 2024-09-14T11:18:40.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.571+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.3 2024-09-14T11:18:40.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.571+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.4 2024-09-14T11:18:40.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.571+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.5 2024-09-14T11:18:40.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.571+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.6 2024-09-14T11:18:40.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.575+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.7 2024-09-14T11:18:40.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.575+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.8 2024-09-14T11:18:40.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.575+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.9 2024-09-14T11:18:40.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.575+0000 7f735cb719c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.10 2024-09-14T11:18:40.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.575+0000 7f735cb719c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:18:40.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.575+0000 7f735cb719c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:18:40.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.583+0000 7f7210fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:40.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.587+0000 7f735cb719c0 20 remove_watcher() i=0 2024-09-14T11:18:40.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.587+0000 7f735cb719c0 2 removed watcher, disabling cache 2024-09-14T11:18:40.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.591+0000 7f735cb719c0 20 remove_watcher() i=1 2024-09-14T11:18:40.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.591+0000 7f735cb719c0 20 remove_watcher() i=2 2024-09-14T11:18:40.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.595+0000 7f735cb719c0 20 remove_watcher() i=3 2024-09-14T11:18:40.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.595+0000 7f735cb719c0 20 remove_watcher() i=4 2024-09-14T11:18:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.595+0000 7f735cb719c0 20 remove_watcher() i=5 2024-09-14T11:18:40.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.599+0000 7f735cb719c0 20 remove_watcher() i=6 2024-09-14T11:18:40.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.603+0000 7f735cb719c0 20 remove_watcher() i=7 2024-09-14T11:18:40.613 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:18:40.640 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:40.640 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:40.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.687+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.687+0000 7f72a3fc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.687+0000 7f72a3fc19c0 20 realm 2024-09-14T11:18:40.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.687+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:40.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:40.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:40.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.691+0000 7f72a3fc19c0 20 searching for the correct realm 2024-09-14T11:18:40.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.699+0000 7f729bfff640 0 -- 172.21.15.148:0/2947294766 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55e598cc9e10 msgr2=0x55e598ccc200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:40.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.703+0000 7f72a1ac7640 0 -- 172.21.15.148:0/2947294766 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f729c038770 msgr2=0x7f729c0962d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:40.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:40.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:40.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:40.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:40.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:40.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:40.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:40.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.711+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:40.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 zone default found 2024-09-14T11:18:40.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 4 Realm: () 2024-09-14T11:18:40.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:40.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:40.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:40.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 zonegroup default 2024-09-14T11:18:40.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 started sync module instance, tier type = 2024-09-14T11:18:40.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.715+0000 7f72a3fc19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:40.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.731+0000 7f72a3fc19c0 20 add_watcher() i=0 2024-09-14T11:18:40.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.731+0000 7f72a3fc19c0 20 add_watcher() i=1 2024-09-14T11:18:40.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.731+0000 7f72a3fc19c0 20 add_watcher() i=2 2024-09-14T11:18:40.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.731+0000 7f72a3fc19c0 20 add_watcher() i=3 2024-09-14T11:18:40.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.731+0000 7f72a3fc19c0 20 add_watcher() i=4 2024-09-14T11:18:40.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.731+0000 7f72a3fc19c0 20 add_watcher() i=5 2024-09-14T11:18:40.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.731+0000 7f72a3fc19c0 20 add_watcher() i=6 2024-09-14T11:18:40.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.735+0000 7f72a3fc19c0 20 add_watcher() i=7 2024-09-14T11:18:40.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.735+0000 7f72a3fc19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:40.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f71537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:40.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:40.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:40.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 5 note: GC not initialized 2024-09-14T11:18:40.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f71527fc640 20 reqs_thread_entry: start 2024-09-14T11:18:40.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:40.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 Filter name: none 2024-09-14T11:18:40.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f70c3fff640 20 reqs_thread_entry: start 2024-09-14T11:18:40.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:40.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:18:40.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:40.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.739+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.743+0000 7f72a3fc19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:40.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.743+0000 7f72a3fc19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.743+0000 7f72a3fc19c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:18:40.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.743+0000 7f72a3fc19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:40.741 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.743+0000 7f71537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:40.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.747+0000 7f72a3fc19c0 20 remove_watcher() i=0 2024-09-14T11:18:40.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.747+0000 7f72a3fc19c0 2 removed watcher, disabling cache 2024-09-14T11:18:40.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.751+0000 7f72a3fc19c0 20 remove_watcher() i=1 2024-09-14T11:18:40.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.751+0000 7f72a3fc19c0 20 remove_watcher() i=2 2024-09-14T11:18:40.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.755+0000 7f72a3fc19c0 20 remove_watcher() i=3 2024-09-14T11:18:40.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.755+0000 7f72a3fc19c0 20 remove_watcher() i=4 2024-09-14T11:18:40.755 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.759+0000 7f72a3fc19c0 20 remove_watcher() i=5 2024-09-14T11:18:40.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.763+0000 7f72a3fc19c0 20 remove_watcher() i=6 2024-09-14T11:18:40.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.763+0000 7f72a3fc19c0 20 remove_watcher() i=7 2024-09-14T11:18:40.774 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-commit-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:40.774 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:40.775 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:40.775 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:40.817 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:40.817 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:40.876 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:18:40.910 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:40.911 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:40.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.955+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 realm 2024-09-14T11:18:40.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:40.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:40.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:40.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:40.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:40.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.959+0000 7f3c603b39c0 20 searching for the correct realm 2024-09-14T11:18:40.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:40.963+0000 7f3c5deb9640 0 -- 172.21.15.148:0/2012109679 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f3c500d03f0 msgr2=0x7f3c500d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:41.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.175+0000 7f3c5deb9640 0 -- 172.21.15.148:0/2012109679 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55c4881b6f40 msgr2=0x7f3c580663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:41.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:41.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:41.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:41.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:41.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:41.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:41.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:41.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:41.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 zone default found 2024-09-14T11:18:41.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 4 Realm: () 2024-09-14T11:18:41.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:41.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:41.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:41.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 zonegroup default 2024-09-14T11:18:41.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.395+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.399+0000 7f3c603b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.399+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.399+0000 7f3c603b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.399+0000 7f3c603b39c0 20 started sync module instance, tier type = 2024-09-14T11:18:41.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.399+0000 7f3c603b39c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:41.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 20 add_watcher() i=0 2024-09-14T11:18:41.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 20 add_watcher() i=1 2024-09-14T11:18:41.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 20 add_watcher() i=2 2024-09-14T11:18:41.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 20 add_watcher() i=3 2024-09-14T11:18:41.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 20 add_watcher() i=4 2024-09-14T11:18:41.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 20 add_watcher() i=5 2024-09-14T11:18:41.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 20 add_watcher() i=6 2024-09-14T11:18:41.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 20 add_watcher() i=7 2024-09-14T11:18:41.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.423+0000 7f3c603b39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:41.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3b0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:41.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:41.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:41.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 5 note: GC not initialized 2024-09-14T11:18:41.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3b0e7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:41.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:41.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 20 Filter name: none 2024-09-14T11:18:41.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3a7ffff640 20 reqs_thread_entry: start 2024-09-14T11:18:41.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:18:41.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:41.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:18:41.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:18:41.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 : miss 2024-09-14T11:18:41.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.431+0000 7f3c603b39c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:18:41.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.435+0000 7f3c603b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:41.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.435+0000 7f3c603b39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:41.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.435+0000 7f3c603b39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:41.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.435+0000 7f3c603b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:41.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.435+0000 7f3c603b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 2024-09-14T11:18:41.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.435+0000 7f3c603b39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:18:41.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.447+0000 7f3c603b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:41.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.447+0000 7f3c603b39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:41.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.447+0000 7f3c603b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:41.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.447+0000 7f3c603b39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31, ofs0, ns] 2024-09-14T11:18:41.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.447+0000 7f3b40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94302587809088 notifier 6869 bl.length()=1015 2024-09-14T11:18:41.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.447+0000 7f3b40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:41.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.447+0000 7f3b40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:41.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.447+0000 7f3b40ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:41.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.451+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_sources= new_sources= 2024-09-14T11:18:41.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.451+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential sources added=[] removed=[] 2024-09-14T11:18:41.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.451+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_dests= new_dests= 2024-09-14T11:18:41.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.451+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential dests added=[] removed=[] 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.0 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.0 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.1 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.1 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.2 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.2 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.3 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.3 2024-09-14T11:18:41.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.4 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.4 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.5 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.5 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.6 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.6 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.7 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.7 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.8 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.8 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.9 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.9 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.10 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.10 2024-09-14T11:18:41.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.11 2024-09-14T11:18:41.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2.11 2024-09-14T11:18:41.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.459+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.0 2024-09-14T11:18:41.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.463+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1 2024-09-14T11:18:41.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.463+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2 2024-09-14T11:18:41.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.463+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.3 2024-09-14T11:18:41.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.463+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.4 2024-09-14T11:18:41.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.467+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.5 2024-09-14T11:18:41.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.467+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.6 2024-09-14T11:18:41.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.467+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.7 2024-09-14T11:18:41.466 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.471+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.8 2024-09-14T11:18:41.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.471+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.9 2024-09-14T11:18:41.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.471+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.10 2024-09-14T11:18:41.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.475+0000 7f3c603b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:41.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.475+0000 7f3c603b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 2024-09-14T11:18:41.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.479+0000 7f3c603b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:41.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.479+0000 7f3c603b39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:41.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.479+0000 7f3c603b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:41.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.479+0000 7f3c603b39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31, ofs0, ns] 2024-09-14T11:18:41.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.479+0000 7f3b40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94302587809088 notifier 6869 bl.length()=1015 2024-09-14T11:18:41.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.479+0000 7f3b40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:41.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.479+0000 7f3b40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:41.478 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.479+0000 7f3b40ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:41.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.483+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_sources= new_sources= 2024-09-14T11:18:41.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.483+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential sources added=[] removed=[] 2024-09-14T11:18:41.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.483+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_dests= new_dests= 2024-09-14T11:18:41.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.483+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential dests added=[] removed=[] 2024-09-14T11:18:41.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.491+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.0 2024-09-14T11:18:41.487 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.491+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.1 2024-09-14T11:18:41.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.491+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.2 2024-09-14T11:18:41.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.491+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.3 2024-09-14T11:18:41.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.491+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.4 2024-09-14T11:18:41.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.491+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.5 2024-09-14T11:18:41.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.495+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.6 2024-09-14T11:18:41.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.495+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.7 2024-09-14T11:18:41.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.495+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.8 2024-09-14T11:18:41.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.495+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.9 2024-09-14T11:18:41.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.495+0000 7f3c603b39c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31.10 2024-09-14T11:18:41.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.495+0000 7f3c603b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:41.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.495+0000 7f3c603b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 2024-09-14T11:18:41.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.499+0000 7f3c603b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:41.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.499+0000 7f3c603b39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:41.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.499+0000 7f3c603b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:41.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.499+0000 7f3c603b39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31, ofs0, ns] 2024-09-14T11:18:41.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.499+0000 7f3b417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94302587809088 notifier 6869 bl.length()=983 2024-09-14T11:18:41.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.499+0000 7f3b417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 info.flags=0x17 2024-09-14T11:18:41.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.499+0000 7f3b417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 to cache LRU end 2024-09-14T11:18:41.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.499+0000 7f3b417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:41.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.503+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_sources= new_sources= 2024-09-14T11:18:41.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.503+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential sources added=[] removed=[] 2024-09-14T11:18:41.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.503+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): orig_dests= new_dests= 2024-09-14T11:18:41.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.503+0000 7f3c603b39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31]): potential dests added=[] removed=[] 2024-09-14T11:18:41.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.507+0000 7f3c603b39c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:18:41.507 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.511+0000 7f3b0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:41.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.515+0000 7f3c603b39c0 20 remove_watcher() i=0 2024-09-14T11:18:41.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.515+0000 7f3c603b39c0 2 removed watcher, disabling cache 2024-09-14T11:18:41.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.515+0000 7f3c603b39c0 20 remove_watcher() i=1 2024-09-14T11:18:41.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.519+0000 7f3c603b39c0 20 remove_watcher() i=2 2024-09-14T11:18:41.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.523+0000 7f3c603b39c0 20 remove_watcher() i=3 2024-09-14T11:18:41.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.523+0000 7f3c603b39c0 20 remove_watcher() i=4 2024-09-14T11:18:41.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.527+0000 7f3c603b39c0 20 remove_watcher() i=5 2024-09-14T11:18:41.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.527+0000 7f3c603b39c0 20 remove_watcher() i=6 2024-09-14T11:18:41.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.531+0000 7f3c603b39c0 20 remove_watcher() i=7 2024-09-14T11:18:41.543 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:18:41.572 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:41.572 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:41.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.619+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.619+0000 7f43414909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.619+0000 7f43414909c0 20 realm 2024-09-14T11:18:41.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.619+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.619+0000 7f43414909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.619+0000 7f43414909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:41.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.619+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.623+0000 7f43414909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.623+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.623+0000 7f43414909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:41.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.623+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.623+0000 7f43414909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:41.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.623+0000 7f43414909c0 20 searching for the correct realm 2024-09-14T11:18:41.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.631+0000 7f433ef96640 0 -- 172.21.15.148:0/822503681 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f432804a030 msgr2=0x7f4328070a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:41.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.635+0000 7f433ef96640 0 -- 172.21.15.148:0/822503681 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f43380d8920 msgr2=0x7f43380e6400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:41.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:41.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:41.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:41.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:41.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:41.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:41.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:41.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:41.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 zone default found 2024-09-14T11:18:41.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 4 Realm: () 2024-09-14T11:18:41.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:41.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:41.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:41.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 zonegroup default 2024-09-14T11:18:41.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:41.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 started sync module instance, tier type = 2024-09-14T11:18:41.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.643+0000 7f43414909c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:41.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.663+0000 7f43414909c0 20 add_watcher() i=0 2024-09-14T11:18:41.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.663+0000 7f43414909c0 20 add_watcher() i=1 2024-09-14T11:18:41.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.663+0000 7f43414909c0 20 add_watcher() i=2 2024-09-14T11:18:41.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.663+0000 7f43414909c0 20 add_watcher() i=3 2024-09-14T11:18:41.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.663+0000 7f43414909c0 20 add_watcher() i=4 2024-09-14T11:18:41.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.663+0000 7f43414909c0 20 add_watcher() i=5 2024-09-14T11:18:41.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.663+0000 7f43414909c0 20 add_watcher() i=6 2024-09-14T11:18:41.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.667+0000 7f43414909c0 20 add_watcher() i=7 2024-09-14T11:18:41.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.667+0000 7f43414909c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:41.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f41f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:41.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:41.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:41.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 5 note: GC not initialized 2024-09-14T11:18:41.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f416ffff640 20 reqs_thread_entry: start 2024-09-14T11:18:41.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:41.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 Filter name: none 2024-09-14T11:18:41.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f416dffb640 20 reqs_thread_entry: start 2024-09-14T11:18:41.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:41.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:41.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:41.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:41.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.671+0000 7f43414909c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:41.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.675+0000 7f43414909c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:41.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.675+0000 7f43414909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:41.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.675+0000 7f41f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:41.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.679+0000 7f43414909c0 20 remove_watcher() i=0 2024-09-14T11:18:41.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.679+0000 7f43414909c0 2 removed watcher, disabling cache 2024-09-14T11:18:41.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.683+0000 7f43414909c0 20 remove_watcher() i=1 2024-09-14T11:18:41.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.683+0000 7f43414909c0 20 remove_watcher() i=2 2024-09-14T11:18:41.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.687+0000 7f43414909c0 20 remove_watcher() i=3 2024-09-14T11:18:41.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.687+0000 7f43414909c0 20 remove_watcher() i=4 2024-09-14T11:18:41.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.691+0000 7f43414909c0 20 remove_watcher() i=5 2024-09-14T11:18:41.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.695+0000 7f43414909c0 20 remove_watcher() i=6 2024-09-14T11:18:41.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:41.695+0000 7f43414909c0 20 remove_watcher() i=7 2024-09-14T11:18:41.706 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:41.706 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:41.706 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-commit-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:18:41.706 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:41.708 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:41.708 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:41.727 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:41.727 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:42.285 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:42.285 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:42.657 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:18:42.657 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:42.659 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:42.659 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:42.803 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:42.803 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:42.889 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:42.890 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:42.985 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:42.985 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.084 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.084 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.189 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.189 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.291 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.291 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.404 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.404 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.504 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.505 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.606 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.606 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.706 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.706 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.801 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.801 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:43.905 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:43.905 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.005 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.006 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.106 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.106 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.211 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.211 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.311 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.311 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.411 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.411 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.517 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.517 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.615 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.615 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.706 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.706 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.805 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:44.806 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:44.911 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:18:44.944 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:44.944 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:44.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.991+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:44.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:44.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 realm 2024-09-14T11:18:44.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:44.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:44.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:44.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:44.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:44.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:44.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:44.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:44.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:44.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:44.995+0000 7ff2f60709c0 20 searching for the correct realm 2024-09-14T11:18:45.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.003+0000 7ff2f3375640 0 -- 172.21.15.148:0/3235829992 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55b8893c0af0 msgr2=0x55b8893c64b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:45.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.007+0000 7ff2f3b76640 0 -- 172.21.15.148:0/3235829992 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7ff2e403d450 msgr2=0x7ff2e403d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:45.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:45.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:45.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:45.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:45.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:45.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:45.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.015+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:45.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:45.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 zone default found 2024-09-14T11:18:45.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 4 Realm: () 2024-09-14T11:18:45.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:45.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:45.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:45.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 zonegroup default 2024-09-14T11:18:45.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 started sync module instance, tier type = 2024-09-14T11:18:45.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.019+0000 7ff2f60709c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:45.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.039+0000 7ff2f60709c0 20 add_watcher() i=0 2024-09-14T11:18:45.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.039+0000 7ff2f60709c0 20 add_watcher() i=1 2024-09-14T11:18:45.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.039+0000 7ff2f60709c0 20 add_watcher() i=2 2024-09-14T11:18:45.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.039+0000 7ff2f60709c0 20 add_watcher() i=3 2024-09-14T11:18:45.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.039+0000 7ff2f60709c0 20 add_watcher() i=4 2024-09-14T11:18:45.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.039+0000 7ff2f60709c0 20 add_watcher() i=5 2024-09-14T11:18:45.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.039+0000 7ff2f60709c0 20 add_watcher() i=6 2024-09-14T11:18:45.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.043+0000 7ff2f60709c0 20 add_watcher() i=7 2024-09-14T11:18:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.043+0000 7ff2f60709c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:45.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff1a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:45.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 5 note: GC not initialized 2024-09-14T11:18:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff1a8fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 Filter name: none 2024-09-14T11:18:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff1227fc640 20 reqs_thread_entry: start 2024-09-14T11:18:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:45.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:45.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:45.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.045 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:45.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:45.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.047+0000 7ff2f60709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:45.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.051+0000 7ff1a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.055+0000 7ff2f60709c0 20 remove_watcher() i=0 2024-09-14T11:18:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.055+0000 7ff2f60709c0 2 removed watcher, disabling cache 2024-09-14T11:18:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.059+0000 7ff2f60709c0 20 remove_watcher() i=1 2024-09-14T11:18:45.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.059+0000 7ff2f60709c0 20 remove_watcher() i=2 2024-09-14T11:18:45.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.063+0000 7ff2f60709c0 20 remove_watcher() i=3 2024-09-14T11:18:45.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.063+0000 7ff2f60709c0 20 remove_watcher() i=4 2024-09-14T11:18:45.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.067+0000 7ff2f60709c0 20 remove_watcher() i=5 2024-09-14T11:18:45.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.067+0000 7ff2f60709c0 20 remove_watcher() i=6 2024-09-14T11:18:45.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.071+0000 7ff2f60709c0 20 remove_watcher() i=7 2024-09-14T11:18:45.082 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-commit-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:45.083 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:18:45.118 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:45.118 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.163+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 realm 2024-09-14T11:18:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:45.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.167+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.171+0000 7f8af82589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:45.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.171+0000 7f8af82589c0 20 searching for the correct realm 2024-09-14T11:18:45.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.179+0000 7f8af555d640 0 -- 172.21.15.148:0/369629161 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x556cfc6ceff0 msgr2=0x556cfc6d1460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:45.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.183+0000 7f8af655f640 0 -- 172.21.15.148:0/369629161 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x556cfc6db790 msgr2=0x556cfc6ddc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:45.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.187+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 zone default found 2024-09-14T11:18:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 4 Realm: () 2024-09-14T11:18:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 zonegroup default 2024-09-14T11:18:45.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 started sync module instance, tier type = 2024-09-14T11:18:45.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.191+0000 7f8af82589c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:45.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.207+0000 7f8af82589c0 20 add_watcher() i=0 2024-09-14T11:18:45.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.207+0000 7f8af82589c0 20 add_watcher() i=1 2024-09-14T11:18:45.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.207+0000 7f8af82589c0 20 add_watcher() i=2 2024-09-14T11:18:45.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.207+0000 7f8af82589c0 20 add_watcher() i=3 2024-09-14T11:18:45.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.207+0000 7f8af82589c0 20 add_watcher() i=4 2024-09-14T11:18:45.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.207+0000 7f8af82589c0 20 add_watcher() i=5 2024-09-14T11:18:45.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.207+0000 7f8af82589c0 20 add_watcher() i=6 2024-09-14T11:18:45.208 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.211+0000 7f8af82589c0 20 add_watcher() i=7 2024-09-14T11:18:45.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.211+0000 7f8af82589c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:45.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f89a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 5 note: GC not initialized 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f89a67fc640 20 reqs_thread_entry: start 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 20 Filter name: none 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8917fff640 20 reqs_thread_entry: start 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:18:45.213 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:45.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:18:45.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:18:45.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 : miss 2024-09-14T11:18:45.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.215+0000 7f8af82589c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.219+0000 7f8af82589c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:45.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.219+0000 7f8af82589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 info.flags=0x17 2024-09-14T11:18:45.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.219+0000 7f8af82589c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 to cache LRU end 2024-09-14T11:18:45.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.219+0000 7f8af82589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:45.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.219+0000 7f8af82589c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:45.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.219+0000 7f8af82589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 2024-09-14T11:18:45.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.227+0000 7f8af82589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 info.flags=0x17 2024-09-14T11:18:45.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.227+0000 7f8af82589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 to cache LRU end 2024-09-14T11:18:45.224 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.227+0000 7f8af82589c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:45.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.227+0000 7f8af82589c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32, ofs0, ns] 2024-09-14T11:18:45.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.227+0000 7f89d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 93926579832384 notifier 7356 bl.length()=1015 2024-09-14T11:18:45.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.227+0000 7f89d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 info.flags=0x17 2024-09-14T11:18:45.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.227+0000 7f89d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 to cache LRU end 2024-09-14T11:18:45.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.227+0000 7f89d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.231+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): orig_sources= new_sources= 2024-09-14T11:18:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.231+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): potential sources added=[] removed=[] 2024-09-14T11:18:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.231+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): orig_dests= new_dests= 2024-09-14T11:18:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.231+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): potential dests added=[] removed=[] 2024-09-14T11:18:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.0 2024-09-14T11:18:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.0 2024-09-14T11:18:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.1 2024-09-14T11:18:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.1 2024-09-14T11:18:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.2 2024-09-14T11:18:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.2 2024-09-14T11:18:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.3 2024-09-14T11:18:45.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.3 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.4 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.4 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.5 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.5 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.6 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.6 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.7 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.7 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.8 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.8 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.9 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.9 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.10 2024-09-14T11:18:45.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.10 2024-09-14T11:18:45.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.11 2024-09-14T11:18:45.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1.11 2024-09-14T11:18:45.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.0 2024-09-14T11:18:45.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1 2024-09-14T11:18:45.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.2 2024-09-14T11:18:45.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.243+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.3 2024-09-14T11:18:45.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.247+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.4 2024-09-14T11:18:45.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.247+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.5 2024-09-14T11:18:45.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.247+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.6 2024-09-14T11:18:45.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.251+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.7 2024-09-14T11:18:45.246 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.251+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.8 2024-09-14T11:18:45.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.251+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.9 2024-09-14T11:18:45.248 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.251+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.10 2024-09-14T11:18:45.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.259+0000 7f8af82589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:45.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.259+0000 7f8af82589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 2024-09-14T11:18:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.259+0000 7f8af82589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 info.flags=0x17 2024-09-14T11:18:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.259+0000 7f8af82589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 to cache LRU end 2024-09-14T11:18:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.259+0000 7f8af82589c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.259+0000 7f8af82589c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32, ofs0, ns] 2024-09-14T11:18:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.263+0000 7f89d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 93926579832384 notifier 7356 bl.length()=1015 2024-09-14T11:18:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.263+0000 7f89d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 info.flags=0x17 2024-09-14T11:18:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.263+0000 7f89d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 to cache LRU end 2024-09-14T11:18:45.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.263+0000 7f89d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:45.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.263+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): orig_sources= new_sources= 2024-09-14T11:18:45.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.263+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): potential sources added=[] removed=[] 2024-09-14T11:18:45.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.263+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): orig_dests= new_dests= 2024-09-14T11:18:45.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.263+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): potential dests added=[] removed=[] 2024-09-14T11:18:45.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.267+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.0 2024-09-14T11:18:45.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.271+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.1 2024-09-14T11:18:45.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.271+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.2 2024-09-14T11:18:45.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.271+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.3 2024-09-14T11:18:45.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.271+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.4 2024-09-14T11:18:45.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.271+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.5 2024-09-14T11:18:45.270 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.275+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.6 2024-09-14T11:18:45.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.275+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.7 2024-09-14T11:18:45.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.275+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.8 2024-09-14T11:18:45.272 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.275+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.9 2024-09-14T11:18:45.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.275+0000 7f8af82589c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32.10 2024-09-14T11:18:45.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f8af82589c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:18:45.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f8af82589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:45.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f8af82589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 2024-09-14T11:18:45.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f8af82589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 info.flags=0x17 2024-09-14T11:18:45.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f8af82589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 to cache LRU end 2024-09-14T11:18:45.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f8af82589c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:45.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f8af82589c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32, ofs0, ns] 2024-09-14T11:18:45.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f89d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 93926579832384 notifier 7356 bl.length()=983 2024-09-14T11:18:45.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f89d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 info.flags=0x17 2024-09-14T11:18:45.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f89d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 to cache LRU end 2024-09-14T11:18:45.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.279+0000 7f89d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:45.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.283+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): orig_sources= new_sources= 2024-09-14T11:18:45.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.283+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): potential sources added=[] removed=[] 2024-09-14T11:18:45.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.283+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): orig_dests= new_dests= 2024-09-14T11:18:45.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.283+0000 7f8af82589c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32]): potential dests added=[] removed=[] 2024-09-14T11:18:45.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.287+0000 7f8af82589c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:18:45.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.291+0000 7f89a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:45.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.295+0000 7f8af82589c0 20 remove_watcher() i=0 2024-09-14T11:18:45.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.295+0000 7f8af82589c0 2 removed watcher, disabling cache 2024-09-14T11:18:45.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.299+0000 7f8af82589c0 20 remove_watcher() i=1 2024-09-14T11:18:45.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.299+0000 7f8af82589c0 20 remove_watcher() i=2 2024-09-14T11:18:45.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.303+0000 7f8af82589c0 20 remove_watcher() i=3 2024-09-14T11:18:45.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.303+0000 7f8af82589c0 20 remove_watcher() i=4 2024-09-14T11:18:45.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.307+0000 7f8af82589c0 20 remove_watcher() i=5 2024-09-14T11:18:45.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.311+0000 7f8af82589c0 20 remove_watcher() i=6 2024-09-14T11:18:45.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.311+0000 7f8af82589c0 20 remove_watcher() i=7 2024-09-14T11:18:45.325 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:18:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:45.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.399+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 realm 2024-09-14T11:18:45.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:45.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:45.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.403+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.407+0000 7f78af8c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:45.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.407+0000 7f78af8c19c0 20 searching for the correct realm 2024-09-14T11:18:45.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.411+0000 7f78ad3c7640 0 -- 172.21.15.148:0/4247337235 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f78a8134040 msgr2=0x7f78a8113410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:45.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.419+0000 7f78ad3c7640 0 -- 172.21.15.148:0/4247337235 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f78a0039040 msgr2=0x7f78a0039930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:45.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:45.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:45.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:45.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:45.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:45.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:45.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.423+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:45.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:45.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 zone default found 2024-09-14T11:18:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 4 Realm: () 2024-09-14T11:18:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 zonegroup default 2024-09-14T11:18:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:45.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 started sync module instance, tier type = 2024-09-14T11:18:45.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.427+0000 7f78af8c19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 20 add_watcher() i=0 2024-09-14T11:18:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 20 add_watcher() i=1 2024-09-14T11:18:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 20 add_watcher() i=2 2024-09-14T11:18:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 20 add_watcher() i=3 2024-09-14T11:18:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 20 add_watcher() i=4 2024-09-14T11:18:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 20 add_watcher() i=5 2024-09-14T11:18:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 20 add_watcher() i=6 2024-09-14T11:18:45.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 20 add_watcher() i=7 2024-09-14T11:18:45.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.447+0000 7f78af8c19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:45.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f77637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:45.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f78af8c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:45.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f78af8c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:45.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f78af8c19c0 5 note: GC not initialized 2024-09-14T11:18:45.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f77627e4640 20 reqs_thread_entry: start 2024-09-14T11:18:45.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f78af8c19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:45.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f78af8c19c0 20 Filter name: none 2024-09-14T11:18:45.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f76d3fff640 20 reqs_thread_entry: start 2024-09-14T11:18:45.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.451+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:45.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:45.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:45.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:45.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:45.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:45.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.455+0000 7f78af8c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:45.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.459+0000 7f77637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:45.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.463+0000 7f78af8c19c0 20 remove_watcher() i=0 2024-09-14T11:18:45.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.463+0000 7f78af8c19c0 2 removed watcher, disabling cache 2024-09-14T11:18:45.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.463+0000 7f78af8c19c0 20 remove_watcher() i=1 2024-09-14T11:18:45.462 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.463+0000 7f78af8c19c0 20 remove_watcher() i=2 2024-09-14T11:18:45.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.467+0000 7f78af8c19c0 20 remove_watcher() i=3 2024-09-14T11:18:45.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.471+0000 7f78af8c19c0 20 remove_watcher() i=4 2024-09-14T11:18:45.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.471+0000 7f78af8c19c0 20 remove_watcher() i=5 2024-09-14T11:18:45.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.475+0000 7f78af8c19c0 20 remove_watcher() i=6 2024-09-14T11:18:45.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:45.479+0000 7f78af8c19c0 20 remove_watcher() i=7 2024-09-14T11:18:45.488 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:45.488 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:45.488 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-commit-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:18:45.488 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:45.489 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:45.489 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:45.515 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:45.515 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:46.102 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:46.102 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:46.494 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:18:46.495 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:46.498 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:46.498 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:46.639 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:46.639 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:46.735 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:46.735 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:46.836 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:46.836 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:46.936 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:46.936 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.043 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.043 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.143 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.144 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.247 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.247 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.349 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.349 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.454 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.455 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.559 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.559 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.666 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.667 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.771 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.772 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.871 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.871 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:48.067 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:48.067 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:48.171 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:48.171 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:48.275 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:48.275 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:48.378 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:48.378 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:48.481 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:48.481 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:48.579 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:48.579 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:48.680 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:48.680 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:49.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.043+0000 7f6063613640 0 --2- 172.21.15.148:0/4095041479 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f604c003100 0x5627bc2fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:18:49.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.071+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.071+0000 7f606530c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.071+0000 7f606530c9c0 20 realm 2024-09-14T11:18:49.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.071+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.071+0000 7f606530c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.071+0000 7f606530c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:49.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.071+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.075+0000 7f606530c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.075+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.075+0000 7f606530c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.075+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.075+0000 7f606530c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:49.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.075+0000 7f606530c9c0 20 searching for the correct realm 2024-09-14T11:18:49.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.075+0000 7f6063613640 0 -- 172.21.15.148:0/1150256828 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x5627bc3e2040 msgr2=0x5627bc3e4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.287+0000 7f6063613640 0 -- 172.21.15.148:0/1150256828 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5627bc3d5900 msgr2=0x5627bc3d7d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:49.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:49.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:49.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:49.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:49.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:49.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.307+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 zone default found 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 4 Realm: () 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 zonegroup default 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 started sync module instance, tier type = 2024-09-14T11:18:49.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.311+0000 7f606530c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.335+0000 7f606530c9c0 20 add_watcher() i=0 2024-09-14T11:18:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.335+0000 7f606530c9c0 20 add_watcher() i=1 2024-09-14T11:18:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.335+0000 7f606530c9c0 20 add_watcher() i=2 2024-09-14T11:18:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.335+0000 7f606530c9c0 20 add_watcher() i=3 2024-09-14T11:18:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.335+0000 7f606530c9c0 20 add_watcher() i=4 2024-09-14T11:18:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.335+0000 7f606530c9c0 20 add_watcher() i=5 2024-09-14T11:18:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.335+0000 7f606530c9c0 20 add_watcher() i=6 2024-09-14T11:18:49.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.339+0000 7f606530c9c0 20 add_watcher() i=7 2024-09-14T11:18:49.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.339+0000 7f606530c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:49.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.343+0000 7f5f197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.343+0000 7f606530c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:49.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.343+0000 7f606530c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:49.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.343+0000 7f606530c9c0 5 note: GC not initialized 2024-09-14T11:18:49.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.347+0000 7f5e93fff640 20 reqs_thread_entry: start 2024-09-14T11:18:49.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.347+0000 7f606530c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:49.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.347+0000 7f606530c9c0 20 Filter name: none 2024-09-14T11:18:49.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.347+0000 7f5e91ffb640 20 reqs_thread_entry: start 2024-09-14T11:18:49.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.347+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.347+0000 7f606530c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:49.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.347+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.347+0000 7f606530c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.351+0000 7f606530c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.351+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.351+0000 7f606530c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:49.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.351+0000 7f606530c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.351+0000 7f606530c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:49.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.351+0000 7f606530c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:49.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.355+0000 7f5f197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.359+0000 7f606530c9c0 20 remove_watcher() i=0 2024-09-14T11:18:49.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.359+0000 7f606530c9c0 2 removed watcher, disabling cache 2024-09-14T11:18:49.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.363+0000 7f606530c9c0 20 remove_watcher() i=1 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.363+0000 7f606530c9c0 20 remove_watcher() i=2 2024-09-14T11:18:49.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.367+0000 7f606530c9c0 20 remove_watcher() i=3 2024-09-14T11:18:49.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.371+0000 7f606530c9c0 20 remove_watcher() i=4 2024-09-14T11:18:49.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.371+0000 7f606530c9c0 20 remove_watcher() i=5 2024-09-14T11:18:49.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.375+0000 7f606530c9c0 20 remove_watcher() i=6 2024-09-14T11:18:49.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.379+0000 7f606530c9c0 20 remove_watcher() i=7 2024-09-14T11:18:49.390 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.391 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:49.391 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-commit-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:49.391 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.391 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:18:49.428 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:49.428 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:49.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 realm 2024-09-14T11:18:49.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.475+0000 7fc51de1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:49.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.475 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:49.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 searching for the correct realm 2024-09-14T11:18:49.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.487+0000 7fc51b924640 0 -- 172.21.15.148:0/235833993 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fc5140037b0 msgr2=0x7fc5140f9a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.491+0000 7fc51b924640 0 -- 172.21.15.148:0/235833993 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc50c044950 msgr2=0x7fc50c017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:49.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:49.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:49.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:49.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:49.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:49.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:49.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 zone default found 2024-09-14T11:18:49.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 Realm: () 2024-09-14T11:18:49.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:49.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:49.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:49.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 zonegroup default 2024-09-14T11:18:49.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 started sync module instance, tier type = 2024-09-14T11:18:49.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:49.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=0 2024-09-14T11:18:49.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=1 2024-09-14T11:18:49.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=2 2024-09-14T11:18:49.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=3 2024-09-14T11:18:49.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=4 2024-09-14T11:18:49.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=5 2024-09-14T11:18:49.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=6 2024-09-14T11:18:49.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.523+0000 7fc51de1e9c0 20 add_watcher() i=7 2024-09-14T11:18:49.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.523+0000 7fc51de1e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:49.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc3d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:49.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:49.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 note: GC not initialized 2024-09-14T11:18:49.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc3d0fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:49.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:49.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 Filter name: none 2024-09-14T11:18:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc34a7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:18:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:18:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:18:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : miss 2024-09-14T11:18:49.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.531+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:49.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:49.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:18:49.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:18:49.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 93869480834976 notifier 6971 bl.length()=1015 2024-09-14T11:18:49.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.540 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:18:49.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:18:49.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:18:49.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.0 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.0 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.1 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.1 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.2 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.2 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.3 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.3 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.4 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.4 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.5 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.5 2024-09-14T11:18:49.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.6 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.6 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.7 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.7 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.8 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.8 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.9 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.9 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.10 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.10 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.11 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.11 2024-09-14T11:18:49.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.0 2024-09-14T11:18:49.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1 2024-09-14T11:18:49.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.2 2024-09-14T11:18:49.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.3 2024-09-14T11:18:49.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.4 2024-09-14T11:18:49.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.5 2024-09-14T11:18:49.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.6 2024-09-14T11:18:49.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.7 2024-09-14T11:18:49.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.8 2024-09-14T11:18:49.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.9 2024-09-14T11:18:49.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.10 2024-09-14T11:18:49.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.571+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:49.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.571+0000 7fc51de1e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:18:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:18:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 93869480834976 notifier 6971 bl.length()=1015 2024-09-14T11:18:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:18:49.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:18:49.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:18:49.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:18:49.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.583+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.0 2024-09-14T11:18:49.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.583+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1 2024-09-14T11:18:49.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.2 2024-09-14T11:18:49.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.3 2024-09-14T11:18:49.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.4 2024-09-14T11:18:49.584 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.5 2024-09-14T11:18:49.585 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.6 2024-09-14T11:18:49.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.7 2024-09-14T11:18:49.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.8 2024-09-14T11:18:49.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.9 2024-09-14T11:18:49.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.10 2024-09-14T11:18:49.589 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc51de1e9c0 time 2024-09-14T11:18:49.596419+0000 2024-09-14T11:18:49.589 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:49.590 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:49.590 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc5216f82eb] 2024-09-14T11:18:49.590 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5216f849f] 2024-09-14T11:18:49.590 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555faf589c01] 2024-09-14T11:18:49.590 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555faf59f1a7] 2024-09-14T11:18:49.590 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc52055ed90] 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc51de1e9c0 thread_name:radosgw-admin 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.591+0000 7fc51de1e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc51de1e9c0 time 2024-09-14T11:18:49.596419+0000 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc5216f82eb] 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5216f849f] 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555faf589c01] 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555faf59f1a7] 2024-09-14T11:18:49.591 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:18:49.592 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc52055ed90] 2024-09-14T11:18:49.592 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:18:49.592 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:18:49.592 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc520577520] 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc5216f8345] 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5216f849f] 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555faf589c01] 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555faf59f1a7] 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc52055ed90] 2024-09-14T11:18:49.602 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.595+0000 7fc51de1e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc51de1e9c0 thread_name:radosgw-admin 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc520577520] 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc5216f8345] 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5216f849f] 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555faf589c01] 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555faf59f1a7] 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:18:49.603 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc52055ed90] 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb0ffbed0) adding con mode: crc 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb0ffbed0) adding con mode: secure 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb0ffbed0) adding con mode: crc 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb0ffbed0) adding con mode: secure 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command rotate-key hook 0x555fb0ffc018 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:49.604 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-c con 0x555fb0eab050 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-a con 0x555fb0eabb40 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-b con 0x555fb0f415f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): authenticate will time out at 2788.518516s 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): get_auth_request con 0x555fb0eab050 auth_method 0 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): get_auth_request con 0x555fb0eabb40 auth_method 0 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.605 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): handle_auth_done global_id 6962 payload 824 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient: _finish_hunting 0 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:18:49.455+0000 7fc51b924640 1 monclient: found mon.noname-c 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: dump: 2024-09-14T11:18:49.606 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: _finish_auth 0 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: _check_auth_tickets 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 monclient: authenticate success, global_id 6962 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.607 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: dump: 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:18:49.455+0000 7fc409e0b640 4 set_mon_vals no callback set 2024-09-14T11:18:49.608 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 1 librados: init done 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:18:49.459+0000 7fc403fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:18:49.459+0000 7fc403fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:18:49.459+0000 7fc403fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:18:49.459+0000 7fc51b123640 10 monclient: get_auth_request con 0x7fc4040718d0 auth_method 0 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:18:49.459+0000 7fc51c125640 10 monclient: get_auth_request con 0x555fb10242d0 auth_method 0 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:18:49.459+0000 7fc51b924640 10 monclient: get_auth_request con 0x555fb10473b0 auth_method 0 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient: get_auth_request con 0x555fb104b710 auth_method 0 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: monmap: 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:49.609 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding auth protocol: cephx 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding auth protocol: cephx 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding auth protocol: cephx 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.610 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command objecter_requests cmddesc objecter_requests hook 0x555fb1053ee0 EEXIST 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: init 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding auth protocol: cephx 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding auth protocol: cephx 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding auth protocol: cephx 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.611 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command rotate-key cmddesc rotate-key hook 0x555fb104ec90 EEXIST 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:49.612 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-a con 0x555fb1078090 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-c con 0x555fb10779c0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-b con 0x555fb10763a0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): authenticate will time out at 2788.527423s 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): get_auth_request con 0x555fb1078090 auth_method 0 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.613 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): get_auth_request con 0x555fb10779c0 auth_method 0 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): handle_auth_done global_id 7407 payload 824 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient: _finish_hunting 0 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:18:49.463+0000 7fc51b924640 1 monclient: found mon.noname-a 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:18:49.614 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:18:49.463+0000 7fc51c125640 10 monclient: get_auth_request con 0x555fb10763a0 auth_method 0 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: dump: 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: _finish_auth 0 2024-09-14T11:18:49.615 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: _check_auth_tickets 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: dump: 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.616 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 monclient: authenticate success, global_id 7407 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:18:49.467+0000 7fc51c926640 4 set_mon_vals no callback set 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:18:49.467+0000 7fc4017fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:18:49.467+0000 7fc4017fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:18:49.467+0000 7fc4017fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient: get_auth_request con 0x7fc3f40717e0 auth_method 0 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: get_monmap_and_config 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: monmap: 2024-09-14T11:18:49.617 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding auth protocol: cephx 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding auth protocol: cephx 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding auth protocol: cephx 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.618 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: init 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding auth protocol: cephx 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding auth protocol: cephx 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding auth protocol: cephx 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.619 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.620 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc249385e8 EEXIST 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-b con 0x555fb10cbcc0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-c con 0x555fb10c70b0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-a con 0x555fb10c7a30 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): authenticate will time out at 2788.531647s 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): get_auth_request con 0x555fb10c70b0 auth_method 0 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.621 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): get_auth_request con 0x555fb10c7a30 auth_method 0 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_done global_id 6968 payload 274 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient: _finish_hunting 0 2024-09-14T11:18:49.622 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:18:49.471+0000 7fc51b123640 1 monclient: found mon.noname-c 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: dump: 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.623 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: dump: 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 monclient: authenticate success, global_id 6968 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 4 set_mon_vals no callback set 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: shutdown 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: monmap: 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding auth protocol: cephx 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding auth protocol: cephx 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding auth protocol: cephx 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.626 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: starting msgr at 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: starting objecter 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command objecter_requests cmddesc objecter_requests hook 0x555fb109c800 EEXIST 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: setting wanted keys 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: calling monclient init 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: init 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding auth protocol: cephx 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding auth protocol: cephx 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding auth protocol: cephx 2024-09-14T11:18:49.627 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.628 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command rotate-key cmddesc rotate-key hook 0x555fb1079ff8 EEXIST 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-a con 0x555fb10c70b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-c con 0x555fb10c7a30 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-b con 0x555fb10cbcc0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): authenticate will time out at 2788.534361s 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): get_auth_request con 0x555fb10c7a30 auth_method 0 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.629 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): get_auth_request con 0x555fb10c70b0 auth_method 0 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_done global_id 6971 payload 824 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient: _finish_hunting 0 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:18:49.471+0000 7fc51b123640 1 monclient: found mon.noname-c 2024-09-14T11:18:49.630 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: dump: 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.631 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: _finish_auth 0 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: dump: 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.632 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:18:49.471+0000 7fc3faffd640 4 set_mon_vals no callback set 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 monclient: authenticate success, global_id 6971 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: init done 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cr dump hook 0x555fb10b9e08 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:18:49.475+0000 7fc3f97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:18:49.475+0000 7fc3f97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:18:49.475+0000 7fc3f97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.633 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:18:49.475+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc3e40718d0 auth_method 0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:18:49.475+0000 7fc51c125640 10 monclient: get_auth_request con 0x555fb10e5d80 auth_method 0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 realm 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:18:49.479+0000 7fc51b924640 10 monclient: get_auth_request con 0x555fb10ea100 auth_method 0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:18:49.479+0000 7fc51b123640 10 monclient: get_auth_request con 0x555fb10ed820 auth_method 0 2024-09-14T11:18:49.634 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 searching for the correct realm 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:18:49.479+0000 7fc51c125640 10 monclient: get_auth_request con 0x555fb10f25e0 auth_method 0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:18:49.483+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc5140037b0 auth_method 0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:18:49.483+0000 7fc51b123640 10 monclient: get_auth_request con 0x7fc50c00f940 auth_method 0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:18:49.487+0000 7fc51b924640 0 -- 172.21.15.148:0/235833993 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fc5140037b0 msgr2=0x7fc5140f9a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:18:49.487+0000 7fc3f97fa640 1 client.6971.objecter ms_handle_reset 0x7fc5140037b0 session 0x7fc5140a6070 osd.0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:18:49.487+0000 7fc3f97fa640 10 monclient: _renew_subs 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:18:49.487+0000 7fc3f97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:18:49.487+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc3e4081b70 auth_method 0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:18:49.487+0000 7fc51c125640 10 monclient: get_auth_request con 0x7fc51410e140 auth_method 0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:18:49.491+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc50c044950 auth_method 0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:18:49.491+0000 7fc51b924640 0 -- 172.21.15.148:0/235833993 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc50c044950 msgr2=0x7fc50c017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:18:49.491+0000 7fc3f97fa640 1 client.6971.objecter ms_handle_reset 0x7fc50c044950 session 0x7fc50c038a80 osd.3 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:18:49.491+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc5140037b0 auth_method 0 2024-09-14T11:18:49.635 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 zone default found 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 Realm: () 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:49.636 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 zonegroup default 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 started sync module instance, tier type = 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=0 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=1 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=2 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=3 2024-09-14T11:18:49.637 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=4 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=5 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=6 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:18:49.523+0000 7fc51de1e9c0 20 add_watcher() i=7 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:18:49.523+0000 7fc51de1e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding auth protocol: cephx 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding auth protocol: cephx 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding auth protocol: cephx 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.638 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:18:49.527+0000 7fc3d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cache list hook 0x555fb10c3dc0 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cache inspect hook 0x555fb10c3dc0 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cache erase hook 0x555fb10c3dc0 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cache zap hook 0x555fb10c3dc0 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 note: GC not initialized 2024-09-14T11:18:49.639 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:18:49.527+0000 7fc3d0fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command sync trace show hook 0x7fc50400da60 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command sync trace history hook 0x7fc50400da60 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command sync trace active hook 0x7fc50400da60 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command sync trace active_short hook 0x7fc50400da60 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 Filter name: none 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:18:49.527+0000 7fc34a7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : miss 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.640 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 93869480834976 notifier 6971 bl.length()=1015 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.641 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.0 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.0 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.1 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.1 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.2 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.2 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.3 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.3 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.4 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.4 2024-09-14T11:18:49.642 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.5 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.5 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.6 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.6 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.7 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.7 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.8 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.8 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.9 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.9 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.10 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.10 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.11 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.11 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.0 2024-09-14T11:18:49.643 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.2 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.3 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.4 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.5 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.6 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.7 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.8 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.9 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.10 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:18:49.571+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:18:49.571+0000 7fc51de1e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.644 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 93869480834976 notifier 6971 bl.length()=1015 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:18:49.583+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.0 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:18:49.583+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.2 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.3 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.4 2024-09-14T11:18:49.645 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.5 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.6 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.7 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.8 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.9 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.10 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc51de1e9c0 time 2024-09-14T11:18:49.596419+0000 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc5216f82eb] 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5216f849f] 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555faf589c01] 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555faf59f1a7] 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:18:49.646 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc52055ed90] 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:18:49.595+0000 7fc51de1e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc51de1e9c0 thread_name:radosgw-admin 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc520577520] 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc5216f8345] 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5216f849f] 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555faf589c01] 2024-09-14T11:18:49.647 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555faf59f1a7] 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc52055ed90] 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:18:49.648 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:18:49.649 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:18:49.650 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:18:49.651 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:18:49.652 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:49.653 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc34a7fc640 / http_manager 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3d0fe1640 / http_manager 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3d1fe3640 / rgw_dt_lg_renew 2024-09-14T11:18:49.654 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3f97fa640 / ms_dispatch 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3fa7fc640 / io_context_pool 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3faffd640 / io_context_pool 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4017fa640 / ms_dispatch 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc403fff640 / ms_dispatch 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc409e0b640 / io_context_pool 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51b123640 / msgr-worker-2 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51b924640 / msgr-worker-1 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51c125640 / msgr-worker-0 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51c926640 / io_context_pool 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51de1e9c0 / radosgw-admin 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.115752.log 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:18:49.655 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb0ffbed0) adding con mode: crc 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb0ffbed0) adding con mode: secure 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb0ffbed0) adding con mode: crc 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb0ffbed0) adding con mode: secure 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command rotate-key hook 0x555fb0ffc018 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-c con 0x555fb0eab050 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-a con 0x555fb0eabb40 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-b con 0x555fb0f415f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.656 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient(hunting): authenticate will time out at 2788.518516s 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): get_auth_request con 0x555fb0eab050 auth_method 0 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): get_auth_request con 0x555fb0eabb40 auth_method 0 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.657 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:18:49.455+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient(hunting): handle_auth_done global_id 6962 payload 824 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient: _finish_hunting 0 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:18:49.455+0000 7fc51b924640 1 monclient: found mon.noname-c 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:18:49.455+0000 7fc51b924640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: dump: 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.658 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: _finish_auth 0 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: _check_auth_tickets 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 5 monclient: authenticate success, global_id 6962 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:18:49.455+0000 7fc403fff640 10 monclient: dump: 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.659 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:18:49.455+0000 7fc409e0b640 4 set_mon_vals no callback set 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:18:49.455+0000 7fc51de1e9c0 1 librados: init done 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:18:49.459+0000 7fc403fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:18:49.459+0000 7fc403fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:18:49.459+0000 7fc403fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.660 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:18:49.459+0000 7fc51b123640 10 monclient: get_auth_request con 0x7fc4040718d0 auth_method 0 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:18:49.459+0000 7fc51c125640 10 monclient: get_auth_request con 0x555fb10242d0 auth_method 0 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:18:49.459+0000 7fc51b924640 10 monclient: get_auth_request con 0x555fb10473b0 auth_method 0 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient: get_auth_request con 0x555fb104b710 auth_method 0 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: monmap: 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding auth protocol: cephx 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding auth protocol: cephx 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding auth protocol: cephx 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: crc 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1050470) adding con mode: secure 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command objecter_requests cmddesc objecter_requests hook 0x555fb1053ee0 EEXIST 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: init 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding auth protocol: cephx 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding auth protocol: cephx 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding auth protocol: cephx 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.663 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: crc 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb104eb48) adding con mode: secure 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command rotate-key cmddesc rotate-key hook 0x555fb104ec90 EEXIST 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-a con 0x555fb1078090 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-c con 0x555fb10779c0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-b con 0x555fb10763a0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:49.664 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:18:49.463+0000 7fc51de1e9c0 10 monclient(hunting): authenticate will time out at 2788.527423s 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): get_auth_request con 0x555fb1078090 auth_method 0 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): get_auth_request con 0x555fb10779c0 auth_method 0 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.665 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:18:49.463+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient(hunting): handle_auth_done global_id 7407 payload 824 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient: _finish_hunting 0 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:18:49.463+0000 7fc51b924640 1 monclient: found mon.noname-a 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:18:49.463+0000 7fc51b924640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:18:49.463+0000 7fc51c125640 10 monclient: get_auth_request con 0x555fb10763a0 auth_method 0 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: dump: 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.666 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: _finish_auth 0 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: _check_auth_tickets 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:18:49.467+0000 7fc4017fa640 10 monclient: dump: 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.667 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 monclient: authenticate success, global_id 7407 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:18:49.467+0000 7fc51c926640 4 set_mon_vals no callback set 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:18:49.467+0000 7fc4017fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:49.668 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:18:49.467+0000 7fc4017fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:18:49.467+0000 7fc4017fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient: get_auth_request con 0x7fc3f40717e0 auth_method 0 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: get_monmap_and_config 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: monmap: 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:49.669 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding auth protocol: cephx 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding auth protocol: cephx 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding auth protocol: cephx 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.670 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: crc 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10977c0) adding con mode: secure 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: init 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding auth protocol: cephx 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding auth protocol: cephx 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding auth protocol: cephx 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.671 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: crc 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc249384a0) adding con mode: secure 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc249385e8 EEXIST 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-b con 0x555fb10cbcc0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-c con 0x555fb10c70b0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-a con 0x555fb10c7a30 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.672 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:18:49.467+0000 7fc51de1e9c0 10 monclient(hunting): authenticate will time out at 2788.531647s 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): get_auth_request con 0x555fb10c70b0 auth_method 0 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): get_auth_request con 0x555fb10c7a30 auth_method 0 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:18:49.467+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.673 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:18:49.467+0000 7fc51c125640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_done global_id 6968 payload 274 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient: _finish_hunting 0 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:18:49.471+0000 7fc51b123640 1 monclient: found mon.noname-c 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: dump: 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.674 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:18:49.471+0000 7fc3faffd640 10 monclient: dump: 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.675 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 monclient: authenticate success, global_id 6968 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 4 set_mon_vals no callback set 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: shutdown 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: build_initial_monmap 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: monmap: 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:18:49.676 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding auth protocol: cephx 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding auth protocol: cephx 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding auth protocol: cephx 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.677 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: crc 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb10be2b0) adding con mode: secure 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: starting msgr at 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: starting objecter 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command objecter_requests cmddesc objecter_requests hook 0x555fb109c800 EEXIST 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: setting wanted keys 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: calling monclient init 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: init 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding auth protocol: cephx 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding auth protocol: cephx 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding auth protocol: cephx 2024-09-14T11:18:49.678 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: crc 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 AuthRegistry(0x555fb1079eb0) adding con mode: secure 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command rotate-key cmddesc rotate-key hook 0x555fb1079ff8 EEXIST 2024-09-14T11:18:49.679 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-a con 0x555fb10c70b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-c con 0x555fb10c7a30 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): picked mon.noname-b con 0x555fb10cbcc0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient(hunting): authenticate will time out at 2788.534361s 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): get_auth_request con 0x555fb10c7a30 auth_method 0 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.680 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): get_auth_request con 0x555fb10c70b0 auth_method 0 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:18:49.471+0000 7fc51b924640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient(hunting): handle_auth_done global_id 6971 payload 824 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient: _finish_hunting 0 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:18:49.471+0000 7fc51b123640 1 monclient: found mon.noname-c 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:18:49.471+0000 7fc51b123640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.681 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: dump: 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: _finish_auth 0 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:49.682 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:18:49.471+0000 7fc3f97fa640 10 monclient: dump: 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:18:49.471+0000 7fc3faffd640 4 set_mon_vals no callback set 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 monclient: authenticate success, global_id 6971 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.683 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _renew_subs 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 1 librados: init done 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:18:49.471+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cr dump hook 0x555fb10b9e08 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:18:49.475+0000 7fc3f97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:18:49.475+0000 7fc3f97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:18:49.475+0000 7fc3f97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:18:49.475+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc3e40718d0 auth_method 0 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:18:49.475+0000 7fc51c125640 10 monclient: get_auth_request con 0x555fb10e5d80 auth_method 0 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 realm 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.684 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:18:49.475+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:18:49.479+0000 7fc51b924640 10 monclient: get_auth_request con 0x555fb10ea100 auth_method 0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:18:49.479+0000 7fc51b123640 10 monclient: get_auth_request con 0x555fb10ed820 auth_method 0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:18:49.479+0000 7fc51de1e9c0 20 searching for the correct realm 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:18:49.479+0000 7fc51c125640 10 monclient: get_auth_request con 0x555fb10f25e0 auth_method 0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:18:49.483+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc5140037b0 auth_method 0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:18:49.483+0000 7fc51b123640 10 monclient: get_auth_request con 0x7fc50c00f940 auth_method 0 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:18:49.487+0000 7fc51b924640 0 -- 172.21.15.148:0/235833993 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fc5140037b0 msgr2=0x7fc5140f9a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.685 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:18:49.487+0000 7fc3f97fa640 1 client.6971.objecter ms_handle_reset 0x7fc5140037b0 session 0x7fc5140a6070 osd.0 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:18:49.487+0000 7fc3f97fa640 10 monclient: _renew_subs 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:18:49.487+0000 7fc3f97fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:18:49.487+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc3e4081b70 auth_method 0 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:18:49.487+0000 7fc51c125640 10 monclient: get_auth_request con 0x7fc51410e140 auth_method 0 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:18:49.491+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc50c044950 auth_method 0 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:18:49.491+0000 7fc51b924640 0 -- 172.21.15.148:0/235833993 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc50c044950 msgr2=0x7fc50c017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:18:49.491+0000 7fc3f97fa640 1 client.6971.objecter ms_handle_reset 0x7fc50c044950 session 0x7fc50c038a80 osd.3 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:18:49.491+0000 7fc51b924640 10 monclient: get_auth_request con 0x7fc5140037b0 auth_method 0 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 zone default found 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 Realm: () 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 zonegroup default 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.687 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:18:49.499+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 started sync module instance, tier type = 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:18:49.503+0000 7fc51de1e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=0 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=1 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=2 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=3 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=4 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=5 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:18:49.519+0000 7fc51de1e9c0 20 add_watcher() i=6 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:18:49.523+0000 7fc51de1e9c0 20 add_watcher() i=7 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:18:49.523+0000 7fc51de1e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:49.688 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding auth protocol: cephx 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding auth protocol: cephx 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding auth protocol: cephx 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: crc 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 AuthRegistry(0x7ffc24938980) adding con mode: secure 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:18:49.527+0000 7fc3d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.689 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cache list hook 0x555fb10c3dc0 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cache inspect hook 0x555fb10c3dc0 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cache erase hook 0x555fb10c3dc0 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command cache zap hook 0x555fb10c3dc0 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 note: GC not initialized 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:18:49.527+0000 7fc3d0fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command sync trace show hook 0x7fc50400da60 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command sync trace history hook 0x7fc50400da60 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command sync trace active hook 0x7fc50400da60 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 5 asok(0x555fb0df0d90) register_command sync trace active_short hook 0x7fc50400da60 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:49.690 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 Filter name: none 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:18:49.527+0000 7fc34a7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : miss 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:18:49.527+0000 7fc51de1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:18:49.531+0000 7fc51de1e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:18:49.691 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 93869480834976 notifier 6971 bl.length()=1015 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:18:49.543+0000 7fc3fa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:18:49.543+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.0 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.0 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.1 2024-09-14T11:18:49.692 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.1 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.2 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.2 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.3 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.3 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.4 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.4 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.5 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.5 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.6 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.6 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.7 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.7 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.8 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.8 2024-09-14T11:18:49.693 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.9 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.9 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.10 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.10 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.11 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.11 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.0 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:18:49.555+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.2 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.3 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.4 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:18:49.559+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.5 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.6 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.7 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.8 2024-09-14T11:18:49.694 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.9 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:18:49.563+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.10 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:18:49.571+0000 7fc51de1e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:18:49.571+0000 7fc51de1e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:18:49.575+0000 7fc51de1e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 93869480834976 notifier 6971 bl.length()=1015 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:18:49.575+0000 7fc3faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:18:49.695 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:18:49.579+0000 7fc51de1e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:18:49.583+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.0 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:18:49.583+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.2 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.3 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.4 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.5 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:18:49.587+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.6 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.7 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.8 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.9 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.10 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:18:49.591+0000 7fc51de1e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc51de1e9c0 time 2024-09-14T11:18:49.596419+0000 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.696 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc5216f82eb] 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5216f849f] 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555faf589c01] 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555faf59f1a7] 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc52055ed90] 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:18:49.595+0000 7fc51de1e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc51de1e9c0 thread_name:radosgw-admin 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc520577520] 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:18:49.697 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc5216f8345] 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc5216f849f] 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555faf589c01] 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555faf59f1a7] 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc52055ed90] 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:18:49.698 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:18:49.699 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:18:49.700 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:49.701 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:18:49.702 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:49.703 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc34a7fc640 / http_manager 2024-09-14T11:18:49.704 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3d0fe1640 / http_manager 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3d1fe3640 / rgw_dt_lg_renew 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3f97fa640 / ms_dispatch 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3fa7fc640 / io_context_pool 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3faffd640 / io_context_pool 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4017fa640 / ms_dispatch 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc403fff640 / ms_dispatch 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc409e0b640 / io_context_pool 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51b123640 / msgr-worker-2 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51b924640 / msgr-worker-1 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51c125640 / msgr-worker-0 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51c926640 / io_context_pool 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc51de1e9c0 / radosgw-admin 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:18:49.598606Z_e8c4825a-3c2f-4c82-aa64-c88df43d305b/log 2024-09-14T11:18:49.705 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:18:49.706 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:18:49.706 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:18:49.706 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:49.706 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:49.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.871+0000 7fc6e8fa7640 0 --2- 172.21.15.148:0/3316233721 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x5618aaf56ac0 0x5618aaf6ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:18:49.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 20 realm 2024-09-14T11:18:49.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:49.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.887+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.891+0000 7fc6eb4a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.887 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.891+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.888 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.891+0000 7fc6eb4a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:49.888 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.891+0000 7fc6eb4a19c0 20 searching for the correct realm 2024-09-14T11:18:49.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.895+0000 7fc6e8fa7640 0 -- 172.21.15.148:0/84272998 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fc6d8062ff0 msgr2=0x7fc6d806d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:49.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:49.903+0000 7fc6e8fa7640 0 -- 172.21.15.148:0/84272998 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc6e000f290 msgr2=0x7fc6e0024020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:50.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:18:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:18:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:50.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:50.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.123+0000 7fc6eb4a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:50.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 zone default found 2024-09-14T11:18:50.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 4 Realm: () 2024-09-14T11:18:50.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:18:50.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:18:50.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:50.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 zonegroup default 2024-09-14T11:18:50.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:50.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:50.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:50.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 started sync module instance, tier type = 2024-09-14T11:18:50.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.127+0000 7fc6eb4a19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:18:50.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.147+0000 7fc6eb4a19c0 20 add_watcher() i=0 2024-09-14T11:18:50.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.147+0000 7fc6eb4a19c0 20 add_watcher() i=1 2024-09-14T11:18:50.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.147+0000 7fc6eb4a19c0 20 add_watcher() i=2 2024-09-14T11:18:50.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.147+0000 7fc6eb4a19c0 20 add_watcher() i=3 2024-09-14T11:18:50.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.147+0000 7fc6eb4a19c0 20 add_watcher() i=4 2024-09-14T11:18:50.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.147+0000 7fc6eb4a19c0 20 add_watcher() i=5 2024-09-14T11:18:50.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.147+0000 7fc6eb4a19c0 20 add_watcher() i=6 2024-09-14T11:18:50.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.151+0000 7fc6eb4a19c0 20 add_watcher() i=7 2024-09-14T11:18:50.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.151+0000 7fc6eb4a19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:50.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.155+0000 7fc59efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:50.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.155+0000 7fc6eb4a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:50.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.155+0000 7fc6eb4a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:50.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.155+0000 7fc6eb4a19c0 5 note: GC not initialized 2024-09-14T11:18:50.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.155+0000 7fc59dfe3640 20 reqs_thread_entry: start 2024-09-14T11:18:50.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.155+0000 7fc6eb4a19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:18:50.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.155+0000 7fc6eb4a19c0 20 Filter name: none 2024-09-14T11:18:50.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc50f7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:50.155 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc6eb4a19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:50.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc6eb4a19c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:18:50.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc6eb4a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:50.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc6eb4a19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:18:50.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.159+0000 7fc6eb4a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:18:50.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.163+0000 7fc6eb4a19c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:18:50.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.163+0000 7fc6eb4a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:50.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.167+0000 7fc59efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:50.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.171+0000 7fc6eb4a19c0 20 remove_watcher() i=0 2024-09-14T11:18:50.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.171+0000 7fc6eb4a19c0 2 removed watcher, disabling cache 2024-09-14T11:18:50.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.171+0000 7fc6eb4a19c0 20 remove_watcher() i=1 2024-09-14T11:18:50.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.175+0000 7fc6eb4a19c0 20 remove_watcher() i=2 2024-09-14T11:18:50.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.175+0000 7fc6eb4a19c0 20 remove_watcher() i=3 2024-09-14T11:18:50.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.179+0000 7fc6eb4a19c0 20 remove_watcher() i=4 2024-09-14T11:18:50.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.183+0000 7fc6eb4a19c0 20 remove_watcher() i=5 2024-09-14T11:18:50.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.183+0000 7fc6eb4a19c0 20 remove_watcher() i=6 2024-09-14T11:18:50.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:18:50.187+0000 7fc6eb4a19c0 20 remove_watcher() i=7 2024-09-14T11:18:50.200 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:50.200 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:18:50.200 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-commit-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:50.200 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:18:50.202 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:18:50.202 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:20.527 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:20.528 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:20.616 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:20.653 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:20.653 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:20.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.698+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 realm 2024-09-14T11:19:20.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:20.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:20.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:20.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.702+0000 7ff4ce5659c0 20 searching for the correct realm 2024-09-14T11:19:20.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.710+0000 7ff4cb86a640 0 -- 172.21.15.148:0/1385228873 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7ff4c4018040 msgr2=0x7ff4c401a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:20.713 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.714+0000 7ff4cc86c640 0 -- 172.21.15.148:0/1385228873 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x555e7be89f40 msgr2=0x555e7be8c330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:20.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:20.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:20.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:20.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:20.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:20.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:20.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:20.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:20.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 zone default found 2024-09-14T11:19:20.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 4 Realm: () 2024-09-14T11:19:20.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:20.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:20.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:20.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 zonegroup default 2024-09-14T11:19:20.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.722+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.726+0000 7ff4ce5659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.726+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.726+0000 7ff4ce5659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.726+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.726+0000 7ff4ce5659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.726+0000 7ff4ce5659c0 20 started sync module instance, tier type = 2024-09-14T11:19:20.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.726+0000 7ff4ce5659c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:20.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 20 add_watcher() i=0 2024-09-14T11:19:20.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 20 add_watcher() i=1 2024-09-14T11:19:20.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 20 add_watcher() i=2 2024-09-14T11:19:20.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 20 add_watcher() i=3 2024-09-14T11:19:20.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 20 add_watcher() i=4 2024-09-14T11:19:20.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 20 add_watcher() i=5 2024-09-14T11:19:20.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 20 add_watcher() i=6 2024-09-14T11:19:20.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 20 add_watcher() i=7 2024-09-14T11:19:20.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.746+0000 7ff4ce5659c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:20.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.750+0000 7ff3827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:20.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.750+0000 7ff4ce5659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:20.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.750+0000 7ff4ce5659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:20.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.750+0000 7ff4ce5659c0 5 note: GC not initialized 2024-09-14T11:19:20.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.750+0000 7ff3817e2640 20 reqs_thread_entry: start 2024-09-14T11:19:20.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.750+0000 7ff4ce5659c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:20.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.750+0000 7ff4ce5659c0 20 Filter name: none 2024-09-14T11:19:20.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff2f2ffd640 20 reqs_thread_entry: start 2024-09-14T11:19:20.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:19:20.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:20.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:19:20.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:19:20.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : miss 2024-09-14T11:19:20.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:20.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:19:20.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:19:20.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:20.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:20.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.754+0000 7ff4ce5659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:19:20.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.766+0000 7ff4ce5659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:19:20.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.766+0000 7ff4ce5659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:19:20.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.766+0000 7ff4ce5659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:20.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.766+0000 7ff4ce5659c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:19:20.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.766+0000 7ff3a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366247 cookie 93864294137824 notifier 7455 bl.length()=1015 2024-09-14T11:19:20.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.766+0000 7ff3a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:19:20.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.766+0000 7ff3a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:19:20.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.766+0000 7ff3a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:20.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.770+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:19:20.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.770+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:19:20.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.770+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:19:20.767 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.770+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:19:20.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.0 2024-09-14T11:19:20.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.0 2024-09-14T11:19:20.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.1 2024-09-14T11:19:20.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.1 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.2 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.2 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.3 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.3 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.4 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.4 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.5 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.5 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.6 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.6 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.7 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.7 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.8 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.8 2024-09-14T11:19:20.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.9 2024-09-14T11:19:20.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.9 2024-09-14T11:19:20.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.10 2024-09-14T11:19:20.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.10 2024-09-14T11:19:20.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.11 2024-09-14T11:19:20.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1.11 2024-09-14T11:19:20.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.778+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.0 2024-09-14T11:19:20.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.782+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1 2024-09-14T11:19:20.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.782+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.2 2024-09-14T11:19:20.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.782+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.3 2024-09-14T11:19:20.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.782+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.4 2024-09-14T11:19:20.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.786+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.5 2024-09-14T11:19:20.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.786+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.6 2024-09-14T11:19:20.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.786+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.7 2024-09-14T11:19:20.785 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.786+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.8 2024-09-14T11:19:20.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.786+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.9 2024-09-14T11:19:20.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.790+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.10 2024-09-14T11:19:20.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.798+0000 7ff4ce5659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:20.795 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.798+0000 7ff4ce5659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:19:20.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.798+0000 7ff4ce5659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:19:20.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.798+0000 7ff4ce5659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:19:20.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.798+0000 7ff4ce5659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:20.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.798+0000 7ff4ce5659c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:19:20.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.802+0000 7ff3a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366248 cookie 93864294137824 notifier 7455 bl.length()=1015 2024-09-14T11:19:20.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.802+0000 7ff3a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:19:20.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.802+0000 7ff3a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:19:20.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.802+0000 7ff3a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:20.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.802+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:19:20.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.802+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:19:20.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.802+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:19:20.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.802+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:19:20.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.806+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.0 2024-09-14T11:19:20.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.810+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.1 2024-09-14T11:19:20.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.810+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.2 2024-09-14T11:19:20.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.810+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.3 2024-09-14T11:19:20.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.810+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.4 2024-09-14T11:19:20.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.810+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.5 2024-09-14T11:19:20.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.814+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.6 2024-09-14T11:19:20.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.814+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.7 2024-09-14T11:19:20.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.814+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.8 2024-09-14T11:19:20.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.814+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.9 2024-09-14T11:19:20.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.814+0000 7ff4ce5659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33.10 2024-09-14T11:19:20.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff4ce5659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:20.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff4ce5659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 2024-09-14T11:19:20.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff4ce5659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:19:20.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff4ce5659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:19:20.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff4ce5659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:20.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff4ce5659c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33, ofs0, ns] 2024-09-14T11:19:20.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff3a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366249 cookie 93864294137824 notifier 7455 bl.length()=983 2024-09-14T11:19:20.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff3a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 info.flags=0x17 2024-09-14T11:19:20.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff3a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 to cache LRU end 2024-09-14T11:19:20.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.818+0000 7ff3a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:20.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.822+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_sources= new_sources= 2024-09-14T11:19:20.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.822+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential sources added=[] removed=[] 2024-09-14T11:19:20.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.822+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): orig_dests= new_dests= 2024-09-14T11:19:20.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.822+0000 7ff4ce5659c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33]): potential dests added=[] removed=[] 2024-09-14T11:19:20.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.830+0000 7ff4ce5659c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:19:20.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.834+0000 7ff3827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:20.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.838+0000 7ff4ce5659c0 20 remove_watcher() i=0 2024-09-14T11:19:20.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.838+0000 7ff4ce5659c0 2 removed watcher, disabling cache 2024-09-14T11:19:20.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.838+0000 7ff4ce5659c0 20 remove_watcher() i=1 2024-09-14T11:19:20.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.842+0000 7ff4ce5659c0 20 remove_watcher() i=2 2024-09-14T11:19:20.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.842+0000 7ff4ce5659c0 20 remove_watcher() i=3 2024-09-14T11:19:20.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.846+0000 7ff4ce5659c0 20 remove_watcher() i=4 2024-09-14T11:19:20.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.846+0000 7ff4ce5659c0 20 remove_watcher() i=5 2024-09-14T11:19:20.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.850+0000 7ff4ce5659c0 20 remove_watcher() i=6 2024-09-14T11:19:20.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.854+0000 7ff4ce5659c0 20 remove_watcher() i=7 2024-09-14T11:19:20.868 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:19:20.899 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:20.900 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:20.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.946+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 realm 2024-09-14T11:19:20.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:20.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:20.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:20.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.950+0000 7f3b862e39c0 20 searching for the correct realm 2024-09-14T11:19:20.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:20.954+0000 7f3b83de9640 0 -- 172.21.15.148:0/2165139271 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f3b7c033930 msgr2=0x7f3b7c063f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:21.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.166+0000 7f3b83de9640 0 -- 172.21.15.148:0/2165139271 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55c834f98f30 msgr2=0x7f3b7411d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:21.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:21.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:21.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:21.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:21.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:21.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:21.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:21.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:21.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.386+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:21.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 zone default found 2024-09-14T11:19:21.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 4 Realm: () 2024-09-14T11:19:21.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:21.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:21.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:21.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 zonegroup default 2024-09-14T11:19:21.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:21.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:21.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:21.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 started sync module instance, tier type = 2024-09-14T11:19:21.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.390+0000 7f3b862e39c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:21.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.414+0000 7f3b862e39c0 20 add_watcher() i=0 2024-09-14T11:19:21.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.414+0000 7f3b862e39c0 20 add_watcher() i=1 2024-09-14T11:19:21.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.414+0000 7f3b862e39c0 20 add_watcher() i=2 2024-09-14T11:19:21.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.414+0000 7f3b862e39c0 20 add_watcher() i=3 2024-09-14T11:19:21.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.414+0000 7f3b862e39c0 20 add_watcher() i=4 2024-09-14T11:19:21.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.414+0000 7f3b862e39c0 20 add_watcher() i=5 2024-09-14T11:19:21.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.414+0000 7f3b862e39c0 20 add_watcher() i=6 2024-09-14T11:19:21.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.418+0000 7f3b862e39c0 20 add_watcher() i=7 2024-09-14T11:19:21.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.418+0000 7f3b862e39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:21.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.422+0000 7f3a39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:21.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.422+0000 7f3b862e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:21.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.422+0000 7f3b862e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:21.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.422+0000 7f3b862e39c0 5 note: GC not initialized 2024-09-14T11:19:21.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.422+0000 7f3a38fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:21.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.422+0000 7f3b862e39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:21.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.422+0000 7f3b862e39c0 20 Filter name: none 2024-09-14T11:19:21.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f39b27fc640 20 reqs_thread_entry: start 2024-09-14T11:19:21.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f3b862e39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:21.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f3b862e39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:21.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f3b862e39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:21.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f3b862e39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:21.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.426+0000 7f3b862e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:21.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.430+0000 7f3b862e39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:21.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.430+0000 7f3b862e39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:21.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.430+0000 7f3a39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:21.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.434+0000 7f3b862e39c0 20 remove_watcher() i=0 2024-09-14T11:19:21.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.434+0000 7f3b862e39c0 2 removed watcher, disabling cache 2024-09-14T11:19:21.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.438+0000 7f3b862e39c0 20 remove_watcher() i=1 2024-09-14T11:19:21.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.438+0000 7f3b862e39c0 20 remove_watcher() i=2 2024-09-14T11:19:21.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.442+0000 7f3b862e39c0 20 remove_watcher() i=3 2024-09-14T11:19:21.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.446+0000 7f3b862e39c0 20 remove_watcher() i=4 2024-09-14T11:19:21.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.446+0000 7f3b862e39c0 20 remove_watcher() i=5 2024-09-14T11:19:21.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.450+0000 7f3b862e39c0 20 remove_watcher() i=6 2024-09-14T11:19:21.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:21.454+0000 7f3b862e39c0 20 remove_watcher() i=7 2024-09-14T11:19:21.465 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:21.465 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:19:21.465 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-commit-target-layout id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:19:21.465 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:21.466 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:21.466 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:21.487 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:21.487 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:22.104 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:22.104 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:22.487 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:19:22.487 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:22.490 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:22.490 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:22.628 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:22.629 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:22.719 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:22.719 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:22.827 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:22.828 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.029 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.029 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.191 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.191 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.290 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.290 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.385 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.385 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.492 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.492 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.592 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.592 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.689 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.689 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.798 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.798 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:23.904 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:23.904 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.012 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:24.013 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.117 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:24.117 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.220 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:24.221 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.321 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:24.321 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.423 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:24.423 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.527 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:24.527 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.632 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:24.632 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.733 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:24.733 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:24.833 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:19:24.865 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:24.865 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:24.909 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.910+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 realm 2024-09-14T11:19:24.911 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:24.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:24.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:24.914 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.914+0000 7f1ec13499c0 20 searching for the correct realm 2024-09-14T11:19:24.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.922+0000 7f1ebee4f640 0 -- 172.21.15.148:0/1012873463 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f1eb00b63d0 msgr2=0x7f1eb00b6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:24.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.926+0000 7f1ebee4f640 0 -- 172.21.15.148:0/1012873463 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f1eb8015070 msgr2=0x7f1eb8015960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:24.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:24.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:24.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:24.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:24.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:24.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:24.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:24.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.934+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:24.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 zone default found 2024-09-14T11:19:24.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 4 Realm: () 2024-09-14T11:19:24.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:24.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:24.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:24.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 zonegroup default 2024-09-14T11:19:24.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 started sync module instance, tier type = 2024-09-14T11:19:24.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.938+0000 7f1ec13499c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:24.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.958+0000 7f1ec13499c0 20 add_watcher() i=0 2024-09-14T11:19:24.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.958+0000 7f1ec13499c0 20 add_watcher() i=1 2024-09-14T11:19:24.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.958+0000 7f1ec13499c0 20 add_watcher() i=2 2024-09-14T11:19:24.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.958+0000 7f1ec13499c0 20 add_watcher() i=3 2024-09-14T11:19:24.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.958+0000 7f1ec13499c0 20 add_watcher() i=4 2024-09-14T11:19:24.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.958+0000 7f1ec13499c0 20 add_watcher() i=5 2024-09-14T11:19:24.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.958+0000 7f1ec13499c0 20 add_watcher() i=6 2024-09-14T11:19:24.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.962+0000 7f1ec13499c0 20 add_watcher() i=7 2024-09-14T11:19:24.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.962+0000 7f1ec13499c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:24.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.962+0000 7f1d757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:24.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.962+0000 7f1ec13499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:24.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.962+0000 7f1ec13499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:24.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.962+0000 7f1ec13499c0 5 note: GC not initialized 2024-09-14T11:19:24.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ceffff640 20 reqs_thread_entry: start 2024-09-14T11:19:24.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:24.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 Filter name: none 2024-09-14T11:19:24.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1cedffb640 20 reqs_thread_entry: start 2024-09-14T11:19:24.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:24.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:24.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:24.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:24.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.966+0000 7f1ec13499c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.970+0000 7f1ec13499c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:24.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.970+0000 7f1ec13499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:24.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.974+0000 7f1d757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:24.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.978+0000 7f1ec13499c0 20 remove_watcher() i=0 2024-09-14T11:19:24.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.978+0000 7f1ec13499c0 2 removed watcher, disabling cache 2024-09-14T11:19:24.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.978+0000 7f1ec13499c0 20 remove_watcher() i=1 2024-09-14T11:19:24.978 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.982+0000 7f1ec13499c0 20 remove_watcher() i=2 2024-09-14T11:19:24.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.982+0000 7f1ec13499c0 20 remove_watcher() i=3 2024-09-14T11:19:24.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.982+0000 7f1ec13499c0 20 remove_watcher() i=4 2024-09-14T11:19:24.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.986+0000 7f1ec13499c0 20 remove_watcher() i=5 2024-09-14T11:19:24.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.990+0000 7f1ec13499c0 20 remove_watcher() i=6 2024-09-14T11:19:24.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:24.990+0000 7f1ec13499c0 20 remove_watcher() i=7 2024-09-14T11:19:25.004 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:25.004 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:19:25.004 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-do-reshard id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:25.004 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:25.004 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:19:25.037 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:25.037 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:25.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.082+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.082+0000 7f52a3a889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.082+0000 7f52a3a889c0 20 realm 2024-09-14T11:19:25.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.082+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:25.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:25.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.086+0000 7f52a3a889c0 20 searching for the correct realm 2024-09-14T11:19:25.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.094+0000 7f52a0d8d640 0 -- 172.21.15.148:0/605743322 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f52940dc410 msgr2=0x7f52940dc890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.098+0000 7f52a158e640 0 -- 172.21.15.148:0/605743322 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f52940ea920 msgr2=0x7f52940b63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:25.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:25.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:25.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:25.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:25.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:25.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:25.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:25.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 zone default found 2024-09-14T11:19:25.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 4 Realm: () 2024-09-14T11:19:25.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:25.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:25.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:25.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 zonegroup default 2024-09-14T11:19:25.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.106+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.110+0000 7f52a3a889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.110+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.110+0000 7f52a3a889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.110+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.110+0000 7f52a3a889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.110+0000 7f52a3a889c0 20 started sync module instance, tier type = 2024-09-14T11:19:25.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.110+0000 7f52a3a889c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:25.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.126+0000 7f52a3a889c0 20 add_watcher() i=0 2024-09-14T11:19:25.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.126+0000 7f52a3a889c0 20 add_watcher() i=1 2024-09-14T11:19:25.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.126+0000 7f52a3a889c0 20 add_watcher() i=2 2024-09-14T11:19:25.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.126+0000 7f52a3a889c0 20 add_watcher() i=3 2024-09-14T11:19:25.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.126+0000 7f52a3a889c0 20 add_watcher() i=4 2024-09-14T11:19:25.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.126+0000 7f52a3a889c0 20 add_watcher() i=5 2024-09-14T11:19:25.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.130+0000 7f52a3a889c0 20 add_watcher() i=6 2024-09-14T11:19:25.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.130+0000 7f52a3a889c0 20 add_watcher() i=7 2024-09-14T11:19:25.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.130+0000 7f52a3a889c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:25.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f5157fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f52a3a889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:25.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f52a3a889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:25.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f52a3a889c0 5 note: GC not initialized 2024-09-14T11:19:25.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f5156fe5640 20 reqs_thread_entry: start 2024-09-14T11:19:25.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f52a3a889c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:25.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f52a3a889c0 20 Filter name: none 2024-09-14T11:19:25.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f5154fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:25.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f52a3a889c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:19:25.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.134+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:25.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:19:25.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:19:25.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 : miss 2024-09-14T11:19:25.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:25.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:25.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.138+0000 7f52a3a889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 2024-09-14T11:19:25.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.150+0000 7f52a3a889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.150+0000 7f52a3a889c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.150+0000 7f52a3a889c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.150+0000 7f52a3a889c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34, ofs0, ns] 2024-09-14T11:19:25.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.150+0000 7f5173fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366268 cookie 93928065032096 notifier 7052 bl.length()=995 2024-09-14T11:19:25.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.150+0000 7f5173fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.150+0000 7f5173fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.150+0000 7f5173fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.154+0000 7f52a3a889c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_sources= new_sources= 2024-09-14T11:19:25.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.154+0000 7f52a3a889c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential sources added=[] removed=[] 2024-09-14T11:19:25.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.154+0000 7f52a3a889c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_dests= new_dests= 2024-09-14T11:19:25.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.154+0000 7f52a3a889c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential dests added=[] removed=[] 2024-09-14T11:19:25.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.162+0000 7f52a3a889c0 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:19:25.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f52a3a889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:25.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f52a3a889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 2024-09-14T11:19:25.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f52a3a889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f52a3a889c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f52a3a889c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f52a3a889c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34, ofs0, ns] 2024-09-14T11:19:25.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f5173fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366269 cookie 93928065032096 notifier 7052 bl.length()=963 2024-09-14T11:19:25.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f5173fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f5173fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.178+0000 7f5173fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.182+0000 7f52a3a889c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_sources= new_sources= 2024-09-14T11:19:25.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.182+0000 7f52a3a889c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential sources added=[] removed=[] 2024-09-14T11:19:25.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.182+0000 7f52a3a889c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_dests= new_dests= 2024-09-14T11:19:25.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.182+0000 7f52a3a889c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential dests added=[] removed=[] 2024-09-14T11:19:25.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.182+0000 7f52a3a889c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:19:25.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.186+0000 7f5157fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.190+0000 7f52a3a889c0 20 remove_watcher() i=0 2024-09-14T11:19:25.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.190+0000 7f52a3a889c0 2 removed watcher, disabling cache 2024-09-14T11:19:25.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.190+0000 7f52a3a889c0 20 remove_watcher() i=1 2024-09-14T11:19:25.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.194+0000 7f52a3a889c0 20 remove_watcher() i=2 2024-09-14T11:19:25.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.194+0000 7f52a3a889c0 20 remove_watcher() i=3 2024-09-14T11:19:25.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.198+0000 7f52a3a889c0 20 remove_watcher() i=4 2024-09-14T11:19:25.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.198+0000 7f52a3a889c0 20 remove_watcher() i=5 2024-09-14T11:19:25.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.202+0000 7f52a3a889c0 20 remove_watcher() i=6 2024-09-14T11:19:25.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.206+0000 7f52a3a889c0 20 remove_watcher() i=7 2024-09-14T11:19:25.219 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:19:25.248 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:25.248 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:25.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.294+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 realm 2024-09-14T11:19:25.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:25.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:25.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.298+0000 7f812ddfb9c0 20 searching for the correct realm 2024-09-14T11:19:25.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.306+0000 7f812b100640 0 -- 172.21.15.148:0/339610529 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5578041a3f00 msgr2=0x5578041a62f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.310+0000 7f812b901640 0 -- 172.21.15.148:0/339610529 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f8124061390 msgr2=0x7f8124069f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:25.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:25.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:25.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:25.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:25.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:25.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 zone default found 2024-09-14T11:19:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 4 Realm: () 2024-09-14T11:19:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 zonegroup default 2024-09-14T11:19:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.318+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.322+0000 7f812ddfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.322+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.322+0000 7f812ddfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.322+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.322+0000 7f812ddfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.322+0000 7f812ddfb9c0 20 started sync module instance, tier type = 2024-09-14T11:19:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.322+0000 7f812ddfb9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:25.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 20 add_watcher() i=0 2024-09-14T11:19:25.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 20 add_watcher() i=1 2024-09-14T11:19:25.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 20 add_watcher() i=2 2024-09-14T11:19:25.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 20 add_watcher() i=3 2024-09-14T11:19:25.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 20 add_watcher() i=4 2024-09-14T11:19:25.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 20 add_watcher() i=5 2024-09-14T11:19:25.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 20 add_watcher() i=6 2024-09-14T11:19:25.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 20 add_watcher() i=7 2024-09-14T11:19:25.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.342+0000 7f812ddfb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:25.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f7fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f812ddfb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:25.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f812ddfb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:25.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f812ddfb9c0 5 note: GC not initialized 2024-09-14T11:19:25.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f7fe0fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:25.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f812ddfb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:25.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f812ddfb9c0 20 Filter name: none 2024-09-14T11:19:25.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f7f5a7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:25.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f812ddfb9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:25.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.346+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.350+0000 7f812ddfb9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:25.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.350+0000 7f812ddfb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:25.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.350+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.350+0000 7f812ddfb9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:25.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.350+0000 7f812ddfb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.350+0000 7f812ddfb9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:25.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.354+0000 7f812ddfb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:25.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.354+0000 7f7fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.358+0000 7f812ddfb9c0 20 remove_watcher() i=0 2024-09-14T11:19:25.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.358+0000 7f812ddfb9c0 2 removed watcher, disabling cache 2024-09-14T11:19:25.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.358+0000 7f812ddfb9c0 20 remove_watcher() i=1 2024-09-14T11:19:25.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.362+0000 7f812ddfb9c0 20 remove_watcher() i=2 2024-09-14T11:19:25.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.362+0000 7f812ddfb9c0 20 remove_watcher() i=3 2024-09-14T11:19:25.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.366+0000 7f812ddfb9c0 20 remove_watcher() i=4 2024-09-14T11:19:25.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.366+0000 7f812ddfb9c0 20 remove_watcher() i=5 2024-09-14T11:19:25.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.370+0000 7f812ddfb9c0 20 remove_watcher() i=6 2024-09-14T11:19:25.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.374+0000 7f812ddfb9c0 20 remove_watcher() i=7 2024-09-14T11:19:25.386 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:25.386 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:19:25.386 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-do-reshard id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:25.386 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:25.387 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:25.387 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:25.428 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:25.428 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:25.488 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:25.523 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:25.523 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:25.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.566+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 realm 2024-09-14T11:19:25.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:25.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.570+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.574+0000 7fdc45dd19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:25.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.574+0000 7fdc45dd19c0 20 searching for the correct realm 2024-09-14T11:19:25.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.578+0000 7fdc438d7640 0 -- 172.21.15.148:0/3744600887 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fdc3411b030 msgr2=0x7fdc34102d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.582+0000 7fdc438d7640 0 -- 172.21.15.148:0/3744600887 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fdc3c028c00 msgr2=0x7fdc3c04f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:25.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:25.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:25.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:25.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:25.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:25.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:25.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 zone default found 2024-09-14T11:19:25.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 4 Realm: () 2024-09-14T11:19:25.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:25.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:25.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:25.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 zonegroup default 2024-09-14T11:19:25.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.590+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.594+0000 7fdc45dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.594+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.594+0000 7fdc45dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.594+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.594+0000 7fdc45dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.594+0000 7fdc45dd19c0 20 started sync module instance, tier type = 2024-09-14T11:19:25.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.594+0000 7fdc45dd19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:25.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 20 add_watcher() i=0 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 20 add_watcher() i=1 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 20 add_watcher() i=2 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 20 add_watcher() i=3 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 20 add_watcher() i=4 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 20 add_watcher() i=5 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 20 add_watcher() i=6 2024-09-14T11:19:25.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 20 add_watcher() i=7 2024-09-14T11:19:25.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.614+0000 7fdc45dd19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:25.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdaf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdc45dd19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:25.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdc45dd19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:25.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdc45dd19c0 5 note: GC not initialized 2024-09-14T11:19:25.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdaf8fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:25.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdc45dd19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:25.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdc45dd19c0 20 Filter name: none 2024-09-14T11:19:25.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fda727fc640 20 reqs_thread_entry: start 2024-09-14T11:19:25.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdc45dd19c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:19:25.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.618+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:25.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:19:25.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:19:25.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 : miss 2024-09-14T11:19:25.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:25.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:25.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.622+0000 7fdc45dd19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 2024-09-14T11:19:25.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdc45dd19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdc45dd19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdc45dd19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdc45dd19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34, ofs0, ns] 2024-09-14T11:19:25.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdb22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366270 cookie 94101022120784 notifier 7545 bl.length()=995 2024-09-14T11:19:25.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdb22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdb22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdb22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_sources= new_sources= 2024-09-14T11:19:25.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential sources added=[] removed=[] 2024-09-14T11:19:25.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_dests= new_dests= 2024-09-14T11:19:25.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.634+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential dests added=[] removed=[] 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.0 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.0 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.1 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.1 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.2 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.2 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.3 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.3 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.4 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.4 2024-09-14T11:19:25.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.5 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.5 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.6 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.6 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.7 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.7 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.8 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.8 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.9 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.9 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.10 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.10 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.11 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1.11 2024-09-14T11:19:25.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.0 2024-09-14T11:19:25.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1 2024-09-14T11:19:25.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.2 2024-09-14T11:19:25.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.646+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.3 2024-09-14T11:19:25.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.650+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.4 2024-09-14T11:19:25.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.650+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.5 2024-09-14T11:19:25.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.650+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.6 2024-09-14T11:19:25.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.650+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.7 2024-09-14T11:19:25.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.650+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.8 2024-09-14T11:19:25.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.650+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.9 2024-09-14T11:19:25.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.654+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.10 2024-09-14T11:19:25.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.658+0000 7fdc45dd19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:25.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.658+0000 7fdc45dd19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 2024-09-14T11:19:25.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.662+0000 7fdc45dd19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.662+0000 7fdc45dd19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.662+0000 7fdc45dd19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.662+0000 7fdc45dd19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34, ofs0, ns] 2024-09-14T11:19:25.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.662+0000 7fdb22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366271 cookie 94101022120784 notifier 7545 bl.length()=995 2024-09-14T11:19:25.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.662+0000 7fdb22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.662+0000 7fdb22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.662+0000 7fdb22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.666+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_sources= new_sources= 2024-09-14T11:19:25.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.666+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential sources added=[] removed=[] 2024-09-14T11:19:25.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.666+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_dests= new_dests= 2024-09-14T11:19:25.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.666+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential dests added=[] removed=[] 2024-09-14T11:19:25.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.670+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.0 2024-09-14T11:19:25.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.670+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.1 2024-09-14T11:19:25.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.670+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.2 2024-09-14T11:19:25.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.674+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.3 2024-09-14T11:19:25.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.674+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.4 2024-09-14T11:19:25.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.674+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.5 2024-09-14T11:19:25.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.674+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.6 2024-09-14T11:19:25.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.674+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.7 2024-09-14T11:19:25.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.674+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.8 2024-09-14T11:19:25.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.674+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.9 2024-09-14T11:19:25.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.674+0000 7fdc45dd19c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34.10 2024-09-14T11:19:25.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.678+0000 7fdc45dd19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:25.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.678+0000 7fdc45dd19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 2024-09-14T11:19:25.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.678+0000 7fdc45dd19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.678+0000 7fdc45dd19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.678+0000 7fdc45dd19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.678+0000 7fdc45dd19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34, ofs0, ns] 2024-09-14T11:19:25.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.682+0000 7fdb22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366272 cookie 94101022120784 notifier 7545 bl.length()=963 2024-09-14T11:19:25.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.682+0000 7fdb22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 info.flags=0x17 2024-09-14T11:19:25.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.682+0000 7fdb22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 to cache LRU end 2024-09-14T11:19:25.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.682+0000 7fdb22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:25.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.682+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_sources= new_sources= 2024-09-14T11:19:25.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.682+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential sources added=[] removed=[] 2024-09-14T11:19:25.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.682+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): orig_dests= new_dests= 2024-09-14T11:19:25.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.682+0000 7fdc45dd19c0 20 handle_bi_update(): bucket=:error-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34]): potential dests added=[] removed=[] 2024-09-14T11:19:25.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.686+0000 7fdc45dd19c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:19:25.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.690+0000 7fdaf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.694+0000 7fdc45dd19c0 20 remove_watcher() i=0 2024-09-14T11:19:25.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.694+0000 7fdc45dd19c0 2 removed watcher, disabling cache 2024-09-14T11:19:25.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.698+0000 7fdc45dd19c0 20 remove_watcher() i=1 2024-09-14T11:19:25.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.702+0000 7fdc45dd19c0 20 remove_watcher() i=2 2024-09-14T11:19:25.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.702+0000 7fdc45dd19c0 20 remove_watcher() i=3 2024-09-14T11:19:25.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.706+0000 7fdc45dd19c0 20 remove_watcher() i=4 2024-09-14T11:19:25.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.706+0000 7fdc45dd19c0 20 remove_watcher() i=5 2024-09-14T11:19:25.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.710+0000 7fdc45dd19c0 20 remove_watcher() i=6 2024-09-14T11:19:25.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.714+0000 7fdc45dd19c0 20 remove_watcher() i=7 2024-09-14T11:19:25.727 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:19:25.759 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:25.759 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:25.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.802+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.806+0000 7f203a3619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.806+0000 7f203a3619c0 20 realm 2024-09-14T11:19:25.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.806+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.806+0000 7f203a3619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.806+0000 7f203a3619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:25.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.806+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.806+0000 7f203a3619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.806+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.810+0000 7f203a3619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.810+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.810+0000 7f203a3619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:25.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.810+0000 7f203a3619c0 20 searching for the correct realm 2024-09-14T11:19:25.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.814+0000 7f2037e67640 0 -- 172.21.15.148:0/3516249067 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f2028044070 msgr2=0x7f202803c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.822+0000 7f2037e67640 0 -- 172.21.15.148:0/3516249067 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x564b0ad16540 msgr2=0x564b0ad18930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.826+0000 7f203a3619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.826+0000 7f203a3619c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.826+0000 7f203a3619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.826+0000 7f203a3619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.826+0000 7f203a3619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.826+0000 7f203a3619c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.826+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 zone default found 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 4 Realm: () 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:25.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 zonegroup default 2024-09-14T11:19:25.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 started sync module instance, tier type = 2024-09-14T11:19:25.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.830+0000 7f203a3619c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:25.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.854+0000 7f203a3619c0 20 add_watcher() i=0 2024-09-14T11:19:25.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.854+0000 7f203a3619c0 20 add_watcher() i=1 2024-09-14T11:19:25.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.854+0000 7f203a3619c0 20 add_watcher() i=2 2024-09-14T11:19:25.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.854+0000 7f203a3619c0 20 add_watcher() i=3 2024-09-14T11:19:25.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.854+0000 7f203a3619c0 20 add_watcher() i=4 2024-09-14T11:19:25.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.854+0000 7f203a3619c0 20 add_watcher() i=5 2024-09-14T11:19:25.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.854+0000 7f203a3619c0 20 add_watcher() i=6 2024-09-14T11:19:25.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.858+0000 7f203a3619c0 20 add_watcher() i=7 2024-09-14T11:19:25.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.858+0000 7f203a3619c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:25.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f1eedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f203a3619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:25.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f203a3619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:25.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f203a3619c0 5 note: GC not initialized 2024-09-14T11:19:25.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f1eecfe1640 20 reqs_thread_entry: start 2024-09-14T11:19:25.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f203a3619c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:25.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f203a3619c0 20 Filter name: none 2024-09-14T11:19:25.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f1e667fc640 20 reqs_thread_entry: start 2024-09-14T11:19:25.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.862+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.866+0000 7f203a3619c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:25.863 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.866+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.866+0000 7f203a3619c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:25.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.866+0000 7f203a3619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:25.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.866+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.866+0000 7f203a3619c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:25.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.866+0000 7f203a3619c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.870+0000 7f203a3619c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:25.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.870+0000 7f203a3619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:25.869 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.870+0000 7f1eedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.874+0000 7f203a3619c0 20 remove_watcher() i=0 2024-09-14T11:19:25.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.874+0000 7f203a3619c0 2 removed watcher, disabling cache 2024-09-14T11:19:25.874 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.878+0000 7f203a3619c0 20 remove_watcher() i=1 2024-09-14T11:19:25.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.882+0000 7f203a3619c0 20 remove_watcher() i=2 2024-09-14T11:19:25.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.882+0000 7f203a3619c0 20 remove_watcher() i=3 2024-09-14T11:19:25.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.886+0000 7f203a3619c0 20 remove_watcher() i=4 2024-09-14T11:19:25.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.886+0000 7f203a3619c0 20 remove_watcher() i=5 2024-09-14T11:19:25.888 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.890+0000 7f203a3619c0 20 remove_watcher() i=6 2024-09-14T11:19:25.891 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:25.894+0000 7f203a3619c0 20 remove_watcher() i=7 2024-09-14T11:19:25.904 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:25.904 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:19:25.905 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-do-reshard id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:19:25.905 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:25.906 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:25.906 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:25.932 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:25.932 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:26.525 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:26.525 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:26.909 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:19:26.909 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:26.912 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:26.912 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.050 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.050 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.139 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.139 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.242 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.242 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.340 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.341 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.445 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.445 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.548 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.548 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.645 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.645 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.744 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.745 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.844 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.844 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:27.944 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:27.944 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.036 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.037 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.138 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.138 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.243 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.243 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.343 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.343 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.443 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.443 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.538 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.538 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.637 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.723 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.723 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.827 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.828 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:28.934 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:28.934 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:29.029 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:29.029 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:29.130 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:19:29.163 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:29.163 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:29.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 20 realm 2024-09-14T11:19:29.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:29.210 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.210+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.214+0000 7f72403c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.214+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.214+0000 7f72403c59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:29.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.214+0000 7f72403c59c0 20 searching for the correct realm 2024-09-14T11:19:29.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.218+0000 7f723d6ca640 0 -- 172.21.15.148:0/258663904 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55a723853570 msgr2=0x55a723855960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.223 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.226+0000 7f723decb640 0 -- 172.21.15.148:0/258663904 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f7238101780 msgr2=0x7f72380fc3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:29.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.230+0000 7f72403c59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:29.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.230+0000 7f72403c59c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:29.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.230+0000 7f72403c59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:29.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.230+0000 7f72403c59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:29.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.230+0000 7f72403c59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:29.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.230+0000 7f72403c59c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:29.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.230+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:29.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 zone default found 2024-09-14T11:19:29.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 4 Realm: () 2024-09-14T11:19:29.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:29.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:29.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:29.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 zonegroup default 2024-09-14T11:19:29.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 started sync module instance, tier type = 2024-09-14T11:19:29.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.234+0000 7f72403c59c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:29.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.254+0000 7f72403c59c0 20 add_watcher() i=0 2024-09-14T11:19:29.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.254+0000 7f72403c59c0 20 add_watcher() i=1 2024-09-14T11:19:29.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.254+0000 7f72403c59c0 20 add_watcher() i=2 2024-09-14T11:19:29.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.254+0000 7f72403c59c0 20 add_watcher() i=3 2024-09-14T11:19:29.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.254+0000 7f72403c59c0 20 add_watcher() i=4 2024-09-14T11:19:29.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.254+0000 7f72403c59c0 20 add_watcher() i=5 2024-09-14T11:19:29.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.254+0000 7f72403c59c0 20 add_watcher() i=6 2024-09-14T11:19:29.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.258+0000 7f72403c59c0 20 add_watcher() i=7 2024-09-14T11:19:29.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.258+0000 7f72403c59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:29.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f70ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:29.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:29.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 5 note: GC not initialized 2024-09-14T11:19:29.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f70ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:29.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:29.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 Filter name: none 2024-09-14T11:19:29.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f705ffff640 20 reqs_thread_entry: start 2024-09-14T11:19:29.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:29.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:29.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:29.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:29.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:29.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.262+0000 7f72403c59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:29.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.266+0000 7f70ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.270+0000 7f72403c59c0 20 remove_watcher() i=0 2024-09-14T11:19:29.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.270+0000 7f72403c59c0 2 removed watcher, disabling cache 2024-09-14T11:19:29.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.274+0000 7f72403c59c0 20 remove_watcher() i=1 2024-09-14T11:19:29.273 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.274+0000 7f72403c59c0 20 remove_watcher() i=2 2024-09-14T11:19:29.275 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.278+0000 7f72403c59c0 20 remove_watcher() i=3 2024-09-14T11:19:29.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.278+0000 7f72403c59c0 20 remove_watcher() i=4 2024-09-14T11:19:29.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.282+0000 7f72403c59c0 20 remove_watcher() i=5 2024-09-14T11:19:29.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.286+0000 7f72403c59c0 20 remove_watcher() i=6 2024-09-14T11:19:29.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.286+0000 7f72403c59c0 20 remove_watcher() i=7 2024-09-14T11:19:29.299 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.299 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:19:29.299 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-do-reshard id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:29.299 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.300 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:19:29.336 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:29.336 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:29.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.382+0000 7f05682c19c0 20 realm 2024-09-14T11:19:29.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:29.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:29.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.386+0000 7f05682c19c0 20 searching for the correct realm 2024-09-14T11:19:29.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.390+0000 7f05655c6640 0 -- 172.21.15.148:0/3763056642 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f0560039060 msgr2=0x7f05600613c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.398+0000 7f05655c6640 0 -- 172.21.15.148:0/3763056642 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5645008fe3b0 msgr2=0x5645009007a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:29.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:29.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:29.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:29.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:29.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:29.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 zone default found 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 4 Realm: () 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:29.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 zonegroup default 2024-09-14T11:19:29.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.410+0000 7f05682c19c0 20 started sync module instance, tier type = 2024-09-14T11:19:29.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.410+0000 7f05682c19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:29.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=0 2024-09-14T11:19:29.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=1 2024-09-14T11:19:29.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=2 2024-09-14T11:19:29.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=3 2024-09-14T11:19:29.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=4 2024-09-14T11:19:29.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=5 2024-09-14T11:19:29.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=6 2024-09-14T11:19:29.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.430+0000 7f05682c19c0 20 add_watcher() i=7 2024-09-14T11:19:29.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.430+0000 7f05682c19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:29.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f04177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:29.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:29.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 5 note: GC not initialized 2024-09-14T11:19:29.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f04167fc640 20 reqs_thread_entry: start 2024-09-14T11:19:29.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:29.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 20 Filter name: none 2024-09-14T11:19:29.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f0387fff640 20 reqs_thread_entry: start 2024-09-14T11:19:29.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:19:29.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 : miss 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:29.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.434+0000 7f05682c19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 2024-09-14T11:19:29.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.446+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.446+0000 7f05682c19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.446+0000 7f05682c19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.446+0000 7f05682c19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35, ofs0, ns] 2024-09-14T11:19:29.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94854362240128 notifier 7136 bl.length()=995 2024-09-14T11:19:29.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_sources= new_sources= 2024-09-14T11:19:29.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential sources added=[] removed=[] 2024-09-14T11:19:29.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_dests= new_dests= 2024-09-14T11:19:29.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential dests added=[] removed=[] 2024-09-14T11:19:29.458 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f05682c19c0 time 2024-09-14T11:19:29.465557+0000 2024-09-14T11:19:29.458 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:29.459 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:29.459 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f056bb9b2eb] 2024-09-14T11:19:29.459 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f056bb9b49f] 2024-09-14T11:19:29.459 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644fedd4c01] 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5644fede9f3a] 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f056aa01d90] 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.462+0000 7f05682c19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f05682c19c0 time 2024-09-14T11:19:29.465557+0000 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f056bb9b2eb] 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f056bb9b49f] 2024-09-14T11:19:29.460 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644fedd4c01] 2024-09-14T11:19:29.461 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5644fede9f3a] 2024-09-14T11:19:29.461 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:19:29.461 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f056aa01d90] 2024-09-14T11:19:29.461 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:19:29.461 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:19:29.461 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.461 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:19:29.461 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f05682c19c0 thread_name:radosgw-admin 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f056aa1a520] 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f056bb9b345] 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f056bb9b49f] 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644fedd4c01] 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5644fede9f3a] 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:19:29.475 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f056aa01d90] 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.462+0000 7f05682c19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f05682c19c0 thread_name:radosgw-admin 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f056aa1a520] 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f056bb9b345] 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f056bb9b49f] 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644fedd4c01] 2024-09-14T11:19:29.476 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5644fede9f3a] 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f056aa01d90] 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:19:29.358+0000 7f05665c8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:19:29.358+0000 7f05655c6640 10 monclient: get_auth_request con 0x5645006d1cc0 auth_method 0 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: dump: 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.477 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: dump: 2024-09-14T11:19:29.478 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7124 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:19:29.362+0000 7f05682c19c0 4 set_mon_vals no callback set 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: shutdown 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 asok(0x564500607d90) unregister_commands rotate-key 2024-09-14T11:19:29.479 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: build_initial_monmap 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 build_initial for_mkfs: 0 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: monmap: 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding auth protocol: cephx 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding auth protocol: cephx 2024-09-14T11:19:29.480 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding auth protocol: cephx 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:19:29.362+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: starting msgr at 2024-09-14T11:19:29.481 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: starting objecter 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 asok(0x564500607d90) register_command objecter_requests hook 0x564500846020 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: setting wanted keys 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: calling monclient init 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: init 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding auth protocol: cephx 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding auth protocol: cephx 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding auth protocol: cephx 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.482 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:19:29.362+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:19:29.362+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 asok(0x564500607d90) register_command rotate-key hook 0x564500814f98 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-c con 0x5645006d0890 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-a con 0x5645006d1cc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-b con 0x56450075b950 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.483 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): authenticate will time out at 2828.426325s 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): get_auth_request con 0x5645006d0890 auth_method 0 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): get_auth_request con 0x5645006d1cc0 auth_method 0 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.484 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): handle_auth_done global_id 7127 payload 824 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient: _finish_hunting 0 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:19:29.362+0000 7f0565dc7640 1 monclient: found mon.noname-c 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:19:29.362+0000 7f05665c8640 10 monclient: get_auth_request con 0x56450075b950 auth_method 0 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: dump: 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.485 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: dump: 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.486 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:19:29.362+0000 7f0453e07640 4 set_mon_vals no callback set 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7127 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: init done 2024-09-14T11:19:29.487 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:19:29.366+0000 7f0452604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:19:29.366+0000 7f0452604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:19:29.366+0000 7f0452604640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:19:29.366+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f044c0718d0 auth_method 0 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:19:29.366+0000 7f05665c8640 10 monclient: get_auth_request con 0x5645008527e0 auth_method 0 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:19:29.370+0000 7f0565dc7640 10 monclient: get_auth_request con 0x56450085f6e0 auth_method 0 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:19:29.370+0000 7f05655c6640 10 monclient: get_auth_request con 0x564500863d80 auth_method 0 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:19:29.370+0000 7f05682c19c0 10 monclient: build_initial_monmap 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:19:29.370+0000 7f05682c19c0 1 build_initial for_mkfs: 0 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:19:29.370+0000 7f05682c19c0 10 monclient: monmap: 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:19:29.488 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding auth protocol: cephx 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding auth protocol: cephx 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding auth protocol: cephx 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.489 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:19:29.370+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 asok(0x564500607d90) register_command objecter_requests cmddesc objecter_requests hook 0x56450086c480 EEXIST 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:19:29.370+0000 7f05682c19c0 10 monclient: init 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding auth protocol: cephx 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding auth protocol: cephx 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding auth protocol: cephx 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.490 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:19:29.370+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:19:29.370+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 asok(0x564500607d90) register_command rotate-key cmddesc rotate-key hook 0x564500867290 EEXIST 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:19:29.491 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-a con 0x564500890630 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-c con 0x56450088ff60 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-b con 0x56450088e940 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): authenticate will time out at 2828.436117s 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): get_auth_request con 0x564500890630 auth_method 0 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): get_auth_request con 0x56450088ff60 auth_method 0 2024-09-14T11:19:29.492 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:19:29.374+0000 7f05665c8640 10 monclient(hunting): get_auth_request con 0x56450088e940 auth_method 0 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:19:29.374+0000 7f05665c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:19:29.374+0000 7f05665c8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:19:29.374+0000 7f05665c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): handle_auth_done global_id 7593 payload 824 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient: _finish_hunting 0 2024-09-14T11:19:29.493 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:19:29.374+0000 7f0565dc7640 1 monclient: found mon.noname-a 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: dump: 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.494 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: dump: 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.495 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7593 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:19:29.374+0000 7f0566dc9640 4 set_mon_vals no callback set 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:19:29.374+0000 7f044b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:19:29.374+0000 7f044b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:19:29.374+0000 7f044b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f04400717e0 auth_method 0 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: get_monmap_and_config 2024-09-14T11:19:29.496 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: build_initial_monmap 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:19:29.374+0000 7f05682c19c0 1 build_initial for_mkfs: 0 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: monmap: 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding auth protocol: cephx 2024-09-14T11:19:29.497 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding auth protocol: cephx 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding auth protocol: cephx 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.498 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:19:29.374+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: init 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding auth protocol: cephx 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding auth protocol: cephx 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding auth protocol: cephx 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.499 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:19:29.374+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:19:29.378+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 asok(0x564500607d90) register_command rotate-key cmddesc rotate-key hook 0x7ffdb105bd18 EEXIST 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-c con 0x5645008e43b0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-b con 0x5645008e4790 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-a con 0x5645008b5370 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.500 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): authenticate will time out at 2828.440227s 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): get_auth_request con 0x5645008e43b0 auth_method 0 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): get_auth_request con 0x5645008b5370 auth_method 0 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.501 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): handle_auth_done global_id 7133 payload 274 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient: _finish_hunting 0 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:19:29.378+0000 7f0565dc7640 1 monclient: found mon.noname-c 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: dump: 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.502 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7133 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:19:29.378+0000 7f05682c19c0 4 set_mon_vals no callback set 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.503 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: dump: 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: shutdown 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: build_initial_monmap 2024-09-14T11:19:29.504 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 build_initial for_mkfs: 0 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: monmap: 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding auth protocol: cephx 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding auth protocol: cephx 2024-09-14T11:19:29.505 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding auth protocol: cephx 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:19:29.378+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: starting msgr at 2024-09-14T11:19:29.506 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: starting objecter 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 asok(0x564500607d90) register_command objecter_requests cmddesc objecter_requests hook 0x5645008903a0 EEXIST 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: setting wanted keys 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: calling monclient init 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: init 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding auth protocol: cephx 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding auth protocol: cephx 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding auth protocol: cephx 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.507 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:19:29.378+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:19:29.378+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 asok(0x564500607d90) register_command rotate-key cmddesc rotate-key hook 0x564500892598 EEXIST 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-b con 0x5645008b5370 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-a con 0x5645008e43b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-c con 0x5645008e2490 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.508 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): authenticate will time out at 2828.442834s 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): get_auth_request con 0x5645008e43b0 auth_method 0 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): get_auth_request con 0x5645008e2490 auth_method 0 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.509 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): get_auth_request con 0x5645008b5370 auth_method 0 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_done global_id 7136 payload 824 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient: _finish_hunting 0 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:19:29.378+0000 7f05665c8640 1 monclient: found mon.noname-c 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: dump: 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.510 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7136 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:29.511 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: dump: 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:19:29.378+0000 7f04497fa640 4 set_mon_vals no callback set 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: init done 2024-09-14T11:19:29.512 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cr dump hook 0x5645008dea38 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:19:29.382+0000 7f04377fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:19:29.382+0000 7f04377fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:19:29.382+0000 7f04377fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:19:29.382+0000 7f0565dc7640 10 monclient: get_auth_request con 0x7f04300718d0 auth_method 0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:19:29.382+0000 7f05655c6640 10 monclient: get_auth_request con 0x5645008fe3b0 auth_method 0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:19:29.382+0000 7f05682c19c0 20 realm 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:19:29.386+0000 7f05682c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:19:29.386+0000 7f0565dc7640 10 monclient: get_auth_request con 0x564500902580 auth_method 0 2024-09-14T11:19:29.513 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:19:29.386+0000 7f05655c6640 10 monclient: get_auth_request con 0x564500905de0 auth_method 0 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 searching for the correct realm 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:19:29.386+0000 7f05665c8640 10 monclient: get_auth_request con 0x56450090ab00 auth_method 0 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:19:29.390+0000 7f0565dc7640 10 monclient: get_auth_request con 0x7f05580709a0 auth_method 0 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:19:29.390+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f0560039060 auth_method 0 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:19:29.390+0000 7f05655c6640 0 -- 172.21.15.148:0/3763056642 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f0560039060 msgr2=0x7f05600613c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:19:29.390+0000 7f04377fe640 1 client.7136.objecter ms_handle_reset 0x7f0560039060 session 0x7f0560062200 osd.5 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:19:29.390+0000 7f04377fe640 10 monclient: _renew_subs 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:19:29.390+0000 7f04377fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:19:29.394+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f0430081bd0 auth_method 0 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:19:29.394+0000 7f05665c8640 10 monclient: get_auth_request con 0x7f055808d8c0 auth_method 0 2024-09-14T11:19:29.514 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:19:29.398+0000 7f0565dc7640 10 monclient: get_auth_request con 0x7f0560017040 auth_method 0 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:19:29.398+0000 7f05655c6640 0 -- 172.21.15.148:0/3763056642 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5645008fe3b0 msgr2=0x5645009007a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:19:29.398+0000 7f04377fe640 1 client.7136.objecter ms_handle_reset 0x5645008fe3b0 session 0x5645008fdd30 osd.6 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:19:29.398+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f0560039060 auth_method 0 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.515 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 zone default found 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:19:29.406+0000 7f05682c19c0 4 Realm: () 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:19:29.406+0000 7f05682c19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:19:29.406+0000 7f05682c19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:19:29.406+0000 7f05682c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 zonegroup default 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 started sync module instance, tier type = 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:29.516 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=0 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=1 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=2 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=3 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=4 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=5 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=6 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:19:29.430+0000 7f05682c19c0 20 add_watcher() i=7 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:19:29.430+0000 7f05682c19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding auth protocol: cephx 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding auth protocol: cephx 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding auth protocol: cephx 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.517 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:19:29.434+0000 7f04177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:19:29.434+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cache list hook 0x5645008b1bb0 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cache inspect hook 0x5645008b1bb0 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cache erase hook 0x5645008b1bb0 2024-09-14T11:19:29.518 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cache zap hook 0x5645008b1bb0 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 note: GC not initialized 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:19:29.434+0000 7f04167fc640 20 reqs_thread_entry: start 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command sync trace show hook 0x7f0558076070 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command sync trace history hook 0x7f0558076070 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command sync trace active hook 0x7f0558076070 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command sync trace active_short hook 0x7f0558076070 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 Filter name: none 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:19:29.434+0000 7f0387fff640 20 reqs_thread_entry: start 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:19:29.519 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 : miss 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:19:29.446+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:19:29.446+0000 7f05682c19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:19:29.446+0000 7f05682c19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:19:29.446+0000 7f05682c19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35, ofs0, ns] 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94854362240128 notifier 7136 bl.length()=995 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.520 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_sources= new_sources= 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential sources added=[] removed=[] 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_dests= new_dests= 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential dests added=[] removed=[] 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:19:29.462+0000 7f05682c19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f05682c19c0 time 2024-09-14T11:19:29.465557+0000 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f056bb9b2eb] 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f056bb9b49f] 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644fedd4c01] 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5644fede9f3a] 2024-09-14T11:19:29.521 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f056aa01d90] 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:19:29.462+0000 7f05682c19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f05682c19c0 thread_name:radosgw-admin 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f056aa1a520] 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f056bb9b345] 2024-09-14T11:19:29.522 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f056bb9b49f] 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644fedd4c01] 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5644fede9f3a] 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f056aa01d90] 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:19:29.523 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:29.524 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:19:29.525 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:19:29.526 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:19:29.527 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:29.528 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0387fff640 / http_manager 2024-09-14T11:19:29.529 INFO:tasks.workunit.client.0.smithi148.stderr: 7f04167fc640 / http_manager 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f04177fe640 / rgw_dt_lg_renew 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f04377fe640 / ms_dispatch 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f04497fa640 / io_context_pool 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f044b7fe640 / ms_dispatch 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0452604640 / ms_dispatch 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0453e07640 / io_context_pool 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f05655c6640 / msgr-worker-2 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0565dc7640 / msgr-worker-1 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f05665c8640 / msgr-worker-0 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0566dc9640 / io_context_pool 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: 7f05682c19c0 / radosgw-admin 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.121652.log 2024-09-14T11:19:29.530 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:19:29.358+0000 7f05665c8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:19:29.358+0000 7f05655c6640 10 monclient: get_auth_request con 0x5645006d1cc0 auth_method 0 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: dump: 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.531 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:19:29.362+0000 7f0453e07640 10 monclient: dump: 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.532 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7124 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:19:29.362+0000 7f05682c19c0 4 set_mon_vals no callback set 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: shutdown 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 asok(0x564500607d90) unregister_commands rotate-key 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: build_initial_monmap 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 build_initial for_mkfs: 0 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: monmap: 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:29.533 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding auth protocol: cephx 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding auth protocol: cephx 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding auth protocol: cephx 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.534 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: crc 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x56450081b920) adding con mode: secure 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:19:29.362+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: starting msgr at 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: starting objecter 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 asok(0x564500607d90) register_command objecter_requests hook 0x564500846020 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: setting wanted keys 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: calling monclient init 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: init 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding auth protocol: cephx 2024-09-14T11:19:29.535 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding auth protocol: cephx 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding auth protocol: cephx 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: crc 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 AuthRegistry(0x564500814e50) adding con mode: secure 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:19:29.362+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.536 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:19:29.362+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 asok(0x564500607d90) register_command rotate-key hook 0x564500814f98 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-c con 0x5645006d0890 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-a con 0x5645006d1cc0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-b con 0x56450075b950 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient(hunting): authenticate will time out at 2828.426325s 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): get_auth_request con 0x5645006d0890 auth_method 0 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.537 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): get_auth_request con 0x5645006d1cc0 auth_method 0 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:19:29.362+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient(hunting): handle_auth_done global_id 7127 payload 824 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient: _finish_hunting 0 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:19:29.362+0000 7f0565dc7640 1 monclient: found mon.noname-c 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:19:29.362+0000 7f0565dc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.538 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:19:29.362+0000 7f05665c8640 10 monclient: get_auth_request con 0x56450075b950 auth_method 0 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: dump: 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.539 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:19:29.362+0000 7f0452604640 10 monclient: dump: 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.540 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:19:29.362+0000 7f0453e07640 4 set_mon_vals no callback set 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:19:29.362+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7127 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:19:29.362+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:19:29.362+0000 7f05682c19c0 1 librados: init done 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:19:29.366+0000 7f0452604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:19:29.366+0000 7f0452604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:19:29.366+0000 7f0452604640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:19:29.366+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f044c0718d0 auth_method 0 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:19:29.366+0000 7f05665c8640 10 monclient: get_auth_request con 0x5645008527e0 auth_method 0 2024-09-14T11:19:29.541 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:19:29.370+0000 7f0565dc7640 10 monclient: get_auth_request con 0x56450085f6e0 auth_method 0 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:19:29.370+0000 7f05655c6640 10 monclient: get_auth_request con 0x564500863d80 auth_method 0 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:19:29.370+0000 7f05682c19c0 10 monclient: build_initial_monmap 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:19:29.370+0000 7f05682c19c0 1 build_initial for_mkfs: 0 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:19:29.370+0000 7f05682c19c0 10 monclient: monmap: 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:19:29.542 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding auth protocol: cephx 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding auth protocol: cephx 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding auth protocol: cephx 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.543 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: crc 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500868ac0) adding con mode: secure 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:19:29.370+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 asok(0x564500607d90) register_command objecter_requests cmddesc objecter_requests hook 0x56450086c480 EEXIST 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:19:29.370+0000 7f05682c19c0 10 monclient: init 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding auth protocol: cephx 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding auth protocol: cephx 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding auth protocol: cephx 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.544 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: crc 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:19:29.370+0000 7f05682c19c0 5 AuthRegistry(0x564500867148) adding con mode: secure 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:19:29.370+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:19:29.370+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 asok(0x564500607d90) register_command rotate-key cmddesc rotate-key hook 0x564500867290 EEXIST 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-a con 0x564500890630 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-c con 0x56450088ff60 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:19:29.545 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-b con 0x56450088e940 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient(hunting): authenticate will time out at 2828.436117s 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): get_auth_request con 0x564500890630 auth_method 0 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): get_auth_request con 0x56450088ff60 auth_method 0 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.546 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:19:29.374+0000 7f05665c8640 10 monclient(hunting): get_auth_request con 0x56450088e940 auth_method 0 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:19:29.374+0000 7f05665c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:19:29.374+0000 7f05665c8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:19:29.374+0000 7f05665c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient(hunting): handle_auth_done global_id 7593 payload 824 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient: _finish_hunting 0 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:19:29.374+0000 7f0565dc7640 1 monclient: found mon.noname-a 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:19:29.374+0000 7f0565dc7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.547 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: dump: 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.548 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:19:29.374+0000 7f044b7fe640 10 monclient: dump: 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7593 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.549 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:19:29.374+0000 7f0566dc9640 4 set_mon_vals no callback set 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:19:29.374+0000 7f044b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:19:29.374+0000 7f044b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:19:29.374+0000 7f044b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:19:29.374+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f04400717e0 auth_method 0 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: get_monmap_and_config 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: build_initial_monmap 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:19:29.374+0000 7f05682c19c0 1 build_initial for_mkfs: 0 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: monmap: 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:19:29.550 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding auth protocol: cephx 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding auth protocol: cephx 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding auth protocol: cephx 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.551 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: crc 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x5645008affe0) adding con mode: secure 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:19:29.374+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:19:29.374+0000 7f05682c19c0 10 monclient: init 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding auth protocol: cephx 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding auth protocol: cephx 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding auth protocol: cephx 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.552 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: crc 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:19:29.374+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105bbd0) adding con mode: secure 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:19:29.374+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:19:29.378+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 asok(0x564500607d90) register_command rotate-key cmddesc rotate-key hook 0x7ffdb105bd18 EEXIST 2024-09-14T11:19:29.553 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-c con 0x5645008e43b0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-b con 0x5645008e4790 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-a con 0x5645008b5370 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): authenticate will time out at 2828.440227s 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): get_auth_request con 0x5645008e43b0 auth_method 0 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): get_auth_request con 0x5645008b5370 auth_method 0 2024-09-14T11:19:29.554 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): handle_auth_done global_id 7133 payload 274 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient: _finish_hunting 0 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:19:29.378+0000 7f0565dc7640 1 monclient: found mon.noname-c 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.555 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: dump: 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.556 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7133 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:19:29.378+0000 7f05682c19c0 4 set_mon_vals no callback set 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:19:29.378+0000 7f04497fa640 10 monclient: dump: 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.557 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: shutdown 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: build_initial_monmap 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 build_initial for_mkfs: 0 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: monmap: 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:19:29.558 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding auth protocol: cephx 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding auth protocol: cephx 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding auth protocol: cephx 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.559 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: crc 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x5645008b4060) adding con mode: secure 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:19:29.378+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: starting msgr at 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: starting objecter 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 asok(0x564500607d90) register_command objecter_requests cmddesc objecter_requests hook 0x5645008903a0 EEXIST 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: setting wanted keys 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: calling monclient init 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: init 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding auth protocol: cephx 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding auth protocol: cephx 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding auth protocol: cephx 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.560 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: crc 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 AuthRegistry(0x564500892450) adding con mode: secure 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:19:29.378+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:19:29.378+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 asok(0x564500607d90) register_command rotate-key cmddesc rotate-key hook 0x564500892598 EEXIST 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:19:29.561 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-b con 0x5645008b5370 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-a con 0x5645008e43b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): picked mon.noname-c con 0x5645008e2490 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient(hunting): authenticate will time out at 2828.442834s 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): get_auth_request con 0x5645008e43b0 auth_method 0 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): get_auth_request con 0x5645008e2490 auth_method 0 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.562 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:19:29.378+0000 7f05655c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): get_auth_request con 0x5645008b5370 auth_method 0 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:19:29.378+0000 7f0565dc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient(hunting): handle_auth_done global_id 7136 payload 824 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient: _finish_hunting 0 2024-09-14T11:19:29.563 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:19:29.378+0000 7f05665c8640 1 monclient: found mon.noname-c 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:19:29.378+0000 7f05665c8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: dump: 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.564 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: _finish_auth 0 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: _check_auth_tickets 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 monclient: authenticate success, global_id 7136 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:29.565 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:19:29.378+0000 7f04377fe640 10 monclient: dump: 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:19:29.378+0000 7f04497fa640 4 set_mon_vals no callback set 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _renew_subs 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:19:29.378+0000 7f05682c19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:19:29.378+0000 7f05682c19c0 1 librados: init done 2024-09-14T11:19:29.566 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:19:29.378+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cr dump hook 0x5645008dea38 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:19:29.382+0000 7f04377fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:19:29.382+0000 7f04377fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:19:29.382+0000 7f04377fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:19:29.382+0000 7f0565dc7640 10 monclient: get_auth_request con 0x7f04300718d0 auth_method 0 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:19:29.382+0000 7f05655c6640 10 monclient: get_auth_request con 0x5645008fe3b0 auth_method 0 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:19:29.382+0000 7f05682c19c0 20 realm 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:19:29.382+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:19:29.386+0000 7f05682c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:29.567 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:19:29.386+0000 7f0565dc7640 10 monclient: get_auth_request con 0x564500902580 auth_method 0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:19:29.386+0000 7f05655c6640 10 monclient: get_auth_request con 0x564500905de0 auth_method 0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:19:29.386+0000 7f05682c19c0 20 searching for the correct realm 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:19:29.386+0000 7f05665c8640 10 monclient: get_auth_request con 0x56450090ab00 auth_method 0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:19:29.390+0000 7f0565dc7640 10 monclient: get_auth_request con 0x7f05580709a0 auth_method 0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:19:29.390+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f0560039060 auth_method 0 2024-09-14T11:19:29.568 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:19:29.390+0000 7f05655c6640 0 -- 172.21.15.148:0/3763056642 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f0560039060 msgr2=0x7f05600613c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:19:29.390+0000 7f04377fe640 1 client.7136.objecter ms_handle_reset 0x7f0560039060 session 0x7f0560062200 osd.5 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:19:29.390+0000 7f04377fe640 10 monclient: _renew_subs 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:19:29.390+0000 7f04377fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:19:29.394+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f0430081bd0 auth_method 0 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:19:29.394+0000 7f05665c8640 10 monclient: get_auth_request con 0x7f055808d8c0 auth_method 0 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:19:29.398+0000 7f0565dc7640 10 monclient: get_auth_request con 0x7f0560017040 auth_method 0 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:19:29.398+0000 7f05655c6640 0 -- 172.21.15.148:0/3763056642 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5645008fe3b0 msgr2=0x5645009007a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:19:29.398+0000 7f04377fe640 1 client.7136.objecter ms_handle_reset 0x5645008fe3b0 session 0x5645008fdd30 osd.6 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:19:29.398+0000 7f05655c6640 10 monclient: get_auth_request con 0x7f0560039060 auth_method 0 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:29.569 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 zone default found 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:19:29.406+0000 7f05682c19c0 4 Realm: () 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:19:29.406+0000 7f05682c19c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:19:29.406+0000 7f05682c19c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:19:29.406+0000 7f05682c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 zonegroup default 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:19:29.406+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.570 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 started sync module instance, tier type = 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:19:29.410+0000 7f05682c19c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=0 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=1 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=2 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=3 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=4 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=5 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:19:29.426+0000 7f05682c19c0 20 add_watcher() i=6 2024-09-14T11:19:29.571 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:19:29.430+0000 7f05682c19c0 20 add_watcher() i=7 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:19:29.430+0000 7f05682c19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding auth protocol: cephx 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding auth protocol: cephx 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding auth protocol: cephx 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:19:29.434+0000 7f04177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.572 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: crc 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 AuthRegistry(0x7ffdb105c0b0) adding con mode: secure 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:19:29.434+0000 7f05682c19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cache list hook 0x5645008b1bb0 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cache inspect hook 0x5645008b1bb0 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cache erase hook 0x5645008b1bb0 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command cache zap hook 0x5645008b1bb0 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 note: GC not initialized 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:19:29.434+0000 7f04167fc640 20 reqs_thread_entry: start 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command sync trace show hook 0x7f0558076070 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command sync trace history hook 0x7f0558076070 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command sync trace active hook 0x7f0558076070 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:19:29.434+0000 7f05682c19c0 5 asok(0x564500607d90) register_command sync trace active_short hook 0x7f0558076070 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:29.573 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 Filter name: none 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:19:29.434+0000 7f0387fff640 20 reqs_thread_entry: start 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 : miss 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:19:29.434+0000 7f05682c19c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:19:29.434+0000 7f05682c19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 2024-09-14T11:19:29.574 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:19:29.446+0000 7f05682c19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:19:29.446+0000 7f05682c19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:19:29.446+0000 7f05682c19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:19:29.446+0000 7f05682c19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35, ofs0, ns] 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 94854362240128 notifier 7136 bl.length()=995 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:19:29.446+0000 7f04497fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_sources= new_sources= 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential sources added=[] removed=[] 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_dests= new_dests= 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:19:29.450+0000 7f05682c19c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential dests added=[] removed=[] 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:19:29.462+0000 7f05682c19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f05682c19c0 time 2024-09-14T11:19:29.465557+0000 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.575 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f056bb9b2eb] 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f056bb9b49f] 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644fedd4c01] 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5644fede9f3a] 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f056aa01d90] 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:19:29.462+0000 7f05682c19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f05682c19c0 thread_name:radosgw-admin 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f056aa1a520] 2024-09-14T11:19:29.576 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f056bb9b345] 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f056bb9b49f] 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644fedd4c01] 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5644fede9f3a] 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f056aa01d90] 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:19:29.577 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:19:29.578 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:19:29.579 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:19:29.580 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:19:29.581 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:19:29.582 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0387fff640 / http_manager 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 7f04167fc640 / http_manager 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 7f04177fe640 / rgw_dt_lg_renew 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 7f04377fe640 / ms_dispatch 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 7f04497fa640 / io_context_pool 2024-09-14T11:19:29.583 INFO:tasks.workunit.client.0.smithi148.stderr: 7f044b7fe640 / ms_dispatch 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0452604640 / ms_dispatch 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0453e07640 / io_context_pool 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: 7f05655c6640 / msgr-worker-2 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0565dc7640 / msgr-worker-1 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: 7f05665c8640 / msgr-worker-0 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: 7f0566dc9640 / io_context_pool 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: 7f05682c19c0 / radosgw-admin 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:19:29.467610Z_17163f81-5b98-4719-b266-2bb0aadaf0c7/log 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:19:29.584 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:19:29.587 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:29.587 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:29.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.542+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.587 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 realm 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.546+0000 7fec94b019c0 20 searching for the correct realm 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.554+0000 7fec91e06640 0 -- 172.21.15.148:0/2085124386 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fec84017030 msgr2=0x7fec8405d370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.558+0000 7fec92e08640 0 -- 172.21.15.148:0/2085124386 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55c8eb780900 msgr2=0x55c8eb782dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:29.588 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 zone default found 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 4 Realm: () 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 zonegroup default 2024-09-14T11:19:29.589 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.566+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.570+0000 7fec94b019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.570+0000 7fec94b019c0 20 started sync module instance, tier type = 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.570+0000 7fec94b019c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.586+0000 7fec94b019c0 20 add_watcher() i=0 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.586+0000 7fec94b019c0 20 add_watcher() i=1 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.586+0000 7fec94b019c0 20 add_watcher() i=2 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.586+0000 7fec94b019c0 20 add_watcher() i=3 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.586+0000 7fec94b019c0 20 add_watcher() i=4 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.586+0000 7fec94b019c0 20 add_watcher() i=5 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.586+0000 7fec94b019c0 20 add_watcher() i=6 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.590+0000 7fec94b019c0 20 add_watcher() i=7 2024-09-14T11:19:29.590 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.590+0000 7fec94b019c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:29.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7feb48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 5 note: GC not initialized 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7feac37fe640 20 reqs_thread_entry: start 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 Filter name: none 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7feac17fa640 20 reqs_thread_entry: start 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:29.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:19:29.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:29.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:29.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:19:29.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.594+0000 7fec94b019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:29.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.598+0000 7feb48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.602+0000 7fec94b019c0 20 remove_watcher() i=0 2024-09-14T11:19:29.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.602+0000 7fec94b019c0 2 removed watcher, disabling cache 2024-09-14T11:19:29.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.602+0000 7fec94b019c0 20 remove_watcher() i=1 2024-09-14T11:19:29.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.606+0000 7fec94b019c0 20 remove_watcher() i=2 2024-09-14T11:19:29.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.606+0000 7fec94b019c0 20 remove_watcher() i=3 2024-09-14T11:19:29.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.610+0000 7fec94b019c0 20 remove_watcher() i=4 2024-09-14T11:19:29.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.610+0000 7fec94b019c0 20 remove_watcher() i=5 2024-09-14T11:19:29.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.614+0000 7fec94b019c0 20 remove_watcher() i=6 2024-09-14T11:19:29.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.618+0000 7fec94b019c0 20 remove_watcher() i=7 2024-09-14T11:19:29.630 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.631 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:19:29.631 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-do-reshard id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:29.631 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:19:29.632 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:29.632 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:29.674 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:19:29.675 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:19:29.740 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:29.775 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:29.775 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:29.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.818+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 realm 2024-09-14T11:19:29.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:29.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:29.822 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.822+0000 7ff91d4539c0 20 searching for the correct realm 2024-09-14T11:19:29.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.830+0000 7ff91af59640 0 -- 172.21.15.148:0/2720013517 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7ff90c09d040 msgr2=0x7ff90c0943b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.834+0000 7ff91af59640 0 -- 172.21.15.148:0/2720013517 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x563dc53cf980 msgr2=0x563dc53d1db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:29.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:19:29.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:29.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:29.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:29.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:19:29.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:29.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 zone default found 2024-09-14T11:19:29.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 4 Realm: () 2024-09-14T11:19:29.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:19:29.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:19:29.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:29.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 zonegroup default 2024-09-14T11:19:29.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.842+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.846+0000 7ff91d4539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.846+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.846+0000 7ff91d4539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.846+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.846+0000 7ff91d4539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.846+0000 7ff91d4539c0 20 started sync module instance, tier type = 2024-09-14T11:19:29.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.846+0000 7ff91d4539c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:19:29.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.862+0000 7ff91d4539c0 20 add_watcher() i=0 2024-09-14T11:19:29.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.862+0000 7ff91d4539c0 20 add_watcher() i=1 2024-09-14T11:19:29.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.862+0000 7ff91d4539c0 20 add_watcher() i=2 2024-09-14T11:19:29.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.862+0000 7ff91d4539c0 20 add_watcher() i=3 2024-09-14T11:19:29.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.862+0000 7ff91d4539c0 20 add_watcher() i=4 2024-09-14T11:19:29.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.862+0000 7ff91d4539c0 20 add_watcher() i=5 2024-09-14T11:19:29.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.862+0000 7ff91d4539c0 20 add_watcher() i=6 2024-09-14T11:19:29.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.866+0000 7ff91d4539c0 20 add_watcher() i=7 2024-09-14T11:19:29.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.866+0000 7ff91d4539c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:29.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff7d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:29.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:29.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 5 note: GC not initialized 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff74bfff640 20 reqs_thread_entry: start 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 20 Filter name: none 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff749ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 : miss 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:19:29.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.870+0000 7ff91d4539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.874+0000 7ff91d4539c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to be held by another RGW process; skipping for now 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.874+0000 7ff7d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.878+0000 7ff91d4539c0 20 remove_watcher() i=0 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.878+0000 7ff91d4539c0 2 removed watcher, disabling cache 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.882+0000 7ff91d4539c0 20 remove_watcher() i=1 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.882+0000 7ff91d4539c0 20 remove_watcher() i=2 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.886+0000 7ff91d4539c0 20 remove_watcher() i=3 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.886+0000 7ff91d4539c0 20 remove_watcher() i=4 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.890+0000 7ff91d4539c0 20 remove_watcher() i=5 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.890+0000 7ff91d4539c0 20 remove_watcher() i=6 2024-09-14T11:19:29.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:19:29.894+0000 7ff91d4539c0 20 remove_watcher() i=7 2024-09-14T11:19:29.906 INFO:tasks.workunit.client.0.smithi148.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:19:59.928 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:59.964 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:59.964 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:00.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.221+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.221+0000 7fcdaca399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.221+0000 7fcdaca399c0 20 realm 2024-09-14T11:20:00.218 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.221+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:00.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:00.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:00.221 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.225+0000 7fcdaca399c0 20 searching for the correct realm 2024-09-14T11:20:00.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.233+0000 7fcda9d3e640 0 -- 172.21.15.148:0/280481972 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fcda40b7b00 msgr2=0x7fcda40ce920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:00.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.449+0000 7fcdaad40640 0 -- 172.21.15.148:0/280481972 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x561ef881d390 msgr2=0x561ef881f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:00.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:00.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:00.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:00.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:00.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:00.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:00.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:00.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:00.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 zone default found 2024-09-14T11:20:00.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 4 Realm: () 2024-09-14T11:20:00.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:00.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:00.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:00.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 zonegroup default 2024-09-14T11:20:00.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.461+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.465+0000 7fcdaca399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.465+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.465+0000 7fcdaca399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.465+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.465+0000 7fcdaca399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.465+0000 7fcdaca399c0 20 started sync module instance, tier type = 2024-09-14T11:20:00.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.465+0000 7fcdaca399c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:00.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 20 add_watcher() i=0 2024-09-14T11:20:00.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 20 add_watcher() i=1 2024-09-14T11:20:00.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 20 add_watcher() i=2 2024-09-14T11:20:00.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 20 add_watcher() i=3 2024-09-14T11:20:00.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 20 add_watcher() i=4 2024-09-14T11:20:00.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 20 add_watcher() i=5 2024-09-14T11:20:00.483 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 20 add_watcher() i=6 2024-09-14T11:20:00.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 20 add_watcher() i=7 2024-09-14T11:20:00.485 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.489+0000 7fcdaca399c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:00.490 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.493+0000 7fcc60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:00.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:00.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:00.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 5 note: GC not initialized 2024-09-14T11:20:00.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcbdb7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:00.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:00.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 20 Filter name: none 2024-09-14T11:20:00.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcbd97fa640 20 reqs_thread_entry: start 2024-09-14T11:20:00.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:20:00.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:00.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:20:00.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:20:00.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 : miss 2024-09-14T11:20:00.492 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:20:00.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:20:00.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:20:00.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:00.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:00.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.497+0000 7fcdaca399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 2024-09-14T11:20:00.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.501+0000 7fcdaca399c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:20:00.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.513+0000 7fcdaca399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:20:00.509 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.513+0000 7fcdaca399c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:20:00.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.513+0000 7fcdaca399c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:00.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.513+0000 7fcdaca399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35, ofs0, ns] 2024-09-14T11:20:00.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.513+0000 7fcc8dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 94691018342096 notifier 7190 bl.length()=995 2024-09-14T11:20:00.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.513+0000 7fcc8dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:20:00.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.513+0000 7fcc8dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:20:00.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.513+0000 7fcc8dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:00.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.517+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_sources= new_sources= 2024-09-14T11:20:00.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.517+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential sources added=[] removed=[] 2024-09-14T11:20:00.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.517+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_dests= new_dests= 2024-09-14T11:20:00.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.517+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential dests added=[] removed=[] 2024-09-14T11:20:00.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.0 2024-09-14T11:20:00.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.0 2024-09-14T11:20:00.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.1 2024-09-14T11:20:00.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.1 2024-09-14T11:20:00.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.2 2024-09-14T11:20:00.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.2 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.3 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.3 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.4 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.4 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.5 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.5 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.6 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.6 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.7 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.7 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.8 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.8 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.9 2024-09-14T11:20:00.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.9 2024-09-14T11:20:00.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.10 2024-09-14T11:20:00.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.10 2024-09-14T11:20:00.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.11 2024-09-14T11:20:00.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2.11 2024-09-14T11:20:00.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.0 2024-09-14T11:20:00.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.1 2024-09-14T11:20:00.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2 2024-09-14T11:20:00.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.3 2024-09-14T11:20:00.530 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.533+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.4 2024-09-14T11:20:00.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.537+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.5 2024-09-14T11:20:00.532 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.537+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.6 2024-09-14T11:20:00.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.537+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.7 2024-09-14T11:20:00.533 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.537+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.8 2024-09-14T11:20:00.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.537+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.9 2024-09-14T11:20:00.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.541+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.10 2024-09-14T11:20:00.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcdaca399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:00.543 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcdaca399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 2024-09-14T11:20:00.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcdaca399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:20:00.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcdaca399c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:20:00.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcdaca399c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:00.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcdaca399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35, ofs0, ns] 2024-09-14T11:20:00.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcc8d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 94691018342096 notifier 7190 bl.length()=995 2024-09-14T11:20:00.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcc8d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:20:00.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcc8d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:20:00.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.549+0000 7fcc8d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:00.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.553+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_sources= new_sources= 2024-09-14T11:20:00.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.553+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential sources added=[] removed=[] 2024-09-14T11:20:00.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.553+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_dests= new_dests= 2024-09-14T11:20:00.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.553+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential dests added=[] removed=[] 2024-09-14T11:20:00.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.561+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.0 2024-09-14T11:20:00.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.561+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.1 2024-09-14T11:20:00.556 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.561+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.2 2024-09-14T11:20:00.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.561+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.3 2024-09-14T11:20:00.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.561+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.4 2024-09-14T11:20:00.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.561+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.5 2024-09-14T11:20:00.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.565+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.6 2024-09-14T11:20:00.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.565+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.7 2024-09-14T11:20:00.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.565+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.8 2024-09-14T11:20:00.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.565+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.9 2024-09-14T11:20:00.561 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.565+0000 7fcdaca399c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35.10 2024-09-14T11:20:00.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.565+0000 7fcdaca399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:00.562 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.565+0000 7fcdaca399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 2024-09-14T11:20:00.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.569+0000 7fcdaca399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:20:00.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.569+0000 7fcdaca399c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:20:00.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.569+0000 7fcdaca399c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:00.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.569+0000 7fcdaca399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35, ofs0, ns] 2024-09-14T11:20:00.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.569+0000 7fcc8dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94691018342096 notifier 7190 bl.length()=963 2024-09-14T11:20:00.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.569+0000 7fcc8dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 info.flags=0x17 2024-09-14T11:20:00.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.569+0000 7fcc8dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 to cache LRU end 2024-09-14T11:20:00.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.569+0000 7fcc8dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:00.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.573+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_sources= new_sources= 2024-09-14T11:20:00.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.573+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential sources added=[] removed=[] 2024-09-14T11:20:00.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.573+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): orig_dests= new_dests= 2024-09-14T11:20:00.569 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.573+0000 7fcdaca399c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35]): potential dests added=[] removed=[] 2024-09-14T11:20:00.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.581+0000 7fcdaca399c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:20:00.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.585+0000 7fcc60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:00.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.589+0000 7fcdaca399c0 20 remove_watcher() i=0 2024-09-14T11:20:00.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.589+0000 7fcdaca399c0 2 removed watcher, disabling cache 2024-09-14T11:20:00.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.589+0000 7fcdaca399c0 20 remove_watcher() i=1 2024-09-14T11:20:00.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.593+0000 7fcdaca399c0 20 remove_watcher() i=2 2024-09-14T11:20:00.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.593+0000 7fcdaca399c0 20 remove_watcher() i=3 2024-09-14T11:20:00.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.597+0000 7fcdaca399c0 20 remove_watcher() i=4 2024-09-14T11:20:00.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.597+0000 7fcdaca399c0 20 remove_watcher() i=5 2024-09-14T11:20:00.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.601+0000 7fcdaca399c0 20 remove_watcher() i=6 2024-09-14T11:20:00.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.601+0000 7fcdaca399c0 20 remove_watcher() i=7 2024-09-14T11:20:00.647 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:20:00.647 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:00.647 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:00.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.689+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 realm 2024-09-14T11:20:00.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:00.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:00.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.693+0000 7f30e3e6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:00.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.697+0000 7f30e3e6d9c0 20 searching for the correct realm 2024-09-14T11:20:00.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.701+0000 7f30e1973640 0 -- 172.21.15.148:0/3708487032 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f30d4008040 msgr2=0x7f30d40660c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:00.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.705+0000 7f30e1973640 0 -- 172.21.15.148:0/3708487032 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f30dc0db3f0 msgr2=0x7f30dc0db830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:00.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:00.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:00.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:00.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:00.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:00.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:00.708 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:00.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 zone default found 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 4 Realm: () 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 zonegroup default 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.710 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.713+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.717+0000 7f30e3e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:00.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.717+0000 7f30e3e6d9c0 20 started sync module instance, tier type = 2024-09-14T11:20:00.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.717+0000 7f30e3e6d9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:00.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.733+0000 7f30e3e6d9c0 20 add_watcher() i=0 2024-09-14T11:20:00.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.733+0000 7f30e3e6d9c0 20 add_watcher() i=1 2024-09-14T11:20:00.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.733+0000 7f30e3e6d9c0 20 add_watcher() i=2 2024-09-14T11:20:00.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.733+0000 7f30e3e6d9c0 20 add_watcher() i=3 2024-09-14T11:20:00.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.733+0000 7f30e3e6d9c0 20 add_watcher() i=4 2024-09-14T11:20:00.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.733+0000 7f30e3e6d9c0 20 add_watcher() i=5 2024-09-14T11:20:00.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.733+0000 7f30e3e6d9c0 20 add_watcher() i=6 2024-09-14T11:20:00.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.737+0000 7f30e3e6d9c0 20 add_watcher() i=7 2024-09-14T11:20:00.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.737+0000 7f30e3e6d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:00.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f2f937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:00.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:00.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:00.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 5 note: GC not initialized 2024-09-14T11:20:00.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f2f927fc640 20 reqs_thread_entry: start 2024-09-14T11:20:00.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:00.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 Filter name: none 2024-09-14T11:20:00.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f2f03fff640 20 reqs_thread_entry: start 2024-09-14T11:20:00.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:00.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:00.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:00.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:00.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:00.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:00.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.741+0000 7f30e3e6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:00.740 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.745+0000 7f2f937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:00.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.749+0000 7f30e3e6d9c0 20 remove_watcher() i=0 2024-09-14T11:20:00.744 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.749+0000 7f30e3e6d9c0 2 removed watcher, disabling cache 2024-09-14T11:20:00.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.749+0000 7f30e3e6d9c0 20 remove_watcher() i=1 2024-09-14T11:20:00.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.753+0000 7f30e3e6d9c0 20 remove_watcher() i=2 2024-09-14T11:20:00.750 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.753+0000 7f30e3e6d9c0 20 remove_watcher() i=3 2024-09-14T11:20:00.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.757+0000 7f30e3e6d9c0 20 remove_watcher() i=4 2024-09-14T11:20:00.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.757+0000 7f30e3e6d9c0 20 remove_watcher() i=5 2024-09-14T11:20:00.757 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.761+0000 7f30e3e6d9c0 20 remove_watcher() i=6 2024-09-14T11:20:00.759 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:00.765+0000 7f30e3e6d9c0 20 remove_watcher() i=7 2024-09-14T11:20:00.772 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:00.772 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:00.773 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-do-reshard id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:20:00.773 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:00.774 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:00.774 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:00.797 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:00.797 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:01.373 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:01.373 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.045 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:20:02.045 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:02.048 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.048 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.210 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.210 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.303 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.304 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.430 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.430 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.548 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.549 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.661 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.661 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.773 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.773 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.884 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.884 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:02.993 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:02.993 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:03.099 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:03.099 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:03.208 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:03.208 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:03.312 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:03.312 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:03.440 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:03.440 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:03.546 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:03.546 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:03.659 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:03.659 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:03.766 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:03.767 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:03.923 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:03.923 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:04.075 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:04.075 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:04.185 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:04.186 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:04.301 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:04.301 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:04.417 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:04.417 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:04.530 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:04.530 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:04.639 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:20:04.674 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:04.674 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:04.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:04.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 20 realm 2024-09-14T11:20:04.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:04.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:04.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:04.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.729+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.733+0000 7fb302e7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:04.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.733+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.733+0000 7fb302e7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:04.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.733+0000 7fb302e7e9c0 20 searching for the correct realm 2024-09-14T11:20:04.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.737+0000 7fb2fbfff640 0 -- 172.21.15.148:0/1027808386 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fb2fc05c250 msgr2=0x7fb2fc06cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:04.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.949+0000 7fb2fbfff640 0 -- 172.21.15.148:0/1027808386 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x561909b1f170 msgr2=0x561909b215a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:04.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:04.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:04.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:04.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:04.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:04.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:04.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:04.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.961+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:04.959 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 zone default found 2024-09-14T11:20:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 4 Realm: () 2024-09-14T11:20:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 zonegroup default 2024-09-14T11:20:04.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:04.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:04.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:04.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 started sync module instance, tier type = 2024-09-14T11:20:04.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.965+0000 7fb302e7e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:04.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.989+0000 7fb302e7e9c0 20 add_watcher() i=0 2024-09-14T11:20:04.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.989+0000 7fb302e7e9c0 20 add_watcher() i=1 2024-09-14T11:20:04.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.989+0000 7fb302e7e9c0 20 add_watcher() i=2 2024-09-14T11:20:04.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.989+0000 7fb302e7e9c0 20 add_watcher() i=3 2024-09-14T11:20:04.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.989+0000 7fb302e7e9c0 20 add_watcher() i=4 2024-09-14T11:20:04.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.989+0000 7fb302e7e9c0 20 add_watcher() i=5 2024-09-14T11:20:04.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.989+0000 7fb302e7e9c0 20 add_watcher() i=6 2024-09-14T11:20:04.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.993+0000 7fb302e7e9c0 20 add_watcher() i=7 2024-09-14T11:20:04.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.993+0000 7fb302e7e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:04.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb1b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:04.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb302e7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:04.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb302e7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:04.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb302e7e9c0 5 note: GC not initialized 2024-09-14T11:20:04.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb1b5fe3640 20 reqs_thread_entry: start 2024-09-14T11:20:04.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb302e7e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:04.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb302e7e9c0 20 Filter name: none 2024-09-14T11:20:04.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb1277fe640 20 reqs_thread_entry: start 2024-09-14T11:20:04.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb302e7e9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:04.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:04.997+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.001+0000 7fb302e7e9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:04.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.001+0000 7fb302e7e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:04.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.001+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.001+0000 7fb302e7e9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:04.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.001+0000 7fb302e7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:04.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.001+0000 7fb302e7e9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:04.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.001+0000 7fb302e7e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:04.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.005+0000 7fb1b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:05.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.009+0000 7fb302e7e9c0 20 remove_watcher() i=0 2024-09-14T11:20:05.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.009+0000 7fb302e7e9c0 2 removed watcher, disabling cache 2024-09-14T11:20:05.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.009+0000 7fb302e7e9c0 20 remove_watcher() i=1 2024-09-14T11:20:05.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.013+0000 7fb302e7e9c0 20 remove_watcher() i=2 2024-09-14T11:20:05.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.017+0000 7fb302e7e9c0 20 remove_watcher() i=3 2024-09-14T11:20:05.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.017+0000 7fb302e7e9c0 20 remove_watcher() i=4 2024-09-14T11:20:05.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.021+0000 7fb302e7e9c0 20 remove_watcher() i=5 2024-09-14T11:20:05.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.021+0000 7fb302e7e9c0 20 remove_watcher() i=6 2024-09-14T11:20:05.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.025+0000 7fb302e7e9c0 20 remove_watcher() i=7 2024-09-14T11:20:05.047 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:05.047 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:05.047 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-logrecord-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:05.047 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:05.048 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:20:05.085 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:05.085 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:05.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 20 realm 2024-09-14T11:20:05.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:05.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.141+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.145+0000 7f21b6edc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:05.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.145+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.145+0000 7f21b6edc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:05.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.145+0000 7f21b6edc9c0 20 searching for the correct realm 2024-09-14T11:20:05.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.149+0000 7f21affff640 0 -- 172.21.15.148:0/2381071336 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5581ac6a4cf0 msgr2=0x5581ac6a70e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:05.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.157+0000 7f21b49e2640 0 -- 172.21.15.148:0/2381071336 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f21b00745e0 msgr2=0x7f21b0073fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:05.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:05.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:05.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:05.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:05.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:05.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:05.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:05.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:05.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 zone default found 2024-09-14T11:20:05.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 4 Realm: () 2024-09-14T11:20:05.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:05.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:05.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:05.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 zonegroup default 2024-09-14T11:20:05.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.165+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.169+0000 7f21b6edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.169+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.169+0000 7f21b6edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.169+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.169+0000 7f21b6edc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.169+0000 7f21b6edc9c0 20 started sync module instance, tier type = 2024-09-14T11:20:05.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.169+0000 7f21b6edc9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:05.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.185+0000 7f21b6edc9c0 20 add_watcher() i=0 2024-09-14T11:20:05.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.185+0000 7f21b6edc9c0 20 add_watcher() i=1 2024-09-14T11:20:05.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.185+0000 7f21b6edc9c0 20 add_watcher() i=2 2024-09-14T11:20:05.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.185+0000 7f21b6edc9c0 20 add_watcher() i=3 2024-09-14T11:20:05.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.185+0000 7f21b6edc9c0 20 add_watcher() i=4 2024-09-14T11:20:05.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.185+0000 7f21b6edc9c0 20 add_watcher() i=5 2024-09-14T11:20:05.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.185+0000 7f21b6edc9c0 20 add_watcher() i=6 2024-09-14T11:20:05.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.189+0000 7f21b6edc9c0 20 add_watcher() i=7 2024-09-14T11:20:05.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.189+0000 7f21b6edc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:05.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f206afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:05.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:05.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:05.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 5 note: GC not initialized 2024-09-14T11:20:05.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f2069fe3640 20 reqs_thread_entry: start 2024-09-14T11:20:05.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:05.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 20 Filter name: none 2024-09-14T11:20:05.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f1fdb7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:05.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:20:05.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:05.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:20:05.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:20:05.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 : miss 2024-09-14T11:20:05.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.193+0000 7f21b6edc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.197+0000 7f21b6edc9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:05.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.197+0000 7f21b6edc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.197+0000 7f21b6edc9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.197+0000 7f21b6edc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:05.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.197+0000 7f21b6edc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.197+0000 7f21b6edc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 2024-09-14T11:20:05.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f21b6edc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f21b6edc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f21b6edc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f21b6edc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36, ofs0, ns] 2024-09-14T11:20:05.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f208b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 94015431795760 notifier 7238 bl.length()=1007 2024-09-14T11:20:05.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f208b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f208b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f208b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f21b6edc9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_sources= new_sources= 2024-09-14T11:20:05.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f21b6edc9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential sources added=[] removed=[] 2024-09-14T11:20:05.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f21b6edc9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_dests= new_dests= 2024-09-14T11:20:05.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.209+0000 7f21b6edc9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential dests added=[] removed=[] 2024-09-14T11:20:05.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.217+0000 7f21b6edc9c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:20:05.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.217+0000 7f21b6edc9c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.229+0000 7f21b6edc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.229+0000 7f21b6edc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.233+0000 7f21b6edc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.233+0000 7f21b6edc9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.233+0000 7f21b6edc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.233+0000 7f21b6edc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36, ofs0, ns] 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.233+0000 7f208bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366255 cookie 94015431795760 notifier 7238 bl.length()=975 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.233+0000 7f208bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.233+0000 7f208bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.233+0000 7f208bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.237+0000 7f21b6edc9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_sources= new_sources= 2024-09-14T11:20:05.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.237+0000 7f21b6edc9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential sources added=[] removed=[] 2024-09-14T11:20:05.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.237+0000 7f21b6edc9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_dests= new_dests= 2024-09-14T11:20:05.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.237+0000 7f21b6edc9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential dests added=[] removed=[] 2024-09-14T11:20:05.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.237+0000 7f206afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:05.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.241+0000 7f21b6edc9c0 20 remove_watcher() i=0 2024-09-14T11:20:05.237 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.241+0000 7f21b6edc9c0 2 removed watcher, disabling cache 2024-09-14T11:20:05.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.245+0000 7f21b6edc9c0 20 remove_watcher() i=1 2024-09-14T11:20:05.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.245+0000 7f21b6edc9c0 20 remove_watcher() i=2 2024-09-14T11:20:05.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.249+0000 7f21b6edc9c0 20 remove_watcher() i=3 2024-09-14T11:20:05.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.249+0000 7f21b6edc9c0 20 remove_watcher() i=4 2024-09-14T11:20:05.247 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.253+0000 7f21b6edc9c0 20 remove_watcher() i=5 2024-09-14T11:20:05.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.253+0000 7f21b6edc9c0 20 remove_watcher() i=6 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.257+0000 7f21b6edc9c0 20 remove_watcher() i=7 2024-09-14T11:20:05.266 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:20:05.293 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:05.293 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:05.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.341+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.345+0000 7f57f39e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.345+0000 7f57f39e79c0 20 realm 2024-09-14T11:20:05.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.345+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.345+0000 7f57f39e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.345+0000 7f57f39e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:05.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.345+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.345+0000 7f57f39e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.345+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.549+0000 7f57f39e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:05.545 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.549+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.553+0000 7f57f39e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:05.547 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.553+0000 7f57f39e79c0 20 searching for the correct realm 2024-09-14T11:20:05.555 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.561+0000 7f57f0cec640 0 -- 172.21.15.148:0/999820097 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f57ec105c50 msgr2=0x7f57ec0fb420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:05.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.569+0000 7f57f14ed640 0 -- 172.21.15.148:0/999820097 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f57ec103430 msgr2=0x7f57ec0fea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:05.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:05.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:05.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:05.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:05.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:05.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:05.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.576 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:05.577 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 zone default found 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 4 Realm: () 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 zonegroup default 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.581+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.585+0000 7f57f39e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.585+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.585+0000 7f57f39e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.585+0000 7f57f39e79c0 20 started sync module instance, tier type = 2024-09-14T11:20:05.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.585+0000 7f57f39e79c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:05.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.605+0000 7f57f39e79c0 20 add_watcher() i=0 2024-09-14T11:20:05.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.605+0000 7f57f39e79c0 20 add_watcher() i=1 2024-09-14T11:20:05.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.605+0000 7f57f39e79c0 20 add_watcher() i=2 2024-09-14T11:20:05.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.605+0000 7f57f39e79c0 20 add_watcher() i=3 2024-09-14T11:20:05.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.605+0000 7f57f39e79c0 20 add_watcher() i=4 2024-09-14T11:20:05.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.605+0000 7f57f39e79c0 20 add_watcher() i=5 2024-09-14T11:20:05.603 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.605+0000 7f57f39e79c0 20 add_watcher() i=6 2024-09-14T11:20:05.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.609+0000 7f57f39e79c0 20 add_watcher() i=7 2024-09-14T11:20:05.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.609+0000 7f57f39e79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:05.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.613+0000 7f56a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:05.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.613+0000 7f57f39e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:05.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.613+0000 7f57f39e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:05.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.613+0000 7f57f39e79c0 5 note: GC not initialized 2024-09-14T11:20:05.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.613+0000 7f56a67e4640 20 reqs_thread_entry: start 2024-09-14T11:20:05.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:05.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 Filter name: none 2024-09-14T11:20:05.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f5617fff640 20 reqs_thread_entry: start 2024-09-14T11:20:05.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:05.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:05.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:05.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:05.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:05.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.617+0000 7f57f39e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:05.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.621+0000 7f56a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:05.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.625+0000 7f57f39e79c0 20 remove_watcher() i=0 2024-09-14T11:20:05.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.625+0000 7f57f39e79c0 2 removed watcher, disabling cache 2024-09-14T11:20:05.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.629+0000 7f57f39e79c0 20 remove_watcher() i=1 2024-09-14T11:20:05.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.629+0000 7f57f39e79c0 20 remove_watcher() i=2 2024-09-14T11:20:05.629 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.633+0000 7f57f39e79c0 20 remove_watcher() i=3 2024-09-14T11:20:05.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.637+0000 7f57f39e79c0 20 remove_watcher() i=4 2024-09-14T11:20:05.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.637+0000 7f57f39e79c0 20 remove_watcher() i=5 2024-09-14T11:20:05.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.641+0000 7f57f39e79c0 20 remove_watcher() i=6 2024-09-14T11:20:05.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.645+0000 7f57f39e79c0 20 remove_watcher() i=7 2024-09-14T11:20:05.659 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:05.659 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:05.659 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-logrecord-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:05.659 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:05.660 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:05.660 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:05.705 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:05.705 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:05.792 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:20:05.830 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:05.830 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:05.873 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.877+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 realm 2024-09-14T11:20:05.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:05.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:05.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.881+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.885+0000 7f6c707ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:05.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.885+0000 7f6c707ed9c0 20 searching for the correct realm 2024-09-14T11:20:05.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.889+0000 7f6c6daf2640 0 -- 172.21.15.148:0/3420672161 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55b8fa46ce80 msgr2=0x55b8fa46f270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:05.890 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.893+0000 7f6c6e2f3640 0 -- 172.21.15.148:0/3420672161 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f6c680e8950 msgr2=0x7f6c680b63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:05.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.901+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:05.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 zone default found 2024-09-14T11:20:05.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 4 Realm: () 2024-09-14T11:20:05.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:05.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:05.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:05.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 zonegroup default 2024-09-14T11:20:05.900 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:05.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 started sync module instance, tier type = 2024-09-14T11:20:05.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.905+0000 7f6c707ed9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:05.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 20 add_watcher() i=0 2024-09-14T11:20:05.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 20 add_watcher() i=1 2024-09-14T11:20:05.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 20 add_watcher() i=2 2024-09-14T11:20:05.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 20 add_watcher() i=3 2024-09-14T11:20:05.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 20 add_watcher() i=4 2024-09-14T11:20:05.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 20 add_watcher() i=5 2024-09-14T11:20:05.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 20 add_watcher() i=6 2024-09-14T11:20:05.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 20 add_watcher() i=7 2024-09-14T11:20:05.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.925+0000 7f6c707ed9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:05.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.929+0000 7f6b24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:05.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.929+0000 7f6c707ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:05.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.929+0000 7f6c707ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:05.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.929+0000 7f6c707ed9c0 5 note: GC not initialized 2024-09-14T11:20:05.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.929+0000 7f6a9f7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:05.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.929+0000 7f6c707ed9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:05.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 20 Filter name: none 2024-09-14T11:20:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6a9d7fa640 20 reqs_thread_entry: start 2024-09-14T11:20:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:20:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:20:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:20:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 : miss 2024-09-14T11:20:05.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:05.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:05.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:05.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.933+0000 7f6c707ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 2024-09-14T11:20:05.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6c707ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6c707ed9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6c707ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6c707ed9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36, ofs0, ns] 2024-09-14T11:20:05.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6b51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366256 cookie 94252961320112 notifier 7746 bl.length()=1007 2024-09-14T11:20:05.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6b51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6b51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6b51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_sources= new_sources= 2024-09-14T11:20:05.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential sources added=[] removed=[] 2024-09-14T11:20:05.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_dests= new_dests= 2024-09-14T11:20:05.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.945+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential dests added=[] removed=[] 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.0 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.0 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.1 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.1 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.2 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.2 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.3 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.3 2024-09-14T11:20:05.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.4 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.4 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.5 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.5 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.6 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.6 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.7 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.7 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.8 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.8 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.9 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.9 2024-09-14T11:20:05.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.10 2024-09-14T11:20:05.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.10 2024-09-14T11:20:05.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.11 2024-09-14T11:20:05.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1.11 2024-09-14T11:20:05.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.0 2024-09-14T11:20:05.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.957+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1 2024-09-14T11:20:05.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.961+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.2 2024-09-14T11:20:05.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.961+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.3 2024-09-14T11:20:05.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.961+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.4 2024-09-14T11:20:05.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.961+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.5 2024-09-14T11:20:05.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.961+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.6 2024-09-14T11:20:05.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.965+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.7 2024-09-14T11:20:05.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.965+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.8 2024-09-14T11:20:05.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.965+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.9 2024-09-14T11:20:05.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.969+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.10 2024-09-14T11:20:05.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.977+0000 7f6c707ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:05.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.977+0000 7f6c707ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 2024-09-14T11:20:05.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.977+0000 7f6c707ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.977+0000 7f6c707ed9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.974 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.977+0000 7f6c707ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.977+0000 7f6c707ed9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36, ofs0, ns] 2024-09-14T11:20:05.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.981+0000 7f6b51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366257 cookie 94252961320112 notifier 7746 bl.length()=1007 2024-09-14T11:20:05.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.981+0000 7f6b51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.981+0000 7f6b51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.981+0000 7f6b51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.981+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_sources= new_sources= 2024-09-14T11:20:05.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.981+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential sources added=[] removed=[] 2024-09-14T11:20:05.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.981+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_dests= new_dests= 2024-09-14T11:20:05.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.981+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential dests added=[] removed=[] 2024-09-14T11:20:05.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.989+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.0 2024-09-14T11:20:05.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.989+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.1 2024-09-14T11:20:05.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.989+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.2 2024-09-14T11:20:05.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.989+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.3 2024-09-14T11:20:05.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.989+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.4 2024-09-14T11:20:05.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.993+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.5 2024-09-14T11:20:05.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.993+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.6 2024-09-14T11:20:05.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.993+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.7 2024-09-14T11:20:05.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.993+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.8 2024-09-14T11:20:05.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.993+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.9 2024-09-14T11:20:05.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.993+0000 7f6c707ed9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36.10 2024-09-14T11:20:05.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.997+0000 7f6c707ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:05.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:05.997+0000 7f6c707ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 2024-09-14T11:20:05.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6c707ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6c707ed9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6c707ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6c707ed9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36, ofs0, ns] 2024-09-14T11:20:05.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6b51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366258 cookie 94252961320112 notifier 7746 bl.length()=975 2024-09-14T11:20:05.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6b51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 info.flags=0x17 2024-09-14T11:20:05.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6b51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 to cache LRU end 2024-09-14T11:20:05.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6b51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:05.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_sources= new_sources= 2024-09-14T11:20:05.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential sources added=[] removed=[] 2024-09-14T11:20:05.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): orig_dests= new_dests= 2024-09-14T11:20:05.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.001+0000 7f6c707ed9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36]): potential dests added=[] removed=[] 2024-09-14T11:20:06.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.009+0000 7f6c707ed9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:20:06.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.013+0000 7f6b24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:06.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.017+0000 7f6c707ed9c0 20 remove_watcher() i=0 2024-09-14T11:20:06.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.017+0000 7f6c707ed9c0 2 removed watcher, disabling cache 2024-09-14T11:20:06.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.017+0000 7f6c707ed9c0 20 remove_watcher() i=1 2024-09-14T11:20:06.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.021+0000 7f6c707ed9c0 20 remove_watcher() i=2 2024-09-14T11:20:06.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.021+0000 7f6c707ed9c0 20 remove_watcher() i=3 2024-09-14T11:20:06.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.025+0000 7f6c707ed9c0 20 remove_watcher() i=4 2024-09-14T11:20:06.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.025+0000 7f6c707ed9c0 20 remove_watcher() i=5 2024-09-14T11:20:06.025 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.029+0000 7f6c707ed9c0 20 remove_watcher() i=6 2024-09-14T11:20:06.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.033+0000 7f6c707ed9c0 20 remove_watcher() i=7 2024-09-14T11:20:06.045 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:20:06.076 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:06.076 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:06.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.125+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.125+0000 7ff1b28ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:06.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.125+0000 7ff1b28ed9c0 20 realm 2024-09-14T11:20:06.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.125+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:06.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:06.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:06.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:06.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:06.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.129+0000 7ff1b28ed9c0 20 searching for the correct realm 2024-09-14T11:20:06.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.137+0000 7ff1afbf2640 0 -- 172.21.15.148:0/3703142843 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x559b36075ce0 msgr2=0x559b360780d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:06.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.141+0000 7ff1b03f3640 0 -- 172.21.15.148:0/3703142843 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7ff1a803d450 msgr2=0x7ff1a803d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:06.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:06.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:06.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:06.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:06.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:06.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:06.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 zone default found 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 4 Realm: () 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 zonegroup default 2024-09-14T11:20:06.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:06.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.149+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.153+0000 7ff1b28ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:06.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.153+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.153+0000 7ff1b28ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:06.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.153+0000 7ff1b28ed9c0 20 started sync module instance, tier type = 2024-09-14T11:20:06.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.153+0000 7ff1b28ed9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:06.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.169+0000 7ff1b28ed9c0 20 add_watcher() i=0 2024-09-14T11:20:06.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.169+0000 7ff1b28ed9c0 20 add_watcher() i=1 2024-09-14T11:20:06.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.169+0000 7ff1b28ed9c0 20 add_watcher() i=2 2024-09-14T11:20:06.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.169+0000 7ff1b28ed9c0 20 add_watcher() i=3 2024-09-14T11:20:06.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.169+0000 7ff1b28ed9c0 20 add_watcher() i=4 2024-09-14T11:20:06.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.169+0000 7ff1b28ed9c0 20 add_watcher() i=5 2024-09-14T11:20:06.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.169+0000 7ff1b28ed9c0 20 add_watcher() i=6 2024-09-14T11:20:06.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.173+0000 7ff1b28ed9c0 20 add_watcher() i=7 2024-09-14T11:20:06.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.173+0000 7ff1b28ed9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:06.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff0677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:06.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:06.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:06.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 5 note: GC not initialized 2024-09-14T11:20:06.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff0667dc640 20 reqs_thread_entry: start 2024-09-14T11:20:06.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:06.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 Filter name: none 2024-09-14T11:20:06.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff05f7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:06.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:06.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:06.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:06.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.177+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.181+0000 7ff1b28ed9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:06.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.181+0000 7ff1b28ed9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:06.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.181+0000 7ff1b28ed9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:06.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.181+0000 7ff1b28ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:06.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.181+0000 7ff0677de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:06.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.185+0000 7ff1b28ed9c0 20 remove_watcher() i=0 2024-09-14T11:20:06.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.185+0000 7ff1b28ed9c0 2 removed watcher, disabling cache 2024-09-14T11:20:06.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.189+0000 7ff1b28ed9c0 20 remove_watcher() i=1 2024-09-14T11:20:06.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.189+0000 7ff1b28ed9c0 20 remove_watcher() i=2 2024-09-14T11:20:06.188 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.193+0000 7ff1b28ed9c0 20 remove_watcher() i=3 2024-09-14T11:20:06.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.193+0000 7ff1b28ed9c0 20 remove_watcher() i=4 2024-09-14T11:20:06.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.197+0000 7ff1b28ed9c0 20 remove_watcher() i=5 2024-09-14T11:20:06.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.201+0000 7ff1b28ed9c0 20 remove_watcher() i=6 2024-09-14T11:20:06.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:06.201+0000 7ff1b28ed9c0 20 remove_watcher() i=7 2024-09-14T11:20:06.212 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:06.212 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:06.212 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-logrecord-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:20:06.212 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:06.213 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:06.213 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:06.236 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:06.236 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:06.800 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:06.800 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:07.186 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:20:07.186 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:07.189 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:07.189 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:07.327 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:07.327 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:07.419 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:07.419 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:07.530 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:07.531 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:07.637 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:07.637 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:07.736 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:07.736 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:07.834 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:07.834 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:07.927 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:07.927 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.019 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.019 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.113 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.113 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.208 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.208 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.307 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.307 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.406 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.406 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.508 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.508 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.608 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.608 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.703 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.703 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.807 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.807 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:08.906 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:08.906 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:09.009 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:09.009 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:09.110 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:09.110 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:09.218 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:09.218 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:09.314 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:09.314 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:09.420 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:20:09.452 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:09.452 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:09.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.501+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 realm 2024-09-14T11:20:09.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:09.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:09.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.505+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.509+0000 7f9134a429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:09.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.509+0000 7f9134a429c0 20 searching for the correct realm 2024-09-14T11:20:09.508 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.513+0000 7f9131d47640 0 -- 172.21.15.148:0/4199048468 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f912c05d940 msgr2=0x7f912c05c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:09.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.725+0000 7f9132d49640 0 -- 172.21.15.148:0/4199048468 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55567604f640 msgr2=0x555676051a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:09.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.737+0000 7f9134a429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:09.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.737+0000 7f9134a429c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:09.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.737+0000 7f9134a429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:09.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.737+0000 7f9134a429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:09.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.737+0000 7f9134a429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:09.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.737+0000 7f9134a429c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:09.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.737+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:09.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 zone default found 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 4 Realm: () 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 zonegroup default 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.741+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.745+0000 7f9134a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.745+0000 7f9134a429c0 20 started sync module instance, tier type = 2024-09-14T11:20:09.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.745+0000 7f9134a429c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:09.763 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 20 add_watcher() i=0 2024-09-14T11:20:09.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 20 add_watcher() i=1 2024-09-14T11:20:09.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 20 add_watcher() i=2 2024-09-14T11:20:09.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 20 add_watcher() i=3 2024-09-14T11:20:09.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 20 add_watcher() i=4 2024-09-14T11:20:09.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 20 add_watcher() i=5 2024-09-14T11:20:09.764 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 20 add_watcher() i=6 2024-09-14T11:20:09.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 20 add_watcher() i=7 2024-09-14T11:20:09.766 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.769+0000 7f9134a429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:09.770 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.773+0000 7f8fe8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:09.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:09.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:09.771 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 5 note: GC not initialized 2024-09-14T11:20:09.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f8f637fe640 20 reqs_thread_entry: start 2024-09-14T11:20:09.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:09.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 Filter name: none 2024-09-14T11:20:09.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f8f617fa640 20 reqs_thread_entry: start 2024-09-14T11:20:09.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:09.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:09.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:09.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.777+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.781+0000 7f9134a429c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:09.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.781+0000 7f9134a429c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.781+0000 7f9134a429c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:09.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.781+0000 7f9134a429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:09.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.781+0000 7f8fe8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:09.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.785+0000 7f9134a429c0 20 remove_watcher() i=0 2024-09-14T11:20:09.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.785+0000 7f9134a429c0 2 removed watcher, disabling cache 2024-09-14T11:20:09.784 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.789+0000 7f9134a429c0 20 remove_watcher() i=1 2024-09-14T11:20:09.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.789+0000 7f9134a429c0 20 remove_watcher() i=2 2024-09-14T11:20:09.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.793+0000 7f9134a429c0 20 remove_watcher() i=3 2024-09-14T11:20:09.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.793+0000 7f9134a429c0 20 remove_watcher() i=4 2024-09-14T11:20:09.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.797+0000 7f9134a429c0 20 remove_watcher() i=5 2024-09-14T11:20:09.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.801+0000 7f9134a429c0 20 remove_watcher() i=6 2024-09-14T11:20:09.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.801+0000 7f9134a429c0 20 remove_watcher() i=7 2024-09-14T11:20:09.812 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.812 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:09.812 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-logrecord-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:09.812 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.812 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:20:09.849 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:09.849 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:09.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.897+0000 7f152757f9c0 20 realm 2024-09-14T11:20:09.894 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.897+0000 7f152757f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:09.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:09.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:09.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.901+0000 7f152757f9c0 20 searching for the correct realm 2024-09-14T11:20:09.903 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.909+0000 7f1525085640 0 -- 172.21.15.148:0/1360375047 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f15180383f0 msgr2=0x7f1518038850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:09.908 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.913+0000 7f1525085640 0 -- 172.21.15.148:0/1360375047 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5643a7771f40 msgr2=0x5643a7774400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:09.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:09.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:09.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:09.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:09.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:09.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:09.916 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:09.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:09.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 zone default found 2024-09-14T11:20:09.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 4 Realm: () 2024-09-14T11:20:09.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:09.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:09.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:09.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 zonegroup default 2024-09-14T11:20:09.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:09.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.925+0000 7f152757f9c0 20 started sync module instance, tier type = 2024-09-14T11:20:09.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.925+0000 7f152757f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:09.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=0 2024-09-14T11:20:09.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=1 2024-09-14T11:20:09.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=2 2024-09-14T11:20:09.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=3 2024-09-14T11:20:09.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=4 2024-09-14T11:20:09.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=5 2024-09-14T11:20:09.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=6 2024-09-14T11:20:09.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.945+0000 7f152757f9c0 20 add_watcher() i=7 2024-09-14T11:20:09.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.945+0000 7f152757f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:09.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f13dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:09.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:09.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:09.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 5 note: GC not initialized 2024-09-14T11:20:09.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f13dafe5640 20 reqs_thread_entry: start 2024-09-14T11:20:09.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:09.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 20 Filter name: none 2024-09-14T11:20:09.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f13d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:09.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:20:09.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:09.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:20:09.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:20:09.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 : miss 2024-09-14T11:20:09.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:09.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:09.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:09.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:09.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:09.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:09.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.949+0000 7f152757f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 2024-09-14T11:20:09.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:09.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f152757f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:09.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f152757f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:09.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f152757f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37, ofs0, ns] 2024-09-14T11:20:09.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94848572406464 notifier 7803 bl.length()=1007 2024-09-14T11:20:09.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:09.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:09.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:09.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_sources= new_sources= 2024-09-14T11:20:09.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential sources added=[] removed=[] 2024-09-14T11:20:09.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_dests= new_dests= 2024-09-14T11:20:09.958 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential dests added=[] removed=[] 2024-09-14T11:20:09.963 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f152757f9c0 time 2024-09-14T11:20:09.970567+0000 2024-09-14T11:20:09.963 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f152ae592eb] 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f152ae5949f] 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5643a60f4c01] 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x142325c) [0x5643a6b5325c] 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5643a6109ecd] 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1529cbfd90] 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:20:09.965 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f152757f9c0 thread_name:radosgw-admin 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.969+0000 7f152757f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f152757f9c0 time 2024-09-14T11:20:09.970567+0000 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f152ae592eb] 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f152ae5949f] 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5643a60f4c01] 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x142325c) [0x5643a6b5325c] 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5643a6109ecd] 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1529cbfd90] 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:20:09.966 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.976 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:09.976 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1529cd8520] 2024-09-14T11:20:09.976 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:20:09.976 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:20:09.976 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:20:09.976 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f152ae59345] 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f152ae5949f] 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5643a60f4c01] 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x142325c) [0x5643a6b5325c] 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5643a6109ecd] 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1529cbfd90] 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:09.969+0000 7f152757f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f152757f9c0 thread_name:radosgw-admin 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1529cd8520] 2024-09-14T11:20:09.977 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f152ae59345] 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f152ae5949f] 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5643a60f4c01] 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x142325c) [0x5643a6b5325c] 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5643a6109ecd] 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1529cbfd90] 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:20:09.978 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7791 payload 274 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:20:09.877+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:20:09.877+0000 7f1525085640 10 monclient: get_auth_request con 0x5643a7535050 auth_method 0 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: dump: 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.979 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: _finish_auth 0 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: _check_auth_tickets 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: dump: 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.980 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7791 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:20:09.877+0000 7f152757f9c0 4 set_mon_vals no callback set 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: shutdown 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 asok(0x5643a747ad90) unregister_commands rotate-key 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: build_initial_monmap 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: monmap: 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:09.981 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding auth protocol: cephx 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding auth protocol: cephx 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding auth protocol: cephx 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:09.982 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:20:09.877+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: starting msgr at 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: starting objecter 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command objecter_requests hook 0x5643a76b5fc0 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: setting wanted keys 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: calling monclient init 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: init 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding auth protocol: cephx 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding auth protocol: cephx 2024-09-14T11:20:09.983 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding auth protocol: cephx 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:20:09.877+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:09.984 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:20:09.877+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command rotate-key hook 0x5643a7685298 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-b con 0x5643a7535050 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-c con 0x5643a7535430 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-a con 0x5643a75cdf90 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): authenticate will time out at 2868.938954s 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): get_auth_request con 0x5643a75cdf90 auth_method 0 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:09.985 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): get_auth_request con 0x5643a7535430 auth_method 0 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7794 payload 824 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:09.986 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:20:09.877+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:20:09.877+0000 7f1525085640 10 monclient: get_auth_request con 0x5643a7535050 auth_method 0 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: dump: 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.987 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: _finish_auth 0 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: _check_auth_tickets 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: dump: 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.988 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:20:09.877+0000 7f1413606640 4 set_mon_vals no callback set 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7794 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: init done 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:20:09.881+0000 7f1411e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:20:09.881+0000 7f1411e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:20:09.881+0000 7f1411e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:20:09.881+0000 7f1525085640 10 monclient: get_auth_request con 0x7f140c0718a0 auth_method 0 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:20:09.881+0000 7f1524884640 10 monclient: get_auth_request con 0x5643a76cd0d0 auth_method 0 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:20:09.885+0000 7f1525085640 10 monclient: get_auth_request con 0x5643a76d02b0 auth_method 0 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:20:09.885+0000 7f1524884640 10 monclient: get_auth_request con 0x5643a76d44a0 auth_method 0 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: build_initial_monmap 2024-09-14T11:20:09.989 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:20:09.885+0000 7f152757f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: monmap: 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding auth protocol: cephx 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding auth protocol: cephx 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding auth protocol: cephx 2024-09-14T11:20:09.990 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:20:09.885+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5643a76dc840 EEXIST 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: init 2024-09-14T11:20:09.991 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding auth protocol: cephx 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding auth protocol: cephx 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding auth protocol: cephx 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:20:09.885+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:09.992 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:20:09.885+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command rotate-key cmddesc rotate-key hook 0x5643a76d7870 EEXIST 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-b con 0x5643a77009f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-c con 0x5643a7700320 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-a con 0x5643a76fed00 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): authenticate will time out at 2868.947908s 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): get_auth_request con 0x5643a7700320 auth_method 0 2024-09-14T11:20:09.993 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): get_auth_request con 0x5643a76fed00 auth_method 0 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient(hunting): get_auth_request con 0x5643a77009f0 auth_method 0 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:09.994 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7797 payload 824 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:20:09.889+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: dump: 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.995 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: _finish_auth 0 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: _check_auth_tickets 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: dump: 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:09.996 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:20:09.889+0000 7f1517fff640 4 set_mon_vals no callback set 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7797 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:20:09.889+0000 7f140affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:20:09.889+0000 7f140affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:20:09.889+0000 7f140affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient: get_auth_request con 0x7f14000718a0 auth_method 0 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: get_monmap_and_config 2024-09-14T11:20:09.997 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: build_initial_monmap 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:20:09.889+0000 7f152757f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: monmap: 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding auth protocol: cephx 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding auth protocol: cephx 2024-09-14T11:20:09.998 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding auth protocol: cephx 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:20:09.889+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: init 2024-09-14T11:20:09.999 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding auth protocol: cephx 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding auth protocol: cephx 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding auth protocol: cephx 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.000 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command rotate-key cmddesc rotate-key hook 0x7fff43ea0198 EEXIST 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-b con 0x5643a7753ef0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-c con 0x5643a7723cd0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-a con 0x5643a77211e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): authenticate will time out at 2868.952472s 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): get_auth_request con 0x5643a77211e0 auth_method 0 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.001 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): get_auth_request con 0x5643a7723cd0 auth_method 0 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7800 payload 274 2024-09-14T11:20:10.002 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:20:09.893+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: dump: 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.003 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: _finish_auth 0 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7800 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:20:09.893+0000 7f152757f9c0 4 set_mon_vals no callback set 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: dump: 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.004 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: shutdown 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: build_initial_monmap 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: monmap: 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:10.005 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding auth protocol: cephx 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding auth protocol: cephx 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding auth protocol: cephx 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.006 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: starting msgr at 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: starting objecter 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5643a7705c60 EEXIST 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: setting wanted keys 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: calling monclient init 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: init 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding auth protocol: cephx 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding auth protocol: cephx 2024-09-14T11:20:10.007 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding auth protocol: cephx 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.008 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command rotate-key cmddesc rotate-key hook 0x5643a7702958 EEXIST 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-c con 0x5643a77211e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-b con 0x5643a7723cd0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-a con 0x5643a7753ef0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): authenticate will time out at 2868.955052s 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): get_auth_request con 0x5643a7753ef0 auth_method 0 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.009 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): get_auth_request con 0x5643a77211e0 auth_method 0 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7803 payload 824 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:10.010 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:20:09.893+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: dump: 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.011 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: dump: 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.012 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7803 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:20:09.893+0000 7f1408ff9640 4 set_mon_vals no callback set 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: init done 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cr dump hook 0x5643a7757978 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:20:09.897+0000 7f13f6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:20:09.897+0000 7f13f6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:20:09.897+0000 7f13f6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:20:09.897+0000 7f1525085640 10 monclient: get_auth_request con 0x7f13f00718a0 auth_method 0 2024-09-14T11:20:10.013 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:20:09.897+0000 7f1524884640 10 monclient: get_auth_request con 0x5643a776de20 auth_method 0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 realm 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:20:09.897+0000 7f152757f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:20:09.901+0000 7f1525085640 10 monclient: get_auth_request con 0x5643a7771f40 auth_method 0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:20:09.901+0000 7f1524884640 10 monclient: get_auth_request con 0x5643a7775830 auth_method 0 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 searching for the correct realm 2024-09-14T11:20:10.014 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:20:09.901+0000 7f1525886640 10 monclient: get_auth_request con 0x5643a777a570 auth_method 0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:20:09.905+0000 7f1525085640 10 monclient: get_auth_request con 0x7f15180383f0 auth_method 0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:20:09.905+0000 7f1524884640 10 monclient: get_auth_request con 0x7f1520004040 auth_method 0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:20:09.909+0000 7f1525085640 0 -- 172.21.15.148:0/1360375047 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f15180383f0 msgr2=0x7f1518038850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:20:09.909+0000 7f13f6ffd640 1 client.7803.objecter ms_handle_reset 0x7f15180383f0 session 0x7f151803e040 osd.0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:20:09.909+0000 7f13f6ffd640 10 monclient: _renew_subs 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:20:09.909+0000 7f13f6ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:20:09.909+0000 7f1525085640 10 monclient: get_auth_request con 0x7f13f0081b40 auth_method 0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:20:09.909+0000 7f1525886640 10 monclient: get_auth_request con 0x7f1518044450 auth_method 0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:20:09.913+0000 7f1525085640 10 monclient: get_auth_request con 0x7f15200bf020 auth_method 0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:20:09.913+0000 7f1525085640 0 -- 172.21.15.148:0/1360375047 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5643a7771f40 msgr2=0x5643a7774400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:20:09.913+0000 7f13f6ffd640 1 client.7803.objecter ms_handle_reset 0x5643a7771f40 session 0x5643a776d630 osd.1 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:20:09.913+0000 7f1525085640 10 monclient: get_auth_request con 0x7f15180383f0 auth_method 0 2024-09-14T11:20:10.015 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 zone default found 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:20:09.921+0000 7f152757f9c0 4 Realm: () 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:20:09.921+0000 7f152757f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:10.016 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:20:09.921+0000 7f152757f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:20:09.921+0000 7f152757f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 zonegroup default 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 started sync module instance, tier type = 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=0 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=1 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=2 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=3 2024-09-14T11:20:10.017 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=4 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=5 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=6 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:20:09.945+0000 7f152757f9c0 20 add_watcher() i=7 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:20:09.945+0000 7f152757f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding auth protocol: cephx 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding auth protocol: cephx 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding auth protocol: cephx 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:20:09.949+0000 7f13dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.018 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:20:09.949+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cache list hook 0x5643a774a3d0 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cache inspect hook 0x5643a774a3d0 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cache erase hook 0x5643a774a3d0 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cache zap hook 0x5643a774a3d0 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 note: GC not initialized 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:20:09.949+0000 7f13dafe5640 20 reqs_thread_entry: start 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command sync trace show hook 0x7f1520112030 2024-09-14T11:20:10.019 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command sync trace history hook 0x7f1520112030 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command sync trace active hook 0x7f1520112030 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command sync trace active_short hook 0x7f1520112030 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 Filter name: none 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:20:09.949+0000 7f13d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 : miss 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:10.020 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:20:09.961+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:20:09.961+0000 7f152757f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:20:09.961+0000 7f152757f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:20:09.961+0000 7f152757f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37, ofs0, ns] 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94848572406464 notifier 7803 bl.length()=1007 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_sources= new_sources= 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential sources added=[] removed=[] 2024-09-14T11:20:10.021 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_dests= new_dests= 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential dests added=[] removed=[] 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:20:09.969+0000 7f152757f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f152757f9c0 time 2024-09-14T11:20:09.970567+0000 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f152ae592eb] 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f152ae5949f] 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5643a60f4c01] 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x142325c) [0x5643a6b5325c] 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5643a6109ecd] 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1529cbfd90] 2024-09-14T11:20:10.022 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:20:09.969+0000 7f152757f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f152757f9c0 thread_name:radosgw-admin 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1529cd8520] 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f152ae59345] 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f152ae5949f] 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5643a60f4c01] 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x142325c) [0x5643a6b5325c] 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5643a6109ecd] 2024-09-14T11:20:10.023 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1529cbfd90] 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:20:10.024 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:20:10.025 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:20:10.026 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:20:10.027 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:20:10.028 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:20:10.029 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:20:10.030 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:20:10.030 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:20:10.030 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:20:10.030 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:20:10.030 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:20:10.030 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:20:10.030 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:20:10.030 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:20:10.031 INFO:tasks.workunit.client.0.smithi148.stderr: 7f13d8fe1640 / http_manager 2024-09-14T11:20:10.031 INFO:tasks.workunit.client.0.smithi148.stderr: 7f13dafe5640 / http_manager 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f13dbfe7640 / rgw_dt_lg_renew 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f13f6ffd640 / ms_dispatch 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1408ff9640 / io_context_pool 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f140affd640 / ms_dispatch 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1411e03640 / ms_dispatch 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1413606640 / io_context_pool 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1517fff640 / io_context_pool 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1524884640 / msgr-worker-2 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1525085640 / msgr-worker-1 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1525886640 / msgr-worker-0 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: 7f152757f9c0 / radosgw-admin 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:20:10.032 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.128142.log 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7791 payload 274 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:20:09.877+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:20:09.877+0000 7f1525085640 10 monclient: get_auth_request con 0x5643a7535050 auth_method 0 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: dump: 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.033 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: _finish_auth 0 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: _check_auth_tickets 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:20:09.877+0000 7f1413606640 10 monclient: dump: 2024-09-14T11:20:10.034 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7791 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:20:09.877+0000 7f152757f9c0 4 set_mon_vals no callback set 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: shutdown 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 asok(0x5643a747ad90) unregister_commands rotate-key 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: build_initial_monmap 2024-09-14T11:20:10.035 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: monmap: 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding auth protocol: cephx 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding auth protocol: cephx 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding auth protocol: cephx 2024-09-14T11:20:10.036 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: crc 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a768b9a0) adding con mode: secure 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:20:09.877+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: starting msgr at 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: starting objecter 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command objecter_requests hook 0x5643a76b5fc0 2024-09-14T11:20:10.037 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: setting wanted keys 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: calling monclient init 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: init 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding auth protocol: cephx 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding auth protocol: cephx 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding auth protocol: cephx 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:10.038 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: crc 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 AuthRegistry(0x5643a7685150) adding con mode: secure 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:20:09.877+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:20:09.877+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command rotate-key hook 0x5643a7685298 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-b con 0x5643a7535050 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-c con 0x5643a7535430 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-a con 0x5643a75cdf90 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.039 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient(hunting): authenticate will time out at 2868.938954s 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): get_auth_request con 0x5643a75cdf90 auth_method 0 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): get_auth_request con 0x5643a7535430 auth_method 0 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.040 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:20:09.877+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7794 payload 824 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:20:09.877+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:20:09.877+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:20:09.877+0000 7f1525085640 10 monclient: get_auth_request con 0x5643a7535050 auth_method 0 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: dump: 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.041 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: _finish_auth 0 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: _check_auth_tickets 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:20:09.877+0000 7f1411e03640 10 monclient: dump: 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.042 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:20:09.877+0000 7f1413606640 4 set_mon_vals no callback set 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:20:09.877+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7794 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:10.043 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:20:09.877+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:20:09.877+0000 7f152757f9c0 1 librados: init done 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:20:09.881+0000 7f1411e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:20:09.881+0000 7f1411e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:20:09.881+0000 7f1411e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:20:09.881+0000 7f1525085640 10 monclient: get_auth_request con 0x7f140c0718a0 auth_method 0 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:20:09.881+0000 7f1524884640 10 monclient: get_auth_request con 0x5643a76cd0d0 auth_method 0 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:20:09.885+0000 7f1525085640 10 monclient: get_auth_request con 0x5643a76d02b0 auth_method 0 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:20:09.885+0000 7f1524884640 10 monclient: get_auth_request con 0x5643a76d44a0 auth_method 0 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: build_initial_monmap 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:20:09.885+0000 7f152757f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: monmap: 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:10.044 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding auth protocol: cephx 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding auth protocol: cephx 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding auth protocol: cephx 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:10.045 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: crc 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d8f40) adding con mode: secure 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:20:09.885+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5643a76dc840 EEXIST 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: init 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding auth protocol: cephx 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding auth protocol: cephx 2024-09-14T11:20:10.046 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding auth protocol: cephx 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: crc 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 AuthRegistry(0x5643a76d7728) adding con mode: secure 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:20:09.885+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.047 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:20:09.885+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:20:09.885+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command rotate-key cmddesc rotate-key hook 0x5643a76d7870 EEXIST 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-b con 0x5643a77009f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-c con 0x5643a7700320 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-a con 0x5643a76fed00 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:20:09.885+0000 7f152757f9c0 10 monclient(hunting): authenticate will time out at 2868.947908s 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): get_auth_request con 0x5643a7700320 auth_method 0 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.048 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): get_auth_request con 0x5643a76fed00 auth_method 0 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:20:09.889+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient(hunting): get_auth_request con 0x5643a77009f0 auth_method 0 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.049 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7797 payload 824 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:20:09.889+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:20:09.889+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: dump: 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.050 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: _finish_auth 0 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: _check_auth_tickets 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:20:09.889+0000 7f140affd640 10 monclient: dump: 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.051 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:20:09.889+0000 7f1517fff640 4 set_mon_vals no callback set 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7797 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:20:09.889+0000 7f140affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:20:09.889+0000 7f140affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:20:09.889+0000 7f140affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:10.052 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:20:09.889+0000 7f1525085640 10 monclient: get_auth_request con 0x7f14000718a0 auth_method 0 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: get_monmap_and_config 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: build_initial_monmap 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:20:09.889+0000 7f152757f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: monmap: 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.053 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding auth protocol: cephx 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding auth protocol: cephx 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding auth protocol: cephx 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: crc 2024-09-14T11:20:10.054 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x5643a771fc70) adding con mode: secure 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:20:09.889+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:20:09.889+0000 7f152757f9c0 10 monclient: init 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding auth protocol: cephx 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding auth protocol: cephx 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding auth protocol: cephx 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.055 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: crc 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:20:09.889+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0050) adding con mode: secure 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command rotate-key cmddesc rotate-key hook 0x7fff43ea0198 EEXIST 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-b con 0x5643a7753ef0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-c con 0x5643a7723cd0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-a con 0x5643a77211e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): authenticate will time out at 2868.952472s 2024-09-14T11:20:10.056 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): get_auth_request con 0x5643a77211e0 auth_method 0 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): get_auth_request con 0x5643a7723cd0 auth_method 0 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:20:09.893+0000 7f1524884640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7800 payload 274 2024-09-14T11:20:10.057 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:20:09.893+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: dump: 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.058 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: _finish_auth 0 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7800 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:20:09.893+0000 7f152757f9c0 4 set_mon_vals no callback set 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:20:09.893+0000 7f1408ff9640 10 monclient: dump: 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.059 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: shutdown 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: build_initial_monmap 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: monmap: 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:10.060 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding auth protocol: cephx 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding auth protocol: cephx 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding auth protocol: cephx 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.061 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: crc 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a75141d0) adding con mode: secure 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: starting msgr at 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: starting objecter 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5643a7705c60 EEXIST 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: setting wanted keys 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: calling monclient init 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: init 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding auth protocol: cephx 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding auth protocol: cephx 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding auth protocol: cephx 2024-09-14T11:20:10.062 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: crc 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 AuthRegistry(0x5643a7702810) adding con mode: secure 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:20:09.893+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command rotate-key cmddesc rotate-key hook 0x5643a7702958 EEXIST 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:10.063 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-c con 0x5643a77211e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-b con 0x5643a7723cd0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): picked mon.noname-a con 0x5643a7753ef0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient(hunting): authenticate will time out at 2868.955052s 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): get_auth_request con 0x5643a7753ef0 auth_method 0 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): get_auth_request con 0x5643a77211e0 auth_method 0 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:10.064 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:20:09.893+0000 7f1525085640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient(hunting): handle_auth_done global_id 7803 payload 824 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient: _finish_hunting 0 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:20:09.893+0000 7f1525886640 1 monclient: found mon.noname-a 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:20:09.893+0000 7f1525886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: dump: 2024-09-14T11:20:10.065 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:20:09.893+0000 7f13f6ffd640 10 monclient: dump: 2024-09-14T11:20:10.066 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 monclient: authenticate success, global_id 7803 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:20:09.893+0000 7f1408ff9640 4 set_mon_vals no callback set 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _renew_subs 2024-09-14T11:20:10.067 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:20:09.893+0000 7f152757f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:20:09.893+0000 7f152757f9c0 1 librados: init done 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:20:09.893+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cr dump hook 0x5643a7757978 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:20:09.897+0000 7f13f6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:20:09.897+0000 7f13f6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:20:09.897+0000 7f13f6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:20:09.897+0000 7f1525085640 10 monclient: get_auth_request con 0x7f13f00718a0 auth_method 0 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:20:09.897+0000 7f1524884640 10 monclient: get_auth_request con 0x5643a776de20 auth_method 0 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 realm 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.068 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:20:09.897+0000 7f152757f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:20:09.897+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:20:09.901+0000 7f1525085640 10 monclient: get_auth_request con 0x5643a7771f40 auth_method 0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:20:09.901+0000 7f1524884640 10 monclient: get_auth_request con 0x5643a7775830 auth_method 0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:20:09.901+0000 7f152757f9c0 20 searching for the correct realm 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:20:09.901+0000 7f1525886640 10 monclient: get_auth_request con 0x5643a777a570 auth_method 0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:20:09.905+0000 7f1525085640 10 monclient: get_auth_request con 0x7f15180383f0 auth_method 0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:20:09.905+0000 7f1524884640 10 monclient: get_auth_request con 0x7f1520004040 auth_method 0 2024-09-14T11:20:10.069 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:20:09.909+0000 7f1525085640 0 -- 172.21.15.148:0/1360375047 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f15180383f0 msgr2=0x7f1518038850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:20:09.909+0000 7f13f6ffd640 1 client.7803.objecter ms_handle_reset 0x7f15180383f0 session 0x7f151803e040 osd.0 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:20:09.909+0000 7f13f6ffd640 10 monclient: _renew_subs 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:20:09.909+0000 7f13f6ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:20:09.909+0000 7f1525085640 10 monclient: get_auth_request con 0x7f13f0081b40 auth_method 0 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:20:09.909+0000 7f1525886640 10 monclient: get_auth_request con 0x7f1518044450 auth_method 0 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:20:09.913+0000 7f1525085640 10 monclient: get_auth_request con 0x7f15200bf020 auth_method 0 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:20:09.913+0000 7f1525085640 0 -- 172.21.15.148:0/1360375047 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5643a7771f40 msgr2=0x5643a7774400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:20:09.913+0000 7f13f6ffd640 1 client.7803.objecter ms_handle_reset 0x5643a7771f40 session 0x5643a776d630 osd.1 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:20:09.913+0000 7f1525085640 10 monclient: get_auth_request con 0x7f15180383f0 auth_method 0 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:10.070 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 zone default found 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:20:09.921+0000 7f152757f9c0 4 Realm: () 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:20:09.921+0000 7f152757f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:20:09.921+0000 7f152757f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:20:09.921+0000 7f152757f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 zonegroup default 2024-09-14T11:20:10.071 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:20:09.921+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 started sync module instance, tier type = 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:20:09.925+0000 7f152757f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=0 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=1 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=2 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=3 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=4 2024-09-14T11:20:10.072 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=5 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:20:09.941+0000 7f152757f9c0 20 add_watcher() i=6 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:20:09.945+0000 7f152757f9c0 20 add_watcher() i=7 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:20:09.945+0000 7f152757f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding auth protocol: cephx 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding auth protocol: cephx 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding auth protocol: cephx 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:20:09.949+0000 7f13dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.073 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: crc 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 AuthRegistry(0x7fff43ea0530) adding con mode: secure 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:20:09.949+0000 7f152757f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cache list hook 0x5643a774a3d0 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cache inspect hook 0x5643a774a3d0 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cache erase hook 0x5643a774a3d0 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command cache zap hook 0x5643a774a3d0 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 note: GC not initialized 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:20:09.949+0000 7f13dafe5640 20 reqs_thread_entry: start 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command sync trace show hook 0x7f1520112030 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command sync trace history hook 0x7f1520112030 2024-09-14T11:20:10.074 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command sync trace active hook 0x7f1520112030 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:20:09.949+0000 7f152757f9c0 5 asok(0x5643a747ad90) register_command sync trace active_short hook 0x7f1520112030 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 Filter name: none 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:20:09.949+0000 7f13d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 : miss 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:20:09.949+0000 7f152757f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:10.075 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:20:09.949+0000 7f152757f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:20:09.961+0000 7f152757f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:20:09.961+0000 7f152757f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:20:09.961+0000 7f152757f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:20:09.961+0000 7f152757f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37, ofs0, ns] 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94848572406464 notifier 7803 bl.length()=1007 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:20:09.961+0000 7f1408ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:10.076 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_sources= new_sources= 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential sources added=[] removed=[] 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_dests= new_dests= 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:20:09.961+0000 7f152757f9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential dests added=[] removed=[] 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:20:09.969+0000 7f152757f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f152757f9c0 time 2024-09-14T11:20:09.970567+0000 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f152ae592eb] 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f152ae5949f] 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5643a60f4c01] 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x142325c) [0x5643a6b5325c] 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5643a6109ecd] 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:20:10.077 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1529cbfd90] 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:20:09.969+0000 7f152757f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f152757f9c0 thread_name:radosgw-admin 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1529cd8520] 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f152ae59345] 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f152ae5949f] 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5643a60f4c01] 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x142325c) [0x5643a6b5325c] 2024-09-14T11:20:10.078 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5643a6109ecd] 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1529cbfd90] 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:20:10.079 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:20:10.080 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:20:10.081 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:20:10.082 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:20:10.083 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:20:10.084 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f13d8fe1640 / http_manager 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f13dafe5640 / http_manager 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f13dbfe7640 / rgw_dt_lg_renew 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f13f6ffd640 / ms_dispatch 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1408ff9640 / io_context_pool 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f140affd640 / ms_dispatch 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1411e03640 / ms_dispatch 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1413606640 / io_context_pool 2024-09-14T11:20:10.085 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1517fff640 / io_context_pool 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1524884640 / msgr-worker-2 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1525085640 / msgr-worker-1 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr: 7f1525886640 / msgr-worker-0 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr: 7f152757f9c0 / radosgw-admin 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:20:09.973052Z_7adcca84-5cbf-4c48-a51f-2cb10b953fda/log 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:20:10.086 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.049+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 realm 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:10.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.053+0000 7f53a68159c0 20 searching for the correct realm 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.061+0000 7f53a431b640 0 -- 172.21.15.148:0/3603476140 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f5394116000 msgr2=0x7f53940b9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.065+0000 7f53a431b640 0 -- 172.21.15.148:0/3603476140 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f539c093b60 msgr2=0x7f539c069a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:10.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 zone default found 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 4 Realm: () 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 zonegroup default 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.073+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.077+0000 7f53a68159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.077+0000 7f53a68159c0 20 started sync module instance, tier type = 2024-09-14T11:20:10.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.077+0000 7f53a68159c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.093+0000 7f53a68159c0 20 add_watcher() i=0 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.093+0000 7f53a68159c0 20 add_watcher() i=1 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.093+0000 7f53a68159c0 20 add_watcher() i=2 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.093+0000 7f53a68159c0 20 add_watcher() i=3 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.093+0000 7f53a68159c0 20 add_watcher() i=4 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.093+0000 7f53a68159c0 20 add_watcher() i=5 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.093+0000 7f53a68159c0 20 add_watcher() i=6 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.097+0000 7f53a68159c0 20 add_watcher() i=7 2024-09-14T11:20:10.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.097+0000 7f53a68159c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:10.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.097+0000 7f525afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:10.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.097+0000 7f53a68159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:10.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.097+0000 7f53a68159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:10.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.097+0000 7f53a68159c0 5 note: GC not initialized 2024-09-14T11:20:10.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f5259fdb640 20 reqs_thread_entry: start 2024-09-14T11:20:10.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:10.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 Filter name: none 2024-09-14T11:20:10.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f51cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:10.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:10.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:20:10.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:10.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:10.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:20:10.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.101+0000 7f53a68159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:10.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.105+0000 7f525afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:10.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.109+0000 7f53a68159c0 20 remove_watcher() i=0 2024-09-14T11:20:10.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.109+0000 7f53a68159c0 2 removed watcher, disabling cache 2024-09-14T11:20:10.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.109+0000 7f53a68159c0 20 remove_watcher() i=1 2024-09-14T11:20:10.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.113+0000 7f53a68159c0 20 remove_watcher() i=2 2024-09-14T11:20:10.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.113+0000 7f53a68159c0 20 remove_watcher() i=3 2024-09-14T11:20:10.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.117+0000 7f53a68159c0 20 remove_watcher() i=4 2024-09-14T11:20:10.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.117+0000 7f53a68159c0 20 remove_watcher() i=5 2024-09-14T11:20:10.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.121+0000 7f53a68159c0 20 remove_watcher() i=6 2024-09-14T11:20:10.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.125+0000 7f53a68159c0 20 remove_watcher() i=7 2024-09-14T11:20:10.131 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.132 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:10.132 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-logrecord-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:10.132 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:10.133 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:10.133 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:10.172 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:10.172 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:10.232 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:20:10.263 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:10.263 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:10.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.309+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 realm 2024-09-14T11:20:10.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:10.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:10.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.313+0000 7fe35edec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:10.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.317+0000 7fe35edec9c0 20 searching for the correct realm 2024-09-14T11:20:10.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.321+0000 7fe35d0f3640 0 -- 172.21.15.148:0/4002747214 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55c0cb0158e0 msgr2=0x55c0cb017cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:10.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.329+0000 7fe35c8f2640 0 -- 172.21.15.148:0/4002747214 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55c0cb019ad0 msgr2=0x55c0cb01bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:10.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.333+0000 7fe35edec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:10.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.333+0000 7fe35edec9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:10.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.333+0000 7fe35edec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:10.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.333+0000 7fe35edec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:10.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.333+0000 7fe35edec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:10.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.333+0000 7fe35edec9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:10.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.333+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:10.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:10.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 zone default found 2024-09-14T11:20:10.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 4 Realm: () 2024-09-14T11:20:10.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:10.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:10.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:10.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 zonegroup default 2024-09-14T11:20:10.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:10.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 started sync module instance, tier type = 2024-09-14T11:20:10.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.337+0000 7fe35edec9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:10.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 20 add_watcher() i=0 2024-09-14T11:20:10.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 20 add_watcher() i=1 2024-09-14T11:20:10.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 20 add_watcher() i=2 2024-09-14T11:20:10.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 20 add_watcher() i=3 2024-09-14T11:20:10.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 20 add_watcher() i=4 2024-09-14T11:20:10.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 20 add_watcher() i=5 2024-09-14T11:20:10.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 20 add_watcher() i=6 2024-09-14T11:20:10.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 20 add_watcher() i=7 2024-09-14T11:20:10.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.357+0000 7fe35edec9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:10.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe212fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:10.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:10.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:10.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 5 note: GC not initialized 2024-09-14T11:20:10.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe211fe3640 20 reqs_thread_entry: start 2024-09-14T11:20:10.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:10.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 20 Filter name: none 2024-09-14T11:20:10.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe1837fe640 20 reqs_thread_entry: start 2024-09-14T11:20:10.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:20:10.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:10.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:20:10.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:20:10.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 : miss 2024-09-14T11:20:10.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:10.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:20:10.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:10.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:10.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:10.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:10.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.361+0000 7fe35edec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 2024-09-14T11:20:10.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.365+0000 7fe35edec9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to be held by another RGW process; skipping for now 2024-09-14T11:20:10.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.365+0000 7fe212fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:10.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.369+0000 7fe35edec9c0 20 remove_watcher() i=0 2024-09-14T11:20:10.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.369+0000 7fe35edec9c0 2 removed watcher, disabling cache 2024-09-14T11:20:10.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.373+0000 7fe35edec9c0 20 remove_watcher() i=1 2024-09-14T11:20:10.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.373+0000 7fe35edec9c0 20 remove_watcher() i=2 2024-09-14T11:20:10.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.377+0000 7fe35edec9c0 20 remove_watcher() i=3 2024-09-14T11:20:10.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.377+0000 7fe35edec9c0 20 remove_watcher() i=4 2024-09-14T11:20:10.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.381+0000 7fe35edec9c0 20 remove_watcher() i=5 2024-09-14T11:20:10.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.381+0000 7fe35edec9c0 20 remove_watcher() i=6 2024-09-14T11:20:10.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:10.385+0000 7fe35edec9c0 20 remove_watcher() i=7 2024-09-14T11:20:10.397 INFO:tasks.workunit.client.0.smithi148.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:20:40.429 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:20:40.466 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:40.466 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:40.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.512+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 realm 2024-09-14T11:20:40.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:40.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.513 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:40.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.516+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.520+0000 7f77c8f659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:40.515 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.520+0000 7f77c8f659c0 20 searching for the correct realm 2024-09-14T11:20:40.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.524+0000 7f77c726c640 0 -- 172.21.15.148:0/1372775080 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55bf9bd14230 msgr2=0x55bf9bd166d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:40.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.532+0000 7f77c726c640 0 -- 172.21.15.148:0/1372775080 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55bf9bd209e0 msgr2=0x55bf9bd22ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:40.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:40.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:40.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:40.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:40.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:40.535 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:40.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:40.536 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 zone default found 2024-09-14T11:20:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 4 Realm: () 2024-09-14T11:20:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 zonegroup default 2024-09-14T11:20:40.537 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.538 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 started sync module instance, tier type = 2024-09-14T11:20:40.539 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.540+0000 7f77c8f659c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:40.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.560+0000 7f77c8f659c0 20 add_watcher() i=0 2024-09-14T11:20:40.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.560+0000 7f77c8f659c0 20 add_watcher() i=1 2024-09-14T11:20:40.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.560+0000 7f77c8f659c0 20 add_watcher() i=2 2024-09-14T11:20:40.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.560+0000 7f77c8f659c0 20 add_watcher() i=3 2024-09-14T11:20:40.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.560+0000 7f77c8f659c0 20 add_watcher() i=4 2024-09-14T11:20:40.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.560+0000 7f77c8f659c0 20 add_watcher() i=5 2024-09-14T11:20:40.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.560+0000 7f77c8f659c0 20 add_watcher() i=6 2024-09-14T11:20:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.564+0000 7f77c8f659c0 20 add_watcher() i=7 2024-09-14T11:20:40.560 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.564+0000 7f77c8f659c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:40.563 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f767d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 5 note: GC not initialized 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f75f7fff640 20 reqs_thread_entry: start 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 20 Filter name: none 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f75f5ffb640 20 reqs_thread_entry: start 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:20:40.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 : miss 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:40.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:40.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:40.566 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.568+0000 7f77c8f659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 2024-09-14T11:20:40.567 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.572+0000 7f77c8f659c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:20:40.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f77c8f659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:40.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f77c8f659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:40.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f77c8f659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:40.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f77c8f659c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37, ofs0, ns] 2024-09-14T11:20:40.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f76a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94281441353840 notifier 7370 bl.length()=1007 2024-09-14T11:20:40.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f76a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:40.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f76a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:40.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f76a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:40.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_sources= new_sources= 2024-09-14T11:20:40.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential sources added=[] removed=[] 2024-09-14T11:20:40.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_dests= new_dests= 2024-09-14T11:20:40.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.584+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential dests added=[] removed=[] 2024-09-14T11:20:40.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.0 2024-09-14T11:20:40.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.0 2024-09-14T11:20:40.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.1 2024-09-14T11:20:40.593 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.1 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.2 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.2 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.3 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.3 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.4 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.4 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.5 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.5 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.6 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.6 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.7 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.7 2024-09-14T11:20:40.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.8 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.8 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.9 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.9 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.10 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.10 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.11 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2.11 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.0 2024-09-14T11:20:40.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.596+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.1 2024-09-14T11:20:40.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.600+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2 2024-09-14T11:20:40.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.600+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.3 2024-09-14T11:20:40.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.600+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.4 2024-09-14T11:20:40.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.604+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.5 2024-09-14T11:20:40.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.604+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.6 2024-09-14T11:20:40.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.604+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.7 2024-09-14T11:20:40.601 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.604+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.8 2024-09-14T11:20:40.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.604+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.9 2024-09-14T11:20:40.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.604+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.10 2024-09-14T11:20:40.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.612+0000 7f77c8f659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:40.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.612+0000 7f77c8f659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 2024-09-14T11:20:40.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f77c8f659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:40.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f77c8f659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:40.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f77c8f659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:40.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f77c8f659c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37, ofs0, ns] 2024-09-14T11:20:40.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f76aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94281441353840 notifier 7370 bl.length()=1007 2024-09-14T11:20:40.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f76aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:40.611 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f76aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:40.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f76aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:40.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_sources= new_sources= 2024-09-14T11:20:40.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential sources added=[] removed=[] 2024-09-14T11:20:40.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_dests= new_dests= 2024-09-14T11:20:40.613 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.616+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential dests added=[] removed=[] 2024-09-14T11:20:40.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.624+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.0 2024-09-14T11:20:40.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.624+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.1 2024-09-14T11:20:40.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.624+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.2 2024-09-14T11:20:40.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.624+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.3 2024-09-14T11:20:40.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.628+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.4 2024-09-14T11:20:40.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.628+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.5 2024-09-14T11:20:40.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.628+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.6 2024-09-14T11:20:40.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.628+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.7 2024-09-14T11:20:40.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.628+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.8 2024-09-14T11:20:40.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.628+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.9 2024-09-14T11:20:40.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f77c8f659c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37.10 2024-09-14T11:20:40.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f77c8f659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:40.628 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f77c8f659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 2024-09-14T11:20:40.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f77c8f659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:40.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f77c8f659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:40.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f77c8f659c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:40.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f77c8f659c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37, ofs0, ns] 2024-09-14T11:20:40.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f76a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94281441353840 notifier 7370 bl.length()=975 2024-09-14T11:20:40.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f76a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 info.flags=0x17 2024-09-14T11:20:40.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f76a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 to cache LRU end 2024-09-14T11:20:40.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.632+0000 7f76a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:40.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.636+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_sources= new_sources= 2024-09-14T11:20:40.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.636+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential sources added=[] removed=[] 2024-09-14T11:20:40.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.636+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): orig_dests= new_dests= 2024-09-14T11:20:40.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.636+0000 7f77c8f659c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37]): potential dests added=[] removed=[] 2024-09-14T11:20:40.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.640+0000 7f77c8f659c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:20:40.642 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.644+0000 7f767d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:40.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.648+0000 7f77c8f659c0 20 remove_watcher() i=0 2024-09-14T11:20:40.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.648+0000 7f77c8f659c0 2 removed watcher, disabling cache 2024-09-14T11:20:40.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.652+0000 7f77c8f659c0 20 remove_watcher() i=1 2024-09-14T11:20:40.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.652+0000 7f77c8f659c0 20 remove_watcher() i=2 2024-09-14T11:20:40.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.656+0000 7f77c8f659c0 20 remove_watcher() i=3 2024-09-14T11:20:40.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.660+0000 7f77c8f659c0 20 remove_watcher() i=4 2024-09-14T11:20:40.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.660+0000 7f77c8f659c0 20 remove_watcher() i=5 2024-09-14T11:20:40.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.664+0000 7f77c8f659c0 20 remove_watcher() i=6 2024-09-14T11:20:40.662 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.664+0000 7f77c8f659c0 20 remove_watcher() i=7 2024-09-14T11:20:40.678 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:20:40.706 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:40.706 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:40.748 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.752+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 realm 2024-09-14T11:20:40.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:40.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.752 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:40.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:40.754 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.756+0000 7fa32b6959c0 20 searching for the correct realm 2024-09-14T11:20:40.760 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.764+0000 7fa32919b640 0 -- 172.21.15.148:0/4086002871 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fa31c01d060 msgr2=0x7fa31c00c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:40.765 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.768+0000 7fa32919b640 0 -- 172.21.15.148:0/4086002871 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55f880efde70 msgr2=0x55f880f00260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:40.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:40.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:40.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:40.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:40.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:40.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:40.772 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:40.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:40.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 zone default found 2024-09-14T11:20:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 4 Realm: () 2024-09-14T11:20:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 zonegroup default 2024-09-14T11:20:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.774 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.776+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.780+0000 7fa32b6959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:40.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.780+0000 7fa32b6959c0 20 started sync module instance, tier type = 2024-09-14T11:20:40.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.780+0000 7fa32b6959c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:40.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.796+0000 7fa32b6959c0 20 add_watcher() i=0 2024-09-14T11:20:40.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.796+0000 7fa32b6959c0 20 add_watcher() i=1 2024-09-14T11:20:40.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.796+0000 7fa32b6959c0 20 add_watcher() i=2 2024-09-14T11:20:40.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.796+0000 7fa32b6959c0 20 add_watcher() i=3 2024-09-14T11:20:40.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.796+0000 7fa32b6959c0 20 add_watcher() i=4 2024-09-14T11:20:40.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.796+0000 7fa32b6959c0 20 add_watcher() i=5 2024-09-14T11:20:40.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.796+0000 7fa32b6959c0 20 add_watcher() i=6 2024-09-14T11:20:40.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.800+0000 7fa32b6959c0 20 add_watcher() i=7 2024-09-14T11:20:40.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.800+0000 7fa32b6959c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:40.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa1df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:40.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:40.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:40.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 5 note: GC not initialized 2024-09-14T11:20:40.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa1de7e4640 20 reqs_thread_entry: start 2024-09-14T11:20:40.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:40.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 Filter name: none 2024-09-14T11:20:40.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa14ffff640 20 reqs_thread_entry: start 2024-09-14T11:20:40.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:40.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:40.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:40.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:20:40.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:40.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:20:40.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.804+0000 7fa32b6959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:40.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.808+0000 7fa1df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:40.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.812+0000 7fa32b6959c0 20 remove_watcher() i=0 2024-09-14T11:20:40.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.812+0000 7fa32b6959c0 2 removed watcher, disabling cache 2024-09-14T11:20:40.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.812+0000 7fa32b6959c0 20 remove_watcher() i=1 2024-09-14T11:20:40.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.816+0000 7fa32b6959c0 20 remove_watcher() i=2 2024-09-14T11:20:40.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.816+0000 7fa32b6959c0 20 remove_watcher() i=3 2024-09-14T11:20:40.816 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.820+0000 7fa32b6959c0 20 remove_watcher() i=4 2024-09-14T11:20:40.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.820+0000 7fa32b6959c0 20 remove_watcher() i=5 2024-09-14T11:20:40.821 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.824+0000 7fa32b6959c0 20 remove_watcher() i=6 2024-09-14T11:20:40.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:40.828+0000 7fa32b6959c0 20 remove_watcher() i=7 2024-09-14T11:20:40.837 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:40.837 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:40.837 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-logrecord-writes id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:20:40.837 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:40.839 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:40.839 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:40.862 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:40.862 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:41.425 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:41.425 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:41.806 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:20:41.806 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:41.809 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:41.809 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:41.959 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:41.959 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.047 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.047 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.165 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.165 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.270 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.270 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.367 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.367 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.473 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.473 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.580 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.580 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.678 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.678 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.781 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.781 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.888 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.888 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:42.993 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:42.993 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.097 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.098 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.202 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.202 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.299 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.299 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.400 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.400 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.497 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.497 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.589 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.589 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.700 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.700 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.803 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.803 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:43.907 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:43.907 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:44.013 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:44.013 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:44.112 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:20:44.145 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:44.145 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:44.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.192+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.196+0000 7fd3baad59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.196+0000 7fd3baad59c0 20 realm 2024-09-14T11:20:44.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.196+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.196+0000 7fd3baad59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.196+0000 7fd3baad59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:44.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.196+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.196+0000 7fd3baad59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.196+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.200+0000 7fd3baad59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:44.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.200+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.200+0000 7fd3baad59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:44.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.200+0000 7fd3baad59c0 20 searching for the correct realm 2024-09-14T11:20:44.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.204+0000 7fd3b85db640 0 -- 172.21.15.148:0/1351317696 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fd3a8008070 msgr2=0x7fd3a8072170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:44.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.416+0000 7fd3b85db640 0 -- 172.21.15.148:0/1351317696 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x5623ae4eb290 msgr2=0x7fd3b002f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:44.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:44.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:44.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 zone default found 2024-09-14T11:20:44.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 4 Realm: () 2024-09-14T11:20:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 zonegroup default 2024-09-14T11:20:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.636+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.640+0000 7fd3baad59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.640+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.640+0000 7fd3baad59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.640+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.640+0000 7fd3baad59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.640+0000 7fd3baad59c0 20 started sync module instance, tier type = 2024-09-14T11:20:44.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.640+0000 7fd3baad59c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:44.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.664+0000 7fd3baad59c0 20 add_watcher() i=0 2024-09-14T11:20:44.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.664+0000 7fd3baad59c0 20 add_watcher() i=1 2024-09-14T11:20:44.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.664+0000 7fd3baad59c0 20 add_watcher() i=2 2024-09-14T11:20:44.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.664+0000 7fd3baad59c0 20 add_watcher() i=3 2024-09-14T11:20:44.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.664+0000 7fd3baad59c0 20 add_watcher() i=4 2024-09-14T11:20:44.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.664+0000 7fd3baad59c0 20 add_watcher() i=5 2024-09-14T11:20:44.661 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.664+0000 7fd3baad59c0 20 add_watcher() i=6 2024-09-14T11:20:44.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.668+0000 7fd3baad59c0 20 add_watcher() i=7 2024-09-14T11:20:44.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.668+0000 7fd3baad59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:44.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd26efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:44.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd3baad59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:44.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd3baad59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:44.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd3baad59c0 5 note: GC not initialized 2024-09-14T11:20:44.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd26dfdb640 20 reqs_thread_entry: start 2024-09-14T11:20:44.669 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd3baad59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:44.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd3baad59c0 20 Filter name: none 2024-09-14T11:20:44.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd1df7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:44.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.672+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:44.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:44.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:44.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:44.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:44.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.676+0000 7fd3baad59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:44.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.680+0000 7fd26efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:44.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.684+0000 7fd3baad59c0 20 remove_watcher() i=0 2024-09-14T11:20:44.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.684+0000 7fd3baad59c0 2 removed watcher, disabling cache 2024-09-14T11:20:44.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.684+0000 7fd3baad59c0 20 remove_watcher() i=1 2024-09-14T11:20:44.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.688+0000 7fd3baad59c0 20 remove_watcher() i=2 2024-09-14T11:20:44.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.692+0000 7fd3baad59c0 20 remove_watcher() i=3 2024-09-14T11:20:44.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.692+0000 7fd3baad59c0 20 remove_watcher() i=4 2024-09-14T11:20:44.691 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.696+0000 7fd3baad59c0 20 remove_watcher() i=5 2024-09-14T11:20:44.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.696+0000 7fd3baad59c0 20 remove_watcher() i=6 2024-09-14T11:20:44.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.700+0000 7fd3baad59c0 20 remove_watcher() i=7 2024-09-14T11:20:44.719 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:44.719 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:44.719 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-change-reshard-state id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:44.720 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:44.720 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:20:44.758 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:44.758 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:44.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.804+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 realm 2024-09-14T11:20:44.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:44.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:44.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.808+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.812+0000 7f84b87939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:44.807 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.812+0000 7f84b87939c0 20 searching for the correct realm 2024-09-14T11:20:44.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.816+0000 7f84b6a9a640 0 -- 172.21.15.148:0/2943073672 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55e8c04819b0 msgr2=0x55e8c0483de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:44.819 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.824+0000 7f84b6a9a640 0 -- 172.21.15.148:0/2943073672 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55e8c048e220 msgr2=0x55e8c04906e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:44.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:44.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:44.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:44.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:44.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:44.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:44.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.828+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 zone default found 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 4 Realm: () 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 zonegroup default 2024-09-14T11:20:44.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.828 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:44.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 started sync module instance, tier type = 2024-09-14T11:20:44.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.832+0000 7f84b87939c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:44.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.848+0000 7f84b87939c0 20 add_watcher() i=0 2024-09-14T11:20:44.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.848+0000 7f84b87939c0 20 add_watcher() i=1 2024-09-14T11:20:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.848+0000 7f84b87939c0 20 add_watcher() i=2 2024-09-14T11:20:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.848+0000 7f84b87939c0 20 add_watcher() i=3 2024-09-14T11:20:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.848+0000 7f84b87939c0 20 add_watcher() i=4 2024-09-14T11:20:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.848+0000 7f84b87939c0 20 add_watcher() i=5 2024-09-14T11:20:44.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.848+0000 7f84b87939c0 20 add_watcher() i=6 2024-09-14T11:20:44.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.852+0000 7f84b87939c0 20 add_watcher() i=7 2024-09-14T11:20:44.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.852+0000 7f84b87939c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:44.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f836d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:44.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:44.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:44.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 5 note: GC not initialized 2024-09-14T11:20:44.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f83677fe640 20 reqs_thread_entry: start 2024-09-14T11:20:44.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:44.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 20 Filter name: none 2024-09-14T11:20:44.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f83657fa640 20 reqs_thread_entry: start 2024-09-14T11:20:44.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:20:44.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 : miss 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:44.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:44.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.856+0000 7f84b87939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 2024-09-14T11:20:44.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.868+0000 7f84b87939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:44.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.868+0000 7f84b87939c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:44.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.868+0000 7f84b87939c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:44.865 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.868+0000 7f84b87939c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38, ofs0, ns] 2024-09-14T11:20:44.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.868+0000 7f8399ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94458146783024 notifier 7418 bl.length()=1015 2024-09-14T11:20:44.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.868+0000 7f8399ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:44.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.868+0000 7f8399ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:44.866 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.868+0000 7f8399ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:44.867 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.872+0000 7f84b87939c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_sources= new_sources= 2024-09-14T11:20:44.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.872+0000 7f84b87939c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential sources added=[] removed=[] 2024-09-14T11:20:44.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.872+0000 7f84b87939c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_dests= new_dests= 2024-09-14T11:20:44.868 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.872+0000 7f84b87939c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential dests added=[] removed=[] 2024-09-14T11:20:44.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.0 2024-09-14T11:20:44.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.0 2024-09-14T11:20:44.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.1 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.1 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.2 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.2 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.3 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.3 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.4 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.4 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.5 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.5 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.6 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.6 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.7 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.7 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.8 2024-09-14T11:20:44.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.8 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.9 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.9 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.10 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.10 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.11 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.11 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.0 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.880+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1 2024-09-14T11:20:44.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.884+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.2 2024-09-14T11:20:44.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.884+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.3 2024-09-14T11:20:44.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.884+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.4 2024-09-14T11:20:44.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.884+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.5 2024-09-14T11:20:44.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.888+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.6 2024-09-14T11:20:44.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.888+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.7 2024-09-14T11:20:44.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.888+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.8 2024-09-14T11:20:44.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.888+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.9 2024-09-14T11:20:44.886 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.888+0000 7f84b87939c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.10 2024-09-14T11:20:44.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.896+0000 7f84b87939c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:20:44.892 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.896+0000 7f84b87939c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:20:44.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.916+0000 7f84b87939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:44.913 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.916+0000 7f84b87939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 2024-09-14T11:20:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.916+0000 7f84b87939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.916+0000 7f84b87939c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.916+0000 7f84b87939c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.916+0000 7f84b87939c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38, ofs0, ns] 2024-09-14T11:20:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f8399ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366264 cookie 94458146783024 notifier 7418 bl.length()=983 2024-09-14T11:20:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f8399ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f8399ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:44.915 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f8399ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:44.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f84b87939c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_sources= new_sources= 2024-09-14T11:20:44.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f84b87939c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential sources added=[] removed=[] 2024-09-14T11:20:44.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f84b87939c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_dests= new_dests= 2024-09-14T11:20:44.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f84b87939c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential dests added=[] removed=[] 2024-09-14T11:20:44.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.920+0000 7f84b87939c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:20:44.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.924+0000 7f836d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:44.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.928+0000 7f84b87939c0 20 remove_watcher() i=0 2024-09-14T11:20:44.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.928+0000 7f84b87939c0 2 removed watcher, disabling cache 2024-09-14T11:20:44.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.928+0000 7f84b87939c0 20 remove_watcher() i=1 2024-09-14T11:20:44.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.932+0000 7f84b87939c0 20 remove_watcher() i=2 2024-09-14T11:20:44.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.932+0000 7f84b87939c0 20 remove_watcher() i=3 2024-09-14T11:20:44.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.936+0000 7f84b87939c0 20 remove_watcher() i=4 2024-09-14T11:20:44.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.936+0000 7f84b87939c0 20 remove_watcher() i=5 2024-09-14T11:20:44.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.940+0000 7f84b87939c0 20 remove_watcher() i=6 2024-09-14T11:20:44.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:44.944+0000 7f84b87939c0 20 remove_watcher() i=7 2024-09-14T11:20:44.955 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:20:44.983 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:44.983 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:45.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 20 realm 2024-09-14T11:20:45.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:45.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.032+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.036+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:45.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.036+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.036+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:45.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.036+0000 7f4a6fbeb9c0 20 searching for the correct realm 2024-09-14T11:20:45.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.040+0000 7f4a6cef0640 0 -- 172.21.15.148:0/1514204982 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x560e77130090 msgr2=0x560e77132480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:45.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.048+0000 7f4a6d6f1640 0 -- 172.21.15.148:0/1514204982 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f4a680675f0 msgr2=0x7f4a68066fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:45.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:45.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:45.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 zone default found 2024-09-14T11:20:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 4 Realm: () 2024-09-14T11:20:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:45.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 zonegroup default 2024-09-14T11:20:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.056+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.060+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.060+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.060+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.055 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.060+0000 7f4a6fbeb9c0 20 started sync module instance, tier type = 2024-09-14T11:20:45.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.060+0000 7f4a6fbeb9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:45.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.076+0000 7f4a6fbeb9c0 20 add_watcher() i=0 2024-09-14T11:20:45.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.076+0000 7f4a6fbeb9c0 20 add_watcher() i=1 2024-09-14T11:20:45.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.076+0000 7f4a6fbeb9c0 20 add_watcher() i=2 2024-09-14T11:20:45.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.076+0000 7f4a6fbeb9c0 20 add_watcher() i=3 2024-09-14T11:20:45.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.076+0000 7f4a6fbeb9c0 20 add_watcher() i=4 2024-09-14T11:20:45.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.076+0000 7f4a6fbeb9c0 20 add_watcher() i=5 2024-09-14T11:20:45.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.076+0000 7f4a6fbeb9c0 20 add_watcher() i=6 2024-09-14T11:20:45.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.080+0000 7f4a6fbeb9c0 20 add_watcher() i=7 2024-09-14T11:20:45.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.080+0000 7f4a6fbeb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:45.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f49237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:45.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:45.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:45.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 5 note: GC not initialized 2024-09-14T11:20:45.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f49227e4640 20 reqs_thread_entry: start 2024-09-14T11:20:45.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:45.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 Filter name: none 2024-09-14T11:20:45.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4893fff640 20 reqs_thread_entry: start 2024-09-14T11:20:45.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.084+0000 7f4a6fbeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.088+0000 7f4a6fbeb9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.088+0000 7f4a6fbeb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:45.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.088+0000 7f49237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:45.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.092+0000 7f4a6fbeb9c0 20 remove_watcher() i=0 2024-09-14T11:20:45.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.092+0000 7f4a6fbeb9c0 2 removed watcher, disabling cache 2024-09-14T11:20:45.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.096+0000 7f4a6fbeb9c0 20 remove_watcher() i=1 2024-09-14T11:20:45.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.096+0000 7f4a6fbeb9c0 20 remove_watcher() i=2 2024-09-14T11:20:45.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.100+0000 7f4a6fbeb9c0 20 remove_watcher() i=3 2024-09-14T11:20:45.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.100+0000 7f4a6fbeb9c0 20 remove_watcher() i=4 2024-09-14T11:20:45.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.104+0000 7f4a6fbeb9c0 20 remove_watcher() i=5 2024-09-14T11:20:45.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.104+0000 7f4a6fbeb9c0 20 remove_watcher() i=6 2024-09-14T11:20:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.108+0000 7f4a6fbeb9c0 20 remove_watcher() i=7 2024-09-14T11:20:45.119 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:45.119 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:45.119 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-change-reshard-state id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:45.119 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:45.120 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:45.120 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:45.161 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:45.236 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:20:45.272 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:45.272 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:45.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.320+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 realm 2024-09-14T11:20:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:45.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.324+0000 7feced1d99c0 20 searching for the correct realm 2024-09-14T11:20:45.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.332+0000 7feceacdf640 0 -- 172.21.15.148:0/3575483657 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fecdc073ac0 msgr2=0x7fecdc04e150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:45.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.336+0000 7feceacdf640 0 -- 172.21.15.148:0/3575483657 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fece40b0070 msgr2=0x7fece40f8910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:45.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.344+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 zone default found 2024-09-14T11:20:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 4 Realm: () 2024-09-14T11:20:45.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:45.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:45.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:45.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 zonegroup default 2024-09-14T11:20:45.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 started sync module instance, tier type = 2024-09-14T11:20:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.348+0000 7feced1d99c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 20 add_watcher() i=0 2024-09-14T11:20:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 20 add_watcher() i=1 2024-09-14T11:20:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 20 add_watcher() i=2 2024-09-14T11:20:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 20 add_watcher() i=3 2024-09-14T11:20:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 20 add_watcher() i=4 2024-09-14T11:20:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 20 add_watcher() i=5 2024-09-14T11:20:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 20 add_watcher() i=6 2024-09-14T11:20:45.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 20 add_watcher() i=7 2024-09-14T11:20:45.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.368+0000 7feced1d99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:45.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feba17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:45.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feced1d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:45.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feced1d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:45.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feced1d99c0 5 note: GC not initialized 2024-09-14T11:20:45.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feb1bfff640 20 reqs_thread_entry: start 2024-09-14T11:20:45.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feced1d99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:45.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feced1d99c0 20 Filter name: none 2024-09-14T11:20:45.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feb19ffb640 20 reqs_thread_entry: start 2024-09-14T11:20:45.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feced1d99c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:20:45.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.372+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 : miss 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.376+0000 7feced1d99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 2024-09-14T11:20:45.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7feced1d99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:45.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7feced1d99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:45.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7feced1d99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:45.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7feced1d99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38, ofs0, ns] 2024-09-14T11:20:45.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7febce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366265 cookie 94254354333824 notifier 7451 bl.length()=1015 2024-09-14T11:20:45.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7febce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:45.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7febce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:45.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7febce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:45.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_sources= new_sources= 2024-09-14T11:20:45.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential sources added=[] removed=[] 2024-09-14T11:20:45.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_dests= new_dests= 2024-09-14T11:20:45.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.384+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential dests added=[] removed=[] 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.0 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.0 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.1 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.1 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.2 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.2 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.3 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.3 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.4 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.4 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.5 2024-09-14T11:20:45.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.5 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.6 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.6 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.7 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.7 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.8 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.8 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.9 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.9 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.10 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.10 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.11 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1.11 2024-09-14T11:20:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.0 2024-09-14T11:20:45.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1 2024-09-14T11:20:45.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.396+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.2 2024-09-14T11:20:45.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.400+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.3 2024-09-14T11:20:45.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.400+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.4 2024-09-14T11:20:45.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.400+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.5 2024-09-14T11:20:45.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.400+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.6 2024-09-14T11:20:45.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.404+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.7 2024-09-14T11:20:45.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.404+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.8 2024-09-14T11:20:45.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.404+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.9 2024-09-14T11:20:45.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.408+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.10 2024-09-14T11:20:45.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.412+0000 7feced1d99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:45.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.412+0000 7feced1d99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 2024-09-14T11:20:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7feced1d99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7feced1d99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7feced1d99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7feced1d99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38, ofs0, ns] 2024-09-14T11:20:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7febce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366266 cookie 94254354333824 notifier 7451 bl.length()=1015 2024-09-14T11:20:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7febce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7febce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:45.412 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7febce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:45.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_sources= new_sources= 2024-09-14T11:20:45.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential sources added=[] removed=[] 2024-09-14T11:20:45.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_dests= new_dests= 2024-09-14T11:20:45.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.416+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential dests added=[] removed=[] 2024-09-14T11:20:45.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.420+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.0 2024-09-14T11:20:45.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.424+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.1 2024-09-14T11:20:45.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.424+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.2 2024-09-14T11:20:45.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.424+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.3 2024-09-14T11:20:45.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.424+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.4 2024-09-14T11:20:45.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.424+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.5 2024-09-14T11:20:45.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.424+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.6 2024-09-14T11:20:45.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.428+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.7 2024-09-14T11:20:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.428+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.8 2024-09-14T11:20:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.428+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.9 2024-09-14T11:20:45.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.428+0000 7feced1d99c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38.10 2024-09-14T11:20:45.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.428+0000 7feced1d99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:45.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.428+0000 7feced1d99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 2024-09-14T11:20:45.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7feced1d99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:45.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7feced1d99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:45.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7feced1d99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:45.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7feced1d99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38, ofs0, ns] 2024-09-14T11:20:45.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7febcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366267 cookie 94254354333824 notifier 7451 bl.length()=983 2024-09-14T11:20:45.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7febcdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 info.flags=0x17 2024-09-14T11:20:45.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7febcdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 to cache LRU end 2024-09-14T11:20:45.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7febcdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:45.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_sources= new_sources= 2024-09-14T11:20:45.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential sources added=[] removed=[] 2024-09-14T11:20:45.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): orig_dests= new_dests= 2024-09-14T11:20:45.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.432+0000 7feced1d99c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38]): potential dests added=[] removed=[] 2024-09-14T11:20:45.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.440+0000 7feced1d99c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:20:45.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.444+0000 7feba17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.448+0000 7feced1d99c0 20 remove_watcher() i=0 2024-09-14T11:20:45.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.448+0000 7feced1d99c0 2 removed watcher, disabling cache 2024-09-14T11:20:45.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.448+0000 7feced1d99c0 20 remove_watcher() i=1 2024-09-14T11:20:45.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.452+0000 7feced1d99c0 20 remove_watcher() i=2 2024-09-14T11:20:45.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.452+0000 7feced1d99c0 20 remove_watcher() i=3 2024-09-14T11:20:45.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.456+0000 7feced1d99c0 20 remove_watcher() i=4 2024-09-14T11:20:45.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.456+0000 7feced1d99c0 20 remove_watcher() i=5 2024-09-14T11:20:45.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.460+0000 7feced1d99c0 20 remove_watcher() i=6 2024-09-14T11:20:45.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.460+0000 7feced1d99c0 20 remove_watcher() i=7 2024-09-14T11:20:45.474 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:20:45.505 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:45.505 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:45.546 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.548+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.548 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 realm 2024-09-14T11:20:45.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.549 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:45.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:45.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.552+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.556+0000 7fe3265ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:45.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.556+0000 7fe3265ce9c0 20 searching for the correct realm 2024-09-14T11:20:45.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.560+0000 7fe3248d5640 0 -- 172.21.15.148:0/467685825 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55dc7dd37ab0 msgr2=0x55dc7dd39ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:45.564 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.568+0000 7fe3248d5640 0 -- 172.21.15.148:0/467685825 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55dc7dd441b0 msgr2=0x55dc7dd46670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.572+0000 7fe3265ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.572+0000 7fe3265ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.572+0000 7fe3265ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.572+0000 7fe3265ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.572+0000 7fe3265ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.572+0000 7fe3265ce9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:45.570 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.572+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:45.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:45.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 zone default found 2024-09-14T11:20:45.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 4 Realm: () 2024-09-14T11:20:45.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:45.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:45.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:45.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 zonegroup default 2024-09-14T11:20:45.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:45.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 started sync module instance, tier type = 2024-09-14T11:20:45.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.576+0000 7fe3265ce9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:45.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 20 add_watcher() i=0 2024-09-14T11:20:45.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 20 add_watcher() i=1 2024-09-14T11:20:45.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 20 add_watcher() i=2 2024-09-14T11:20:45.591 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 20 add_watcher() i=3 2024-09-14T11:20:45.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 20 add_watcher() i=4 2024-09-14T11:20:45.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 20 add_watcher() i=5 2024-09-14T11:20:45.592 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 20 add_watcher() i=6 2024-09-14T11:20:45.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 20 add_watcher() i=7 2024-09-14T11:20:45.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.596+0000 7fe3265ce9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:45.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe1dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:45.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe3265ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:45.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe3265ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:45.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe3265ce9c0 5 note: GC not initialized 2024-09-14T11:20:45.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe1d9fdb640 20 reqs_thread_entry: start 2024-09-14T11:20:45.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe3265ce9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:45.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe3265ce9c0 20 Filter name: none 2024-09-14T11:20:45.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe14b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:45.598 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe3265ce9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:45.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.600+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.604+0000 7fe3265ce9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:45.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.604+0000 7fe3265ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:45.599 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.604+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.604+0000 7fe3265ce9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:45.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.604+0000 7fe3265ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:45.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.604+0000 7fe3265ce9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:45.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.604+0000 7fe3265ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:45.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.604+0000 7fe1dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:45.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.608+0000 7fe3265ce9c0 20 remove_watcher() i=0 2024-09-14T11:20:45.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.608+0000 7fe3265ce9c0 2 removed watcher, disabling cache 2024-09-14T11:20:45.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.612+0000 7fe3265ce9c0 20 remove_watcher() i=1 2024-09-14T11:20:45.610 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.612+0000 7fe3265ce9c0 20 remove_watcher() i=2 2024-09-14T11:20:45.612 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.616+0000 7fe3265ce9c0 20 remove_watcher() i=3 2024-09-14T11:20:45.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.616+0000 7fe3265ce9c0 20 remove_watcher() i=4 2024-09-14T11:20:45.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.620+0000 7fe3265ce9c0 20 remove_watcher() i=5 2024-09-14T11:20:45.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.624+0000 7fe3265ce9c0 20 remove_watcher() i=6 2024-09-14T11:20:45.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:45.624+0000 7fe3265ce9c0 20 remove_watcher() i=7 2024-09-14T11:20:45.635 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:45.635 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:45.635 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-change-reshard-state id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:20:45.635 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:45.636 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:45.636 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:45.656 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:45.656 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:46.197 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:46.197 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:46.590 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:20:46.590 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:46.592 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:46.592 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:46.728 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:46.728 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:46.818 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:46.893 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:46.930 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:46.931 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.033 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.033 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.133 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.133 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.235 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.235 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.333 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.334 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.438 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.438 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.543 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.543 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.641 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.641 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.742 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.742 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.844 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.844 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:47.945 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:47.945 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.040 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:48.040 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.145 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:48.145 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.246 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:48.246 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.346 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:48.346 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.447 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:48.447 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.550 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:48.550 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.656 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:48.656 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.759 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:48.759 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:48.859 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:20:48.893 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:48.893 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:48.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.940+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:48.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 realm 2024-09-14T11:20:48.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:48.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:48.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:48.940 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:48.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:48.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.944+0000 7f00a75879c0 20 searching for the correct realm 2024-09-14T11:20:48.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.952+0000 7f00a488c640 0 -- 172.21.15.148:0/1191375003 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x555fb7de84f0 msgr2=0x555fb7dea8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:48.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.956+0000 7f00a508d640 0 -- 172.21.15.148:0/1191375003 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f00a006c720 msgr2=0x7f00a00842f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:48.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:48.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:48.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:48.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:48.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:48.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:48.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:48.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:48.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.964+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:48.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 zone default found 2024-09-14T11:20:48.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 4 Realm: () 2024-09-14T11:20:48.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:48.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:48.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:48.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 zonegroup default 2024-09-14T11:20:48.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:48.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:48.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:48.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 started sync module instance, tier type = 2024-09-14T11:20:48.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.968+0000 7f00a75879c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:48.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.984+0000 7f00a75879c0 20 add_watcher() i=0 2024-09-14T11:20:48.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.984+0000 7f00a75879c0 20 add_watcher() i=1 2024-09-14T11:20:48.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.984+0000 7f00a75879c0 20 add_watcher() i=2 2024-09-14T11:20:48.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.984+0000 7f00a75879c0 20 add_watcher() i=3 2024-09-14T11:20:48.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.984+0000 7f00a75879c0 20 add_watcher() i=4 2024-09-14T11:20:48.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.984+0000 7f00a75879c0 20 add_watcher() i=5 2024-09-14T11:20:48.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.984+0000 7f00a75879c0 20 add_watcher() i=6 2024-09-14T11:20:48.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.988+0000 7f00a75879c0 20 add_watcher() i=7 2024-09-14T11:20:48.985 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.988+0000 7f00a75879c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:48.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7eff5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:48.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7f00a75879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:48.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7f00a75879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:48.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7f00a75879c0 5 note: GC not initialized 2024-09-14T11:20:48.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7eff5a7e4640 20 reqs_thread_entry: start 2024-09-14T11:20:48.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7f00a75879c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:48.989 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7f00a75879c0 20 Filter name: none 2024-09-14T11:20:48.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7efecbfff640 20 reqs_thread_entry: start 2024-09-14T11:20:48.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7f00a75879c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:48.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.992+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.996+0000 7f00a75879c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:48.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.996+0000 7f00a75879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:48.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.996+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.996+0000 7f00a75879c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:48.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.996+0000 7f00a75879c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:48.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.996+0000 7f00a75879c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:48.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:48.996+0000 7f00a75879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:48.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.000+0000 7eff5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:48.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.004+0000 7f00a75879c0 20 remove_watcher() i=0 2024-09-14T11:20:48.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.004+0000 7f00a75879c0 2 removed watcher, disabling cache 2024-09-14T11:20:49.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.004+0000 7f00a75879c0 20 remove_watcher() i=1 2024-09-14T11:20:49.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.008+0000 7f00a75879c0 20 remove_watcher() i=2 2024-09-14T11:20:49.005 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.008+0000 7f00a75879c0 20 remove_watcher() i=3 2024-09-14T11:20:49.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.012+0000 7f00a75879c0 20 remove_watcher() i=4 2024-09-14T11:20:49.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.012+0000 7f00a75879c0 20 remove_watcher() i=5 2024-09-14T11:20:49.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.016+0000 7f00a75879c0 20 remove_watcher() i=6 2024-09-14T11:20:49.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.020+0000 7f00a75879c0 20 remove_watcher() i=7 2024-09-14T11:20:49.030 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:49.030 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:49.030 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-change-reshard-state id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:49.030 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:49.030 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:20:49.065 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:49.066 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:49.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.112+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 realm 2024-09-14T11:20:49.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:49.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:49.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:49.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.116+0000 7ff9ca26a9c0 20 searching for the correct realm 2024-09-14T11:20:49.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.124+0000 7ff9c7d70640 0 -- 172.21.15.148:0/3139601655 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7ff9c0019070 msgr2=0x7ff9c005d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:49.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.128+0000 7ff9c7d70640 0 -- 172.21.15.148:0/3139601655 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55cd134176b0 msgr2=0x55cd13419aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:49.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.332+0000 7ff9ca26a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:49.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.332+0000 7ff9ca26a9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:49.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.332+0000 7ff9ca26a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:49.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.332+0000 7ff9ca26a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:49.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.332+0000 7ff9ca26a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:49.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.332+0000 7ff9ca26a9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:49.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.332+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.331 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:49.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:49.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 zone default found 2024-09-14T11:20:49.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 4 Realm: () 2024-09-14T11:20:49.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:49.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:49.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:49.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 zonegroup default 2024-09-14T11:20:49.333 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.336+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.340+0000 7ff9ca26a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.340+0000 7ff9ca26a9c0 20 started sync module instance, tier type = 2024-09-14T11:20:49.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.340+0000 7ff9ca26a9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:49.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.360+0000 7ff9ca26a9c0 20 add_watcher() i=0 2024-09-14T11:20:49.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.360+0000 7ff9ca26a9c0 20 add_watcher() i=1 2024-09-14T11:20:49.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.360+0000 7ff9ca26a9c0 20 add_watcher() i=2 2024-09-14T11:20:49.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.360+0000 7ff9ca26a9c0 20 add_watcher() i=3 2024-09-14T11:20:49.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.360+0000 7ff9ca26a9c0 20 add_watcher() i=4 2024-09-14T11:20:49.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.360+0000 7ff9ca26a9c0 20 add_watcher() i=5 2024-09-14T11:20:49.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.360+0000 7ff9ca26a9c0 20 add_watcher() i=6 2024-09-14T11:20:49.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.364+0000 7ff9ca26a9c0 20 add_watcher() i=7 2024-09-14T11:20:49.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.364+0000 7ff9ca26a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:49.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.368+0000 7ff87dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:49.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:49.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:49.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 5 note: GC not initialized 2024-09-14T11:20:49.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff87cfe1640 20 reqs_thread_entry: start 2024-09-14T11:20:49.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:49.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 20 Filter name: none 2024-09-14T11:20:49.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff7f67fc640 20 reqs_thread_entry: start 2024-09-14T11:20:49.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:20:49.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:49.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:20:49.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:20:49.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 : miss 2024-09-14T11:20:49.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:49.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 info.flags=0x17 2024-09-14T11:20:49.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 to cache LRU end 2024-09-14T11:20:49.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:49.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:49.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.372+0000 7ff9ca26a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 2024-09-14T11:20:49.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff9ca26a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 info.flags=0x17 2024-09-14T11:20:49.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff9ca26a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 to cache LRU end 2024-09-14T11:20:49.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff9ca26a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:49.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff9ca26a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39, ofs0, ns] 2024-09-14T11:20:49.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff8a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366272 cookie 94339279720560 notifier 8001 bl.length()=1015 2024-09-14T11:20:49.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff8a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 info.flags=0x17 2024-09-14T11:20:49.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff8a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 to cache LRU end 2024-09-14T11:20:49.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff8a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:49.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): orig_sources= new_sources= 2024-09-14T11:20:49.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): potential sources added=[] removed=[] 2024-09-14T11:20:49.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): orig_dests= new_dests= 2024-09-14T11:20:49.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.388+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): potential dests added=[] removed=[] 2024-09-14T11:20:49.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.0 2024-09-14T11:20:49.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.0 2024-09-14T11:20:49.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.1 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.1 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.2 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.2 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.3 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.3 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.4 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.4 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.5 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.5 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.6 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.6 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.7 2024-09-14T11:20:49.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.7 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.8 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.8 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.9 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.9 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.10 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.10 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.11 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1.11 2024-09-14T11:20:49.401 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.0 2024-09-14T11:20:49.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1 2024-09-14T11:20:49.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.404+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.2 2024-09-14T11:20:49.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.408+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.3 2024-09-14T11:20:49.404 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.408+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.4 2024-09-14T11:20:49.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.408+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.5 2024-09-14T11:20:49.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.408+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.6 2024-09-14T11:20:49.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.408+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.7 2024-09-14T11:20:49.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.412+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.8 2024-09-14T11:20:49.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.412+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.9 2024-09-14T11:20:49.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.412+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.10 2024-09-14T11:20:49.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.420+0000 7ff9ca26a9c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:20:49.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.420+0000 7ff9ca26a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:49.415 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.420+0000 7ff9ca26a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 2024-09-14T11:20:49.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.420+0000 7ff9ca26a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 info.flags=0x17 2024-09-14T11:20:49.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.420+0000 7ff9ca26a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 to cache LRU end 2024-09-14T11:20:49.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.420+0000 7ff9ca26a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:49.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.420+0000 7ff9ca26a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39, ofs0, ns] 2024-09-14T11:20:49.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.424+0000 7ff8a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366273 cookie 94339279720560 notifier 8001 bl.length()=1015 2024-09-14T11:20:49.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.424+0000 7ff8a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 info.flags=0x17 2024-09-14T11:20:49.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.424+0000 7ff8a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 to cache LRU end 2024-09-14T11:20:49.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.424+0000 7ff8a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:49.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.424+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): orig_sources= new_sources= 2024-09-14T11:20:49.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.424+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): potential sources added=[] removed=[] 2024-09-14T11:20:49.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.424+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): orig_dests= new_dests= 2024-09-14T11:20:49.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.424+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): potential dests added=[] removed=[] 2024-09-14T11:20:49.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.432+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.0 2024-09-14T11:20:49.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.432+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.1 2024-09-14T11:20:49.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.432+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.2 2024-09-14T11:20:49.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.432+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.3 2024-09-14T11:20:49.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.436+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.4 2024-09-14T11:20:49.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.436+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.5 2024-09-14T11:20:49.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.436+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.6 2024-09-14T11:20:49.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.436+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.7 2024-09-14T11:20:49.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.436+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.8 2024-09-14T11:20:49.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.436+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.9 2024-09-14T11:20:49.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.440+0000 7ff9ca26a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39.10 2024-09-14T11:20:49.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.440+0000 7ff9ca26a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:49.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.440+0000 7ff9ca26a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 2024-09-14T11:20:49.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff9ca26a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 info.flags=0x17 2024-09-14T11:20:49.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff9ca26a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 to cache LRU end 2024-09-14T11:20:49.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff9ca26a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:49.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff9ca26a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39, ofs0, ns] 2024-09-14T11:20:49.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff8a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366274 cookie 94339279720560 notifier 8001 bl.length()=983 2024-09-14T11:20:49.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff8a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 info.flags=0x17 2024-09-14T11:20:49.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff8a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 to cache LRU end 2024-09-14T11:20:49.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff8a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:49.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): orig_sources= new_sources= 2024-09-14T11:20:49.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): potential sources added=[] removed=[] 2024-09-14T11:20:49.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): orig_dests= new_dests= 2024-09-14T11:20:49.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.444+0000 7ff9ca26a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39]): potential dests added=[] removed=[] 2024-09-14T11:20:49.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.452+0000 7ff9ca26a9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:20:49.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.456+0000 7ff87dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:49.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.460+0000 7ff9ca26a9c0 20 remove_watcher() i=0 2024-09-14T11:20:49.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.460+0000 7ff9ca26a9c0 2 removed watcher, disabling cache 2024-09-14T11:20:49.459 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.464+0000 7ff9ca26a9c0 20 remove_watcher() i=1 2024-09-14T11:20:49.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.464+0000 7ff9ca26a9c0 20 remove_watcher() i=2 2024-09-14T11:20:49.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.468+0000 7ff9ca26a9c0 20 remove_watcher() i=3 2024-09-14T11:20:49.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.468+0000 7ff9ca26a9c0 20 remove_watcher() i=4 2024-09-14T11:20:49.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.472+0000 7ff9ca26a9c0 20 remove_watcher() i=5 2024-09-14T11:20:49.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.472+0000 7ff9ca26a9c0 20 remove_watcher() i=6 2024-09-14T11:20:49.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.476+0000 7ff9ca26a9c0 20 remove_watcher() i=7 2024-09-14T11:20:49.495 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:20:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:49.526 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:49.568 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.572+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 realm 2024-09-14T11:20:49.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:49.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.572 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:49.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:49.574 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.576+0000 7fa57512b9c0 20 searching for the correct realm 2024-09-14T11:20:49.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.584+0000 7fa573432640 0 -- 172.21.15.148:0/3794236093 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55bf854ed280 msgr2=0x55bf854ef740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:49.586 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.588+0000 7fa572c31640 0 -- 172.21.15.148:0/3794236093 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55bf854f1510 msgr2=0x55bf854f3920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.594 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.596+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 zone default found 2024-09-14T11:20:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 4 Realm: () 2024-09-14T11:20:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:49.595 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:49.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 zonegroup default 2024-09-14T11:20:49.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.596 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:49.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 started sync module instance, tier type = 2024-09-14T11:20:49.597 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.600+0000 7fa57512b9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 20 add_watcher() i=0 2024-09-14T11:20:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 20 add_watcher() i=1 2024-09-14T11:20:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 20 add_watcher() i=2 2024-09-14T11:20:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 20 add_watcher() i=3 2024-09-14T11:20:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 20 add_watcher() i=4 2024-09-14T11:20:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 20 add_watcher() i=5 2024-09-14T11:20:49.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 20 add_watcher() i=6 2024-09-14T11:20:49.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 20 add_watcher() i=7 2024-09-14T11:20:49.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.620+0000 7fa57512b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:49.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa4297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:49.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa57512b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:49.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa57512b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:49.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa57512b9c0 5 note: GC not initialized 2024-09-14T11:20:49.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa3a3fff640 20 reqs_thread_entry: start 2024-09-14T11:20:49.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa57512b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:49.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa57512b9c0 20 Filter name: none 2024-09-14T11:20:49.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa3a1ffb640 20 reqs_thread_entry: start 2024-09-14T11:20:49.622 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa57512b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.624+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.628+0000 7fa57512b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:49.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.628+0000 7fa57512b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.628+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.628+0000 7fa57512b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:49.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.628+0000 7fa57512b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.628+0000 7fa57512b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:49.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.628+0000 7fa57512b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:49.627 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.632+0000 7fa4297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.636+0000 7fa57512b9c0 20 remove_watcher() i=0 2024-09-14T11:20:49.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.636+0000 7fa57512b9c0 2 removed watcher, disabling cache 2024-09-14T11:20:49.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.636+0000 7fa57512b9c0 20 remove_watcher() i=1 2024-09-14T11:20:49.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.640+0000 7fa57512b9c0 20 remove_watcher() i=2 2024-09-14T11:20:49.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.640+0000 7fa57512b9c0 20 remove_watcher() i=3 2024-09-14T11:20:49.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.644+0000 7fa57512b9c0 20 remove_watcher() i=4 2024-09-14T11:20:49.641 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.644+0000 7fa57512b9c0 20 remove_watcher() i=5 2024-09-14T11:20:49.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.648+0000 7fa57512b9c0 20 remove_watcher() i=6 2024-09-14T11:20:49.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:49.652+0000 7fa57512b9c0 20 remove_watcher() i=7 2024-09-14T11:20:49.661 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:49.661 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: error-at-change-reshard-state id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:20:49.661 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:49.662 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:49.662 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:49.686 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:49.686 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:50.268 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:50.268 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:50.653 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:20:50.653 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:50.656 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:50.656 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:50.789 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:50.789 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:50.879 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:50.879 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:50.987 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:50.987 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.090 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.090 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.197 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.197 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.290 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.290 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.393 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.393 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.517 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.517 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.626 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.626 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.726 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.726 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.827 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.827 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:51.941 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:51.941 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.042 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.042 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.143 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.143 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.251 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.251 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.348 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.349 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.449 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.450 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.552 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.552 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.644 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.644 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.731 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.731 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.832 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:52.832 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:52.929 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:20:52.961 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:52.961 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:53.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.008+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 realm 2024-09-14T11:20:53.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:53.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:53.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.012+0000 7f296efd69c0 20 searching for the correct realm 2024-09-14T11:20:53.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.020+0000 7f296cadc640 0 -- 172.21.15.148:0/3931164082 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f295c07c070 msgr2=0x7f295c067e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:53.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.024+0000 7f296cadc640 0 -- 172.21.15.148:0/3931164082 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f29640df910 msgr2=0x7f29640cc3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:53.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:53.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:53.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:53.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:53.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:53.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:53.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.032+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:53.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 zone default found 2024-09-14T11:20:53.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 4 Realm: () 2024-09-14T11:20:53.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:53.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:53.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:53.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 zonegroup default 2024-09-14T11:20:53.034 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 started sync module instance, tier type = 2024-09-14T11:20:53.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.036+0000 7f296efd69c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:53.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 20 add_watcher() i=0 2024-09-14T11:20:53.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 20 add_watcher() i=1 2024-09-14T11:20:53.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 20 add_watcher() i=2 2024-09-14T11:20:53.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 20 add_watcher() i=3 2024-09-14T11:20:53.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 20 add_watcher() i=4 2024-09-14T11:20:53.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 20 add_watcher() i=5 2024-09-14T11:20:53.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 20 add_watcher() i=6 2024-09-14T11:20:53.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 20 add_watcher() i=7 2024-09-14T11:20:53.054 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.056+0000 7f296efd69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:53.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.060+0000 7f2822fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.060+0000 7f296efd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:53.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.060+0000 7f296efd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:53.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.060+0000 7f296efd69c0 5 note: GC not initialized 2024-09-14T11:20:53.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.060+0000 7f2821fe3640 20 reqs_thread_entry: start 2024-09-14T11:20:53.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:53.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 Filter name: none 2024-09-14T11:20:53.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f27937fe640 20 reqs_thread_entry: start 2024-09-14T11:20:53.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:53.060 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:53.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:53.061 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:53.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:53.062 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.064+0000 7f296efd69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:53.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.068+0000 7f2822fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.072+0000 7f296efd69c0 20 remove_watcher() i=0 2024-09-14T11:20:53.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.072+0000 7f296efd69c0 2 removed watcher, disabling cache 2024-09-14T11:20:53.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.076+0000 7f296efd69c0 20 remove_watcher() i=1 2024-09-14T11:20:53.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.076+0000 7f296efd69c0 20 remove_watcher() i=2 2024-09-14T11:20:53.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.080+0000 7f296efd69c0 20 remove_watcher() i=3 2024-09-14T11:20:53.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.080+0000 7f296efd69c0 20 remove_watcher() i=4 2024-09-14T11:20:53.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.084+0000 7f296efd69c0 20 remove_watcher() i=5 2024-09-14T11:20:53.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.084+0000 7f296efd69c0 20 remove_watcher() i=6 2024-09-14T11:20:53.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.088+0000 7f296efd69c0 20 remove_watcher() i=7 2024-09-14T11:20:53.099 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.099 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:53.099 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-change-reshard-state id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:53.099 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.100 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:20:53.135 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:53.136 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:53.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.180+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 realm 2024-09-14T11:20:53.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:53.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.188+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:53.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.188+0000 7f9a569139c0 20 searching for the correct realm 2024-09-14T11:20:53.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.192+0000 7f9a54c1a640 0 -- 172.21.15.148:0/2990246492 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55dd87513ec0 msgr2=0x55dd87516350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:53.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.200+0000 7f9a54419640 0 -- 172.21.15.148:0/2990246492 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55dd87517f90 msgr2=0x55dd8751a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:53.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:53.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:53.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:53.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:53.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:53.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:53.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:53.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 zone default found 2024-09-14T11:20:53.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 4 Realm: () 2024-09-14T11:20:53.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:53.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:53.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:53.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 zonegroup default 2024-09-14T11:20:53.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 started sync module instance, tier type = 2024-09-14T11:20:53.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.208+0000 7f9a569139c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:53.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=0 2024-09-14T11:20:53.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=1 2024-09-14T11:20:53.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=2 2024-09-14T11:20:53.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=3 2024-09-14T11:20:53.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=4 2024-09-14T11:20:53.225 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=5 2024-09-14T11:20:53.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=6 2024-09-14T11:20:53.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.232+0000 7f9a569139c0 20 add_watcher() i=7 2024-09-14T11:20:53.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.232+0000 7f9a569139c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:53.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f990afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 5 note: GC not initialized 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9909fdb640 20 reqs_thread_entry: start 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 20 Filter name: none 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f987b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:20:53.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:53.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:20:53.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:20:53.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 : miss 2024-09-14T11:20:53.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:53.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:53.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.236+0000 7f9a569139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 2024-09-14T11:20:53.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.244+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.244+0000 7f9a569139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.244+0000 7f9a569139c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.244+0000 7f9a569139c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40, ofs0, ns] 2024-09-14T11:20:53.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94409946403632 notifier 7550 bl.length()=1015 2024-09-14T11:20:53.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_sources= new_sources= 2024-09-14T11:20:53.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential sources added=[] removed=[] 2024-09-14T11:20:53.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_dests= new_dests= 2024-09-14T11:20:53.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential dests added=[] removed=[] 2024-09-14T11:20:53.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.0 2024-09-14T11:20:53.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.0 2024-09-14T11:20:53.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.1 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.1 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.2 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.2 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.3 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.3 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.4 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.4 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.5 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.5 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.6 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.6 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.7 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.7 2024-09-14T11:20:53.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.8 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.8 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.9 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.9 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.10 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.10 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.11 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.11 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.0 2024-09-14T11:20:53.259 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1 2024-09-14T11:20:53.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2 2024-09-14T11:20:53.260 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.3 2024-09-14T11:20:53.261 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.4 2024-09-14T11:20:53.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.5 2024-09-14T11:20:53.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.6 2024-09-14T11:20:53.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.7 2024-09-14T11:20:53.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.8 2024-09-14T11:20:53.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.9 2024-09-14T11:20:53.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.272+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.10 2024-09-14T11:20:53.274 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a569139c0 time 2024-09-14T11:20:53.280904+0000 2024-09-14T11:20:53.274 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:53.275 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:53.275 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9a5a1ed2eb] 2024-09-14T11:20:53.275 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a5a1ed49f] 2024-09-14T11:20:53.275 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dd8580ac01] 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55dd8581f231] 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55dd85820884] 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a59053d90] 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f9a569139c0 thread_name:radosgw-admin 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.280+0000 7f9a569139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a569139c0 time 2024-09-14T11:20:53.280904+0000 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9a5a1ed2eb] 2024-09-14T11:20:53.276 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a5a1ed49f] 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dd8580ac01] 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55dd8581f231] 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55dd85820884] 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a59053d90] 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:20:53.277 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.289 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:53.289 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9a5906c520] 2024-09-14T11:20:53.289 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:20:53.289 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:20:53.289 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:20:53.289 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9a5a1ed345] 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a5a1ed49f] 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dd8580ac01] 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55dd8581f231] 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55dd85820884] 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a59053d90] 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.280+0000 7f9a569139c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f9a569139c0 thread_name:radosgw-admin 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9a5906c520] 2024-09-14T11:20:53.290 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9a5a1ed345] 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a5a1ed49f] 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dd8580ac01] 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55dd8581f231] 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55dd85820884] 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a59053d90] 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:53.291 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:20:53.160+0000 7f9a569139c0 5 AuthRegistry(0x55dd8742b2d0) adding con mode: crc 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:20:53.160+0000 7f9a569139c0 5 AuthRegistry(0x55dd8742b2d0) adding con mode: secure 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:20:53.160+0000 7f9a569139c0 5 AuthRegistry(0x55dd8742b2d0) adding con mode: crc 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:20:53.160+0000 7f9a569139c0 5 AuthRegistry(0x55dd8742b2d0) adding con mode: secure 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:20:53.164+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: starting msgr at 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: starting objecter 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command objecter_requests hook 0x55dd8742f8e0 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: setting wanted keys 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: calling monclient init 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: init 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding auth protocol: cephx 2024-09-14T11:20:53.292 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding auth protocol: cephx 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding auth protocol: cephx 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.293 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:20:53.164+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:20:53.164+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command rotate-key hook 0x55dd87429628 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-b con 0x55dd872e3e00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-a con 0x55dd872e4f40 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-c con 0x55dd873752d0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): authenticate will time out at 2912.225006s 2024-09-14T11:20:53.294 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request con 0x55dd873752d0 auth_method 0 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): get_auth_request con 0x55dd872e4f40 auth_method 0 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.295 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_done global_id 7541 payload 824 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient: _finish_hunting 0 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 1 monclient: found mon.noname-c 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: dump: 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.296 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: _finish_auth 0 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: _check_auth_tickets 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 monclient: authenticate success, global_id 7541 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: dump: 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.297 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:20:53.164+0000 7f994260c640 4 set_mon_vals no callback set 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: init done 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:20:53.164+0000 7f9940e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:20:53.164+0000 7f9940e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:20:53.164+0000 7f9940e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:20:53.168+0000 7f9a54419640 10 monclient: get_auth_request con 0x7f993c0718a0 auth_method 0 2024-09-14T11:20:53.298 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:20:53.168+0000 7f9a53c18640 10 monclient: get_auth_request con 0x55dd874521f0 auth_method 0 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:20:53.168+0000 7f9a54419640 10 monclient: get_auth_request con 0x55dd874754e0 auth_method 0 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:20:53.168+0000 7f9a53c18640 10 monclient: get_auth_request con 0x55dd87479840 auth_method 0 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: build_initial_monmap 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:20:53.172+0000 7f9a569139c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: monmap: 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:53.299 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding auth protocol: cephx 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding auth protocol: cephx 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding auth protocol: cephx 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.300 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:20:53.172+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command objecter_requests cmddesc objecter_requests hook 0x55dd87481c00 EEXIST 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: init 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding auth protocol: cephx 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding auth protocol: cephx 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding auth protocol: cephx 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.301 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:20:53.172+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:20:53.172+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command rotate-key cmddesc rotate-key hook 0x55dd8747cc10 EEXIST 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:53.302 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-c con 0x55dd874a5db0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-a con 0x55dd874a56e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-b con 0x55dd874a40c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): authenticate will time out at 2912.234102s 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): get_auth_request con 0x55dd874a5db0 auth_method 0 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): get_auth_request con 0x55dd874a56e0 auth_method 0 2024-09-14T11:20:53.303 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:20:53.172+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request con 0x55dd874a40c0 auth_method 0 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:20:53.172+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:20:53.172+0000 7f9a54c1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:20:53.172+0000 7f9a54c1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): handle_auth_done global_id 7544 payload 824 2024-09-14T11:20:53.304 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient: _finish_hunting 0 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:20:53.172+0000 7f9a54419640 1 monclient: found mon.noname-c 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: dump: 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.305 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: _finish_auth 0 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: dump: 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.306 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 monclient: authenticate success, global_id 7544 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:20:53.172+0000 7f9a5541b640 4 set_mon_vals no callback set 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:20:53.176+0000 7f9939ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:20:53.176+0000 7f9939ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:20:53.176+0000 7f9939ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient: get_auth_request con 0x7f992c0717e0 auth_method 0 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: get_monmap_and_config 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: build_initial_monmap 2024-09-14T11:20:53.307 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:20:53.176+0000 7f9a569139c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: monmap: 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding auth protocol: cephx 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding auth protocol: cephx 2024-09-14T11:20:53.308 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding auth protocol: cephx 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.309 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:20:53.176+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: init 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding auth protocol: cephx 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding auth protocol: cephx 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding auth protocol: cephx 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.310 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:20:53.176+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:20:53.176+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command rotate-key cmddesc rotate-key hook 0x7fff2faa8d58 EEXIST 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-b con 0x55dd874f9a80 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-a con 0x55dd874f9e60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-c con 0x55dd874f5640 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.311 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): authenticate will time out at 2912.238502s 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): get_auth_request con 0x55dd874f9e60 auth_method 0 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request con 0x55dd874f5640 auth_method 0 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.312 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_done global_id 7547 payload 274 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient: _finish_hunting 0 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 1 monclient: found mon.noname-c 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: dump: 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.313 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: dump: 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.314 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 monclient: authenticate success, global_id 7547 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: get_monmap_and_config success 2024-09-14T11:20:53.316 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:20:53.176+0000 7f9a569139c0 4 set_mon_vals no callback set 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: shutdown 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: build_initial_monmap 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: monmap: 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:53.317 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding auth protocol: cephx 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding auth protocol: cephx 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding auth protocol: cephx 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.318 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:20:53.180+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: starting msgr at 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: starting objecter 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command objecter_requests cmddesc objecter_requests hook 0x55dd874eca80 EEXIST 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: setting wanted keys 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: calling monclient init 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: init 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding auth protocol: cephx 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding auth protocol: cephx 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding auth protocol: cephx 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.319 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.320 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:20:53.180+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:20:53.180+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command rotate-key cmddesc rotate-key hook 0x55dd874a7d18 EEXIST 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-c con 0x55dd874f5640 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-a con 0x55dd874f9a80 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-b con 0x55dd874f03b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): authenticate will time out at 2912.241065s 2024-09-14T11:20:53.321 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): get_auth_request con 0x55dd874f5640 auth_method 0 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): get_auth_request con 0x55dd874f9a80 auth_method 0 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.322 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): handle_auth_done global_id 7550 payload 824 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient: _finish_hunting 0 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:20:53.180+0000 7f9a54419640 1 monclient: found mon.noname-c 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: dump: 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.323 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: _finish_auth 0 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: dump: 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.324 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:20:53.180+0000 7f992b7fe640 4 set_mon_vals no callback set 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 monclient: authenticate success, global_id 7550 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.325 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: init done 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cr dump hook 0x55dd874e95b8 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:20:53.180+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:20:53.184+0000 7f9929ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:20:53.184+0000 7f9929ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:20:53.184+0000 7f9929ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:20:53.184+0000 7f9a53c18640 10 monclient: get_auth_request con 0x7f991c0718a0 auth_method 0 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:20:53.184+0000 7f9a54c1a640 10 monclient: get_auth_request con 0x55dd87513ec0 auth_method 0 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 realm 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:20:53.184+0000 7f9a569139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.326 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:20:53.184+0000 7f9a54419640 10 monclient: get_auth_request con 0x55dd87517f90 auth_method 0 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:20:53.184+0000 7f9a53c18640 10 monclient: get_auth_request con 0x55dd8751b7f0 auth_method 0 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:20:53.188+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:20:53.188+0000 7f9a569139c0 20 searching for the correct realm 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:20:53.188+0000 7f9a54c1a640 10 monclient: get_auth_request con 0x55dd875205c0 auth_method 0 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:20:53.188+0000 7f9a54419640 10 monclient: get_auth_request con 0x7f9a440024d0 auth_method 0 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:20:53.192+0000 7f9a53c18640 10 monclient: get_auth_request con 0x7f9a4c079c20 auth_method 0 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:20:53.192+0000 7f9a54c1a640 0 -- 172.21.15.148:0/2990246492 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55dd87513ec0 msgr2=0x55dd87516350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:20:53.192+0000 7f9929ffb640 1 client.7550.objecter ms_handle_reset 0x55dd87513ec0 session 0x55dd874c9030 osd.6 2024-09-14T11:20:53.327 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:20:53.192+0000 7f9929ffb640 10 monclient: _renew_subs 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:20:53.192+0000 7f9929ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:20:53.192+0000 7f9a54c1a640 10 monclient: get_auth_request con 0x7f991c081ac0 auth_method 0 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:20:53.196+0000 7f9a54c1a640 10 monclient: get_auth_request con 0x7f9a4403bc80 auth_method 0 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:20:53.196+0000 7f9a54419640 10 monclient: get_auth_request con 0x7f9a4c083070 auth_method 0 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:20:53.200+0000 7f9a54419640 0 -- 172.21.15.148:0/2990246492 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55dd87517f90 msgr2=0x55dd8751a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:20:53.200+0000 7f9929ffb640 1 client.7550.objecter ms_handle_reset 0x55dd87517f90 session 0x55dd874c9df0 osd.1 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:20:53.200+0000 7f9a54419640 10 monclient: get_auth_request con 0x55dd87513ec0 auth_method 0 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:53.328 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 zone default found 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:20:53.208+0000 7f9a569139c0 4 Realm: () 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:20:53.208+0000 7f9a569139c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:20:53.208+0000 7f9a569139c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:53.329 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:20:53.208+0000 7f9a569139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 zonegroup default 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 started sync module instance, tier type = 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=0 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=1 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=2 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=3 2024-09-14T11:20:53.330 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=4 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=5 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=6 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:20:53.232+0000 7f9a569139c0 20 add_watcher() i=7 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:20:53.232+0000 7f9a569139c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding auth protocol: cephx 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding auth protocol: cephx 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding auth protocol: cephx 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.331 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:20:53.236+0000 7f990afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:20:53.236+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cache list hook 0x55dd874e8aa0 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cache inspect hook 0x55dd874e8aa0 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cache erase hook 0x55dd874e8aa0 2024-09-14T11:20:53.332 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cache zap hook 0x55dd874e8aa0 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 note: GC not initialized 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:20:53.236+0000 7f9909fdb640 20 reqs_thread_entry: start 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command sync trace show hook 0x7f9a4c004b80 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command sync trace history hook 0x7f9a4c004b80 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command sync trace active hook 0x7f9a4c004b80 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command sync trace active_short hook 0x7f9a4c004b80 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 Filter name: none 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:20:53.236+0000 7f987b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:20:53.333 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 : miss 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:20:53.244+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:20:53.244+0000 7f9a569139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:20:53.244+0000 7f9a569139c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:20:53.244+0000 7f9a569139c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40, ofs0, ns] 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94409946403632 notifier 7550 bl.length()=1015 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.334 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_sources= new_sources= 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential sources added=[] removed=[] 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_dests= new_dests= 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential dests added=[] removed=[] 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.0 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.0 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.1 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.1 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.2 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.2 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.3 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.3 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.4 2024-09-14T11:20:53.335 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.4 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.5 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.5 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.6 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.6 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.7 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.7 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.8 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.8 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.9 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.9 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.10 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.10 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.11 2024-09-14T11:20:53.336 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.11 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.0 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.3 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.4 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.5 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.6 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.7 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.8 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.9 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:20:53.272+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.10 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:20:53.280+0000 7f9a569139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a569139c0 time 2024-09-14T11:20:53.280904+0000 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.337 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9a5a1ed2eb] 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a5a1ed49f] 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dd8580ac01] 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55dd8581f231] 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55dd85820884] 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a59053d90] 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:20:53.280+0000 7f9a569139c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f9a569139c0 thread_name:radosgw-admin 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.338 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9a5906c520] 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9a5a1ed345] 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a5a1ed49f] 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dd8580ac01] 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55dd8581f231] 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55dd85820884] 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a59053d90] 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.339 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:20:53.340 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:20:53.341 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:20:53.342 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:20:53.343 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:20:53.344 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:20:53.345 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 7f987b7fe640 / http_manager 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9909fdb640 / http_manager 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 7f990afdd640 / rgw_dt_lg_renew 2024-09-14T11:20:53.346 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9929ffb640 / ms_dispatch 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f992affd640 / io_context_pool 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f992b7fe640 / io_context_pool 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9939ffb640 / ms_dispatch 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9940e09640 / ms_dispatch 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f994260c640 / io_context_pool 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a53c18640 / msgr-worker-2 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a54419640 / msgr-worker-1 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a54c1a640 / msgr-worker-0 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a5541b640 / io_context_pool 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a569139c0 / radosgw-admin 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:20:53.347 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.136402.log 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:20:53.160+0000 7f9a569139c0 5 AuthRegistry(0x55dd8742b2d0) adding con mode: crc 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:20:53.160+0000 7f9a569139c0 5 AuthRegistry(0x55dd8742b2d0) adding con mode: secure 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:20:53.160+0000 7f9a569139c0 5 AuthRegistry(0x55dd8742b2d0) adding con mode: crc 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:20:53.160+0000 7f9a569139c0 5 AuthRegistry(0x55dd8742b2d0) adding con mode: secure 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:20:53.164+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: starting msgr at 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: starting objecter 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command objecter_requests hook 0x55dd8742f8e0 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: setting wanted keys 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: calling monclient init 2024-09-14T11:20:53.348 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: init 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding auth protocol: cephx 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding auth protocol: cephx 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding auth protocol: cephx 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.349 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: crc 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 AuthRegistry(0x55dd874294e0) adding con mode: secure 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:20:53.164+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:20:53.164+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command rotate-key hook 0x55dd87429628 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-b con 0x55dd872e3e00 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-a con 0x55dd872e4f40 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-c con 0x55dd873752d0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.350 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient(hunting): authenticate will time out at 2912.225006s 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request con 0x55dd873752d0 auth_method 0 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): get_auth_request con 0x55dd872e4f40 auth_method 0 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.351 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:20:53.164+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_done global_id 7541 payload 824 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient: _finish_hunting 0 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 1 monclient: found mon.noname-c 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:20:53.164+0000 7f9a54c1a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: dump: 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.352 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: _finish_auth 0 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: _check_auth_tickets 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:20:53.164+0000 7f9a569139c0 5 monclient: authenticate success, global_id 7541 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.353 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:20:53.164+0000 7f9940e09640 10 monclient: dump: 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:20:53.164+0000 7f994260c640 4 set_mon_vals no callback set 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:20:53.164+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.354 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:20:53.164+0000 7f9a569139c0 1 librados: init done 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:20:53.164+0000 7f9940e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:20:53.164+0000 7f9940e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:20:53.164+0000 7f9940e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:20:53.168+0000 7f9a54419640 10 monclient: get_auth_request con 0x7f993c0718a0 auth_method 0 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:20:53.168+0000 7f9a53c18640 10 monclient: get_auth_request con 0x55dd874521f0 auth_method 0 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:20:53.168+0000 7f9a54419640 10 monclient: get_auth_request con 0x55dd874754e0 auth_method 0 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:20:53.168+0000 7f9a53c18640 10 monclient: get_auth_request con 0x55dd87479840 auth_method 0 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: build_initial_monmap 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:20:53.172+0000 7f9a569139c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: monmap: 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:53.355 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding auth protocol: cephx 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding auth protocol: cephx 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding auth protocol: cephx 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.356 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: crc 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747e1f0) adding con mode: secure 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:20:53.172+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command objecter_requests cmddesc objecter_requests hook 0x55dd87481c00 EEXIST 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: init 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding auth protocol: cephx 2024-09-14T11:20:53.357 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding auth protocol: cephx 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding auth protocol: cephx 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: crc 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 AuthRegistry(0x55dd8747cac8) adding con mode: secure 2024-09-14T11:20:53.358 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:20:53.172+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:20:53.172+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command rotate-key cmddesc rotate-key hook 0x55dd8747cc10 EEXIST 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-c con 0x55dd874a5db0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-a con 0x55dd874a56e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-b con 0x55dd874a40c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient(hunting): authenticate will time out at 2912.234102s 2024-09-14T11:20:53.359 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): get_auth_request con 0x55dd874a5db0 auth_method 0 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): get_auth_request con 0x55dd874a56e0 auth_method 0 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:20:53.172+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.360 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:20:53.172+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request con 0x55dd874a40c0 auth_method 0 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:20:53.172+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:20:53.172+0000 7f9a54c1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:20:53.172+0000 7f9a54c1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient(hunting): handle_auth_done global_id 7544 payload 824 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient: _finish_hunting 0 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:20:53.172+0000 7f9a54419640 1 monclient: found mon.noname-c 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:20:53.172+0000 7f9a54419640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: dump: 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.361 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: _finish_auth 0 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:20:53.172+0000 7f9939ffb640 10 monclient: dump: 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.362 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:20:53.172+0000 7f9a569139c0 5 monclient: authenticate success, global_id 7544 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:20:53.172+0000 7f9a5541b640 4 set_mon_vals no callback set 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.363 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:20:53.172+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:20:53.176+0000 7f9939ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:20:53.176+0000 7f9939ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:20:53.176+0000 7f9939ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient: get_auth_request con 0x7f992c0717e0 auth_method 0 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: get_monmap_and_config 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: build_initial_monmap 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:20:53.176+0000 7f9a569139c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: monmap: 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:53.364 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding auth protocol: cephx 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding auth protocol: cephx 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding auth protocol: cephx 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.365 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: crc 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x55dd874c5740) adding con mode: secure 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:20:53.176+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: init 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding auth protocol: cephx 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding auth protocol: cephx 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding auth protocol: cephx 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.366 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: crc 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa8c10) adding con mode: secure 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:20:53.176+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:20:53.176+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command rotate-key cmddesc rotate-key hook 0x7fff2faa8d58 EEXIST 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:20:53.367 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-b con 0x55dd874f9a80 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-a con 0x55dd874f9e60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-c con 0x55dd874f5640 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient(hunting): authenticate will time out at 2912.238502s 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): get_auth_request con 0x55dd874f9e60 auth_method 0 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request con 0x55dd874f5640 auth_method 0 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.368 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:20:53.176+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient(hunting): handle_auth_done global_id 7547 payload 274 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient: _finish_hunting 0 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 1 monclient: found mon.noname-c 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:20:53.176+0000 7f9a54c1a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: dump: 2024-09-14T11:20:53.369 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.370 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:20:53.176+0000 7f992b7fe640 10 monclient: dump: 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:20:53.176+0000 7f9a569139c0 5 monclient: authenticate success, global_id 7547 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: get_monmap_and_config success 2024-09-14T11:20:53.371 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:20:53.176+0000 7f9a569139c0 4 set_mon_vals no callback set 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:20:53.176+0000 7f9a569139c0 10 monclient: shutdown 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: build_initial_monmap 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 build_initial for_mkfs: 0 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: monmap: 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:20:53.372 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding auth protocol: cephx 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding auth protocol: cephx 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding auth protocol: cephx 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.373 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: crc 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874ea2c0) adding con mode: secure 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:20:53.180+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: starting msgr at 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: starting objecter 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command objecter_requests cmddesc objecter_requests hook 0x55dd874eca80 EEXIST 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: setting wanted keys 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: calling monclient init 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: init 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding auth protocol: cephx 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding auth protocol: cephx 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding auth protocol: cephx 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.374 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: crc 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 AuthRegistry(0x55dd874a7bd0) adding con mode: secure 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:20:53.180+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:20:53.180+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command rotate-key cmddesc rotate-key hook 0x55dd874a7d18 EEXIST 2024-09-14T11:20:53.375 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _reopen_session rank -1 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-c con 0x55dd874f5640 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-a con 0x55dd874f9a80 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): picked mon.noname-b con 0x55dd874f03b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): _renew_subs 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient(hunting): authenticate will time out at 2912.241065s 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): get_auth_request con 0x55dd874f5640 auth_method 0 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.376 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): get_auth_request con 0x55dd874f9a80 auth_method 0 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:20:53.180+0000 7f9a53c18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient(hunting): handle_auth_done global_id 7550 payload 824 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient: _finish_hunting 0 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:20:53.180+0000 7f9a54419640 1 monclient: found mon.noname-c 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:20:53.180+0000 7f9a54419640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.377 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: dump: 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: _finish_auth 0 2024-09-14T11:20:53.378 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:20:53.180+0000 7f9929ffb640 10 monclient: dump: 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:20:53.379 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:20:53.180+0000 7f992b7fe640 4 set_mon_vals no callback set 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 monclient: authenticate success, global_id 7550 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _renew_subs 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:20:53.180+0000 7f9a569139c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:20:53.180+0000 7f9a569139c0 1 librados: init done 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:20:53.180+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cr dump hook 0x55dd874e95b8 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:20:53.180+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:20:53.184+0000 7f9929ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:20:53.184+0000 7f9929ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:20:53.184+0000 7f9929ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:20:53.184+0000 7f9a53c18640 10 monclient: get_auth_request con 0x7f991c0718a0 auth_method 0 2024-09-14T11:20:53.380 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:20:53.184+0000 7f9a54c1a640 10 monclient: get_auth_request con 0x55dd87513ec0 auth_method 0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 realm 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:20:53.184+0000 7f9a569139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:20:53.184+0000 7f9a54419640 10 monclient: get_auth_request con 0x55dd87517f90 auth_method 0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:20:53.184+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:20:53.184+0000 7f9a53c18640 10 monclient: get_auth_request con 0x55dd8751b7f0 auth_method 0 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:20:53.188+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:53.381 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:20:53.188+0000 7f9a569139c0 20 searching for the correct realm 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:20:53.188+0000 7f9a54c1a640 10 monclient: get_auth_request con 0x55dd875205c0 auth_method 0 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:20:53.188+0000 7f9a54419640 10 monclient: get_auth_request con 0x7f9a440024d0 auth_method 0 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:20:53.192+0000 7f9a53c18640 10 monclient: get_auth_request con 0x7f9a4c079c20 auth_method 0 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:20:53.192+0000 7f9a54c1a640 0 -- 172.21.15.148:0/2990246492 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55dd87513ec0 msgr2=0x55dd87516350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:20:53.192+0000 7f9929ffb640 1 client.7550.objecter ms_handle_reset 0x55dd87513ec0 session 0x55dd874c9030 osd.6 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:20:53.192+0000 7f9929ffb640 10 monclient: _renew_subs 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:20:53.192+0000 7f9929ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:20:53.192+0000 7f9a54c1a640 10 monclient: get_auth_request con 0x7f991c081ac0 auth_method 0 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:20:53.196+0000 7f9a54c1a640 10 monclient: get_auth_request con 0x7f9a4403bc80 auth_method 0 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:20:53.196+0000 7f9a54419640 10 monclient: get_auth_request con 0x7f9a4c083070 auth_method 0 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:20:53.200+0000 7f9a54419640 0 -- 172.21.15.148:0/2990246492 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55dd87517f90 msgr2=0x55dd8751a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:20:53.200+0000 7f9929ffb640 1 client.7550.objecter ms_handle_reset 0x55dd87517f90 session 0x55dd874c9df0 osd.1 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:20:53.200+0000 7f9a54419640 10 monclient: get_auth_request con 0x55dd87513ec0 auth_method 0 2024-09-14T11:20:53.382 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 zone default found 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:20:53.208+0000 7f9a569139c0 4 Realm: () 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:20:53.208+0000 7f9a569139c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:53.383 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:20:53.208+0000 7f9a569139c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:20:53.208+0000 7f9a569139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 zonegroup default 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 started sync module instance, tier type = 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:20:53.208+0000 7f9a569139c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=0 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=1 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=2 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=3 2024-09-14T11:20:53.384 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=4 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=5 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:20:53.228+0000 7f9a569139c0 20 add_watcher() i=6 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:20:53.232+0000 7f9a569139c0 20 add_watcher() i=7 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:20:53.232+0000 7f9a569139c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding auth protocol: cephx 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding auth protocol: cephx 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding auth protocol: cephx 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.385 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: crc 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 AuthRegistry(0x7fff2faa90f0) adding con mode: secure 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:20:53.236+0000 7f990afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:20:53.236+0000 7f9a569139c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cache list hook 0x55dd874e8aa0 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cache inspect hook 0x55dd874e8aa0 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cache erase hook 0x55dd874e8aa0 2024-09-14T11:20:53.386 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command cache zap hook 0x55dd874e8aa0 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 note: GC not initialized 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:20:53.236+0000 7f9909fdb640 20 reqs_thread_entry: start 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command sync trace show hook 0x7f9a4c004b80 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command sync trace history hook 0x7f9a4c004b80 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command sync trace active hook 0x7f9a4c004b80 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:20:53.236+0000 7f9a569139c0 5 asok(0x55dd8721ed90) register_command sync trace active_short hook 0x7f9a4c004b80 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 Filter name: none 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:20:53.236+0000 7f987b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:53.387 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 : miss 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:20:53.236+0000 7f9a569139c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:20:53.236+0000 7f9a569139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:20:53.244+0000 7f9a569139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.388 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:20:53.244+0000 7f9a569139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:20:53.244+0000 7f9a569139c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:20:53.244+0000 7f9a569139c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40, ofs0, ns] 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94409946403632 notifier 7550 bl.length()=1015 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:20:53.244+0000 7f992affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_sources= new_sources= 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential sources added=[] removed=[] 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_dests= new_dests= 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:20:53.248+0000 7f9a569139c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential dests added=[] removed=[] 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.0 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.0 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.1 2024-09-14T11:20:53.389 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.1 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.2 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.2 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.3 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.3 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.4 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.4 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.5 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.5 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.6 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.6 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.7 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.7 2024-09-14T11:20:53.390 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.8 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.8 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.9 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.9 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.10 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.10 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:20:53.260+0000 7f9a569139c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.11 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1.11 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.0 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:20:53.260+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.3 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:20:53.264+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.4 2024-09-14T11:20:53.391 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.5 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.6 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.7 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.8 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:20:53.268+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.9 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:20:53.272+0000 7f9a569139c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.10 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:20:53.280+0000 7f9a569139c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a569139c0 time 2024-09-14T11:20:53.280904+0000 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9a5a1ed2eb] 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a5a1ed49f] 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dd8580ac01] 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55dd8581f231] 2024-09-14T11:20:53.392 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55dd85820884] 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a59053d90] 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:20:53.280+0000 7f9a569139c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7f9a569139c0 thread_name:radosgw-admin 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9a5906c520] 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:20:53.393 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9a5a1ed345] 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a5a1ed49f] 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dd8580ac01] 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55dd8581f231] 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55dd85820884] 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a59053d90] 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:20:53.394 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:20:53.395 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:20:53.396 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:20:53.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:20:53.398 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:20:53.399 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:20:53.400 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 7f987b7fe640 / http_manager 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9909fdb640 / http_manager 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 7f990afdd640 / rgw_dt_lg_renew 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9929ffb640 / ms_dispatch 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 7f992affd640 / io_context_pool 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 7f992b7fe640 / io_context_pool 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9939ffb640 / ms_dispatch 2024-09-14T11:20:53.401 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9940e09640 / ms_dispatch 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: 7f994260c640 / io_context_pool 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a53c18640 / msgr-worker-2 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a54419640 / msgr-worker-1 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a54c1a640 / msgr-worker-0 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a5541b640 / io_context_pool 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: 7f9a569139c0 / radosgw-admin 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:20:53.283314Z_e493a7b2-7f01-41f1-940a-2c3c1973ab8f/log 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:20:53.402 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:20:53.405 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:53.405 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:53.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.356+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 realm 2024-09-14T11:20:53.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.360+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.364+0000 7fd44cad89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.364+0000 7fd44cad89c0 20 searching for the correct realm 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.368+0000 7fd449ddd640 0 -- 172.21.15.148:0/3976936660 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fd444070f90 msgr2=0x7fd44406fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.372+0000 7fd449ddd640 0 -- 172.21.15.148:0/3976936660 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5573d0506b80 msgr2=0x5573d0508fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:53.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 zone default found 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 4 Realm: () 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:53.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 zonegroup default 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.380+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.384+0000 7fd44cad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.384+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.384+0000 7fd44cad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.384+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.384+0000 7fd44cad89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.384+0000 7fd44cad89c0 20 started sync module instance, tier type = 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.384+0000 7fd44cad89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 20 add_watcher() i=0 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 20 add_watcher() i=1 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 20 add_watcher() i=2 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 20 add_watcher() i=3 2024-09-14T11:20:53.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 20 add_watcher() i=4 2024-09-14T11:20:53.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 20 add_watcher() i=5 2024-09-14T11:20:53.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 20 add_watcher() i=6 2024-09-14T11:20:53.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 20 add_watcher() i=7 2024-09-14T11:20:53.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.404+0000 7fd44cad89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:53.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd300fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd44cad89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:53.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd44cad89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd44cad89c0 5 note: GC not initialized 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd27b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd44cad89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd44cad89c0 20 Filter name: none 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd2797fa640 20 reqs_thread_entry: start 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.408+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:20:53.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.412+0000 7fd44cad89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:53.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.416+0000 7fd300fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.416 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.420+0000 7fd44cad89c0 20 remove_watcher() i=0 2024-09-14T11:20:53.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.420+0000 7fd44cad89c0 2 removed watcher, disabling cache 2024-09-14T11:20:53.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.420+0000 7fd44cad89c0 20 remove_watcher() i=1 2024-09-14T11:20:53.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.424+0000 7fd44cad89c0 20 remove_watcher() i=2 2024-09-14T11:20:53.422 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.424+0000 7fd44cad89c0 20 remove_watcher() i=3 2024-09-14T11:20:53.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.428+0000 7fd44cad89c0 20 remove_watcher() i=4 2024-09-14T11:20:53.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.428+0000 7fd44cad89c0 20 remove_watcher() i=5 2024-09-14T11:20:53.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.432+0000 7fd44cad89c0 20 remove_watcher() i=6 2024-09-14T11:20:53.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.436+0000 7fd44cad89c0 20 remove_watcher() i=7 2024-09-14T11:20:53.445 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.445 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:20:53.445 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-change-reshard-state id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:53.445 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:20:53.446 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:53.446 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:53.488 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:20:53.488 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:20:53.548 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:20:53.579 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:53.579 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:53.621 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.624+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 realm 2024-09-14T11:20:53.623 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:53.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.624 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.625 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:53.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.628+0000 7f965af399c0 20 searching for the correct realm 2024-09-14T11:20:53.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.636+0000 7f9659240640 0 -- 172.21.15.148:0/3495035061 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55977b2f81d0 msgr2=0x55977b2fa620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:53.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.644+0000 7f9659240640 0 -- 172.21.15.148:0/3495035061 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55977b3049a0 msgr2=0x55977b306e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:53.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:53.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:20:53.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:53.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:53.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:53.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:20:53.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:53.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.648+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:53.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 zone default found 2024-09-14T11:20:53.647 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 4 Realm: () 2024-09-14T11:20:53.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:20:53.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:20:53.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:53.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 zonegroup default 2024-09-14T11:20:53.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:53.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 started sync module instance, tier type = 2024-09-14T11:20:53.649 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.652+0000 7f965af399c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:20:53.667 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 20 add_watcher() i=0 2024-09-14T11:20:53.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 20 add_watcher() i=1 2024-09-14T11:20:53.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 20 add_watcher() i=2 2024-09-14T11:20:53.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 20 add_watcher() i=3 2024-09-14T11:20:53.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 20 add_watcher() i=4 2024-09-14T11:20:53.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 20 add_watcher() i=5 2024-09-14T11:20:53.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 20 add_watcher() i=6 2024-09-14T11:20:53.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 20 add_watcher() i=7 2024-09-14T11:20:53.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.672+0000 7f965af399c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:53.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.676+0000 7f950efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:53.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:53.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 5 note: GC not initialized 2024-09-14T11:20:53.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f950dfe3640 20 reqs_thread_entry: start 2024-09-14T11:20:53.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 20 init_complete bucket index max shards: 11 2024-09-14T11:20:53.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 20 Filter name: none 2024-09-14T11:20:53.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:20:53.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f947f7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:53.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:53.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:20:53.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:20:53.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 : miss 2024-09-14T11:20:53.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 20 rados->read ofs=0 len=0 2024-09-14T11:20:53.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:20:53.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:20:53.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:20:53.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:53.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:53.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.680+0000 7f965af399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 2024-09-14T11:20:53.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.684+0000 7f965af399c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to be held by another RGW process; skipping for now 2024-09-14T11:20:53.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.684+0000 7f950efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:53.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.688+0000 7f965af399c0 20 remove_watcher() i=0 2024-09-14T11:20:53.685 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.688+0000 7f965af399c0 2 removed watcher, disabling cache 2024-09-14T11:20:53.687 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.692+0000 7f965af399c0 20 remove_watcher() i=1 2024-09-14T11:20:53.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.692+0000 7f965af399c0 20 remove_watcher() i=2 2024-09-14T11:20:53.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.696+0000 7f965af399c0 20 remove_watcher() i=3 2024-09-14T11:20:53.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.696+0000 7f965af399c0 20 remove_watcher() i=4 2024-09-14T11:20:53.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.700+0000 7f965af399c0 20 remove_watcher() i=5 2024-09-14T11:20:53.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.700+0000 7f965af399c0 20 remove_watcher() i=6 2024-09-14T11:20:53.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:20:53.704+0000 7f965af399c0 20 remove_watcher() i=7 2024-09-14T11:20:53.714 INFO:tasks.workunit.client.0.smithi148.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:21:23.746 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:21:23.781 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:23.782 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:23.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.827+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.831+0000 7fd2798469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:23.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.831+0000 7fd2798469c0 20 realm 2024-09-14T11:21:23.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.831+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.831+0000 7fd2798469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:23.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.831+0000 7fd2798469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:23.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.831+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.831+0000 7fd2798469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:23.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.831+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.835+0000 7fd2798469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:23.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.835+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.835+0000 7fd2798469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:23.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.835+0000 7fd2798469c0 20 searching for the correct realm 2024-09-14T11:21:23.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.843+0000 7fd27734c640 0 -- 172.21.15.148:0/2192562041 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fd27001c040 msgr2=0x7fd2700651e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:23.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.847+0000 7fd27734c640 0 -- 172.21.15.148:0/2192562041 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fd26811e040 msgr2=0x7fd268102850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:23.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:23.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:23.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:23.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:23.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:23.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:23.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:23.854 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 zone default found 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 4 Realm: () 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 zonegroup default 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:23.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.855+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.859+0000 7fd2798469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:23.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.859+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.859+0000 7fd2798469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:23.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.859+0000 7fd2798469c0 20 started sync module instance, tier type = 2024-09-14T11:21:23.856 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.859+0000 7fd2798469c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:23.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 20 add_watcher() i=0 2024-09-14T11:21:23.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 20 add_watcher() i=1 2024-09-14T11:21:23.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 20 add_watcher() i=2 2024-09-14T11:21:23.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 20 add_watcher() i=3 2024-09-14T11:21:23.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 20 add_watcher() i=4 2024-09-14T11:21:23.875 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 20 add_watcher() i=5 2024-09-14T11:21:23.876 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 20 add_watcher() i=6 2024-09-14T11:21:23.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 20 add_watcher() i=7 2024-09-14T11:21:23.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.879+0000 7fd2798469c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:23.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd12dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:23.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:23.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:23.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 5 note: GC not initialized 2024-09-14T11:21:23.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd12cfe1640 20 reqs_thread_entry: start 2024-09-14T11:21:23.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:23.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 20 Filter name: none 2024-09-14T11:21:23.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd0a67fc640 20 reqs_thread_entry: start 2024-09-14T11:21:23.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:21:23.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.883 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.883+0000 7fd2798469c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 : miss 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:23.884 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 2024-09-14T11:21:23.885 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.887+0000 7fd2798469c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:21:23.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.899+0000 7fd2798469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:21:23.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.899+0000 7fd2798469c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:21:23.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.899+0000 7fd2798469c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:23.898 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.899+0000 7fd2798469c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40, ofs0, ns] 2024-09-14T11:21:23.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.899+0000 7fd15affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94417951344224 notifier 8115 bl.length()=1015 2024-09-14T11:21:23.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.899+0000 7fd15affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:21:23.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.899+0000 7fd15affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:21:23.899 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.899+0000 7fd15affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:23.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.903+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_sources= new_sources= 2024-09-14T11:21:23.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.903+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential sources added=[] removed=[] 2024-09-14T11:21:23.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.903+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_dests= new_dests= 2024-09-14T11:21:23.901 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.903+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential dests added=[] removed=[] 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.0 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.0 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.1 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.1 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.2 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.2 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.3 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.3 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.4 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.4 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.5 2024-09-14T11:21:23.917 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.5 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.6 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.6 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.7 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.7 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.8 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.8 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.9 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.9 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.10 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.10 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.11 2024-09-14T11:21:23.918 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2.11 2024-09-14T11:21:23.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.0 2024-09-14T11:21:23.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1 2024-09-14T11:21:23.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.919+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2 2024-09-14T11:21:23.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.923+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.3 2024-09-14T11:21:23.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.923+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.4 2024-09-14T11:21:23.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.923+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.5 2024-09-14T11:21:23.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.923+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.6 2024-09-14T11:21:23.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.927+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.7 2024-09-14T11:21:23.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.927+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.8 2024-09-14T11:21:23.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.927+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.9 2024-09-14T11:21:23.926 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.927+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.10 2024-09-14T11:21:23.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd2798469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:23.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd2798469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 2024-09-14T11:21:23.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd2798469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:21:23.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd2798469c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:21:23.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd2798469c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:23.934 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd2798469c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40, ofs0, ns] 2024-09-14T11:21:23.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd15affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94417951344224 notifier 8115 bl.length()=1015 2024-09-14T11:21:23.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd15affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:21:23.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd15affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:21:23.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.935+0000 7fd15affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:23.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.939+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_sources= new_sources= 2024-09-14T11:21:23.936 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.939+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential sources added=[] removed=[] 2024-09-14T11:21:23.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.939+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_dests= new_dests= 2024-09-14T11:21:23.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.939+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential dests added=[] removed=[] 2024-09-14T11:21:23.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.947+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.0 2024-09-14T11:21:23.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.947+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.1 2024-09-14T11:21:23.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.947+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.2 2024-09-14T11:21:23.945 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.947+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.3 2024-09-14T11:21:23.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.947+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.4 2024-09-14T11:21:23.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.951+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.5 2024-09-14T11:21:23.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.951+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.6 2024-09-14T11:21:23.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.951+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.7 2024-09-14T11:21:23.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.951+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.8 2024-09-14T11:21:23.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.951+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.9 2024-09-14T11:21:23.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd2798469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40.10 2024-09-14T11:21:23.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd2798469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:23.951 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd2798469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 2024-09-14T11:21:23.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd2798469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:21:23.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd2798469c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:21:23.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd2798469c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:23.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd2798469c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40, ofs0, ns] 2024-09-14T11:21:23.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd15affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94417951344224 notifier 8115 bl.length()=983 2024-09-14T11:21:23.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd15affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 info.flags=0x17 2024-09-14T11:21:23.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd15affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 to cache LRU end 2024-09-14T11:21:23.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.955+0000 7fd15affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:23.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.959+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_sources= new_sources= 2024-09-14T11:21:23.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.959+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential sources added=[] removed=[] 2024-09-14T11:21:23.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.959+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): orig_dests= new_dests= 2024-09-14T11:21:23.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.959+0000 7fd2798469c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40]): potential dests added=[] removed=[] 2024-09-14T11:21:23.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.963+0000 7fd2798469c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:21:23.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.967+0000 7fd12dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:23.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.975+0000 7fd2798469c0 20 remove_watcher() i=0 2024-09-14T11:21:23.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.975+0000 7fd2798469c0 2 removed watcher, disabling cache 2024-09-14T11:21:23.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.975+0000 7fd2798469c0 20 remove_watcher() i=1 2024-09-14T11:21:23.975 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.979+0000 7fd2798469c0 20 remove_watcher() i=2 2024-09-14T11:21:23.977 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.979+0000 7fd2798469c0 20 remove_watcher() i=3 2024-09-14T11:21:23.979 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.983+0000 7fd2798469c0 20 remove_watcher() i=4 2024-09-14T11:21:23.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.983+0000 7fd2798469c0 20 remove_watcher() i=5 2024-09-14T11:21:23.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.987+0000 7fd2798469c0 20 remove_watcher() i=6 2024-09-14T11:21:23.987 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:23.991+0000 7fd2798469c0 20 remove_watcher() i=7 2024-09-14T11:21:24.003 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:21:24.035 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:24.035 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:24.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:24.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 20 realm 2024-09-14T11:21:24.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:24.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:24.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:24.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.083+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.087+0000 7fec4137e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:24.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.087+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.087+0000 7fec4137e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:24.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.087+0000 7fec4137e9c0 20 searching for the correct realm 2024-09-14T11:21:24.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.095+0000 7fec3ee84640 0 -- 172.21.15.148:0/4279412359 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fec3004e040 msgr2=0x7fec3004f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:24.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.099+0000 7fec3ee84640 0 -- 172.21.15.148:0/4279412359 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fec3800e070 msgr2=0x7fec38066aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:24.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:24.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:24.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:24.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:24.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:24.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:24.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:24.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:24.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:24.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 zone default found 2024-09-14T11:21:24.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 4 Realm: () 2024-09-14T11:21:24.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:24.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:24.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:24.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 zonegroup default 2024-09-14T11:21:24.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:24.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:24.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:24.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 started sync module instance, tier type = 2024-09-14T11:21:24.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.107+0000 7fec4137e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:24.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.127+0000 7fec4137e9c0 20 add_watcher() i=0 2024-09-14T11:21:24.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.127+0000 7fec4137e9c0 20 add_watcher() i=1 2024-09-14T11:21:24.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.127+0000 7fec4137e9c0 20 add_watcher() i=2 2024-09-14T11:21:24.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.127+0000 7fec4137e9c0 20 add_watcher() i=3 2024-09-14T11:21:24.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.127+0000 7fec4137e9c0 20 add_watcher() i=4 2024-09-14T11:21:24.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.127+0000 7fec4137e9c0 20 add_watcher() i=5 2024-09-14T11:21:24.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.127+0000 7fec4137e9c0 20 add_watcher() i=6 2024-09-14T11:21:24.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.131+0000 7fec4137e9c0 20 add_watcher() i=7 2024-09-14T11:21:24.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.131+0000 7fec4137e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:24.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7feaf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:24.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:24.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:24.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 5 note: GC not initialized 2024-09-14T11:21:24.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fea6ffff640 20 reqs_thread_entry: start 2024-09-14T11:21:24.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:24.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 Filter name: none 2024-09-14T11:21:24.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fea6dffb640 20 reqs_thread_entry: start 2024-09-14T11:21:24.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:24.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:24.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:24.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.135+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.139+0000 7fec4137e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:24.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.139+0000 7fec4137e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:24.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.139+0000 7fec4137e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:24.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.139+0000 7fec4137e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:24.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.139+0000 7feaf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:24.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.143+0000 7fec4137e9c0 20 remove_watcher() i=0 2024-09-14T11:21:24.142 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.143+0000 7fec4137e9c0 2 removed watcher, disabling cache 2024-09-14T11:21:24.144 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.147+0000 7fec4137e9c0 20 remove_watcher() i=1 2024-09-14T11:21:24.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.147+0000 7fec4137e9c0 20 remove_watcher() i=2 2024-09-14T11:21:24.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.151+0000 7fec4137e9c0 20 remove_watcher() i=3 2024-09-14T11:21:24.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.151+0000 7fec4137e9c0 20 remove_watcher() i=4 2024-09-14T11:21:24.152 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.155+0000 7fec4137e9c0 20 remove_watcher() i=5 2024-09-14T11:21:24.154 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.155+0000 7fec4137e9c0 20 remove_watcher() i=6 2024-09-14T11:21:24.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:24.159+0000 7fec4137e9c0 20 remove_watcher() i=7 2024-09-14T11:21:24.171 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:24.171 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:21:24.171 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: abort-at-change-reshard-state id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:21:24.171 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:24.173 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:21:24.173 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:21:24.202 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:21:24.202 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:21:24.804 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:21:24.805 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:21:25.184 INFO:tasks.workunit.client.0.smithi148.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:21:25.184 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:21:25.218 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:25.218 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:25.262 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.263+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.267+0000 7f10048709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.267+0000 7f10048709c0 20 realm 2024-09-14T11:21:25.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.267+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.267+0000 7f10048709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.267+0000 7f10048709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:25.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.267+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.267+0000 7f10048709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.267+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.271+0000 7f10048709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:25.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.271+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.271+0000 7f10048709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:25.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.271+0000 7f10048709c0 20 searching for the correct realm 2024-09-14T11:21:25.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.275+0000 7f1001b75640 0 -- 172.21.15.148:0/2837646495 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x557e8ef398d0 msgr2=0x557e8ef3bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:25.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.283+0000 7f1002376640 0 -- 172.21.15.148:0/2837646495 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f0ffc04db40 msgr2=0x7f0ffc069100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:25.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.287+0000 7f10048709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:25.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.287+0000 7f10048709c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:25.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.287+0000 7f10048709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:25.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.287+0000 7f10048709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:25.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.287+0000 7f10048709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:25.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.287+0000 7f10048709c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:25.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.287+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:25.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 zone default found 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 4 Realm: () 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 zonegroup default 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 started sync module instance, tier type = 2024-09-14T11:21:25.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.291+0000 7f10048709c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:25.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 20 add_watcher() i=0 2024-09-14T11:21:25.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 20 add_watcher() i=1 2024-09-14T11:21:25.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 20 add_watcher() i=2 2024-09-14T11:21:25.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 20 add_watcher() i=3 2024-09-14T11:21:25.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 20 add_watcher() i=4 2024-09-14T11:21:25.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 20 add_watcher() i=5 2024-09-14T11:21:25.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 20 add_watcher() i=6 2024-09-14T11:21:25.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 20 add_watcher() i=7 2024-09-14T11:21:25.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.315+0000 7f10048709c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f0eb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f10048709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f10048709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f10048709c0 5 note: GC not initialized 2024-09-14T11:21:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f0e337fe640 20 reqs_thread_entry: start 2024-09-14T11:21:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f10048709c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:25.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f10048709c0 20 Filter name: none 2024-09-14T11:21:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f0e317fa640 20 reqs_thread_entry: start 2024-09-14T11:21:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.319+0000 7f10048709c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:25.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.323+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.323+0000 7f10048709c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.323+0000 7f10048709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.323+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.323+0000 7f10048709c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:25.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.323+0000 7f10048709c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.323+0000 7f10048709c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:25.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.323+0000 7f10048709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:25.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.327+0000 7f0eb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:25.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.331+0000 7f10048709c0 20 remove_watcher() i=0 2024-09-14T11:21:25.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.331+0000 7f10048709c0 2 removed watcher, disabling cache 2024-09-14T11:21:25.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.331+0000 7f10048709c0 20 remove_watcher() i=1 2024-09-14T11:21:25.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.335+0000 7f10048709c0 20 remove_watcher() i=2 2024-09-14T11:21:25.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.339+0000 7f10048709c0 20 remove_watcher() i=3 2024-09-14T11:21:25.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.343+0000 7f10048709c0 20 remove_watcher() i=4 2024-09-14T11:21:25.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.343+0000 7f10048709c0 20 remove_watcher() i=5 2024-09-14T11:21:25.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.347+0000 7f10048709c0 20 remove_watcher() i=6 2024-09-14T11:21:25.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.347+0000 7f10048709c0 20 remove_watcher() i=7 2024-09-14T11:21:25.361 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:25.361 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:21:25.361 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: a-bucket id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:21:25.361 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:25.361 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:21:25.388 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:25.388 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:25.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.435+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.439+0000 7fc16dade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.439+0000 7fc16dade9c0 20 realm 2024-09-14T11:21:25.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.439+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.439+0000 7fc16dade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.439+0000 7fc16dade9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:25.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.439+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.439+0000 7fc16dade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.439+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.443+0000 7fc16dade9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:25.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.443+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.443+0000 7fc16dade9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:25.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.443+0000 7fc16dade9c0 20 searching for the correct realm 2024-09-14T11:21:25.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.447+0000 7fc16b5e4640 0 -- 172.21.15.148:0/3600424287 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fc15c077030 msgr2=0x7fc15c06f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:25.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.659+0000 7fc16b5e4640 0 -- 172.21.15.148:0/3600424287 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc154003ac0 msgr2=0x7fc16402e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:25.877 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:25.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:25.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:25.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:25.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:25.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:25.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.878 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.879+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:25.879 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:25.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 zone default found 2024-09-14T11:21:25.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 4 Realm: () 2024-09-14T11:21:25.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:25.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:25.880 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:25.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 zonegroup default 2024-09-14T11:21:25.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.881 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:25.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 started sync module instance, tier type = 2024-09-14T11:21:25.882 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.883+0000 7fc16dade9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:25.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.907+0000 7fc16dade9c0 20 add_watcher() i=0 2024-09-14T11:21:25.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.907+0000 7fc16dade9c0 20 add_watcher() i=1 2024-09-14T11:21:25.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.907+0000 7fc16dade9c0 20 add_watcher() i=2 2024-09-14T11:21:25.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.907+0000 7fc16dade9c0 20 add_watcher() i=3 2024-09-14T11:21:25.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.907+0000 7fc16dade9c0 20 add_watcher() i=4 2024-09-14T11:21:25.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.907+0000 7fc16dade9c0 20 add_watcher() i=5 2024-09-14T11:21:25.907 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.907+0000 7fc16dade9c0 20 add_watcher() i=6 2024-09-14T11:21:25.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.915+0000 7fc16dade9c0 20 add_watcher() i=7 2024-09-14T11:21:25.912 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.915+0000 7fc16dade9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:25.919 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc021fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:25.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc16dade9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:25.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc16dade9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:25.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc16dade9c0 5 note: GC not initialized 2024-09-14T11:21:25.920 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc020fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:25.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc16dade9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:25.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc16dade9c0 20 Filter name: none 2024-09-14T11:21:25.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fbf9a7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:25.921 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc16dade9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:25.922 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.923+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.927+0000 7fc16dade9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:25.923 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.927+0000 7fc16dade9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:25.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.927+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.927+0000 7fc16dade9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:25.924 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.927+0000 7fc16dade9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:25.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.927+0000 7fc16dade9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:25.925 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.927+0000 7fc16dade9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:25.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.931+0000 7fc021fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:25.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.935+0000 7fc16dade9c0 20 remove_watcher() i=0 2024-09-14T11:21:25.933 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.935+0000 7fc16dade9c0 2 removed watcher, disabling cache 2024-09-14T11:21:25.935 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.939+0000 7fc16dade9c0 20 remove_watcher() i=1 2024-09-14T11:21:25.937 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.939+0000 7fc16dade9c0 20 remove_watcher() i=2 2024-09-14T11:21:25.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.943+0000 7fc16dade9c0 20 remove_watcher() i=3 2024-09-14T11:21:25.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.943+0000 7fc16dade9c0 20 remove_watcher() i=4 2024-09-14T11:21:25.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.947+0000 7fc16dade9c0 20 remove_watcher() i=5 2024-09-14T11:21:25.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.951+0000 7fc16dade9c0 20 remove_watcher() i=6 2024-09-14T11:21:25.953 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:25.955+0000 7fc16dade9c0 20 remove_watcher() i=7 2024-09-14T11:21:25.968 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:21:26.003 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:26.003 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:26.046 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.047+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 realm 2024-09-14T11:21:26.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.051+0000 7efffdbda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:26.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.050 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.051 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:26.052 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 searching for the correct realm 2024-09-14T11:21:26.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.059+0000 7efffb6e0640 0 -- 172.21.15.148:0/1654054603 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7effec073070 msgr2=0x7effec05dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:26.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.067+0000 7efffb6e0640 0 -- 172.21.15.148:0/1654054603 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7efff40d6910 msgr2=0x7efff40aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:26.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:26.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:26.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:26.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:26.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:26.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:26.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:26.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 zone default found 2024-09-14T11:21:26.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 Realm: () 2024-09-14T11:21:26.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:26.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:26.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:26.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 zonegroup default 2024-09-14T11:21:26.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 started sync module instance, tier type = 2024-09-14T11:21:26.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:26.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=0 2024-09-14T11:21:26.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=1 2024-09-14T11:21:26.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=2 2024-09-14T11:21:26.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=3 2024-09-14T11:21:26.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=4 2024-09-14T11:21:26.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=5 2024-09-14T11:21:26.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=6 2024-09-14T11:21:26.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.099+0000 7efffdbda9c0 20 add_watcher() i=7 2024-09-14T11:21:26.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.099+0000 7efffdbda9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:26.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efeb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:26.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:26.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:26.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 note: GC not initialized 2024-09-14T11:21:26.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efeb0fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:26.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:26.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 Filter name: none 2024-09-14T11:21:26.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efe2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:26.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:26.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:26.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:26.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:26.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:26.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.107+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:26.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:26.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:26.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:21:26.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 94184052114288 notifier 8178 bl.length()=911 2024-09-14T11:21:26.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:21:26.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:21:26.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:21:26.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:21:26.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:21:26.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:21:26.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.1 2024-09-14T11:21:26.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.1 2024-09-14T11:21:26.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.2 2024-09-14T11:21:26.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.2 2024-09-14T11:21:26.131 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.3 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.3 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.4 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.4 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.5 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.5 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.6 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.6 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.7 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.7 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.8 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.8 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.9 2024-09-14T11:21:26.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.9 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.10 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.10 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.11 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.11 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.12 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.12 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.13 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.13 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:26.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:26.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:26.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:26.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:26.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:26.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:26.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:26.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:26.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:26.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:26.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:26.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:26.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:26.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:26.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:26.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:26.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:26.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:26.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:26.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:26.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:26.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.143+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:26.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.143+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:26.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.143+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:26.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.143+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:26.151 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efffdbda9c0 time 2024-09-14T11:21:26.157719+0000 2024-09-14T11:21:26.151 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:26.152 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:26.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f00014b42eb] 2024-09-14T11:21:26.152 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f00014b449f] 2024-09-14T11:21:26.152 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8ed912c01] 2024-09-14T11:21:26.152 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a8ed927231] 2024-09-14T11:21:26.152 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a8ed928884] 2024-09-14T11:21:26.152 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f000031ad90] 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7efffdbda9c0 thread_name:radosgw-admin 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.155+0000 7efffdbda9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efffdbda9c0 time 2024-09-14T11:21:26.157719+0000 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f00014b42eb] 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f00014b449f] 2024-09-14T11:21:26.153 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8ed912c01] 2024-09-14T11:21:26.154 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a8ed927231] 2024-09-14T11:21:26.154 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a8ed928884] 2024-09-14T11:21:26.154 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:21:26.154 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f000031ad90] 2024-09-14T11:21:26.154 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:21:26.154 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:21:26.154 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0000333520] 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f00014b4345] 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f00014b449f] 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8ed912c01] 2024-09-14T11:21:26.166 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a8ed927231] 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a8ed928884] 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f000031ad90] 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.155+0000 7efffdbda9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7efffdbda9c0 thread_name:radosgw-admin 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0000333520] 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:21:26.167 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f00014b4345] 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f00014b449f] 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8ed912c01] 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a8ed927231] 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a8ed928884] 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f000031ad90] 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eee874b0) adding con mode: crc 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eee874b0) adding con mode: secure 2024-09-14T11:21:26.168 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eee874b0) adding con mode: crc 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eee874b0) adding con mode: secure 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command rotate-key hook 0x55a8eee875f8 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-a con 0x55a8eed37050 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-b con 0x55a8eed37b40 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-c con 0x55a8eedcd5f0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): authenticate will time out at 2945.093024s 2024-09-14T11:21:26.169 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): get_auth_request con 0x55a8eed37050 auth_method 0 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): get_auth_request con 0x55a8eedcd5f0 auth_method 0 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): handle_auth_done global_id 8169 payload 824 2024-09-14T11:21:26.170 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient: _finish_hunting 0 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:21:26.031+0000 7efffb6e0640 1 monclient: found mon.noname-a 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:21:26.031+0000 7efffaedf640 10 monclient: get_auth_request con 0x55a8eed37b40 auth_method 0 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: dump: 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.171 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: _finish_auth 0 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: _check_auth_tickets 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: dump: 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.172 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 monclient: authenticate success, global_id 8169 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:21:26.031+0000 7efee960a640 4 set_mon_vals no callback set 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 1 librados: init done 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:21:26.031+0000 7efee7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:21:26.031+0000 7efee7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:21:26.031+0000 7efee7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:21:26.035+0000 7efffaedf640 10 monclient: get_auth_request con 0x7efee00718a0 auth_method 0 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:21:26.035+0000 7efffbee1640 10 monclient: get_auth_request con 0x55a8eeec8bb0 auth_method 0 2024-09-14T11:21:26.173 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:21:26.035+0000 7efffb6e0640 10 monclient: get_auth_request con 0x55a8eeed2360 auth_method 0 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:21:26.035+0000 7efffaedf640 10 monclient: get_auth_request con 0x55a8eeed66c0 auth_method 0 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: build_initial_monmap 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: monmap: 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.174 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding auth protocol: cephx 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding auth protocol: cephx 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding auth protocol: cephx 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.175 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55a8eeedf810 EEXIST 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: init 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding auth protocol: cephx 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding auth protocol: cephx 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding auth protocol: cephx 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.176 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command rotate-key cmddesc rotate-key hook 0x55a8eeed9b00 EEXIST 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-a con 0x55a8eef07eb0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-c con 0x55a8eef06600 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-b con 0x55a8eef1aad0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.177 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): authenticate will time out at 2945.102257s 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): get_auth_request con 0x55a8eef07eb0 auth_method 0 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): get_auth_request con 0x55a8eef06600 auth_method 0 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.178 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): handle_auth_done global_id 8172 payload 824 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient: _finish_hunting 0 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:21:26.039+0000 7efffb6e0640 1 monclient: found mon.noname-a 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: dump: 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.179 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: _finish_auth 0 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: _check_auth_tickets 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: dump: 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.180 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 monclient: authenticate success, global_id 8172 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:21:26.039+0000 7efffc6e2640 4 set_mon_vals no callback set 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.181 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:21:26.043+0000 7efee5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:21:26.043+0000 7efee5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:21:26.043+0000 7efee5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient: get_auth_request con 0x7efed40717b0 auth_method 0 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: get_monmap_and_config 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: build_initial_monmap 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: monmap: 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:26.182 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding auth protocol: cephx 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding auth protocol: cephx 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding auth protocol: cephx 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.183 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: init 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding auth protocol: cephx 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding auth protocol: cephx 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding auth protocol: cephx 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.184 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc2a7849d8 EEXIST 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-b con 0x55a8eef540e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-c con 0x55a8eef544c0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:26.185 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-a con 0x55a8eef55980 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): authenticate will time out at 2945.106200s 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): get_auth_request con 0x55a8eef544c0 auth_method 0 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): get_auth_request con 0x55a8eef55980 auth_method 0 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.186 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): handle_auth_done global_id 7667 payload 274 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient: _finish_hunting 0 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:21:26.043+0000 7efffaedf640 1 monclient: found mon.noname-c 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: dump: 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.187 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: _finish_auth 0 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: _check_auth_tickets 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: dump: 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.188 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 monclient: authenticate success, global_id 7667 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:21:26.189 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 4 set_mon_vals no callback set 2024-09-14T11:21:26.192 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: shutdown 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: build_initial_monmap 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: monmap: 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:26.193 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding auth protocol: cephx 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding auth protocol: cephx 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding auth protocol: cephx 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.194 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: starting msgr at 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: starting objecter 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55a8eeeb5660 EEXIST 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: setting wanted keys 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: calling monclient init 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: init 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding auth protocol: cephx 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding auth protocol: cephx 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding auth protocol: cephx 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.195 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command rotate-key cmddesc rotate-key hook 0x55a8eef250c8 EEXIST 2024-09-14T11:21:26.196 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-a con 0x55a8eef540e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-b con 0x55a8eef55980 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-c con 0x55a8eef67bf0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): authenticate will time out at 2945.109006s 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): get_auth_request con 0x55a8eef67bf0 auth_method 0 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.197 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): get_auth_request con 0x55a8eef540e0 auth_method 0 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:21:26.047+0000 7efffaedf640 10 monclient(hunting): get_auth_request con 0x55a8eef55980 auth_method 0 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:21:26.047+0000 7efffaedf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:21:26.047+0000 7efffaedf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:21:26.047+0000 7efffaedf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): handle_auth_done global_id 8178 payload 824 2024-09-14T11:21:26.198 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient: _finish_hunting 0 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:21:26.047+0000 7efffb6e0640 1 monclient: found mon.noname-a 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: dump: 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.199 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: dump: 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.200 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:21:26.047+0000 7efedeffd640 4 set_mon_vals no callback set 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 monclient: authenticate success, global_id 8178 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: init done 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cr dump hook 0x55a8eef4c1c8 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:21:26.051+0000 7efedd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:21:26.051+0000 7efedd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:21:26.051+0000 7efedd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:21:26.051+0000 7efffaedf640 10 monclient: get_auth_request con 0x7efec40718a0 auth_method 0 2024-09-14T11:21:26.201 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:21:26.051+0000 7efffbee1640 10 monclient: get_auth_request con 0x55a8eef73830 auth_method 0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 realm 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:21:26.051+0000 7efffb6e0640 10 monclient: get_auth_request con 0x55a8eef77c50 auth_method 0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:21:26.055+0000 7efffaedf640 10 monclient: get_auth_request con 0x55a8eef7b390 auth_method 0 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:26.202 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 searching for the correct realm 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:21:26.055+0000 7efffbee1640 10 monclient: get_auth_request con 0x55a8eef80150 auth_method 0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:21:26.059+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7effec073070 auth_method 0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:21:26.059+0000 7efffaedf640 10 monclient: get_auth_request con 0x7efff40b9b80 auth_method 0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:21:26.059+0000 7efffb6e0640 0 -- 172.21.15.148:0/1654054603 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7effec073070 msgr2=0x7effec05dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:21:26.059+0000 7efedd7fa640 1 client.8178.objecter ms_handle_reset 0x7effec073070 session 0x7effec04b130 osd.0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:21:26.059+0000 7efedd7fa640 10 monclient: _renew_subs 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:21:26.059+0000 7efedd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:21:26.059+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7efec4081ac0 auth_method 0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:21:26.063+0000 7efffbee1640 10 monclient: get_auth_request con 0x7effec017020 auth_method 0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:21:26.063+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7efff40d6910 auth_method 0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:21:26.067+0000 7efffb6e0640 0 -- 172.21.15.148:0/1654054603 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7efff40d6910 msgr2=0x7efff40aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:21:26.067+0000 7efedd7fa640 1 client.8178.objecter ms_handle_reset 0x7efff40d6910 session 0x7efff40a6070 osd.3 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:21:26.067+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7effec073070 auth_method 0 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:26.203 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 zone default found 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 Realm: () 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:26.204 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 zonegroup default 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 started sync module instance, tier type = 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:21:26.079+0000 7efedd7fa640 1 client.8178.objecter ms_handle_reset 0x7efec4081ac0 session 0x7effec04b130 osd.0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:21:26.079+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7efec4087180 auth_method 0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=0 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=1 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=2 2024-09-14T11:21:26.205 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=3 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=4 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=5 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=6 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:21:26.099+0000 7efffdbda9c0 20 add_watcher() i=7 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:21:26.099+0000 7efffdbda9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding auth protocol: cephx 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding auth protocol: cephx 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding auth protocol: cephx 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.206 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:21:26.103+0000 7efeb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cache list hook 0x55a8eef530a0 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cache inspect hook 0x55a8eef530a0 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cache erase hook 0x55a8eef530a0 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cache zap hook 0x55a8eef530a0 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 note: GC not initialized 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:21:26.103+0000 7efeb0fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:26.207 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command sync trace show hook 0x7effe401b050 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command sync trace history hook 0x7effe401b050 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command sync trace active hook 0x7effe401b050 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command sync trace active_short hook 0x7effe401b050 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 Filter name: none 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:21:26.103+0000 7efe2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:26.208 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 94184052114288 notifier 8178 bl.length()=911 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.209 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.1 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.1 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.2 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.2 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.3 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.3 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.4 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.4 2024-09-14T11:21:26.210 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.5 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.5 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.6 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.6 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.7 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.7 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.8 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.8 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.9 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.9 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.10 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.10 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.11 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.11 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.12 2024-09-14T11:21:26.211 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.12 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.13 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.13 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:26.212 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:21:26.143+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:21:26.143+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:21:26.143+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:21:26.143+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:21:26.155+0000 7efffdbda9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efffdbda9c0 time 2024-09-14T11:21:26.157719+0000 2024-09-14T11:21:26.213 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f00014b42eb] 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f00014b449f] 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8ed912c01] 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a8ed927231] 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a8ed928884] 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f000031ad90] 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:21:26.155+0000 7efffdbda9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7efffdbda9c0 thread_name:radosgw-admin 2024-09-14T11:21:26.214 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0000333520] 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f00014b4345] 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f00014b449f] 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8ed912c01] 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a8ed927231] 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a8ed928884] 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f000031ad90] 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:21:26.215 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:21:26.216 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:21:26.217 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:21:26.218 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:21:26.219 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:21:26.220 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:21:26.221 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efe2a7fc640 / http_manager 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efeb0fe1640 / http_manager 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efeb1fe3640 / rgw_dt_lg_renew 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efedd7fa640 / ms_dispatch 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efede7fc640 / io_context_pool 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efedeffd640 / io_context_pool 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efee5602640 / ms_dispatch 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efee7e07640 / ms_dispatch 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efee960a640 / io_context_pool 2024-09-14T11:21:26.222 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffaedf640 / msgr-worker-2 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffb6e0640 / msgr-worker-1 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffbee1640 / msgr-worker-0 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffc6e2640 / io_context_pool 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffdbda9c0 / radosgw-admin 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.140533.log 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eee874b0) adding con mode: crc 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eee874b0) adding con mode: secure 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eee874b0) adding con mode: crc 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eee874b0) adding con mode: secure 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.223 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command rotate-key hook 0x55a8eee875f8 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-a con 0x55a8eed37050 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-b con 0x55a8eed37b40 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-c con 0x55a8eedcd5f0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient(hunting): authenticate will time out at 2945.093024s 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): get_auth_request con 0x55a8eed37050 auth_method 0 2024-09-14T11:21:26.224 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): get_auth_request con 0x55a8eedcd5f0 auth_method 0 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:21:26.031+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.225 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient(hunting): handle_auth_done global_id 8169 payload 824 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient: _finish_hunting 0 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:21:26.031+0000 7efffb6e0640 1 monclient: found mon.noname-a 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:21:26.031+0000 7efffb6e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:21:26.031+0000 7efffaedf640 10 monclient: get_auth_request con 0x55a8eed37b40 auth_method 0 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: dump: 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.226 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: _finish_auth 0 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: _check_auth_tickets 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:21:26.031+0000 7efee7e07640 10 monclient: dump: 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.227 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 5 monclient: authenticate success, global_id 8169 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:21:26.031+0000 7efee960a640 4 set_mon_vals no callback set 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:21:26.031+0000 7efffdbda9c0 1 librados: init done 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:21:26.031+0000 7efee7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:26.228 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:21:26.031+0000 7efee7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:21:26.031+0000 7efee7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:21:26.035+0000 7efffaedf640 10 monclient: get_auth_request con 0x7efee00718a0 auth_method 0 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:21:26.035+0000 7efffbee1640 10 monclient: get_auth_request con 0x55a8eeec8bb0 auth_method 0 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:21:26.035+0000 7efffb6e0640 10 monclient: get_auth_request con 0x55a8eeed2360 auth_method 0 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:21:26.035+0000 7efffaedf640 10 monclient: get_auth_request con 0x55a8eeed66c0 auth_method 0 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: build_initial_monmap 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: monmap: 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:26.229 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding auth protocol: cephx 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding auth protocol: cephx 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding auth protocol: cephx 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.230 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: crc 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeedb3f0) adding con mode: secure 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55a8eeedf810 EEXIST 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: init 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding auth protocol: cephx 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding auth protocol: cephx 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding auth protocol: cephx 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.231 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: crc 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eeed99b8) adding con mode: secure 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command rotate-key cmddesc rotate-key hook 0x55a8eeed9b00 EEXIST 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:21:26.232 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-a con 0x55a8eef07eb0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-c con 0x55a8eef06600 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-b con 0x55a8eef1aad0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient(hunting): authenticate will time out at 2945.102257s 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): get_auth_request con 0x55a8eef07eb0 auth_method 0 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.233 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): get_auth_request con 0x55a8eef06600 auth_method 0 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:21:26.039+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient(hunting): handle_auth_done global_id 8172 payload 824 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient: _finish_hunting 0 2024-09-14T11:21:26.234 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:21:26.039+0000 7efffb6e0640 1 monclient: found mon.noname-a 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:21:26.039+0000 7efffb6e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: dump: 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: _finish_auth 0 2024-09-14T11:21:26.235 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: _check_auth_tickets 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:21:26.039+0000 7efee5602640 10 monclient: dump: 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.236 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 5 monclient: authenticate success, global_id 8172 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:21:26.039+0000 7efffc6e2640 4 set_mon_vals no callback set 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:21:26.039+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:21:26.043+0000 7efee5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:21:26.043+0000 7efee5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:21:26.043+0000 7efee5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient: get_auth_request con 0x7efed40717b0 auth_method 0 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: get_monmap_and_config 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: build_initial_monmap 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: monmap: 2024-09-14T11:21:26.237 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding auth protocol: cephx 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding auth protocol: cephx 2024-09-14T11:21:26.238 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding auth protocol: cephx 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: crc 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef25d40) adding con mode: secure 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.239 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: init 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding auth protocol: cephx 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding auth protocol: cephx 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding auth protocol: cephx 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.240 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: crc 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784890) adding con mode: secure 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc2a7849d8 EEXIST 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-b con 0x55a8eef540e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-c con 0x55a8eef544c0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-a con 0x55a8eef55980 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:26.241 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient(hunting): authenticate will time out at 2945.106200s 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): get_auth_request con 0x55a8eef544c0 auth_method 0 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): get_auth_request con 0x55a8eef55980 auth_method 0 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:21:26.043+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient(hunting): handle_auth_done global_id 7667 payload 274 2024-09-14T11:21:26.242 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient: _finish_hunting 0 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:21:26.043+0000 7efffaedf640 1 monclient: found mon.noname-c 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:21:26.043+0000 7efffaedf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: dump: 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.243 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: _finish_auth 0 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: _check_auth_tickets 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:21:26.043+0000 7efedeffd640 10 monclient: dump: 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.244 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 monclient: authenticate success, global_id 7667 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 4 set_mon_vals no callback set 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: shutdown 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: build_initial_monmap 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 10 monclient: monmap: 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:26.245 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding auth protocol: cephx 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding auth protocol: cephx 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding auth protocol: cephx 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.246 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: crc 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:21:26.043+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef4c660) adding con mode: secure 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: starting msgr at 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: starting objecter 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55a8eeeb5660 EEXIST 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: setting wanted keys 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: calling monclient init 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: init 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding auth protocol: cephx 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding auth protocol: cephx 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding auth protocol: cephx 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.247 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: crc 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 AuthRegistry(0x55a8eef24f80) adding con mode: secure 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command rotate-key cmddesc rotate-key hook 0x55a8eef250c8 EEXIST 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:26.248 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-a con 0x55a8eef540e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-b con 0x55a8eef55980 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): picked mon.noname-c con 0x55a8eef67bf0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient(hunting): authenticate will time out at 2945.109006s 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): get_auth_request con 0x55a8eef67bf0 auth_method 0 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): get_auth_request con 0x55a8eef540e0 auth_method 0 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.249 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:21:26.047+0000 7efffbee1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:21:26.047+0000 7efffaedf640 10 monclient(hunting): get_auth_request con 0x55a8eef55980 auth_method 0 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:21:26.047+0000 7efffaedf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:21:26.047+0000 7efffaedf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:21:26.047+0000 7efffaedf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient(hunting): handle_auth_done global_id 8178 payload 824 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient: _finish_hunting 0 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:21:26.047+0000 7efffb6e0640 1 monclient: found mon.noname-a 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:21:26.047+0000 7efffb6e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.250 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: dump: 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:26.251 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:21:26.047+0000 7efedd7fa640 10 monclient: dump: 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:21:26.047+0000 7efedeffd640 4 set_mon_vals no callback set 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 monclient: authenticate success, global_id 8178 2024-09-14T11:21:26.252 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _renew_subs 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 1 librados: init done 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cr dump hook 0x55a8eef4c1c8 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:21:26.047+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:21:26.051+0000 7efedd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:21:26.051+0000 7efedd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:21:26.051+0000 7efedd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:21:26.051+0000 7efffaedf640 10 monclient: get_auth_request con 0x7efec40718a0 auth_method 0 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:21:26.051+0000 7efffbee1640 10 monclient: get_auth_request con 0x55a8eef73830 auth_method 0 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.253 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 realm 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:21:26.051+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:21:26.051+0000 7efffb6e0640 10 monclient: get_auth_request con 0x55a8eef77c50 auth_method 0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:21:26.055+0000 7efffaedf640 10 monclient: get_auth_request con 0x55a8eef7b390 auth_method 0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:21:26.055+0000 7efffdbda9c0 20 searching for the correct realm 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:21:26.055+0000 7efffbee1640 10 monclient: get_auth_request con 0x55a8eef80150 auth_method 0 2024-09-14T11:21:26.254 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:21:26.059+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7effec073070 auth_method 0 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:21:26.059+0000 7efffaedf640 10 monclient: get_auth_request con 0x7efff40b9b80 auth_method 0 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:21:26.059+0000 7efffb6e0640 0 -- 172.21.15.148:0/1654054603 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7effec073070 msgr2=0x7effec05dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:21:26.059+0000 7efedd7fa640 1 client.8178.objecter ms_handle_reset 0x7effec073070 session 0x7effec04b130 osd.0 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:21:26.059+0000 7efedd7fa640 10 monclient: _renew_subs 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:21:26.059+0000 7efedd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:21:26.059+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7efec4081ac0 auth_method 0 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:21:26.063+0000 7efffbee1640 10 monclient: get_auth_request con 0x7effec017020 auth_method 0 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:21:26.063+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7efff40d6910 auth_method 0 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:21:26.067+0000 7efffb6e0640 0 -- 172.21.15.148:0/1654054603 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7efff40d6910 msgr2=0x7efff40aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:21:26.067+0000 7efedd7fa640 1 client.8178.objecter ms_handle_reset 0x7efff40d6910 session 0x7efff40a6070 osd.3 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:21:26.067+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7effec073070 auth_method 0 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:26.255 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 zone default found 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 Realm: () 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 zonegroup default 2024-09-14T11:21:26.256 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:21:26.075+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 started sync module instance, tier type = 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:21:26.079+0000 7efffdbda9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:21:26.079+0000 7efedd7fa640 1 client.8178.objecter ms_handle_reset 0x7efec4081ac0 session 0x7effec04b130 osd.0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:21:26.079+0000 7efffb6e0640 10 monclient: get_auth_request con 0x7efec4087180 auth_method 0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=0 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=1 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=2 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=3 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=4 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=5 2024-09-14T11:21:26.257 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:21:26.095+0000 7efffdbda9c0 20 add_watcher() i=6 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:21:26.099+0000 7efffdbda9c0 20 add_watcher() i=7 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:21:26.099+0000 7efffdbda9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding auth protocol: cephx 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding auth protocol: cephx 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding auth protocol: cephx 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:21:26.103+0000 7efeb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.258 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: crc 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 AuthRegistry(0x7ffc2a784d70) adding con mode: secure 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cache list hook 0x55a8eef530a0 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cache inspect hook 0x55a8eef530a0 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cache erase hook 0x55a8eef530a0 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command cache zap hook 0x55a8eef530a0 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 note: GC not initialized 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:21:26.103+0000 7efeb0fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command sync trace show hook 0x7effe401b050 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command sync trace history hook 0x7effe401b050 2024-09-14T11:21:26.259 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command sync trace active hook 0x7effe401b050 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 5 asok(0x55a8eec7cd90) register_command sync trace active_short hook 0x7effe401b050 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 Filter name: none 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:21:26.103+0000 7efe2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:21:26.103+0000 7efffdbda9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.260 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:21:26.107+0000 7efffdbda9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 94184052114288 notifier 8178 bl.length()=911 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:21:26.119+0000 7efede7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:21:26.261 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:21:26.119+0000 7efffdbda9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.1 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.1 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.2 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.2 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.3 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.3 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.4 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.4 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.5 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.5 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.6 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.6 2024-09-14T11:21:26.262 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.7 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.7 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.8 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.8 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.9 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.9 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.10 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.10 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.11 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.11 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.12 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.12 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.13 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.13 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:26.263 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:21:26.135+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:26.264 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:21:26.139+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:21:26.143+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:21:26.143+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:21:26.143+0000 7efffdbda9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:21:26.143+0000 7efffdbda9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:21:26.155+0000 7efffdbda9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efffdbda9c0 time 2024-09-14T11:21:26.157719+0000 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f00014b42eb] 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f00014b449f] 2024-09-14T11:21:26.265 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8ed912c01] 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a8ed927231] 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a8ed928884] 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f000031ad90] 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:21:26.155+0000 7efffdbda9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7efffdbda9c0 thread_name:radosgw-admin 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0000333520] 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:21:26.266 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f00014b4345] 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f00014b449f] 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8ed912c01] 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55a8ed927231] 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55a8ed928884] 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f000031ad90] 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:21:26.267 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:21:26.268 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:21:26.269 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:21:26.270 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:21:26.271 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:21:26.272 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 7efe2a7fc640 / http_manager 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 7efeb0fe1640 / http_manager 2024-09-14T11:21:26.273 INFO:tasks.workunit.client.0.smithi148.stderr: 7efeb1fe3640 / rgw_dt_lg_renew 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efedd7fa640 / ms_dispatch 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efede7fc640 / io_context_pool 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efedeffd640 / io_context_pool 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efee5602640 / ms_dispatch 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efee7e07640 / ms_dispatch 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efee960a640 / io_context_pool 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffaedf640 / msgr-worker-2 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffb6e0640 / msgr-worker-1 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffbee1640 / msgr-worker-0 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffc6e2640 / io_context_pool 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: 7efffdbda9c0 / radosgw-admin 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:21:26.160201Z_22c33e0f-2a4b-445c-85c8-5c52d26f35bd/log 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:21:26.274 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:21:26.275 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.235+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 realm 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.239+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.243+0000 7f3c0d8d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.243+0000 7f3c0d8d09c0 20 searching for the correct realm 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.247+0000 7f3c0b3d6640 0 -- 172.21.15.148:0/3451104095 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f3bfc033040 msgr2=0x7f3bfc033930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.255+0000 7f3c0b3d6640 0 -- 172.21.15.148:0/3451104095 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f3c0406e180 msgr2=0x7f3c0406b900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.259+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 zone default found 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 4 Realm: () 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 zonegroup default 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 started sync module instance, tier type = 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.263+0000 7f3c0d8d09c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 20 add_watcher() i=0 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 20 add_watcher() i=1 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 20 add_watcher() i=2 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 20 add_watcher() i=3 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 20 add_watcher() i=4 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 20 add_watcher() i=5 2024-09-14T11:21:26.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 20 add_watcher() i=6 2024-09-14T11:21:26.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 20 add_watcher() i=7 2024-09-14T11:21:26.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.283+0000 7f3c0d8d09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:26.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3ac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:26.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3c0d8d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3c0d8d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3c0d8d09c0 5 note: GC not initialized 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3ac0fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3c0d8d09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3c0d8d09c0 20 Filter name: none 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3a3a7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.287+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:26.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:21:26.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:26.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:26.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:21:26.290 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.291+0000 7f3c0d8d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:26.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.295+0000 7f3ac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:26.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.299+0000 7f3c0d8d09c0 20 remove_watcher() i=0 2024-09-14T11:21:26.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.299+0000 7f3c0d8d09c0 2 removed watcher, disabling cache 2024-09-14T11:21:26.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.303+0000 7f3c0d8d09c0 20 remove_watcher() i=1 2024-09-14T11:21:26.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.303+0000 7f3c0d8d09c0 20 remove_watcher() i=2 2024-09-14T11:21:26.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.307+0000 7f3c0d8d09c0 20 remove_watcher() i=3 2024-09-14T11:21:26.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.307+0000 7f3c0d8d09c0 20 remove_watcher() i=4 2024-09-14T11:21:26.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.307+0000 7f3c0d8d09c0 20 remove_watcher() i=5 2024-09-14T11:21:26.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.311+0000 7f3c0d8d09c0 20 remove_watcher() i=6 2024-09-14T11:21:26.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.315+0000 7f3c0d8d09c0 20 remove_watcher() i=7 2024-09-14T11:21:26.327 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:21:26.327 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:21:26.374 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:21:26.401 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:26.401 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:26.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 20 realm 2024-09-14T11:21:26.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:26.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.447+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.451+0000 7fc0817cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.451+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.451+0000 7fc0817cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:26.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.451+0000 7fc0817cd9c0 20 searching for the correct realm 2024-09-14T11:21:26.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.455+0000 7fc07ead2640 0 -- 172.21.15.148:0/911427192 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fc0780980c0 msgr2=0x7fc07806f630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:26.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.463+0000 7fc07fad4640 0 -- 172.21.15.148:0/911427192 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5577430c4780 msgr2=0x5577430c6b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:26.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:26.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:26.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:26.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:26.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:26.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:26.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:26.468 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:26.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 zone default found 2024-09-14T11:21:26.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 4 Realm: () 2024-09-14T11:21:26.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:26.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:26.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:26.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 zonegroup default 2024-09-14T11:21:26.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:26.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 started sync module instance, tier type = 2024-09-14T11:21:26.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.471+0000 7fc0817cd9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:26.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.491+0000 7fc0817cd9c0 20 add_watcher() i=0 2024-09-14T11:21:26.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.491+0000 7fc0817cd9c0 20 add_watcher() i=1 2024-09-14T11:21:26.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.491+0000 7fc0817cd9c0 20 add_watcher() i=2 2024-09-14T11:21:26.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.491+0000 7fc0817cd9c0 20 add_watcher() i=3 2024-09-14T11:21:26.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.491+0000 7fc0817cd9c0 20 add_watcher() i=4 2024-09-14T11:21:26.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.491+0000 7fc0817cd9c0 20 add_watcher() i=5 2024-09-14T11:21:26.489 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.491+0000 7fc0817cd9c0 20 add_watcher() i=6 2024-09-14T11:21:26.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.495+0000 7fc0817cd9c0 20 add_watcher() i=7 2024-09-14T11:21:26.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.495+0000 7fc0817cd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:26.494 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.495+0000 7fbf35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.495+0000 7fc0817cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.495+0000 7fc0817cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.495+0000 7fc0817cd9c0 5 note: GC not initialized 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fbf34fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 Filter name: none 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fbeae7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:26.495 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:26.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:26.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:26.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:26.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:26.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:21:26.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:26.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:26.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:26.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:26.497 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:26.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:26.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:26.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:26.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:26.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:26.498 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.499+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:26.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:26.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:26.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:26.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:26.499 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:26.500 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:26.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:26.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:26.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:26.501 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:26.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:26.502 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.503+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:26.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:26.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:26.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:26.503 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:26.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:26.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:26.504 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fc0817cd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:26.505 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fc0817cd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:26.506 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.507+0000 7fbf35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:26.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.511+0000 7fc0817cd9c0 20 remove_watcher() i=0 2024-09-14T11:21:26.510 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.511+0000 7fc0817cd9c0 2 removed watcher, disabling cache 2024-09-14T11:21:26.512 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.515+0000 7fc0817cd9c0 20 remove_watcher() i=1 2024-09-14T11:21:26.514 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.515+0000 7fc0817cd9c0 20 remove_watcher() i=2 2024-09-14T11:21:26.516 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.519+0000 7fc0817cd9c0 20 remove_watcher() i=3 2024-09-14T11:21:26.518 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.519+0000 7fc0817cd9c0 20 remove_watcher() i=4 2024-09-14T11:21:26.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.523+0000 7fc0817cd9c0 20 remove_watcher() i=5 2024-09-14T11:21:26.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.527+0000 7fc0817cd9c0 20 remove_watcher() i=6 2024-09-14T11:21:26.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:26.527+0000 7fc0817cd9c0 20 remove_watcher() i=7 2024-09-14T11:21:56.571 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:21:56.604 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:56.604 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:56.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.650+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.650+0000 7f74a31359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.650+0000 7f74a31359c0 20 realm 2024-09-14T11:21:56.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.650+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:56.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:56.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:56.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.654+0000 7f74a31359c0 20 searching for the correct realm 2024-09-14T11:21:56.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.662+0000 7f74a0c3b640 0 -- 172.21.15.148:0/3786612175 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f749001f070 msgr2=0x7f749002c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:56.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.666+0000 7f74a0c3b640 0 -- 172.21.15.148:0/3786612175 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f74980df910 msgr2=0x7f74980cd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:56.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:56.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:56.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:56.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:56.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:56.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:56.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 zone default found 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 4 Realm: () 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 zonegroup default 2024-09-14T11:21:56.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.674+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.678+0000 7f74a31359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.678+0000 7f74a31359c0 20 started sync module instance, tier type = 2024-09-14T11:21:56.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.678+0000 7f74a31359c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:56.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.694+0000 7f74a31359c0 20 add_watcher() i=0 2024-09-14T11:21:56.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.694+0000 7f74a31359c0 20 add_watcher() i=1 2024-09-14T11:21:56.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.694+0000 7f74a31359c0 20 add_watcher() i=2 2024-09-14T11:21:56.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.694+0000 7f74a31359c0 20 add_watcher() i=3 2024-09-14T11:21:56.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.694+0000 7f74a31359c0 20 add_watcher() i=4 2024-09-14T11:21:56.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.694+0000 7f74a31359c0 20 add_watcher() i=5 2024-09-14T11:21:56.694 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.694+0000 7f74a31359c0 20 add_watcher() i=6 2024-09-14T11:21:56.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.698+0000 7f74a31359c0 20 add_watcher() i=7 2024-09-14T11:21:56.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.698+0000 7f74a31359c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:56.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f7356fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:56.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:56.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:56.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 5 note: GC not initialized 2024-09-14T11:21:56.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f7355fe3640 20 reqs_thread_entry: start 2024-09-14T11:21:56.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:56.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 Filter name: none 2024-09-14T11:21:56.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f72c77fe640 20 reqs_thread_entry: start 2024-09-14T11:21:56.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:56.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:21:56.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:56.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.702+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.706+0000 7f74a31359c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:56.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.706+0000 7f74a31359c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.706+0000 7f74a31359c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:21:56.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.706+0000 7f74a31359c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:56.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.710+0000 7f7356fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:56.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.714+0000 7f74a31359c0 20 remove_watcher() i=0 2024-09-14T11:21:56.711 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.714+0000 7f74a31359c0 2 removed watcher, disabling cache 2024-09-14T11:21:56.712 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.714+0000 7f74a31359c0 20 remove_watcher() i=1 2024-09-14T11:21:56.714 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.714+0000 7f74a31359c0 20 remove_watcher() i=2 2024-09-14T11:21:56.717 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.718+0000 7f74a31359c0 20 remove_watcher() i=3 2024-09-14T11:21:56.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.722+0000 7f74a31359c0 20 remove_watcher() i=4 2024-09-14T11:21:56.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.722+0000 7f74a31359c0 20 remove_watcher() i=5 2024-09-14T11:21:56.723 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.726+0000 7f74a31359c0 20 remove_watcher() i=6 2024-09-14T11:21:56.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:56.726+0000 7f74a31359c0 20 remove_watcher() i=7 2024-09-14T11:21:56.741 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:21:56.742 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:21:56.937 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:21:56.969 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:56.969 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:57.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.014+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 realm 2024-09-14T11:21:57.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:57.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:57.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.018+0000 7fdb0aca79c0 20 searching for the correct realm 2024-09-14T11:21:57.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.026+0000 7fdb07fac640 0 -- 172.21.15.148:0/3059809095 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x559786a65bf0 msgr2=0x559786a67fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:57.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.030+0000 7fdb087ad640 0 -- 172.21.15.148:0/3059809095 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fdb00043e80 msgr2=0x7fdb0005b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:57.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:57.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:57.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:57.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:57.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:57.035 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:57.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.036 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 zone default found 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 4 Realm: () 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 zonegroup default 2024-09-14T11:21:57.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 started sync module instance, tier type = 2024-09-14T11:21:57.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.038+0000 7fdb0aca79c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:57.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 20 add_watcher() i=0 2024-09-14T11:21:57.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 20 add_watcher() i=1 2024-09-14T11:21:57.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 20 add_watcher() i=2 2024-09-14T11:21:57.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 20 add_watcher() i=3 2024-09-14T11:21:57.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 20 add_watcher() i=4 2024-09-14T11:21:57.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 20 add_watcher() i=5 2024-09-14T11:21:57.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 20 add_watcher() i=6 2024-09-14T11:21:57.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 20 add_watcher() i=7 2024-09-14T11:21:57.058 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.058+0000 7fdb0aca79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:57.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.062+0000 7fd9befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.062+0000 7fdb0aca79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:57.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.062+0000 7fdb0aca79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:57.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.062+0000 7fdb0aca79c0 5 note: GC not initialized 2024-09-14T11:21:57.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.062+0000 7fd9bdfdb640 20 reqs_thread_entry: start 2024-09-14T11:21:57.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.062+0000 7fdb0aca79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:57.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 Filter name: none 2024-09-14T11:21:57.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fd92f7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:57.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:57.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:57.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:57.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:57.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:57.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:57.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:57.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:57.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.066+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:57.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:57.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:57.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:57.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:57.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:57.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:57.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:57.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:57.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:57.069 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:57.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:57.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:57.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:57.070 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.070+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:57.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.074+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:57.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.074+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:57.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.074+0000 7fdb0aca79c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:57.071 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.074+0000 7fdb0aca79c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:57.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.074+0000 7fd9befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.078+0000 7fdb0aca79c0 20 remove_watcher() i=0 2024-09-14T11:21:57.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.078+0000 7fdb0aca79c0 2 removed watcher, disabling cache 2024-09-14T11:21:57.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.082+0000 7fdb0aca79c0 20 remove_watcher() i=1 2024-09-14T11:21:57.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.082+0000 7fdb0aca79c0 20 remove_watcher() i=2 2024-09-14T11:21:57.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.086+0000 7fdb0aca79c0 20 remove_watcher() i=3 2024-09-14T11:21:57.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.086+0000 7fdb0aca79c0 20 remove_watcher() i=4 2024-09-14T11:21:57.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.086+0000 7fdb0aca79c0 20 remove_watcher() i=5 2024-09-14T11:21:57.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.090+0000 7fdb0aca79c0 20 remove_watcher() i=6 2024-09-14T11:21:57.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.094+0000 7fdb0aca79c0 20 remove_watcher() i=7 2024-09-14T11:21:57.107 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:21:57.134 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:57.134 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:57.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.178+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 realm 2024-09-14T11:21:57.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:57.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:57.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.182+0000 7fc5f5b319c0 20 searching for the correct realm 2024-09-14T11:21:57.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.186+0000 7fc5f3637640 0 -- 172.21.15.148:0/2029860102 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fc5e401d040 msgr2=0x7fc5e400f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:57.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.398+0000 7fc5f3637640 0 -- 172.21.15.148:0/2029860102 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x55a9c28c9270 msgr2=0x7fc5ec070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:57.615 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:57.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 zone default found 2024-09-14T11:21:57.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 4 Realm: () 2024-09-14T11:21:57.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:57.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:57.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:57.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 zonegroup default 2024-09-14T11:21:57.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.618+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.622+0000 7fc5f5b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.619 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.622+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.622+0000 7fc5f5b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.622+0000 7fc5f5b319c0 20 started sync module instance, tier type = 2024-09-14T11:21:57.620 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.622+0000 7fc5f5b319c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:57.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 20 add_watcher() i=0 2024-09-14T11:21:57.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 20 add_watcher() i=1 2024-09-14T11:21:57.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 20 add_watcher() i=2 2024-09-14T11:21:57.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 20 add_watcher() i=3 2024-09-14T11:21:57.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 20 add_watcher() i=4 2024-09-14T11:21:57.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 20 add_watcher() i=5 2024-09-14T11:21:57.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 20 add_watcher() i=6 2024-09-14T11:21:57.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 20 add_watcher() i=7 2024-09-14T11:21:57.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.646+0000 7fc5f5b319c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:57.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc4a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc5f5b319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:57.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc5f5b319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:57.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc5f5b319c0 5 note: GC not initialized 2024-09-14T11:21:57.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc4a8fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:57.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc5f5b319c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:57.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc5f5b319c0 20 Filter name: none 2024-09-14T11:21:57.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc4227fc640 20 reqs_thread_entry: start 2024-09-14T11:21:57.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc5f5b319c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:57.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.654+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.658+0000 7fc5f5b319c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:57.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.658+0000 7fc5f5b319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:57.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.658+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.658+0000 7fc5f5b319c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:57.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.658+0000 7fc5f5b319c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.658+0000 7fc5f5b319c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:57.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.658+0000 7fc5f5b319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:57.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.662+0000 7fc4a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.666+0000 7fc5f5b319c0 20 remove_watcher() i=0 2024-09-14T11:21:57.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.666+0000 7fc5f5b319c0 2 removed watcher, disabling cache 2024-09-14T11:21:57.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.666+0000 7fc5f5b319c0 20 remove_watcher() i=1 2024-09-14T11:21:57.668 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.670+0000 7fc5f5b319c0 20 remove_watcher() i=2 2024-09-14T11:21:57.670 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.670+0000 7fc5f5b319c0 20 remove_watcher() i=3 2024-09-14T11:21:57.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.674+0000 7fc5f5b319c0 20 remove_watcher() i=4 2024-09-14T11:21:57.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.678+0000 7fc5f5b319c0 20 remove_watcher() i=5 2024-09-14T11:21:57.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.678+0000 7fc5f5b319c0 20 remove_watcher() i=6 2024-09-14T11:21:57.681 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.682+0000 7fc5f5b319c0 20 remove_watcher() i=7 2024-09-14T11:21:57.696 INFO:tasks.workunit.client.0.smithi148.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:21:57.697 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:21:57.729 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:57.729 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:57.773 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.774+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 realm 2024-09-14T11:21:57.775 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:57.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.777 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:57.778 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.778+0000 7f810948e9c0 20 searching for the correct realm 2024-09-14T11:21:57.783 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.786+0000 7f8106793640 0 -- 172.21.15.148:0/3498702230 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f8100109fe0 msgr2=0x7f81001099b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:57.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.790+0000 7f8106793640 0 -- 172.21.15.148:0/3498702230 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55aaa22a9430 msgr2=0x55aaa22ab820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:57.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:57.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:57.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:57.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:57.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:57.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:57.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:57.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 zone default found 2024-09-14T11:21:57.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 4 Realm: () 2024-09-14T11:21:57.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:57.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:57.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:57.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 zonegroup default 2024-09-14T11:21:57.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.798+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.802+0000 7f810948e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.802+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.802+0000 7f810948e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.802+0000 7f810948e9c0 20 started sync module instance, tier type = 2024-09-14T11:21:57.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.802+0000 7f810948e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:57.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.818+0000 7f810948e9c0 20 add_watcher() i=0 2024-09-14T11:21:57.817 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.818+0000 7f810948e9c0 20 add_watcher() i=1 2024-09-14T11:21:57.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.818+0000 7f810948e9c0 20 add_watcher() i=2 2024-09-14T11:21:57.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.818+0000 7f810948e9c0 20 add_watcher() i=3 2024-09-14T11:21:57.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.818+0000 7f810948e9c0 20 add_watcher() i=4 2024-09-14T11:21:57.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.818+0000 7f810948e9c0 20 add_watcher() i=5 2024-09-14T11:21:57.818 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.818+0000 7f810948e9c0 20 add_watcher() i=6 2024-09-14T11:21:57.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.822+0000 7f810948e9c0 20 add_watcher() i=7 2024-09-14T11:21:57.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.822+0000 7f810948e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:57.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f7fbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:57.824 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:57.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 5 note: GC not initialized 2024-09-14T11:21:57.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f7f37fff640 20 reqs_thread_entry: start 2024-09-14T11:21:57.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:57.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 Filter name: none 2024-09-14T11:21:57.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f7f35ffb640 20 reqs_thread_entry: start 2024-09-14T11:21:57.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:57.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:57.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:57.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:57.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.826+0000 7f810948e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.830+0000 7f810948e9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:57.827 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.830+0000 7f810948e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:57.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.830+0000 7f7fbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.834+0000 7f810948e9c0 20 remove_watcher() i=0 2024-09-14T11:21:57.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.834+0000 7f810948e9c0 2 removed watcher, disabling cache 2024-09-14T11:21:57.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.838+0000 7f810948e9c0 20 remove_watcher() i=1 2024-09-14T11:21:57.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.838+0000 7f810948e9c0 20 remove_watcher() i=2 2024-09-14T11:21:57.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.842+0000 7f810948e9c0 20 remove_watcher() i=3 2024-09-14T11:21:57.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.842+0000 7f810948e9c0 20 remove_watcher() i=4 2024-09-14T11:21:57.844 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.846+0000 7f810948e9c0 20 remove_watcher() i=5 2024-09-14T11:21:57.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.850+0000 7f810948e9c0 20 remove_watcher() i=6 2024-09-14T11:21:57.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.850+0000 7f810948e9c0 20 remove_watcher() i=7 2024-09-14T11:21:57.863 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:57.863 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:21:57.863 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: a-bucket id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:21:57.864 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:57.864 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:21:57.896 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:57.896 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:57.939 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 20 realm 2024-09-14T11:21:57.941 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:57.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.942 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.943 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:57.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.946+0000 7fd208b809c0 20 searching for the correct realm 2024-09-14T11:21:57.950 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.950+0000 7fd205e85640 0 -- 172.21.15.148:0/982615114 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x562943387140 msgr2=0x562943389530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:57.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.958+0000 7fd206686640 0 -- 172.21.15.148:0/982615114 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fd2000d7410 msgr2=0x7fd2000d7890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:57.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:57.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:57.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:57.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:57.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:57.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:57.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:57.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 zone default found 2024-09-14T11:21:57.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 4 Realm: () 2024-09-14T11:21:57.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:57.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:57.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:57.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 zonegroup default 2024-09-14T11:21:57.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.970+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.970+0000 7fd208b809c0 20 started sync module instance, tier type = 2024-09-14T11:21:57.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.970+0000 7fd208b809c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:57.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=0 2024-09-14T11:21:57.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=1 2024-09-14T11:21:57.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=2 2024-09-14T11:21:57.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=3 2024-09-14T11:21:57.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=4 2024-09-14T11:21:57.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=5 2024-09-14T11:21:57.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=6 2024-09-14T11:21:57.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.990+0000 7fd208b809c0 20 add_watcher() i=7 2024-09-14T11:21:57.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.990+0000 7fd208b809c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:57.992 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd0bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:57.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:57.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 5 note: GC not initialized 2024-09-14T11:21:57.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd0377fe640 20 reqs_thread_entry: start 2024-09-14T11:21:57.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:57.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 20 Filter name: none 2024-09-14T11:21:57.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd0357fa640 20 reqs_thread_entry: start 2024-09-14T11:21:57.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:57.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:57.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:57.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:57.994 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:57.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.998+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:57.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.998+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:57.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.998+0000 7fd208b809c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:57.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.998+0000 7fd208b809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:57.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.998+0000 7fd208b809c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:57.995 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:57.998+0000 7fd208b809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:58.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.006+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.006+0000 7fd208b809c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.006+0000 7fd208b809c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.006 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.006+0000 7fd208b809c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:21:58.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94735221426384 notifier 7790 bl.length()=911 2024-09-14T11:21:58.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:21:58.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:21:58.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:21:58.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:21:58.021 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd208b809c0 time 2024-09-14T11:21:58.028002+0000 2024-09-14T11:21:58.021 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:58.022 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:58.022 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd20c45a2eb] 2024-09-14T11:21:58.022 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd20c45a49f] 2024-09-14T11:21:58.022 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562940b9ac01] 2024-09-14T11:21:58.022 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562940baff3a] 2024-09-14T11:21:58.022 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:21:58.022 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd20b2c0d90] 2024-09-14T11:21:58.022 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.022+0000 7fd208b809c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd208b809c0 time 2024-09-14T11:21:58.028002+0000 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd20c45a2eb] 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd20c45a49f] 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562940b9ac01] 2024-09-14T11:21:58.023 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562940baff3a] 2024-09-14T11:21:58.024 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:21:58.024 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd20b2c0d90] 2024-09-14T11:21:58.024 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:21:58.024 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:21:58.024 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.024 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:21:58.024 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fd208b809c0 thread_name:radosgw-admin 2024-09-14T11:21:58.039 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:58.039 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd20b2d9520] 2024-09-14T11:21:58.039 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:21:58.039 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd20c45a345] 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd20c45a49f] 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562940b9ac01] 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562940baff3a] 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd20b2c0d90] 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.026+0000 7fd208b809c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fd208b809c0 thread_name:radosgw-admin 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.040 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd20b2d9520] 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd20c45a345] 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd20c45a49f] 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562940b9ac01] 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562940baff3a] 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd20b2c0d90] 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:21:58.041 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:58.042 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.042 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:21:58.043 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:21:57.918+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.043 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:21:57.918+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.043 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:21:57.918+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.043 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:21:57.918+0000 7fd206e87640 10 monclient(hunting): handle_auth_done global_id 7778 payload 274 2024-09-14T11:21:58.043 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:21:57.918+0000 7fd206e87640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:21:57.918+0000 7fd206e87640 1 monclient: found mon.noname-c 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:21:57.918+0000 7fd206e87640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: dump: 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.044 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:21:57.918+0000 7fd208b809c0 5 monclient: authenticate success, global_id 7778 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:21:57.918+0000 7fd208b809c0 10 monclient: get_monmap_and_config success 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:21:57.918+0000 7fd208b809c0 4 set_mon_vals no callback set 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: dump: 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.045 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: shutdown 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 asok(0x562943088d90) unregister_commands rotate-key 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: build_initial_monmap 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: monmap: 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:58.046 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding auth protocol: cephx 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding auth protocol: cephx 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding auth protocol: cephx 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.047 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:21:57.922+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: starting msgr at 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: starting objecter 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 asok(0x562943088d90) register_command objecter_requests hook 0x5629432c4520 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: setting wanted keys 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: calling monclient init 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: init 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding auth protocol: cephx 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding auth protocol: cephx 2024-09-14T11:21:58.048 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding auth protocol: cephx 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:21:57.922+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:21:57.922+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.049 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 asok(0x562943088d90) register_command rotate-key hook 0x562943295f88 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-a con 0x562943151890 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-c con 0x562943152cc0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-b con 0x5629431dc950 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): authenticate will time out at 2976.985986s 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): get_auth_request con 0x562943151890 auth_method 0 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.050 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): get_auth_request con 0x562943152cc0 auth_method 0 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): handle_auth_done global_id 8298 payload 824 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:21:57.922+0000 7fd206686640 1 monclient: found mon.noname-a 2024-09-14T11:21:58.051 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: dump: 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.052 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: dump: 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.053 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 monclient: authenticate success, global_id 8298 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:21:57.922+0000 7fd0f4608640 4 set_mon_vals no callback set 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: init done 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:21:57.926+0000 7fd0f2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:21:57.926+0000 7fd0f2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:21:57.926+0000 7fd0f2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:21:57.926+0000 7fd205e85640 10 monclient: get_auth_request con 0x7fd0ec0718a0 auth_method 0 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:21:57.926+0000 7fd206e87640 10 monclient: get_auth_request con 0x5629432bd9b0 auth_method 0 2024-09-14T11:21:58.054 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:21:57.926+0000 7fd206686640 10 monclient: get_auth_request con 0x5629432e09f0 auth_method 0 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:21:57.926+0000 7fd205e85640 10 monclient: get_auth_request con 0x5629432e4f20 auth_method 0 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: build_initial_monmap 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:21:57.930+0000 7fd208b809c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: monmap: 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:58.055 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding auth protocol: cephx 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding auth protocol: cephx 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding auth protocol: cephx 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.056 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:21:57.930+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 asok(0x562943088d90) register_command objecter_requests cmddesc objecter_requests hook 0x5629432ed810 EEXIST 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: init 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding auth protocol: cephx 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding auth protocol: cephx 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding auth protocol: cephx 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.057 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:21:57.930+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:21:57.930+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 asok(0x562943088d90) register_command rotate-key cmddesc rotate-key hook 0x5629432e8600 EEXIST 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-b con 0x5629433119c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-a con 0x5629433112f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-c con 0x56294330fcd0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.058 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): authenticate will time out at 2976.995016s 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): get_auth_request con 0x5629433112f0 auth_method 0 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): get_auth_request con 0x56294330fcd0 auth_method 0 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.059 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:21:57.930+0000 7fd206686640 10 monclient(hunting): get_auth_request con 0x5629433119c0 auth_method 0 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:21:57.930+0000 7fd206686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:21:57.930+0000 7fd206686640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:21:57.930+0000 7fd206686640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): handle_auth_done global_id 8301 payload 824 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:21:57.930+0000 7fd205e85640 1 monclient: found mon.noname-a 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:58.060 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: dump: 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.061 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 monclient: authenticate success, global_id 8301 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: dump: 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.062 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:21:57.930+0000 7fd207688640 4 set_mon_vals no callback set 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:21:57.934+0000 7fd0ebfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:21:57.934+0000 7fd0ebfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:21:57.934+0000 7fd0ebfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient: get_auth_request con 0x7fd0e00717e0 auth_method 0 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: get_monmap_and_config 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: build_initial_monmap 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:21:57.934+0000 7fd208b809c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: monmap: 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:58.063 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding auth protocol: cephx 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding auth protocol: cephx 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding auth protocol: cephx 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.064 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:21:57.934+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: init 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding auth protocol: cephx 2024-09-14T11:21:58.065 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding auth protocol: cephx 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding auth protocol: cephx 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:21:57.934+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.066 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:21:57.934+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 asok(0x562943088d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc1322ce38 EEXIST 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-a con 0x56294335f910 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-c con 0x56294335fcf0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-b con 0x5629433611b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:58.067 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): authenticate will time out at 2976.999463s 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): get_auth_request con 0x56294335f910 auth_method 0 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): get_auth_request con 0x56294335fcf0 auth_method 0 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.068 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): handle_auth_done global_id 8304 payload 274 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:21:57.934+0000 7fd206686640 1 monclient: found mon.noname-a 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: dump: 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.069 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: dump: 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.070 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 monclient: authenticate success, global_id 8304 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: get_monmap_and_config success 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:21:57.938+0000 7fd208b809c0 4 set_mon_vals no callback set 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: shutdown 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: build_initial_monmap 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: monmap: 2024-09-14T11:21:58.071 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding auth protocol: cephx 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding auth protocol: cephx 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding auth protocol: cephx 2024-09-14T11:21:58.072 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:21:57.938+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: starting msgr at 2024-09-14T11:21:58.073 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: starting objecter 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 asok(0x562943088d90) register_command objecter_requests cmddesc objecter_requests hook 0x562943335b70 EEXIST 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: setting wanted keys 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: calling monclient init 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: init 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding auth protocol: cephx 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding auth protocol: cephx 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding auth protocol: cephx 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.074 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:21:57.938+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:21:57.938+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 asok(0x562943088d90) register_command rotate-key cmddesc rotate-key hook 0x562943313928 EEXIST 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-c con 0x56294335f910 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-a con 0x5629433611b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:58.075 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-b con 0x56294335d0e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): authenticate will time out at 2977.002062s 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): get_auth_request con 0x56294335f910 auth_method 0 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): get_auth_request con 0x5629433611b0 auth_method 0 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.076 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.077 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.077 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:21:57.938+0000 7fd206686640 1 monclient: found mon.noname-c 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: dump: 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.078 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: dump: 2024-09-14T11:21:58.079 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 monclient: authenticate success, global_id 7790 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 4 set_mon_vals no callback set 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.080 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: init done 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cr dump hook 0x562943357a58 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:21:57.942+0000 7fd0d7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:21:57.942+0000 7fd0d7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:21:57.942+0000 7fd0d7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:21:57.942+0000 7fd205e85640 10 monclient: get_auth_request con 0x7fd0d00718a0 auth_method 0 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:21:57.942+0000 7fd206e87640 10 monclient: get_auth_request con 0x56294337f650 auth_method 0 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 realm 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.081 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:21:57.942+0000 7fd208b809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:21:57.942+0000 7fd206686640 10 monclient: get_auth_request con 0x562943383900 auth_method 0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:21:57.946+0000 7fd205e85640 10 monclient: get_auth_request con 0x562943387140 auth_method 0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:21:57.946+0000 7fd208b809c0 20 searching for the correct realm 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:21:57.946+0000 7fd206e87640 10 monclient: get_auth_request con 0x56294338bee0 auth_method 0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:21:57.950+0000 7fd206686640 10 monclient: get_auth_request con 0x7fd1f806f070 auth_method 0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:21:57.950+0000 7fd205e85640 10 monclient: get_auth_request con 0x7fd2000c0040 auth_method 0 2024-09-14T11:21:58.082 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:21:57.950+0000 7fd205e85640 0 -- 172.21.15.148:0/982615114 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x562943387140 msgr2=0x562943389530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:21:57.950+0000 7fd0d7fff640 1 client.7790.objecter ms_handle_reset 0x562943387140 session 0x562943382c90 osd.2 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:21:57.950+0000 7fd0d7fff640 10 monclient: _renew_subs 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:21:57.950+0000 7fd0d7fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:21:57.950+0000 7fd205e85640 10 monclient: get_auth_request con 0x7fd0d0081b40 auth_method 0 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:21:57.954+0000 7fd206e87640 10 monclient: get_auth_request con 0x7fd1f800e070 auth_method 0 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:21:57.954+0000 7fd206686640 10 monclient: get_auth_request con 0x7fd2000d7410 auth_method 0 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:21:57.958+0000 7fd206686640 0 -- 172.21.15.148:0/982615114 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fd2000d7410 msgr2=0x7fd2000d7890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:21:57.958+0000 7fd0d7fff640 1 client.7790.objecter ms_handle_reset 0x7fd2000d7410 session 0x7fd2000a6070 osd.3 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:21:57.958+0000 7fd206686640 10 monclient: get_auth_request con 0x562943387140 auth_method 0 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:58.083 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 zone default found 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:21:57.966+0000 7fd208b809c0 4 Realm: () 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:21:57.966+0000 7fd208b809c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:21:57.966+0000 7fd208b809c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:21:57.966+0000 7fd208b809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:58.084 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 zonegroup default 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:21:57.970+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:21:57.970+0000 7fd208b809c0 20 started sync module instance, tier type = 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:21:57.970+0000 7fd208b809c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=0 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=1 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=2 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=3 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=4 2024-09-14T11:21:58.085 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=5 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=6 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:21:57.990+0000 7fd208b809c0 20 add_watcher() i=7 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:21:57.990+0000 7fd208b809c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding auth protocol: cephx 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding auth protocol: cephx 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding auth protocol: cephx 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.086 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:21:57.994+0000 7fd0bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:21:57.994+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cache list hook 0x56294335f1f0 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cache inspect hook 0x56294335f1f0 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cache erase hook 0x56294335f1f0 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cache zap hook 0x56294335f1f0 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 note: GC not initialized 2024-09-14T11:21:58.087 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:21:57.994+0000 7fd0377fe640 20 reqs_thread_entry: start 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command sync trace show hook 0x7fd1fc0045c0 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command sync trace history hook 0x7fd1fc0045c0 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command sync trace active hook 0x7fd1fc0045c0 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command sync trace active_short hook 0x7fd1fc0045c0 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 Filter name: none 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:21:57.994+0000 7fd0357fa640 20 reqs_thread_entry: start 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:21:57.994+0000 7fd208b809c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:58.088 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:21:57.998+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:21:58.006+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:21:58.006+0000 7fd208b809c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:21:58.006+0000 7fd208b809c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:21:58.006+0000 7fd208b809c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94735221426384 notifier 7790 bl.length()=911 2024-09-14T11:21:58.089 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:21:58.022+0000 7fd208b809c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd208b809c0 time 2024-09-14T11:21:58.028002+0000 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd20c45a2eb] 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd20c45a49f] 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562940b9ac01] 2024-09-14T11:21:58.090 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562940baff3a] 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd20b2c0d90] 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:21:58.026+0000 7fd208b809c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fd208b809c0 thread_name:radosgw-admin 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd20b2d9520] 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:21:58.091 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd20c45a345] 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd20c45a49f] 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562940b9ac01] 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562940baff3a] 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd20b2c0d90] 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:21:58.092 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:21:58.093 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:21:58.094 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:21:58.095 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:21:58.096 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:21:58.097 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:21:58.098 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0357fa640 / http_manager 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0377fe640 / http_manager 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0bcfe1640 / rgw_dt_lg_renew 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0d7fff640 / ms_dispatch 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0e9ffb640 / io_context_pool 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0ebfff640 / ms_dispatch 2024-09-14T11:21:58.099 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0f2e05640 / ms_dispatch 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0f4608640 / io_context_pool 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd205e85640 / msgr-worker-2 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd206686640 / msgr-worker-1 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd206e87640 / msgr-worker-0 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd207688640 / io_context_pool 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd208b809c0 / radosgw-admin 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.144663.log 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:21:57.918+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:21:57.918+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.100 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:21:57.918+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:21:57.918+0000 7fd206e87640 10 monclient(hunting): handle_auth_done global_id 7778 payload 274 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:21:57.918+0000 7fd206e87640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:21:57.918+0000 7fd206e87640 1 monclient: found mon.noname-c 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:21:57.918+0000 7fd206e87640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: dump: 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.101 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:21:57.918+0000 7fd208b809c0 5 monclient: authenticate success, global_id 7778 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:21:57.918+0000 7fd208b809c0 10 monclient: get_monmap_and_config success 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:21:57.918+0000 7fd208b809c0 4 set_mon_vals no callback set 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:58.102 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:21:57.918+0000 7fd0f4608640 10 monclient: dump: 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: shutdown 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 asok(0x562943088d90) unregister_commands rotate-key 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: build_initial_monmap 2024-09-14T11:21:58.103 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: monmap: 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding auth protocol: cephx 2024-09-14T11:21:58.104 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding auth protocol: cephx 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding auth protocol: cephx 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: crc 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x56294329c480) adding con mode: secure 2024-09-14T11:21:58.105 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:21:57.922+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: starting msgr at 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: starting objecter 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 asok(0x562943088d90) register_command objecter_requests hook 0x5629432c4520 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: setting wanted keys 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: calling monclient init 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: init 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding auth protocol: cephx 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding auth protocol: cephx 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding auth protocol: cephx 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.106 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: crc 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 AuthRegistry(0x562943295e40) adding con mode: secure 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:21:57.922+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:21:57.922+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 asok(0x562943088d90) register_command rotate-key hook 0x562943295f88 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:58.107 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-a con 0x562943151890 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-c con 0x562943152cc0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-b con 0x5629431dc950 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient(hunting): authenticate will time out at 2976.985986s 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): get_auth_request con 0x562943151890 auth_method 0 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.108 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): get_auth_request con 0x562943152cc0 auth_method 0 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:21:57.922+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient(hunting): handle_auth_done global_id 8298 payload 824 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:21:57.922+0000 7fd206686640 1 monclient: found mon.noname-a 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:21:57.922+0000 7fd206686640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.109 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: dump: 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.110 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:21:57.922+0000 7fd0f2e05640 10 monclient: dump: 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.111 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:21:57.922+0000 7fd208b809c0 5 monclient: authenticate success, global_id 8298 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:21:57.922+0000 7fd0f4608640 4 set_mon_vals no callback set 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:21:57.922+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:21:57.922+0000 7fd208b809c0 1 librados: init done 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:21:57.926+0000 7fd0f2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:21:57.926+0000 7fd0f2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:21:57.926+0000 7fd0f2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.112 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:21:57.926+0000 7fd205e85640 10 monclient: get_auth_request con 0x7fd0ec0718a0 auth_method 0 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:21:57.926+0000 7fd206e87640 10 monclient: get_auth_request con 0x5629432bd9b0 auth_method 0 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:21:57.926+0000 7fd206686640 10 monclient: get_auth_request con 0x5629432e09f0 auth_method 0 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:21:57.926+0000 7fd205e85640 10 monclient: get_auth_request con 0x5629432e4f20 auth_method 0 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: build_initial_monmap 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:21:57.930+0000 7fd208b809c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: monmap: 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:58.113 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding auth protocol: cephx 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding auth protocol: cephx 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding auth protocol: cephx 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.114 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: crc 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e9de0) adding con mode: secure 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:21:57.930+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 asok(0x562943088d90) register_command objecter_requests cmddesc objecter_requests hook 0x5629432ed810 EEXIST 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: init 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding auth protocol: cephx 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding auth protocol: cephx 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding auth protocol: cephx 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.115 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: crc 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 AuthRegistry(0x5629432e84b8) adding con mode: secure 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:21:57.930+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:21:57.930+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 asok(0x562943088d90) register_command rotate-key cmddesc rotate-key hook 0x5629432e8600 EEXIST 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:21:58.116 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-b con 0x5629433119c0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-a con 0x5629433112f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-c con 0x56294330fcd0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient(hunting): authenticate will time out at 2976.995016s 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): get_auth_request con 0x5629433112f0 auth_method 0 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): get_auth_request con 0x56294330fcd0 auth_method 0 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.117 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:21:57.930+0000 7fd206e87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:21:57.930+0000 7fd206686640 10 monclient(hunting): get_auth_request con 0x5629433119c0 auth_method 0 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:21:57.930+0000 7fd206686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:21:57.930+0000 7fd206686640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:21:57.930+0000 7fd206686640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient(hunting): handle_auth_done global_id 8301 payload 824 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.118 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:21:57.930+0000 7fd205e85640 1 monclient: found mon.noname-a 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:21:57.930+0000 7fd205e85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: dump: 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.119 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:21:57.930+0000 7fd208b809c0 5 monclient: authenticate success, global_id 8301 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:21:57.930+0000 7fd0ebfff640 10 monclient: dump: 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.120 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:21:57.930+0000 7fd207688640 4 set_mon_vals no callback set 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:21:57.930+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:21:57.934+0000 7fd0ebfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:21:57.934+0000 7fd0ebfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:21:57.934+0000 7fd0ebfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient: get_auth_request con 0x7fd0e00717e0 auth_method 0 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: get_monmap_and_config 2024-09-14T11:21:58.121 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: build_initial_monmap 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:21:57.934+0000 7fd208b809c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: monmap: 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding auth protocol: cephx 2024-09-14T11:21:58.122 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding auth protocol: cephx 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding auth protocol: cephx 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: crc 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x562943331320) adding con mode: secure 2024-09-14T11:21:58.123 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:21:57.934+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: init 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding auth protocol: cephx 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding auth protocol: cephx 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding auth protocol: cephx 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.124 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: crc 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322ccf0) adding con mode: secure 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:21:57.934+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:21:57.934+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:21:57.934+0000 7fd208b809c0 5 asok(0x562943088d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc1322ce38 EEXIST 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-a con 0x56294335f910 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-c con 0x56294335fcf0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-b con 0x5629433611b0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.125 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:21:57.934+0000 7fd208b809c0 10 monclient(hunting): authenticate will time out at 2976.999463s 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): get_auth_request con 0x56294335f910 auth_method 0 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): get_auth_request con 0x56294335fcf0 auth_method 0 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.126 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:21:57.934+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient(hunting): handle_auth_done global_id 8304 payload 274 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:21:57.934+0000 7fd206686640 1 monclient: found mon.noname-a 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:21:57.934+0000 7fd206686640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: dump: 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.127 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 10 monclient: dump: 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.128 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 monclient: authenticate success, global_id 8304 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: get_monmap_and_config success 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:21:57.938+0000 7fd208b809c0 4 set_mon_vals no callback set 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: shutdown 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: build_initial_monmap 2024-09-14T11:21:58.129 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 build_initial for_mkfs: 0 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: monmap: 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding auth protocol: cephx 2024-09-14T11:21:58.130 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding auth protocol: cephx 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding auth protocol: cephx 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: crc 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x562943357e40) adding con mode: secure 2024-09-14T11:21:58.131 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:21:57.938+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: starting msgr at 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: starting objecter 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 asok(0x562943088d90) register_command objecter_requests cmddesc objecter_requests hook 0x562943335b70 EEXIST 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: setting wanted keys 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: calling monclient init 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: init 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding auth protocol: cephx 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding auth protocol: cephx 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding auth protocol: cephx 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.132 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: crc 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 AuthRegistry(0x5629433137e0) adding con mode: secure 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:21:57.938+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:21:57.938+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 asok(0x562943088d90) register_command rotate-key cmddesc rotate-key hook 0x562943313928 EEXIST 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _reopen_session rank -1 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:21:58.133 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-c con 0x56294335f910 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-a con 0x5629433611b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): picked mon.noname-b con 0x56294335d0e0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): _renew_subs 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient(hunting): authenticate will time out at 2977.002062s 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): get_auth_request con 0x56294335f910 auth_method 0 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): get_auth_request con 0x5629433611b0 auth_method 0 2024-09-14T11:21:58.134 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:21:57.938+0000 7fd205e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient: _finish_hunting 0 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:21:57.938+0000 7fd206686640 1 monclient: found mon.noname-c 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:21:57.938+0000 7fd206686640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.135 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: dump: 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: _finish_auth 0 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:21:58.136 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:21:57.938+0000 7fd0d7fff640 10 monclient: dump: 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:21:58.137 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 monclient: authenticate success, global_id 7790 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:21:57.938+0000 7fd0e9ffb640 4 set_mon_vals no callback set 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _renew_subs 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:21:57.938+0000 7fd208b809c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:21:57.938+0000 7fd208b809c0 1 librados: init done 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:21:57.938+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cr dump hook 0x562943357a58 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:21:57.942+0000 7fd0d7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:21:57.942+0000 7fd0d7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:21:57.942+0000 7fd0d7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:21:57.942+0000 7fd205e85640 10 monclient: get_auth_request con 0x7fd0d00718a0 auth_method 0 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:21:57.942+0000 7fd206e87640 10 monclient: get_auth_request con 0x56294337f650 auth_method 0 2024-09-14T11:21:58.138 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 realm 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:21:57.942+0000 7fd208b809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:21:57.942+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:21:57.942+0000 7fd206686640 10 monclient: get_auth_request con 0x562943383900 auth_method 0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:21:57.946+0000 7fd205e85640 10 monclient: get_auth_request con 0x562943387140 auth_method 0 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:21:57.946+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:21:57.946+0000 7fd208b809c0 20 searching for the correct realm 2024-09-14T11:21:58.139 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:21:57.946+0000 7fd206e87640 10 monclient: get_auth_request con 0x56294338bee0 auth_method 0 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:21:57.950+0000 7fd206686640 10 monclient: get_auth_request con 0x7fd1f806f070 auth_method 0 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:21:57.950+0000 7fd205e85640 10 monclient: get_auth_request con 0x7fd2000c0040 auth_method 0 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:21:57.950+0000 7fd205e85640 0 -- 172.21.15.148:0/982615114 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x562943387140 msgr2=0x562943389530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:21:57.950+0000 7fd0d7fff640 1 client.7790.objecter ms_handle_reset 0x562943387140 session 0x562943382c90 osd.2 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:21:57.950+0000 7fd0d7fff640 10 monclient: _renew_subs 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:21:57.950+0000 7fd0d7fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:21:57.950+0000 7fd205e85640 10 monclient: get_auth_request con 0x7fd0d0081b40 auth_method 0 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:21:57.954+0000 7fd206e87640 10 monclient: get_auth_request con 0x7fd1f800e070 auth_method 0 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:21:57.954+0000 7fd206686640 10 monclient: get_auth_request con 0x7fd2000d7410 auth_method 0 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:21:57.958+0000 7fd206686640 0 -- 172.21.15.148:0/982615114 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fd2000d7410 msgr2=0x7fd2000d7890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:21:57.958+0000 7fd0d7fff640 1 client.7790.objecter ms_handle_reset 0x7fd2000d7410 session 0x7fd2000a6070 osd.3 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:21:57.958+0000 7fd206686640 10 monclient: get_auth_request con 0x562943387140 auth_method 0 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:58.140 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 zone default found 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:21:57.966+0000 7fd208b809c0 4 Realm: () 2024-09-14T11:21:58.141 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:21:57.966+0000 7fd208b809c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:21:57.966+0000 7fd208b809c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:21:57.966+0000 7fd208b809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 zonegroup default 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:21:57.966+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:21:57.970+0000 7fd208b809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:21:57.970+0000 7fd208b809c0 20 started sync module instance, tier type = 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:21:57.970+0000 7fd208b809c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=0 2024-09-14T11:21:58.142 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=1 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=2 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=3 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=4 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=5 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:21:57.986+0000 7fd208b809c0 20 add_watcher() i=6 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:21:57.990+0000 7fd208b809c0 20 add_watcher() i=7 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:21:57.990+0000 7fd208b809c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding auth protocol: cephx 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding auth protocol: cephx 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding auth protocol: cephx 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.143 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:21:57.994+0000 7fd0bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: crc 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 AuthRegistry(0x7ffc1322d1d0) adding con mode: secure 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:21:57.994+0000 7fd208b809c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cache list hook 0x56294335f1f0 2024-09-14T11:21:58.144 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cache inspect hook 0x56294335f1f0 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cache erase hook 0x56294335f1f0 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command cache zap hook 0x56294335f1f0 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 note: GC not initialized 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:21:57.994+0000 7fd0377fe640 20 reqs_thread_entry: start 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command sync trace show hook 0x7fd1fc0045c0 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command sync trace history hook 0x7fd1fc0045c0 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command sync trace active hook 0x7fd1fc0045c0 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:21:57.994+0000 7fd208b809c0 5 asok(0x562943088d90) register_command sync trace active_short hook 0x7fd1fc0045c0 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 Filter name: none 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:21:57.994+0000 7fd0357fa640 20 reqs_thread_entry: start 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.145 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:21:57.994+0000 7fd208b809c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:21:57.994+0000 7fd208b809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:21:57.994+0000 7fd208b809c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:21:57.998+0000 7fd208b809c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:21:57.998+0000 7fd208b809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:21:58.006+0000 7fd208b809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:21:58.006+0000 7fd208b809c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.146 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:21:58.006+0000 7fd208b809c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:21:58.006+0000 7fd208b809c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94735221426384 notifier 7790 bl.length()=911 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:21:58.010+0000 7fd0e9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:21:58.010+0000 7fd208b809c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:21:58.022+0000 7fd208b809c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd208b809c0 time 2024-09-14T11:21:58.028002+0000 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:58.147 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd20c45a2eb] 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd20c45a49f] 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562940b9ac01] 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562940baff3a] 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd20b2c0d90] 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:21:58.026+0000 7fd208b809c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fd208b809c0 thread_name:radosgw-admin 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd20b2d9520] 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:21:58.148 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd20c45a345] 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd20c45a49f] 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562940b9ac01] 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562940baff3a] 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd20b2c0d90] 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:21:58.149 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:21:58.150 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:21:58.151 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:21:58.152 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:21:58.153 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:21:58.154 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:21:58.155 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0357fa640 / http_manager 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0377fe640 / http_manager 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0bcfe1640 / rgw_dt_lg_renew 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0d7fff640 / ms_dispatch 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0e9ffb640 / io_context_pool 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0ebfff640 / ms_dispatch 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0f2e05640 / ms_dispatch 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd0f4608640 / io_context_pool 2024-09-14T11:21:58.156 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd205e85640 / msgr-worker-2 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd206686640 / msgr-worker-1 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd206e87640 / msgr-worker-0 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd207688640 / io_context_pool 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr: 7fd208b809c0 / radosgw-admin 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:21:58.030038Z_c520e4fe-0057-4f49-89c4-c69c2bd09f43/log 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:21:58.157 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:21:58.161 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:58.161 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:58.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.106+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.106+0000 7f2f0e1239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.106+0000 7f2f0e1239c0 20 realm 2024-09-14T11:21:58.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.106+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.106+0000 7f2f0e1239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.106+0000 7f2f0e1239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.106+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.110+0000 7f2f0e1239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.110+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.110+0000 7f2f0e1239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.110+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.110+0000 7f2f0e1239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.110+0000 7f2f0e1239c0 20 searching for the correct realm 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.114+0000 7f2f0b428640 0 -- 172.21.15.148:0/3793358593 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f2f04018050 msgr2=0x7f2f04033430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.122+0000 7f2f0bc29640 0 -- 172.21.15.148:0/3793358593 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f2f04033940 msgr2=0x7f2f04023430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:58.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 zone default found 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 4 Realm: () 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:58.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 zonegroup default 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 started sync module instance, tier type = 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.130+0000 7f2f0e1239c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.150+0000 7f2f0e1239c0 20 add_watcher() i=0 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.150+0000 7f2f0e1239c0 20 add_watcher() i=1 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.150+0000 7f2f0e1239c0 20 add_watcher() i=2 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.150+0000 7f2f0e1239c0 20 add_watcher() i=3 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.150+0000 7f2f0e1239c0 20 add_watcher() i=4 2024-09-14T11:21:58.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.150+0000 7f2f0e1239c0 20 add_watcher() i=5 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.150+0000 7f2f0e1239c0 20 add_watcher() i=6 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.154+0000 7f2f0e1239c0 20 add_watcher() i=7 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.154+0000 7f2f0e1239c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.154+0000 7f2dc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.154+0000 7f2f0e1239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.154+0000 7f2f0e1239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 5 note: GC not initialized 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2dc0fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 Filter name: none 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2d3a7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:21:58.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:58.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:58.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:21:58.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.158+0000 7f2f0e1239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:58.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.162+0000 7f2dc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:58.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.166+0000 7f2f0e1239c0 20 remove_watcher() i=0 2024-09-14T11:21:58.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.166+0000 7f2f0e1239c0 2 removed watcher, disabling cache 2024-09-14T11:21:58.167 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.170+0000 7f2f0e1239c0 20 remove_watcher() i=1 2024-09-14T11:21:58.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.170+0000 7f2f0e1239c0 20 remove_watcher() i=2 2024-09-14T11:21:58.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.170+0000 7f2f0e1239c0 20 remove_watcher() i=3 2024-09-14T11:21:58.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.174+0000 7f2f0e1239c0 20 remove_watcher() i=4 2024-09-14T11:21:58.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.174+0000 7f2f0e1239c0 20 remove_watcher() i=5 2024-09-14T11:21:58.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.178+0000 7f2f0e1239c0 20 remove_watcher() i=6 2024-09-14T11:21:58.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.182+0000 7f2f0e1239c0 20 remove_watcher() i=7 2024-09-14T11:21:58.195 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:21:58.195 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:21:58.240 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:21:58.267 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:58.267 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:58.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.310+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 realm 2024-09-14T11:21:58.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:58.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:58.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.314+0000 7f3b793749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:58.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.318+0000 7f3b793749c0 20 searching for the correct realm 2024-09-14T11:21:58.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.322+0000 7f3b76679640 0 -- 172.21.15.148:0/3252121129 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x561f427d33f0 msgr2=0x561f427d57e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:58.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.326+0000 7f3b76e7a640 0 -- 172.21.15.148:0/3252121129 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f3b70010040 msgr2=0x7f3b70069fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:58.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:58.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:21:58.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:58.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:58.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:58.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:21:58.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.334+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:58.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:58.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 zone default found 2024-09-14T11:21:58.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 4 Realm: () 2024-09-14T11:21:58.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:21:58.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:21:58.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:58.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 zonegroup default 2024-09-14T11:21:58.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:58.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 started sync module instance, tier type = 2024-09-14T11:21:58.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.338+0000 7f3b793749c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:21:58.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 20 add_watcher() i=0 2024-09-14T11:21:58.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 20 add_watcher() i=1 2024-09-14T11:21:58.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 20 add_watcher() i=2 2024-09-14T11:21:58.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 20 add_watcher() i=3 2024-09-14T11:21:58.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 20 add_watcher() i=4 2024-09-14T11:21:58.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 20 add_watcher() i=5 2024-09-14T11:21:58.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 20 add_watcher() i=6 2024-09-14T11:21:58.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 20 add_watcher() i=7 2024-09-14T11:21:58.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.358+0000 7f3b793749c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:58.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.362+0000 7f3a2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:58.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:58.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:58.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 5 note: GC not initialized 2024-09-14T11:21:58.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f39a7fff640 20 reqs_thread_entry: start 2024-09-14T11:21:58.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 init_complete bucket index max shards: 11 2024-09-14T11:21:58.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 Filter name: none 2024-09-14T11:21:58.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f39a5ffb640 20 reqs_thread_entry: start 2024-09-14T11:21:58.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:21:58.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:21:58.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:21:58.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:21:58.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:21:58.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 rados->read ofs=0 len=0 2024-09-14T11:21:58.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:58.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:21:58.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:58.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:21:58.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:58.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.366+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:21:58.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:58.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:21:58.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:58.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:21:58.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:58.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:21:58.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:58.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:21:58.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:58.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:21:58.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:58.370 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.370+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:21:58.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.374+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:58.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.374+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:21:58.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.374+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:58.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.374+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:21:58.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.374+0000 7f3b793749c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:58.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.374+0000 7f3b793749c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:21:58.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.374+0000 7f3a2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:58.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.378+0000 7f3b793749c0 20 remove_watcher() i=0 2024-09-14T11:21:58.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.378+0000 7f3b793749c0 2 removed watcher, disabling cache 2024-09-14T11:21:58.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.382+0000 7f3b793749c0 20 remove_watcher() i=1 2024-09-14T11:21:58.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.382+0000 7f3b793749c0 20 remove_watcher() i=2 2024-09-14T11:21:58.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.386+0000 7f3b793749c0 20 remove_watcher() i=3 2024-09-14T11:21:58.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.386+0000 7f3b793749c0 20 remove_watcher() i=4 2024-09-14T11:21:58.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.390+0000 7f3b793749c0 20 remove_watcher() i=5 2024-09-14T11:21:58.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.390+0000 7f3b793749c0 20 remove_watcher() i=6 2024-09-14T11:21:58.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:21:58.394+0000 7f3b793749c0 20 remove_watcher() i=7 2024-09-14T11:22:28.438 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:22:28.476 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:28.476 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:28.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 realm 2024-09-14T11:22:28.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:28.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.527 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:28.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:28.529 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 searching for the correct realm 2024-09-14T11:22:28.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.537+0000 7fc9abc93640 0 -- 172.21.15.148:0/838216799 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fc9a40b7040 msgr2=0x7fc9a40d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:28.541 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.541+0000 7fc9acc95640 0 -- 172.21.15.148:0/838216799 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55861e130fa0 msgr2=0x55861e133390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:28.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:28.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:28.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:28.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:28.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:28.550 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:28.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:28.551 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 zone default found 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 Realm: () 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 zonegroup default 2024-09-14T11:22:28.552 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.553 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 started sync module instance, tier type = 2024-09-14T11:22:28.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:28.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=0 2024-09-14T11:22:28.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=1 2024-09-14T11:22:28.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=2 2024-09-14T11:22:28.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=3 2024-09-14T11:22:28.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=4 2024-09-14T11:22:28.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=5 2024-09-14T11:22:28.573 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=6 2024-09-14T11:22:28.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 20 add_watcher() i=7 2024-09-14T11:22:28.575 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:28.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.577+0000 7fc862fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:28.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:28.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 note: GC not initialized 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc861fdb640 20 reqs_thread_entry: start 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 Filter name: none 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc7d37fe640 20 reqs_thread_entry: start 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:28.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:28.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:28.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:22:28.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:28.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:28.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:22:28.583 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.585+0000 7fc9ae98e9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:22:28.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:22:28.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94034518551072 notifier 7841 bl.length()=911 2024-09-14T11:22:28.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:22:28.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:22:28.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:22:28.604 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:22:28.612 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9ae98e9c0 time 2024-09-14T11:22:28.619295+0000 2024-09-14T11:22:28.612 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:28.613 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc9b22682eb] 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc9b226849f] 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55861c05dc01] 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x142325c) [0x55861cabc25c] 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55861c072ecd] 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc9b10ced90] 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc9ae98e9c0 thread_name:radosgw-admin 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.613+0000 7fc9ae98e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9ae98e9c0 time 2024-09-14T11:22:28.619295+0000 2024-09-14T11:22:28.614 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc9b22682eb] 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc9b226849f] 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55861c05dc01] 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x142325c) [0x55861cabc25c] 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55861c072ecd] 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc9b10ced90] 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:22:28.615 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.625 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:28.625 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc9b10e7520] 2024-09-14T11:22:28.625 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc9b2268345] 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc9b226849f] 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55861c05dc01] 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x142325c) [0x55861cabc25c] 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55861c072ecd] 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc9b10ced90] 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.617+0000 7fc9ae98e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:28.626 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc9ae98e9c0 thread_name:radosgw-admin 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc9b10e7520] 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc9b2268345] 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc9b226849f] 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55861c05dc01] 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x142325c) [0x55861cabc25c] 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55861c072ecd] 2024-09-14T11:22:28.627 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc9b10ced90] 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:22:28.501+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:22:28.501+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:22:28.501+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:22:28.501+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:22:28.501+0000 7fc9abc93640 10 monclient(hunting): handle_auth_done global_id 7829 payload 274 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:22:28.501+0000 7fc9abc93640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:22:28.501+0000 7fc9abc93640 1 monclient: found mon.noname-c 2024-09-14T11:22:28.628 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:22:28.501+0000 7fc9abc93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:22:28.501+0000 7fc89a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: dump: 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.629 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: dump: 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.630 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 7829 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 4 set_mon_vals no callback set 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: shutdown 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) unregister_commands rotate-key 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: build_initial_monmap 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: monmap: 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:28.631 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding auth protocol: cephx 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding auth protocol: cephx 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding auth protocol: cephx 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.632 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: starting msgr at 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: starting objecter 2024-09-14T11:22:28.633 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command objecter_requests hook 0x55861e04c8f0 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: setting wanted keys 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: calling monclient init 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: init 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding auth protocol: cephx 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding auth protocol: cephx 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding auth protocol: cephx 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.634 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command rotate-key hook 0x55861e047e28 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-b con 0x55861df01f50 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:28.635 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-c con 0x55861df944b0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-a con 0x55861df997d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): authenticate will time out at 3007.570202s 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): get_auth_request con 0x55861df944b0 auth_method 0 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.636 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): get_auth_request con 0x55861df997d0 auth_method 0 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): handle_auth_done global_id 7832 payload 824 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:22:28.505+0000 7fc9abc93640 1 monclient: found mon.noname-c 2024-09-14T11:22:28.637 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: dump: 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.638 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: dump: 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.639 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 7832 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:22:28.505+0000 7fc89a60c640 4 set_mon_vals no callback set 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: init done 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:22:28.509+0000 7fc898e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:22:28.509+0000 7fc898e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:22:28.509+0000 7fc898e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:22:28.509+0000 7fc9ac494640 10 monclient: get_auth_request con 0x7fc8940718d0 auth_method 0 2024-09-14T11:22:28.640 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:22:28.509+0000 7fc9acc95640 10 monclient: get_auth_request con 0x55861e0887d0 auth_method 0 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:22:28.509+0000 7fc9ac494640 10 monclient: get_auth_request con 0x55861e092960 auth_method 0 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient: get_auth_request con 0x55861e096b90 auth_method 0 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: build_initial_monmap 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: monmap: 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:28.641 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding auth protocol: cephx 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding auth protocol: cephx 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding auth protocol: cephx 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.642 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55861e09f3e0 EEXIST 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: init 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding auth protocol: cephx 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding auth protocol: cephx 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding auth protocol: cephx 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.643 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command rotate-key cmddesc rotate-key hook 0x55861e09a170 EEXIST 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-a con 0x55861e0c3590 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-c con 0x55861e0c2ec0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:28.644 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-b con 0x55861e0c18a0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): authenticate will time out at 3007.579630s 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): get_auth_request con 0x55861e0c3590 auth_method 0 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): get_auth_request con 0x55861e0c2ec0 auth_method 0 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.645 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:22:28.517+0000 7fc9ac494640 10 monclient(hunting): handle_auth_done global_id 8358 payload 824 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:22:28.517+0000 7fc9ac494640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:22:28.517+0000 7fc9ac494640 1 monclient: found mon.noname-a 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:22:28.517+0000 7fc9ac494640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:22:28.517+0000 7fc9acc95640 10 monclient: get_auth_request con 0x55861e0c18a0 auth_method 0 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: dump: 2024-09-14T11:22:28.646 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.647 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: dump: 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:22:28.517+0000 7fc9ad496640 4 set_mon_vals no callback set 2024-09-14T11:22:28.648 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 8358 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:22:28.517+0000 7fc891ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:22:28.517+0000 7fc891ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:22:28.517+0000 7fc891ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:22:28.517+0000 7fc9abc93640 10 monclient: get_auth_request con 0x7fc8840717e0 auth_method 0 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: get_monmap_and_config 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: build_initial_monmap 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: monmap: 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:28.649 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding auth protocol: cephx 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding auth protocol: cephx 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding auth protocol: cephx 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.650 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: init 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding auth protocol: cephx 2024-09-14T11:22:28.651 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding auth protocol: cephx 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding auth protocol: cephx 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.652 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command rotate-key cmddesc rotate-key hook 0x7fff4b55b5e8 EEXIST 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-c con 0x55861e111510 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-b con 0x55861e1118f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-a con 0x55861e112db0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): authenticate will time out at 3007.584328s 2024-09-14T11:22:28.653 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): get_auth_request con 0x55861e111510 auth_method 0 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): get_auth_request con 0x55861e112db0 auth_method 0 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.654 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_done global_id 7838 payload 274 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:22:28.521+0000 7fc9ac494640 1 monclient: found mon.noname-c 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: dump: 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.655 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 7838 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 4 set_mon_vals no callback set 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: dump: 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.656 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: shutdown 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: build_initial_monmap 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: monmap: 2024-09-14T11:22:28.657 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding auth protocol: cephx 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding auth protocol: cephx 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding auth protocol: cephx 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.658 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: starting msgr at 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: starting objecter 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55861e10a4e0 EEXIST 2024-09-14T11:22:28.659 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: setting wanted keys 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: calling monclient init 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: init 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding auth protocol: cephx 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding auth protocol: cephx 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding auth protocol: cephx 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.660 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command rotate-key cmddesc rotate-key hook 0x55861e0c54f8 EEXIST 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-c con 0x55861e111510 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-b con 0x55861e112db0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-a con 0x55861e10e100 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:28.661 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): authenticate will time out at 3007.587024s 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): get_auth_request con 0x55861e10e100 auth_method 0 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): get_auth_request con 0x55861e111510 auth_method 0 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.662 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:22:28.521+0000 7fc9ac494640 1 monclient: found mon.noname-c 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:22:28.521+0000 7fc9abc93640 10 monclient: get_auth_request con 0x55861e112db0 auth_method 0 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: dump: 2024-09-14T11:22:28.663 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.664 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: dump: 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 7841 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:22:28.521+0000 7fc8837fe640 4 set_mon_vals no callback set 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.665 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: init done 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cr dump hook 0x55861e110788 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:22:28.525+0000 7fc881ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:22:28.525+0000 7fc881ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:22:28.525+0000 7fc881ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:22:28.525+0000 7fc9abc93640 10 monclient: get_auth_request con 0x7fc8740718a0 auth_method 0 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:22:28.525+0000 7fc9acc95640 10 monclient: get_auth_request con 0x55861e130fa0 auth_method 0 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 realm 2024-09-14T11:22:28.666 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:22:28.529+0000 7fc9ac494640 10 monclient: get_auth_request con 0x55861e135120 auth_method 0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:22:28.529+0000 7fc9abc93640 10 monclient: get_auth_request con 0x55861e138980 auth_method 0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 searching for the correct realm 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:22:28.529+0000 7fc9acc95640 10 monclient: get_auth_request con 0x55861e13d740 auth_method 0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:22:28.533+0000 7fc9ac494640 10 monclient: get_auth_request con 0x7fc99c004320 auth_method 0 2024-09-14T11:22:28.667 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:22:28.533+0000 7fc9abc93640 10 monclient: get_auth_request con 0x7fc9a40b7040 auth_method 0 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:22:28.537+0000 7fc9abc93640 0 -- 172.21.15.148:0/838216799 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fc9a40b7040 msgr2=0x7fc9a40d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:22:28.537+0000 7fc881ffb640 1 client.7841.objecter ms_handle_reset 0x7fc9a40b7040 session 0x7fc9a40b99c0 osd.5 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:22:28.537+0000 7fc881ffb640 10 monclient: _renew_subs 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:22:28.537+0000 7fc881ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:22:28.537+0000 7fc9abc93640 10 monclient: get_auth_request con 0x7fc874081b40 auth_method 0 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:22:28.541+0000 7fc9acc95640 10 monclient: get_auth_request con 0x7fc99c08d040 auth_method 0 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:22:28.541+0000 7fc9ac494640 10 monclient: get_auth_request con 0x7fc9a40deb30 auth_method 0 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:22:28.541+0000 7fc9acc95640 0 -- 172.21.15.148:0/838216799 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55861e130fa0 msgr2=0x55861e133390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:22:28.541+0000 7fc881ffb640 1 client.7841.objecter ms_handle_reset 0x55861e130fa0 session 0x55861e130920 osd.6 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:22:28.541+0000 7fc9acc95640 10 monclient: get_auth_request con 0x7fc9a40b7040 auth_method 0 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:28.668 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 zone default found 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 Realm: () 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:28.669 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 zonegroup default 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 started sync module instance, tier type = 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=0 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=1 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=2 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=3 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=4 2024-09-14T11:22:28.670 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=5 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=6 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 20 add_watcher() i=7 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding auth protocol: cephx 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding auth protocol: cephx 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding auth protocol: cephx 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.671 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:22:28.577+0000 7fc862fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cache list hook 0x55861e10e540 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cache inspect hook 0x55861e10e540 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cache erase hook 0x55861e10e540 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cache zap hook 0x55861e10e540 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 note: GC not initialized 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:22:28.581+0000 7fc861fdb640 20 reqs_thread_entry: start 2024-09-14T11:22:28.672 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command sync trace show hook 0x7fc9a001d070 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command sync trace history hook 0x7fc9a001d070 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command sync trace active hook 0x7fc9a001d070 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command sync trace active_short hook 0x7fc9a001d070 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 Filter name: none 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:22:28.581+0000 7fc7d37fe640 20 reqs_thread_entry: start 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.673 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:22:28.585+0000 7fc9ae98e9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94034518551072 notifier 7841 bl.length()=911 2024-09-14T11:22:28.674 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:22:28.613+0000 7fc9ae98e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9ae98e9c0 time 2024-09-14T11:22:28.619295+0000 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc9b22682eb] 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc9b226849f] 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55861c05dc01] 2024-09-14T11:22:28.675 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x142325c) [0x55861cabc25c] 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55861c072ecd] 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc9b10ced90] 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:22:28.617+0000 7fc9ae98e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc9ae98e9c0 thread_name:radosgw-admin 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc9b10e7520] 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:22:28.676 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc9b2268345] 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc9b226849f] 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55861c05dc01] 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x142325c) [0x55861cabc25c] 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55861c072ecd] 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc9b10ced90] 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:22:28.677 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:22:28.678 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:22:28.679 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:22:28.680 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:22:28.681 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:22:28.682 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:22:28.683 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc7d37fe640 / http_manager 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc861fdb640 / http_manager 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc862fdd640 / rgw_dt_lg_renew 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc881ffb640 / ms_dispatch 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc882ffd640 / io_context_pool 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc8837fe640 / io_context_pool 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc891ffb640 / ms_dispatch 2024-09-14T11:22:28.684 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc898e09640 / ms_dispatch 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc89a60c640 / io_context_pool 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9abc93640 / msgr-worker-2 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9ac494640 / msgr-worker-1 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9acc95640 / msgr-worker-0 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9ad496640 / io_context_pool 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9ae98e9c0 / radosgw-admin 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.146434.log 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:22:28.501+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.685 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:22:28.501+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:22:28.501+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:22:28.501+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:22:28.501+0000 7fc9abc93640 10 monclient(hunting): handle_auth_done global_id 7829 payload 274 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:22:28.501+0000 7fc9abc93640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:22:28.501+0000 7fc9abc93640 1 monclient: found mon.noname-c 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:22:28.501+0000 7fc9abc93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:22:28.501+0000 7fc89a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: dump: 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.686 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.687 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:22:28.505+0000 7fc89a60c640 10 monclient: dump: 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 7829 2024-09-14T11:22:28.688 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 4 set_mon_vals no callback set 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: shutdown 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) unregister_commands rotate-key 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: build_initial_monmap 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: monmap: 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:28.689 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding auth protocol: cephx 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding auth protocol: cephx 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding auth protocol: cephx 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.690 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: crc 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e04adc0) adding con mode: secure 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: starting msgr at 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: starting objecter 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command objecter_requests hook 0x55861e04c8f0 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: setting wanted keys 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: calling monclient init 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: init 2024-09-14T11:22:28.691 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding auth protocol: cephx 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding auth protocol: cephx 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding auth protocol: cephx 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.692 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: crc 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e047ce0) adding con mode: secure 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command rotate-key hook 0x55861e047e28 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-b con 0x55861df01f50 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-c con 0x55861df944b0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-a con 0x55861df997d0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.693 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient(hunting): authenticate will time out at 3007.570202s 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): get_auth_request con 0x55861df944b0 auth_method 0 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): get_auth_request con 0x55861df997d0 auth_method 0 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.694 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:22:28.505+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient(hunting): handle_auth_done global_id 7832 payload 824 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:22:28.505+0000 7fc9abc93640 1 monclient: found mon.noname-c 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:22:28.505+0000 7fc9abc93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: dump: 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.695 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:22:28.505+0000 7fc898e09640 10 monclient: dump: 2024-09-14T11:22:28.696 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 7832 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:22:28.505+0000 7fc89a60c640 4 set_mon_vals no callback set 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.697 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:22:28.505+0000 7fc9ae98e9c0 1 librados: init done 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:22:28.509+0000 7fc898e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:22:28.509+0000 7fc898e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:22:28.509+0000 7fc898e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:22:28.509+0000 7fc9ac494640 10 monclient: get_auth_request con 0x7fc8940718d0 auth_method 0 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:22:28.509+0000 7fc9acc95640 10 monclient: get_auth_request con 0x55861e0887d0 auth_method 0 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:22:28.509+0000 7fc9ac494640 10 monclient: get_auth_request con 0x55861e092960 auth_method 0 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient: get_auth_request con 0x55861e096b90 auth_method 0 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: build_initial_monmap 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: monmap: 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:28.698 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding auth protocol: cephx 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding auth protocol: cephx 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding auth protocol: cephx 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.699 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: crc 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09ba60) adding con mode: secure 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55861e09f3e0 EEXIST 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: init 2024-09-14T11:22:28.700 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding auth protocol: cephx 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding auth protocol: cephx 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding auth protocol: cephx 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.701 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: crc 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e09a028) adding con mode: secure 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command rotate-key cmddesc rotate-key hook 0x55861e09a170 EEXIST 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-a con 0x55861e0c3590 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-c con 0x55861e0c2ec0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-b con 0x55861e0c18a0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.702 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:22:28.513+0000 7fc9ae98e9c0 10 monclient(hunting): authenticate will time out at 3007.579630s 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): get_auth_request con 0x55861e0c3590 auth_method 0 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): get_auth_request con 0x55861e0c2ec0 auth_method 0 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.703 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:22:28.513+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:22:28.513+0000 7fc9abc93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:22:28.517+0000 7fc9ac494640 10 monclient(hunting): handle_auth_done global_id 8358 payload 824 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:22:28.517+0000 7fc9ac494640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:22:28.517+0000 7fc9ac494640 1 monclient: found mon.noname-a 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:22:28.517+0000 7fc9ac494640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:22:28.517+0000 7fc9acc95640 10 monclient: get_auth_request con 0x55861e0c18a0 auth_method 0 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: dump: 2024-09-14T11:22:28.704 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.705 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:22:28.517+0000 7fc891ffb640 10 monclient: dump: 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.706 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:22:28.517+0000 7fc9ad496640 4 set_mon_vals no callback set 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 8358 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:22:28.517+0000 7fc891ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:22:28.517+0000 7fc891ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:22:28.517+0000 7fc891ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.707 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:22:28.517+0000 7fc9abc93640 10 monclient: get_auth_request con 0x7fc8840717e0 auth_method 0 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: get_monmap_and_config 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: build_initial_monmap 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: monmap: 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:28.708 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding auth protocol: cephx 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding auth protocol: cephx 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding auth protocol: cephx 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.709 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: crc 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0e2f50) adding con mode: secure 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 10 monclient: init 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding auth protocol: cephx 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding auth protocol: cephx 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding auth protocol: cephx 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.710 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: crc 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b4a0) adding con mode: secure 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:22:28.517+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command rotate-key cmddesc rotate-key hook 0x7fff4b55b5e8 EEXIST 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-c con 0x55861e111510 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-b con 0x55861e1118f0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:28.711 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-a con 0x55861e112db0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): authenticate will time out at 3007.584328s 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): get_auth_request con 0x55861e111510 auth_method 0 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): get_auth_request con 0x55861e112db0 auth_method 0 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.712 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_done global_id 7838 payload 274 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:22:28.521+0000 7fc9ac494640 1 monclient: found mon.noname-c 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:28.713 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: dump: 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.714 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 7838 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 4 set_mon_vals no callback set 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:22:28.521+0000 7fc8837fe640 10 monclient: dump: 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.715 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: shutdown 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: build_initial_monmap 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: monmap: 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.716 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding auth protocol: cephx 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding auth protocol: cephx 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding auth protocol: cephx 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.717 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: crc 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e1099e0) adding con mode: secure 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: starting msgr at 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: starting objecter 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55861e10a4e0 EEXIST 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: setting wanted keys 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: calling monclient init 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: init 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding auth protocol: cephx 2024-09-14T11:22:28.718 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding auth protocol: cephx 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding auth protocol: cephx 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: crc 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 AuthRegistry(0x55861e0c53b0) adding con mode: secure 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.719 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command rotate-key cmddesc rotate-key hook 0x55861e0c54f8 EEXIST 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-c con 0x55861e111510 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-b con 0x55861e112db0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): picked mon.noname-a con 0x55861e10e100 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient(hunting): authenticate will time out at 3007.587024s 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): get_auth_request con 0x55861e10e100 auth_method 0 2024-09-14T11:22:28.720 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): get_auth_request con 0x55861e111510 auth_method 0 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:22:28.521+0000 7fc9acc95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:28.721 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient: _finish_hunting 0 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:22:28.521+0000 7fc9ac494640 1 monclient: found mon.noname-c 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:22:28.521+0000 7fc9ac494640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:22:28.521+0000 7fc9abc93640 10 monclient: get_auth_request con 0x55861e112db0 auth_method 0 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: dump: 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.722 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: _finish_auth 0 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:22:28.521+0000 7fc881ffb640 10 monclient: dump: 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:28.723 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 monclient: authenticate success, global_id 7841 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:22:28.521+0000 7fc8837fe640 4 set_mon_vals no callback set 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _renew_subs 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 1 librados: init done 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:22:28.521+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cr dump hook 0x55861e110788 2024-09-14T11:22:28.724 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:22:28.525+0000 7fc881ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:22:28.525+0000 7fc881ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:22:28.525+0000 7fc881ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:22:28.525+0000 7fc9abc93640 10 monclient: get_auth_request con 0x7fc8740718a0 auth_method 0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:22:28.525+0000 7fc9acc95640 10 monclient: get_auth_request con 0x55861e130fa0 auth_method 0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 realm 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:22:28.525+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.725 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:22:28.529+0000 7fc9ac494640 10 monclient: get_auth_request con 0x55861e135120 auth_method 0 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:22:28.529+0000 7fc9abc93640 10 monclient: get_auth_request con 0x55861e138980 auth_method 0 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:22:28.529+0000 7fc9ae98e9c0 20 searching for the correct realm 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:22:28.529+0000 7fc9acc95640 10 monclient: get_auth_request con 0x55861e13d740 auth_method 0 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:22:28.533+0000 7fc9ac494640 10 monclient: get_auth_request con 0x7fc99c004320 auth_method 0 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:22:28.533+0000 7fc9abc93640 10 monclient: get_auth_request con 0x7fc9a40b7040 auth_method 0 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:22:28.537+0000 7fc9abc93640 0 -- 172.21.15.148:0/838216799 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fc9a40b7040 msgr2=0x7fc9a40d1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:22:28.537+0000 7fc881ffb640 1 client.7841.objecter ms_handle_reset 0x7fc9a40b7040 session 0x7fc9a40b99c0 osd.5 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:22:28.537+0000 7fc881ffb640 10 monclient: _renew_subs 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:22:28.537+0000 7fc881ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:22:28.537+0000 7fc9abc93640 10 monclient: get_auth_request con 0x7fc874081b40 auth_method 0 2024-09-14T11:22:28.726 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:22:28.541+0000 7fc9acc95640 10 monclient: get_auth_request con 0x7fc99c08d040 auth_method 0 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:22:28.541+0000 7fc9ac494640 10 monclient: get_auth_request con 0x7fc9a40deb30 auth_method 0 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:22:28.541+0000 7fc9acc95640 0 -- 172.21.15.148:0/838216799 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55861e130fa0 msgr2=0x55861e133390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:22:28.541+0000 7fc881ffb640 1 client.7841.objecter ms_handle_reset 0x55861e130fa0 session 0x55861e130920 osd.6 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:22:28.541+0000 7fc9acc95640 10 monclient: get_auth_request con 0x7fc9a40b7040 auth_method 0 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.727 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:22:28.549+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 zone default found 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 Realm: () 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 zonegroup default 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.728 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 started sync module instance, tier type = 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:22:28.553+0000 7fc9ae98e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=0 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=1 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=2 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=3 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=4 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=5 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:22:28.573+0000 7fc9ae98e9c0 20 add_watcher() i=6 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 20 add_watcher() i=7 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:28.729 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding auth protocol: cephx 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding auth protocol: cephx 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding auth protocol: cephx 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: crc 2024-09-14T11:22:28.730 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:22:28.577+0000 7fc9ae98e9c0 5 AuthRegistry(0x7fff4b55b980) adding con mode: secure 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:22:28.577+0000 7fc862fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cache list hook 0x55861e10e540 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cache inspect hook 0x55861e10e540 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cache erase hook 0x55861e10e540 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command cache zap hook 0x55861e10e540 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 note: GC not initialized 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:22:28.581+0000 7fc861fdb640 20 reqs_thread_entry: start 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command sync trace show hook 0x7fc9a001d070 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command sync trace history hook 0x7fc9a001d070 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command sync trace active hook 0x7fc9a001d070 2024-09-14T11:22:28.731 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 5 asok(0x55861de3cd90) register_command sync trace active_short hook 0x7fc9a001d070 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 Filter name: none 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:22:28.581+0000 7fc7d37fe640 20 reqs_thread_entry: start 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.732 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:22:28.581+0000 7fc9ae98e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:22:28.585+0000 7fc9ae98e9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:22:28.601+0000 7fc9ae98e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94034518551072 notifier 7841 bl.length()=911 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:22:28.601+0000 7fc882ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:22:28.733 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:22:28.605+0000 7fc9ae98e9c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:22:28.613+0000 7fc9ae98e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9ae98e9c0 time 2024-09-14T11:22:28.619295+0000 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc9b22682eb] 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc9b226849f] 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55861c05dc01] 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 4: radosgw-admin(+0x142325c) [0x55861cabc25c] 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55861c072ecd] 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 6: main() 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc9b10ced90] 2024-09-14T11:22:28.734 INFO:tasks.workunit.client.0.smithi148.stderr: 8: __libc_start_main() 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 9: _start() 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:22:28.617+0000 7fc9ae98e9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc9ae98e9c0 thread_name:radosgw-admin 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc9b10e7520] 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc9b2268345] 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc9b226849f] 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55861c05dc01] 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 8: radosgw-admin(+0x142325c) [0x55861cabc25c] 2024-09-14T11:22:28.735 INFO:tasks.workunit.client.0.smithi148.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55861c072ecd] 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 10: main() 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc9b10ced90] 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 12: __libc_start_main() 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 13: _start() 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:22:28.736 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:22:28.737 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:22:28.738 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:22:28.739 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:22:28.740 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:22:28.741 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:22:28.742 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc7d37fe640 / http_manager 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc861fdb640 / http_manager 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc862fdd640 / rgw_dt_lg_renew 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc881ffb640 / ms_dispatch 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc882ffd640 / io_context_pool 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc8837fe640 / io_context_pool 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc891ffb640 / ms_dispatch 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc898e09640 / ms_dispatch 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc89a60c640 / io_context_pool 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9abc93640 / msgr-worker-2 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9ac494640 / msgr-worker-1 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9acc95640 / msgr-worker-0 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9ad496640 / io_context_pool 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc9ae98e9c0 / radosgw-admin 2024-09-14T11:22:28.743 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:22:28.744 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:22:28.744 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:22:28.621838Z_c27cb519-2871-4920-979b-1e4a249e3f8e/log 2024-09-14T11:22:28.744 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:22:28.744 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:22:28.744 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:22:28.745 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.693+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 realm 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.697+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.746 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.701+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:28.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.701+0000 7fbb5f2fd9c0 20 searching for the correct realm 2024-09-14T11:22:28.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.701+0000 7fbb5ce03640 0 -- 172.21.15.148:0/1040514502 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fbb4c0c5040 msgr2=0x7fbb4c0fd7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:28.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.709+0000 7fbb5ce03640 0 -- 172.21.15.148:0/1040514502 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fbb44003ac0 msgr2=0x7fbb540672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:28.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.925+0000 7fbb5f2fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:28.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.925+0000 7fbb5f2fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:28.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.925+0000 7fbb5f2fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:28.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.925+0000 7fbb5f2fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:28.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.925+0000 7fbb5f2fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:28.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.925+0000 7fbb5f2fd9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:28.927 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.925+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:28.928 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:28.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 zone default found 2024-09-14T11:22:28.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 4 Realm: () 2024-09-14T11:22:28.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:28.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:28.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:28.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 zonegroup default 2024-09-14T11:22:28.929 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.930 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.929+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.933+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.931 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.933+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.933+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:28.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.933+0000 7fbb5f2fd9c0 20 started sync module instance, tier type = 2024-09-14T11:22:28.932 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.933+0000 7fbb5f2fd9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:28.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.953+0000 7fbb5f2fd9c0 20 add_watcher() i=0 2024-09-14T11:22:28.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.953+0000 7fbb5f2fd9c0 20 add_watcher() i=1 2024-09-14T11:22:28.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.953+0000 7fbb5f2fd9c0 20 add_watcher() i=2 2024-09-14T11:22:28.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.953+0000 7fbb5f2fd9c0 20 add_watcher() i=3 2024-09-14T11:22:28.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.953+0000 7fbb5f2fd9c0 20 add_watcher() i=4 2024-09-14T11:22:28.954 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.953+0000 7fbb5f2fd9c0 20 add_watcher() i=5 2024-09-14T11:22:28.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.953+0000 7fbb5f2fd9c0 20 add_watcher() i=6 2024-09-14T11:22:28.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.957+0000 7fbb5f2fd9c0 20 add_watcher() i=7 2024-09-14T11:22:28.956 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.957+0000 7fbb5f2fd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:28.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.961+0000 7fba137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:28.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.961+0000 7fbb5f2fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:28.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.961+0000 7fbb5f2fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:28.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.961+0000 7fbb5f2fd9c0 5 note: GC not initialized 2024-09-14T11:22:28.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.961+0000 7fba127e4640 20 reqs_thread_entry: start 2024-09-14T11:22:28.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.961+0000 7fbb5f2fd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:28.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.961+0000 7fbb5f2fd9c0 20 Filter name: none 2024-09-14T11:22:28.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fba0b7fe640 20 reqs_thread_entry: start 2024-09-14T11:22:28.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:28.963 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:28.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:28.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:28.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:22:28.964 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:28.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:28.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:28.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:28.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:28.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:28.965 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:22:28.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:22:28.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:22:28.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:22:28.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:22:28.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:22:28.966 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.965+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:22:28.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:22:28.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:22:28.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:22:28.967 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:22:28.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:22:28.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:22:28.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:22:28.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:22:28.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:22:28.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.969+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:22:28.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:22:28.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:22:28.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:22:28.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:22:28.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:22:28.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:22:28.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:22:28.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:22:28.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:22:28.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.973+0000 7fbb5f2fd9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:22:28.976 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.977+0000 7fba137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:28.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.981+0000 7fbb5f2fd9c0 20 remove_watcher() i=0 2024-09-14T11:22:28.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.981+0000 7fbb5f2fd9c0 2 removed watcher, disabling cache 2024-09-14T11:22:28.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.985+0000 7fbb5f2fd9c0 20 remove_watcher() i=1 2024-09-14T11:22:28.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.985+0000 7fbb5f2fd9c0 20 remove_watcher() i=2 2024-09-14T11:22:28.986 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.989+0000 7fbb5f2fd9c0 20 remove_watcher() i=3 2024-09-14T11:22:28.988 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.989+0000 7fbb5f2fd9c0 20 remove_watcher() i=4 2024-09-14T11:22:28.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.993+0000 7fbb5f2fd9c0 20 remove_watcher() i=5 2024-09-14T11:22:28.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.993+0000 7fbb5f2fd9c0 20 remove_watcher() i=6 2024-09-14T11:22:28.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:28.997+0000 7fbb5f2fd9c0 20 remove_watcher() i=7 2024-09-14T11:22:29.011 INFO:tasks.workunit.client.0.smithi148.stderr: test: duplicated entries can be purged manually 2024-09-14T11:22:59.043 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:22:59.076 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:59.076 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:59.121 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.125+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 realm 2024-09-14T11:22:59.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:59.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.125 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.129+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.133+0000 7f4d1def69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:59.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.133+0000 7f4d1def69c0 20 searching for the correct realm 2024-09-14T11:22:59.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.137+0000 7f4d1b1fb640 0 -- 172.21.15.148:0/2427483965 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f4d14116040 msgr2=0x7f4d140fc0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.141+0000 7f4d1c1fd640 0 -- 172.21.15.148:0/2427483965 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55584dc97ac0 msgr2=0x55584dc99ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:59.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:59.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:59.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:59.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:59.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:59.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.146 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.149+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:59.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 zone default found 2024-09-14T11:22:59.147 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 4 Realm: () 2024-09-14T11:22:59.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:59.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:59.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:59.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 zonegroup default 2024-09-14T11:22:59.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 started sync module instance, tier type = 2024-09-14T11:22:59.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.153+0000 7f4d1def69c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:59.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.173+0000 7f4d1def69c0 20 add_watcher() i=0 2024-09-14T11:22:59.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.173+0000 7f4d1def69c0 20 add_watcher() i=1 2024-09-14T11:22:59.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.173+0000 7f4d1def69c0 20 add_watcher() i=2 2024-09-14T11:22:59.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.173+0000 7f4d1def69c0 20 add_watcher() i=3 2024-09-14T11:22:59.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.173+0000 7f4d1def69c0 20 add_watcher() i=4 2024-09-14T11:22:59.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.173+0000 7f4d1def69c0 20 add_watcher() i=5 2024-09-14T11:22:59.168 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.173+0000 7f4d1def69c0 20 add_watcher() i=6 2024-09-14T11:22:59.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.177+0000 7f4d1def69c0 20 add_watcher() i=7 2024-09-14T11:22:59.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.177+0000 7f4d1def69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:59.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.177+0000 7f4bd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:59.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:59.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 5 note: GC not initialized 2024-09-14T11:22:59.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4bd0fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:59.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:59.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 Filter name: none 2024-09-14T11:22:59.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4b4a7fc640 20 reqs_thread_entry: start 2024-09-14T11:22:59.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:59.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:59.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:59.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.181+0000 7f4d1def69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:59.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.185+0000 7f4bd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.189+0000 7f4d1def69c0 20 remove_watcher() i=0 2024-09-14T11:22:59.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.189+0000 7f4d1def69c0 2 removed watcher, disabling cache 2024-09-14T11:22:59.187 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.193+0000 7f4d1def69c0 20 remove_watcher() i=1 2024-09-14T11:22:59.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.193+0000 7f4d1def69c0 20 remove_watcher() i=2 2024-09-14T11:22:59.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.197+0000 7f4d1def69c0 20 remove_watcher() i=3 2024-09-14T11:22:59.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.197+0000 7f4d1def69c0 20 remove_watcher() i=4 2024-09-14T11:22:59.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.201+0000 7f4d1def69c0 20 remove_watcher() i=5 2024-09-14T11:22:59.198 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.201+0000 7f4d1def69c0 20 remove_watcher() i=6 2024-09-14T11:22:59.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.205+0000 7f4d1def69c0 20 remove_watcher() i=7 2024-09-14T11:22:59.215 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.215 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:22:59.215 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: a-bucket id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:22:59.215 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.215 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:22:59.247 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:59.247 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:59.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.293+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 realm 2024-09-14T11:22:59.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:59.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:59.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 searching for the correct realm 2024-09-14T11:22:59.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.305+0000 7fc4d8e38640 0 -- 172.21.15.148:0/97584591 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5580d3e19af0 msgr2=0x5580d3e1bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.309+0000 7fc4d9639640 0 -- 172.21.15.148:0/97584591 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc4d4019410 msgr2=0x7fc4d4019870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:59.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:59.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:59.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:59.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:59.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:59.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.314 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 zone default found 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 Realm: () 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 zonegroup default 2024-09-14T11:22:59.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 started sync module instance, tier type = 2024-09-14T11:22:59.317 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:59.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=0 2024-09-14T11:22:59.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=1 2024-09-14T11:22:59.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=2 2024-09-14T11:22:59.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=3 2024-09-14T11:22:59.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=4 2024-09-14T11:22:59.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=5 2024-09-14T11:22:59.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=6 2024-09-14T11:22:59.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.341+0000 7fc4dbb339c0 20 add_watcher() i=7 2024-09-14T11:22:59.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.341+0000 7fc4dbb339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:59.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc38f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:59.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:59.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 note: GC not initialized 2024-09-14T11:22:59.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc38e7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:59.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:59.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 Filter name: none 2024-09-14T11:22:59.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc2fffff640 20 reqs_thread_entry: start 2024-09-14T11:22:59.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:59.341 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:59.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:59.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:22:59.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:59.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:59.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:22:59.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.349+0000 7fc4dbb339c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:22:59.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:22:59.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 94011798958400 notifier 7892 bl.length()=911 2024-09-14T11:22:59.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:22:59.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:22:59.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:22:59.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:22:59.375 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4dbb339c0 time 2024-09-14T11:22:59.382407+0000 2024-09-14T11:22:59.375 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:59.376 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:59.376 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4df40d2eb] 2024-09-14T11:22:59.376 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4df40d49f] 2024-09-14T11:22:59.376 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580d1963c01] 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5580d1978f3a] 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4de273d90] 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc4dbb339c0 thread_name:radosgw-admin 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.381+0000 7fc4dbb339c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4dbb339c0 time 2024-09-14T11:22:59.382407+0000 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:59.377 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4df40d2eb] 2024-09-14T11:22:59.378 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4df40d49f] 2024-09-14T11:22:59.378 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580d1963c01] 2024-09-14T11:22:59.378 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5580d1978f3a] 2024-09-14T11:22:59.378 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:22:59.378 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4de273d90] 2024-09-14T11:22:59.378 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:22:59.378 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:22:59.378 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.396 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:59.396 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4de28c520] 2024-09-14T11:22:59.396 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:22:59.396 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:22:59.396 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4df40d345] 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4df40d49f] 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580d1963c01] 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5580d1978f3a] 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4de273d90] 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.381+0000 7fc4dbb339c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc4dbb339c0 thread_name:radosgw-admin 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:59.397 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4de28c520] 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4df40d345] 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4df40d49f] 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580d1963c01] 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5580d1978f3a] 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4de273d90] 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:59.398 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:22:59.273+0000 7fc4d8e38640 1 monclient: found mon.noname-a 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:22:59.273+0000 7fc4d8e38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: dump: 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.399 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: dump: 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.400 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 8403 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: get_monmap_and_config success 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 4 set_mon_vals no callback set 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: shutdown 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) unregister_commands rotate-key 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: build_initial_monmap 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:59.401 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: monmap: 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding auth protocol: cephx 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding auth protocol: cephx 2024-09-14T11:22:59.402 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding auth protocol: cephx 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.403 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 librados: starting msgr at 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 librados: starting objecter 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command objecter_requests hook 0x5580d3d574a0 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 librados: setting wanted keys 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 librados: calling monclient init 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: init 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding auth protocol: cephx 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding auth protocol: cephx 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding auth protocol: cephx 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.404 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command rotate-key hook 0x5580d3d29028 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:22:59.405 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-a con 0x5580d3bd8050 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-b con 0x5580d3bd8430 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-c con 0x5580d3c70f90 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): authenticate will time out at 3038.336066s 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): get_auth_request con 0x5580d3bd8050 auth_method 0 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request con 0x5580d3c70f90 auth_method 0 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.406 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): handle_auth_done global_id 8406 payload 824 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient: _finish_hunting 0 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:22:59.277+0000 7fc4d9639640 1 monclient: found mon.noname-a 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:59.407 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: dump: 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.408 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: dump: 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.409 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 8406 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:22:59.277+0000 7fc3c7606640 4 set_mon_vals no callback set 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 1 librados: init done 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:22:59.277+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x7fc3c00718a0 auth_method 0 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient: get_auth_request con 0x5580d3d50dd0 auth_method 0 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:22:59.281+0000 7fc4d9639640 10 monclient: get_auth_request con 0x5580d3d73ea0 auth_method 0 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:22:59.281+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x5580d3d78090 auth_method 0 2024-09-14T11:22:59.410 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 10 monclient: build_initial_monmap 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 10 monclient: monmap: 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.411 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding auth protocol: cephx 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding auth protocol: cephx 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding auth protocol: cephx 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.412 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5580d3d80730 EEXIST 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: init 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding auth protocol: cephx 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding auth protocol: cephx 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding auth protocol: cephx 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.413 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command rotate-key cmddesc rotate-key hook 0x5580d3d7b560 EEXIST 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-c con 0x5580d3da48e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:59.414 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-a con 0x5580d3da4210 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-b con 0x5580d3da2bf0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): authenticate will time out at 3038.345111s 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request con 0x5580d3da4210 auth_method 0 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): get_auth_request con 0x5580d3da48e0 auth_method 0 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.415 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:22:59.285+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request con 0x5580d3da2bf0 auth_method 0 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:22:59.285+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:22:59.285+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:22:59.285+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): handle_auth_done global_id 7886 payload 824 2024-09-14T11:22:59.416 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient: _finish_hunting 0 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:22:59.285+0000 7fc4d9639640 1 monclient: found mon.noname-c 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: dump: 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.417 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: dump: 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.418 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:22:59.285+0000 7fc4da63b640 4 set_mon_vals no callback set 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 7886 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:22:59.289+0000 7fc3beffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:59.419 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:22:59.289+0000 7fc3beffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:22:59.289+0000 7fc3beffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x7fc3b40717e0 auth_method 0 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: get_monmap_and_config 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: build_initial_monmap 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: monmap: 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:59.420 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding auth protocol: cephx 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding auth protocol: cephx 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding auth protocol: cephx 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.421 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: init 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding auth protocol: cephx 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding auth protocol: cephx 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding auth protocol: cephx 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.422 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffe613092a8 EEXIST 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:22:59.423 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-a con 0x5580d3dc84b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-c con 0x5580d3dc97e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-b con 0x5580d3df4230 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): authenticate will time out at 3038.349687s 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request con 0x5580d3dc97e0 auth_method 0 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): get_auth_request con 0x5580d3dc84b0 auth_method 0 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.424 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:22:59.289+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request con 0x5580d3df4230 auth_method 0 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:22:59.289+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:22:59.289+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:22:59.289+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): handle_auth_done global_id 8412 payload 274 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient: _finish_hunting 0 2024-09-14T11:22:59.425 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:22:59.289+0000 7fc4d9639640 1 monclient: found mon.noname-a 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: dump: 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.426 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: dump: 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.427 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 8412 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: get_monmap_and_config success 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 4 set_mon_vals no callback set 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: shutdown 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: build_initial_monmap 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: monmap: 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:59.428 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding auth protocol: cephx 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding auth protocol: cephx 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding auth protocol: cephx 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.429 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 librados: starting msgr at 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 librados: starting objecter 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5580d3df4670 EEXIST 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 librados: setting wanted keys 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 librados: calling monclient init 2024-09-14T11:22:59.430 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: init 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding auth protocol: cephx 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding auth protocol: cephx 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding auth protocol: cephx 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.431 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command rotate-key cmddesc rotate-key hook 0x5580d3da6848 EEXIST 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-a con 0x5580d3dc84b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-c con 0x5580d3dc97e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-b con 0x5580d3df4230 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:59.432 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): authenticate will time out at 3038.352305s 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): get_auth_request con 0x5580d3dc84b0 auth_method 0 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request con 0x5580d3dc97e0 auth_method 0 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.433 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_done global_id 7892 payload 824 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient: _finish_hunting 0 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 1 monclient: found mon.noname-c 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:59.434 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: dump: 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.435 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: dump: 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.436 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 7892 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:22:59.293+0000 7fc3bcff9640 4 set_mon_vals no callback set 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 1 librados: init done 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cr dump hook 0x7fc4cc0668a8 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.437 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient: get_auth_request con 0x7fc3a40718a0 auth_method 0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:22:59.297+0000 7fc4d9e3a640 10 monclient: get_auth_request con 0x5580d3e12050 auth_method 0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 realm 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:22:59.297+0000 7fc4d9639640 10 monclient: get_auth_request con 0x5580d3e16290 auth_method 0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.438 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:22:59.297+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x5580d3e19af0 auth_method 0 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 searching for the correct realm 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:22:59.301+0000 7fc4d9e3a640 10 monclient: get_auth_request con 0x5580d3e1e8b0 auth_method 0 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:22:59.301+0000 7fc4d9639640 10 monclient: get_auth_request con 0x7fc4cc00ec20 auth_method 0 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:22:59.305+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x7fc4d4029040 auth_method 0 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:22:59.305+0000 7fc4d8e38640 0 -- 172.21.15.148:0/97584591 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5580d3e19af0 msgr2=0x5580d3e1bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:22:59.305+0000 7fc3aaffd640 1 client.7892.objecter ms_handle_reset 0x5580d3e19af0 session 0x5580d3e15620 osd.2 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:22:59.305+0000 7fc3aaffd640 10 monclient: _renew_subs 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:22:59.305+0000 7fc3aaffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:22:59.305+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x7fc3a4081b40 auth_method 0 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:22:59.309+0000 7fc4d9e3a640 10 monclient: get_auth_request con 0x7fc4cc017070 auth_method 0 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:22:59.309+0000 7fc4d9639640 10 monclient: get_auth_request con 0x7fc4d4019410 auth_method 0 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:22:59.309+0000 7fc4d9639640 0 -- 172.21.15.148:0/97584591 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc4d4019410 msgr2=0x7fc4d4019870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.439 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:22:59.309+0000 7fc3aaffd640 1 client.7892.objecter ms_handle_reset 0x7fc4d4019410 session 0x7fc4d4001780 osd.3 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:22:59.309+0000 7fc4d9639640 10 monclient: get_auth_request con 0x5580d3e19af0 auth_method 0 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.440 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 zone default found 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 Realm: () 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 zonegroup default 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.441 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 started sync module instance, tier type = 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=0 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=1 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=2 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=3 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=4 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=5 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=6 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:22:59.341+0000 7fc4dbb339c0 20 add_watcher() i=7 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:22:59.341+0000 7fc4dbb339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding auth protocol: cephx 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding auth protocol: cephx 2024-09-14T11:22:59.442 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding auth protocol: cephx 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:22:59.345+0000 7fc38f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.443 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cache list hook 0x5580d3de2d50 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cache inspect hook 0x5580d3de2d50 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cache erase hook 0x5580d3de2d50 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cache zap hook 0x5580d3de2d50 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 note: GC not initialized 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:22:59.345+0000 7fc38e7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command sync trace show hook 0x7fc4cc07c020 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command sync trace history hook 0x7fc4cc07c020 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command sync trace active hook 0x7fc4cc07c020 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command sync trace active_short hook 0x7fc4cc07c020 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 Filter name: none 2024-09-14T11:22:59.444 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:22:59.345+0000 7fc2fffff640 20 reqs_thread_entry: start 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.445 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:22:59.349+0000 7fc4dbb339c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 94011798958400 notifier 7892 bl.length()=911 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:22:59.446 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:22:59.381+0000 7fc4dbb339c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4dbb339c0 time 2024-09-14T11:22:59.382407+0000 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4df40d2eb] 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4df40d49f] 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580d1963c01] 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5580d1978f3a] 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4de273d90] 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:22:59.381+0000 7fc4dbb339c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:59.447 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc4dbb339c0 thread_name:radosgw-admin 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4de28c520] 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4df40d345] 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4df40d49f] 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580d1963c01] 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5580d1978f3a] 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:22:59.448 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4de273d90] 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:22:59.449 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:22:59.450 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:22:59.451 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:22:59.452 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:22:59.453 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:22:59.454 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc2fffff640 / http_manager 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc38e7e4640 / http_manager 2024-09-14T11:22:59.455 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc38f7e6640 / rgw_dt_lg_renew 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3aaffd640 / ms_dispatch 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3bcff9640 / io_context_pool 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3beffd640 / ms_dispatch 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3c5e03640 / ms_dispatch 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3c7606640 / io_context_pool 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4d8e38640 / msgr-worker-2 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4d9639640 / msgr-worker-1 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4d9e3a640 / msgr-worker-0 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4da63b640 / io_context_pool 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4dbb339c0 / radosgw-admin 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/log/ceph/ceph-client.admin.148204.log 2024-09-14T11:22:59.456 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:--- begin dump of recent events --- 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr: -499> 2024-09-14T11:22:59.273+0000 7fc4d8e38640 1 monclient: found mon.noname-a 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr: -498> 2024-09-14T11:22:59.273+0000 7fc4d8e38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr: -497> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr: -496> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr: -495> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: dump: 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.457 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr: -494> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr: -493> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr: -492> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr: -491> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr: -490> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr: -489> 2024-09-14T11:22:59.273+0000 7fc3c7606640 10 monclient: dump: 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.458 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: -488> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 8403 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: -487> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: get_monmap_and_config success 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: -486> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 4 set_mon_vals no callback set 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: -485> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: shutdown 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: -484> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) unregister_commands rotate-key 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: -483> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: build_initial_monmap 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: -482> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr: -481> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: monmap: 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:59.459 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr: -480> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding auth protocol: cephx 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr: -479> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding auth protocol: cephx 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr: -478> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding auth protocol: cephx 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr: -477> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr: -476> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr: -475> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.460 INFO:tasks.workunit.client.0.smithi148.stderr: -474> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -473> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -472> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -471> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -470> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -469> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -468> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -467> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: crc 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -466> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d2f730) adding con mode: secure 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -465> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -464> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 librados: starting msgr at 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -463> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 librados: starting objecter 2024-09-14T11:22:59.461 INFO:tasks.workunit.client.0.smithi148.stderr: -462> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command objecter_requests hook 0x5580d3d574a0 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -461> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 librados: setting wanted keys 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -460> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 1 librados: calling monclient init 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -459> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 10 monclient: init 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -458> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding auth protocol: cephx 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -457> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding auth protocol: cephx 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -456> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding auth protocol: cephx 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -455> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -454> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -453> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -452> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -451> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -450> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -449> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.462 INFO:tasks.workunit.client.0.smithi148.stderr: -448> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -447> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -446> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -445> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: crc 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -444> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d28ee0) adding con mode: secure 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -443> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -442> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -441> 2024-09-14T11:22:59.273+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command rotate-key hook 0x5580d3d29028 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -440> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -439> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -438> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-a con 0x5580d3bd8050 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -437> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-b con 0x5580d3bd8430 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -436> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-c con 0x5580d3c70f90 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:59.463 INFO:tasks.workunit.client.0.smithi148.stderr: -435> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -434> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -433> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -432> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -431> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient(hunting): authenticate will time out at 3038.336066s 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -430> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): get_auth_request con 0x5580d3bd8050 auth_method 0 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -429> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -428> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -427> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -426> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request con 0x5580d3c70f90 auth_method 0 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -425> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -424> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -423> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.464 INFO:tasks.workunit.client.0.smithi148.stderr: -422> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -421> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -420> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -419> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -418> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -417> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -416> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient(hunting): handle_auth_done global_id 8406 payload 824 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -415> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient: _finish_hunting 0 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -414> 2024-09-14T11:22:59.277+0000 7fc4d9639640 1 monclient: found mon.noname-a 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -413> 2024-09-14T11:22:59.277+0000 7fc4d9639640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -412> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -411> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:59.465 INFO:tasks.workunit.client.0.smithi148.stderr: -410> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: dump: 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr: -409> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr: -408> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr: -407> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.466 INFO:tasks.workunit.client.0.smithi148.stderr: -406> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr: -405> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr: -404> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 10 monclient: dump: 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr: -403> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 8406 2024-09-14T11:22:59.467 INFO:tasks.workunit.client.0.smithi148.stderr: -402> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -401> 2024-09-14T11:22:59.277+0000 7fc3c7606640 4 set_mon_vals no callback set 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -400> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -399> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -398> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -397> 2024-09-14T11:22:59.277+0000 7fc4dbb339c0 1 librados: init done 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -396> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -395> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -394> 2024-09-14T11:22:59.277+0000 7fc3c5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -393> 2024-09-14T11:22:59.277+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x7fc3c00718a0 auth_method 0 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -392> 2024-09-14T11:22:59.277+0000 7fc4d9e3a640 10 monclient: get_auth_request con 0x5580d3d50dd0 auth_method 0 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -391> 2024-09-14T11:22:59.281+0000 7fc4d9639640 10 monclient: get_auth_request con 0x5580d3d73ea0 auth_method 0 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -390> 2024-09-14T11:22:59.281+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x5580d3d78090 auth_method 0 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -389> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 10 monclient: build_initial_monmap 2024-09-14T11:22:59.468 INFO:tasks.workunit.client.0.smithi148.stderr: -388> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr: -387> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 10 monclient: monmap: 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr: -386> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding auth protocol: cephx 2024-09-14T11:22:59.469 INFO:tasks.workunit.client.0.smithi148.stderr: -385> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding auth protocol: cephx 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -384> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding auth protocol: cephx 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -383> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -382> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -381> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -380> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -379> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -378> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -377> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -376> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -375> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -374> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -373> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: crc 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -372> 2024-09-14T11:22:59.281+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7cd90) adding con mode: secure 2024-09-14T11:22:59.470 INFO:tasks.workunit.client.0.smithi148.stderr: -371> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -370> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5580d3d80730 EEXIST 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -369> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: init 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -368> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding auth protocol: cephx 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -367> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding auth protocol: cephx 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -366> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding auth protocol: cephx 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -365> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -364> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -363> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -362> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -361> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -360> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.471 INFO:tasks.workunit.client.0.smithi148.stderr: -359> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -358> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -357> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -356> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -355> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: crc 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -354> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3d7b418) adding con mode: secure 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -353> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -352> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -351> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command rotate-key cmddesc rotate-key hook 0x5580d3d7b560 EEXIST 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -350> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -349> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -348> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-c con 0x5580d3da48e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -347> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-a con 0x5580d3da4210 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -346> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-b con 0x5580d3da2bf0 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:59.472 INFO:tasks.workunit.client.0.smithi148.stderr: -345> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -344> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -343> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -342> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -341> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient(hunting): authenticate will time out at 3038.345111s 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -340> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request con 0x5580d3da4210 auth_method 0 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -339> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -338> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -337> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -336> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): get_auth_request con 0x5580d3da48e0 auth_method 0 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -335> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -334> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.473 INFO:tasks.workunit.client.0.smithi148.stderr: -333> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -332> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -331> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -330> 2024-09-14T11:22:59.285+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -329> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -328> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -327> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -326> 2024-09-14T11:22:59.285+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request con 0x5580d3da2bf0 auth_method 0 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -325> 2024-09-14T11:22:59.285+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -324> 2024-09-14T11:22:59.285+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -323> 2024-09-14T11:22:59.285+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -322> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient(hunting): handle_auth_done global_id 7886 payload 824 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -321> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient: _finish_hunting 0 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -320> 2024-09-14T11:22:59.285+0000 7fc4d9639640 1 monclient: found mon.noname-c 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -319> 2024-09-14T11:22:59.285+0000 7fc4d9639640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.474 INFO:tasks.workunit.client.0.smithi148.stderr: -318> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr: -317> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr: -316> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: dump: 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr: -315> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr: -314> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.475 INFO:tasks.workunit.client.0.smithi148.stderr: -313> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr: -312> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr: -311> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr: -310> 2024-09-14T11:22:59.285+0000 7fc3beffd640 10 monclient: dump: 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.476 INFO:tasks.workunit.client.0.smithi148.stderr: -309> 2024-09-14T11:22:59.285+0000 7fc4da63b640 4 set_mon_vals no callback set 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -308> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 7886 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -307> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -306> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -305> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -304> 2024-09-14T11:22:59.285+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -303> 2024-09-14T11:22:59.289+0000 7fc3beffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -302> 2024-09-14T11:22:59.289+0000 7fc3beffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -301> 2024-09-14T11:22:59.289+0000 7fc3beffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -300> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x7fc3b40717e0 auth_method 0 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -299> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: get_monmap_and_config 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -298> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: build_initial_monmap 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -297> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr: -296> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: monmap: 2024-09-14T11:22:59.477 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr: -295> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding auth protocol: cephx 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr: -294> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding auth protocol: cephx 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr: -293> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding auth protocol: cephx 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr: -292> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr: -291> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.478 INFO:tasks.workunit.client.0.smithi148.stderr: -290> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -289> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -288> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -287> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -286> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -285> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -284> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -283> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -282> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: crc 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -281> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3dc4220) adding con mode: secure 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -280> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -279> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: init 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -278> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding auth protocol: cephx 2024-09-14T11:22:59.479 INFO:tasks.workunit.client.0.smithi148.stderr: -277> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding auth protocol: cephx 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -276> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding auth protocol: cephx 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -275> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -274> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -273> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -272> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -271> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -270> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -269> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -268> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -267> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -266> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -265> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: crc 2024-09-14T11:22:59.480 INFO:tasks.workunit.client.0.smithi148.stderr: -264> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309160) adding con mode: secure 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -263> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -262> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -261> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffe613092a8 EEXIST 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -260> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -259> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -258> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-a con 0x5580d3dc84b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -257> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-c con 0x5580d3dc97e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -256> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-b con 0x5580d3df4230 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -255> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -254> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -253> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -252> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -251> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient(hunting): authenticate will time out at 3038.349687s 2024-09-14T11:22:59.481 INFO:tasks.workunit.client.0.smithi148.stderr: -250> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request con 0x5580d3dc97e0 auth_method 0 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -249> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -248> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -247> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -246> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): get_auth_request con 0x5580d3dc84b0 auth_method 0 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -245> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -244> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -243> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -242> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -241> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -240> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -239> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -238> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -237> 2024-09-14T11:22:59.289+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -236> 2024-09-14T11:22:59.289+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request con 0x5580d3df4230 auth_method 0 2024-09-14T11:22:59.482 INFO:tasks.workunit.client.0.smithi148.stderr: -235> 2024-09-14T11:22:59.289+0000 7fc4d9e3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -234> 2024-09-14T11:22:59.289+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -233> 2024-09-14T11:22:59.289+0000 7fc4d9e3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -232> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient(hunting): handle_auth_done global_id 8412 payload 274 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -231> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient: _finish_hunting 0 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -230> 2024-09-14T11:22:59.289+0000 7fc4d9639640 1 monclient: found mon.noname-a 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -229> 2024-09-14T11:22:59.289+0000 7fc4d9639640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.148:3300/0 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -228> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -227> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr: -226> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: dump: 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.483 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr: -225> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr: -224> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr: -223> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr: -222> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr: -221> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr: -220> 2024-09-14T11:22:59.289+0000 7fc3bcff9640 10 monclient: dump: 2024-09-14T11:22:59.484 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr: -219> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 8412 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr: -218> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: get_monmap_and_config success 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr: -217> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 4 set_mon_vals no callback set 2024-09-14T11:22:59.485 INFO:tasks.workunit.client.0.smithi148.stderr: -216> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: shutdown 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr: -215> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: build_initial_monmap 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr: -214> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 build_initial for_mkfs: 0 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr: -213> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: monmap: 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 0 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 0.000000 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:created 0.000000 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-a 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.noname-b 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.noname-c 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.486 INFO:tasks.workunit.client.0.smithi148.stderr: -212> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding auth protocol: cephx 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -211> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding auth protocol: cephx 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -210> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding auth protocol: cephx 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -209> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -208> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -207> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -206> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -205> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -204> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -203> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -202> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -201> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -200> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -199> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: crc 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -198> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3deaae0) adding con mode: secure 2024-09-14T11:22:59.487 INFO:tasks.workunit.client.0.smithi148.stderr: -197> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -196> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 librados: starting msgr at 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -195> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 librados: starting objecter 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -194> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5580d3df4670 EEXIST 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -193> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 librados: setting wanted keys 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -192> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 1 librados: calling monclient init 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -191> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 10 monclient: init 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -190> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding auth protocol: cephx 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -189> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding auth protocol: cephx 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -188> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding auth protocol: cephx 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -187> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -186> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -185> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.488 INFO:tasks.workunit.client.0.smithi148.stderr: -184> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -183> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -182> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -181> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -180> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -179> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -178> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -177> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: crc 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -176> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 5 AuthRegistry(0x5580d3da6700) adding con mode: secure 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -175> 2024-09-14T11:22:59.289+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -174> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -173> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command rotate-key cmddesc rotate-key hook 0x5580d3da6848 EEXIST 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -172> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _reopen_session rank -1 2024-09-14T11:22:59.489 INFO:tasks.workunit.client.0.smithi148.stderr: -171> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -170> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-a con 0x5580d3dc84b0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -169> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-c con 0x5580d3dc97e0 addr [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -168> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): picked mon.noname-b con 0x5580d3df4230 addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -167> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -166> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -165> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -164> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): _renew_subs 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -163> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient(hunting): authenticate will time out at 3038.352305s 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -162> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): get_auth_request con 0x5580d3dc84b0 auth_method 0 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -161> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -160> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -159> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.490 INFO:tasks.workunit.client.0.smithi148.stderr: -158> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request con 0x5580d3dc97e0 auth_method 0 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -157> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -156> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -155> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -154> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -153> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -152> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -151> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -150> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -149> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -148> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient(hunting): handle_auth_done global_id 7892 payload 824 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -147> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient: _finish_hunting 0 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -146> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 1 monclient: found mon.noname-c 2024-09-14T11:22:59.491 INFO:tasks.workunit.client.0.smithi148.stderr: -145> 2024-09-14T11:22:59.293+0000 7fc4d8e38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.492 INFO:tasks.workunit.client.0.smithi148.stderr: -144> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.492 INFO:tasks.workunit.client.0.smithi148.stderr: -143> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:22:59.492 INFO:tasks.workunit.client.0.smithi148.stderr: -142> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: dump: 2024-09-14T11:22:59.492 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.492 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.492 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.492 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.492 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr: -141> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: _finish_auth 0 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr: -140> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr: -139> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:59.493 INFO:tasks.workunit.client.0.smithi148.stderr: -138> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr: -137> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr: -136> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 10 monclient: dump: 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:epoch 1 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:fsid 34b25a2a-02e0-45bd-900d-fa93b60a7234 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:last_changed 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:created 2024-09-14T10:48:07.167829+0000 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:election_strategy: 1 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:0: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.a 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr:2: [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] mon.c 2024-09-14T11:22:59.494 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -135> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 5 monclient: authenticate success, global_id 7892 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -134> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -133> 2024-09-14T11:22:59.293+0000 7fc3bcff9640 4 set_mon_vals no callback set 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -132> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -131> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _renew_subs 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -130> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -129> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 1 librados: init done 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -128> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cr dump hook 0x7fc4cc0668a8 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -127> 2024-09-14T11:22:59.293+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -126> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -125> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -124> 2024-09-14T11:22:59.293+0000 7fc3aaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/1759264388,v1:172.21.15.148:6833/1759264388] 2024-09-14T11:22:59.495 INFO:tasks.workunit.client.0.smithi148.stderr: -123> 2024-09-14T11:22:59.293+0000 7fc4d9639640 10 monclient: get_auth_request con 0x7fc3a40718a0 auth_method 0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -122> 2024-09-14T11:22:59.297+0000 7fc4d9e3a640 10 monclient: get_auth_request con 0x5580d3e12050 auth_method 0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -121> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -120> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 realm 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -119> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -118> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -117> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -116> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -115> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -114> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -113> 2024-09-14T11:22:59.297+0000 7fc4d9639640 10 monclient: get_auth_request con 0x5580d3e16290 auth_method 0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -112> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -111> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi148.stderr: -110> 2024-09-14T11:22:59.297+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x5580d3e19af0 auth_method 0 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -109> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -108> 2024-09-14T11:22:59.297+0000 7fc4dbb339c0 20 searching for the correct realm 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -107> 2024-09-14T11:22:59.301+0000 7fc4d9e3a640 10 monclient: get_auth_request con 0x5580d3e1e8b0 auth_method 0 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -106> 2024-09-14T11:22:59.301+0000 7fc4d9639640 10 monclient: get_auth_request con 0x7fc4cc00ec20 auth_method 0 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -105> 2024-09-14T11:22:59.305+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x7fc4d4029040 auth_method 0 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -104> 2024-09-14T11:22:59.305+0000 7fc4d8e38640 0 -- 172.21.15.148:0/97584591 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5580d3e19af0 msgr2=0x5580d3e1bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -103> 2024-09-14T11:22:59.305+0000 7fc3aaffd640 1 client.7892.objecter ms_handle_reset 0x5580d3e19af0 session 0x5580d3e15620 osd.2 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -102> 2024-09-14T11:22:59.305+0000 7fc3aaffd640 10 monclient: _renew_subs 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -101> 2024-09-14T11:22:59.305+0000 7fc3aaffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.148:3301/0 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -100> 2024-09-14T11:22:59.305+0000 7fc4d8e38640 10 monclient: get_auth_request con 0x7fc3a4081b40 auth_method 0 2024-09-14T11:22:59.497 INFO:tasks.workunit.client.0.smithi148.stderr: -99> 2024-09-14T11:22:59.309+0000 7fc4d9e3a640 10 monclient: get_auth_request con 0x7fc4cc017070 auth_method 0 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -98> 2024-09-14T11:22:59.309+0000 7fc4d9639640 10 monclient: get_auth_request con 0x7fc4d4019410 auth_method 0 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -97> 2024-09-14T11:22:59.309+0000 7fc4d9639640 0 -- 172.21.15.148:0/97584591 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fc4d4019410 msgr2=0x7fc4d4019870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -96> 2024-09-14T11:22:59.309+0000 7fc3aaffd640 1 client.7892.objecter ms_handle_reset 0x7fc4d4019410 session 0x7fc4d4001780 osd.3 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -95> 2024-09-14T11:22:59.309+0000 7fc4d9639640 10 monclient: get_auth_request con 0x5580d3e19af0 auth_method 0 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -94> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -93> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -92> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -91> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -90> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -89> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -88> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -87> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.498 INFO:tasks.workunit.client.0.smithi148.stderr: -86> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -85> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -84> 2024-09-14T11:22:59.317+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -83> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -82> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 zone default found 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -81> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 Realm: () 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -80> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -79> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -78> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -77> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 zonegroup default 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -76> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -75> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -74> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -73> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.499 INFO:tasks.workunit.client.0.smithi148.stderr: -72> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -71> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -70> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 started sync module instance, tier type = 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -69> 2024-09-14T11:22:59.321+0000 7fc4dbb339c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -68> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=0 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -67> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=1 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -66> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=2 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -65> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=3 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -64> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=4 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -63> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=5 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -62> 2024-09-14T11:22:59.337+0000 7fc4dbb339c0 20 add_watcher() i=6 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -61> 2024-09-14T11:22:59.341+0000 7fc4dbb339c0 20 add_watcher() i=7 2024-09-14T11:22:59.500 INFO:tasks.workunit.client.0.smithi148.stderr: -60> 2024-09-14T11:22:59.341+0000 7fc4dbb339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -59> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding auth protocol: cephx 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -58> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding auth protocol: cephx 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -57> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding auth protocol: cephx 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -56> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -55> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -54> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -53> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -52> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -51> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -50> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -49> 2024-09-14T11:22:59.345+0000 7fc38f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -48> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.501 INFO:tasks.workunit.client.0.smithi148.stderr: -47> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -46> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -45> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: crc 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -44> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 AuthRegistry(0x7ffe61309640) adding con mode: secure 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -43> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -42> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -41> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -40> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cache list hook 0x5580d3de2d50 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -39> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cache inspect hook 0x5580d3de2d50 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -38> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cache erase hook 0x5580d3de2d50 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -37> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command cache zap hook 0x5580d3de2d50 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -36> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 note: GC not initialized 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -35> 2024-09-14T11:22:59.345+0000 7fc38e7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -34> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command sync trace show hook 0x7fc4cc07c020 2024-09-14T11:22:59.502 INFO:tasks.workunit.client.0.smithi148.stderr: -33> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command sync trace history hook 0x7fc4cc07c020 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -32> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command sync trace active hook 0x7fc4cc07c020 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -31> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 5 asok(0x5580d3b1dd90) register_command sync trace active_short hook 0x7fc4cc07c020 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -30> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -29> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 Filter name: none 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -28> 2024-09-14T11:22:59.345+0000 7fc2fffff640 20 reqs_thread_entry: start 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -27> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -26> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -25> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -24> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -23> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:59.503 INFO:tasks.workunit.client.0.smithi148.stderr: -22> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -21> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -20> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -19> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -18> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -17> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -16> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -15> 2024-09-14T11:22:59.345+0000 7fc4dbb339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -14> 2024-09-14T11:22:59.349+0000 7fc4dbb339c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -13> 2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -12> 2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -11> 2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -10> 2024-09-14T11:22:59.365+0000 7fc4dbb339c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -9> 2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 94011798958400 notifier 7892 bl.length()=911 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -8> 2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.504 INFO:tasks.workunit.client.0.smithi148.stderr: -7> 2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: -6> 2024-09-14T11:22:59.365+0000 7fc3bcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: -5> 2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: -4> 2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: -3> 2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: -2> 2024-09-14T11:22:59.369+0000 7fc4dbb339c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: -1> 2024-09-14T11:22:59.381+0000 7fc4dbb339c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4dbb339c0 time 2024-09-14T11:22:59.382407+0000 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4df40d2eb] 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4df40d49f] 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580d1963c01] 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5580d1978f3a] 2024-09-14T11:22:59.505 INFO:tasks.workunit.client.0.smithi148.stderr: 5: main() 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4de273d90] 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 7: __libc_start_main() 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 8: _start() 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 0> 2024-09-14T11:22:59.381+0000 7fc4dbb339c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: in thread 7fc4dbb339c0 thread_name:radosgw-admin 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4de28c520] 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 2: pthread_kill() 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 3: raise() 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 4: abort() 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4df40d345] 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4df40d49f] 2024-09-14T11:22:59.506 INFO:tasks.workunit.client.0.smithi148.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5580d1963c01] 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5580d1978f3a] 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 9: main() 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4de273d90] 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 11: __libc_start_main() 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 12: _start() 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr:--- logging levels --- 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 none 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 lockdep 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 context 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 crush 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_balancer 2024-09-14T11:22:59.507 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_locker 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_log_expire 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mds_migrator 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 3/ 5 mds_quiesce 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 buffer 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 timer 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 filer 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 striper 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 1 objecter 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rados 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_mirror 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_replay 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 rbd_pwl 2024-09-14T11:22:59.508 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 journaler 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objectcacher 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 client 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 osd 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 optracker 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 objclass 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 filestore 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 journal 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 ms 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mon 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 0/10 monc 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 paxos 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 tp 2024-09-14T11:22:59.509 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 auth 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 crypto 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 finisher 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 reserver 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 heartbeatmap 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 perfcounter 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_sync 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_datacache 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_access 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_flight 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:22:59.510 INFO:tasks.workunit.client.0.smithi148.stderr: 20/20 rgw_notification 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 javaclient 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 asok 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 1 throttle 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 0 refs 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 compressor 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluestore 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 bluefs 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 3 bdev 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 kstore 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 4/ 5 rocksdb 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 fuse 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 2/ 5 mgr 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mgrc 2024-09-14T11:22:59.511 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 dpdk 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 eventtrace 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 prioritycache 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 test 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cephsqlite 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_onode 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_odata 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_omap 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_tm 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_t 2024-09-14T11:22:59.512 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_epm 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_lba 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_cache 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_journal 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_device 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 seastore_backref 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 alienstore 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 mclock 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 cyanstore 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 ceph_exporter 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 memstore 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 1/ 5 trace 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: 0/ 5 ceph_dedup 2024-09-14T11:22:59.513 INFO:tasks.workunit.client.0.smithi148.stderr: -2/-2 (syslog threshold) 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 99/99 (stderr threshold) 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc2fffff640 / http_manager 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc38e7e4640 / http_manager 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc38f7e6640 / rgw_dt_lg_renew 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3aaffd640 / ms_dispatch 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3bcff9640 / io_context_pool 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3beffd640 / ms_dispatch 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3c5e03640 / ms_dispatch 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc3c7606640 / io_context_pool 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4d8e38640 / msgr-worker-2 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4d9639640 / msgr-worker-1 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4d9e3a640 / msgr-worker-0 2024-09-14T11:22:59.514 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4da63b640 / io_context_pool 2024-09-14T11:22:59.515 INFO:tasks.workunit.client.0.smithi148.stderr: 7fc4dbb339c0 / radosgw-admin 2024-09-14T11:22:59.515 INFO:tasks.workunit.client.0.smithi148.stderr: max_recent 500 2024-09-14T11:22:59.515 INFO:tasks.workunit.client.0.smithi148.stderr: max_new 1000 2024-09-14T11:22:59.515 INFO:tasks.workunit.client.0.smithi148.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:22:59.384420Z_2296c8c8-40a7-49aa-a88c-ed63fadbc591/log 2024-09-14T11:22:59.515 INFO:tasks.workunit.client.0.smithi148.stderr:--- end dump of recent events --- 2024-09-14T11:22:59.515 INFO:tasks.workunit.client.0.smithi148.stderr:Aborted 2024-09-14T11:22:59.515 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.465+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 realm 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.519 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.469+0000 7f275da6d9c0 20 searching for the correct realm 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.477+0000 7f275ad72640 0 -- 172.21.15.148:0/4093067388 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x560affe481e0 msgr2=0x560affe4a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.481+0000 7f275b573640 0 -- 172.21.15.148:0/4093067388 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f2754067be0 msgr2=0x7f2754083170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:59.520 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 zone default found 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 4 Realm: () 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 zonegroup default 2024-09-14T11:22:59.521 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 started sync module instance, tier type = 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.489+0000 7f275da6d9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 20 add_watcher() i=0 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 20 add_watcher() i=1 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 20 add_watcher() i=2 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 20 add_watcher() i=3 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 20 add_watcher() i=4 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 20 add_watcher() i=5 2024-09-14T11:22:59.522 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 20 add_watcher() i=6 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 20 add_watcher() i=7 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.509+0000 7f275da6d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f2611fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f275da6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f275da6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f275da6d9c0 5 note: GC not initialized 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f2610fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f275da6d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f275da6d9c0 20 Filter name: none 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f258a7fc640 20 reqs_thread_entry: start 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.513+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.523 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:59.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:59.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:59.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.517+0000 7f275da6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:59.524 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.521+0000 7f2611fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.525+0000 7f275da6d9c0 20 remove_watcher() i=0 2024-09-14T11:22:59.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.525+0000 7f275da6d9c0 2 removed watcher, disabling cache 2024-09-14T11:22:59.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.525+0000 7f275da6d9c0 20 remove_watcher() i=1 2024-09-14T11:22:59.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.529+0000 7f275da6d9c0 20 remove_watcher() i=2 2024-09-14T11:22:59.525 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.529+0000 7f275da6d9c0 20 remove_watcher() i=3 2024-09-14T11:22:59.526 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.533+0000 7f275da6d9c0 20 remove_watcher() i=4 2024-09-14T11:22:59.528 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.533+0000 7f275da6d9c0 20 remove_watcher() i=5 2024-09-14T11:22:59.531 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.537+0000 7f275da6d9c0 20 remove_watcher() i=6 2024-09-14T11:22:59.534 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.537+0000 7f275da6d9c0 20 remove_watcher() i=7 2024-09-14T11:22:59.546 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:22:59.546 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:22:59.586 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:22:59.610 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:59.610 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:59.648 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.653+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.653+0000 7f858105f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.653+0000 7f858105f9c0 20 realm 2024-09-14T11:22:59.650 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.653+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:59.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.651 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:59.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.657+0000 7f858105f9c0 20 searching for the correct realm 2024-09-14T11:22:59.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.665+0000 7f857f366640 0 -- 172.21.15.148:0/3003230848 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x561b671e9d30 msgr2=0x561b671ec150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.665 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.669+0000 7f857eb65640 0 -- 172.21.15.148:0/3003230848 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x561b671ee000 msgr2=0x561b671f03f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:59.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:22:59.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:59.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:59.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:59.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:22:59.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.673 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 zone default found 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 4 Realm: () 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 zonegroup default 2024-09-14T11:22:59.674 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.677+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.681+0000 7f858105f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.681+0000 7f858105f9c0 20 started sync module instance, tier type = 2024-09-14T11:22:59.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.681+0000 7f858105f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:22:59.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.697+0000 7f858105f9c0 20 add_watcher() i=0 2024-09-14T11:22:59.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.697+0000 7f858105f9c0 20 add_watcher() i=1 2024-09-14T11:22:59.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.697+0000 7f858105f9c0 20 add_watcher() i=2 2024-09-14T11:22:59.692 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.697+0000 7f858105f9c0 20 add_watcher() i=3 2024-09-14T11:22:59.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.697+0000 7f858105f9c0 20 add_watcher() i=4 2024-09-14T11:22:59.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.697+0000 7f858105f9c0 20 add_watcher() i=5 2024-09-14T11:22:59.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.697+0000 7f858105f9c0 20 add_watcher() i=6 2024-09-14T11:22:59.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.701+0000 7f858105f9c0 20 add_watcher() i=7 2024-09-14T11:22:59.695 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.701+0000 7f858105f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:59.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.701+0000 7f84357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:59.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:59.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 5 note: GC not initialized 2024-09-14T11:22:59.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f83affff640 20 reqs_thread_entry: start 2024-09-14T11:22:59.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:22:59.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 Filter name: none 2024-09-14T11:22:59.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f83adffb640 20 reqs_thread_entry: start 2024-09-14T11:22:59.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:59.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.700 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:59.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:59.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:22:59.701 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:22:59.702 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:22:59.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:22:59.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:22:59.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:22:59.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:22:59.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:22:59.703 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.705+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:22:59.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:22:59.705 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.709+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.713+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:22:59.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.713+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:22:59.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.713+0000 7f858105f9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:22:59.707 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.713+0000 7f858105f9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:22:59.709 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.713+0000 7f84357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.713 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.717+0000 7f858105f9c0 20 remove_watcher() i=0 2024-09-14T11:22:59.713 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.717+0000 7f858105f9c0 2 removed watcher, disabling cache 2024-09-14T11:22:59.715 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.721+0000 7f858105f9c0 20 remove_watcher() i=1 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.721+0000 7f858105f9c0 20 remove_watcher() i=2 2024-09-14T11:22:59.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.721+0000 7f858105f9c0 20 remove_watcher() i=3 2024-09-14T11:22:59.720 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.725+0000 7f858105f9c0 20 remove_watcher() i=4 2024-09-14T11:22:59.722 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.725+0000 7f858105f9c0 20 remove_watcher() i=5 2024-09-14T11:22:59.724 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.729+0000 7f858105f9c0 20 remove_watcher() i=6 2024-09-14T11:22:59.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:22:59.733+0000 7f858105f9c0 20 remove_watcher() i=7 2024-09-14T11:23:29.769 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:23:29.801 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:29.801 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:29.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.848+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:29.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.852+0000 7f4b37ba99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:29.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.852+0000 7f4b37ba99c0 20 realm 2024-09-14T11:23:29.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.852+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:29.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.852+0000 7f4b37ba99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:29.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.852+0000 7f4b37ba99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:29.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.852+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:29.850 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.852+0000 7f4b37ba99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:29.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.852+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:29.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.856+0000 7f4b37ba99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:29.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.856+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:29.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.856+0000 7f4b37ba99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:29.852 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.856+0000 7f4b37ba99c0 20 searching for the correct realm 2024-09-14T11:23:29.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.860+0000 7f4b356af640 0 -- 172.21.15.148:0/3884699685 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f4b28010040 msgr2=0x7f4b2805c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:29.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:29.864+0000 7f4b356af640 0 -- 172.21.15.148:0/3884699685 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x5648d4738120 msgr2=0x7f4b3003f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:30.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:30.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:30.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:30.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:30.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:30.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:30.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:30.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 zone default found 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 4 Realm: () 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 zonegroup default 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.084+0000 7f4b37ba99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.088+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.088+0000 7f4b37ba99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.088+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.088+0000 7f4b37ba99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.088+0000 7f4b37ba99c0 20 started sync module instance, tier type = 2024-09-14T11:23:30.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.088+0000 7f4b37ba99c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:30.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 20 add_watcher() i=0 2024-09-14T11:23:30.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 20 add_watcher() i=1 2024-09-14T11:23:30.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 20 add_watcher() i=2 2024-09-14T11:23:30.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 20 add_watcher() i=3 2024-09-14T11:23:30.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 20 add_watcher() i=4 2024-09-14T11:23:30.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 20 add_watcher() i=5 2024-09-14T11:23:30.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 20 add_watcher() i=6 2024-09-14T11:23:30.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 20 add_watcher() i=7 2024-09-14T11:23:30.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.112+0000 7f4b37ba99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:30.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f49ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:30.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:30.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:30.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 5 note: GC not initialized 2024-09-14T11:23:30.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f49eafe5640 20 reqs_thread_entry: start 2024-09-14T11:23:30.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:30.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 20 Filter name: none 2024-09-14T11:23:30.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f49e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:23:30.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:30.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:30.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:30.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:30.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:23:30.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.120+0000 7f4b37ba99c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.124+0000 7f4b37ba99c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:30.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.124+0000 7f4b37ba99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:30.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.124+0000 7f4b37ba99c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:30.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.124+0000 7f4b37ba99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:30.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.124+0000 7f4b37ba99c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:30.119 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.124+0000 7f4b37ba99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:23:30.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.132+0000 7f49ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:30.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.136+0000 7f4b37ba99c0 20 remove_watcher() i=0 2024-09-14T11:23:30.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.136+0000 7f4b37ba99c0 2 removed watcher, disabling cache 2024-09-14T11:23:30.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.140+0000 7f4b37ba99c0 20 remove_watcher() i=1 2024-09-14T11:23:30.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.140+0000 7f4b37ba99c0 20 remove_watcher() i=2 2024-09-14T11:23:30.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.144+0000 7f4b37ba99c0 20 remove_watcher() i=3 2024-09-14T11:23:30.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.148+0000 7f4b37ba99c0 20 remove_watcher() i=4 2024-09-14T11:23:30.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.148+0000 7f4b37ba99c0 20 remove_watcher() i=5 2024-09-14T11:23:30.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.152+0000 7f4b37ba99c0 20 remove_watcher() i=6 2024-09-14T11:23:30.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.156+0000 7f4b37ba99c0 20 remove_watcher() i=7 2024-09-14T11:23:30.175 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:23:30.209 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:30.209 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:30.253 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.256+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 realm 2024-09-14T11:23:30.255 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:30.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:30.257 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:30.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.260+0000 7faf809e09c0 20 searching for the correct realm 2024-09-14T11:23:30.264 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.268+0000 7faf7dce5640 0 -- 172.21.15.148:0/848593747 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5650283ce8a0 msgr2=0x5650283d0cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:30.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.272+0000 7faf7e4e6640 0 -- 172.21.15.148:0/848593747 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7faf780b8be0 msgr2=0x7faf780e3900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:30.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:30.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:30.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:30.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:30.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:30.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:30.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:30.277 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:30.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 zone default found 2024-09-14T11:23:30.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 4 Realm: () 2024-09-14T11:23:30.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:30.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:30.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:30.278 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 zonegroup default 2024-09-14T11:23:30.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.280+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.284+0000 7faf809e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.284+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.284+0000 7faf809e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.284+0000 7faf809e09c0 20 started sync module instance, tier type = 2024-09-14T11:23:30.280 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.284+0000 7faf809e09c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:30.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.300+0000 7faf809e09c0 20 add_watcher() i=0 2024-09-14T11:23:30.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.300+0000 7faf809e09c0 20 add_watcher() i=1 2024-09-14T11:23:30.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.300+0000 7faf809e09c0 20 add_watcher() i=2 2024-09-14T11:23:30.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.300+0000 7faf809e09c0 20 add_watcher() i=3 2024-09-14T11:23:30.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.300+0000 7faf809e09c0 20 add_watcher() i=4 2024-09-14T11:23:30.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.300+0000 7faf809e09c0 20 add_watcher() i=5 2024-09-14T11:23:30.298 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.300+0000 7faf809e09c0 20 add_watcher() i=6 2024-09-14T11:23:30.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.304+0000 7faf809e09c0 20 add_watcher() i=7 2024-09-14T11:23:30.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.304+0000 7faf809e09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:30.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7fae34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 5 note: GC not initialized 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7fadaf7fe640 20 reqs_thread_entry: start 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 Filter name: none 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7fadad7fa640 20 reqs_thread_entry: start 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:30.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:23:30.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:23:30.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.308+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:23:30.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:23:30.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:23:30.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:23:30.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:23:30.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:23:30.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:23:30.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:23:30.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:23:30.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:23:30.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.312+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:23:30.310 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:23:30.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:23:30.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:23:30.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:23:30.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:23:30.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:23:30.312 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:23:30.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:23:30.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:23:30.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.316+0000 7faf809e09c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:23:30.315 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.320+0000 7fae34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:30.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.324+0000 7faf809e09c0 20 remove_watcher() i=0 2024-09-14T11:23:30.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.324+0000 7faf809e09c0 2 removed watcher, disabling cache 2024-09-14T11:23:30.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.324+0000 7faf809e09c0 20 remove_watcher() i=1 2024-09-14T11:23:30.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.328+0000 7faf809e09c0 20 remove_watcher() i=2 2024-09-14T11:23:30.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.328+0000 7faf809e09c0 20 remove_watcher() i=3 2024-09-14T11:23:30.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.332+0000 7faf809e09c0 20 remove_watcher() i=4 2024-09-14T11:23:30.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.332+0000 7faf809e09c0 20 remove_watcher() i=5 2024-09-14T11:23:30.332 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.336+0000 7faf809e09c0 20 remove_watcher() i=6 2024-09-14T11:23:30.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.340+0000 7faf809e09c0 20 remove_watcher() i=7 2024-09-14T11:23:30.349 INFO:tasks.workunit.client.0.smithi148.stderr:check reshard logrecord successfully 2024-09-14T11:23:30.349 INFO:tasks.workunit.client.0.smithi148.stderr: test: reshard versioned bucket 2024-09-14T11:23:30.349 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:23:30.376 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:30.376 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:30.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.424+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 realm 2024-09-14T11:23:30.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:30.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:30.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:30.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.428+0000 7f2e2b7529c0 20 searching for the correct realm 2024-09-14T11:23:30.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.436+0000 7f2e29258640 0 -- 172.21.15.148:0/864449496 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f2e1c017070 msgr2=0x7f2e1c0659d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:30.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.440+0000 7f2e29258640 0 -- 172.21.15.148:0/864449496 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f2e240fdd50 msgr2=0x7f2e24131900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:30.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:30.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:30.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:30.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:30.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:30.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:30.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:30.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 zone default found 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 4 Realm: () 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 zonegroup default 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 started sync module instance, tier type = 2024-09-14T11:23:30.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.448+0000 7f2e2b7529c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:30.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.468+0000 7f2e2b7529c0 20 add_watcher() i=0 2024-09-14T11:23:30.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.468+0000 7f2e2b7529c0 20 add_watcher() i=1 2024-09-14T11:23:30.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.468+0000 7f2e2b7529c0 20 add_watcher() i=2 2024-09-14T11:23:30.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.468+0000 7f2e2b7529c0 20 add_watcher() i=3 2024-09-14T11:23:30.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.468+0000 7f2e2b7529c0 20 add_watcher() i=4 2024-09-14T11:23:30.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.468+0000 7f2e2b7529c0 20 add_watcher() i=5 2024-09-14T11:23:30.464 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.468+0000 7f2e2b7529c0 20 add_watcher() i=6 2024-09-14T11:23:30.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.472+0000 7f2e2b7529c0 20 add_watcher() i=7 2024-09-14T11:23:30.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.472+0000 7f2e2b7529c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:30.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.472+0000 7f2cdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:30.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:30.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:30.470 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 5 note: GC not initialized 2024-09-14T11:23:30.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2cde7e4640 20 reqs_thread_entry: start 2024-09-14T11:23:30.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:30.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 Filter name: none 2024-09-14T11:23:30.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2c4ffff640 20 reqs_thread_entry: start 2024-09-14T11:23:30.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:30.472 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:30.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:30.473 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:30.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.476+0000 7f2e2b7529c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.480+0000 7f2e2b7529c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:30.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.480+0000 7f2e2b7529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:30.477 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.480+0000 7f2cdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:30.480 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.484+0000 7f2e2b7529c0 20 remove_watcher() i=0 2024-09-14T11:23:30.481 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.484+0000 7f2e2b7529c0 2 removed watcher, disabling cache 2024-09-14T11:23:30.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.488+0000 7f2e2b7529c0 20 remove_watcher() i=1 2024-09-14T11:23:30.484 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.488+0000 7f2e2b7529c0 20 remove_watcher() i=2 2024-09-14T11:23:30.486 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.492+0000 7f2e2b7529c0 20 remove_watcher() i=3 2024-09-14T11:23:30.488 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.492+0000 7f2e2b7529c0 20 remove_watcher() i=4 2024-09-14T11:23:30.491 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.496+0000 7f2e2b7529c0 20 remove_watcher() i=5 2024-09-14T11:23:30.493 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.496+0000 7f2e2b7529c0 20 remove_watcher() i=6 2024-09-14T11:23:30.496 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.500+0000 7f2e2b7529c0 20 remove_watcher() i=7 2024-09-14T11:23:30.510 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:30.510 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:23:30.510 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: myver id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:23:30.510 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:30.510 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:23:30.539 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:30.539 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:30.768 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.772+0000 7efe4d7b5640 0 --2- 172.21.15.148:0/2552159419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bd44850c70 0x55bd449f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:23:30.793 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.796+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 realm 2024-09-14T11:23:30.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:30.796 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:30.797 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:30.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.800+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:30.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.804+0000 7efe4fcaf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:30.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.804+0000 7efe4fcaf9c0 20 searching for the correct realm 2024-09-14T11:23:30.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.808+0000 7efe4d7b5640 0 -- 172.21.15.148:0/2407987304 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7efe4003a050 msgr2=0x7efe40044930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:30.809 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:30.812+0000 7efe4d7b5640 0 -- 172.21.15.148:0/2407987304 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7efe48062280 msgr2=0x7efe4806ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:23:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.028+0000 7efe4fcaf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.028+0000 7efe4fcaf9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.028+0000 7efe4fcaf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.028+0000 7efe4fcaf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.028+0000 7efe4fcaf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.028+0000 7efe4fcaf9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.028 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:31.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 zone default found 2024-09-14T11:23:31.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 4 Realm: () 2024-09-14T11:23:31.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:31.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:31.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:31.029 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 zonegroup default 2024-09-14T11:23:31.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.032+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.036+0000 7efe4fcaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.031 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.036+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.036+0000 7efe4fcaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.036+0000 7efe4fcaf9c0 20 started sync module instance, tier type = 2024-09-14T11:23:31.032 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.036+0000 7efe4fcaf9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:31.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.060+0000 7efe4fcaf9c0 20 add_watcher() i=0 2024-09-14T11:23:31.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.060+0000 7efe4fcaf9c0 20 add_watcher() i=1 2024-09-14T11:23:31.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.060+0000 7efe4fcaf9c0 20 add_watcher() i=2 2024-09-14T11:23:31.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.060+0000 7efe4fcaf9c0 20 add_watcher() i=3 2024-09-14T11:23:31.056 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.060+0000 7efe4fcaf9c0 20 add_watcher() i=4 2024-09-14T11:23:31.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.060+0000 7efe4fcaf9c0 20 add_watcher() i=5 2024-09-14T11:23:31.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.060+0000 7efe4fcaf9c0 20 add_watcher() i=6 2024-09-14T11:23:31.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.064+0000 7efe4fcaf9c0 20 add_watcher() i=7 2024-09-14T11:23:31.059 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.064+0000 7efe4fcaf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:31.063 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efd03fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:31.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efe4fcaf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:31.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efe4fcaf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:31.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efe4fcaf9c0 5 note: GC not initialized 2024-09-14T11:23:31.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efd02fe5640 20 reqs_thread_entry: start 2024-09-14T11:23:31.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efe4fcaf9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:31.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efe4fcaf9c0 20 Filter name: none 2024-09-14T11:23:31.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efd00fe1640 20 reqs_thread_entry: start 2024-09-14T11:23:31.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efe4fcaf9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:23:31.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.068+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:31.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:23:31.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:23:31.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : miss 2024-09-14T11:23:31.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:31.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:31.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:31.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:31.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.072+0000 7efe4fcaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:31.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efe4fcaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:31.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efe4fcaf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:31.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efe4fcaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efe4fcaf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:31.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efd30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94271389285296 notifier 7991 bl.length()=905 2024-09-14T11:23:31.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efd30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:31.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efd30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:31.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efd30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:31.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:31.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:31.081 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.084+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:31.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.0 2024-09-14T11:23:31.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.0 2024-09-14T11:23:31.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.1 2024-09-14T11:23:31.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.1 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.2 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.2 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.3 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.3 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.4 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.4 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.5 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.5 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.6 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.6 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.7 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.7 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.8 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.8 2024-09-14T11:23:31.091 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.9 2024-09-14T11:23:31.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.9 2024-09-14T11:23:31.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.10 2024-09-14T11:23:31.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.10 2024-09-14T11:23:31.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.11 2024-09-14T11:23:31.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.11 2024-09-14T11:23:31.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.092+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.0 2024-09-14T11:23:31.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.096+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1 2024-09-14T11:23:31.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.096+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2 2024-09-14T11:23:31.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.096+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3 2024-09-14T11:23:31.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.096+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.4 2024-09-14T11:23:31.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.096+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.5 2024-09-14T11:23:31.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.096+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.6 2024-09-14T11:23:31.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.100+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.7 2024-09-14T11:23:31.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.100+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.8 2024-09-14T11:23:31.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.100+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.9 2024-09-14T11:23:31.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.100+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.10 2024-09-14T11:23:31.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.100+0000 7efe4fcaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:23:31.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efe4fcaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:31.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efe4fcaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:31.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efe4fcaf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:31.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efe4fcaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efe4fcaf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:31.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efd1ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94271389285296 notifier 7991 bl.length()=905 2024-09-14T11:23:31.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efd1ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:31.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efd1ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:31.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.104+0000 7efd1ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.108+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:31.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.108+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:31.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.108+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:31.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.108+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:31.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.112+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.0 2024-09-14T11:23:31.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.112+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1 2024-09-14T11:23:31.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.112+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2 2024-09-14T11:23:31.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.112+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3 2024-09-14T11:23:31.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.112+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.4 2024-09-14T11:23:31.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.116+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.5 2024-09-14T11:23:31.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.116+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.6 2024-09-14T11:23:31.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.116+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.7 2024-09-14T11:23:31.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.116+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.8 2024-09-14T11:23:31.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.116+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.9 2024-09-14T11:23:31.113 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.116+0000 7efe4fcaf9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.10 2024-09-14T11:23:31.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.116+0000 7efe4fcaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:23:31.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.116+0000 7efe4fcaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:31.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.120+0000 7efe4fcaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:31.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.120+0000 7efe4fcaf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:31.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.120+0000 7efe4fcaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.120+0000 7efe4fcaf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:31.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.120+0000 7efd30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94271389285296 notifier 7991 bl.length()=873 2024-09-14T11:23:31.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.120+0000 7efd30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:31.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.120+0000 7efd30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:31.117 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.120+0000 7efd30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.124+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:31.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.124+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:31.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.124+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:31.120 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.124+0000 7efe4fcaf9c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:31.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.128+0000 7efe4fcaf9c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:23:31.128 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.132+0000 7efd03fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:31.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.136+0000 7efe4fcaf9c0 20 remove_watcher() i=0 2024-09-14T11:23:31.132 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.136+0000 7efe4fcaf9c0 2 removed watcher, disabling cache 2024-09-14T11:23:31.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.140+0000 7efe4fcaf9c0 20 remove_watcher() i=1 2024-09-14T11:23:31.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.140+0000 7efe4fcaf9c0 20 remove_watcher() i=2 2024-09-14T11:23:31.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.144+0000 7efe4fcaf9c0 20 remove_watcher() i=3 2024-09-14T11:23:31.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.144+0000 7efe4fcaf9c0 20 remove_watcher() i=4 2024-09-14T11:23:31.143 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.148+0000 7efe4fcaf9c0 20 remove_watcher() i=5 2024-09-14T11:23:31.145 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.148+0000 7efe4fcaf9c0 20 remove_watcher() i=6 2024-09-14T11:23:31.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.152+0000 7efe4fcaf9c0 20 remove_watcher() i=7 2024-09-14T11:23:31.166 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:23:31.196 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:31.196 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:31.239 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.244+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.244+0000 7f0e6451e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.244+0000 7f0e6451e9c0 20 realm 2024-09-14T11:23:31.242 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.244+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:31.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.243 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:31.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.248+0000 7f0e6451e9c0 20 searching for the correct realm 2024-09-14T11:23:31.250 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.256+0000 7f0e61823640 0 -- 172.21.15.148:0/2864289254 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f0e5c0ab070 msgr2=0x7f0e5c0c7920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:31.256 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.260+0000 7f0e62825640 0 -- 172.21.15.148:0/2864289254 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x557c126669a0 msgr2=0x557c12668df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:23:31.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:31.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:31.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:31.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:31.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:31.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:31.265 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.266 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:31.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 zone default found 2024-09-14T11:23:31.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 4 Realm: () 2024-09-14T11:23:31.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:31.267 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:31.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:31.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 zonegroup default 2024-09-14T11:23:31.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.268+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.272+0000 7f0e6451e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.272+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.272+0000 7f0e6451e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.272+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.272+0000 7f0e6451e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.272+0000 7f0e6451e9c0 20 started sync module instance, tier type = 2024-09-14T11:23:31.269 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.272+0000 7f0e6451e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:31.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 20 add_watcher() i=0 2024-09-14T11:23:31.286 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 20 add_watcher() i=1 2024-09-14T11:23:31.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 20 add_watcher() i=2 2024-09-14T11:23:31.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 20 add_watcher() i=3 2024-09-14T11:23:31.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 20 add_watcher() i=4 2024-09-14T11:23:31.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 20 add_watcher() i=5 2024-09-14T11:23:31.287 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 20 add_watcher() i=6 2024-09-14T11:23:31.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 20 add_watcher() i=7 2024-09-14T11:23:31.289 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.292+0000 7f0e6451e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:31.292 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0d18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:31.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0e6451e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:31.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0e6451e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:31.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0e6451e9c0 5 note: GC not initialized 2024-09-14T11:23:31.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0c937fe640 20 reqs_thread_entry: start 2024-09-14T11:23:31.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0e6451e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:31.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0e6451e9c0 20 Filter name: none 2024-09-14T11:23:31.293 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0c917fa640 20 reqs_thread_entry: start 2024-09-14T11:23:31.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0e6451e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:31.294 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.296+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.300+0000 7f0e6451e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:31.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.300+0000 7f0e6451e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:31.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.300+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.295 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.300+0000 7f0e6451e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:31.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.300+0000 7f0e6451e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.300+0000 7f0e6451e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:31.296 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.300+0000 7f0e6451e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:31.299 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.304+0000 7f0d18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:31.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.308+0000 7f0e6451e9c0 20 remove_watcher() i=0 2024-09-14T11:23:31.303 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.308+0000 7f0e6451e9c0 2 removed watcher, disabling cache 2024-09-14T11:23:31.305 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.308+0000 7f0e6451e9c0 20 remove_watcher() i=1 2024-09-14T11:23:31.307 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.312+0000 7f0e6451e9c0 20 remove_watcher() i=2 2024-09-14T11:23:31.309 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.312+0000 7f0e6451e9c0 20 remove_watcher() i=3 2024-09-14T11:23:31.311 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.316+0000 7f0e6451e9c0 20 remove_watcher() i=4 2024-09-14T11:23:31.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.316+0000 7f0e6451e9c0 20 remove_watcher() i=5 2024-09-14T11:23:31.316 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.320+0000 7f0e6451e9c0 20 remove_watcher() i=6 2024-09-14T11:23:31.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:31.324+0000 7f0e6451e9c0 20 remove_watcher() i=7 2024-09-14T11:23:31.332 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:31.332 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:23:31.333 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: myver id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:23:31.333 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:31.334 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:31.334 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:31.353 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:31.353 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:31.416 INFO:tasks.workunit.client.0.smithi148.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:23:31.423 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:31.423 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:31.566 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:31.566 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:32.279 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:23:32.313 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:32.314 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:32.359 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.364+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.364+0000 7f3b88de79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.364+0000 7f3b88de79c0 20 realm 2024-09-14T11:23:32.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.364+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.364+0000 7f3b88de79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.364+0000 7f3b88de79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:32.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.364+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.368+0000 7f3b88de79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.368+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.368+0000 7f3b88de79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:32.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.368+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.368+0000 7f3b88de79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:32.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.368+0000 7f3b88de79c0 20 searching for the correct realm 2024-09-14T11:23:32.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.372+0000 7f3b868ed640 0 -- 172.21.15.148:0/2588041932 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f3b78066c50 msgr2=0x7f3b7805f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:32.582 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.584+0000 7f3b868ed640 0 -- 172.21.15.148:0/2588041932 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x56026189eb50 msgr2=0x7f3b800d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:23:32.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.800+0000 7f3b88de79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:32.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.800+0000 7f3b88de79c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:32.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.800+0000 7f3b88de79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:32.798 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.800+0000 7f3b88de79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:32.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.800+0000 7f3b88de79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:32.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.800+0000 7f3b88de79c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:32.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.800+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.799 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:32.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 zone default found 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 4 Realm: () 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 zonegroup default 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.804+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.808+0000 7f3b88de79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.808+0000 7f3b88de79c0 20 started sync module instance, tier type = 2024-09-14T11:23:32.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.808+0000 7f3b88de79c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:32.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.828+0000 7f3b88de79c0 20 add_watcher() i=0 2024-09-14T11:23:32.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.828+0000 7f3b88de79c0 20 add_watcher() i=1 2024-09-14T11:23:32.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.828+0000 7f3b88de79c0 20 add_watcher() i=2 2024-09-14T11:23:32.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.828+0000 7f3b88de79c0 20 add_watcher() i=3 2024-09-14T11:23:32.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.828+0000 7f3b88de79c0 20 add_watcher() i=4 2024-09-14T11:23:32.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.828+0000 7f3b88de79c0 20 add_watcher() i=5 2024-09-14T11:23:32.826 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.828+0000 7f3b88de79c0 20 add_watcher() i=6 2024-09-14T11:23:32.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.832+0000 7f3b88de79c0 20 add_watcher() i=7 2024-09-14T11:23:32.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.832+0000 7f3b88de79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:32.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.836+0000 7f3a3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:32.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.836+0000 7f3b88de79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:32.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.836+0000 7f3b88de79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:32.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.836+0000 7f3b88de79c0 5 note: GC not initialized 2024-09-14T11:23:32.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f39b7fff640 20 reqs_thread_entry: start 2024-09-14T11:23:32.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:32.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 Filter name: none 2024-09-14T11:23:32.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f39b5ffb640 20 reqs_thread_entry: start 2024-09-14T11:23:32.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:32.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:32.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:32.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:32.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.840+0000 7f3b88de79c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.844+0000 7f3b88de79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:32.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.844+0000 7f3b88de79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:32.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.844+0000 7f3a3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:32.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.852+0000 7f3b88de79c0 20 remove_watcher() i=0 2024-09-14T11:23:32.846 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.852+0000 7f3b88de79c0 2 removed watcher, disabling cache 2024-09-14T11:23:32.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.852+0000 7f3b88de79c0 20 remove_watcher() i=1 2024-09-14T11:23:32.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.856+0000 7f3b88de79c0 20 remove_watcher() i=2 2024-09-14T11:23:32.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.856+0000 7f3b88de79c0 20 remove_watcher() i=3 2024-09-14T11:23:32.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.860+0000 7f3b88de79c0 20 remove_watcher() i=4 2024-09-14T11:23:32.858 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.860+0000 7f3b88de79c0 20 remove_watcher() i=5 2024-09-14T11:23:32.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.864+0000 7f3b88de79c0 20 remove_watcher() i=6 2024-09-14T11:23:32.864 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.868+0000 7f3b88de79c0 20 remove_watcher() i=7 2024-09-14T11:23:32.880 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:32.880 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:23:32.880 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: a-bucket id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:23:32.880 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:32.881 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:23:32.911 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:32.911 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:32.957 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.960+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 realm 2024-09-14T11:23:32.960 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:32.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:32.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:32.962 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.964+0000 7f58334cd9c0 20 searching for the correct realm 2024-09-14T11:23:32.968 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.972+0000 7f58307d2640 0 -- 172.21.15.148:0/2918808361 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x558e125e3d40 msgr2=0x558e125e6130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:32.973 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.976+0000 7f5830fd3640 0 -- 172.21.15.148:0/2918808361 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f5828061c70 msgr2=0x7f582806a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:32.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:32.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:32.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:32.980 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:32.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:32.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:32.981 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 zone default found 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 4 Realm: () 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 zonegroup default 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.984+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.988+0000 7f58334cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.988+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.988+0000 7f58334cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.983 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.988+0000 7f58334cd9c0 20 started sync module instance, tier type = 2024-09-14T11:23:32.984 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:32.988+0000 7f58334cd9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:33.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.004+0000 7f58334cd9c0 20 add_watcher() i=0 2024-09-14T11:23:33.001 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.004+0000 7f58334cd9c0 20 add_watcher() i=1 2024-09-14T11:23:33.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.004+0000 7f58334cd9c0 20 add_watcher() i=2 2024-09-14T11:23:33.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.004+0000 7f58334cd9c0 20 add_watcher() i=3 2024-09-14T11:23:33.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.004+0000 7f58334cd9c0 20 add_watcher() i=4 2024-09-14T11:23:33.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.004+0000 7f58334cd9c0 20 add_watcher() i=5 2024-09-14T11:23:33.002 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.004+0000 7f58334cd9c0 20 add_watcher() i=6 2024-09-14T11:23:33.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.008+0000 7f58334cd9c0 20 add_watcher() i=7 2024-09-14T11:23:33.004 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.008+0000 7f58334cd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:33.007 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f56e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:33.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:33.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 5 note: GC not initialized 2024-09-14T11:23:33.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f56e5fe3640 20 reqs_thread_entry: start 2024-09-14T11:23:33.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:33.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 Filter name: none 2024-09-14T11:23:33.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f56577fe640 20 reqs_thread_entry: start 2024-09-14T11:23:33.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:33.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:33.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.012+0000 7f58334cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:33.010 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.016+0000 7f56e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.020+0000 7f58334cd9c0 20 remove_watcher() i=0 2024-09-14T11:23:33.014 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.020+0000 7f58334cd9c0 2 removed watcher, disabling cache 2024-09-14T11:23:33.016 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.020+0000 7f58334cd9c0 20 remove_watcher() i=1 2024-09-14T11:23:33.018 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.024+0000 7f58334cd9c0 20 remove_watcher() i=2 2024-09-14T11:23:33.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.024+0000 7f58334cd9c0 20 remove_watcher() i=3 2024-09-14T11:23:33.022 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.024+0000 7f58334cd9c0 20 remove_watcher() i=4 2024-09-14T11:23:33.024 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.028+0000 7f58334cd9c0 20 remove_watcher() i=5 2024-09-14T11:23:33.027 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.032+0000 7f58334cd9c0 20 remove_watcher() i=6 2024-09-14T11:23:33.030 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.032+0000 7f58334cd9c0 20 remove_watcher() i=7 2024-09-14T11:23:33.044 INFO:tasks.workunit.client.0.smithi148.stderr:rados -p default.rgw.buckets.index setomapval .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:23:33.070 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:33.071 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:33.089 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:23:33.115 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:33.115 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:33.156 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.160+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 realm 2024-09-14T11:23:33.158 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:33.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:33.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:33.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.164+0000 7f60293ab9c0 20 searching for the correct realm 2024-09-14T11:23:33.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.168+0000 7f60266b0640 0 -- 172.21.15.148:0/1774853467 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f6020013420 msgr2=0x7f60200138a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:33.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.380+0000 7f60276b2640 0 -- 172.21.15.148:0/1774853467 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5630ea1a75b0 msgr2=0x5630ea1a99a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:33.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.392+0000 7f60293ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:33.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.392+0000 7f60293ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:33.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.392+0000 7f60293ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:33.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.392+0000 7f60293ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:33.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.392+0000 7f60293ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:33.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.392+0000 7f60293ab9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:33.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.392+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:33.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:33.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 zone default found 2024-09-14T11:23:33.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 4 Realm: () 2024-09-14T11:23:33.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:33.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:33.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:33.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 zonegroup default 2024-09-14T11:23:33.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.396+0000 7f60293ab9c0 20 started sync module instance, tier type = 2024-09-14T11:23:33.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.400+0000 7f60293ab9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:33.418 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.420+0000 7f60293ab9c0 20 add_watcher() i=0 2024-09-14T11:23:33.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.420+0000 7f60293ab9c0 20 add_watcher() i=1 2024-09-14T11:23:33.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.420+0000 7f60293ab9c0 20 add_watcher() i=2 2024-09-14T11:23:33.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.420+0000 7f60293ab9c0 20 add_watcher() i=3 2024-09-14T11:23:33.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.420+0000 7f60293ab9c0 20 add_watcher() i=4 2024-09-14T11:23:33.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.420+0000 7f60293ab9c0 20 add_watcher() i=5 2024-09-14T11:23:33.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.420+0000 7f60293ab9c0 20 add_watcher() i=6 2024-09-14T11:23:33.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.424+0000 7f60293ab9c0 20 add_watcher() i=7 2024-09-14T11:23:33.421 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.424+0000 7f60293ab9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:33.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.428+0000 7f5edd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.428+0000 7f60293ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:33.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.428+0000 7f60293ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:33.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.428+0000 7f60293ab9c0 5 note: GC not initialized 2024-09-14T11:23:33.426 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.428+0000 7f5e57fff640 20 reqs_thread_entry: start 2024-09-14T11:23:33.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:33.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 Filter name: none 2024-09-14T11:23:33.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f5e55ffb640 20 reqs_thread_entry: start 2024-09-14T11:23:33.427 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:33.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:33.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:33.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:23:33.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 INFO: main: starting shard=0 2024-09-14T11:23:33.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:23:33.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:23:33.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:23:33.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 INFO: main: starting shard=1 2024-09-14T11:23:33.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:23:33.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:23:33.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.430 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 INFO: main: starting shard=2 2024-09-14T11:23:33.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:23:33.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.432+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:23:33.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 INFO: main: starting shard=3 2024-09-14T11:23:33.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:23:33.431 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:23:33.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 INFO: main: starting shard=4 2024-09-14T11:23:33.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:23:33.432 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:23:33.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 INFO: main: starting shard=5 2024-09-14T11:23:33.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:23:33.433 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:23:33.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 INFO: main: starting shard=6 2024-09-14T11:23:33.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:23:33.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.436+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:23:33.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 INFO: main: starting shard=7 2024-09-14T11:23:33.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:23:33.436 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:23:33.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 INFO: main: starting shard=8 2024-09-14T11:23:33.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:23:33.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:23:33.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 INFO: main: starting shard=9 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 INFO: main: starting shard=10 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.440+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:23:33.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 20 INFO: main: starting shard=11 2024-09-14T11:23:33.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:23:33.439 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:23:33.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 20 INFO: main: starting shard=12 2024-09-14T11:23:33.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:23:33.440 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:23:33.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.444+0000 7f60293ab9c0 20 INFO: main: done 2024-09-14T11:23:33.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.448+0000 7f5edd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.452+0000 7f60293ab9c0 20 remove_watcher() i=0 2024-09-14T11:23:33.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.452+0000 7f60293ab9c0 2 removed watcher, disabling cache 2024-09-14T11:23:33.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.452+0000 7f60293ab9c0 20 remove_watcher() i=1 2024-09-14T11:23:33.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.456+0000 7f60293ab9c0 20 remove_watcher() i=2 2024-09-14T11:23:33.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.456+0000 7f60293ab9c0 20 remove_watcher() i=3 2024-09-14T11:23:33.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.460+0000 7f60293ab9c0 20 remove_watcher() i=4 2024-09-14T11:23:33.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.460+0000 7f60293ab9c0 20 remove_watcher() i=5 2024-09-14T11:23:33.460 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.464+0000 7f60293ab9c0 20 remove_watcher() i=6 2024-09-14T11:23:33.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.468+0000 7f60293ab9c0 20 remove_watcher() i=7 2024-09-14T11:23:33.479 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:23:33.510 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:33.510 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:33.554 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.556+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.560+0000 7fbed8a469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.560+0000 7fbed8a469c0 20 realm 2024-09-14T11:23:33.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.560+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.560+0000 7fbed8a469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.560+0000 7fbed8a469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:33.557 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.560+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.560+0000 7fbed8a469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.560+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.564+0000 7fbed8a469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:33.558 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.564+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.564+0000 7fbed8a469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:33.559 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.564+0000 7fbed8a469c0 20 searching for the correct realm 2024-09-14T11:23:33.565 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.568+0000 7fbed5d4b640 0 -- 172.21.15.148:0/4109385077 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5647fb896c90 msgr2=0x5647fb899080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:33.571 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.576+0000 7fbed654c640 0 -- 172.21.15.148:0/4109385077 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fbed0067830 msgr2=0x7fbed00831d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:33.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:33.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:33.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:33.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:33.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:33.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:33.578 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.580+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:33.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:33.579 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 zone default found 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 4 Realm: () 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 zonegroup default 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 started sync module instance, tier type = 2024-09-14T11:23:33.581 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.584+0000 7fbed8a469c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:33.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.604+0000 7fbed8a469c0 20 add_watcher() i=0 2024-09-14T11:23:33.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.604+0000 7fbed8a469c0 20 add_watcher() i=1 2024-09-14T11:23:33.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.604+0000 7fbed8a469c0 20 add_watcher() i=2 2024-09-14T11:23:33.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.604+0000 7fbed8a469c0 20 add_watcher() i=3 2024-09-14T11:23:33.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.604+0000 7fbed8a469c0 20 add_watcher() i=4 2024-09-14T11:23:33.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.604+0000 7fbed8a469c0 20 add_watcher() i=5 2024-09-14T11:23:33.600 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.604+0000 7fbed8a469c0 20 add_watcher() i=6 2024-09-14T11:23:33.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.608+0000 7fbed8a469c0 20 add_watcher() i=7 2024-09-14T11:23:33.602 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.608+0000 7fbed8a469c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:33.605 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.608+0000 7fbd8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.608+0000 7fbed8a469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:33.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.608+0000 7fbed8a469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:33.606 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.608+0000 7fbed8a469c0 5 note: GC not initialized 2024-09-14T11:23:33.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbd077fe640 20 reqs_thread_entry: start 2024-09-14T11:23:33.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:33.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 20 Filter name: none 2024-09-14T11:23:33.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbd057fa640 20 reqs_thread_entry: start 2024-09-14T11:23:33.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:33.607 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:33.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:33.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:33.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : miss 2024-09-14T11:23:33.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:33.608 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:33.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:33.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:33.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:33.609 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.612+0000 7fbed8a469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:23:33.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbed8a469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:33.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbed8a469c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:33.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbed8a469c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:33.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbed8a469c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:23:33.616 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbdb97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366283 cookie 94867162788352 notifier 8619 bl.length()=911 2024-09-14T11:23:33.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbdb97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:33.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbdb97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:33.617 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbdb97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:33.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:23:33.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:23:33.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:23:33.618 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.620+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:23:33.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.632+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:23:33.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.632+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:23:33.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.632+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:23:33.630 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.632+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:23:33.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.632+0000 7fbed8a469c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:23:33.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.632+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:23:33.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.632+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:23:33.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:23:33.631 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:23:33.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:23:33.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:23:33.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:23:33.632 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:23:33.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:23:33.633 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:23:33.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:23:33.634 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.636+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:23:33.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.640+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:23:33.635 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.640+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:23:33.636 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.640+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:23:33.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.640+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:23:33.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.640+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:23:33.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.640+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:23:33.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.640+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:23:33.637 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.640+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:23:33.638 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.644+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:23:33.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.644+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:23:33.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.644+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:23:33.639 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.644+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:23:33.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.644+0000 7fbed8a469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:23:33.640 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.644+0000 7fbed8a469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:23:33.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbed8a469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:33.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbed8a469c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:33.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbed8a469c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:33.643 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbed8a469c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:23:33.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbdb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366284 cookie 94867162788352 notifier 8619 bl.length()=911 2024-09-14T11:23:33.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbdb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:33.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbdb9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:33.644 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbdb9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:33.645 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:23:33.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:23:33.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:23:33.646 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.648+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:23:33.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:23:33.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.0 2024-09-14T11:23:33.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:23:33.652 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.1 2024-09-14T11:23:33.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:23:33.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.2 2024-09-14T11:23:33.653 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:23:33.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.3 2024-09-14T11:23:33.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:23:33.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.656+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.4 2024-09-14T11:23:33.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:23:33.654 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.5 2024-09-14T11:23:33.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:23:33.655 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.6 2024-09-14T11:23:33.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:23:33.656 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.7 2024-09-14T11:23:33.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:23:33.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.8 2024-09-14T11:23:33.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:23:33.657 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.9 2024-09-14T11:23:33.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:23:33.658 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.660+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.10 2024-09-14T11:23:33.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.664+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:23:33.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.664+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.11 2024-09-14T11:23:33.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.664+0000 7fbed8a469c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:23:33.659 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.664+0000 7fbed8a469c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.2.12 2024-09-14T11:23:33.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.664+0000 7fbed8a469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:23:33.660 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.664+0000 7fbed8a469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 2024-09-14T11:23:33.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbed8a469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:33.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbed8a469c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:33.663 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbed8a469c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:33.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbed8a469c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18, ofs0, ns] 2024-09-14T11:23:33.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbdb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366285 cookie 94867162788352 notifier 8619 bl.length()=879 2024-09-14T11:23:33.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbdb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 info.flags=0x17 2024-09-14T11:23:33.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbdb9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18 to cache LRU end 2024-09-14T11:23:33.664 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbdb9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:33.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_sources= new_sources= 2024-09-14T11:23:33.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential sources added=[] removed=[] 2024-09-14T11:23:33.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): orig_dests= new_dests= 2024-09-14T11:23:33.666 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.668+0000 7fbed8a469c0 20 handle_bi_update(): bucket=:a-bucket[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18]): potential dests added=[] removed=[] 2024-09-14T11:23:33.671 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.676+0000 7fbed8a469c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:23:33.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.680+0000 7fbd8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.679 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.684+0000 7fbed8a469c0 20 remove_watcher() i=0 2024-09-14T11:23:33.680 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.684+0000 7fbed8a469c0 2 removed watcher, disabling cache 2024-09-14T11:23:33.682 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.684+0000 7fbed8a469c0 20 remove_watcher() i=1 2024-09-14T11:23:33.684 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.688+0000 7fbed8a469c0 20 remove_watcher() i=2 2024-09-14T11:23:33.686 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.692+0000 7fbed8a469c0 20 remove_watcher() i=3 2024-09-14T11:23:33.688 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.692+0000 7fbed8a469c0 20 remove_watcher() i=4 2024-09-14T11:23:33.690 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.696+0000 7fbed8a469c0 20 remove_watcher() i=5 2024-09-14T11:23:33.693 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.696+0000 7fbed8a469c0 20 remove_watcher() i=6 2024-09-14T11:23:33.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.700+0000 7fbed8a469c0 20 remove_watcher() i=7 2024-09-14T11:23:33.713 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:23:33.744 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:33.744 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:33.786 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 20 realm 2024-09-14T11:23:33.789 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:33.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.790 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.792+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.796+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:33.791 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.796+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.796+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:33.792 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.796+0000 7fd3b5a2a9c0 20 searching for the correct realm 2024-09-14T11:23:33.800 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.804+0000 7fd3b3530640 0 -- 172.21.15.148:0/1138166916 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5646fc6629b0 msgr2=0x5646fc664da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:33.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.808+0000 7fd3b3d31640 0 -- 172.21.15.148:0/1138166916 >> [v2:172.21.15.150:6800/2640697978,v1:172.21.15.150:6801/2640697978] conn(0x7fd3a4056b10 msgr2=0x7fd3a4064450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:33.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:33.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:33.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:33.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:33.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:33.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:33.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:33.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 zone default found 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 4 Realm: () 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 zonegroup default 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.814 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 started sync module instance, tier type = 2024-09-14T11:23:33.815 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.816+0000 7fd3b5a2a9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:33.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.836+0000 7fd3b5a2a9c0 20 add_watcher() i=0 2024-09-14T11:23:33.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.836+0000 7fd3b5a2a9c0 20 add_watcher() i=1 2024-09-14T11:23:33.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.836+0000 7fd3b5a2a9c0 20 add_watcher() i=2 2024-09-14T11:23:33.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.836+0000 7fd3b5a2a9c0 20 add_watcher() i=3 2024-09-14T11:23:33.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.836+0000 7fd3b5a2a9c0 20 add_watcher() i=4 2024-09-14T11:23:33.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.836+0000 7fd3b5a2a9c0 20 add_watcher() i=5 2024-09-14T11:23:33.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.836+0000 7fd3b5a2a9c0 20 add_watcher() i=6 2024-09-14T11:23:33.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.840+0000 7fd3b5a2a9c0 20 add_watcher() i=7 2024-09-14T11:23:33.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.840+0000 7fd3b5a2a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:33.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd269fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:33.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:33.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 5 note: GC not initialized 2024-09-14T11:23:33.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd268fe1640 20 reqs_thread_entry: start 2024-09-14T11:23:33.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:33.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 Filter name: none 2024-09-14T11:23:33.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd1e27fc640 20 reqs_thread_entry: start 2024-09-14T11:23:33.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:33.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:33.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:33.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:23:33.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 INFO: main: starting shard=0 2024-09-14T11:23:33.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:23:33.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.844+0000 7fd3b5a2a9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18.3.0 2024-09-14T11:23:33.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.848+0000 7fd3b5a2a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:33.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.848+0000 7fd3b5a2a9c0 20 INFO: main: done 2024-09-14T11:23:33.843 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.848+0000 7fd269fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.852+0000 7fd3b5a2a9c0 20 remove_watcher() i=0 2024-09-14T11:23:33.848 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.852+0000 7fd3b5a2a9c0 2 removed watcher, disabling cache 2024-09-14T11:23:33.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.852+0000 7fd3b5a2a9c0 20 remove_watcher() i=1 2024-09-14T11:23:33.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.856+0000 7fd3b5a2a9c0 20 remove_watcher() i=2 2024-09-14T11:23:33.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.856+0000 7fd3b5a2a9c0 20 remove_watcher() i=3 2024-09-14T11:23:33.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.860+0000 7fd3b5a2a9c0 20 remove_watcher() i=4 2024-09-14T11:23:33.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.860+0000 7fd3b5a2a9c0 20 remove_watcher() i=5 2024-09-14T11:23:33.860 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.864+0000 7fd3b5a2a9c0 20 remove_watcher() i=6 2024-09-14T11:23:33.862 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.864+0000 7fd3b5a2a9c0 20 remove_watcher() i=7 2024-09-14T11:23:33.875 INFO:tasks.workunit.client.0.smithi148.stderr: test: PUT succeeds during reshard 2024-09-14T11:23:33.876 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:23:33.902 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:33.902 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:33.944 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.948+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.946 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 realm 2024-09-14T11:23:33.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:33.947 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:33.948 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:33.949 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.952+0000 7fbd958489c0 20 searching for the correct realm 2024-09-14T11:23:33.955 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.960+0000 7fbd92b4d640 0 -- 172.21.15.148:0/2528803975 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5617286a6690 msgr2=0x5617286a8a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:23:33.961 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.964+0000 7fbd9334e640 0 -- 172.21.15.148:0/2528803975 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fbd8c10ea20 msgr2=0x7fbd8c0ee0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:33.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:33.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:33.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:33.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:33.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:33.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:33.969 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:33.970 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 zone default found 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 4 Realm: () 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 zonegroup default 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.972+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.976+0000 7fbd958489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.976+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.976+0000 7fbd958489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.976+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.976+0000 7fbd958489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:33.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.976+0000 7fbd958489c0 20 started sync module instance, tier type = 2024-09-14T11:23:33.972 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.976+0000 7fbd958489c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:33.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.992+0000 7fbd958489c0 20 add_watcher() i=0 2024-09-14T11:23:33.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.992+0000 7fbd958489c0 20 add_watcher() i=1 2024-09-14T11:23:33.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.992+0000 7fbd958489c0 20 add_watcher() i=2 2024-09-14T11:23:33.990 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.992+0000 7fbd958489c0 20 add_watcher() i=3 2024-09-14T11:23:33.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.992+0000 7fbd958489c0 20 add_watcher() i=4 2024-09-14T11:23:33.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.992+0000 7fbd958489c0 20 add_watcher() i=5 2024-09-14T11:23:33.991 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.996+0000 7fbd958489c0 20 add_watcher() i=6 2024-09-14T11:23:33.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.996+0000 7fbd958489c0 20 add_watcher() i=7 2024-09-14T11:23:33.993 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:33.996+0000 7fbd958489c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:33.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbc49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:33.996 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbd958489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:33.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbd958489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:33.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbd958489c0 5 note: GC not initialized 2024-09-14T11:23:33.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbc48fe1640 20 reqs_thread_entry: start 2024-09-14T11:23:33.997 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbd958489c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:33.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbd958489c0 20 Filter name: none 2024-09-14T11:23:33.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbbc27fc640 20 reqs_thread_entry: start 2024-09-14T11:23:33.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.000+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:33.998 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:33.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:33.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:33.999 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:34.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:34.000 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.004+0000 7fbd958489c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:34.003 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.008+0000 7fbc49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:34.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.012+0000 7fbd958489c0 20 remove_watcher() i=0 2024-09-14T11:23:34.008 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.012+0000 7fbd958489c0 2 removed watcher, disabling cache 2024-09-14T11:23:34.009 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.012+0000 7fbd958489c0 20 remove_watcher() i=1 2024-09-14T11:23:34.011 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.016+0000 7fbd958489c0 20 remove_watcher() i=2 2024-09-14T11:23:34.013 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.016+0000 7fbd958489c0 20 remove_watcher() i=3 2024-09-14T11:23:34.015 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.020+0000 7fbd958489c0 20 remove_watcher() i=4 2024-09-14T11:23:34.017 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.020+0000 7fbd958489c0 20 remove_watcher() i=5 2024-09-14T11:23:34.020 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.024+0000 7fbd958489c0 20 remove_watcher() i=6 2024-09-14T11:23:34.023 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.028+0000 7fbd958489c0 20 remove_watcher() i=7 2024-09-14T11:23:34.037 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:34.037 INFO:tasks.workunit.client.0.smithi148.stderr:BUCKET_STATS: 2024-09-14T11:23:34.037 INFO:tasks.workunit.client.0.smithi148.stderr:bucket: myver id: de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:23:34.037 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:34.038 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:23:34.069 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:34.069 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:34.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.116+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:34.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 realm 2024-09-14T11:23:34.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:34.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:34.115 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:34.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:34.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:34.118 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.120+0000 7f06e2ae89c0 20 searching for the correct realm 2024-09-14T11:23:34.123 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.128+0000 7f06dfded640 0 -- 172.21.15.148:0/2765098365 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55f21ecc77c0 msgr2=0x55f21ecc9bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:34.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.132+0000 7f06e05ee640 0 -- 172.21.15.148:0/2765098365 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f06d803c950 msgr2=0x7f06d8019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:34.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:34.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:34.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:34.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:34.136 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:34.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:34.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:34.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.137 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:34.138 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.139 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 zone default found 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 4 Realm: () 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 zonegroup default 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.140+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.144+0000 7f06e2ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.144+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.144+0000 7f06e2ae89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:34.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.144+0000 7f06e2ae89c0 20 started sync module instance, tier type = 2024-09-14T11:23:34.141 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.144+0000 7f06e2ae89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.160+0000 7f06e2ae89c0 20 add_watcher() i=0 2024-09-14T11:23:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.160+0000 7f06e2ae89c0 20 add_watcher() i=1 2024-09-14T11:23:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.160+0000 7f06e2ae89c0 20 add_watcher() i=2 2024-09-14T11:23:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.160+0000 7f06e2ae89c0 20 add_watcher() i=3 2024-09-14T11:23:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.160+0000 7f06e2ae89c0 20 add_watcher() i=4 2024-09-14T11:23:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.160+0000 7f06e2ae89c0 20 add_watcher() i=5 2024-09-14T11:23:34.157 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.160+0000 7f06e2ae89c0 20 add_watcher() i=6 2024-09-14T11:23:34.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.164+0000 7f06e2ae89c0 20 add_watcher() i=7 2024-09-14T11:23:34.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.164+0000 7f06e2ae89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:34.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f0596fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:34.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:34.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:34.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 5 note: GC not initialized 2024-09-14T11:23:34.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f0595fdb640 20 reqs_thread_entry: start 2024-09-14T11:23:34.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:34.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 20 Filter name: none 2024-09-14T11:23:34.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f05077fe640 20 reqs_thread_entry: start 2024-09-14T11:23:34.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:23:34.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:34.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:23:34.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : miss 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 adding default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.168+0000 7f06e2ae89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:34.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.176+0000 7f06e2ae89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:34.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.176+0000 7f06e2ae89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:34.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.176+0000 7f06e2ae89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:34.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.176+0000 7f06e2ae89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:34.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.176+0000 7f05b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366188 cookie 94498387198944 notifier 8129 bl.length()=905 2024-09-14T11:23:34.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.176+0000 7f05b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:34.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.176+0000 7f05b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:34.175 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.180+0000 7f05b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:34.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.180+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:34.176 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.180+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:34.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.180+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:34.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.180+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:34.189 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:34.192+0000 7f06e2ae89c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:23:35.042 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:35.042 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:35.208 INFO:tasks.workunit.client.0.smithi148.stderr:put object successful 2024-09-14T11:23:39.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:39.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:39.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:39.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:39.190 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:39.191 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:39.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:39.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:39.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:39.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:39.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:39.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:39.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.0 2024-09-14T11:23:39.192 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.192+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.0 2024-09-14T11:23:39.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.196+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.1 2024-09-14T11:23:39.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.196+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.1 2024-09-14T11:23:39.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.196+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.2 2024-09-14T11:23:39.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.196+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.2 2024-09-14T11:23:39.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.196+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.3 2024-09-14T11:23:39.194 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.196+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.3 2024-09-14T11:23:39.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.200+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.4 2024-09-14T11:23:39.195 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.200+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.4 2024-09-14T11:23:39.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.200+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.5 2024-09-14T11:23:39.197 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.200+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.5 2024-09-14T11:23:39.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.204+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.6 2024-09-14T11:23:39.199 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.204+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.6 2024-09-14T11:23:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.204+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.7 2024-09-14T11:23:39.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.204+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.7 2024-09-14T11:23:39.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.204+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.8 2024-09-14T11:23:39.201 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.204+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.8 2024-09-14T11:23:39.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.208+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.9 2024-09-14T11:23:39.203 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.208+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.9 2024-09-14T11:23:39.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.208+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.10 2024-09-14T11:23:39.205 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.208+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.10 2024-09-14T11:23:39.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.208+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.11 2024-09-14T11:23:39.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.208+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.11 2024-09-14T11:23:39.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.216+0000 7f06e2ae89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:23:39.211 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.216+0000 7f06e2ae89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:39.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.216+0000 7f06e2ae89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:39.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.216+0000 7f06e2ae89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:39.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.216+0000 7f06e2ae89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:39.214 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.216+0000 7f06e2ae89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:39.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.220+0000 7f05b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94498387198944 notifier 8129 bl.length()=905 2024-09-14T11:23:39.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.220+0000 7f05b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:39.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.220+0000 7f05b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:39.216 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.220+0000 7f05b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:39.219 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.224+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:39.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.224+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:39.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.224+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:39.220 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.224+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:39.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.228+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.0 2024-09-14T11:23:39.226 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.228+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.0 2024-09-14T11:23:39.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.1 2024-09-14T11:23:39.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.1 2024-09-14T11:23:39.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.2 2024-09-14T11:23:39.227 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.2 2024-09-14T11:23:39.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.3 2024-09-14T11:23:39.228 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.3 2024-09-14T11:23:39.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.4 2024-09-14T11:23:39.229 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.4 2024-09-14T11:23:39.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.5 2024-09-14T11:23:39.230 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.232+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.5 2024-09-14T11:23:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.6 2024-09-14T11:23:39.231 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.6 2024-09-14T11:23:39.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.7 2024-09-14T11:23:39.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.7 2024-09-14T11:23:39.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.8 2024-09-14T11:23:39.232 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.8 2024-09-14T11:23:39.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.9 2024-09-14T11:23:39.233 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.9 2024-09-14T11:23:39.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.10 2024-09-14T11:23:39.234 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.236+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.10 2024-09-14T11:23:39.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.240+0000 7f06e2ae89c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.11 2024-09-14T11:23:39.235 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.240+0000 7f06e2ae89c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.1.11 2024-09-14T11:23:39.240 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.244+0000 7f06e2ae89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:23:39.241 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.244+0000 7f06e2ae89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:39.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.248+0000 7f06e2ae89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:39.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.248+0000 7f06e2ae89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:39.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.248+0000 7f06e2ae89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:39.244 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.248+0000 7f06e2ae89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:39.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.248+0000 7f05b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 94498387198944 notifier 8129 bl.length()=873 2024-09-14T11:23:39.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.248+0000 7f05b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:39.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.248+0000 7f05b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:39.245 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.248+0000 7f05b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.252+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.252+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.252+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:39.249 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.252+0000 7f06e2ae89c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:39.258 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.260+0000 7f06e2ae89c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:23:39.263 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.268+0000 7f0596fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:39.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.272+0000 7f06e2ae89c0 20 remove_watcher() i=0 2024-09-14T11:23:39.268 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.272+0000 7f06e2ae89c0 2 removed watcher, disabling cache 2024-09-14T11:23:39.271 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.276+0000 7f06e2ae89c0 20 remove_watcher() i=1 2024-09-14T11:23:39.274 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.276+0000 7f06e2ae89c0 20 remove_watcher() i=2 2024-09-14T11:23:39.276 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.280+0000 7f06e2ae89c0 20 remove_watcher() i=3 2024-09-14T11:23:39.279 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.284+0000 7f06e2ae89c0 20 remove_watcher() i=4 2024-09-14T11:23:39.282 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.284+0000 7f06e2ae89c0 20 remove_watcher() i=5 2024-09-14T11:23:39.285 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.288+0000 7f06e2ae89c0 20 remove_watcher() i=6 2024-09-14T11:23:39.288 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:39.292+0000 7f06e2ae89c0 20 remove_watcher() i=7 2024-09-14T11:23:40.213 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:23:40.214 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T11:23:40.218 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:40.218 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:40.315 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:40.316 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:40.485 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:40.485 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:40.635 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:40.635 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:40.715 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:40.715 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:40.866 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:40.867 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:40.940 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:40.940 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:41.094 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:41.094 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:41.165 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:23:41.613 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:23:43.069 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:43.069 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:43.240 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:23:43.241 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:23:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:43.275 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:43.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.324+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.324+0000 7efeccb089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.324+0000 7efeccb089c0 20 realm 2024-09-14T11:23:43.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.324+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:43.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:43.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.324 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:43.325 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.328+0000 7efeccb089c0 20 searching for the correct realm 2024-09-14T11:23:43.330 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.332+0000 7efec9e0d640 0 -- 172.21.15.148:0/3790991344 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7efec40c9930 msgr2=0x7efec40d7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:43.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.340+0000 7efeca60e640 0 -- 172.21.15.148:0/3790991344 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7efec40b3400 msgr2=0x7efec40b3860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:43.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:43.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:43.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:43.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:43.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:43.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:43.344 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:43.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:43.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 zone default found 2024-09-14T11:23:43.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 4 Realm: () 2024-09-14T11:23:43.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:43.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:43.346 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 zonegroup default 2024-09-14T11:23:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.348+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.352+0000 7efeccb089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.352+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.352+0000 7efeccb089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.352+0000 7efeccb089c0 20 started sync module instance, tier type = 2024-09-14T11:23:43.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.352+0000 7efeccb089c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:43.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.368+0000 7efeccb089c0 20 add_watcher() i=0 2024-09-14T11:23:43.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.368+0000 7efeccb089c0 20 add_watcher() i=1 2024-09-14T11:23:43.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.368+0000 7efeccb089c0 20 add_watcher() i=2 2024-09-14T11:23:43.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.368+0000 7efeccb089c0 20 add_watcher() i=3 2024-09-14T11:23:43.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.368+0000 7efeccb089c0 20 add_watcher() i=4 2024-09-14T11:23:43.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.368+0000 7efeccb089c0 20 add_watcher() i=5 2024-09-14T11:23:43.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.368+0000 7efeccb089c0 20 add_watcher() i=6 2024-09-14T11:23:43.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.372+0000 7efeccb089c0 20 add_watcher() i=7 2024-09-14T11:23:43.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.372+0000 7efeccb089c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:43.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efd80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:43.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:43.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:43.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 5 note: GC not initialized 2024-09-14T11:23:43.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efcfb7fe640 20 reqs_thread_entry: start 2024-09-14T11:23:43.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:43.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 Filter name: none 2024-09-14T11:23:43.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efcf97fa640 20 reqs_thread_entry: start 2024-09-14T11:23:43.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:43.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:43.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:43.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:23:43.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 INFO: main: starting shard=0 2024-09-14T11:23:43.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:43.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.376+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:43.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 INFO: main: starting shard=1 2024-09-14T11:23:43.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:43.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:43.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 INFO: main: starting shard=2 2024-09-14T11:23:43.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:43.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:43.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 INFO: main: starting shard=3 2024-09-14T11:23:43.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:43.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:43.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 INFO: main: starting shard=4 2024-09-14T11:23:43.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:43.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.380+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: starting shard=5 2024-09-14T11:23:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:23:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: starting shard=6 2024-09-14T11:23:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:43.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:43.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: starting shard=7 2024-09-14T11:23:43.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:43.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:43.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: starting shard=8 2024-09-14T11:23:43.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:43.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:43.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: starting shard=9 2024-09-14T11:23:43.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:43.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:43.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: starting shard=10 2024-09-14T11:23:43.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:43.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:43.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 INFO: main: starting shard=11 2024-09-14T11:23:43.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:43.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.384+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:43.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.388+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.388+0000 7efeccb089c0 20 INFO: main: starting shard=12 2024-09-14T11:23:43.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.388+0000 7efeccb089c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:43.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.388+0000 7efeccb089c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:43.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.388+0000 7efeccb089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.388+0000 7efeccb089c0 20 INFO: main: done 2024-09-14T11:23:43.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.388+0000 7efd80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:43.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.392+0000 7efeccb089c0 20 remove_watcher() i=0 2024-09-14T11:23:43.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.392+0000 7efeccb089c0 2 removed watcher, disabling cache 2024-09-14T11:23:43.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.396+0000 7efeccb089c0 20 remove_watcher() i=1 2024-09-14T11:23:43.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.396+0000 7efeccb089c0 20 remove_watcher() i=2 2024-09-14T11:23:43.396 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.400+0000 7efeccb089c0 20 remove_watcher() i=3 2024-09-14T11:23:43.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.400+0000 7efeccb089c0 20 remove_watcher() i=4 2024-09-14T11:23:43.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.404+0000 7efeccb089c0 20 remove_watcher() i=5 2024-09-14T11:23:43.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.408+0000 7efeccb089c0 20 remove_watcher() i=6 2024-09-14T11:23:43.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.408+0000 7efeccb089c0 20 remove_watcher() i=7 2024-09-14T11:23:43.422 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:43.422 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:43.456 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:43.456 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:43.591 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:23:43.592 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:23:43.628 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:43.628 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:43.672 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.676+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 realm 2024-09-14T11:23:43.675 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:43.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:43.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.677 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:43.678 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.680+0000 7ff3f933c9c0 20 searching for the correct realm 2024-09-14T11:23:43.683 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.688+0000 7ff3f6641640 0 -- 172.21.15.148:0/2925965162 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x55f252dee600 msgr2=0x55f252df09f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:43.689 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.692+0000 7ff3f6e42640 0 -- 172.21.15.148:0/2925965162 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7ff3f005ce40 msgr2=0x7ff3f0090a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:43.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:43.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:43.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:43.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:43.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:43.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:43.696 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:43.697 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 zone default found 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 4 Realm: () 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 zonegroup default 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.698 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.700+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.704+0000 7ff3f933c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.704+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.704+0000 7ff3f933c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:43.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.704+0000 7ff3f933c9c0 20 started sync module instance, tier type = 2024-09-14T11:23:43.699 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.704+0000 7ff3f933c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:43.718 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 20 add_watcher() i=0 2024-09-14T11:23:43.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 20 add_watcher() i=1 2024-09-14T11:23:43.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 20 add_watcher() i=2 2024-09-14T11:23:43.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 20 add_watcher() i=3 2024-09-14T11:23:43.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 20 add_watcher() i=4 2024-09-14T11:23:43.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 20 add_watcher() i=5 2024-09-14T11:23:43.719 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 20 add_watcher() i=6 2024-09-14T11:23:43.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 20 add_watcher() i=7 2024-09-14T11:23:43.721 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.724+0000 7ff3f933c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:43.725 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff2ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:43.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff3f933c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:43.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff3f933c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:43.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff3f933c9c0 5 note: GC not initialized 2024-09-14T11:23:43.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff227fff640 20 reqs_thread_entry: start 2024-09-14T11:23:43.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff3f933c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:43.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff3f933c9c0 20 Filter name: none 2024-09-14T11:23:43.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff225ffb640 20 reqs_thread_entry: start 2024-09-14T11:23:43.726 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.728+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:43.727 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:43.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:43.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:43.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:23:43.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 INFO: main: starting shard=0 2024-09-14T11:23:43.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:43.728 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:43.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 INFO: main: starting shard=1 2024-09-14T11:23:43.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:43.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:43.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 INFO: main: starting shard=2 2024-09-14T11:23:43.729 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:43.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.732+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:43.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.730 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: starting shard=3 2024-09-14T11:23:43.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:43.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:43.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: starting shard=4 2024-09-14T11:23:43.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:43.731 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:43.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: starting shard=5 2024-09-14T11:23:43.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:43.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:43.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: starting shard=6 2024-09-14T11:23:43.732 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:43.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:43.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: starting shard=7 2024-09-14T11:23:43.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:43.733 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:43.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: starting shard=8 2024-09-14T11:23:43.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:43.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:43.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 INFO: main: starting shard=9 2024-09-14T11:23:43.734 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:43.735 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.736+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:43.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:23:43.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 INFO: main: starting shard=10 2024-09-14T11:23:43.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:43.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:43.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 INFO: main: starting shard=11 2024-09-14T11:23:43.736 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:43.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:43.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 INFO: main: starting shard=12 2024-09-14T11:23:43.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:43.737 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:43.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:43.738 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.740+0000 7ff3f933c9c0 20 INFO: main: done 2024-09-14T11:23:43.739 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.744+0000 7ff2ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:43.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.748+0000 7ff3f933c9c0 20 remove_watcher() i=0 2024-09-14T11:23:43.743 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.748+0000 7ff3f933c9c0 2 removed watcher, disabling cache 2024-09-14T11:23:43.745 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.748+0000 7ff3f933c9c0 20 remove_watcher() i=1 2024-09-14T11:23:43.747 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.752+0000 7ff3f933c9c0 20 remove_watcher() i=2 2024-09-14T11:23:43.749 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.752+0000 7ff3f933c9c0 20 remove_watcher() i=3 2024-09-14T11:23:43.751 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.756+0000 7ff3f933c9c0 20 remove_watcher() i=4 2024-09-14T11:23:43.753 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.756+0000 7ff3f933c9c0 20 remove_watcher() i=5 2024-09-14T11:23:43.756 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.760+0000 7ff3f933c9c0 20 remove_watcher() i=6 2024-09-14T11:23:43.758 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:43.764+0000 7ff3f933c9c0 20 remove_watcher() i=7 2024-09-14T11:23:43.774 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:43.774 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:43.800 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:43.800 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:43.959 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:23:43.960 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:23:43.995 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:43.995 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:44.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.044+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.044+0000 7f7bc804d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:44.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.044+0000 7f7bc804d9c0 20 realm 2024-09-14T11:23:44.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.044+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.044+0000 7f7bc804d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:44.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.044+0000 7f7bc804d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:44.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.044+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.048+0000 7f7bc804d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:44.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.048+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.048+0000 7f7bc804d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:44.043 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.048+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.048+0000 7f7bc804d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:44.044 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.048+0000 7f7bc804d9c0 20 searching for the correct realm 2024-09-14T11:23:44.049 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.052+0000 7f7bc5352640 0 -- 172.21.15.148:0/913191632 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f7bc0066040 msgr2=0x7f7bc0061ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:44.057 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.060+0000 7f7bc5352640 0 -- 172.21.15.148:0/913191632 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55ee0a9026b0 msgr2=0x55ee0a904ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:44.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:44.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:44.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:44.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:44.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:44.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:44.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:44.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:44.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 zone default found 2024-09-14T11:23:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 4 Realm: () 2024-09-14T11:23:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 zonegroup default 2024-09-14T11:23:44.066 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.068+0000 7f7bc804d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:44.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.072+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.072+0000 7f7bc804d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:44.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.072+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.072+0000 7f7bc804d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:44.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.072+0000 7f7bc804d9c0 20 started sync module instance, tier type = 2024-09-14T11:23:44.068 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.072+0000 7f7bc804d9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:44.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 20 add_watcher() i=0 2024-09-14T11:23:44.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 20 add_watcher() i=1 2024-09-14T11:23:44.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 20 add_watcher() i=2 2024-09-14T11:23:44.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 20 add_watcher() i=3 2024-09-14T11:23:44.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 20 add_watcher() i=4 2024-09-14T11:23:44.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 20 add_watcher() i=5 2024-09-14T11:23:44.088 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 20 add_watcher() i=6 2024-09-14T11:23:44.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 20 add_watcher() i=7 2024-09-14T11:23:44.090 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.092+0000 7f7bc804d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:44.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.096+0000 7f7a777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:44.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.096+0000 7f7bc804d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:44.094 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.096+0000 7f7bc804d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:44.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.096+0000 7f7bc804d9c0 5 note: GC not initialized 2024-09-14T11:23:44.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.096+0000 7f7a767fc640 20 reqs_thread_entry: start 2024-09-14T11:23:44.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.096+0000 7f7bc804d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:44.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 Filter name: none 2024-09-14T11:23:44.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f79ebfff640 20 reqs_thread_entry: start 2024-09-14T11:23:44.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:44.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:44.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:44.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:44.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:23:44.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 INFO: main: starting shard=0 2024-09-14T11:23:44.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:44.096 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:44.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:23:44.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 INFO: main: starting shard=1 2024-09-14T11:23:44.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:44.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:44.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 INFO: main: starting shard=2 2024-09-14T11:23:44.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:44.098 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.100+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:44.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: starting shard=3 2024-09-14T11:23:44.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:44.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:44.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: starting shard=4 2024-09-14T11:23:44.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:44.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:44.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: starting shard=5 2024-09-14T11:23:44.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:44.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:44.100 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: starting shard=6 2024-09-14T11:23:44.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:44.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:44.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: starting shard=7 2024-09-14T11:23:44.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:44.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:44.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: starting shard=8 2024-09-14T11:23:44.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:44.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:44.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 INFO: main: starting shard=9 2024-09-14T11:23:44.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:44.102 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.104+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:44.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 INFO: main: starting shard=10 2024-09-14T11:23:44.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:44.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:44.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 INFO: main: starting shard=11 2024-09-14T11:23:44.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:44.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:44.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 INFO: main: starting shard=12 2024-09-14T11:23:44.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:44.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:44.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:23:44.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7bc804d9c0 20 INFO: main: done 2024-09-14T11:23:44.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.108+0000 7f7a777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:44.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.116+0000 7f7bc804d9c0 20 remove_watcher() i=0 2024-09-14T11:23:44.110 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.116+0000 7f7bc804d9c0 2 removed watcher, disabling cache 2024-09-14T11:23:44.112 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.116+0000 7f7bc804d9c0 20 remove_watcher() i=1 2024-09-14T11:23:44.114 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.116+0000 7f7bc804d9c0 20 remove_watcher() i=2 2024-09-14T11:23:44.116 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.120+0000 7f7bc804d9c0 20 remove_watcher() i=3 2024-09-14T11:23:44.122 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.124+0000 7f7bc804d9c0 20 remove_watcher() i=4 2024-09-14T11:23:44.124 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.128+0000 7f7bc804d9c0 20 remove_watcher() i=5 2024-09-14T11:23:44.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.132+0000 7f7bc804d9c0 20 remove_watcher() i=6 2024-09-14T11:23:44.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:44.132+0000 7f7bc804d9c0 20 remove_watcher() i=7 2024-09-14T11:23:44.145 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:44.145 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:44.171 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:23:44.592 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:23:45.008 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:23:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:45.040 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:45.080 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.084+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 realm 2024-09-14T11:23:45.082 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:45.083 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.084 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:45.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:45.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.088+0000 7f2db57c29c0 20 searching for the correct realm 2024-09-14T11:23:45.092 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.096+0000 7f2db3ac9640 0 -- 172.21.15.148:0/302085564 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55cfd04d12d0 msgr2=0x55cfd04d3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:45.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.100+0000 7f2db32c8640 0 -- 172.21.15.148:0/302085564 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55cfd04d55f0 msgr2=0x55cfd04d79e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:45.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:45.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:45.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:45.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:45.103 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:45.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:45.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.104 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 zone default found 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 4 Realm: () 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 zonegroup default 2024-09-14T11:23:45.105 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 started sync module instance, tier type = 2024-09-14T11:23:45.107 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.108+0000 7f2db57c29c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:45.126 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 20 add_watcher() i=0 2024-09-14T11:23:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 20 add_watcher() i=1 2024-09-14T11:23:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 20 add_watcher() i=2 2024-09-14T11:23:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 20 add_watcher() i=3 2024-09-14T11:23:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 20 add_watcher() i=4 2024-09-14T11:23:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 20 add_watcher() i=5 2024-09-14T11:23:45.127 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 20 add_watcher() i=6 2024-09-14T11:23:45.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 20 add_watcher() i=7 2024-09-14T11:23:45.129 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.132+0000 7f2db57c29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2c69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 5 note: GC not initialized 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2c68fe1640 20 reqs_thread_entry: start 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 20 Filter name: none 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2be27fc640 20 reqs_thread_entry: start 2024-09-14T11:23:45.133 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:23:45.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:45.134 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : miss 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 adding default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:45.135 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.136+0000 7f2db57c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:45.148 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2db57c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:45.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2db57c29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:45.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2db57c29c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:45.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2db57c29c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:45.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2c967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366191 cookie 94351041309808 notifier 8219 bl.length()=905 2024-09-14T11:23:45.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2c967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:45.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2c967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:45.149 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2c967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:45.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:45.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:45.150 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:45.151 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.152+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.0 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.0 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.1 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.1 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.2 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.2 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.3 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.3 2024-09-14T11:23:45.159 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.4 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.4 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.5 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.5 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.6 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.6 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.7 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.7 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.8 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.8 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.160 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.10 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.10 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.11 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.11 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.12 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.12 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.13 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.13 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.14 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.14 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.15 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.15 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.16 2024-09-14T11:23:45.161 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.16 2024-09-14T11:23:45.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:45.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:45.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:45.162 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.164+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:45.163 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:45.164 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:45.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:45.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:45.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:45.165 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:45.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:45.166 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.168+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:45.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.172+0000 7f2db57c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:23:45.170 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.172+0000 7f2db57c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:45.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2db57c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:45.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2db57c29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:45.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2db57c29c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:45.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2db57c29c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:45.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2c96ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94351041309808 notifier 8219 bl.length()=905 2024-09-14T11:23:45.171 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2c96ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:45.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2c96ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:45.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2c96ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:45.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.176+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:45.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.180+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:45.177 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.180+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.0 2024-09-14T11:23:45.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.180+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:45.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.180+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.1 2024-09-14T11:23:45.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.180+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:45.178 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.180+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.2 2024-09-14T11:23:45.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:45.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.3 2024-09-14T11:23:45.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:45.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.4 2024-09-14T11:23:45.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:45.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.5 2024-09-14T11:23:45.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:45.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.6 2024-09-14T11:23:45.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:45.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.7 2024-09-14T11:23:45.180 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:45.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.8 2024-09-14T11:23:45.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:45.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.9 2024-09-14T11:23:45.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:45.181 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.10 2024-09-14T11:23:45.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:45.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.184+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.11 2024-09-14T11:23:45.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:45.182 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.2.12 2024-09-14T11:23:45.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:23:45.183 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:45.184 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 10 moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19, ofs0, ns] 2024-09-14T11:23:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2c967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94351041309808 notifier 8219 bl.length()=873 2024-09-14T11:23:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2c967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2c967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:45.185 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2c967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:45.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_sources= new_sources= 2024-09-14T11:23:45.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential sources added=[] removed=[] 2024-09-14T11:23:45.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): orig_dests= new_dests= 2024-09-14T11:23:45.186 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.188+0000 7f2db57c29c0 20 handle_bi_update(): bucket=:myver[de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19]): potential dests added=[] removed=[] 2024-09-14T11:23:45.193 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.196+0000 7f2db57c29c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:23:45.196 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.200+0000 7f2c69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:45.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.204+0000 7f2db57c29c0 20 remove_watcher() i=0 2024-09-14T11:23:45.200 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.204+0000 7f2db57c29c0 2 removed watcher, disabling cache 2024-09-14T11:23:45.202 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.204+0000 7f2db57c29c0 20 remove_watcher() i=1 2024-09-14T11:23:45.204 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.208+0000 7f2db57c29c0 20 remove_watcher() i=2 2024-09-14T11:23:45.206 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.208+0000 7f2db57c29c0 20 remove_watcher() i=3 2024-09-14T11:23:45.207 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.212+0000 7f2db57c29c0 20 remove_watcher() i=4 2024-09-14T11:23:45.209 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.212+0000 7f2db57c29c0 20 remove_watcher() i=5 2024-09-14T11:23:45.212 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.216+0000 7f2db57c29c0 20 remove_watcher() i=6 2024-09-14T11:23:45.215 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.220+0000 7f2db57c29c0 20 remove_watcher() i=7 2024-09-14T11:23:45.227 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:23:45.259 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:45.259 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:45.297 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.300+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 realm 2024-09-14T11:23:45.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:45.300 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:45.301 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:45.302 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.304+0000 7f615104d9c0 20 searching for the correct realm 2024-09-14T11:23:45.308 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.312+0000 7f614f354640 0 -- 172.21.15.148:0/1245229464 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55d939a3cae0 msgr2=0x55d939a3efa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:45.313 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.316+0000 7f614f354640 0 -- 172.21.15.148:0/1245229464 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55d939a493a0 msgr2=0x55d939a4b860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:45.318 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:45.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:45.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:45.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:45.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:45.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:45.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.319 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.320 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 zone default found 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 4 Realm: () 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 zonegroup default 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.321 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 started sync module instance, tier type = 2024-09-14T11:23:45.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.324+0000 7f615104d9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 20 add_watcher() i=0 2024-09-14T11:23:45.342 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 20 add_watcher() i=1 2024-09-14T11:23:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 20 add_watcher() i=2 2024-09-14T11:23:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 20 add_watcher() i=3 2024-09-14T11:23:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 20 add_watcher() i=4 2024-09-14T11:23:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 20 add_watcher() i=5 2024-09-14T11:23:45.343 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 20 add_watcher() i=6 2024-09-14T11:23:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 20 add_watcher() i=7 2024-09-14T11:23:45.345 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.348+0000 7f615104d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:45.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f6005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:45.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:45.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:45.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 5 note: GC not initialized 2024-09-14T11:23:45.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f6004fe1640 20 reqs_thread_entry: start 2024-09-14T11:23:45.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:45.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 20 Filter name: none 2024-09-14T11:23:45.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f5ffdffb640 20 reqs_thread_entry: start 2024-09-14T11:23:45.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:23:45.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:45.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:23:45.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:23:45.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 : miss 2024-09-14T11:23:45.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.352+0000 7f615104d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 info.flags=0x17 2024-09-14T11:23:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 to cache LRU end 2024-09-14T11:23:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19 2024-09-14T11:23:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.0 2024-09-14T11:23:45.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.0 2024-09-14T11:23:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:23:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.1 2024-09-14T11:23:45.353 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.1 2024-09-14T11:23:45.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:23:45.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.2 2024-09-14T11:23:45.354 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.356+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.2 2024-09-14T11:23:45.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:23:45.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.3 2024-09-14T11:23:45.355 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.3 2024-09-14T11:23:45.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:23:45.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.4 2024-09-14T11:23:45.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.4 2024-09-14T11:23:45.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:23:45.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.5 2024-09-14T11:23:45.356 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.5 2024-09-14T11:23:45.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:23:45.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.6 2024-09-14T11:23:45.357 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.6 2024-09-14T11:23:45.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:23:45.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.7 2024-09-14T11:23:45.358 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.360+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.7 2024-09-14T11:23:45.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.364+0000 7f615104d9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:23:45.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.364+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.8 2024-09-14T11:23:45.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.364+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.8 2024-09-14T11:23:45.360 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.364+0000 7f615104d9c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:23:45.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.364+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.364+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.364+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.10 2024-09-14T11:23:45.361 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.364+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.10 2024-09-14T11:23:45.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:23:45.362 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.11 2024-09-14T11:23:45.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.11 2024-09-14T11:23:45.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:23:45.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.12 2024-09-14T11:23:45.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.12 2024-09-14T11:23:45.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:23:45.363 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.13 2024-09-14T11:23:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.13 2024-09-14T11:23:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:23:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.14 2024-09-14T11:23:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.14 2024-09-14T11:23:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:23:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.15 2024-09-14T11:23:45.364 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.15 2024-09-14T11:23:45.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:23:45.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 10 bucket_obj is .dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.16 2024-09-14T11:23:45.365 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.368+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.16 2024-09-14T11:23:45.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.372+0000 7f615104d9c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:23:45.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.372+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.372+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:x state=0x55d939a78128 s->prefetch_data=0 2024-09-14T11:23:45.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.372+0000 7f615104d9c0 20 get_obj_state: setting s->obj_tag to hf6suxmvgghzmucfw2cx1efh9s0exkwu 2024-09-14T11:23:45.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.372+0000 7f615104d9c0 20 get_obj_state_impl: setting s->olh_tag to mos76e06mz8vaj8oc0kloxerriyoxis9 2024-09-14T11:23:45.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.372+0000 7f615104d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mos76e06mz8vaj8oc0kloxerriyoxis9 2024-09-14T11:23:45.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.372+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:23:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 20 olh_log_entry: epoch=2 op=3 key=x[5eO8XYUkZJ8bIXmnCGDUF1Zg7HY3Ofc] 2024-09-14T11:23:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:_:5eO8XYUkZJ8bIXmnCGDUF1Zg7HY3Ofc_x state=0x55d939aa69e8 s->prefetch_data=0 2024-09-14T11:23:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 10 manifest: total_size = 12 2024-09-14T11:23:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12731760211066927935 2024-09-14T11:23:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:_:5eO8XYUkZJ8bIXmnCGDUF1Zg7HY3Ofc_x state=0x55d939aa69e8 s->prefetch_data=0 2024-09-14T11:23:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55d939aa69e8 2024-09-14T11:23:45.372 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.376+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.380+0000 7f615104d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:23:45.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.380+0000 7f615104d9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:23:45.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.380+0000 7f615104d9c0 0 deleting objects inline since gc isn't initialized 2024-09-14T11:23:45.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.380+0000 7f615104d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19__shadow:5eO8XYUkZJ8bIXmnCGDUF1Zg7HY3Ofc_.ENcaEjEE0Y8OIp_XyUUf5Wxi2Lqzcnt_0 2024-09-14T11:23:45.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.380+0000 7f60327fc640 20 handle_completion(): completion ok for obj=x[5eO8XYUkZJ8bIXmnCGDUF1Zg7HY3Ofc] 2024-09-14T11:23:45.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.384+0000 7f615104d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:23:45.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.384+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:x state=0x55d939a78128 s->prefetch_data=0 2024-09-14T11:23:45.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.384+0000 7f615104d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mos76e06mz8vaj8oc0kloxerriyoxis9 2024-09-14T11:23:45.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.388+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.392+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.392+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.392+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:y state=0x55d939a7cd78 s->prefetch_data=0 2024-09-14T11:23:45.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.392+0000 7f615104d9c0 20 get_obj_state: setting s->obj_tag to ijchgzpt14upxuefwf5v8np4d9p6gstf 2024-09-14T11:23:45.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.392+0000 7f615104d9c0 20 get_obj_state_impl: setting s->olh_tag to pj2d4j6i2cf52nm6hg27659elk67f2rs 2024-09-14T11:23:45.389 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.392+0000 7f615104d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pj2d4j6i2cf52nm6hg27659elk67f2rs 2024-09-14T11:23:45.392 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.396+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.396+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.396+0000 7f615104d9c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:23:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.396+0000 7f615104d9c0 20 olh_log_entry: epoch=2 op=3 key=y[fkfivBWzZetezWHcW845xFYSD1Pcajw] 2024-09-14T11:23:45.394 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.396+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:_:fkfivBWzZetezWHcW845xFYSD1Pcajw_y state=0x55d939aa69e8 s->prefetch_data=0 2024-09-14T11:23:45.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 10 manifest: total_size = 22 2024-09-14T11:23:45.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7619587314884659043 2024-09-14T11:23:45.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:_:fkfivBWzZetezWHcW845xFYSD1Pcajw_y state=0x55d939aa69e8 s->prefetch_data=0 2024-09-14T11:23:45.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55d939aa69e8 2024-09-14T11:23:45.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:23:45.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:23:45.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 0 deleting objects inline since gc isn't initialized 2024-09-14T11:23:45.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.400+0000 7f615104d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19__shadow:fkfivBWzZetezWHcW845xFYSD1Pcajw_.kUiWtQt3hFdrbkGyUXQ0cpCe4AbXodL_0 2024-09-14T11:23:45.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.404+0000 7f60327fc640 20 handle_completion(): completion ok for obj=y[fkfivBWzZetezWHcW845xFYSD1Pcajw] 2024-09-14T11:23:45.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.404+0000 7f615104d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:23:45.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.408+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:y state=0x55d939a7cd78 s->prefetch_data=0 2024-09-14T11:23:45.403 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.408+0000 7f615104d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pj2d4j6i2cf52nm6hg27659elk67f2rs 2024-09-14T11:23:45.411 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.416+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.416+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.416+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.413 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.416+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:z state=0x55d939a7cd78 s->prefetch_data=0 2024-09-14T11:23:45.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.420+0000 7f615104d9c0 20 get_obj_state: setting s->obj_tag to 5vjti0xi82a75tyidcjhnr16j0wdzbza 2024-09-14T11:23:45.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.420+0000 7f615104d9c0 20 get_obj_state_impl: setting s->olh_tag to vue86gxnmj0xscm35s4uik7optjak6w9 2024-09-14T11:23:45.414 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.420+0000 7f615104d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vue86gxnmj0xscm35s4uik7optjak6w9 2024-09-14T11:23:45.417 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.420+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:23:45.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 20 olh_log_entry: epoch=2 op=3 key=z[WExYKZwwhiGFtytLRB8.bM0DnkawPiq] 2024-09-14T11:23:45.419 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:_:WExYKZwwhiGFtytLRB8.bM0DnkawPiq_z state=0x55d939aa69e8 s->prefetch_data=0 2024-09-14T11:23:45.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 10 manifest: total_size = 11 2024-09-14T11:23:45.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 20 get_obj_state: setting s->obj_tag to de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13312416476217813115 2024-09-14T11:23:45.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:_:WExYKZwwhiGFtytLRB8.bM0DnkawPiq_z state=0x55d939aa69e8 s->prefetch_data=0 2024-09-14T11:23:45.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55d939aa69e8 2024-09-14T11:23:45.420 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.424+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.428+0000 7f615104d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:23:45.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.428+0000 7f615104d9c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:23:45.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.428+0000 7f615104d9c0 0 deleting objects inline since gc isn't initialized 2024-09-14T11:23:45.423 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.428+0000 7f615104d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19__shadow:WExYKZwwhiGFtytLRB8.bM0DnkawPiq_.zIHyVYenhvbH-zEJv1StcsAFYpj_ceB_0 2024-09-14T11:23:45.424 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.428+0000 7f60327fc640 20 handle_completion(): completion ok for obj=z[WExYKZwwhiGFtytLRB8.bM0DnkawPiq] 2024-09-14T11:23:45.425 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.428+0000 7f615104d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:23:45.428 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.432+0000 7f615104d9c0 20 get_obj_state: octx=0x55d9397cd9c0 obj=myver:z state=0x55d939a7cd78 s->prefetch_data=0 2024-09-14T11:23:45.429 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.432+0000 7f615104d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vue86gxnmj0xscm35s4uik7optjak6w9 2024-09-14T11:23:45.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.440+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.440+0000 7f615104d9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19.3.9 2024-09-14T11:23:45.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.440+0000 7f615104d9c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:23:45.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.440+0000 7f615104d9c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:23:45.438 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.440+0000 7f6005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:45.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.444+0000 7f615104d9c0 20 remove_watcher() i=0 2024-09-14T11:23:45.442 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.444+0000 7f615104d9c0 2 removed watcher, disabling cache 2024-09-14T11:23:45.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.448+0000 7f615104d9c0 20 remove_watcher() i=1 2024-09-14T11:23:45.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.448+0000 7f615104d9c0 20 remove_watcher() i=2 2024-09-14T11:23:45.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.452+0000 7f615104d9c0 20 remove_watcher() i=3 2024-09-14T11:23:45.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.452+0000 7f615104d9c0 20 remove_watcher() i=4 2024-09-14T11:23:45.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.456+0000 7f615104d9c0 20 remove_watcher() i=5 2024-09-14T11:23:45.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.460+0000 7f615104d9c0 20 remove_watcher() i=6 2024-09-14T11:23:45.461 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.464+0000 7f615104d9c0 20 remove_watcher() i=7 2024-09-14T11:23:45.475 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:45.475 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:45.521 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:45.521 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:45.815 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:23:45.848 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:45.848 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:45.893 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.896+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 realm 2024-09-14T11:23:45.895 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:45.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:45.896 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:45.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:45.897 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:45.900+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.104+0000 7f8f9f95b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:46.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.104+0000 7f8f9f95b9c0 20 searching for the correct realm 2024-09-14T11:23:46.109 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.112+0000 7f8f9cc60640 0 -- 172.21.15.148:0/2213711165 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f8f9801e040 msgr2=0x7f8f9801e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:23:46.322 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.324+0000 7f8f9dc62640 0 -- 172.21.15.148:0/2213711165 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55a9f843b030 msgr2=0x55a9f843d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.336+0000 7f8f9f95b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.336+0000 7f8f9f95b9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.336+0000 7f8f9f95b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.336+0000 7f8f9f95b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.336+0000 7f8f9f95b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.336+0000 7f8f9f95b9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.336+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:46.334 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:46.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:46.336 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 zone default found 2024-09-14T11:23:46.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 4 Realm: () 2024-09-14T11:23:46.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:23:46.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:23:46.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:46.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 zonegroup default 2024-09-14T11:23:46.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.337 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:46.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:46.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.340+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.344+0000 7f8f9f95b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:46.338 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.344+0000 7f8f9f95b9c0 20 started sync module instance, tier type = 2024-09-14T11:23:46.339 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.344+0000 7f8f9f95b9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:23:46.366 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 20 add_watcher() i=0 2024-09-14T11:23:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 20 add_watcher() i=1 2024-09-14T11:23:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 20 add_watcher() i=2 2024-09-14T11:23:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 20 add_watcher() i=3 2024-09-14T11:23:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 20 add_watcher() i=4 2024-09-14T11:23:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 20 add_watcher() i=5 2024-09-14T11:23:46.367 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 20 add_watcher() i=6 2024-09-14T11:23:46.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 20 add_watcher() i=7 2024-09-14T11:23:46.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.372+0000 7f8f9f95b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:46.373 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.376+0000 7f8e537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:46.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.376+0000 7f8f9f95b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:46.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.376+0000 7f8f9f95b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:46.374 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.376+0000 7f8f9f95b9c0 5 note: GC not initialized 2024-09-14T11:23:46.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8e527e4640 20 reqs_thread_entry: start 2024-09-14T11:23:46.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:46.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 Filter name: none 2024-09-14T11:23:46.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8dc3fff640 20 reqs_thread_entry: start 2024-09-14T11:23:46.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:46.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:46.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:46.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:23:46.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.380+0000 7f8f9f95b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:46.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.384+0000 7f8f9f95b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:23:46.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.384+0000 7f8f9f95b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:46.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.384+0000 7f8e537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:46.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.388+0000 7f8f9f95b9c0 20 remove_watcher() i=0 2024-09-14T11:23:46.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.388+0000 7f8f9f95b9c0 2 removed watcher, disabling cache 2024-09-14T11:23:46.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.392+0000 7f8f9f95b9c0 20 remove_watcher() i=1 2024-09-14T11:23:46.390 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.392+0000 7f8f9f95b9c0 20 remove_watcher() i=2 2024-09-14T11:23:46.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.396+0000 7f8f9f95b9c0 20 remove_watcher() i=3 2024-09-14T11:23:46.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.400+0000 7f8f9f95b9c0 20 remove_watcher() i=4 2024-09-14T11:23:46.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.400+0000 7f8f9f95b9c0 20 remove_watcher() i=5 2024-09-14T11:23:46.399 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.404+0000 7f8f9f95b9c0 20 remove_watcher() i=6 2024-09-14T11:23:46.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T11:23:46.404+0000 7f8f9f95b9c0 20 remove_watcher() i=7 2024-09-14T11:23:46.417 INFO:tasks.workunit.client.0.smithi148.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:23:46.417 INFO:tasks.workunit.client.0.smithi148.stderr:Deleting bucket a-bucket 2024-09-14T11:23:46.418 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:46.418 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:46.449 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:46.449 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:46.559 INFO:tasks.workunit.client.0.smithi148.stderr:Deleting bucket myver 2024-09-14T11:23:46.562 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:46.562 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:46.698 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:23:46.699 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T11:23:47.192 INFO:tasks.workunit.client.0.smithi148.stderr:Completed resharding tests 2024-09-14T11:23:47.192 INFO:tasks.workunit.client.0.smithi148.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:23:47.192 INFO:tasks.workunit.client.0.smithi148.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:23:47.192 INFO:tasks.workunit.client.0.smithi148.stdout:connected to https://localhost:443 2024-09-14T11:23:47.317 INFO:tasks.workunit.client.0.smithi148.stderr:+ deactivate 2024-09-14T11:23:47.317 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:23:47.317 INFO:tasks.workunit.client.0.smithi148.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:23:47.317 INFO:tasks.workunit.client.0.smithi148.stderr:+ export PATH 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ hash -r 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset -f deactivate 2024-09-14T11:23:47.318 INFO:tasks.workunit.client.0.smithi148.stderr:+ echo OK. 2024-09-14T11:23:47.320 INFO:tasks.workunit.client.0.smithi148.stdout:OK. 2024-09-14T11:23:47.320 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:23:47.320 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:23:47.374 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:23:47.374 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:23:47.818 DEBUG:teuthology.parallel:result is None 2024-09-14T11:23:47.818 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:23:47.831 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:23:47.832 DEBUG:teuthology.orchestra.run.smithi148:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:23:47.883 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:23:47.883 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:23:47.903 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:23:47.903 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:23:47.903 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:23:47.903 DEBUG:teuthology.orchestra.run.smithi148:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:23:47.931 INFO:teuthology.orchestra.run.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:23:52.336 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:23:52.337 DEBUG:teuthology.orchestra.run.smithi148:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:23:52.431 INFO:teuthology.orchestra.run.smithi148.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-14T11:23:52.492 INFO:teuthology.orchestra.run.smithi148.stdout:Reading package lists... 2024-09-14T11:23:52.707 INFO:teuthology.orchestra.run.smithi148.stdout:Building dependency tree... 2024-09-14T11:23:52.708 INFO:teuthology.orchestra.run.smithi148.stdout:Reading state information... 2024-09-14T11:23:52.914 INFO:teuthology.orchestra.run.smithi148.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:23:52.914 INFO:teuthology.orchestra.run.smithi148.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:23:52.914 INFO:teuthology.orchestra.run.smithi148.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:23:52.914 INFO:teuthology.orchestra.run.smithi148.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:23:52.914 INFO:teuthology.orchestra.run.smithi148.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:23:52.915 INFO:teuthology.orchestra.run.smithi148.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:23:52.915 INFO:teuthology.orchestra.run.smithi148.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:23:52.915 INFO:teuthology.orchestra.run.smithi148.stdout:The following additional packages will be installed: 2024-09-14T11:23:52.916 INFO:teuthology.orchestra.run.smithi148.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-14T11:23:52.916 INFO:teuthology.orchestra.run.smithi148.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-14T11:23:52.918 INFO:teuthology.orchestra.run.smithi148.stdout:Suggested packages: 2024-09-14T11:23:52.918 INFO:teuthology.orchestra.run.smithi148.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-14T11:23:52.918 INFO:teuthology.orchestra.run.smithi148.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-14T11:23:52.918 INFO:teuthology.orchestra.run.smithi148.stdout: fonts-wqy-zenhei fonts-indic 2024-09-14T11:23:52.953 INFO:teuthology.orchestra.run.smithi148.stdout:The following NEW packages will be installed: 2024-09-14T11:23:52.954 INFO:teuthology.orchestra.run.smithi148.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-14T11:23:52.954 INFO:teuthology.orchestra.run.smithi148.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-14T11:23:53.218 INFO:teuthology.orchestra.run.smithi148.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:23:53.219 INFO:teuthology.orchestra.run.smithi148.stdout:Need to get 46.0 MB of archives. 2024-09-14T11:23:53.219 INFO:teuthology.orchestra.run.smithi148.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-14T11:23:53.219 INFO:teuthology.orchestra.run.smithi148.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-14T11:23:53.585 INFO:teuthology.orchestra.run.smithi148.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-14T11:23:53.940 INFO:teuthology.orchestra.run.smithi148.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-14T11:23:53.941 INFO:teuthology.orchestra.run.smithi148.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-14T11:23:53.947 INFO:teuthology.orchestra.run.smithi148.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-14T11:23:53.947 INFO:teuthology.orchestra.run.smithi148.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-14T11:23:55.024 INFO:teuthology.orchestra.run.smithi148.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-14T11:23:55.026 INFO:teuthology.orchestra.run.smithi148.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-14T11:23:55.265 INFO:teuthology.orchestra.run.smithi148.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-14T11:23:55.685 INFO:teuthology.orchestra.run.smithi148.stderr:debconf: unable to initialize frontend: Dialog 2024-09-14T11:23:55.685 INFO:teuthology.orchestra.run.smithi148.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-14T11:23:55.685 INFO:teuthology.orchestra.run.smithi148.stderr:debconf: falling back to frontend: Readline 2024-09-14T11:23:55.699 INFO:teuthology.orchestra.run.smithi148.stderr:debconf: unable to initialize frontend: Readline 2024-09-14T11:23:55.699 INFO:teuthology.orchestra.run.smithi148.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-14T11:23:55.699 INFO:teuthology.orchestra.run.smithi148.stderr:debconf: falling back to frontend: Teletype 2024-09-14T11:23:55.703 INFO:teuthology.orchestra.run.smithi148.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-14T11:23:55.738 INFO:teuthology.orchestra.run.smithi148.stdout:Fetched 46.0 MB in 2s (19.1 MB/s) 2024-09-14T11:23:55.851 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-14T11:23:55.943 INFO:teuthology.orchestra.run.smithi148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177250 files and directories currently installed.) 2024-09-14T11:23:55.949 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-14T11:23:55.991 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-14T11:23:56.345 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-14T11:23:56.374 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:23:56.437 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:23:56.850 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-14T11:23:56.878 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:23:56.916 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:23:57.152 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-14T11:23:57.169 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:23:57.210 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:23:57.471 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-14T11:23:57.488 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:23:57.529 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-14T11:23:57.950 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-14T11:23:57.978 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:23:58.019 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:23:59.588 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-14T11:23:59.617 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:23:59.658 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:24:00.076 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-14T11:24:00.104 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:24:00.146 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:24:00.904 INFO:teuthology.orchestra.run.smithi148.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-14T11:24:00.933 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:24:00.974 INFO:teuthology.orchestra.run.smithi148.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:24:01.334 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:24:02.478 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-14T11:24:02.504 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-14T11:24:02.530 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-14T11:24:02.879 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-14T11:24:03.030 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:24:03.390 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:24:03.499 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-14T11:24:03.567 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:24:03.660 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-14T11:24:03.687 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-14T11:24:03.713 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-14T11:24:03.738 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-14T11:24:03.865 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-14T11:24:04.009 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-14T11:24:04.128 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-14T11:24:04.221 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-14T11:24:04.272 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-14T11:24:04.331 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-14T11:24:04.365 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-14T11:24:04.391 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-14T11:24:04.455 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:24:04.581 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-14T11:24:04.707 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:24:04.807 INFO:teuthology.orchestra.run.smithi148.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-14T11:24:04.901 INFO:teuthology.orchestra.run.smithi148.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:24:05.028 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:24:06.120 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:24:06.211 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-14T11:24:06.506 INFO:teuthology.orchestra.run.smithi148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:24:06.953 INFO:teuthology.orchestra.run.smithi148.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:24:06.975 INFO:teuthology.orchestra.run.smithi148.stderr:--2024-09-14 11:24:06-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:24:06.978 INFO:teuthology.orchestra.run.smithi148.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4965, ... 2024-09-14T11:24:06.991 INFO:teuthology.orchestra.run.smithi148.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-14T11:24:07.047 INFO:teuthology.orchestra.run.smithi148.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:24:07.047 INFO:teuthology.orchestra.run.smithi148.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:24:07.047 INFO:teuthology.orchestra.run.smithi148.stderr:--2024-09-14 11:24:07-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:24:07.048 INFO:teuthology.orchestra.run.smithi148.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-09-14T11:24:07.059 INFO:teuthology.orchestra.run.smithi148.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-09-14T11:24:07.099 INFO:teuthology.orchestra.run.smithi148.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:24:07.099 INFO:teuthology.orchestra.run.smithi148.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T112338Z&X-Amz-Expires=300&X-Amz-Signature=6885cca56d9ac6f15eb2625d7c8700bfa3d7aa81d31a78a7039780e84bc8f997&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:24:07.099 INFO:teuthology.orchestra.run.smithi148.stderr:--2024-09-14 11:24:07-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T112338Z&X-Amz-Expires=300&X-Amz-Signature=6885cca56d9ac6f15eb2625d7c8700bfa3d7aa81d31a78a7039780e84bc8f997&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:24:07.137 INFO:teuthology.orchestra.run.smithi148.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.108.133, 185.199.109.133, ... 2024-09-14T11:24:07.149 INFO:teuthology.orchestra.run.smithi148.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-14T11:24:07.223 INFO:teuthology.orchestra.run.smithi148.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:24:07.224 INFO:teuthology.orchestra.run.smithi148.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:24:07.224 INFO:teuthology.orchestra.run.smithi148.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-14T11:24:07.224 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-14T11:24:07.237 INFO:teuthology.orchestra.run.smithi148.stderr: 0K .......... .......... .......... .......... .......... 0% 3.52M 26s 2024-09-14T11:24:07.246 INFO:teuthology.orchestra.run.smithi148.stderr: 50K .......... .......... .......... .......... .......... 0% 5.00M 22s 2024-09-14T11:24:07.249 INFO:teuthology.orchestra.run.smithi148.stderr: 100K .......... .......... .......... .......... .......... 0% 16.4M 16s 2024-09-14T11:24:07.252 INFO:teuthology.orchestra.run.smithi148.stderr: 150K .......... .......... .......... .......... .......... 0% 19.7M 13s 2024-09-14T11:24:07.258 INFO:teuthology.orchestra.run.smithi148.stderr: 200K .......... .......... .......... .......... .......... 0% 8.03M 13s 2024-09-14T11:24:07.259 INFO:teuthology.orchestra.run.smithi148.stderr: 250K .......... .......... .......... .......... .......... 0% 37.5M 11s 2024-09-14T11:24:07.261 INFO:teuthology.orchestra.run.smithi148.stderr: 300K .......... .......... .......... .......... .......... 0% 27.7M 10s 2024-09-14T11:24:07.263 INFO:teuthology.orchestra.run.smithi148.stderr: 350K .......... .......... .......... .......... .......... 0% 27.9M 9s 2024-09-14T11:24:07.265 INFO:teuthology.orchestra.run.smithi148.stderr: 400K .......... .......... .......... .......... .......... 0% 41.1M 8s 2024-09-14T11:24:07.270 INFO:teuthology.orchestra.run.smithi148.stderr: 450K .......... .......... .......... .......... .......... 0% 9.69M 9s 2024-09-14T11:24:07.270 INFO:teuthology.orchestra.run.smithi148.stderr: 500K .......... .......... .......... .......... .......... 0% 96.1M 8s 2024-09-14T11:24:08.338 INFO:teuthology.orchestra.run.smithi148.stderr: 550K .......... .......... .......... .......... .......... 0% 31.5M 7s 2024-09-14T11:24:08.338 INFO:teuthology.orchestra.run.smithi148.stderr: 600K .......... .......... .......... .......... .......... 0% 77.3M 7s 2024-09-14T11:24:08.338 INFO:teuthology.orchestra.run.smithi148.stderr: 650K .......... .......... .......... .......... .......... 0% 59.1M 7s 2024-09-14T11:24:08.338 INFO:teuthology.orchestra.run.smithi148.stderr: 700K .......... .......... .......... .......... .......... 0% 133M 6s 2024-09-14T11:24:08.338 INFO:teuthology.orchestra.run.smithi148.stderr: 750K .......... .......... .......... .......... .......... 0% 58.9M 6s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 800K .......... .......... .......... .......... .......... 0% 57.6M 6s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 850K .......... .......... .......... .......... .......... 0% 40.2M 5s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 900K .......... .......... .......... .......... .......... 1% 125M 5s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 950K .......... .......... .......... .......... .......... 1% 109M 5s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1000K .......... .......... .......... .......... .......... 1% 11.3M 5s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1050K .......... .......... .......... .......... .......... 1% 114M 5s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1100K .......... .......... .......... .......... .......... 1% 41.5M 5s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1150K .......... .......... .......... .......... .......... 1% 128M 5s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1200K .......... .......... .......... .......... .......... 1% 122M 4s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1250K .......... .......... .......... .......... .......... 1% 123M 4s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1300K .......... .......... .......... .......... .......... 1% 119M 4s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1350K .......... .......... .......... .......... .......... 1% 121M 4s 2024-09-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi148.stderr: 1400K .......... .......... .......... .......... .......... 1% 128M 4s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1450K .......... .......... .......... .......... .......... 1% 129M 4s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1500K .......... .......... .......... .......... .......... 1% 106M 4s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1550K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1600K .......... .......... .......... .......... .......... 1% 106M 4s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1650K .......... .......... .......... .......... .......... 1% 126M 3s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1700K .......... .......... .......... .......... .......... 1% 123M 3s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1750K .......... .......... .......... .......... .......... 1% 98.8M 3s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1800K .......... .......... .......... .......... .......... 1% 131M 3s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1850K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1900K .......... .......... .......... .......... .......... 2% 127M 3s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 1950K .......... .......... .......... .......... .......... 2% 116M 3s 2024-09-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi148.stderr: 2000K .......... .......... .......... .......... .......... 2% 16.6M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2050K .......... .......... .......... .......... .......... 2% 121M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2100K .......... .......... .......... .......... .......... 2% 126M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2150K .......... .......... .......... .......... .......... 2% 107M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2200K .......... .......... .......... .......... .......... 2% 133M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2250K .......... .......... .......... .......... .......... 2% 96.9M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2300K .......... .......... .......... .......... .......... 2% 120M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2350K .......... .......... .......... .......... .......... 2% 115M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2400K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2450K .......... .......... .......... .......... .......... 2% 101M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2500K .......... .......... .......... .......... .......... 2% 115M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2550K .......... .......... .......... .......... .......... 2% 116M 3s 2024-09-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi148.stderr: 2600K .......... .......... .......... .......... .......... 2% 122M 3s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 2650K .......... .......... .......... .......... .......... 2% 101M 3s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 2700K .......... .......... .......... .......... .......... 2% 109M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 2750K .......... .......... .......... .......... .......... 3% 99.8M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 2800K .......... .......... .......... .......... .......... 3% 115M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 2850K .......... .......... .......... .......... .......... 3% 124M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 2900K .......... .......... .......... .......... .......... 3% 115M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 2950K .......... .......... .......... .......... .......... 3% 131M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 3000K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 3050K .......... .......... .......... .......... .......... 3% 129M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 3100K .......... .......... .......... .......... .......... 3% 110M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 3150K .......... .......... .......... .......... .......... 3% 133M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 3200K .......... .......... .......... .......... .......... 3% 122M 2s 2024-09-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi148.stderr: 3250K .......... .......... .......... .......... .......... 3% 124M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3300K .......... .......... .......... .......... .......... 3% 112M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3350K .......... .......... .......... .......... .......... 3% 142M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3400K .......... .......... .......... .......... .......... 3% 102M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3450K .......... .......... .......... .......... .......... 3% 112M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3500K .......... .......... .......... .......... .......... 3% 115M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3550K .......... .......... .......... .......... .......... 3% 134M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3600K .......... .......... .......... .......... .......... 3% 104M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3650K .......... .......... .......... .......... .......... 3% 116M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3700K .......... .......... .......... .......... .......... 4% 114M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3750K .......... .......... .......... .......... .......... 4% 123M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3800K .......... .......... .......... .......... .......... 4% 96.7M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3850K .......... .......... .......... .......... .......... 4% 118M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3900K .......... .......... .......... .......... .......... 4% 113M 2s 2024-09-14T11:24:08.343 INFO:teuthology.orchestra.run.smithi148.stderr: 3950K .......... .......... .......... .......... .......... 4% 111M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4000K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4050K .......... .......... .......... .......... .......... 4% 101M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4100K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4150K .......... .......... .......... .......... .......... 4% 104M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4200K .......... .......... .......... .......... .......... 4% 97.6M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4250K .......... .......... .......... .......... .......... 4% 124M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4300K .......... .......... .......... .......... .......... 4% 123M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4350K .......... .......... .......... .......... .......... 4% 114M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4400K .......... .......... .......... .......... .......... 4% 107M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4450K .......... .......... .......... .......... .......... 4% 134M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4500K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4550K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4600K .......... .......... .......... .......... .......... 5% 112M 2s 2024-09-14T11:24:08.344 INFO:teuthology.orchestra.run.smithi148.stderr: 4650K .......... .......... .......... .......... .......... 5% 119M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 4700K .......... .......... .......... .......... .......... 5% 132M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 4750K .......... .......... .......... .......... .......... 5% 117M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 4800K .......... .......... .......... .......... .......... 5% 98.7M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 4850K .......... .......... .......... .......... .......... 5% 120M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 4900K .......... .......... .......... .......... .......... 5% 125M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 4950K .......... .......... .......... .......... .......... 5% 93.1M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 5000K .......... .......... .......... .......... .......... 5% 73.1M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 5050K .......... .......... .......... .......... .......... 5% 67.8M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 5100K .......... .......... .......... .......... .......... 5% 58.2M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 5150K .......... .......... .......... .......... .......... 5% 98.0M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 5200K .......... .......... .......... .......... .......... 5% 116M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 5250K .......... .......... .......... .......... .......... 5% 127M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 5300K .......... .......... .......... .......... .......... 5% 103M 2s 2024-09-14T11:24:08.345 INFO:teuthology.orchestra.run.smithi148.stderr: 5350K .......... .......... .......... .......... .......... 5% 121M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5400K .......... .......... .......... .......... .......... 5% 129M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5450K .......... .......... .......... .......... .......... 5% 98.0M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5500K .......... .......... .......... .......... .......... 5% 106M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5550K .......... .......... .......... .......... .......... 6% 121M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5600K .......... .......... .......... .......... .......... 6% 135M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5650K .......... .......... .......... .......... .......... 6% 128M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5700K .......... .......... .......... .......... .......... 6% 134M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5750K .......... .......... .......... .......... .......... 6% 115M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5800K .......... .......... .......... .......... .......... 6% 133M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5850K .......... .......... .......... .......... .......... 6% 135M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5900K .......... .......... .......... .......... .......... 6% 135M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 5950K .......... .......... .......... .......... .......... 6% 107M 2s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 6000K .......... .......... .......... .......... .......... 6% 126M 1s 2024-09-14T11:24:08.346 INFO:teuthology.orchestra.run.smithi148.stderr: 6050K .......... .......... .......... .......... .......... 6% 135M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6100K .......... .......... .......... .......... .......... 6% 112M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6150K .......... .......... .......... .......... .......... 6% 141M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6200K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6250K .......... .......... .......... .......... .......... 6% 132M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6300K .......... .......... .......... .......... .......... 6% 147M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6350K .......... .......... .......... .......... .......... 6% 123M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6400K .......... .......... .......... .......... .......... 6% 140M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6450K .......... .......... .......... .......... .......... 6% 136M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6500K .......... .......... .......... .......... .......... 7% 134M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6550K .......... .......... .......... .......... .......... 7% 116M 1s 2024-09-14T11:24:08.347 INFO:teuthology.orchestra.run.smithi148.stderr: 6600K .......... .......... .......... .......... .......... 7% 134M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 6650K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 6700K .......... .......... .......... .......... .......... 7% 147M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 6750K .......... .......... .......... .......... .......... 7% 123M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 6800K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 6850K .......... .......... .......... .......... .......... 7% 142M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 6900K .......... .......... .......... .......... .......... 7% 153M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 6950K .......... .......... .......... .......... .......... 7% 147M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 7000K .......... .......... .......... .......... .......... 7% 122M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 7050K .......... .......... .......... .......... .......... 7% 137M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 7100K .......... .......... .......... .......... .......... 7% 154M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 7150K .......... .......... .......... .......... .......... 7% 162M 1s 2024-09-14T11:24:08.348 INFO:teuthology.orchestra.run.smithi148.stderr: 7200K .......... .......... .......... .......... .......... 7% 150M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7250K .......... .......... .......... .......... .......... 7% 164M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7300K .......... .......... .......... .......... .......... 7% 155M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7350K .......... .......... .......... .......... .......... 7% 166M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7400K .......... .......... .......... .......... .......... 8% 155M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7450K .......... .......... .......... .......... .......... 8% 157M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7500K .......... .......... .......... .......... .......... 8% 142M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7550K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7600K .......... .......... .......... .......... .......... 8% 161M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7650K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7700K .......... .......... .......... .......... .......... 8% 106M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7750K .......... .......... .......... .......... .......... 8% 146M 1s 2024-09-14T11:24:08.349 INFO:teuthology.orchestra.run.smithi148.stderr: 7800K .......... .......... .......... .......... .......... 8% 160M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 7850K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 7900K .......... .......... .......... .......... .......... 8% 159M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 7950K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 8000K .......... .......... .......... .......... .......... 8% 160M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 8050K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 8100K .......... .......... .......... .......... .......... 8% 167M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 8150K .......... .......... .......... .......... .......... 8% 146M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 8200K .......... .......... .......... .......... .......... 8% 167M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 8250K .......... .......... .......... .......... .......... 8% 153M 1s 2024-09-14T11:24:08.350 INFO:teuthology.orchestra.run.smithi148.stderr: 8300K .......... .......... .......... .......... .......... 8% 131M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8350K .......... .......... .......... .......... .......... 9% 164M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8400K .......... .......... .......... .......... .......... 9% 189M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8450K .......... .......... .......... .......... .......... 9% 156M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8500K .......... .......... .......... .......... .......... 9% 166M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8550K .......... .......... .......... .......... .......... 9% 191M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8600K .......... .......... .......... .......... .......... 9% 186M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8650K .......... .......... .......... .......... .......... 9% 171M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8700K .......... .......... .......... .......... .......... 9% 173M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8750K .......... .......... .......... .......... .......... 9% 175M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8800K .......... .......... .......... .......... .......... 9% 175M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8850K .......... .......... .......... .......... .......... 9% 187M 1s 2024-09-14T11:24:08.351 INFO:teuthology.orchestra.run.smithi148.stderr: 8900K .......... .......... .......... .......... .......... 9% 202M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 8950K .......... .......... .......... .......... .......... 9% 177M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9000K .......... .......... .......... .......... .......... 9% 177M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9050K .......... .......... .......... .......... .......... 9% 191M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9100K .......... .......... .......... .......... .......... 9% 192M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9150K .......... .......... .......... .......... .......... 9% 158M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9200K .......... .......... .......... .......... .......... 9% 194M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9250K .......... .......... .......... .......... .......... 10% 202M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9300K .......... .......... .......... .......... .......... 10% 199M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9350K .......... .......... .......... .......... .......... 10% 193M 1s 2024-09-14T11:24:08.352 INFO:teuthology.orchestra.run.smithi148.stderr: 9400K .......... .......... .......... .......... .......... 10% 171M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9450K .......... .......... .......... .......... .......... 10% 204M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9500K .......... .......... .......... .......... .......... 10% 199M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9550K .......... .......... .......... .......... .......... 10% 201M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9600K .......... .......... .......... .......... .......... 10% 197M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9650K .......... .......... .......... .......... .......... 10% 172M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9700K .......... .......... .......... .......... .......... 10% 197M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9750K .......... .......... .......... .......... .......... 10% 189M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9800K .......... .......... .......... .......... .......... 10% 174M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9850K .......... .......... .......... .......... .......... 10% 174M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9900K .......... .......... .......... .......... .......... 10% 183M 1s 2024-09-14T11:24:08.353 INFO:teuthology.orchestra.run.smithi148.stderr: 9950K .......... .......... .......... .......... .......... 10% 214M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10000K .......... .......... .......... .......... .......... 10% 219M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10050K .......... .......... .......... .......... .......... 10% 233M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10100K .......... .......... .......... .......... .......... 10% 200M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10150K .......... .......... .......... .......... .......... 10% 181M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10200K .......... .......... .......... .......... .......... 11% 228M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10250K .......... .......... .......... .......... .......... 11% 227M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10300K .......... .......... .......... .......... .......... 11% 189M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10350K .......... .......... .......... .......... .......... 11% 220M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10400K .......... .......... .......... .......... .......... 11% 218M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10450K .......... .......... .......... .......... .......... 11% 235M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10500K .......... .......... .......... .......... .......... 11% 199M 1s 2024-09-14T11:24:08.354 INFO:teuthology.orchestra.run.smithi148.stderr: 10550K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 10600K .......... .......... .......... .......... .......... 11% 219M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 10650K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 10700K .......... .......... .......... .......... .......... 11% 163M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 10750K .......... .......... .......... .......... .......... 11% 223M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 10800K .......... .......... .......... .......... .......... 11% 208M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 10850K .......... .......... .......... .......... .......... 11% 225M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 10900K .......... .......... .......... .......... .......... 11% 191M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 10950K .......... .......... .......... .......... .......... 11% 234M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 11000K .......... .......... .......... .......... .......... 11% 232M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 11050K .......... .......... .......... .......... .......... 11% 200M 1s 2024-09-14T11:24:08.355 INFO:teuthology.orchestra.run.smithi148.stderr: 11100K .......... .......... .......... .......... .......... 12% 182M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11150K .......... .......... .......... .......... .......... 12% 222M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11200K .......... .......... .......... .......... .......... 12% 215M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11250K .......... .......... .......... .......... .......... 12% 236M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11300K .......... .......... .......... .......... .......... 12% 182M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11350K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11400K .......... .......... .......... .......... .......... 12% 209M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11450K .......... .......... .......... .......... .......... 12% 226M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11500K .......... .......... .......... .......... .......... 12% 165M 1s 2024-09-14T11:24:08.356 INFO:teuthology.orchestra.run.smithi148.stderr: 11550K .......... .......... .......... .......... .......... 12% 197M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 11600K .......... .......... .......... .......... .......... 12% 215M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 11650K .......... .......... .......... .......... .......... 12% 209M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 11700K .......... .......... .......... .......... .......... 12% 208M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 11750K .......... .......... .......... .......... .......... 12% 235M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 11800K .......... .......... .......... .......... .......... 12% 210M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 11850K .......... .......... .......... .......... .......... 12% 218M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 11900K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 11950K .......... .......... .......... .......... .......... 12% 251M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 12000K .......... .......... .......... .......... .......... 12% 218M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 12050K .......... .......... .......... .......... .......... 13% 203M 1s 2024-09-14T11:24:08.357 INFO:teuthology.orchestra.run.smithi148.stderr: 12100K .......... .......... .......... .......... .......... 13% 232M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12150K .......... .......... .......... .......... .......... 13% 231M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12200K .......... .......... .......... .......... .......... 13% 203M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12250K .......... .......... .......... .......... .......... 13% 223M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12300K .......... .......... .......... .......... .......... 13% 211M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12350K .......... .......... .......... .......... .......... 13% 225M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12400K .......... .......... .......... .......... .......... 13% 150M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12450K .......... .......... .......... .......... .......... 13% 227M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12500K .......... .......... .......... .......... .......... 13% 255M 1s 2024-09-14T11:24:08.358 INFO:teuthology.orchestra.run.smithi148.stderr: 12550K .......... .......... .......... .......... .......... 13% 251M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 12600K .......... .......... .......... .......... .......... 13% 220M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 12650K .......... .......... .......... .......... .......... 13% 238M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 12700K .......... .......... .......... .......... .......... 13% 262M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 12750K .......... .......... .......... .......... .......... 13% 231M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 12800K .......... .......... .......... .......... .......... 13% 103M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 12850K .......... .......... .......... .......... .......... 13% 178M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 12900K .......... .......... .......... .......... .......... 13% 187M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 12950K .......... .......... .......... .......... .......... 13% 185M 1s 2024-09-14T11:24:08.359 INFO:teuthology.orchestra.run.smithi148.stderr: 13000K .......... .......... .......... .......... .......... 14% 174M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13050K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13100K .......... .......... .......... .......... .......... 14% 204M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13150K .......... .......... .......... .......... .......... 14% 211M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13200K .......... .......... .......... .......... .......... 14% 218M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13250K .......... .......... .......... .......... .......... 14% 236M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13300K .......... .......... .......... .......... .......... 14% 204M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13350K .......... .......... .......... .......... .......... 14% 270M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13400K .......... .......... .......... .......... .......... 14% 237M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13450K .......... .......... .......... .......... .......... 14% 240M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13500K .......... .......... .......... .......... .......... 14% 252M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13550K .......... .......... .......... .......... .......... 14% 246M 1s 2024-09-14T11:24:08.360 INFO:teuthology.orchestra.run.smithi148.stderr: 13600K .......... .......... .......... .......... .......... 14% 237M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 13650K .......... .......... .......... .......... .......... 14% 256M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 13700K .......... .......... .......... .......... .......... 14% 226M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 13750K .......... .......... .......... .......... .......... 14% 270M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 13800K .......... .......... .......... .......... .......... 14% 235M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 13850K .......... .......... .......... .......... .......... 14% 209M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 13900K .......... .......... .......... .......... .......... 15% 252M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 13950K .......... .......... .......... .......... .......... 15% 238M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 14000K .......... .......... .......... .......... .......... 15% 268M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 14050K .......... .......... .......... .......... .......... 15% 246M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 14100K .......... .......... .......... .......... .......... 15% 228M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 14150K .......... .......... .......... .......... .......... 15% 226M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 14200K .......... .......... .......... .......... .......... 15% 222M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 14250K .......... .......... .......... .......... .......... 15% 263M 1s 2024-09-14T11:24:08.361 INFO:teuthology.orchestra.run.smithi148.stderr: 14300K .......... .......... .......... .......... .......... 15% 257M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14350K .......... .......... .......... .......... .......... 15% 230M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14400K .......... .......... .......... .......... .......... 15% 280M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14450K .......... .......... .......... .......... .......... 15% 247M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14500K .......... .......... .......... .......... .......... 15% 245M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14550K .......... .......... .......... .......... .......... 15% 289M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14600K .......... .......... .......... .......... .......... 15% 275M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14650K .......... .......... .......... .......... .......... 15% 235M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14700K .......... .......... .......... .......... .......... 15% 283M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14750K .......... .......... .......... .......... .......... 15% 250M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14800K .......... .......... .......... .......... .......... 15% 282M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14850K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14900K .......... .......... .......... .......... .......... 16% 211M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 14950K .......... .......... .......... .......... .......... 16% 253M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 15000K .......... .......... .......... .......... .......... 16% 235M 1s 2024-09-14T11:24:08.362 INFO:teuthology.orchestra.run.smithi148.stderr: 15050K .......... .......... .......... .......... .......... 16% 247M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15100K .......... .......... .......... .......... .......... 16% 248M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15150K .......... .......... .......... .......... .......... 16% 239M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15200K .......... .......... .......... .......... .......... 16% 247M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15250K .......... .......... .......... .......... .......... 16% 231M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15300K .......... .......... .......... .......... .......... 16% 293M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15350K .......... .......... .......... .......... .......... 16% 244M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15400K .......... .......... .......... .......... .......... 16% 264M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15450K .......... .......... .......... .......... .......... 16% 316M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15500K .......... .......... .......... .......... .......... 16% 228M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15550K .......... .......... .......... .......... .......... 16% 283M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15600K .......... .......... .......... .......... .......... 16% 254M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15650K .......... .......... .......... .......... .......... 16% 285M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15700K .......... .......... .......... .......... .......... 16% 257M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15750K .......... .......... .......... .......... .......... 17% 257M 1s 2024-09-14T11:24:08.363 INFO:teuthology.orchestra.run.smithi148.stderr: 15800K .......... .......... .......... .......... .......... 17% 295M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 15850K .......... .......... .......... .......... .......... 17% 236M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 15900K .......... .......... .......... .......... .......... 17% 273M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 15950K .......... .......... .......... .......... .......... 17% 267M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16000K .......... .......... .......... .......... .......... 17% 237M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16050K .......... .......... .......... .......... .......... 17% 276M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16100K .......... .......... .......... .......... .......... 17% 248M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16150K .......... .......... .......... .......... .......... 17% 278M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16200K .......... .......... .......... .......... .......... 17% 273M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16250K .......... .......... .......... .......... .......... 17% 247M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16300K .......... .......... .......... .......... .......... 17% 267M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16350K .......... .......... .......... .......... .......... 17% 292M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16400K .......... .......... .......... .......... .......... 17% 241M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16450K .......... .......... .......... .......... .......... 17% 244M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16500K .......... .......... .......... .......... .......... 17% 225M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16550K .......... .......... .......... .......... .......... 17% 252M 1s 2024-09-14T11:24:08.364 INFO:teuthology.orchestra.run.smithi148.stderr: 16600K .......... .......... .......... .......... .......... 17% 313M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 16650K .......... .......... .......... .......... .......... 17% 257M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 16700K .......... .......... .......... .......... .......... 18% 301M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 16750K .......... .......... .......... .......... .......... 18% 293M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 16800K .......... .......... .......... .......... .......... 18% 245M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 16850K .......... .......... .......... .......... .......... 18% 286M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 16900K .......... .......... .......... .......... .......... 18% 282M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 16950K .......... .......... .......... .......... .......... 18% 275M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 17000K .......... .......... .......... .......... .......... 18% 295M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 17050K .......... .......... .......... .......... .......... 18% 97.4M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 17100K .......... .......... .......... .......... .......... 18% 259M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 17150K .......... .......... .......... .......... .......... 18% 255M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 17200K .......... .......... .......... .......... .......... 18% 266M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 17250K .......... .......... .......... .......... .......... 18% 309M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 17300K .......... .......... .......... .......... .......... 18% 281M 1s 2024-09-14T11:24:08.365 INFO:teuthology.orchestra.run.smithi148.stderr: 17350K .......... .......... .......... .......... .......... 18% 300M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17400K .......... .......... .......... .......... .......... 18% 23.3M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17450K .......... .......... .......... .......... .......... 18% 290M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17500K .......... .......... .......... .......... .......... 18% 300M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17550K .......... .......... .......... .......... .......... 18% 312M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17600K .......... .......... .......... .......... .......... 18% 278M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17650K .......... .......... .......... .......... .......... 19% 330M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17700K .......... .......... .......... .......... .......... 19% 267M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17750K .......... .......... .......... .......... .......... 19% 301M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17800K .......... .......... .......... .......... .......... 19% 303M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17850K .......... .......... .......... .......... .......... 19% 342M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17900K .......... .......... .......... .......... .......... 19% 239M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 17950K .......... .......... .......... .......... .......... 19% 294M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 18000K .......... .......... .......... .......... .......... 19% 292M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 18050K .......... .......... .......... .......... .......... 19% 274M 1s 2024-09-14T11:24:08.366 INFO:teuthology.orchestra.run.smithi148.stderr: 18100K .......... .......... .......... .......... .......... 19% 235M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18150K .......... .......... .......... .......... .......... 19% 296M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18200K .......... .......... .......... .......... .......... 19% 290M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18250K .......... .......... .......... .......... .......... 19% 283M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18300K .......... .......... .......... .......... .......... 19% 199M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18350K .......... .......... .......... .......... .......... 19% 253M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18400K .......... .......... .......... .......... .......... 19% 278M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18450K .......... .......... .......... .......... .......... 19% 281M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18500K .......... .......... .......... .......... .......... 19% 302M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18550K .......... .......... .......... .......... .......... 20% 275M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18600K .......... .......... .......... .......... .......... 20% 279M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18650K .......... .......... .......... .......... .......... 20% 235M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18700K .......... .......... .......... .......... .......... 20% 252M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18750K .......... .......... .......... .......... .......... 20% 285M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18800K .......... .......... .......... .......... .......... 20% 295M 1s 2024-09-14T11:24:08.367 INFO:teuthology.orchestra.run.smithi148.stderr: 18850K .......... .......... .......... .......... .......... 20% 297M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 18900K .......... .......... .......... .......... .......... 20% 253M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 18950K .......... .......... .......... .......... .......... 20% 267M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19000K .......... .......... .......... .......... .......... 20% 258M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19050K .......... .......... .......... .......... .......... 20% 289M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19100K .......... .......... .......... .......... .......... 20% 271M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19150K .......... .......... .......... .......... .......... 20% 247M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19200K .......... .......... .......... .......... .......... 20% 295M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19250K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19300K .......... .......... .......... .......... .......... 20% 281M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19350K .......... .......... .......... .......... .......... 20% 251M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19400K .......... .......... .......... .......... .......... 20% 279M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19450K .......... .......... .......... .......... .......... 20% 286M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19500K .......... .......... .......... .......... .......... 21% 276M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19550K .......... .......... .......... .......... .......... 21% 287M 1s 2024-09-14T11:24:08.368 INFO:teuthology.orchestra.run.smithi148.stderr: 19600K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 19650K .......... .......... .......... .......... .......... 21% 249M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 19700K .......... .......... .......... .......... .......... 21% 306M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 19750K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 19800K .......... .......... .......... .......... .......... 21% 283M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 19850K .......... .......... .......... .......... .......... 21% 243M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 19900K .......... .......... .......... .......... .......... 21% 283M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 19950K .......... .......... .......... .......... .......... 21% 260M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 20000K .......... .......... .......... .......... .......... 21% 310M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 20050K .......... .......... .......... .......... .......... 21% 260M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 20100K .......... .......... .......... .......... .......... 21% 294M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 20150K .......... .......... .......... .......... .......... 21% 272M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 20200K .......... .......... .......... .......... .......... 21% 302M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 20250K .......... .......... .......... .......... .......... 21% 29.6M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 20300K .......... .......... .......... .......... .......... 21% 218M 1s 2024-09-14T11:24:08.369 INFO:teuthology.orchestra.run.smithi148.stderr: 20350K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20400K .......... .......... .......... .......... .......... 22% 278M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20450K .......... .......... .......... .......... .......... 22% 278M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20500K .......... .......... .......... .......... .......... 22% 318M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20550K .......... .......... .......... .......... .......... 22% 321M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20600K .......... .......... .......... .......... .......... 22% 202M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20650K .......... .......... .......... .......... .......... 22% 303M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20700K .......... .......... .......... .......... .......... 22% 279M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20750K .......... .......... .......... .......... .......... 22% 317M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20800K .......... .......... .......... .......... .......... 22% 266M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20850K .......... .......... .......... .......... .......... 22% 274M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20900K .......... .......... .......... .......... .......... 22% 330M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 20950K .......... .......... .......... .......... .......... 22% 323M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 21000K .......... .......... .......... .......... .......... 22% 272M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 21050K .......... .......... .......... .......... .......... 22% 294M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 21100K .......... .......... .......... .......... .......... 22% 272M 1s 2024-09-14T11:24:08.370 INFO:teuthology.orchestra.run.smithi148.stderr: 21150K .......... .......... .......... .......... .......... 22% 270M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21200K .......... .......... .......... .......... .......... 22% 303M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21250K .......... .......... .......... .......... .......... 22% 309M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21300K .......... .......... .......... .......... .......... 22% 238M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21350K .......... .......... .......... .......... .......... 23% 196M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21400K .......... .......... .......... .......... .......... 23% 228M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21450K .......... .......... .......... .......... .......... 23% 273M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21500K .......... .......... .......... .......... .......... 23% 266M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21550K .......... .......... .......... .......... .......... 23% 190M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21600K .......... .......... .......... .......... .......... 23% 233M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21650K .......... .......... .......... .......... .......... 23% 210M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21700K .......... .......... .......... .......... .......... 23% 200M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21750K .......... .......... .......... .......... .......... 23% 205M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21800K .......... .......... .......... .......... .......... 23% 200M 1s 2024-09-14T11:24:08.371 INFO:teuthology.orchestra.run.smithi148.stderr: 21850K .......... .......... .......... .......... .......... 23% 252M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 21900K .......... .......... .......... .......... .......... 23% 249M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 21950K .......... .......... .......... .......... .......... 23% 144M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22000K .......... .......... .......... .......... .......... 23% 177M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22050K .......... .......... .......... .......... .......... 23% 213M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22100K .......... .......... .......... .......... .......... 23% 190M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22150K .......... .......... .......... .......... .......... 23% 175M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22200K .......... .......... .......... .......... .......... 23% 203M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22250K .......... .......... .......... .......... .......... 24% 184M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22300K .......... .......... .......... .......... .......... 24% 267M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22350K .......... .......... .......... .......... .......... 24% 234M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22400K .......... .......... .......... .......... .......... 24% 254M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22450K .......... .......... .......... .......... .......... 24% 221M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22500K .......... .......... .......... .......... .......... 24% 257M 1s 2024-09-14T11:24:08.372 INFO:teuthology.orchestra.run.smithi148.stderr: 22550K .......... .......... .......... .......... .......... 24% 258M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 22600K .......... .......... .......... .......... .......... 24% 251M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 22650K .......... .......... .......... .......... .......... 24% 225M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 22700K .......... .......... .......... .......... .......... 24% 266M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 22750K .......... .......... .......... .......... .......... 24% 226M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 22800K .......... .......... .......... .......... .......... 24% 265M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 22850K .......... .......... .......... .......... .......... 24% 252M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 22900K .......... .......... .......... .......... .......... 24% 278M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 22950K .......... .......... .......... .......... .......... 24% 237M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 23000K .......... .......... .......... .......... .......... 24% 77.6M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 23050K .......... .......... .......... .......... .......... 24% 203M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 23100K .......... .......... .......... .......... .......... 24% 220M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 23150K .......... .......... .......... .......... .......... 24% 221M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 23200K .......... .......... .......... .......... .......... 25% 189M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 23250K .......... .......... .......... .......... .......... 25% 163M 1s 2024-09-14T11:24:08.373 INFO:teuthology.orchestra.run.smithi148.stderr: 23300K .......... .......... .......... .......... .......... 25% 222M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23350K .......... .......... .......... .......... .......... 25% 225M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23400K .......... .......... .......... .......... .......... 25% 257M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23450K .......... .......... .......... .......... .......... 25% 242M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23500K .......... .......... .......... .......... .......... 25% 276M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23550K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23600K .......... .......... .......... .......... .......... 25% 248M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23650K .......... .......... .......... .......... .......... 25% 221M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23700K .......... .......... .......... .......... .......... 25% 255M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23750K .......... .......... .......... .......... .......... 25% 251M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23800K .......... .......... .......... .......... .......... 25% 272M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23850K .......... .......... .......... .......... .......... 25% 209M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23900K .......... .......... .......... .......... .......... 25% 248M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 23950K .......... .......... .......... .......... .......... 25% 226M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 24000K .......... .......... .......... .......... .......... 25% 225M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 24050K .......... .......... .......... .......... .......... 25% 209M 1s 2024-09-14T11:24:08.374 INFO:teuthology.orchestra.run.smithi148.stderr: 24100K .......... .......... .......... .......... .......... 25% 269M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24150K .......... .......... .......... .......... .......... 26% 267M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24200K .......... .......... .......... .......... .......... 26% 228M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24250K .......... .......... .......... .......... .......... 26% 207M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24300K .......... .......... .......... .......... .......... 26% 266M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24350K .......... .......... .......... .......... .......... 26% 280M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24400K .......... .......... .......... .......... .......... 26% 271M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24450K .......... .......... .......... .......... .......... 26% 228M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24500K .......... .......... .......... .......... .......... 26% 258M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24550K .......... .......... .......... .......... .......... 26% 202M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24600K .......... .......... .......... .......... .......... 26% 256M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24650K .......... .......... .......... .......... .......... 26% 254M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24700K .......... .......... .......... .......... .......... 26% 195M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24750K .......... .......... .......... .......... .......... 26% 266M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24800K .......... .......... .......... .......... .......... 26% 270M 1s 2024-09-14T11:24:08.375 INFO:teuthology.orchestra.run.smithi148.stderr: 24850K .......... .......... .......... .......... .......... 26% 224M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 24900K .......... .......... .......... .......... .......... 26% 274M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 24950K .......... .......... .......... .......... .......... 26% 271M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25000K .......... .......... .......... .......... .......... 26% 287M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25050K .......... .......... .......... .......... .......... 27% 247M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25100K .......... .......... .......... .......... .......... 27% 249M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25150K .......... .......... .......... .......... .......... 27% 270M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25200K .......... .......... .......... .......... .......... 27% 286M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25250K .......... .......... .......... .......... .......... 27% 227M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25300K .......... .......... .......... .......... .......... 27% 271M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25350K .......... .......... .......... .......... .......... 27% 285M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25400K .......... .......... .......... .......... .......... 27% 288M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25450K .......... .......... .......... .......... .......... 27% 267M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25500K .......... .......... .......... .......... .......... 27% 239M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25550K .......... .......... .......... .......... .......... 27% 278M 1s 2024-09-14T11:24:08.376 INFO:teuthology.orchestra.run.smithi148.stderr: 25600K .......... .......... .......... .......... .......... 27% 39.8M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 25650K .......... .......... .......... .......... .......... 27% 278M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 25700K .......... .......... .......... .......... .......... 27% 221M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 25750K .......... .......... .......... .......... .......... 27% 283M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 25800K .......... .......... .......... .......... .......... 27% 273M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 25850K .......... .......... .......... .......... .......... 27% 234M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 25900K .......... .......... .......... .......... .......... 27% 266M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 25950K .......... .......... .......... .......... .......... 27% 281M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 26000K .......... .......... .......... .......... .......... 28% 259M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 26050K .......... .......... .......... .......... .......... 28% 284M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 26100K .......... .......... .......... .......... .......... 28% 290M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 26150K .......... .......... .......... .......... .......... 28% 265M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 26200K .......... .......... .......... .......... .......... 28% 218M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 26250K .......... .......... .......... .......... .......... 28% 278M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 26300K .......... .......... .......... .......... .......... 28% 294M 1s 2024-09-14T11:24:08.377 INFO:teuthology.orchestra.run.smithi148.stderr: 26350K .......... .......... .......... .......... .......... 28% 281M 1s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26400K .......... .......... .......... .......... .......... 28% 234M 1s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26450K .......... .......... .......... .......... .......... 28% 230M 1s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26500K .......... .......... .......... .......... .......... 28% 287M 0s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26550K .......... .......... .......... .......... .......... 28% 287M 0s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26600K .......... .......... .......... .......... .......... 28% 294M 0s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26650K .......... .......... .......... .......... .......... 28% 269M 0s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26700K .......... .......... .......... .......... .......... 28% 279M 0s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26750K .......... .......... .......... .......... .......... 28% 254M 0s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26800K .......... .......... .......... .......... .......... 28% 280M 0s 2024-09-14T11:24:08.378 INFO:teuthology.orchestra.run.smithi148.stderr: 26850K .......... .......... .......... .......... .......... 28% 260M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 26900K .......... .......... .......... .......... .......... 29% 257M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 26950K .......... .......... .......... .......... .......... 29% 258M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27000K .......... .......... .......... .......... .......... 29% 249M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27050K .......... .......... .......... .......... .......... 29% 286M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27100K .......... .......... .......... .......... .......... 29% 281M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27150K .......... .......... .......... .......... .......... 29% 268M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27200K .......... .......... .......... .......... .......... 29% 282M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27250K .......... .......... .......... .......... .......... 29% 248M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27300K .......... .......... .......... .......... .......... 29% 292M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27350K .......... .......... .......... .......... .......... 29% 288M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27400K .......... .......... .......... .......... .......... 29% 236M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27450K .......... .......... .......... .......... .......... 29% 273M 0s 2024-09-14T11:24:08.379 INFO:teuthology.orchestra.run.smithi148.stderr: 27500K .......... .......... .......... .......... .......... 29% 221M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27550K .......... .......... .......... .......... .......... 29% 283M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27600K .......... .......... .......... .......... .......... 29% 280M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27650K .......... .......... .......... .......... .......... 29% 259M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27700K .......... .......... .......... .......... .......... 29% 284M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27750K .......... .......... .......... .......... .......... 29% 258M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27800K .......... .......... .......... .......... .......... 29% 295M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27850K .......... .......... .......... .......... .......... 30% 298M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27900K .......... .......... .......... .......... .......... 30% 237M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 27950K .......... .......... .......... .......... .......... 30% 275M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 28000K .......... .......... .......... .......... .......... 30% 233M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 28050K .......... .......... .......... .......... .......... 30% 290M 0s 2024-09-14T11:24:08.380 INFO:teuthology.orchestra.run.smithi148.stderr: 28100K .......... .......... .......... .......... .......... 30% 302M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28150K .......... .......... .......... .......... .......... 30% 288M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28200K .......... .......... .......... .......... .......... 30% 240M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28250K .......... .......... .......... .......... .......... 30% 266M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28300K .......... .......... .......... .......... .......... 30% 30.4M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28350K .......... .......... .......... .......... .......... 30% 210M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28400K .......... .......... .......... .......... .......... 30% 254M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28450K .......... .......... .......... .......... .......... 30% 275M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28500K .......... .......... .......... .......... .......... 30% 256M 0s 2024-09-14T11:24:08.381 INFO:teuthology.orchestra.run.smithi148.stderr: 28550K .......... .......... .......... .......... .......... 30% 293M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 28600K .......... .......... .......... .......... .......... 30% 263M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 28650K .......... .......... .......... .......... .......... 30% 266M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 28700K .......... .......... .......... .......... .......... 30% 299M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 28750K .......... .......... .......... .......... .......... 31% 218M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 28800K .......... .......... .......... .......... .......... 31% 287M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 28850K .......... .......... .......... .......... .......... 31% 290M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 28900K .......... .......... .......... .......... .......... 31% 267M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 28950K .......... .......... .......... .......... .......... 31% 269M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 29000K .......... .......... .......... .......... .......... 31% 245M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 29050K .......... .......... .......... .......... .......... 31% 269M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 29100K .......... .......... .......... .......... .......... 31% 298M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 29150K .......... .......... .......... .......... .......... 31% 292M 0s 2024-09-14T11:24:08.382 INFO:teuthology.orchestra.run.smithi148.stderr: 29200K .......... .......... .......... .......... .......... 31% 247M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29250K .......... .......... .......... .......... .......... 31% 295M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29300K .......... .......... .......... .......... .......... 31% 254M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29350K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29400K .......... .......... .......... .......... .......... 31% 273M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29450K .......... .......... .......... .......... .......... 31% 294M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29500K .......... .......... .......... .......... .......... 31% 268M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29550K .......... .......... .......... .......... .......... 31% 249M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29600K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29650K .......... .......... .......... .......... .......... 31% 294M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29700K .......... .......... .......... .......... .......... 32% 267M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29750K .......... .......... .......... .......... .......... 32% 275M 0s 2024-09-14T11:24:08.383 INFO:teuthology.orchestra.run.smithi148.stderr: 29800K .......... .......... .......... .......... .......... 32% 298M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 29850K .......... .......... .......... .......... .......... 32% 302M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 29900K .......... .......... .......... .......... .......... 32% 237M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 29950K .......... .......... .......... .......... .......... 32% 273M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30000K .......... .......... .......... .......... .......... 32% 295M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30050K .......... .......... .......... .......... .......... 32% 271M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30100K .......... .......... .......... .......... .......... 32% 285M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30150K .......... .......... .......... .......... .......... 32% 253M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30200K .......... .......... .......... .......... .......... 32% 291M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30250K .......... .......... .......... .......... .......... 32% 275M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30300K .......... .......... .......... .......... .......... 32% 292M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30350K .......... .......... .......... .......... .......... 32% 269M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30400K .......... .......... .......... .......... .......... 32% 296M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30450K .......... .......... .......... .......... .......... 32% 254M 0s 2024-09-14T11:24:08.384 INFO:teuthology.orchestra.run.smithi148.stderr: 30500K .......... .......... .......... .......... .......... 32% 291M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30550K .......... .......... .......... .......... .......... 32% 253M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30600K .......... .......... .......... .......... .......... 32% 319M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30650K .......... .......... .......... .......... .......... 33% 327M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30700K .......... .......... .......... .......... .......... 33% 292M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30750K .......... .......... .......... .......... .......... 33% 240M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30800K .......... .......... .......... .......... .......... 33% 290M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30850K .......... .......... .......... .......... .......... 33% 299M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30900K .......... .......... .......... .......... .......... 33% 316M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 30950K .......... .......... .......... .......... .......... 33% 275M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 31000K .......... .......... .......... .......... .......... 33% 296M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 31050K .......... .......... .......... .......... .......... 33% 318M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 31100K .......... .......... .......... .......... .......... 33% 200M 0s 2024-09-14T11:24:08.385 INFO:teuthology.orchestra.run.smithi148.stderr: 31150K .......... .......... .......... .......... .......... 33% 239M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31200K .......... .......... .......... .......... .......... 33% 315M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31250K .......... .......... .......... .......... .......... 33% 306M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31300K .......... .......... .......... .......... .......... 33% 48.9M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31350K .......... .......... .......... .......... .......... 33% 250M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31400K .......... .......... .......... .......... .......... 33% 139M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31450K .......... .......... .......... .......... .......... 33% 307M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31500K .......... .......... .......... .......... .......... 33% 265M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31550K .......... .......... .......... .......... .......... 34% 254M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31600K .......... .......... .......... .......... .......... 34% 327M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31650K .......... .......... .......... .......... .......... 34% 298M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31700K .......... .......... .......... .......... .......... 34% 299M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31750K .......... .......... .......... .......... .......... 34% 95.0M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31800K .......... .......... .......... .......... .......... 34% 302M 0s 2024-09-14T11:24:08.386 INFO:teuthology.orchestra.run.smithi148.stderr: 31850K .......... .......... .......... .......... .......... 34% 288M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 31900K .......... .......... .......... .......... .......... 34% 329M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 31950K .......... .......... .......... .......... .......... 34% 251M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32000K .......... .......... .......... .......... .......... 34% 294M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32050K .......... .......... .......... .......... .......... 34% 324M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32100K .......... .......... .......... .......... .......... 34% 237M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32150K .......... .......... .......... .......... .......... 34% 299M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32200K .......... .......... .......... .......... .......... 34% 289M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32250K .......... .......... .......... .......... .......... 34% 296M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32300K .......... .......... .......... .......... .......... 34% 309M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32350K .......... .......... .......... .......... .......... 34% 235M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32400K .......... .......... .......... .......... .......... 34% 290M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32450K .......... .......... .......... .......... .......... 34% 296M 0s 2024-09-14T11:24:08.387 INFO:teuthology.orchestra.run.smithi148.stderr: 32500K .......... .......... .......... .......... .......... 35% 253M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32550K .......... .......... .......... .......... .......... 35% 253M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32600K .......... .......... .......... .......... .......... 35% 334M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32650K .......... .......... .......... .......... .......... 35% 305M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32700K .......... .......... .......... .......... .......... 35% 331M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32750K .......... .......... .......... .......... .......... 35% 246M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32800K .......... .......... .......... .......... .......... 35% 292M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32850K .......... .......... .......... .......... .......... 35% 251M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32900K .......... .......... .......... .......... .......... 35% 295M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 32950K .......... .......... .......... .......... .......... 35% 291M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 33000K .......... .......... .......... .......... .......... 35% 296M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 33050K .......... .......... .......... .......... .......... 35% 252M 0s 2024-09-14T11:24:08.388 INFO:teuthology.orchestra.run.smithi148.stderr: 33100K .......... .......... .......... .......... .......... 35% 318M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33150K .......... .......... .......... .......... .......... 35% 322M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33200K .......... .......... .......... .......... .......... 35% 297M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33250K .......... .......... .......... .......... .......... 35% 257M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33300K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33350K .......... .......... .......... .......... .......... 35% 310M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33400K .......... .......... .......... .......... .......... 36% 265M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33450K .......... .......... .......... .......... .......... 36% 300M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33500K .......... .......... .......... .......... .......... 36% 315M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33550K .......... .......... .......... .......... .......... 36% 104M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33600K .......... .......... .......... .......... .......... 36% 277M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33650K .......... .......... .......... .......... .......... 36% 320M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33700K .......... .......... .......... .......... .......... 36% 302M 0s 2024-09-14T11:24:08.389 INFO:teuthology.orchestra.run.smithi148.stderr: 33750K .......... .......... .......... .......... .......... 36% 235M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 33800K .......... .......... .......... .......... .......... 36% 308M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 33850K .......... .......... .......... .......... .......... 36% 318M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 33900K .......... .......... .......... .......... .......... 36% 334M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 33950K .......... .......... .......... .......... .......... 36% 160M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34000K .......... .......... .......... .......... .......... 36% 258M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34050K .......... .......... .......... .......... .......... 36% 315M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34100K .......... .......... .......... .......... .......... 36% 317M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34150K .......... .......... .......... .......... .......... 36% 317M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34200K .......... .......... .......... .......... .......... 36% 287M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34250K .......... .......... .......... .......... .......... 36% 63.4M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34300K .......... .......... .......... .......... .......... 36% 296M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34350K .......... .......... .......... .......... .......... 37% 339M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34400K .......... .......... .......... .......... .......... 37% 207M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34450K .......... .......... .......... .......... .......... 37% 276M 0s 2024-09-14T11:24:08.390 INFO:teuthology.orchestra.run.smithi148.stderr: 34500K .......... .......... .......... .......... .......... 37% 175M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34550K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34600K .......... .......... .......... .......... .......... 37% 315M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34650K .......... .......... .......... .......... .......... 37% 317M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34700K .......... .......... .......... .......... .......... 37% 80.6M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34750K .......... .......... .......... .......... .......... 37% 310M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34800K .......... .......... .......... .......... .......... 37% 297M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34850K .......... .......... .......... .......... .......... 37% 326M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34900K .......... .......... .......... .......... .......... 37% 283M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 34950K .......... .......... .......... .......... .......... 37% 152M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 35000K .......... .......... .......... .......... .......... 37% 312M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 35050K .......... .......... .......... .......... .......... 37% 283M 0s 2024-09-14T11:24:08.391 INFO:teuthology.orchestra.run.smithi148.stderr: 35100K .......... .......... .......... .......... .......... 37% 248M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35150K .......... .......... .......... .......... .......... 37% 301M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35200K .......... .......... .......... .......... .......... 37% 283M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35250K .......... .......... .......... .......... .......... 37% 306M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35300K .......... .......... .......... .......... .......... 38% 281M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35350K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35400K .......... .......... .......... .......... .......... 38% 251M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35450K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35500K .......... .......... .......... .......... .......... 38% 313M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35550K .......... .......... .......... .......... .......... 38% 310M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35600K .......... .......... .......... .......... .......... 38% 305M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35650K .......... .......... .......... .......... .......... 38% 273M 0s 2024-09-14T11:24:08.392 INFO:teuthology.orchestra.run.smithi148.stderr: 35700K .......... .......... .......... .......... .......... 38% 281M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 35750K .......... .......... .......... .......... .......... 38% 320M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 35800K .......... .......... .......... .......... .......... 38% 314M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 35850K .......... .......... .......... .......... .......... 38% 309M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 35900K .......... .......... .......... .......... .......... 38% 269M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 35950K .......... .......... .......... .......... .......... 38% 296M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 36000K .......... .......... .......... .......... .......... 38% 337M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 36050K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 36100K .......... .......... .......... .......... .......... 38% 313M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 36150K .......... .......... .......... .......... .......... 38% 249M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 36200K .......... .......... .......... .......... .......... 39% 313M 0s 2024-09-14T11:24:08.393 INFO:teuthology.orchestra.run.smithi148.stderr: 36250K .......... .......... .......... .......... .......... 39% 326M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36300K .......... .......... .......... .......... .......... 39% 315M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36350K .......... .......... .......... .......... .......... 39% 256M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36400K .......... .......... .......... .......... .......... 39% 331M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36450K .......... .......... .......... .......... .......... 39% 297M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36500K .......... .......... .......... .......... .......... 39% 92.9M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36550K .......... .......... .......... .......... .......... 39% 306M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36600K .......... .......... .......... .......... .......... 39% 260M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36650K .......... .......... .......... .......... .......... 39% 280M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36700K .......... .......... .......... .......... .......... 39% 319M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36750K .......... .......... .......... .......... .......... 39% 322M 0s 2024-09-14T11:24:08.394 INFO:teuthology.orchestra.run.smithi148.stderr: 36800K .......... .......... .......... .......... .......... 39% 101M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 36850K .......... .......... .......... .......... .......... 39% 214M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 36900K .......... .......... .......... .......... .......... 39% 324M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 36950K .......... .......... .......... .......... .......... 39% 251M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37000K .......... .......... .......... .......... .......... 39% 315M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37050K .......... .......... .......... .......... .......... 39% 266M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37100K .......... .......... .......... .......... .......... 39% 331M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37150K .......... .......... .......... .......... .......... 40% 327M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37200K .......... .......... .......... .......... .......... 40% 95.4M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37250K .......... .......... .......... .......... .......... 40% 258M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37300K .......... .......... .......... .......... .......... 40% 305M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37350K .......... .......... .......... .......... .......... 40% 334M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37400K .......... .......... .......... .......... .......... 40% 332M 0s 2024-09-14T11:24:08.395 INFO:teuthology.orchestra.run.smithi148.stderr: 37450K .......... .......... .......... .......... .......... 40% 292M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37500K .......... .......... .......... .......... .......... 40% 318M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37550K .......... .......... .......... .......... .......... 40% 259M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37600K .......... .......... .......... .......... .......... 40% 329M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37650K .......... .......... .......... .......... .......... 40% 351M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37700K .......... .......... .......... .......... .......... 40% 86.6M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37750K .......... .......... .......... .......... .......... 40% 203M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37800K .......... .......... .......... .......... .......... 40% 308M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37850K .......... .......... .......... .......... .......... 40% 334M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37900K .......... .......... .......... .......... .......... 40% 114M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 37950K .......... .......... .......... .......... .......... 40% 275M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 38000K .......... .......... .......... .......... .......... 40% 287M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 38050K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-14T11:24:08.396 INFO:teuthology.orchestra.run.smithi148.stderr: 38100K .......... .......... .......... .......... .......... 41% 328M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38150K .......... .......... .......... .......... .......... 41% 316M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38200K .......... .......... .......... .......... .......... 41% 252M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38250K .......... .......... .......... .......... .......... 41% 315M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38300K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38350K .......... .......... .......... .......... .......... 41% 303M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38400K .......... .......... .......... .......... .......... 41% 289M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38450K .......... .......... .......... .......... .......... 41% 309M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38500K .......... .......... .......... .......... .......... 41% 294M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38550K .......... .......... .......... .......... .......... 41% 329M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38600K .......... .......... .......... .......... .......... 41% 267M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38650K .......... .......... .......... .......... .......... 41% 320M 0s 2024-09-14T11:24:08.397 INFO:teuthology.orchestra.run.smithi148.stderr: 38700K .......... .......... .......... .......... .......... 41% 88.1M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 38750K .......... .......... .......... .......... .......... 41% 292M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 38800K .......... .......... .......... .......... .......... 41% 297M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 38850K .......... .......... .......... .......... .......... 41% 323M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 38900K .......... .......... .......... .......... .......... 41% 266M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 38950K .......... .......... .......... .......... .......... 41% 330M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39000K .......... .......... .......... .......... .......... 42% 300M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39050K .......... .......... .......... .......... .......... 42% 313M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39100K .......... .......... .......... .......... .......... 42% 324M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39150K .......... .......... .......... .......... .......... 42% 312M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39200K .......... .......... .......... .......... .......... 42% 316M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39250K .......... .......... .......... .......... .......... 42% 329M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39300K .......... .......... .......... .......... .......... 42% 263M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39350K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39400K .......... .......... .......... .......... .......... 42% 96.1M 0s 2024-09-14T11:24:08.398 INFO:teuthology.orchestra.run.smithi148.stderr: 39450K .......... .......... .......... .......... .......... 42% 304M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39500K .......... .......... .......... .......... .......... 42% 312M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39550K .......... .......... .......... .......... .......... 42% 228M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39600K .......... .......... .......... .......... .......... 42% 318M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39650K .......... .......... .......... .......... .......... 42% 324M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39700K .......... .......... .......... .......... .......... 42% 126M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39750K .......... .......... .......... .......... .......... 42% 216M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39800K .......... .......... .......... .......... .......... 42% 300M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39850K .......... .......... .......... .......... .......... 42% 346M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39900K .......... .......... .......... .......... .......... 43% 269M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 39950K .......... .......... .......... .......... .......... 43% 326M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 40000K .......... .......... .......... .......... .......... 43% 338M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 40050K .......... .......... .......... .......... .......... 43% 75.1M 0s 2024-09-14T11:24:08.399 INFO:teuthology.orchestra.run.smithi148.stderr: 40100K .......... .......... .......... .......... .......... 43% 317M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40150K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40200K .......... .......... .......... .......... .......... 43% 325M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40250K .......... .......... .......... .......... .......... 43% 276M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40300K .......... .......... .......... .......... .......... 43% 322M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40350K .......... .......... .......... .......... .......... 43% 321M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40400K .......... .......... .......... .......... .......... 43% 315M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40450K .......... .......... .......... .......... .......... 43% 287M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40500K .......... .......... .......... .......... .......... 43% 306M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40550K .......... .......... .......... .......... .......... 43% 274M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40600K .......... .......... .......... .......... .......... 43% 340M 0s 2024-09-14T11:24:08.400 INFO:teuthology.orchestra.run.smithi148.stderr: 40650K .......... .......... .......... .......... .......... 43% 326M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 40700K .......... .......... .......... .......... .......... 43% 276M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 40750K .......... .......... .......... .......... .......... 43% 244M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 40800K .......... .......... .......... .......... .......... 43% 167M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 40850K .......... .......... .......... .......... .......... 44% 109M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 40900K .......... .......... .......... .......... .......... 44% 218M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 40950K .......... .......... .......... .......... .......... 44% 389M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 41000K .......... .......... .......... .......... .......... 44% 323M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 41050K .......... .......... .......... .......... .......... 44% 243M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 41100K .......... .......... .......... .......... .......... 44% 246M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 41150K .......... .......... .......... .......... .......... 44% 241M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 41200K .......... .......... .......... .......... .......... 44% 312M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 41250K .......... .......... .......... .......... .......... 44% 306M 0s 2024-09-14T11:24:08.401 INFO:teuthology.orchestra.run.smithi148.stderr: 41300K .......... .......... .......... .......... .......... 44% 307M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41350K .......... .......... .......... .......... .......... 44% 268M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41400K .......... .......... .......... .......... .......... 44% 301M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41450K .......... .......... .......... .......... .......... 44% 308M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41500K .......... .......... .......... .......... .......... 44% 312M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41550K .......... .......... .......... .......... .......... 44% 272M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41600K .......... .......... .......... .......... .......... 44% 292M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41650K .......... .......... .......... .......... .......... 44% 90.6M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41700K .......... .......... .......... .......... .......... 44% 317M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41750K .......... .......... .......... .......... .......... 44% 292M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41800K .......... .......... .......... .......... .......... 45% 330M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41850K .......... .......... .......... .......... .......... 45% 330M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41900K .......... .......... .......... .......... .......... 45% 317M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 41950K .......... .......... .......... .......... .......... 45% 291M 0s 2024-09-14T11:24:08.402 INFO:teuthology.orchestra.run.smithi148.stderr: 42000K .......... .......... .......... .......... .......... 45% 348M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42050K .......... .......... .......... .......... .......... 45% 323M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42100K .......... .......... .......... .......... .......... 45% 338M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42150K .......... .......... .......... .......... .......... 45% 302M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42200K .......... .......... .......... .......... .......... 45% 290M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42250K .......... .......... .......... .......... .......... 45% 62.6M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42300K .......... .......... .......... .......... .......... 45% 307M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42350K .......... .......... .......... .......... .......... 45% 250M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42400K .......... .......... .......... .......... .......... 45% 305M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42450K .......... .......... .......... .......... .......... 45% 340M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42500K .......... .......... .......... .......... .......... 45% 255M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42550K .......... .......... .......... .......... .......... 45% 321M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42600K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-14T11:24:08.403 INFO:teuthology.orchestra.run.smithi148.stderr: 42650K .......... .......... .......... .......... .......... 45% 210M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 42700K .......... .......... .......... .......... .......... 46% 303M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 42750K .......... .......... .......... .......... .......... 46% 329M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 42800K .......... .......... .......... .......... .......... 46% 284M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 42850K .......... .......... .......... .......... .......... 46% 316M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 42900K .......... .......... .......... .......... .......... 46% 340M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 42950K .......... .......... .......... .......... .......... 46% 76.0M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 43000K .......... .......... .......... .......... .......... 46% 330M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 43050K .......... .......... .......... .......... .......... 46% 331M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 43100K .......... .......... .......... .......... .......... 46% 314M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 43150K .......... .......... .......... .......... .......... 46% 275M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 43200K .......... .......... .......... .......... .......... 46% 346M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 43250K .......... .......... .......... .......... .......... 46% 335M 0s 2024-09-14T11:24:08.404 INFO:teuthology.orchestra.run.smithi148.stderr: 43300K .......... .......... .......... .......... .......... 46% 316M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43350K .......... .......... .......... .......... .......... 46% 287M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43400K .......... .......... .......... .......... .......... 46% 287M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43450K .......... .......... .......... .......... .......... 46% 324M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43500K .......... .......... .......... .......... .......... 46% 322M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43550K .......... .......... .......... .......... .......... 46% 344M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43600K .......... .......... .......... .......... .......... 46% 255M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43650K .......... .......... .......... .......... .......... 47% 332M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43700K .......... .......... .......... .......... .......... 47% 313M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43750K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43800K .......... .......... .......... .......... .......... 47% 264M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43850K .......... .......... .......... .......... .......... 47% 84.9M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43900K .......... .......... .......... .......... .......... 47% 323M 0s 2024-09-14T11:24:08.405 INFO:teuthology.orchestra.run.smithi148.stderr: 43950K .......... .......... .......... .......... .......... 47% 329M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44000K .......... .......... .......... .......... .......... 47% 116M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44050K .......... .......... .......... .......... .......... 47% 264M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44100K .......... .......... .......... .......... .......... 47% 335M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44150K .......... .......... .......... .......... .......... 47% 331M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44200K .......... .......... .......... .......... .......... 47% 327M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44250K .......... .......... .......... .......... .......... 47% 296M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44300K .......... .......... .......... .......... .......... 47% 282M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44350K .......... .......... .......... .......... .......... 47% 279M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44400K .......... .......... .......... .......... .......... 47% 351M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44450K .......... .......... .......... .......... .......... 47% 272M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44500K .......... .......... .......... .......... .......... 47% 371M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44550K .......... .......... .......... .......... .......... 48% 83.1M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44600K .......... .......... .......... .......... .......... 48% 304M 0s 2024-09-14T11:24:08.406 INFO:teuthology.orchestra.run.smithi148.stderr: 44650K .......... .......... .......... .......... .......... 48% 318M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 44700K .......... .......... .......... .......... .......... 48% 311M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 44750K .......... .......... .......... .......... .......... 48% 267M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 44800K .......... .......... .......... .......... .......... 48% 334M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 44850K .......... .......... .......... .......... .......... 48% 319M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 44900K .......... .......... .......... .......... .......... 48% 326M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 44950K .......... .......... .......... .......... .......... 48% 297M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45000K .......... .......... .......... .......... .......... 48% 347M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45050K .......... .......... .......... .......... .......... 48% 332M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45100K .......... .......... .......... .......... .......... 48% 323M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45150K .......... .......... .......... .......... .......... 48% 231M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45200K .......... .......... .......... .......... .......... 48% 332M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45250K .......... .......... .......... .......... .......... 48% 83.5M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45300K .......... .......... .......... .......... .......... 48% 316M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45350K .......... .......... .......... .......... .......... 48% 137M 0s 2024-09-14T11:24:08.407 INFO:teuthology.orchestra.run.smithi148.stderr: 45400K .......... .......... .......... .......... .......... 48% 273M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45450K .......... .......... .......... .......... .......... 48% 322M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45500K .......... .......... .......... .......... .......... 49% 337M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45550K .......... .......... .......... .......... .......... 49% 267M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45600K .......... .......... .......... .......... .......... 49% 194M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45650K .......... .......... .......... .......... .......... 49% 324M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45700K .......... .......... .......... .......... .......... 49% 323M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45750K .......... .......... .......... .......... .......... 49% 310M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45800K .......... .......... .......... .......... .......... 49% 279M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45850K .......... .......... .......... .......... .......... 49% 353M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45900K .......... .......... .......... .......... .......... 49% 89.0M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 45950K .......... .......... .......... .......... .......... 49% 310M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 46000K .......... .......... .......... .......... .......... 49% 323M 0s 2024-09-14T11:24:08.408 INFO:teuthology.orchestra.run.smithi148.stderr: 46050K .......... .......... .......... .......... .......... 49% 340M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46100K .......... .......... .......... .......... .......... 49% 276M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46150K .......... .......... .......... .......... .......... 49% 340M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46200K .......... .......... .......... .......... .......... 49% 259M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46250K .......... .......... .......... .......... .......... 49% 334M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46300K .......... .......... .......... .......... .......... 49% 300M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46350K .......... .......... .......... .......... .......... 49% 335M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46400K .......... .......... .......... .......... .......... 49% 312M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46450K .......... .......... .......... .......... .......... 50% 342M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46500K .......... .......... .......... .......... .......... 50% 351M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46550K .......... .......... .......... .......... .......... 50% 306M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46600K .......... .......... .......... .......... .......... 50% 339M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46650K .......... .......... .......... .......... .......... 50% 322M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46700K .......... .......... .......... .......... .......... 50% 315M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46750K .......... .......... .......... .......... .......... 50% 200M 0s 2024-09-14T11:24:08.409 INFO:teuthology.orchestra.run.smithi148.stderr: 46800K .......... .......... .......... .......... .......... 50% 361M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 46850K .......... .......... .......... .......... .......... 50% 161M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 46900K .......... .......... .......... .......... .......... 50% 171M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 46950K .......... .......... .......... .......... .......... 50% 311M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47000K .......... .......... .......... .......... .......... 50% 115M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47050K .......... .......... .......... .......... .......... 50% 207M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47100K .......... .......... .......... .......... .......... 50% 330M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47150K .......... .......... .......... .......... .......... 50% 254M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47200K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47250K .......... .......... .......... .......... .......... 50% 182M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47300K .......... .......... .......... .......... .......... 50% 317M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47350K .......... .......... .......... .......... .......... 51% 317M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47400K .......... .......... .......... .......... .......... 51% 316M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47450K .......... .......... .......... .......... .......... 51% 319M 0s 2024-09-14T11:24:08.410 INFO:teuthology.orchestra.run.smithi148.stderr: 47500K .......... .......... .......... .......... .......... 51% 76.0M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47550K .......... .......... .......... .......... .......... 51% 322M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47600K .......... .......... .......... .......... .......... 51% 300M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47650K .......... .......... .......... .......... .......... 51% 303M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47700K .......... .......... .......... .......... .......... 51% 316M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47750K .......... .......... .......... .......... .......... 51% 352M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47800K .......... .......... .......... .......... .......... 51% 311M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47850K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47900K .......... .......... .......... .......... .......... 51% 345M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 47950K .......... .......... .......... .......... .......... 51% 283M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 48000K .......... .......... .......... .......... .......... 51% 333M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 48050K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 48100K .......... .......... .......... .......... .......... 51% 312M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 48150K .......... .......... .......... .......... .......... 51% 348M 0s 2024-09-14T11:24:08.411 INFO:teuthology.orchestra.run.smithi148.stderr: 48200K .......... .......... .......... .......... .......... 51% 89.2M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48250K .......... .......... .......... .......... .......... 51% 340M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48300K .......... .......... .......... .......... .......... 52% 305M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48350K .......... .......... .......... .......... .......... 52% 254M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48400K .......... .......... .......... .......... .......... 52% 144M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48450K .......... .......... .......... .......... .......... 52% 295M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48500K .......... .......... .......... .......... .......... 52% 215M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48550K .......... .......... .......... .......... .......... 52% 292M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48600K .......... .......... .......... .......... .......... 52% 321M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48650K .......... .......... .......... .......... .......... 52% 296M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48700K .......... .......... .......... .......... .......... 52% 310M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48750K .......... .......... .......... .......... .......... 52% 340M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48800K .......... .......... .......... .......... .......... 52% 84.3M 0s 2024-09-14T11:24:08.412 INFO:teuthology.orchestra.run.smithi148.stderr: 48850K .......... .......... .......... .......... .......... 52% 241M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 48900K .......... .......... .......... .......... .......... 52% 310M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 48950K .......... .......... .......... .......... .......... 52% 308M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49000K .......... .......... .......... .......... .......... 52% 332M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49050K .......... .......... .......... .......... .......... 52% 305M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49100K .......... .......... .......... .......... .......... 52% 366M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49150K .......... .......... .......... .......... .......... 52% 313M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49200K .......... .......... .......... .......... .......... 53% 351M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49250K .......... .......... .......... .......... .......... 53% 238M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49300K .......... .......... .......... .......... .......... 53% 326M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49350K .......... .......... .......... .......... .......... 53% 290M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49400K .......... .......... .......... .......... .......... 53% 312M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49450K .......... .......... .......... .......... .......... 53% 325M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49500K .......... .......... .......... .......... .......... 53% 269M 0s 2024-09-14T11:24:08.413 INFO:teuthology.orchestra.run.smithi148.stderr: 49550K .......... .......... .......... .......... .......... 53% 338M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 49600K .......... .......... .......... .......... .......... 53% 349M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 49650K .......... .......... .......... .......... .......... 53% 343M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 49700K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 49750K .......... .......... .......... .......... .......... 53% 346M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 49800K .......... .......... .......... .......... .......... 53% 315M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 49850K .......... .......... .......... .......... .......... 53% 308M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 49900K .......... .......... .......... .......... .......... 53% 203M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 49950K .......... .......... .......... .......... .......... 53% 107M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 50000K .......... .......... .......... .......... .......... 53% 339M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 50050K .......... .......... .......... .......... .......... 53% 204M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 50100K .......... .......... .......... .......... .......... 53% 172M 0s 2024-09-14T11:24:08.414 INFO:teuthology.orchestra.run.smithi148.stderr: 50150K .......... .......... .......... .......... .......... 54% 316M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50200K .......... .......... .......... .......... .......... 54% 263M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50250K .......... .......... .......... .......... .......... 54% 346M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50300K .......... .......... .......... .......... .......... 54% 155M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50350K .......... .......... .......... .......... .......... 54% 325M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50400K .......... .......... .......... .......... .......... 54% 69.5M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50450K .......... .......... .......... .......... .......... 54% 349M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50500K .......... .......... .......... .......... .......... 54% 307M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50550K .......... .......... .......... .......... .......... 54% 288M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50600K .......... .......... .......... .......... .......... 54% 354M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50650K .......... .......... .......... .......... .......... 54% 253M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50700K .......... .......... .......... .......... .......... 54% 331M 0s 2024-09-14T11:24:08.415 INFO:teuthology.orchestra.run.smithi148.stderr: 50750K .......... .......... .......... .......... .......... 54% 336M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 50800K .......... .......... .......... .......... .......... 54% 326M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 50850K .......... .......... .......... .......... .......... 54% 265M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 50900K .......... .......... .......... .......... .......... 54% 340M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 50950K .......... .......... .......... .......... .......... 54% 354M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51000K .......... .......... .......... .......... .......... 54% 355M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51050K .......... .......... .......... .......... .......... 55% 302M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51100K .......... .......... .......... .......... .......... 55% 98.7M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51150K .......... .......... .......... .......... .......... 55% 192M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51200K .......... .......... .......... .......... .......... 55% 285M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51250K .......... .......... .......... .......... .......... 55% 341M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51300K .......... .......... .......... .......... .......... 55% 322M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51350K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-14T11:24:08.416 INFO:teuthology.orchestra.run.smithi148.stderr: 51400K .......... .......... .......... .......... .......... 55% 341M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51450K .......... .......... .......... .......... .......... 55% 233M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51500K .......... .......... .......... .......... .......... 55% 159M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51550K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51600K .......... .......... .......... .......... .......... 55% 329M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51650K .......... .......... .......... .......... .......... 55% 358M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51700K .......... .......... .......... .......... .......... 55% 324M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51750K .......... .......... .......... .......... .......... 55% 323M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51800K .......... .......... .......... .......... .......... 55% 94.1M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51850K .......... .......... .......... .......... .......... 55% 347M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51900K .......... .......... .......... .......... .......... 55% 277M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 51950K .......... .......... .......... .......... .......... 55% 164M 0s 2024-09-14T11:24:08.417 INFO:teuthology.orchestra.run.smithi148.stderr: 52000K .......... .......... .......... .......... .......... 56% 336M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52050K .......... .......... .......... .......... .......... 56% 343M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52100K .......... .......... .......... .......... .......... 56% 293M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52150K .......... .......... .......... .......... .......... 56% 326M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52200K .......... .......... .......... .......... .......... 56% 339M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52250K .......... .......... .......... .......... .......... 56% 320M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52300K .......... .......... .......... .......... .......... 56% 284M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52350K .......... .......... .......... .......... .......... 56% 355M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52400K .......... .......... .......... .......... .......... 56% 339M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52450K .......... .......... .......... .......... .......... 56% 287M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52500K .......... .......... .......... .......... .......... 56% 343M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52550K .......... .......... .......... .......... .......... 56% 331M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52600K .......... .......... .......... .......... .......... 56% 329M 0s 2024-09-14T11:24:08.418 INFO:teuthology.orchestra.run.smithi148.stderr: 52650K .......... .......... .......... .......... .......... 56% 321M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 52700K .......... .......... .......... .......... .......... 56% 243M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 52750K .......... .......... .......... .......... .......... 56% 339M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 52800K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 52850K .......... .......... .......... .......... .......... 56% 330M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 52900K .......... .......... .......... .......... .......... 56% 331M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 52950K .......... .......... .......... .......... .......... 57% 168M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 53000K .......... .......... .......... .......... .......... 57% 345M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 53050K .......... .......... .......... .......... .......... 57% 160M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 53100K .......... .......... .......... .......... .......... 57% 149M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 53150K .......... .......... .......... .......... .......... 57% 175M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 53200K .......... .......... .......... .......... .......... 57% 313M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 53250K .......... .......... .......... .......... .......... 57% 341M 0s 2024-09-14T11:24:08.419 INFO:teuthology.orchestra.run.smithi148.stderr: 53300K .......... .......... .......... .......... .......... 57% 200M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53350K .......... .......... .......... .......... .......... 57% 265M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53400K .......... .......... .......... .......... .......... 57% 76.6M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53450K .......... .......... .......... .......... .......... 57% 179M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53500K .......... .......... .......... .......... .......... 57% 302M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53550K .......... .......... .......... .......... .......... 57% 231M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53600K .......... .......... .......... .......... .......... 57% 333M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53650K .......... .......... .......... .......... .......... 57% 327M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53700K .......... .......... .......... .......... .......... 57% 300M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53750K .......... .......... .......... .......... .......... 57% 311M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53800K .......... .......... .......... .......... .......... 57% 131M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53850K .......... .......... .......... .......... .......... 58% 288M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53900K .......... .......... .......... .......... .......... 58% 329M 0s 2024-09-14T11:24:08.420 INFO:teuthology.orchestra.run.smithi148.stderr: 53950K .......... .......... .......... .......... .......... 58% 350M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54000K .......... .......... .......... .......... .......... 58% 357M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54050K .......... .......... .......... .......... .......... 58% 135M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54100K .......... .......... .......... .......... .......... 58% 258M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54150K .......... .......... .......... .......... .......... 58% 202M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54200K .......... .......... .......... .......... .......... 58% 231M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54250K .......... .......... .......... .......... .......... 58% 317M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54300K .......... .......... .......... .......... .......... 58% 258M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54350K .......... .......... .......... .......... .......... 58% 318M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54400K .......... .......... .......... .......... .......... 58% 278M 0s 2024-09-14T11:24:08.421 INFO:teuthology.orchestra.run.smithi148.stderr: 54450K .......... .......... .......... .......... .......... 58% 287M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54500K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54550K .......... .......... .......... .......... .......... 58% 241M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54600K .......... .......... .......... .......... .......... 58% 243M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54650K .......... .......... .......... .......... .......... 58% 321M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54700K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54750K .......... .......... .......... .......... .......... 58% 358M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54800K .......... .......... .......... .......... .......... 59% 263M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54850K .......... .......... .......... .......... .......... 59% 122M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54900K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 54950K .......... .......... .......... .......... .......... 59% 339M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 55000K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-14T11:24:08.422 INFO:teuthology.orchestra.run.smithi148.stderr: 55050K .......... .......... .......... .......... .......... 59% 270M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55100K .......... .......... .......... .......... .......... 59% 181M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55150K .......... .......... .......... .......... .......... 59% 337M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55200K .......... .......... .......... .......... .......... 59% 317M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55250K .......... .......... .......... .......... .......... 59% 234M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55300K .......... .......... .......... .......... .......... 59% 288M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55350K .......... .......... .......... .......... .......... 59% 331M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55400K .......... .......... .......... .......... .......... 59% 311M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55450K .......... .......... .......... .......... .......... 59% 330M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55500K .......... .......... .......... .......... .......... 59% 267M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55550K .......... .......... .......... .......... .......... 59% 322M 0s 2024-09-14T11:24:08.423 INFO:teuthology.orchestra.run.smithi148.stderr: 55600K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 55650K .......... .......... .......... .......... .......... 59% 325M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 55700K .......... .......... .......... .......... .......... 60% 283M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 55750K .......... .......... .......... .......... .......... 60% 346M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 55800K .......... .......... .......... .......... .......... 60% 290M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 55850K .......... .......... .......... .......... .......... 60% 334M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 55900K .......... .......... .......... .......... .......... 60% 332M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 55950K .......... .......... .......... .......... .......... 60% 273M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 56000K .......... .......... .......... .......... .......... 60% 314M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 56050K .......... .......... .......... .......... .......... 60% 328M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 56100K .......... .......... .......... .......... .......... 60% 346M 0s 2024-09-14T11:24:08.424 INFO:teuthology.orchestra.run.smithi148.stderr: 56150K .......... .......... .......... .......... .......... 60% 114M 0s 2024-09-14T11:24:08.425 INFO:teuthology.orchestra.run.smithi148.stderr: 56200K .......... .......... .......... .......... .......... 60% 134M 0s 2024-09-14T11:24:08.425 INFO:teuthology.orchestra.run.smithi148.stderr: 56250K .......... .......... .......... .......... .......... 60% 182M 0s 2024-09-14T11:24:08.425 INFO:teuthology.orchestra.run.smithi148.stderr: 56300K .......... .......... .......... .......... .......... 60% 279M 0s 2024-09-14T11:24:08.425 INFO:teuthology.orchestra.run.smithi148.stderr: 56350K .......... .......... .......... .......... .......... 60% 76.8M 0s 2024-09-14T11:24:08.425 INFO:teuthology.orchestra.run.smithi148.stderr: 56400K .......... .......... .......... .......... .......... 60% 364M 0s 2024-09-14T11:24:08.425 INFO:teuthology.orchestra.run.smithi148.stderr: 56450K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-14T11:24:08.425 INFO:teuthology.orchestra.run.smithi148.stderr: 56500K .......... .......... .......... .......... .......... 60% 342M 0s 2024-09-14T11:24:08.425 INFO:teuthology.orchestra.run.smithi148.stderr: 56550K .......... .......... .......... .......... .......... 60% 344M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 56600K .......... .......... .......... .......... .......... 60% 184M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 56650K .......... .......... .......... .......... .......... 61% 295M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 56700K .......... .......... .......... .......... .......... 61% 311M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 56750K .......... .......... .......... .......... .......... 61% 362M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 56800K .......... .......... .......... .......... .......... 61% 202M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 56850K .......... .......... .......... .......... .......... 61% 244M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 56900K .......... .......... .......... .......... .......... 61% 74.5M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 56950K .......... .......... .......... .......... .......... 61% 291M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 57000K .......... .......... .......... .......... .......... 61% 301M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 57050K .......... .......... .......... .......... .......... 61% 301M 0s 2024-09-14T11:24:08.426 INFO:teuthology.orchestra.run.smithi148.stderr: 57100K .......... .......... .......... .......... .......... 61% 281M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57150K .......... .......... .......... .......... .......... 61% 333M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57200K .......... .......... .......... .......... .......... 61% 335M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57250K .......... .......... .......... .......... .......... 61% 318M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57300K .......... .......... .......... .......... .......... 61% 175M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57350K .......... .......... .......... .......... .......... 61% 313M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57400K .......... .......... .......... .......... .......... 61% 348M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57450K .......... .......... .......... .......... .......... 61% 246M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57500K .......... .......... .......... .......... .......... 61% 269M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57550K .......... .......... .......... .......... .......... 62% 344M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57600K .......... .......... .......... .......... .......... 62% 355M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57650K .......... .......... .......... .......... .......... 62% 329M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57700K .......... .......... .......... .......... .......... 62% 299M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57750K .......... .......... .......... .......... .......... 62% 339M 0s 2024-09-14T11:24:08.427 INFO:teuthology.orchestra.run.smithi148.stderr: 57800K .......... .......... .......... .......... .......... 62% 275M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 57850K .......... .......... .......... .......... .......... 62% 180M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 57900K .......... .......... .......... .......... .......... 62% 337M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 57950K .......... .......... .......... .......... .......... 62% 313M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58000K .......... .......... .......... .......... .......... 62% 289M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58050K .......... .......... .......... .......... .......... 62% 357M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58100K .......... .......... .......... .......... .......... 62% 250M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58150K .......... .......... .......... .......... .......... 62% 337M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58200K .......... .......... .......... .......... .......... 62% 141M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58250K .......... .......... .......... .......... .......... 62% 343M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58300K .......... .......... .......... .......... .......... 62% 271M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58350K .......... .......... .......... .......... .......... 62% 324M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58400K .......... .......... .......... .......... .......... 62% 345M 0s 2024-09-14T11:24:08.428 INFO:teuthology.orchestra.run.smithi148.stderr: 58450K .......... .......... .......... .......... .......... 62% 269M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58500K .......... .......... .......... .......... .......... 63% 176M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58550K .......... .......... .......... .......... .......... 63% 339M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58600K .......... .......... .......... .......... .......... 63% 328M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58650K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58700K .......... .......... .......... .......... .......... 63% 309M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58750K .......... .......... .......... .......... .......... 63% 332M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58800K .......... .......... .......... .......... .......... 63% 280M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58850K .......... .......... .......... .......... .......... 63% 293M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58900K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 58950K .......... .......... .......... .......... .......... 63% 308M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 59000K .......... .......... .......... .......... .......... 63% 339M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 59050K .......... .......... .......... .......... .......... 63% 284M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 59100K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 59150K .......... .......... .......... .......... .......... 63% 291M 0s 2024-09-14T11:24:08.429 INFO:teuthology.orchestra.run.smithi148.stderr: 59200K .......... .......... .......... .......... .......... 63% 135M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59250K .......... .......... .......... .......... .......... 63% 124M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59300K .......... .......... .......... .......... .......... 63% 108M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59350K .......... .......... .......... .......... .......... 63% 292M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59400K .......... .......... .......... .......... .......... 63% 143M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59450K .......... .......... .......... .......... .......... 64% 318M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59500K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59550K .......... .......... .......... .......... .......... 64% 284M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59600K .......... .......... .......... .......... .......... 64% 324M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59650K .......... .......... .......... .......... .......... 64% 159M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59700K .......... .......... .......... .......... .......... 64% 241M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59750K .......... .......... .......... .......... .......... 64% 319M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59800K .......... .......... .......... .......... .......... 64% 240M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59850K .......... .......... .......... .......... .......... 64% 334M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59900K .......... .......... .......... .......... .......... 64% 85.8M 0s 2024-09-14T11:24:08.430 INFO:teuthology.orchestra.run.smithi148.stderr: 59950K .......... .......... .......... .......... .......... 64% 303M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60000K .......... .......... .......... .......... .......... 64% 224M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60050K .......... .......... .......... .......... .......... 64% 255M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60100K .......... .......... .......... .......... .......... 64% 333M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60150K .......... .......... .......... .......... .......... 64% 356M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60200K .......... .......... .......... .......... .......... 64% 139M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60250K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60300K .......... .......... .......... .......... .......... 64% 308M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60350K .......... .......... .......... .......... .......... 65% 340M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60400K .......... .......... .......... .......... .......... 65% 169M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60450K .......... .......... .......... .......... .......... 65% 281M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60500K .......... .......... .......... .......... .......... 65% 282M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60550K .......... .......... .......... .......... .......... 65% 338M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60600K .......... .......... .......... .......... .......... 65% 356M 0s 2024-09-14T11:24:08.431 INFO:teuthology.orchestra.run.smithi148.stderr: 60650K .......... .......... .......... .......... .......... 65% 327M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 60700K .......... .......... .......... .......... .......... 65% 301M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 60750K .......... .......... .......... .......... .......... 65% 311M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 60800K .......... .......... .......... .......... .......... 65% 331M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 60850K .......... .......... .......... .......... .......... 65% 342M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 60900K .......... .......... .......... .......... .......... 65% 126M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 60950K .......... .......... .......... .......... .......... 65% 275M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 61000K .......... .......... .......... .......... .......... 65% 354M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 61050K .......... .......... .......... .......... .......... 65% 324M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 61100K .......... .......... .......... .......... .......... 65% 331M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 61150K .......... .......... .......... .......... .......... 65% 301M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 61200K .......... .......... .......... .......... .......... 65% 353M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 61250K .......... .......... .......... .......... .......... 65% 355M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 61300K .......... .......... .......... .......... .......... 66% 167M 0s 2024-09-14T11:24:08.432 INFO:teuthology.orchestra.run.smithi148.stderr: 61350K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61400K .......... .......... .......... .......... .......... 66% 289M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61450K .......... .......... .......... .......... .......... 66% 346M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61500K .......... .......... .......... .......... .......... 66% 345M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61550K .......... .......... .......... .......... .......... 66% 227M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61600K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61650K .......... .......... .......... .......... .......... 66% 339M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61700K .......... .......... .......... .......... .......... 66% 356M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61750K .......... .......... .......... .......... .......... 66% 157M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61800K .......... .......... .......... .......... .......... 66% 330M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61850K .......... .......... .......... .......... .......... 66% 349M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61900K .......... .......... .......... .......... .......... 66% 336M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 61950K .......... .......... .......... .......... .......... 66% 290M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 62000K .......... .......... .......... .......... .......... 66% 340M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 62050K .......... .......... .......... .......... .......... 66% 335M 0s 2024-09-14T11:24:08.433 INFO:teuthology.orchestra.run.smithi148.stderr: 62100K .......... .......... .......... .......... .......... 66% 218M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62150K .......... .......... .......... .......... .......... 66% 295M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62200K .......... .......... .......... .......... .......... 67% 342M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62250K .......... .......... .......... .......... .......... 67% 204M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62300K .......... .......... .......... .......... .......... 67% 227M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62350K .......... .......... .......... .......... .......... 67% 94.8M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62400K .......... .......... .......... .......... .......... 67% 228M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62450K .......... .......... .......... .......... .......... 67% 191M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62500K .......... .......... .......... .......... .......... 67% 148M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62550K .......... .......... .......... .......... .......... 67% 338M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62600K .......... .......... .......... .......... .......... 67% 280M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62650K .......... .......... .......... .......... .......... 67% 325M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62700K .......... .......... .......... .......... .......... 67% 126M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62750K .......... .......... .......... .......... .......... 67% 270M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62800K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-14T11:24:08.434 INFO:teuthology.orchestra.run.smithi148.stderr: 62850K .......... .......... .......... .......... .......... 67% 353M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 62900K .......... .......... .......... .......... .......... 67% 167M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 62950K .......... .......... .......... .......... .......... 67% 146M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63000K .......... .......... .......... .......... .......... 67% 281M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63050K .......... .......... .......... .......... .......... 67% 341M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63100K .......... .......... .......... .......... .......... 67% 263M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63150K .......... .......... .......... .......... .......... 68% 320M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63200K .......... .......... .......... .......... .......... 68% 176M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63250K .......... .......... .......... .......... .......... 68% 159M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63300K .......... .......... .......... .......... .......... 68% 338M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63350K .......... .......... .......... .......... .......... 68% 118M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63400K .......... .......... .......... .......... .......... 68% 315M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63450K .......... .......... .......... .......... .......... 68% 297M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63500K .......... .......... .......... .......... .......... 68% 337M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63550K .......... .......... .......... .......... .......... 68% 394M 0s 2024-09-14T11:24:08.435 INFO:teuthology.orchestra.run.smithi148.stderr: 63600K .......... .......... .......... .......... .......... 68% 294M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 63650K .......... .......... .......... .......... .......... 68% 350M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 63700K .......... .......... .......... .......... .......... 68% 336M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 63750K .......... .......... .......... .......... .......... 68% 285M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 63800K .......... .......... .......... .......... .......... 68% 355M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 63850K .......... .......... .......... .......... .......... 68% 83.6M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 63900K .......... .......... .......... .......... .......... 68% 260M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 63950K .......... .......... .......... .......... .......... 68% 325M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 64000K .......... .......... .......... .......... .......... 68% 309M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 64050K .......... .......... .......... .......... .......... 68% 336M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 64100K .......... .......... .......... .......... .......... 69% 293M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 64150K .......... .......... .......... .......... .......... 69% 300M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 64200K .......... .......... .......... .......... .......... 69% 354M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 64250K .......... .......... .......... .......... .......... 69% 275M 0s 2024-09-14T11:24:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 64300K .......... .......... .......... .......... .......... 69% 326M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64350K .......... .......... .......... .......... .......... 69% 129M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64400K .......... .......... .......... .......... .......... 69% 284M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64450K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64500K .......... .......... .......... .......... .......... 69% 348M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64550K .......... .......... .......... .......... .......... 69% 302M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64600K .......... .......... .......... .......... .......... 69% 343M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64650K .......... .......... .......... .......... .......... 69% 169M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64700K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64750K .......... .......... .......... .......... .......... 69% 334M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64800K .......... .......... .......... .......... .......... 69% 303M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64850K .......... .......... .......... .......... .......... 69% 315M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64900K .......... .......... .......... .......... .......... 69% 312M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 64950K .......... .......... .......... .......... .......... 69% 301M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 65000K .......... .......... .......... .......... .......... 70% 310M 0s 2024-09-14T11:24:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: 65050K .......... .......... .......... .......... .......... 70% 281M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65100K .......... .......... .......... .......... .......... 70% 295M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65150K .......... .......... .......... .......... .......... 70% 342M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65200K .......... .......... .......... .......... .......... 70% 297M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65250K .......... .......... .......... .......... .......... 70% 337M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65300K .......... .......... .......... .......... .......... 70% 352M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65350K .......... .......... .......... .......... .......... 70% 113M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65400K .......... .......... .......... .......... .......... 70% 290M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65450K .......... .......... .......... .......... .......... 70% 325M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65500K .......... .......... .......... .......... .......... 70% 217M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65550K .......... .......... .......... .......... .......... 70% 222M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65600K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65650K .......... .......... .......... .......... .......... 70% 220M 0s 2024-09-14T11:24:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: 65700K .......... .......... .......... .......... .......... 70% 134M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 65750K .......... .......... .......... .......... .......... 70% 257M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 65800K .......... .......... .......... .......... .......... 70% 172M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 65850K .......... .......... .......... .......... .......... 70% 338M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 65900K .......... .......... .......... .......... .......... 70% 342M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 65950K .......... .......... .......... .......... .......... 71% 257M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66000K .......... .......... .......... .......... .......... 71% 121M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66050K .......... .......... .......... .......... .......... 71% 316M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66100K .......... .......... .......... .......... .......... 71% 326M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66150K .......... .......... .......... .......... .......... 71% 307M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66200K .......... .......... .......... .......... .......... 71% 296M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66250K .......... .......... .......... .......... .......... 71% 314M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66300K .......... .......... .......... .......... .......... 71% 114M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66350K .......... .......... .......... .......... .......... 71% 339M 0s 2024-09-14T11:24:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: 66400K .......... .......... .......... .......... .......... 71% 199M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66450K .......... .......... .......... .......... .......... 71% 220M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66500K .......... .......... .......... .......... .......... 71% 211M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66550K .......... .......... .......... .......... .......... 71% 319M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66600K .......... .......... .......... .......... .......... 71% 280M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66650K .......... .......... .......... .......... .......... 71% 339M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66700K .......... .......... .......... .......... .......... 71% 327M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66750K .......... .......... .......... .......... .......... 71% 108M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66800K .......... .......... .......... .......... .......... 71% 194M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66850K .......... .......... .......... .......... .......... 72% 334M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66900K .......... .......... .......... .......... .......... 72% 281M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 66950K .......... .......... .......... .......... .......... 72% 326M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 67000K .......... .......... .......... .......... .......... 72% 284M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 67050K .......... .......... .......... .......... .......... 72% 347M 0s 2024-09-14T11:24:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: 67100K .......... .......... .......... .......... .......... 72% 283M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67150K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67200K .......... .......... .......... .......... .......... 72% 95.8M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67250K .......... .......... .......... .......... .......... 72% 256M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67300K .......... .......... .......... .......... .......... 72% 271M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67350K .......... .......... .......... .......... .......... 72% 310M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67400K .......... .......... .......... .......... .......... 72% 338M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67450K .......... .......... .......... .......... .......... 72% 338M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67500K .......... .......... .......... .......... .......... 72% 334M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67550K .......... .......... .......... .......... .......... 72% 118M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67600K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67650K .......... .......... .......... .......... .......... 72% 269M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67700K .......... .......... .......... .......... .......... 72% 349M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67750K .......... .......... .......... .......... .......... 72% 333M 0s 2024-09-14T11:24:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: 67800K .......... .......... .......... .......... .......... 73% 319M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 67850K .......... .......... .......... .......... .......... 73% 311M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 67900K .......... .......... .......... .......... .......... 73% 256M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 67950K .......... .......... .......... .......... .......... 73% 340M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68000K .......... .......... .......... .......... .......... 73% 341M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68050K .......... .......... .......... .......... .......... 73% 302M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68100K .......... .......... .......... .......... .......... 73% 290M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68150K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68200K .......... .......... .......... .......... .......... 73% 345M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68250K .......... .......... .......... .......... .......... 73% 289M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68300K .......... .......... .......... .......... .......... 73% 225M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68350K .......... .......... .......... .......... .......... 73% 320M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68400K .......... .......... .......... .......... .......... 73% 295M 0s 2024-09-14T11:24:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: 68450K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68500K .......... .......... .......... .......... .......... 73% 318M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68550K .......... .......... .......... .......... .......... 73% 347M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68600K .......... .......... .......... .......... .......... 73% 196M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68650K .......... .......... .......... .......... .......... 73% 178M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68700K .......... .......... .......... .......... .......... 74% 318M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68750K .......... .......... .......... .......... .......... 74% 236M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68800K .......... .......... .......... .......... .......... 74% 341M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68850K .......... .......... .......... .......... .......... 74% 148M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68900K .......... .......... .......... .......... .......... 74% 330M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 68950K .......... .......... .......... .......... .......... 74% 264M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 69000K .......... .......... .......... .......... .......... 74% 171M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 69050K .......... .......... .......... .......... .......... 74% 186M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 69100K .......... .......... .......... .......... .......... 74% 311M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 69150K .......... .......... .......... .......... .......... 74% 326M 0s 2024-09-14T11:24:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: 69200K .......... .......... .......... .......... .......... 74% 337M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69250K .......... .......... .......... .......... .......... 74% 241M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69300K .......... .......... .......... .......... .......... 74% 125M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69350K .......... .......... .......... .......... .......... 74% 322M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69400K .......... .......... .......... .......... .......... 74% 319M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69450K .......... .......... .......... .......... .......... 74% 154M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69500K .......... .......... .......... .......... .......... 74% 342M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69550K .......... .......... .......... .......... .......... 74% 202M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69600K .......... .......... .......... .......... .......... 74% 272M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69650K .......... .......... .......... .......... .......... 75% 361M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69700K .......... .......... .......... .......... .......... 75% 356M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69750K .......... .......... .......... .......... .......... 75% 109M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69800K .......... .......... .......... .......... .......... 75% 232M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69850K .......... .......... .......... .......... .......... 75% 326M 0s 2024-09-14T11:24:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: 69900K .......... .......... .......... .......... .......... 75% 225M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 69950K .......... .......... .......... .......... .......... 75% 124M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70000K .......... .......... .......... .......... .......... 75% 219M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70050K .......... .......... .......... .......... .......... 75% 334M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70100K .......... .......... .......... .......... .......... 75% 299M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70150K .......... .......... .......... .......... .......... 75% 340M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70200K .......... .......... .......... .......... .......... 75% 219M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70250K .......... .......... .......... .......... .......... 75% 236M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70300K .......... .......... .......... .......... .......... 75% 132M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70350K .......... .......... .......... .......... .......... 75% 347M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70400K .......... .......... .......... .......... .......... 75% 336M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70450K .......... .......... .......... .......... .......... 75% 115M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70500K .......... .......... .......... .......... .......... 75% 288M 0s 2024-09-14T11:24:08.445 INFO:teuthology.orchestra.run.smithi148.stderr: 70550K .......... .......... .......... .......... .......... 75% 361M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 70600K .......... .......... .......... .......... .......... 76% 285M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 70650K .......... .......... .......... .......... .......... 76% 325M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 70700K .......... .......... .......... .......... .......... 76% 327M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 70750K .......... .......... .......... .......... .......... 76% 305M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 70800K .......... .......... .......... .......... .......... 76% 301M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 70850K .......... .......... .......... .......... .......... 76% 330M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 70900K .......... .......... .......... .......... .......... 76% 327M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 70950K .......... .......... .......... .......... .......... 76% 281M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 71000K .......... .......... .......... .......... .......... 76% 206M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 71050K .......... .......... .......... .......... .......... 76% 316M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 71100K .......... .......... .......... .......... .......... 76% 304M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 71150K .......... .......... .......... .......... .......... 76% 310M 0s 2024-09-14T11:24:08.446 INFO:teuthology.orchestra.run.smithi148.stderr: 71200K .......... .......... .......... .......... .......... 76% 337M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71250K .......... .......... .......... .......... .......... 76% 274M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71300K .......... .......... .......... .......... .......... 76% 314M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71350K .......... .......... .......... .......... .......... 76% 343M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71400K .......... .......... .......... .......... .......... 76% 322M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71450K .......... .......... .......... .......... .......... 76% 295M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71500K .......... .......... .......... .......... .......... 77% 358M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71550K .......... .......... .......... .......... .......... 77% 252M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71600K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71650K .......... .......... .......... .......... .......... 77% 280M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71700K .......... .......... .......... .......... .......... 77% 416M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71750K .......... .......... .......... .......... .......... 77% 320M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71800K .......... .......... .......... .......... .......... 77% 138M 0s 2024-09-14T11:24:08.447 INFO:teuthology.orchestra.run.smithi148.stderr: 71850K .......... .......... .......... .......... .......... 77% 317M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 71900K .......... .......... .......... .......... .......... 77% 328M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 71950K .......... .......... .......... .......... .......... 77% 291M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72000K .......... .......... .......... .......... .......... 77% 343M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72050K .......... .......... .......... .......... .......... 77% 159M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72100K .......... .......... .......... .......... .......... 77% 205M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72150K .......... .......... .......... .......... .......... 77% 277M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72200K .......... .......... .......... .......... .......... 77% 328M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72250K .......... .......... .......... .......... .......... 77% 318M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72300K .......... .......... .......... .......... .......... 77% 307M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72350K .......... .......... .......... .......... .......... 77% 76.3M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72400K .......... .......... .......... .......... .......... 77% 313M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72450K .......... .......... .......... .......... .......... 78% 343M 0s 2024-09-14T11:24:08.448 INFO:teuthology.orchestra.run.smithi148.stderr: 72500K .......... .......... .......... .......... .......... 78% 329M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72550K .......... .......... .......... .......... .......... 78% 287M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72600K .......... .......... .......... .......... .......... 78% 191M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72650K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72700K .......... .......... .......... .......... .......... 78% 338M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72750K .......... .......... .......... .......... .......... 78% 275M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72800K .......... .......... .......... .......... .......... 78% 144M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72850K .......... .......... .......... .......... .......... 78% 328M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72900K .......... .......... .......... .......... .......... 78% 292M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 72950K .......... .......... .......... .......... .......... 78% 117M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 73000K .......... .......... .......... .......... .......... 78% 164M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 73050K .......... .......... .......... .......... .......... 78% 268M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 73100K .......... .......... .......... .......... .......... 78% 145M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 73150K .......... .......... .......... .......... .......... 78% 316M 0s 2024-09-14T11:24:08.449 INFO:teuthology.orchestra.run.smithi148.stderr: 73200K .......... .......... .......... .......... .......... 78% 348M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73250K .......... .......... .......... .......... .......... 78% 319M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73300K .......... .......... .......... .......... .......... 78% 235M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73350K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73400K .......... .......... .......... .......... .......... 79% 179M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73450K .......... .......... .......... .......... .......... 79% 77.2M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73500K .......... .......... .......... .......... .......... 79% 319M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73550K .......... .......... .......... .......... .......... 79% 323M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73600K .......... .......... .......... .......... .......... 79% 321M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73650K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73700K .......... .......... .......... .......... .......... 79% 346M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73750K .......... .......... .......... .......... .......... 79% 214M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73800K .......... .......... .......... .......... .......... 79% 273M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73850K .......... .......... .......... .......... .......... 79% 276M 0s 2024-09-14T11:24:08.450 INFO:teuthology.orchestra.run.smithi148.stderr: 73900K .......... .......... .......... .......... .......... 79% 333M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 73950K .......... .......... .......... .......... .......... 79% 145M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74000K .......... .......... .......... .......... .......... 79% 272M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74050K .......... .......... .......... .......... .......... 79% 332M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74100K .......... .......... .......... .......... .......... 79% 314M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74150K .......... .......... .......... .......... .......... 79% 321M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74200K .......... .......... .......... .......... .......... 79% 295M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74250K .......... .......... .......... .......... .......... 79% 313M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74300K .......... .......... .......... .......... .......... 80% 343M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74350K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74400K .......... .......... .......... .......... .......... 80% 311M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74450K .......... .......... .......... .......... .......... 80% 272M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74500K .......... .......... .......... .......... .......... 80% 338M 0s 2024-09-14T11:24:08.451 INFO:teuthology.orchestra.run.smithi148.stderr: 74550K .......... .......... .......... .......... .......... 80% 328M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 74600K .......... .......... .......... .......... .......... 80% 331M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 74650K .......... .......... .......... .......... .......... 80% 313M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 74700K .......... .......... .......... .......... .......... 80% 328M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 74750K .......... .......... .......... .......... .......... 80% 356M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 74800K .......... .......... .......... .......... .......... 80% 317M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 74850K .......... .......... .......... .......... .......... 80% 275M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 74900K .......... .......... .......... .......... .......... 80% 302M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 74950K .......... .......... .......... .......... .......... 80% 317M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 75000K .......... .......... .......... .......... .......... 80% 305M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 75050K .......... .......... .......... .......... .......... 80% 339M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 75100K .......... .......... .......... .......... .......... 80% 263M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 75150K .......... .......... .......... .......... .......... 80% 325M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 75200K .......... .......... .......... .......... .......... 81% 336M 0s 2024-09-14T11:24:08.452 INFO:teuthology.orchestra.run.smithi148.stderr: 75250K .......... .......... .......... .......... .......... 81% 336M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75300K .......... .......... .......... .......... .......... 81% 285M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75350K .......... .......... .......... .......... .......... 81% 75.1M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75400K .......... .......... .......... .......... .......... 81% 301M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75450K .......... .......... .......... .......... .......... 81% 328M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75500K .......... .......... .......... .......... .......... 81% 284M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75550K .......... .......... .......... .......... .......... 81% 340M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75600K .......... .......... .......... .......... .......... 81% 274M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75650K .......... .......... .......... .......... .......... 81% 337M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75700K .......... .......... .......... .......... .......... 81% 286M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75750K .......... .......... .......... .......... .......... 81% 197M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75800K .......... .......... .......... .......... .......... 81% 175M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75850K .......... .......... .......... .......... .......... 81% 302M 0s 2024-09-14T11:24:08.453 INFO:teuthology.orchestra.run.smithi148.stderr: 75900K .......... .......... .......... .......... .......... 81% 186M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 75950K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76000K .......... .......... .......... .......... .......... 81% 144M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76050K .......... .......... .......... .......... .......... 81% 239M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76100K .......... .......... .......... .......... .......... 81% 146M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76150K .......... .......... .......... .......... .......... 82% 335M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76200K .......... .......... .......... .......... .......... 82% 180M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76250K .......... .......... .......... .......... .......... 82% 119M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76300K .......... .......... .......... .......... .......... 82% 360M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76350K .......... .......... .......... .......... .......... 82% 325M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76400K .......... .......... .......... .......... .......... 82% 352M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76450K .......... .......... .......... .......... .......... 82% 101M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76500K .......... .......... .......... .......... .......... 82% 126M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76550K .......... .......... .......... .......... .......... 82% 266M 0s 2024-09-14T11:24:08.454 INFO:teuthology.orchestra.run.smithi148.stderr: 76600K .......... .......... .......... .......... .......... 82% 327M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 76650K .......... .......... .......... .......... .......... 82% 304M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 76700K .......... .......... .......... .......... .......... 82% 344M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 76750K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 76800K .......... .......... .......... .......... .......... 82% 292M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 76850K .......... .......... .......... .......... .......... 82% 111M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 76900K .......... .......... .......... .......... .......... 82% 222M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 76950K .......... .......... .......... .......... .......... 82% 292M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 77000K .......... .......... .......... .......... .......... 82% 325M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 77050K .......... .......... .......... .......... .......... 82% 327M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 77100K .......... .......... .......... .......... .......... 83% 328M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 77150K .......... .......... .......... .......... .......... 83% 267M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 77200K .......... .......... .......... .......... .......... 83% 324M 0s 2024-09-14T11:24:08.455 INFO:teuthology.orchestra.run.smithi148.stderr: 77250K .......... .......... .......... .......... .......... 83% 364M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77300K .......... .......... .......... .......... .......... 83% 321M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77350K .......... .......... .......... .......... .......... 83% 292M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77400K .......... .......... .......... .......... .......... 83% 308M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77450K .......... .......... .......... .......... .......... 83% 343M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77500K .......... .......... .......... .......... .......... 83% 353M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77550K .......... .......... .......... .......... .......... 83% 330M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77600K .......... .......... .......... .......... .......... 83% 293M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77650K .......... .......... .......... .......... .......... 83% 321M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77700K .......... .......... .......... .......... .......... 83% 206M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77750K .......... .......... .......... .......... .......... 83% 226M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77800K .......... .......... .......... .......... .......... 83% 241M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77850K .......... .......... .......... .......... .......... 83% 317M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77900K .......... .......... .......... .......... .......... 83% 329M 0s 2024-09-14T11:24:08.456 INFO:teuthology.orchestra.run.smithi148.stderr: 77950K .......... .......... .......... .......... .......... 83% 261M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78000K .......... .......... .......... .......... .......... 84% 282M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78050K .......... .......... .......... .......... .......... 84% 328M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78100K .......... .......... .......... .......... .......... 84% 331M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78150K .......... .......... .......... .......... .......... 84% 287M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78200K .......... .......... .......... .......... .......... 84% 312M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78250K .......... .......... .......... .......... .......... 84% 354M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78300K .......... .......... .......... .......... .......... 84% 307M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78350K .......... .......... .......... .......... .......... 84% 287M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78400K .......... .......... .......... .......... .......... 84% 209M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78450K .......... .......... .......... .......... .......... 84% 219M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78500K .......... .......... .......... .......... .......... 84% 230M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78550K .......... .......... .......... .......... .......... 84% 310M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78600K .......... .......... .......... .......... .......... 84% 311M 0s 2024-09-14T11:24:08.457 INFO:teuthology.orchestra.run.smithi148.stderr: 78650K .......... .......... .......... .......... .......... 84% 332M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 78700K .......... .......... .......... .......... .......... 84% 299M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 78750K .......... .......... .......... .......... .......... 84% 295M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 78800K .......... .......... .......... .......... .......... 84% 233M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 78850K .......... .......... .......... .......... .......... 84% 190M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 78900K .......... .......... .......... .......... .......... 84% 316M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 78950K .......... .......... .......... .......... .......... 85% 324M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 79000K .......... .......... .......... .......... .......... 85% 323M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 79050K .......... .......... .......... .......... .......... 85% 127M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 79100K .......... .......... .......... .......... .......... 85% 206M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 79150K .......... .......... .......... .......... .......... 85% 133M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 79200K .......... .......... .......... .......... .......... 85% 278M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 79250K .......... .......... .......... .......... .......... 85% 195M 0s 2024-09-14T11:24:08.458 INFO:teuthology.orchestra.run.smithi148.stderr: 79300K .......... .......... .......... .......... .......... 85% 172M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79350K .......... .......... .......... .......... .......... 85% 325M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79400K .......... .......... .......... .......... .......... 85% 328M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79450K .......... .......... .......... .......... .......... 85% 78.7M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79500K .......... .......... .......... .......... .......... 85% 132M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79550K .......... .......... .......... .......... .......... 85% 323M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79600K .......... .......... .......... .......... .......... 85% 288M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79650K .......... .......... .......... .......... .......... 85% 277M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79700K .......... .......... .......... .......... .......... 85% 332M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79750K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79800K .......... .......... .......... .......... .......... 85% 98.5M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79850K .......... .......... .......... .......... .......... 86% 258M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79900K .......... .......... .......... .......... .......... 86% 320M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 79950K .......... .......... .......... .......... .......... 86% 330M 0s 2024-09-14T11:24:08.459 INFO:teuthology.orchestra.run.smithi148.stderr: 80000K .......... .......... .......... .......... .......... 86% 321M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80050K .......... .......... .......... .......... .......... 86% 324M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80100K .......... .......... .......... .......... .......... 86% 351M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80150K .......... .......... .......... .......... .......... 86% 237M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80200K .......... .......... .......... .......... .......... 86% 277M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80250K .......... .......... .......... .......... .......... 86% 335M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80300K .......... .......... .......... .......... .......... 86% 330M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80350K .......... .......... .......... .......... .......... 86% 312M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80400K .......... .......... .......... .......... .......... 86% 314M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80450K .......... .......... .......... .......... .......... 86% 318M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80500K .......... .......... .......... .......... .......... 86% 344M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80550K .......... .......... .......... .......... .......... 86% 103M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80600K .......... .......... .......... .......... .......... 86% 319M 0s 2024-09-14T11:24:08.460 INFO:teuthology.orchestra.run.smithi148.stderr: 80650K .......... .......... .......... .......... .......... 86% 319M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 80700K .......... .......... .......... .......... .......... 86% 336M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 80750K .......... .......... .......... .......... .......... 86% 335M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 80800K .......... .......... .......... .......... .......... 87% 276M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 80850K .......... .......... .......... .......... .......... 87% 308M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 80900K .......... .......... .......... .......... .......... 87% 306M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 80950K .......... .......... .......... .......... .......... 87% 313M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 81000K .......... .......... .......... .......... .......... 87% 295M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 81050K .......... .......... .......... .......... .......... 87% 312M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 81100K .......... .......... .......... .......... .......... 87% 315M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 81150K .......... .......... .......... .......... .......... 87% 344M 0s 2024-09-14T11:24:08.461 INFO:teuthology.orchestra.run.smithi148.stderr: 81200K .......... .......... .......... .......... .......... 87% 159M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81250K .......... .......... .......... .......... .......... 87% 260M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81300K .......... .......... .......... .......... .......... 87% 278M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81350K .......... .......... .......... .......... .......... 87% 315M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81400K .......... .......... .......... .......... .......... 87% 315M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81450K .......... .......... .......... .......... .......... 87% 352M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81500K .......... .......... .......... .......... .......... 87% 277M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81550K .......... .......... .......... .......... .......... 87% 334M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81600K .......... .......... .......... .......... .......... 87% 333M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81650K .......... .......... .......... .......... .......... 87% 340M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81700K .......... .......... .......... .......... .......... 87% 291M 0s 2024-09-14T11:24:08.462 INFO:teuthology.orchestra.run.smithi148.stderr: 81750K .......... .......... .......... .......... .......... 88% 286M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 81800K .......... .......... .......... .......... .......... 88% 342M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 81850K .......... .......... .......... .......... .......... 88% 324M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 81900K .......... .......... .......... .......... .......... 88% 339M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 81950K .......... .......... .......... .......... .......... 88% 271M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82000K .......... .......... .......... .......... .......... 88% 278M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82050K .......... .......... .......... .......... .......... 88% 310M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82100K .......... .......... .......... .......... .......... 88% 135M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82150K .......... .......... .......... .......... .......... 88% 217M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82200K .......... .......... .......... .......... .......... 88% 141M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82250K .......... .......... .......... .......... .......... 88% 316M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82300K .......... .......... .......... .......... .......... 88% 236M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82350K .......... .......... .......... .......... .......... 88% 203M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82400K .......... .......... .......... .......... .......... 88% 82.4M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82450K .......... .......... .......... .......... .......... 88% 121M 0s 2024-09-14T11:24:08.463 INFO:teuthology.orchestra.run.smithi148.stderr: 82500K .......... .......... .......... .......... .......... 88% 261M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82550K .......... .......... .......... .......... .......... 88% 289M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82600K .......... .......... .......... .......... .......... 88% 238M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82650K .......... .......... .......... .......... .......... 89% 195M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82700K .......... .......... .......... .......... .......... 89% 315M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82750K .......... .......... .......... .......... .......... 89% 292M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82800K .......... .......... .......... .......... .......... 89% 127M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82850K .......... .......... .......... .......... .......... 89% 197M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82900K .......... .......... .......... .......... .......... 89% 313M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 82950K .......... .......... .......... .......... .......... 89% 278M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 83000K .......... .......... .......... .......... .......... 89% 350M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 83050K .......... .......... .......... .......... .......... 89% 218M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 83100K .......... .......... .......... .......... .......... 89% 300M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 83150K .......... .......... .......... .......... .......... 89% 227M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 83200K .......... .......... .......... .......... .......... 89% 264M 0s 2024-09-14T11:24:08.464 INFO:teuthology.orchestra.run.smithi148.stderr: 83250K .......... .......... .......... .......... .......... 89% 261M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83300K .......... .......... .......... .......... .......... 89% 314M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83350K .......... .......... .......... .......... .......... 89% 309M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83400K .......... .......... .......... .......... .......... 89% 339M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83450K .......... .......... .......... .......... .......... 89% 339M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83500K .......... .......... .......... .......... .......... 89% 163M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83550K .......... .......... .......... .......... .......... 89% 275M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83600K .......... .......... .......... .......... .......... 90% 317M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83650K .......... .......... .......... .......... .......... 90% 329M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83700K .......... .......... .......... .......... .......... 90% 284M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83750K .......... .......... .......... .......... .......... 90% 325M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83800K .......... .......... .......... .......... .......... 90% 259M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83850K .......... .......... .......... .......... .......... 90% 360M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83900K .......... .......... .......... .......... .......... 90% 320M 0s 2024-09-14T11:24:08.465 INFO:teuthology.orchestra.run.smithi148.stderr: 83950K .......... .......... .......... .......... .......... 90% 361M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84000K .......... .......... .......... .......... .......... 90% 292M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84050K .......... .......... .......... .......... .......... 90% 352M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84100K .......... .......... .......... .......... .......... 90% 386M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84150K .......... .......... .......... .......... .......... 90% 123M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84200K .......... .......... .......... .......... .......... 90% 274M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84250K .......... .......... .......... .......... .......... 90% 264M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84300K .......... .......... .......... .......... .......... 90% 256M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84350K .......... .......... .......... .......... .......... 90% 315M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84400K .......... .......... .......... .......... .......... 90% 291M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84450K .......... .......... .......... .......... .......... 90% 287M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84500K .......... .......... .......... .......... .......... 91% 314M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84550K .......... .......... .......... .......... .......... 91% 339M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84600K .......... .......... .......... .......... .......... 91% 322M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84650K .......... .......... .......... .......... .......... 91% 293M 0s 2024-09-14T11:24:08.466 INFO:teuthology.orchestra.run.smithi148.stderr: 84700K .......... .......... .......... .......... .......... 91% 296M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 84750K .......... .......... .......... .......... .......... 91% 209M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 84800K .......... .......... .......... .......... .......... 91% 266M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 84850K .......... .......... .......... .......... .......... 91% 314M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 84900K .......... .......... .......... .......... .......... 91% 315M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 84950K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85000K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85050K .......... .......... .......... .......... .......... 91% 274M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85100K .......... .......... .......... .......... .......... 91% 350M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85150K .......... .......... .......... .......... .......... 91% 217M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85200K .......... .......... .......... .......... .......... 91% 287M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85250K .......... .......... .......... .......... .......... 91% 288M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85300K .......... .......... .......... .......... .......... 91% 120M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85350K .......... .......... .......... .......... .......... 91% 335M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85400K .......... .......... .......... .......... .......... 91% 112M 0s 2024-09-14T11:24:08.467 INFO:teuthology.orchestra.run.smithi148.stderr: 85450K .......... .......... .......... .......... .......... 92% 113M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85500K .......... .......... .......... .......... .......... 92% 331M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85550K .......... .......... .......... .......... .......... 92% 210M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85600K .......... .......... .......... .......... .......... 92% 319M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85650K .......... .......... .......... .......... .......... 92% 156M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85700K .......... .......... .......... .......... .......... 92% 261M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85750K .......... .......... .......... .......... .......... 92% 336M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85800K .......... .......... .......... .......... .......... 92% 139M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85850K .......... .......... .......... .......... .......... 92% 264M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85900K .......... .......... .......... .......... .......... 92% 119M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 85950K .......... .......... .......... .......... .......... 92% 324M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 86000K .......... .......... .......... .......... .......... 92% 299M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 86050K .......... .......... .......... .......... .......... 92% 355M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 86100K .......... .......... .......... .......... .......... 92% 189M 0s 2024-09-14T11:24:08.468 INFO:teuthology.orchestra.run.smithi148.stderr: 86150K .......... .......... .......... .......... .......... 92% 315M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86200K .......... .......... .......... .......... .......... 92% 331M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86250K .......... .......... .......... .......... .......... 92% 348M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86300K .......... .......... .......... .......... .......... 92% 204M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86350K .......... .......... .......... .......... .......... 93% 319M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86400K .......... .......... .......... .......... .......... 93% 140M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86450K .......... .......... .......... .......... .......... 93% 320M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86500K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86550K .......... .......... .......... .......... .......... 93% 339M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86600K .......... .......... .......... .......... .......... 93% 293M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86650K .......... .......... .......... .......... .......... 93% 306M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86700K .......... .......... .......... .......... .......... 93% 298M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86750K .......... .......... .......... .......... .......... 93% 326M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86800K .......... .......... .......... .......... .......... 93% 286M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86850K .......... .......... .......... .......... .......... 93% 342M 0s 2024-09-14T11:24:08.469 INFO:teuthology.orchestra.run.smithi148.stderr: 86900K .......... .......... .......... .......... .......... 93% 308M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 86950K .......... .......... .......... .......... .......... 93% 332M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87000K .......... .......... .......... .......... .......... 93% 335M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87050K .......... .......... .......... .......... .......... 93% 109M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87100K .......... .......... .......... .......... .......... 93% 234M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87150K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87200K .......... .......... .......... .......... .......... 93% 328M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87250K .......... .......... .......... .......... .......... 93% 334M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87300K .......... .......... .......... .......... .......... 94% 304M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87350K .......... .......... .......... .......... .......... 94% 349M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87400K .......... .......... .......... .......... .......... 94% 333M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87450K .......... .......... .......... .......... .......... 94% 230M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87500K .......... .......... .......... .......... .......... 94% 322M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87550K .......... .......... .......... .......... .......... 94% 281M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87600K .......... .......... .......... .......... .......... 94% 352M 0s 2024-09-14T11:24:08.470 INFO:teuthology.orchestra.run.smithi148.stderr: 87650K .......... .......... .......... .......... .......... 94% 251M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 87700K .......... .......... .......... .......... .......... 94% 329M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 87750K .......... .......... .......... .......... .......... 94% 232M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 87800K .......... .......... .......... .......... .......... 94% 338M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 87850K .......... .......... .......... .......... .......... 94% 314M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 87900K .......... .......... .......... .......... .......... 94% 341M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 87950K .......... .......... .......... .......... .......... 94% 276M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88000K .......... .......... .......... .......... .......... 94% 343M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88050K .......... .......... .......... .......... .......... 94% 226M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88100K .......... .......... .......... .......... .......... 94% 324M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88150K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88200K .......... .......... .......... .......... .......... 94% 266M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88250K .......... .......... .......... .......... .......... 95% 244M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88300K .......... .......... .......... .......... .......... 95% 262M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88350K .......... .......... .......... .......... .......... 95% 83.6M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88400K .......... .......... .......... .......... .......... 95% 332M 0s 2024-09-14T11:24:08.471 INFO:teuthology.orchestra.run.smithi148.stderr: 88450K .......... .......... .......... .......... .......... 95% 261M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88500K .......... .......... .......... .......... .......... 95% 188M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88550K .......... .......... .......... .......... .......... 95% 290M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88600K .......... .......... .......... .......... .......... 95% 182M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88650K .......... .......... .......... .......... .......... 95% 336M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88700K .......... .......... .......... .......... .......... 95% 92.7M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88750K .......... .......... .......... .......... .......... 95% 279M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88800K .......... .......... .......... .......... .......... 95% 260M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88850K .......... .......... .......... .......... .......... 95% 173M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88900K .......... .......... .......... .......... .......... 95% 183M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 88950K .......... .......... .......... .......... .......... 95% 293M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 89000K .......... .......... .......... .......... .......... 95% 358M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 89050K .......... .......... .......... .......... .......... 95% 127M 0s 2024-09-14T11:24:08.472 INFO:teuthology.orchestra.run.smithi148.stderr: 89100K .......... .......... .......... .......... .......... 95% 342M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89150K .......... .......... .......... .......... .......... 96% 315M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89200K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89250K .......... .......... .......... .......... .......... 96% 321M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89300K .......... .......... .......... .......... .......... 96% 300M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89350K .......... .......... .......... .......... .......... 96% 139M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89400K .......... .......... .......... .......... .......... 96% 291M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89450K .......... .......... .......... .......... .......... 96% 263M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89500K .......... .......... .......... .......... .......... 96% 316M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89550K .......... .......... .......... .......... .......... 96% 178M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89600K .......... .......... .......... .......... .......... 96% 316M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89650K .......... .......... .......... .......... .......... 96% 299M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89700K .......... .......... .......... .......... .......... 96% 281M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89750K .......... .......... .......... .......... .......... 96% 324M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89800K .......... .......... .......... .......... .......... 96% 332M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89850K .......... .......... .......... .......... .......... 96% 340M 0s 2024-09-14T11:24:08.473 INFO:teuthology.orchestra.run.smithi148.stderr: 89900K .......... .......... .......... .......... .......... 96% 305M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 89950K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90000K .......... .......... .......... .......... .......... 96% 116M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90050K .......... .......... .......... .......... .......... 96% 327M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90100K .......... .......... .......... .......... .......... 97% 263M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90150K .......... .......... .......... .......... .......... 97% 311M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90200K .......... .......... .......... .......... .......... 97% 256M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90250K .......... .......... .......... .......... .......... 97% 344M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90300K .......... .......... .......... .......... .......... 97% 302M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90350K .......... .......... .......... .......... .......... 97% 324M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90400K .......... .......... .......... .......... .......... 97% 297M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90450K .......... .......... .......... .......... .......... 97% 311M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90500K .......... .......... .......... .......... .......... 97% 334M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90550K .......... .......... .......... .......... .......... 97% 321M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90600K .......... .......... .......... .......... .......... 97% 279M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90650K .......... .......... .......... .......... .......... 97% 328M 0s 2024-09-14T11:24:08.474 INFO:teuthology.orchestra.run.smithi148.stderr: 90700K .......... .......... .......... .......... .......... 97% 358M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 90750K .......... .......... .......... .......... .......... 97% 92.1M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 90800K .......... .......... .......... .......... .......... 97% 265M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 90850K .......... .......... .......... .......... .......... 97% 326M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 90900K .......... .......... .......... .......... .......... 97% 307M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 90950K .......... .......... .......... .......... .......... 97% 363M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91000K .......... .......... .......... .......... .......... 98% 310M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91050K .......... .......... .......... .......... .......... 98% 367M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91100K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91150K .......... .......... .......... .......... .......... 98% 333M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91200K .......... .......... .......... .......... .......... 98% 322M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91250K .......... .......... .......... .......... .......... 98% 326M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91300K .......... .......... .......... .......... .......... 98% 154M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91350K .......... .......... .......... .......... .......... 98% 262M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91400K .......... .......... .......... .......... .......... 98% 321M 0s 2024-09-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi148.stderr: 91450K .......... .......... .......... .......... .......... 98% 330M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91500K .......... .......... .......... .......... .......... 98% 237M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91550K .......... .......... .......... .......... .......... 98% 290M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91600K .......... .......... .......... .......... .......... 98% 191M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91650K .......... .......... .......... .......... .......... 98% 166M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91700K .......... .......... .......... .......... .......... 98% 123M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91750K .......... .......... .......... .......... .......... 98% 107M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91800K .......... .......... .......... .......... .......... 98% 309M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91850K .......... .......... .......... .......... .......... 98% 322M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91900K .......... .......... .......... .......... .......... 98% 329M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 91950K .......... .......... .......... .......... .......... 99% 102M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 92000K .......... .......... .......... .......... .......... 99% 314M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 92050K .......... .......... .......... .......... .......... 99% 324M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 92100K .......... .......... .......... .......... .......... 99% 276M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 92150K .......... .......... .......... .......... .......... 99% 335M 0s 2024-09-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi148.stderr: 92200K .......... .......... .......... .......... .......... 99% 329M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92250K .......... .......... .......... .......... .......... 99% 326M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92300K .......... .......... .......... .......... .......... 99% 326M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92350K .......... .......... .......... .......... .......... 99% 108M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92400K .......... .......... .......... .......... .......... 99% 323M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92450K .......... .......... .......... .......... .......... 99% 315M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92500K .......... .......... .......... .......... .......... 99% 321M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92550K .......... .......... .......... .......... .......... 99% 303M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92600K .......... .......... .......... .......... .......... 99% 305M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92650K .......... .......... .......... .......... .......... 99% 148M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92700K .......... .......... .......... .......... .......... 99% 292M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92750K .......... .......... .......... .......... .......... 99% 313M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92800K .......... .......... .......... .......... .......... 99% 337M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92850K .......... .......... .......... .......... .......... 99% 351M 0s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-14T11:24:08.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14 11:24:07 (197 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-14T11:24:08.478 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-14T11:24:08.505 INFO:teuthology.orchestra.run.smithi148.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:24:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:24:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:24:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:24:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:24:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:24:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:24:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:24:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:24:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:24:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:24:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:24:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:24:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:24:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:24:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:24:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:24:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:24:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:24:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:24:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:24:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:24:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:24:08.523 INFO:teuthology.orchestra.run.smithi148.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-14T11:24:08.840 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:08.840 INFO:teuthology.orchestra.run.smithi148.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:24:08.840 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout:Here are the highlights of this release: 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - Advanced control of transitive versions 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - Support for optional features and dependencies 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - Rules to tweak published metadata 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - Support for Java 13 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - New Zinc compiler for Scala 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - VS2019 support 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi148.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:------------------------------------------------------------ 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:Gradle 6.0.1 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:------------------------------------------------------------ 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:Kotlin: 1.3.50 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:Groovy: 2.5.8 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi148.stdout:OS: Linux 5.15.0-121-generic amd64 2024-09-14T11:24:08.843 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:08.855 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:24:08.856 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:24:08.856 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T11:24:08.856 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:24:08.856 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T11:24:08.856 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:24:09.207 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:24:09.207 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:24:09.207 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'XVJPKUFPPQRQGNVOFPJW', 'access_secret': 'fDlYB+KtT5ZaA2sYdugZL2ikn4Mj3X3PaPWnAPVyDr9+miLyTVLObA==', 'region': 'mexico', 'endpoint': 'smithi148.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi148.front.sepia.ceph.com'} 2024-09-14T11:24:09.207 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:24:09.207 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'XVJPKUFPPQRQGNVOFPJW', '--secret', 'fDlYB+KtT5ZaA2sYdugZL2ikn4Mj3X3PaPWnAPVyDr9+miLyTVLObA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:24:09.208 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key XVJPKUFPPQRQGNVOFPJW --secret fDlYB+KtT5ZaA2sYdugZL2ikn4Mj3X3PaPWnAPVyDr9+miLyTVLObA== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:24:09.253 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:09.254 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:09.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.295+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 realm 2024-09-14T11:24:09.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:09.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.299+0000 7fe93d9379c0 20 searching for the correct realm 2024-09-14T11:24:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.307+0000 7fe93ac3c640 0 -- 172.21.15.148:0/3782762452 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fe93400e070 msgr2=0x7fe93400e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:09.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.519+0000 7fe93bc3e640 0 -- 172.21.15.148:0/3782762452 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x56494ebf27e0 msgr2=0x56494ebf4c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.531+0000 7fe93d9379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.531+0000 7fe93d9379c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.531+0000 7fe93d9379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.531+0000 7fe93d9379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.531+0000 7fe93d9379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.531+0000 7fe93d9379c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.531+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:09.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 zone default found 2024-09-14T11:24:09.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 4 Realm: () 2024-09-14T11:24:09.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:24:09.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:24:09.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:09.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 zonegroup default 2024-09-14T11:24:09.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.535+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.539+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.539+0000 7fe93d9379c0 20 started sync module instance, tier type = 2024-09-14T11:24:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.539+0000 7fe93d9379c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:24:09.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 20 add_watcher() i=0 2024-09-14T11:24:09.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 20 add_watcher() i=1 2024-09-14T11:24:09.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 20 add_watcher() i=2 2024-09-14T11:24:09.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 20 add_watcher() i=3 2024-09-14T11:24:09.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 20 add_watcher() i=4 2024-09-14T11:24:09.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 20 add_watcher() i=5 2024-09-14T11:24:09.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 20 add_watcher() i=6 2024-09-14T11:24:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 20 add_watcher() i=7 2024-09-14T11:24:09.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.563+0000 7fe93d9379c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:09.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.567+0000 7fe7f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:09.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.567+0000 7fe93d9379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:09.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.567+0000 7fe93d9379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:09.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.567+0000 7fe93d9379c0 5 note: GC not initialized 2024-09-14T11:24:09.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.567+0000 7fe7f17e2640 20 reqs_thread_entry: start 2024-09-14T11:24:09.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.567+0000 7fe93d9379c0 20 init_complete bucket index max shards: 11 2024-09-14T11:24:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 20 Filter name: none 2024-09-14T11:24:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe7ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:24:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:24:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache get: name=default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW : miss 2024-09-14T11:24:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache put: name=default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW info.flags=0x0 2024-09-14T11:24:09.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 adding default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW to cache LRU end 2024-09-14T11:24:09.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache get: name=default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW : hit (negative entry) 2024-09-14T11:24:09.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache get: name=default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW : hit (negative entry) 2024-09-14T11:24:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:24:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:24:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.571+0000 7fe93d9379c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:24:09.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.575+0000 7fe81effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366286 cookie 94872853827424 notifier 8832 bl.length()=670 2024-09-14T11:24:09.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.575+0000 7fe81effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:24:09.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.575+0000 7fe81effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:24:09.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.579+0000 7fe93d9379c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:24:09.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.579+0000 7fe93d9379c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:24:09.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.579+0000 7fe93d9379c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:24:09.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.579+0000 7fe81effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94872853817792 notifier 8832 bl.length()=200 2024-09-14T11:24:09.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.579+0000 7fe81effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:24:09.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.579+0000 7fe81effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:24:09.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.583+0000 7fe93d9379c0 10 cache put: name=default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW info.flags=0x7 2024-09-14T11:24:09.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.583+0000 7fe93d9379c0 10 moving default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW to cache LRU end 2024-09-14T11:24:09.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.583+0000 7fe93d9379c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:XVJPKUFPPQRQGNVOFPJW, ofs0, ns] 2024-09-14T11:24:09.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.587+0000 7fe81effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366288 cookie 94872853816736 notifier 8832 bl.length()=189 2024-09-14T11:24:09.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.587+0000 7fe81effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW info.flags=0x7 2024-09-14T11:24:09.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.587+0000 7fe81effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XVJPKUFPPQRQGNVOFPJW to cache LRU end 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "tester.client.0", 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:24:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "tester.client.0", 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "XVJPKUFPPQRQGNVOFPJW", 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "fDlYB+KtT5ZaA2sYdugZL2ikn4Mj3X3PaPWnAPVyDr9+miLyTVLObA==", 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:24:09.575756Z" 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:24:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:24:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "rgw", 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "", 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:24:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:24:09.575730Z", 2024-09-14T11:24:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:24:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:24:09.589 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:24:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:09.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.587+0000 7fe7f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:09.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.595+0000 7fe93d9379c0 20 remove_watcher() i=0 2024-09-14T11:24:09.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.595+0000 7fe93d9379c0 2 removed watcher, disabling cache 2024-09-14T11:24:09.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.595+0000 7fe93d9379c0 20 remove_watcher() i=1 2024-09-14T11:24:09.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.599+0000 7fe93d9379c0 20 remove_watcher() i=2 2024-09-14T11:24:09.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.599+0000 7fe93d9379c0 20 remove_watcher() i=3 2024-09-14T11:24:09.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.603+0000 7fe93d9379c0 20 remove_watcher() i=4 2024-09-14T11:24:09.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.603+0000 7fe93d9379c0 20 remove_watcher() i=5 2024-09-14T11:24:09.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.607+0000 7fe93d9379c0 20 remove_watcher() i=6 2024-09-14T11:24:09.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.611+0000 7fe93d9379c0 20 remove_watcher() i=7 2024-09-14T11:24:09.623 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T11:24:09.623 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:24:09.670 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:24:09.670 DEBUG:teuthology.orchestra.run.smithi148:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:24:09.715 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:24:09.789 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:09.789 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:09.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.835+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 realm 2024-09-14T11:24:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:09.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:09.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.839+0000 7f20a6b4f9c0 20 searching for the correct realm 2024-09-14T11:24:09.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.847+0000 7f20a3e54640 0 -- 172.21.15.148:0/526072263 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f209c007b00 msgr2=0x7f209c001980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:09.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.851+0000 7f20a4e56640 0 -- 172.21.15.148:0/526072263 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5612431fa060 msgr2=0x5612431fc500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:24:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:24:09.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.859+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 zone default found 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 4 Realm: () 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 zonegroup default 2024-09-14T11:24:09.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 started sync module instance, tier type = 2024-09-14T11:24:09.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.863+0000 7f20a6b4f9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.879+0000 7f20a6b4f9c0 20 add_watcher() i=0 2024-09-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.879+0000 7f20a6b4f9c0 20 add_watcher() i=1 2024-09-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.879+0000 7f20a6b4f9c0 20 add_watcher() i=2 2024-09-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.879+0000 7f20a6b4f9c0 20 add_watcher() i=3 2024-09-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.879+0000 7f20a6b4f9c0 20 add_watcher() i=4 2024-09-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.879+0000 7f20a6b4f9c0 20 add_watcher() i=5 2024-09-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.879+0000 7f20a6b4f9c0 20 add_watcher() i=6 2024-09-14T11:24:09.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.883+0000 7f20a6b4f9c0 20 add_watcher() i=7 2024-09-14T11:24:09.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.883+0000 7f20a6b4f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.887+0000 7f1f5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.887+0000 7f20a6b4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:09.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.887+0000 7f20a6b4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:09.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.955+0000 7f1f59fdb640 20 reqs_thread_entry: start 2024-09-14T11:24:09.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.955+0000 7f20a6b4f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:24:09.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.955+0000 7f20a6b4f9c0 20 Filter name: none 2024-09-14T11:24:09.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.955+0000 7f1ecb7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:09.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.955+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:24:09.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:09.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8047559534101065952', time=2024-09-14T13:14:14.974627+0000, chain.objs.size()=3 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.1 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.2 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.3 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16400865766548469606', time=2024-09-14T13:14:15.324798+0000, chain.objs.size()=1 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8__shadow_.9Sn2Q-a_7CfC8veHWbCTuRcpQP_Naiq_0 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16134706295567713810', time=2024-09-14T13:16:36.620213+0000, chain.objs.size()=1 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.yGRpsgtmz7TNdHsKE_UltNmPSZQKOx0_0 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3026295191893391791', time=2024-09-14T13:17:14.741995+0000, chain.objs.size()=1 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.0gXu2k68W89knfZUBHUFKBH-3WY1PuX_0 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17482268153561387869', time=2024-09-14T13:17:19.710623+0000, chain.objs.size()=1 2024-09-14T11:24:09.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.xKIbd8xJMJ_elBBiH5RSmmztdcN6QmH_0 2024-09-14T11:24:09.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14749871537086816758', time=2024-09-14T13:18:37.505438+0000, chain.objs.size()=1 2024-09-14T11:24:09.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.AbetfCzLNS6u157iBC85TUJXcw52-EO_0 2024-09-14T11:24:09.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8527867520485558763', time=2024-09-14T13:18:42.048551+0000, chain.objs.size()=1 2024-09-14T11:24:09.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.Ekb-Exff7XPlWUepe3K5wzYe9fmPHBE_0 2024-09-14T11:24:09.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3086880908472216617', time=2024-09-14T13:18:45.870399+0000, chain.objs.size()=1 2024-09-14T11:24:09.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.dZ4WVC9RDUP83st-KHX_axfqDShLBFn_0 2024-09-14T11:24:09.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15397910143000663420', time=2024-09-14T13:19:21.934181+0000, chain.objs.size()=1 2024-09-14T11:24:09.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.qayPhs6POZctWi3fCH4XZq0zxOg8xtg_0 2024-09-14T11:24:09.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4116291529972147301', time=2024-09-14T13:20:46.068639+0000, chain.objs.size()=1 2024-09-14T11:24:09.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.959+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.6L4pE6tYkDQqW2yh7beumY4TRqa9jrU_0 2024-09-14T11:24:09.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.975+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:09.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.979+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:24:09.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.979+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:09.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:09.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:24:09.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15899970275292444914', time=2024-09-14T13:15:51.036571+0000, chain.objs.size()=1 2024-09-14T11:24:09.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.BJLL-vsz5NjTq2ioecTmOe9t_noTEWv_0 2024-09-14T11:24:09.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7107405203349595946', time=2024-09-14T13:15:55.567033+0000, chain.objs.size()=1 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.VUz7PyuNOM2WLcFzTqG2bgSH4ZdEhWj_0 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8039636176559202462', time=2024-09-14T13:15:55.568443+0000, chain.objs.size()=1 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.IU1qmqgBK4ipumO-EDONErFtvYADu5G_0 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4583875350684277665', time=2024-09-14T13:15:55.602987+0000, chain.objs.size()=1 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.Pfe_kw5f_dkxATN9U9dqCojzsBee2Gd_0 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17723818660929544669', time=2024-09-14T13:15:55.725863+0000, chain.objs.size()=1 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.uKGt4LOmLrm3aKz6EKzGt_XOs5qFG_Q_0 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3984794680558268838', time=2024-09-14T13:16:40.373679+0000, chain.objs.size()=1 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.HePZXWlXgK5G6YqpkW0kLR1PAhKKEV9_0 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14885009402651477056', time=2024-09-14T13:16:43.704381+0000, chain.objs.size()=1 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.HGMMGJCjGzuM52naz6keLMJ18UEz8Va_0 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15436140057737345816', time=2024-09-14T13:17:14.739722+0000, chain.objs.size()=1 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.SHt5QCNxLjrKoxD_P37IQbrRtHsCuQG_0 2024-09-14T11:24:09.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14364226903991702265', time=2024-09-14T13:17:14.823341+0000, chain.objs.size()=1 2024-09-14T11:24:09.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.XBUdmybw-1fwe5OACjNlXsUgLPQWmZD_0 2024-09-14T11:24:09.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11902372753235217520', time=2024-09-14T13:17:57.993169+0000, chain.objs.size()=1 2024-09-14T11:24:09.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.EwnEWBzE7vHXD6YfQ8Ouy-DPQgeFK4S_0 2024-09-14T11:24:09.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10013860289958722683', time=2024-09-14T13:18:37.425406+0000, chain.objs.size()=1 2024-09-14T11:24:09.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.svhbwi2oeGdkOWXa1dPLxyR1vAHqXje_0 2024-09-14T11:24:09.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1954323566005413956', time=2024-09-14T13:18:42.254549+0000, chain.objs.size()=1 2024-09-14T11:24:09.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.983+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.RprFbkHJpgwJgADrk5lnh9z2csLwlrv_0 2024-09-14T11:24:09.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.995+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6125850615827497496', time=2024-09-14T13:18:45.771109+0000, chain.objs.size()=1 2024-09-14T11:24:09.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.995+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.k61Eg7AE4an9jyt8Mth1Qrrr0PgQ0w8_0 2024-09-14T11:24:09.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.995+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7496567377761929327', time=2024-09-14T13:18:46.014020+0000, chain.objs.size()=1 2024-09-14T11:24:09.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.995+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.L2gPAtN9bAuL784kI73bsDmLrcGzScD_0 2024-09-14T11:24:09.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.995+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2430522746215414330', time=2024-09-14T13:18:46.090165+0000, chain.objs.size()=1 2024-09-14T11:24:09.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.995+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.LHqrNTbvEEe49EZ3sbLDTm3ejkcpMBJ_0 2024-09-14T11:24:09.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.995+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9497845723345011872', time=2024-09-14T13:20:05.709156+0000, chain.objs.size()=1 2024-09-14T11:24:09.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:09.995+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.25t5eAzPveDZR8hJi7nj2l_NkOrQ-TT_0 2024-09-14T11:24:10.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.003+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.007+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:24:10.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:24:10.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9879573244746104132', time=2024-09-14T13:14:14.721862+0000, chain.objs.size()=2 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.AXkVt1u_h0yZQ_lunzd1Y3Y_JRajXR6_0 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.AXkVt1u_h0yZQ_lunzd1Y3Y_JRajXR6_1 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15768360671367264880', time=2024-09-14T13:14:15.429509+0000, chain.objs.size()=1 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9__shadow_.m1pXUlDJkjCjy4Tavskwa3iSCjVGNiY_0 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11718916340077644213', time=2024-09-14T13:16:32.022110+0000, chain.objs.size()=1 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.5KMmz33-kVhSVz5-2xI4xgx4SZO9IBl_0 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15004052935592660403', time=2024-09-14T13:16:36.459693+0000, chain.objs.size()=1 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.qjqIKqHaRr_I5iLhAYdhh5x-Owkpvjn_0 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10138172680901653596', time=2024-09-14T13:17:14.695063+0000, chain.objs.size()=1 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.NUD0PTQUIIJRirZQ8ktwgo-rpkQundh_0 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1525436580315976319', time=2024-09-14T13:18:02.403227+0000, chain.objs.size()=1 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.8uNchpTfGPL4rfmI-iZ3yFCT-S4rBeD_0 2024-09-14T11:24:10.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9992361087392307411', time=2024-09-14T13:18:37.258873+0000, chain.objs.size()=1 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.X-fJ9gET8YZtMndeyE0vyy6-REGvUTy_0 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17180313788542751289', time=2024-09-14T13:18:37.421294+0000, chain.objs.size()=1 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.3Je_XWKNnGNGmtm_HPDTbvUtwiSRyHw_0 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578163498164919204', time=2024-09-14T13:19:22.076705+0000, chain.objs.size()=1 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.NQ31SheEefEiitJC2VszKeWjFKmkOsQ_0 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14093989082687895284', time=2024-09-14T13:19:26.415903+0000, chain.objs.size()=1 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.TFZrYJhTNcwtap0gU5Ev9gViwjRZx9L_0 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2336783245473500189', time=2024-09-14T13:19:26.417351+0000, chain.objs.size()=1 2024-09-14T11:24:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.011+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.UEsMCSePx_8tsywkMkReQYCPb_Oab4i_0 2024-09-14T11:24:10.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.015+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11447886582884250357', time=2024-09-14T13:20:01.335167+0000, chain.objs.size()=1 2024-09-14T11:24:10.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.015+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.Jp4cEcyo7epo7FIOoEjf0Xeiy-w_jc9_0 2024-09-14T11:24:10.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.015+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11016708731758919639', time=2024-09-14T13:20:06.626959+0000, chain.objs.size()=1 2024-09-14T11:24:10.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.015+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.6Fz3JHbfTrjEpquRyjJ1bVf93Mx3yVU_0 2024-09-14T11:24:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.019+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7265469302711777670', time=2024-09-14T13:20:41.168126+0000, chain.objs.size()=1 2024-09-14T11:24:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.019+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.7UY2GpDxVnY7oILfjO5akKUojaLB_M7_0 2024-09-14T11:24:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.019+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17717287107021356321', time=2024-09-14T13:21:24.575522+0000, chain.objs.size()=1 2024-09-14T11:24:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.019+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.sTRdqdGf5L_op_p08Sm2UqH4gcvkzxL_0 2024-09-14T11:24:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.019+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5067418286653861836', time=2024-09-14T13:23:40.450602+0000, chain.objs.size()=1 2024-09-14T11:24:10.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.019+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19__shadow:-LsQYhSlg84a53t4s6Ndy8.5KSnqnEb_.fc0m4j-cJz1-djiZYYMwqi4EwAGv1yV_0 2024-09-14T11:24:10.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.023+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.027+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:24:10.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:24:10.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_WsVPCnR9KiEk_zKh2cQHVx28mym_Bsx', time=2024-09-14T13:14:14.744882+0000, chain.objs.size()=2 2024-09-14T11:24:10.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.prMX6cN9FtYHvGHw3dzvFwkn1sHPnIx_0 2024-09-14T11:24:10.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.prMX6cN9FtYHvGHw3dzvFwkn1sHPnIx_1 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_wtVVswVT0h2AS07qxVRU2Vyc07CQC9c', time=2024-09-14T13:14:14.999347+0000, chain.objs.size()=1 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.Ju2FfzdXzjxCDvazc0SnryGeB2vb_RQ_0 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3702424804554551441', time=2024-09-14T13:15:51.057512+0000, chain.objs.size()=1 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.cIC6nzFuqbDG5IGWOtOZL5Lr9nQZW2z_0 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5816879666743342088', time=2024-09-14T13:16:31.902775+0000, chain.objs.size()=1 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.V0V9U2S7CKSIjeNuK6xm5dKDNE618ya_0 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4059858353414506645', time=2024-09-14T13:16:40.263162+0000, chain.objs.size()=1 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.bR1G8xSVX9xAd7mz_8mfPxJKGjwM0Tc_0 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12492187147885999807', time=2024-09-14T13:17:19.679814+0000, chain.objs.size()=1 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.ZIOlWQ72N0tJjhvdtpUCcH2yLqLy70N_0 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16975710229748043430', time=2024-09-14T13:17:58.017442+0000, chain.objs.size()=1 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.cglYThL2OBCRq1AQWfCnDcMb4bpJRFX_0 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1378897815235688027', time=2024-09-14T13:17:58.022302+0000, chain.objs.size()=1 2024-09-14T11:24:10.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_._ejJpRfHn7zuMuKpPitBr_Au2YXCGE0_0 2024-09-14T11:24:10.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8671097427605165248', time=2024-09-14T13:18:02.368637+0000, chain.objs.size()=1 2024-09-14T11:24:10.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.vqIIrI2rOMm3kZpu9HNR1ioyyz6OqZD_0 2024-09-14T11:24:10.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14580992936830237285', time=2024-09-14T13:18:02.441946+0000, chain.objs.size()=1 2024-09-14T11:24:10.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.qgVu0-w4St8nYwbWtlXBQl9gLizdM9y_0 2024-09-14T11:24:10.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18375725363987074292', time=2024-09-14T13:18:02.550618+0000, chain.objs.size()=1 2024-09-14T11:24:10.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.031+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.A2c4Kd63IIRjGTWNdCgaoW0FNabdG9A_0 2024-09-14T11:24:10.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3212231042501619303', time=2024-09-14T13:18:45.881385+0000, chain.objs.size()=1 2024-09-14T11:24:10.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.fBsTCuWw-KK0B2e1NiOZw_vbHhQQDxC_0 2024-09-14T11:24:10.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15718163088795365118', time=2024-09-14T13:19:21.914614+0000, chain.objs.size()=1 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.bq0JsxCPHHqbgcZZD3GYF8TS9AzYK9z_0 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9963626053849091117', time=2024-09-14T13:20:41.217990+0000, chain.objs.size()=1 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.pU63aUde96doZgvmoRcxIkqH_FSNDFw_0 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5043732978018668535', time=2024-09-14T13:20:41.280781+0000, chain.objs.size()=1 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.WZjiOo-8TJM5G5C58idTlgKhb5evo6r_0 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6086855170866798313', time=2024-09-14T13:20:41.402813+0000, chain.objs.size()=1 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.bTLy7yFVQiRyiO-DeX2eU-L5UHr4qUB_0 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6066602819948464783', time=2024-09-14T13:20:50.233912+0000, chain.objs.size()=1 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.lT85nHjp9wOaDob1Pzy3uXFksBO5115_0 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16309513107332677216', time=2024-09-14T13:21:24.596811+0000, chain.objs.size()=1 2024-09-14T11:24:10.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.039+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_._6cU79zyGfrTKm02MFM3Rj8K6FcsYH__0 2024-09-14T11:24:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.043+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.533491649008969862', time=2024-09-14T13:23:45.709924+0000, chain.objs.size()=1 2024-09-14T11:24:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.043+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19__shadow:AhQtXezaulDpPqSPuW2YcI0CZr0ogzb_.PEIHjQglDANkA2Kb4D1DEVGlvGgIdN4_0 2024-09-14T11:24:10.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.047+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.051+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:24:10.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.051+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.051+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:24:10.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7113426279220068958', time=2024-09-14T13:15:50.945613+0000, chain.objs.size()=1 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.Eju6nTJHcSaOSYm8I36UTmCcO1vgazz_0 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17728085188127290432', time=2024-09-14T13:15:55.719562+0000, chain.objs.size()=1 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.m7yoIuXwws2Gl_H3s0yFkq2gWlqeTGo_0 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3169788277341030685', time=2024-09-14T13:16:31.834950+0000, chain.objs.size()=1 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.-E3vQrsqz2i3uLhrfvLehjTLGZfqWQQ_0 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8392966900033460446', time=2024-09-14T13:16:36.585151+0000, chain.objs.size()=1 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.uP2BTO95IkTrC9wMIdL0HU7B6CWBM-x_0 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3647826274141534028', time=2024-09-14T13:16:36.603264+0000, chain.objs.size()=1 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.8oickS4zGsuXNzLaE0y-zMsnadt604F_0 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5291925261903281167', time=2024-09-14T13:16:36.716822+0000, chain.objs.size()=1 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.1ARDG96RJoA3fDAFMzeP2FFwf3YK7zL_0 2024-09-14T11:24:10.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4994026973332997256', time=2024-09-14T13:17:57.978188+0000, chain.objs.size()=1 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.tlZIPw7HEiowMIpxoXAbCMkJ6hWfpnK_0 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6978568159949435964', time=2024-09-14T13:17:57.981565+0000, chain.objs.size()=1 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.1mbeuRYXJqnjC8vinQgd9qEnHF_orUH_0 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12464627963183404522', time=2024-09-14T13:17:57.992177+0000, chain.objs.size()=1 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.OPU-3b0atQDUv9Ac7-6wLwyF3EQxkU8_0 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15309343558530241811', time=2024-09-14T13:19:26.316517+0000, chain.objs.size()=1 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.yVydw2ZVvEDhjho9cq11ZzeTeS3eDVe_0 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17864137055654803384', time=2024-09-14T13:19:26.318956+0000, chain.objs.size()=1 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.zuSnEgk97SbhHAt9oFV6u0v2N_sIrs9_0 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8020638120525537578', time=2024-09-14T13:20:41.323435+0000, chain.objs.size()=1 2024-09-14T11:24:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.055+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.jztGt7cI7anL3GbTEVRUYSw1bV4FXdM_0 2024-09-14T11:24:10.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.063+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8578644850869785829', time=2024-09-14T13:20:46.064154+0000, chain.objs.size()=1 2024-09-14T11:24:10.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.063+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.c4Ol4iUNlFL67B6Nc21nYc5UvGN3dzv_0 2024-09-14T11:24:10.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.063+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7088424196322027429', time=2024-09-14T13:20:46.075333+0000, chain.objs.size()=1 2024-09-14T11:24:10.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.063+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.8OthAUwenHhODPhd7j0WnHGuWy-cNPR_0 2024-09-14T11:24:10.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.063+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14862055569178116868', time=2024-09-14T13:21:24.550919+0000, chain.objs.size()=1 2024-09-14T11:24:10.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.063+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.3hXXBHv_HEQQqL4BY5or25NbhKKW16F_0 2024-09-14T11:24:10.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.063+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7596626968042424906', time=2024-09-14T13:23:32.222149+0000, chain.objs.size()=1 2024-09-14T11:24:10.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.063+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.Br3qgQUGz3RLiM9_h1VlVzWcXtifPm7_0 2024-09-14T11:24:10.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.067+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:24:10.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:24:10.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12760863878095421656', time=2024-09-14T13:14:14.822238+0000, chain.objs.size()=2 2024-09-14T11:24:10.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.AXkVt1u_h0yZQ_lunzd1Y3Y_JRajXR6_0 2024-09-14T11:24:10.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.AXkVt1u_h0yZQ_lunzd1Y3Y_JRajXR6_1 2024-09-14T11:24:10.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11057588561122233998', time=2024-09-14T13:14:14.962506+0000, chain.objs.size()=5 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.1 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.1_1 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.2 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.2_1 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.3 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3550073670582832201', time=2024-09-14T13:15:51.153677+0000, chain.objs.size()=1 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.e4yeOzB0mdvsNCruhgxRdZkHPDKbutv_0 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9372909410505418639', time=2024-09-14T13:16:31.801354+0000, chain.objs.size()=1 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.NM4usQJkXMcHkhsS8W2oBgQYT8-fp-7_0 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3484690227536641667', time=2024-09-14T13:16:31.949936+0000, chain.objs.size()=1 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.mKTLpKV6kOxZDo8oheoSyIq1tiShtp8_0 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12342019607407528586', time=2024-09-14T13:17:19.451104+0000, chain.objs.size()=1 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.ICNsa55dExJ1o-IPazK4G9ugBKVrz9A_0 2024-09-14T11:24:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3638143480215912261', time=2024-09-14T13:18:02.506183+0000, chain.objs.size()=1 2024-09-14T11:24:10.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.071+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.-DXpVI3JudxUTdIWV47Dc8Se6H9V7W1_0 2024-09-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.591424103007956498', time=2024-09-14T13:18:42.129456+0000, chain.objs.size()=1 2024-09-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.hq1AHiTur2zPFDrFa5WyFKww4dASGMU_0 2024-09-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14501307134323708286', time=2024-09-14T13:19:26.415870+0000, chain.objs.size()=1 2024-09-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.jQArF-3VhLUmx4Tsuw_AenmCiK7exSX_0 2024-09-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15071701873504358664', time=2024-09-14T13:20:06.699242+0000, chain.objs.size()=1 2024-09-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.saQd-tQQXMV4Ft2vBHg9Z9RvaVJwIxE_0 2024-09-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2073467928387866559', time=2024-09-14T13:20:41.163702+0000, chain.objs.size()=1 2024-09-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.i9amIxhnioSbVrwNXV1y78bQm3EWV1Y_0 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12583057358240006223', time=2024-09-14T13:20:41.296068+0000, chain.objs.size()=1 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.V5no2yUmJ4Ou3Foxg3tIsvngonXfB7o_0 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2433949974401082303', time=2024-09-14T13:20:49.945412+0000, chain.objs.size()=1 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.ln3EfRcKnhHoY2w3pg6ydgaXDdRtoCL_0 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14921237773950813602', time=2024-09-14T13:20:50.154276+0000, chain.objs.size()=1 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.I7IrUFQnfEV3yPQBz5gdMcxxDfS98yd_0 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1395991613897545673', time=2024-09-14T13:23:32.212238+0000, chain.objs.size()=1 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.Tdd0l9woJDlGPoR3t_bn5-uuqBEQt1y_0 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3098170814426948112', time=2024-09-14T13:23:45.697520+0000, chain.objs.size()=1 2024-09-14T11:24:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.075+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19__shadow:zt0.1VXOx1KR8qGzOvzBzRsFhTv.OnK_.47MQALDR9Ic77eCBnGhTNIH8xkqnD7Z_0 2024-09-14T11:24:10.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.083+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.087+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:24:10.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.087+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4697125000417946295', time=2024-09-14T13:14:14.334808+0000, chain.objs.size()=1 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.qVBief0ys_qernkEHs6K5VY3XNxRmAl_0 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9029131174924278481', time=2024-09-14T13:15:51.008747+0000, chain.objs.size()=1 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.WsyLcpOsw92hfz0vTJr4wk4HIQKCT8x_0 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14056480049493328158', time=2024-09-14T13:16:31.897562+0000, chain.objs.size()=1 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.OAcwYljYP-qpANhZcVF1Cpg3IQUcJt3_0 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13608838066166497082', time=2024-09-14T13:16:40.334292+0000, chain.objs.size()=1 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.wZpVrxZVMza-lHchM0hIuKjF9xSxUvC_0 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2580391176388290352', time=2024-09-14T13:17:23.610324+0000, chain.objs.size()=1 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.lT2bWno4sB0Cuj61gkRj_Zh4lFI0nro_0 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11213826146924024796', time=2024-09-14T13:17:23.611731+0000, chain.objs.size()=1 2024-09-14T11:24:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.M8EKRuEK_SMBqyQhgDufjDHHDzQfsOg_0 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10999926578362818159', time=2024-09-14T13:18:42.036348+0000, chain.objs.size()=1 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.b4tcWbqcCGQBYabvF7dbJyUInEEcf5I_0 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8886814870332440392', time=2024-09-14T13:18:42.119182+0000, chain.objs.size()=1 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.aic5vcKb2mEU3pJ5WTswY1W1rvzgoI-_0 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7260277711776329044', time=2024-09-14T13:19:26.318808+0000, chain.objs.size()=1 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.CldZiA_xl9eSloTzbLXs_6_DGXhS_G4_0 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12375850638051028664', time=2024-09-14T13:19:26.427332+0000, chain.objs.size()=1 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.D264inl6WjPwVVg8r153UTrP7d_ATpJ_0 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11229385799179664295', time=2024-09-14T13:20:01.116868+0000, chain.objs.size()=1 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.R8w9O3VZNG8NxLZGBGF6VHMDa0tvmxV_0 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6372177894353582824', time=2024-09-14T13:23:32.171954+0000, chain.objs.size()=1 2024-09-14T11:24:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.091+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.Y9ETorzl-K3vm3kqkz7fg4hNWOcM_l4_0 2024-09-14T11:24:10.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.099+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:24:10.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8799870398181792716', time=2024-09-14T13:15:51.014064+0000, chain.objs.size()=1 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.e7QyabCPSlhTI222rnwDAYuOj9BJo43_0 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11515922908402698900', time=2024-09-14T13:16:31.851601+0000, chain.objs.size()=1 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.H-n_ISP2i374J3b8wUtz9k4h28NsVgi_0 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11769795870008446355', time=2024-09-14T13:16:32.034703+0000, chain.objs.size()=1 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.mvcGF8Gsl33zKMPoIDof8Qy1bEn-pvF_0 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15888994348936478802', time=2024-09-14T13:18:02.498047+0000, chain.objs.size()=1 2024-09-14T11:24:10.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.ELaTGg0tZ55n8S21lAcTdPdf5cri0KC_0 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16349690205827721867', time=2024-09-14T13:18:37.352873+0000, chain.objs.size()=1 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.N7rRjke0yTdk44A_cwcZMCL2pNMoDD1_0 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14825278552315513817', time=2024-09-14T13:18:37.507217+0000, chain.objs.size()=1 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.98gsm2SzziYzLKKwAZjDiUWwK7fCRVW_0 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5069759459435366895', time=2024-09-14T13:18:37.508755+0000, chain.objs.size()=1 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.ztTLKamQSexTbvQP7Dyx54c_DXBivcs_0 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6676784300024299837', time=2024-09-14T13:18:46.014984+0000, chain.objs.size()=1 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.IGFKHi7DAEfrT7suf2DT9sak_j4VMuR_0 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11084203266535547653', time=2024-09-14T13:20:46.021425+0000, chain.objs.size()=1 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.vd4katjSfBrCyArcCsWSV_vY80fL1Bq_0 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11655674921358449783', time=2024-09-14T13:20:46.128291+0000, chain.objs.size()=1 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.Sy-Is1JNzcN22--gW55rla4vk7JR20p_0 2024-09-14T11:24:10.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4264932420968498604', time=2024-09-14T13:23:32.171039+0000, chain.objs.size()=1 2024-09-14T11:24:10.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.6wIIFLyZJRzUAHnOitvvItOPvN3Yr24_0 2024-09-14T11:24:10.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3809805303337277737', time=2024-09-14T13:23:32.173555+0000, chain.objs.size()=1 2024-09-14T11:24:10.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.103+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.nrSIVXcGMummiClPx6RsW_EuTSqgyxT_0 2024-09-14T11:24:10.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.111+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.115+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:24:10.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.115+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.115+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_r_oxyOktsEkqUctj04Yei9vKDVXQBjy', time=2024-09-14T13:14:14.735600+0000, chain.objs.size()=2 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.ZE49U_wOdKeQEUCu005zpAAZGDcEDL4_0 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.ZE49U_wOdKeQEUCu005zpAAZGDcEDL4_1 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_G5zUxW-1_VLOoIWfbD1-Nyo9plR4ls3', time=2024-09-14T13:14:14.895325+0000, chain.objs.size()=3 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.ur4tV1qlkwrqrv5mpt0zESXhYaP-zWE_0 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.ur4tV1qlkwrqrv5mpt0zESXhYaP-zWE_1 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.ur4tV1qlkwrqrv5mpt0zESXhYaP-zWE_2 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14902690946417348978', time=2024-09-14T13:14:14.941197+0000, chain.objs.size()=3 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.1 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.2 2024-09-14T11:24:10.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-STANDARD.2~zdRFVjAGZWST0pRkGzCdcjO78oypI1Z.3 2024-09-14T11:24:10.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5757718507475084754', time=2024-09-14T13:16:36.585082+0000, chain.objs.size()=1 2024-09-14T11:24:10.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.qM3MFLgiBcK7de_dBIKHm4kEnl2Pho0_0 2024-09-14T11:24:10.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18236643218700160858', time=2024-09-14T13:16:40.295839+0000, chain.objs.size()=1 2024-09-14T11:24:10.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_._Jzq7AqmZveAXOCECLOpF9uoBpAzI_Q_0 2024-09-14T11:24:10.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7486727582225689183', time=2024-09-14T13:16:40.379307+0000, chain.objs.size()=1 2024-09-14T11:24:10.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.9FAwQbBJ0RkG-ZgUHS-iEZnZIVIOK-V_0 2024-09-14T11:24:10.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8702568930780771670', time=2024-09-14T13:17:19.464279+0000, chain.objs.size()=1 2024-09-14T11:24:10.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.119+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.F_9fs_OrzltjyEbzTkb1NUW64SnikDb_0 2024-09-14T11:24:10.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13868406448084022818', time=2024-09-14T13:17:19.555545+0000, chain.objs.size()=1 2024-09-14T11:24:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.Z_fug-RPoYO1fPTGgwotWLkTOCiNGys_0 2024-09-14T11:24:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11763052514573063170', time=2024-09-14T13:17:19.632556+0000, chain.objs.size()=1 2024-09-14T11:24:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.nD8u1stsoeNEZ5XDGe-v-jnY963tnjS_0 2024-09-14T11:24:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4476834459770706048', time=2024-09-14T13:17:23.753106+0000, chain.objs.size()=1 2024-09-14T11:24:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.-Zng2lUC14pIO_J_T1q6azfYz4ZJMBb_0 2024-09-14T11:24:10.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2511091723315809974', time=2024-09-14T13:17:27.001288+0000, chain.objs.size()=1 2024-09-14T11:24:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.sNQ7oSv66sg-lQFmMrvfe_a25wE97Dy_0 2024-09-14T11:24:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7355685294232730842', time=2024-09-14T13:18:45.838283+0000, chain.objs.size()=1 2024-09-14T11:24:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.b7fipxiHvlQWGQk9rciPx4xFHc2NM-8_0 2024-09-14T11:24:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7459139835767068998', time=2024-09-14T13:18:45.959621+0000, chain.objs.size()=1 2024-09-14T11:24:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.ZhdZh4iTybTNeYoquILIZWSLdQNL3US_0 2024-09-14T11:24:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5563436142950698302', time=2024-09-14T13:18:46.065172+0000, chain.objs.size()=1 2024-09-14T11:24:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.fNeYCTrkPfxQp9NJSixp0fL73GAvg2o_0 2024-09-14T11:24:10.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16742483187173666715', time=2024-09-14T13:19:26.318869+0000, chain.objs.size()=1 2024-09-14T11:24:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.RgilyyZJec6S3ZPHtlJCKsZOBX9bMqi_0 2024-09-14T11:24:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6623138750854857481', time=2024-09-14T13:19:29.677400+0000, chain.objs.size()=1 2024-09-14T11:24:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.ul4kg5JR5hOgnScvE95ouqtba7A9JHE_0 2024-09-14T11:24:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18285252926552008866', time=2024-09-14T13:20:06.640351+0000, chain.objs.size()=1 2024-09-14T11:24:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.ti7bUmVRQBiP98rCiGWe9tJO0ke8ue9_0 2024-09-14T11:24:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13840160610849032630', time=2024-09-14T13:20:41.173446+0000, chain.objs.size()=1 2024-09-14T11:24:10.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.123+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.aOvfrXDT8xeObRM8P7OQN-OKmnjl78n_0 2024-09-14T11:24:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.127+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5123094445679264591', time=2024-09-14T13:20:50.149385+0000, chain.objs.size()=1 2024-09-14T11:24:10.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.127+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.Xk6ihDuVFfhjOsIh6OVuXKGYxGplZSg_0 2024-09-14T11:24:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.131+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6118929975639717349', time=2024-09-14T13:21:24.762248+0000, chain.objs.size()=1 2024-09-14T11:24:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.131+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.PwuGZlbKWwtTr_4_Kgwk01H7OQu0PIN_0 2024-09-14T11:24:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.131+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8910880542100402212', time=2024-09-14T13:21:24.802569+0000, chain.objs.size()=1 2024-09-14T11:24:10.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.131+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.50TyfTdV5xkQ9zl-wKx5E_R1SQxRcti_0 2024-09-14T11:24:10.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.131+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13674850149167828371', time=2024-09-14T13:23:32.267649+0000, chain.objs.size()=1 2024-09-14T11:24:10.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.131+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.AIe0ebekcXBSdQuyMchJ23soa9EniGR_0 2024-09-14T11:24:10.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.135+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.135+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:24:10.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:24:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15840348603879529001', time=2024-09-14T13:14:15.336162+0000, chain.objs.size()=1 2024-09-14T11:24:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8__shadow_.oQ-bt0YE4SIoGGyGxgBvVtbMEdqDen5_0 2024-09-14T11:24:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.695504664546882749', time=2024-09-14T13:14:15.440823+0000, chain.objs.size()=1 2024-09-14T11:24:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9__shadow_.-_Qg9UY95HoJ5083-5FpgjEQ4VJMW8z_0 2024-09-14T11:24:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16970231056289414503', time=2024-09-14T13:15:51.038496+0000, chain.objs.size()=1 2024-09-14T11:24:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.x9my8CCg_2S1gYW1RkIjJ_tpnvft2Qb_0 2024-09-14T11:24:10.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17817079142367896277', time=2024-09-14T13:16:36.610132+0000, chain.objs.size()=1 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.ySRGsbiyhepsZiRcpKzG6Y-zxv23SZz_0 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15153167666121481603', time=2024-09-14T13:16:36.611777+0000, chain.objs.size()=1 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.H-vHsPX4bOkV66B8zZUbXfH-VFs0ItP_0 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18358996713417258854', time=2024-09-14T13:16:40.459553+0000, chain.objs.size()=1 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.zsWf5G9p0I5z9PhJ-0o3LdGtsSaWz5__0 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8260604378154424094', time=2024-09-14T13:17:58.130489+0000, chain.objs.size()=1 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.za1o7sjoxDoM5fHWSAkKff-RTmTYmqG_0 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9580456885328809585', time=2024-09-14T13:17:58.186518+0000, chain.objs.size()=1 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.GjHRgm5u3e3dBIHC7xnOVTINLcx-4fN_0 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4767833686237778363', time=2024-09-14T13:18:02.621065+0000, chain.objs.size()=1 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.KbtXCTioROolpwa23wjR4CgxW55pn9F_0 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7398667481442140330', time=2024-09-14T13:21:24.617267+0000, chain.objs.size()=1 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.katR4blbgzyDHpAilF13bHas8dtxIUt_0 2024-09-14T11:24:10.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5702167352303567482', time=2024-09-14T13:23:32.212210+0000, chain.objs.size()=1 2024-09-14T11:24:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.DxnTHifOe6x-qpCoeAAyF6adNglt9mp_0 2024-09-14T11:24:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8118590542558906502', time=2024-09-14T13:23:32.214338+0000, chain.objs.size()=1 2024-09-14T11:24:10.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.139+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.oQSCBFX7rxOLOm6NZFBW09DwLaxE1BR_0 2024-09-14T11:24:10.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.147+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.147+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:24:10.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:24:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11181740963281416411', time=2024-09-14T13:14:14.343001+0000, chain.objs.size()=1 2024-09-14T11:24:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.woE28IVV5XShrXLEM2TPksgx9P6BwCs_0 2024-09-14T11:24:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7730537985925706351', time=2024-09-14T13:14:14.791495+0000, chain.objs.size()=1 2024-09-14T11:24:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.lLY922J-lf7tolNZ1NkrDTj6qSLXNaR_0 2024-09-14T11:24:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2232184968820331992', time=2024-09-14T13:15:51.013115+0000, chain.objs.size()=1 2024-09-14T11:24:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.1hbDclFpGTZZpK_MQJ1M7mWRH-vObzH_0 2024-09-14T11:24:10.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8543684454032986733', time=2024-09-14T13:15:51.014983+0000, chain.objs.size()=1 2024-09-14T11:24:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.WsD0j65JMmeSc8AJOzF1HLIG7X2J4tA_0 2024-09-14T11:24:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11885021106341451811', time=2024-09-14T13:15:55.816484+0000, chain.objs.size()=1 2024-09-14T11:24:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.4gdNG42VcJoy8ABaqVRg7kP9fwueP9j_0 2024-09-14T11:24:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18001616020985936533', time=2024-09-14T13:16:36.530085+0000, chain.objs.size()=1 2024-09-14T11:24:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.jwvBUqnTCSkDVVD9iJtE0vSpDGyimIJ_0 2024-09-14T11:24:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12188976772129849440', time=2024-09-14T13:16:40.281048+0000, chain.objs.size()=1 2024-09-14T11:24:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.UsPy347XUgCAhvpSXhx7els-laxXMKo_0 2024-09-14T11:24:10.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3256176430909276481', time=2024-09-14T13:16:40.282689+0000, chain.objs.size()=1 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.uxcIGMJCKq2giJJjiqrmwjdcHLKL8sF_0 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5241643943993701223', time=2024-09-14T13:16:40.376309+0000, chain.objs.size()=1 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.Prj1VGE6_S56oeYKUJ6rpficGzGZRtu_0 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7523632083305200932', time=2024-09-14T13:17:19.538104+0000, chain.objs.size()=1 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.JrF_9qa-NJbPeQqoVToGmVblM8Wn1eW_0 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11003490192154755709', time=2024-09-14T13:17:23.548810+0000, chain.objs.size()=1 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.q6Osp_p20WLzxlLZJvC2mWnwwXaeYmO_0 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16660404023329623851', time=2024-09-14T13:18:45.959650+0000, chain.objs.size()=1 2024-09-14T11:24:10.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.151+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.XtZQLCDCi4uFlP4fjJvGZq21gGkaTdt_0 2024-09-14T11:24:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.155+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16261723933633965490', time=2024-09-14T13:18:46.029700+0000, chain.objs.size()=1 2024-09-14T11:24:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.155+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.rQW65qXUzjXh90XW5sZ3G7dn8Tag9LH_0 2024-09-14T11:24:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.155+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8701801867241431441', time=2024-09-14T13:18:46.031410+0000, chain.objs.size()=1 2024-09-14T11:24:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.155+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.jwJsM9QRiEHdFf0cXyahU2hz9lnz7L__0 2024-09-14T11:24:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.155+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5271083458618073226', time=2024-09-14T13:19:21.919097+0000, chain.objs.size()=1 2024-09-14T11:24:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.155+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.ETnMzS8DjgoOFhRF2ndfbz4OTJ8fHun_0 2024-09-14T11:24:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.155+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15223432366960124574', time=2024-09-14T13:19:26.495439+0000, chain.objs.size()=1 2024-09-14T11:24:10.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.155+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.UPWm4ZlErr_-T4JuAerZa7Dj6vsWuJK_0 2024-09-14T11:24:10.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.159+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:24:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:24:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6762856165430810081', time=2024-09-14T13:14:14.754537+0000, chain.objs.size()=1 2024-09-14T11:24:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.lLY922J-lf7tolNZ1NkrDTj6qSLXNaR_0 2024-09-14T11:24:10.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15754749991737864985', time=2024-09-14T13:15:55.610924+0000, chain.objs.size()=1 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.mif5FT6vdG4YLB9AcJMJzkOO7-HyoOZ_0 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2461606625559254252', time=2024-09-14T13:16:36.718074+0000, chain.objs.size()=1 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.wgxR9o96UulYT0yzz221yBOhKHd24XB_0 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13916179876309413148', time=2024-09-14T13:17:19.544502+0000, chain.objs.size()=1 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.cKLJKgqlOlQAwq36syd0UIPJGJTtPbQ_0 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3200552303672366269', time=2024-09-14T13:18:37.502354+0000, chain.objs.size()=1 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.q1qdjt8f7QlO632Z3h6HKTrOkazAvJ__0 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14149433560774409781', time=2024-09-14T13:18:42.039475+0000, chain.objs.size()=1 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.Bhy6Jr6Myp4GNkqvUMnj62uW-txaMXM_0 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13026404463068077417', time=2024-09-14T13:18:46.027734+0000, chain.objs.size()=1 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.JlSIuvXieZMl4BCTZpEMoScLd4MF37n_0 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14085187292233182179', time=2024-09-14T13:19:20.522724+0000, chain.objs.size()=1 2024-09-14T11:24:10.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.A3MXkxb_HQIuCiIDiPoqxb4-Q0CghJG_0 2024-09-14T11:24:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2660162000585254074', time=2024-09-14T13:19:21.967121+0000, chain.objs.size()=1 2024-09-14T11:24:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.vnc2K--1ypoEEbDPcqzeiO4v4YQrCOO_0 2024-09-14T11:24:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6183188100530945964', time=2024-09-14T13:19:22.030665+0000, chain.objs.size()=1 2024-09-14T11:24:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.LW608U8rGEtYB8ZPMZxfu-hvuhMe9cA_0 2024-09-14T11:24:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2562677954843219421', time=2024-09-14T13:19:26.320337+0000, chain.objs.size()=1 2024-09-14T11:24:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.g6wYRsJFAuANHbgq9FkwkY8DyTjB2yB_0 2024-09-14T11:24:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18402010174675765381', time=2024-09-14T13:20:01.214077+0000, chain.objs.size()=1 2024-09-14T11:24:10.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.163+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.CWvjGV_t3c_FcwYQRJ1mF6OTgee8arD_0 2024-09-14T11:24:10.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.167+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9657511718457702987', time=2024-09-14T13:20:01.275553+0000, chain.objs.size()=1 2024-09-14T11:24:10.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.167+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.CiiE1DCWfKdYMOlT6k9fk6mtfGMu5S7_0 2024-09-14T11:24:10.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.167+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1091057574820199909', time=2024-09-14T13:20:46.058229+0000, chain.objs.size()=1 2024-09-14T11:24:10.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.167+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.9whSHAq9yaqniPwpVFcRBn1EB_er-Kc_0 2024-09-14T11:24:10.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.167+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11407795629222377348', time=2024-09-14T13:20:50.201020+0000, chain.objs.size()=1 2024-09-14T11:24:10.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.167+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.uDp_vIVY_rzQKxsnL-6xxvZT39dkCwR_0 2024-09-14T11:24:10.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.167+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17586633866652981625', time=2024-09-14T13:21:24.645588+0000, chain.objs.size()=1 2024-09-14T11:24:10.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.167+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.RzSyQB0-1HY8hXjRYVJojPeqOOSsIpv_0 2024-09-14T11:24:10.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.175+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:24:10.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:24:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14115770325078838470', time=2024-09-14T13:14:14.410507+0000, chain.objs.size()=1 2024-09-14T11:24:10.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.cqOD0THUbljgvM44KrgsT5WkTljvqYe_0 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17038731319215760966', time=2024-09-14T13:15:55.721482+0000, chain.objs.size()=1 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.eTKU7pB5wLU_jtGBubTqyVV8KL3v2UG_0 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17726032293659129252', time=2024-09-14T13:15:55.723493+0000, chain.objs.size()=1 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.dsPSxxIH-2Tl6ZJaMmGUporT3bIhWm2_0 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13045854774107175901', time=2024-09-14T13:17:14.739458+0000, chain.objs.size()=1 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.mnOIA1VX8x9RdM3wPRggWdTW-A4tdIF_0 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2806381790980740111', time=2024-09-14T13:17:19.655061+0000, chain.objs.size()=1 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.U1Sodgigj6stqXzQMMbxB4wddcLaWX1_0 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11004050427777967055', time=2024-09-14T13:17:23.653936+0000, chain.objs.size()=1 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.5Ja2MGKLI8Hh1GNBu5HgKVMDhZKk94y_0 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17923637449127136575', time=2024-09-14T13:17:23.669660+0000, chain.objs.size()=1 2024-09-14T11:24:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.tVdQulYZ1F5WXzMmxbZ7cik8ROQFsho_0 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16887427617852557435', time=2024-09-14T13:18:42.217039+0000, chain.objs.size()=1 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.yVVS29Yg41yKSSSBqprYWmSccQVtxx3_0 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16811645962579799102', time=2024-09-14T13:18:45.822320+0000, chain.objs.size()=1 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.KH_8iv6Hz2vH3pFMte0ReFi1YLii8_i_0 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18382493523052672821', time=2024-09-14T13:20:01.172860+0000, chain.objs.size()=1 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.5spvnv2leHX8-Xk5rm29qNGziWKrhtF_0 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4242669217198372275', time=2024-09-14T13:20:41.230993+0000, chain.objs.size()=1 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.La1BMztZDJP198YxjZo6Xz4FiHYHZ28_0 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15675907278581713321', time=2024-09-14T13:20:49.872298+0000, chain.objs.size()=1 2024-09-14T11:24:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.179+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.FnmKdqxfuSmknFJHJv5viVV-Du3BsXh_0 2024-09-14T11:24:10.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.183+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17669831270490476514', time=2024-09-14T13:20:50.233086+0000, chain.objs.size()=1 2024-09-14T11:24:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.183+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.6Nu0rZhl7WXZ7ytGg2nqIg12qp5FWSf_0 2024-09-14T11:24:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.183+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12214003282845560650', time=2024-09-14T13:21:24.717861+0000, chain.objs.size()=1 2024-09-14T11:24:10.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.183+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.LcPiqksZXtCmP04dCha-3TTixPZ_aW7_0 2024-09-14T11:24:10.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.187+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:24:10.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:24:10.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18313887031868918260', time=2024-09-14T13:14:14.989834+0000, chain.objs.size()=5 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.1 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.1_1 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.2 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.2_1 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-LUKEWARM.2~_WqtgKzxl1Iy-SbiOxKtQIxg6yEvpsz.3 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5295374377413549310', time=2024-09-14T13:14:15.013420+0000, chain.objs.size()=5 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.1 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.1_1 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.2 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.2_1 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.3 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8470167657965635651', time=2024-09-14T13:15:51.062329+0000, chain.objs.size()=1 2024-09-14T11:24:10.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.yhzWSKODyeq1D5iMfNrTkD-iqUEvQHS_0 2024-09-14T11:24:10.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18424944846002583450', time=2024-09-14T13:16:35.508451+0000, chain.objs.size()=1 2024-09-14T11:24:10.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.191+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.LHQtYEdCHLzyL_0ljGRrIsPhbNwfkXO_0 2024-09-14T11:24:10.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14469800568908188927', time=2024-09-14T13:16:40.493155+0000, chain.objs.size()=1 2024-09-14T11:24:10.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.Of3C5TZLk_6qehN1q-EO2kpPphudjCm_0 2024-09-14T11:24:10.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11094327410459285880', time=2024-09-14T13:17:14.824571+0000, chain.objs.size()=1 2024-09-14T11:24:10.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.-Y3q7dVFBsykCZMuiYLzr9nWQzc6iEt_0 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18136825443413191244', time=2024-09-14T13:17:14.833095+0000, chain.objs.size()=1 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.YaU1VQK8_Brgn2wi9c2b3gl_fkW-aPq_0 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1682595991424770050', time=2024-09-14T13:18:02.495111+0000, chain.objs.size()=1 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.i749TkYCBHaxptf6TA9kpv6_AbFFQ3S_0 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6935169529452147104', time=2024-09-14T13:18:02.603062+0000, chain.objs.size()=1 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.cHPq5Zr7EpKFiyNwdVE9TnNkh5ZJfIy_0 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8729970295675075985', time=2024-09-14T13:18:37.351526+0000, chain.objs.size()=1 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.GIRYPXmW_xvhHLTzFiTLS8RwSqw8XAx_0 2024-09-14T11:24:10.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9699605748872211676', time=2024-09-14T13:18:37.354749+0000, chain.objs.size()=1 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.4wYLqc6PwSWpSsKAg10zLauKdspk05j_0 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14557781248682467675', time=2024-09-14T13:18:37.557405+0000, chain.objs.size()=1 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.hlR_0X2d6QAfQGs28hauPE3rU-DhWC9_0 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9183784747211815213', time=2024-09-14T13:18:42.214861+0000, chain.objs.size()=1 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.l2NLt9dylqqCqvc8e8eqCn3_ZoldiYs_0 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8909805252116010187', time=2024-09-14T13:19:21.862668+0000, chain.objs.size()=1 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.mPog6Tzn1E1M0NRYCXil_mvH3q1l4Ba_0 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1078202918430311370', time=2024-09-14T13:19:22.035131+0000, chain.objs.size()=1 2024-09-14T11:24:10.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.195+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.qlksHmcrbbNfFbQuu7ntTFPP5OaJ4dW_0 2024-09-14T11:24:10.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.199+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15272358927766344079', time=2024-09-14T13:19:26.319713+0000, chain.objs.size()=1 2024-09-14T11:24:10.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.199+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.fSlJ2AtbmH3oc--PB5C6a6IzIAZIu2i_0 2024-09-14T11:24:10.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.199+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10118716644626364220', time=2024-09-14T13:20:41.226107+0000, chain.objs.size()=1 2024-09-14T11:24:10.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.199+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.386SHqJUj3gtQNRdQMoEeZ0V00F1XCj_0 2024-09-14T11:24:10.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.203+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1435773993219293500', time=2024-09-14T13:20:50.022817+0000, chain.objs.size()=1 2024-09-14T11:24:10.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.203+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.I0Fusfnx9GU3_L3Dkvt47UpFR8scZXX_0 2024-09-14T11:24:10.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.203+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3722241904376038225', time=2024-09-14T13:20:50.179124+0000, chain.objs.size()=1 2024-09-14T11:24:10.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.203+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.qRjdi_mMv5VOcaMBJMrZully1BqJ8Yc_0 2024-09-14T11:24:10.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.203+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2688534441561967230', time=2024-09-14T13:23:32.238444+0000, chain.objs.size()=1 2024-09-14T11:24:10.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.203+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.zHCGJIgNj_QYoC7Jp0xEVDB4ZRpBQjq_0 2024-09-14T11:24:10.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.207+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:24:10.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13659632832106902055', time=2024-09-14T13:14:14.516283+0000, chain.objs.size()=4 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13__multipart_foo.2~tG4sqIMbSP9rZGaXK4W7SU1zaQMw4FC.1 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13__multipart_foo.2~tG4sqIMbSP9rZGaXK4W7SU1zaQMw4FC.2 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13__multipart_foo.2~tG4sqIMbSP9rZGaXK4W7SU1zaQMw4FC.3 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13__multipart_foo.2~tG4sqIMbSP9rZGaXK4W7SU1zaQMw4FC.4 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34448434876270737', time=2024-09-14T13:14:14.778946+0000, chain.objs.size()=2 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.PzBaaSWxhmj3fFfBtFOJdmVKG1pc6W2_0 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.PzBaaSWxhmj3fFfBtFOJdmVKG1pc6W2_1 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13776042049864727225', time=2024-09-14T13:15:55.834965+0000, chain.objs.size()=1 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.2JSPj-D2VCpRlsy75ACmydF55qhg5hB_0 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7798133775348693315', time=2024-09-14T13:16:31.949458+0000, chain.objs.size()=1 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.vAf6-e8mFguWxqFGb5j6_bxZwVXyJoD_0 2024-09-14T11:24:10.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.255223481690730931', time=2024-09-14T13:16:40.263049+0000, chain.objs.size()=1 2024-09-14T11:24:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.6XNXvY80ebzTr-CL7Eb4dzmqJU9TIHp_0 2024-09-14T11:24:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13307543063244498681', time=2024-09-14T13:16:40.368949+0000, chain.objs.size()=1 2024-09-14T11:24:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.WOdCRR3oT79L3fwjkrAf3YDL4TrYkT0_0 2024-09-14T11:24:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3589578474733493901', time=2024-09-14T13:16:40.483410+0000, chain.objs.size()=1 2024-09-14T11:24:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.RolF_9GX-UU45M_m3u6pdQTCTJPxq3A_0 2024-09-14T11:24:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13339889928407323734', time=2024-09-14T13:17:14.751481+0000, chain.objs.size()=1 2024-09-14T11:24:10.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.211+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.RnnAMzRX-q-wY5puuxbzpt69vYl_nd0_0 2024-09-14T11:24:10.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10470101925965110526', time=2024-09-14T13:17:58.085276+0000, chain.objs.size()=1 2024-09-14T11:24:10.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.wS1cKaUPqyvk4n7j-avqVjfeMW5MlEl_0 2024-09-14T11:24:10.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11456485505413653105', time=2024-09-14T13:17:58.128878+0000, chain.objs.size()=1 2024-09-14T11:24:10.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.vHmshY5YFy9OM8hIdokjENaGAXRsiRN_0 2024-09-14T11:24:10.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8351764236927029791', time=2024-09-14T13:18:02.442132+0000, chain.objs.size()=1 2024-09-14T11:24:10.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.o1fr3BN1DAfTdZWlxh3LgZ8fuW88Vl0_0 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16977890793118152266', time=2024-09-14T13:18:37.247511+0000, chain.objs.size()=1 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.ybPI8gBwD3VrYsI7cjo3D4XIFWM9kP1_0 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3600336270878446991', time=2024-09-14T13:18:40.818309+0000, chain.objs.size()=1 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.8_bgfpVOB0fTa4ArDMeK8cKgb4Zr4Yq_0 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2443163895962748350', time=2024-09-14T13:18:42.064330+0000, chain.objs.size()=1 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.2hZjYJfMHUiKdMiUWrsSXjlyqPzRTi6_0 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17919631664991892713', time=2024-09-14T13:18:42.137702+0000, chain.objs.size()=1 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.PQuMEXxF1Mq3Lq7pNsXaEMj7ZzT6vsQ_0 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17624643774263221465', time=2024-09-14T13:18:42.139253+0000, chain.objs.size()=1 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.X_YBctFVxoCAua8WvslIpuUUEgi3dnx_0 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17278256703591614782', time=2024-09-14T13:18:46.066885+0000, chain.objs.size()=1 2024-09-14T11:24:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.215+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.rIpq7-7Ac44Z23JHzLCrQXgcEklIJr7_0 2024-09-14T11:24:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.219+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5130731279415671109', time=2024-09-14T13:19:21.914814+0000, chain.objs.size()=1 2024-09-14T11:24:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.219+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.He9CFS3ICX_nX48c-Xi3KFE55RIblQ-_0 2024-09-14T11:24:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.219+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11844336884204399410', time=2024-09-14T13:19:21.916576+0000, chain.objs.size()=1 2024-09-14T11:24:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.219+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.zqhfM5Tt-0NDeojy1t6nsUSwYaL_Ou3_0 2024-09-14T11:24:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.223+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10807237861039701125', time=2024-09-14T13:19:22.092867+0000, chain.objs.size()=1 2024-09-14T11:24:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.223+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.b5oMt_9__FxLmS7kn86nGgeeu_6RY0u_0 2024-09-14T11:24:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.223+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4904980830536382605', time=2024-09-14T13:20:46.026034+0000, chain.objs.size()=1 2024-09-14T11:24:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.223+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.gnnUhzzwXYckexVipUzGiG1NtlNLl9I_0 2024-09-14T11:24:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.223+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17433711295695688191', time=2024-09-14T13:20:50.162178+0000, chain.objs.size()=1 2024-09-14T11:24:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.223+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.VW2Mtja8czcT1kBrhjj36CI9A06vzAk_0 2024-09-14T11:24:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.223+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8069855424975604200', time=2024-09-14T13:21:24.755948+0000, chain.objs.size()=1 2024-09-14T11:24:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.223+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.GU_X6VDg5d-xO7lwG40YypvRPuErXyQ_0 2024-09-14T11:24:10.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.227+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.227+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:24:10.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:24:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8878319571142396253', time=2024-09-14T13:14:14.350867+0000, chain.objs.size()=1 2024-09-14T11:24:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.g6mctPykQiIEUntADNdrWFEmKJzxoE8_0 2024-09-14T11:24:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17649240887968320807', time=2024-09-14T13:14:15.183975+0000, chain.objs.size()=3 2024-09-14T11:24:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.baLOh-pZxq38pgRTkp4Yo0bKkmLXBEz_0 2024-09-14T11:24:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.baLOh-pZxq38pgRTkp4Yo0bKkmLXBEz_1 2024-09-14T11:24:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.baLOh-pZxq38pgRTkp4Yo0bKkmLXBEz_2 2024-09-14T11:24:10.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2818394906368061122', time=2024-09-14T13:17:23.445162+0000, chain.objs.size()=1 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.HqbV3U6CF23azbqAPJxsj9pVUd2Q5iw_0 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16667687722091522243', time=2024-09-14T13:17:23.657688+0000, chain.objs.size()=1 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.WAoQPgUrnr3c7zyIXVWd8VBKv8-EHV4_0 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14673421171647981949', time=2024-09-14T13:18:02.612714+0000, chain.objs.size()=1 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.ZYaWcRdhrUXjF3O9wSV1hDIhpPALdHj_0 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1135683733756494417', time=2024-09-14T13:18:42.280278+0000, chain.objs.size()=1 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.2wghAwyXzNEXe13ayyzeVRBYgx3ASML_0 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4374236951307203362', time=2024-09-14T13:20:41.183920+0000, chain.objs.size()=1 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.iURj4KjI8VeMsyWoSDfCu3f89NW3uy7_0 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4128242015656257020', time=2024-09-14T13:20:50.124619+0000, chain.objs.size()=1 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.chjoRXh9v0H1wqTN651rZF4nTtk-e7u_0 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7979528427008718199', time=2024-09-14T13:21:24.718393+0000, chain.objs.size()=1 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.Q11mgJK678i_16FJ7i4w-0QKfoS22hH_0 2024-09-14T11:24:10.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11330992358591582884', time=2024-09-14T13:23:32.197105+0000, chain.objs.size()=1 2024-09-14T11:24:10.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.231+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.B1ZQ8cydPFudDXYu4mSnwguYKQpZpZY_0 2024-09-14T11:24:10.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.239+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:24:10.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.514564239297707319', time=2024-09-14T13:14:15.097720+0000, chain.objs.size()=5 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.1 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__shadow_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.1_1 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.2 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__shadow_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.2_1 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-LUKEWARM.2~qCdQ8WMoze7lH1Gzq9tZby9J2OqYjrc.3 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2909846062839630810', time=2024-09-14T13:16:36.459951+0000, chain.objs.size()=1 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.fv8uSYaNy14Hx7ci3MVO3U_34VRIueU_0 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3696179293411718593', time=2024-09-14T13:18:45.942097+0000, chain.objs.size()=1 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.mETOZyYmNimC7taUXsLxBBGwVuLwZKg_0 2024-09-14T11:24:10.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13003641209522435520', time=2024-09-14T13:20:06.730447+0000, chain.objs.size()=1 2024-09-14T11:24:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.lh0aAbqv88Y1QRLoSKOU92r5RPdWFeZ_0 2024-09-14T11:24:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10237439764057424996', time=2024-09-14T13:20:41.280641+0000, chain.objs.size()=1 2024-09-14T11:24:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.i0NniXwnDmHx63GRB0FmTo-I5SFVWMQ_0 2024-09-14T11:24:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1230859892974062317', time=2024-09-14T13:20:46.021117+0000, chain.objs.size()=1 2024-09-14T11:24:10.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.243+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.0y7-47wdpu_dgjZKTCZmfhfb8YjHL5d_0 2024-09-14T11:24:10.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.247+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.251+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:24:10.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.251+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:24:10.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17066200296014327533', time=2024-09-14T13:14:14.370216+0000, chain.objs.size()=1 2024-09-14T11:24:10.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.1DHYqCTn0z8DWMg8Cgq3EEMKgg_IBum_0 2024-09-14T11:24:10.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5958111588833853344', time=2024-09-14T13:14:14.583385+0000, chain.objs.size()=4 2024-09-14T11:24:10.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11__multipart_foo.2~6LSid9q-93L3neYMw03FQtZWtz-0Xot.1 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11__multipart_foo.2~6LSid9q-93L3neYMw03FQtZWtz-0Xot.2 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11__multipart_foo.2~6LSid9q-93L3neYMw03FQtZWtz-0Xot.3 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11__multipart_foo.2~6LSid9q-93L3neYMw03FQtZWtz-0Xot.4 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5868799392206116523', time=2024-09-14T13:14:15.171857+0000, chain.objs.size()=3 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.BUjubPseM41N-OQvXDVALbZueNCTYE1_0 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.BUjubPseM41N-OQvXDVALbZueNCTYE1_1 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.BUjubPseM41N-OQvXDVALbZueNCTYE1_2 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4589155246838353651', time=2024-09-14T13:16:40.254557+0000, chain.objs.size()=1 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.1tfpYslyAfcj-99qqzGhvxEFlhNJMo2_0 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12572925436069627230', time=2024-09-14T13:17:14.932422+0000, chain.objs.size()=1 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.RTJ_zXRiSYCNJk1NK7qcBYwLhete6EV_0 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1669713707441553666', time=2024-09-14T13:17:23.542273+0000, chain.objs.size()=1 2024-09-14T11:24:10.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.mEjjU3xyGgpOd2tSh8eJTEQpKH-A6af_0 2024-09-14T11:24:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4937637395329553406', time=2024-09-14T13:17:23.543643+0000, chain.objs.size()=1 2024-09-14T11:24:10.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.255+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.vFg86W7ti1BvkPh5E7ZnMB3AygMKN2R_0 2024-09-14T11:24:10.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12953961616944835688', time=2024-09-14T13:17:23.607667+0000, chain.objs.size()=1 2024-09-14T11:24:10.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.ipQiAZx4RjkakJAFy24nYmo2LGfhicu_0 2024-09-14T11:24:10.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4288410336894927077', time=2024-09-14T13:17:23.776979+0000, chain.objs.size()=1 2024-09-14T11:24:10.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.yk0MstOQY86bmFWAknE7lrM4lESmssi_0 2024-09-14T11:24:10.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1937853274772614395', time=2024-09-14T13:18:05.873296+0000, chain.objs.size()=1 2024-09-14T11:24:10.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.KccliqSr-klM1PTSGEG3HD9taH9NJiT_0 2024-09-14T11:24:10.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8571530744513678559', time=2024-09-14T13:19:26.439566+0000, chain.objs.size()=1 2024-09-14T11:24:10.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_._DWYFvakizCpacLipkIXGoZVLR9OVoZ_0 2024-09-14T11:24:10.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13340846019231554735', time=2024-09-14T13:20:46.014714+0000, chain.objs.size()=1 2024-09-14T11:24:10.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.9Gi8DcKXKCyroM3WSW14kLyl_s-72eF_0 2024-09-14T11:24:10.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17829243188382055034', time=2024-09-14T13:20:46.178294+0000, chain.objs.size()=1 2024-09-14T11:24:10.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.PbnQF0MFGTqS6MYJB9QP0W1PDLN6mv0_0 2024-09-14T11:24:10.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6812233052787039586', time=2024-09-14T13:23:32.276875+0000, chain.objs.size()=1 2024-09-14T11:24:10.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.259+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.qtI3e0rXsSxrHyZ0AhIKywFayPOv9hT_0 2024-09-14T11:24:10.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.263+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.267+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:24:10.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.267+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.267+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14929186970218127588', time=2024-09-14T13:14:14.903654+0000, chain.objs.size()=5 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.1 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.1_1 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.2 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.2_1 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__multipart_foo-FROZEN.2~io3dnWHKMInYTVov0tt7AJYnnrbUwZz.3 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13914655170315203195', time=2024-09-14T13:15:55.764573+0000, chain.objs.size()=1 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.3OMUdrbYrohVllEzH55vy4Fz5dwcNMY_0 2024-09-14T11:24:10.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8705062919694529015', time=2024-09-14T13:16:31.813351+0000, chain.objs.size()=1 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.jBX0JYRdNWJwXMYZjNpm4nm5xA4kmFN_0 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12346177705159901926', time=2024-09-14T13:16:31.949338+0000, chain.objs.size()=1 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.W55DcHebQDqbj_jSyu0jb03fZzPbtGi_0 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15215410840730053095', time=2024-09-14T13:17:14.751542+0000, chain.objs.size()=1 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.DLnWpeJBUKq6OFtR03aKEHdM3amCgYE_0 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13996423661711195102', time=2024-09-14T13:17:14.787076+0000, chain.objs.size()=1 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.Hsz8Wafu3Y1aSN1V3NfkAxsdf8gypMj_0 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12376982392264831418', time=2024-09-14T13:18:42.265049+0000, chain.objs.size()=1 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.7pmEHimmwG1uY670CJCTZtLGDz6wR4B_0 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10887778881979182809', time=2024-09-14T13:19:26.509557+0000, chain.objs.size()=1 2024-09-14T11:24:10.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.271+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.2O4ZxFMl9MBvmhn_jckor77L-ck0FKx_0 2024-09-14T11:24:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3188870618472474913', time=2024-09-14T13:20:01.189401+0000, chain.objs.size()=1 2024-09-14T11:24:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.MDtirI5vPjMLLmCOy59yC91ZY_hLTki_0 2024-09-14T11:24:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.70423757607211675', time=2024-09-14T13:20:06.518397+0000, chain.objs.size()=1 2024-09-14T11:24:10.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.PjH9HDQYvJd80tRg2szWi9VOituXpiV_0 2024-09-14T11:24:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6298148051837974618', time=2024-09-14T13:20:46.147022+0000, chain.objs.size()=1 2024-09-14T11:24:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.lfq5RIyBXFwvOYPSHAQeDAoIbZZY4Y__0 2024-09-14T11:24:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15765315994617327033', time=2024-09-14T13:20:50.053438+0000, chain.objs.size()=1 2024-09-14T11:24:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.D-z7VWKuv_rkRdenpgYpIJS-aT-FDNo_0 2024-09-14T11:24:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9419889537030933986', time=2024-09-14T13:21:24.598874+0000, chain.objs.size()=1 2024-09-14T11:24:10.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.Tlk64D62O1udrBja_hvDLabTXuOijFX_0 2024-09-14T11:24:10.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.275+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.279+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:24:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.279+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:24:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_UWVq-gA8Hzp3S3IB0-AgR9eZ2wjYVhY', time=2024-09-14T13:14:14.813526+0000, chain.objs.size()=1 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.ckEgHc3olCDAgxOnFXmmZtLUPeiWuEA_0 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.109215235122385371', time=2024-09-14T13:16:31.883467+0000, chain.objs.size()=1 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.Hias_MEUvzrU3bd0sY0OZ1hHcao3bc__0 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8287336090129919454', time=2024-09-14T13:16:36.487803+0000, chain.objs.size()=1 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.80iJEDySSrUF8UXKjFARi3sxoylhioN_0 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17855173289978422754', time=2024-09-14T13:16:36.556494+0000, chain.objs.size()=1 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.qyk8q6B6CiGUZGfY8dFUZ_1b6IjnvnO_0 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15618385849726963138', time=2024-09-14T13:17:14.800278+0000, chain.objs.size()=1 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.se4D2umHcIgeFue_OyELM8Cy68o6Ry6_0 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13441252611225264672', time=2024-09-14T13:17:14.943808+0000, chain.objs.size()=1 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.y3L06mSrf5TzBD5zzk5xPfMQE3YX2U7_0 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5583698080311054024', time=2024-09-14T13:17:18.455240+0000, chain.objs.size()=1 2024-09-14T11:24:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.pNPPJruSJLeJY3FqvD0grfEHJt_rq7c_0 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3456856781256176040', time=2024-09-14T13:17:19.511521+0000, chain.objs.size()=1 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.e0pStCAsiz_qV0IJSDWuT4BcDVq54Ps_0 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5233179214472605539', time=2024-09-14T13:17:58.062391+0000, chain.objs.size()=1 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.KIx6sgdIS8wx78ZKieOoK1T3q10fAxL_0 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6886048813129971869', time=2024-09-14T13:18:02.500556+0000, chain.objs.size()=1 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.RPscw8ZriLNp7TqGPXiTIRHC4MGjgaZ_0 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16920640303658071634', time=2024-09-14T13:19:26.423452+0000, chain.objs.size()=1 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.lcWuy9SNgzUzFTeMEpABth0t6ugtSxB_0 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17654647170966574008', time=2024-09-14T13:20:46.126557+0000, chain.objs.size()=1 2024-09-14T11:24:10.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.283+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.pCFyFVtAsngBdBr8HxZ0O0-dOKGszW9_0 2024-09-14T11:24:10.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.287+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:24:10.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:24:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_tYJBdzO6WMXvydnpci1yQ8BCVZ5H7mK', time=2024-09-14T13:14:14.699286+0000, chain.objs.size()=1 2024-09-14T11:24:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.NPxMJfUf0qtMuFg6sLxGkzMGuVvVHS2_0 2024-09-14T11:24:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8040261627476187318', time=2024-09-14T13:15:50.201561+0000, chain.objs.size()=1 2024-09-14T11:24:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.ns7rqjf23ogaZjRnLSnM4Ifr5eu9rDd_0 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9655535837650770487', time=2024-09-14T13:15:55.572227+0000, chain.objs.size()=1 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.GX55NAkV1y6v0R7yxgi10bwQ6LmPGHh_0 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2105265349117256591', time=2024-09-14T13:15:55.763866+0000, chain.objs.size()=1 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.ydLH4CQUzeP7Qxs-NcW46MoHCAhZccF_0 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12441900553567823648', time=2024-09-14T13:15:55.842290+0000, chain.objs.size()=1 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.87YjETSZjxrXaWNmHXhMH1GgAfYb-3k_0 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10064523899456461134', time=2024-09-14T13:16:31.816665+0000, chain.objs.size()=1 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.RiNNmY7T56sJSJLr1oSA304vt8i_Nli_0 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4287846978806057069', time=2024-09-14T13:17:23.609846+0000, chain.objs.size()=1 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.0KKyB6pDUbRa2bL0uPtMI8g0x8w_Hty_0 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3546996431283508709', time=2024-09-14T13:18:02.494684+0000, chain.objs.size()=1 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.UlGfPCSReswZ-B6fK5QGz4xgBf29nAg_0 2024-09-14T11:24:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7706949574658452863', time=2024-09-14T13:18:02.496702+0000, chain.objs.size()=1 2024-09-14T11:24:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.y-MSOYnXDSdS5HjmMaMSsrdNEZk8nms_0 2024-09-14T11:24:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14045706621692594487', time=2024-09-14T13:19:21.834964+0000, chain.objs.size()=1 2024-09-14T11:24:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.P9UhDFD24AokhZrTSEb31iAdUtrkgqz_0 2024-09-14T11:24:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7921569515804150603', time=2024-09-14T13:19:22.008990+0000, chain.objs.size()=1 2024-09-14T11:24:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.-Ib8OdSwXsZF5Pm1Dz17EGknlcS9MLK_0 2024-09-14T11:24:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9183664019031348459', time=2024-09-14T13:19:22.010922+0000, chain.objs.size()=1 2024-09-14T11:24:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.291+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.JdZ4AoDQcTNdfqmf0PUETT0rQjN0emO_0 2024-09-14T11:24:10.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.295+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5681936207952207327', time=2024-09-14T13:20:01.345389+0000, chain.objs.size()=1 2024-09-14T11:24:10.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.295+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.x_so7l1sxqOlQznWkGkGSzmlgefi4RN_0 2024-09-14T11:24:10.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.295+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12033561524381592250', time=2024-09-14T13:20:01.347695+0000, chain.objs.size()=1 2024-09-14T11:24:10.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.295+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.qf_V5-x8zY4SR0r4TiW1CJ4tQpjjIIX_0 2024-09-14T11:24:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.299+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.928536046207469375', time=2024-09-14T13:20:41.384022+0000, chain.objs.size()=1 2024-09-14T11:24:10.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.299+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.bKTdXbKdLuKDdo9pgb2oU3BjTwZ5yVt_0 2024-09-14T11:24:10.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.299+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.887742052437278232', time=2024-09-14T13:20:41.406002+0000, chain.objs.size()=1 2024-09-14T11:24:10.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.299+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_._Fb12PeCYSETXbVoKNRh3jkXLpAG8Et_0 2024-09-14T11:24:10.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.299+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5006822466085405645', time=2024-09-14T13:20:50.054105+0000, chain.objs.size()=1 2024-09-14T11:24:10.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.299+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.ZkAYZOiMazvQqTn2UNWkOEyIusXrYcl_0 2024-09-14T11:24:10.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.303+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.303+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:24:10.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_FChYZ-XKIbQ4h5eUD_V48YcuDsD-7nW', time=2024-09-14T13:14:14.953241+0000, chain.objs.size()=3 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.K_OBBnRneU4kKVTFblkoXpPAXgZ4BIF_0 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.K_OBBnRneU4kKVTFblkoXpPAXgZ4BIF_1 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.K_OBBnRneU4kKVTFblkoXpPAXgZ4BIF_2 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1805519714084687201', time=2024-09-14T13:15:51.011623+0000, chain.objs.size()=1 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.V8VAIi8a4TxTjdnjhW2LlUvT-OsS6ln_0 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6689862528391349300', time=2024-09-14T13:15:51.016433+0000, chain.objs.size()=1 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.ZoTVDcMHKaFzmQtUl1bv4MnbUJMswbA_0 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6624422187320673337', time=2024-09-14T13:15:51.176769+0000, chain.objs.size()=1 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.GBQETg21nU4DRkVpLoh1-dAsiZUKS8c_0 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.924700842328241821', time=2024-09-14T13:15:55.580768+0000, chain.objs.size()=1 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.UTZZjUf8BaHep_a-hhOhixyOqHnKO6z_0 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5478048868476131275', time=2024-09-14T13:16:36.437053+0000, chain.objs.size()=1 2024-09-14T11:24:10.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.1igJZluA0W1s2GdirDlezImVXV-Tz_5_0 2024-09-14T11:24:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9022562548715769994', time=2024-09-14T13:16:40.184928+0000, chain.objs.size()=1 2024-09-14T11:24:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.6aDXeks43OIpcbwKgO8e7p3nZala_V7_0 2024-09-14T11:24:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5066371663653033714', time=2024-09-14T13:16:40.295681+0000, chain.objs.size()=1 2024-09-14T11:24:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.vb0ud8xnFQeyq18px-Qg4i0v1NUc1qj_0 2024-09-14T11:24:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15125080492662477220', time=2024-09-14T13:18:02.474228+0000, chain.objs.size()=1 2024-09-14T11:24:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.i3NwKshwwXf5klZWdVJ6AE3xQvP9L-O_0 2024-09-14T11:24:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13337323918770890934', time=2024-09-14T13:19:26.518907+0000, chain.objs.size()=1 2024-09-14T11:24:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.307+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.9_PhfwPP2lMiSW52aZGLm1FrdV9nfMb_0 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5762211050505540567', time=2024-09-14T13:20:06.528086+0000, chain.objs.size()=1 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.FxsaJNwfhdLQ47THX-2cMWuXdd7oNj8_0 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11778373317533319103', time=2024-09-14T13:20:06.542058+0000, chain.objs.size()=1 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.tFRK2ifj1vgpGDsUZz7HPfTQnA70HHz_0 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3197954468079203203', time=2024-09-14T13:20:06.785972+0000, chain.objs.size()=1 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.6AZpYAil6rNYkvbBEn8WFu7kM5MVZf__0 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11292953584280237012', time=2024-09-14T13:20:49.976315+0000, chain.objs.size()=1 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.Tty0PqMOWdfPC5-mOYRRAkhTEkfM-bs_0 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8857335702112220550', time=2024-09-14T13:21:24.698716+0000, chain.objs.size()=1 2024-09-14T11:24:10.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.yd9gRPWilLvfffUymX825eD8TjxXQ1v_0 2024-09-14T11:24:10.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15783131362021444909', time=2024-09-14T13:23:45.724573+0000, chain.objs.size()=1 2024-09-14T11:24:10.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.311+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19__shadow:CwPKzt2Zl0KJ4jKQOqSaJT7X5TRPA2e_.p0XRY7Tw5crf4ynLLY-BS6bjJBqu-5N_0 2024-09-14T11:24:10.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.315+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.319+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:24:10.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.319+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-14T11:24:10.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10488872789335850728', time=2024-09-14T13:14:15.359393+0000, chain.objs.size()=1 2024-09-14T11:24:10.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8__shadow_.pdj-Z-ylmNV-ykT65yF1NpNjTBHhjHI_0 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9339268665582091597', time=2024-09-14T13:16:31.869067+0000, chain.objs.size()=1 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.MiS0819VsfW530xtEvaURQEB3xexQXB_0 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7358857468084563299', time=2024-09-14T13:16:40.312923+0000, chain.objs.size()=1 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.Hug0hH3n2sOoJ7b2NYRru_qnNSQS3kr_0 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15164763923753352619', time=2024-09-14T13:16:40.422560+0000, chain.objs.size()=1 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.IgTCOloZZ0t15LBKh3TECxyY8lknVVY_0 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3527518653713616355', time=2024-09-14T13:17:14.751535+0000, chain.objs.size()=1 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.AaGAJl-Iq-By2WgLyALlLwRy3NwV5Bu_0 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18011594800604011190', time=2024-09-14T13:17:14.787180+0000, chain.objs.size()=1 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.uD2PE-PQH4rDzKMXhoAjbaPJoak3NJ9_0 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6440997821312360149', time=2024-09-14T13:17:14.789374+0000, chain.objs.size()=1 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.e0ikk9QPRlS8stfAsQykbEbGwsVmZBi_0 2024-09-14T11:24:10.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17275234841886489607', time=2024-09-14T13:17:14.910449+0000, chain.objs.size()=1 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.9wbCyqQXEUqMwl2CgqHpQt-4k9FvwYv_0 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3632573974298228342', time=2024-09-14T13:17:19.525503+0000, chain.objs.size()=1 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.7ePLoGnaSjriNZu0HZC3Nk3fYFjic5Z_0 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4058132091617763118', time=2024-09-14T13:17:19.625207+0000, chain.objs.size()=1 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.gmG3qBrOBDqMpahJHYXAFC5UPrIQ0-s_0 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2090452288279138872', time=2024-09-14T13:17:23.544594+0000, chain.objs.size()=1 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.v-xMlYnBmNWx9HXJEvnIw6fVGoDgoLE_0 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2480765804256906820', time=2024-09-14T13:17:23.546919+0000, chain.objs.size()=1 2024-09-14T11:24:10.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.323+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.NWnD_S1GmWun9xahBMH2lFe96JsnMDz_0 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11511082210451285468', time=2024-09-14T13:17:58.017392+0000, chain.objs.size()=1 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.Mz1-e7IivUtgyLPPrPrJZAXN5ODO1I4_0 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14720307284898649056', time=2024-09-14T13:17:58.020810+0000, chain.objs.size()=1 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.6GcJQapmBn0KehBPd4czdaHgxClq86B_0 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2724922743662540045', time=2024-09-14T13:18:37.361204+0000, chain.objs.size()=1 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.Osapdq6k7cbscwjBFJdB-WYZ2ygOOQV_0 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4181555183295552236', time=2024-09-14T13:18:37.436011+0000, chain.objs.size()=1 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.5ZEIcSRst0bY6w74h8B41ma6EBVWSFF_0 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7848579712052998427', time=2024-09-14T13:18:42.064424+0000, chain.objs.size()=1 2024-09-14T11:24:10.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.3NemNs0AHKnYXfMOsk5iGIZczHvmVxu_0 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4038219952016228366', time=2024-09-14T13:18:45.883086+0000, chain.objs.size()=1 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.gVmCV6MnRA5UB4oYDxeJ3vql2_DFjMo_0 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4217112091333214754', time=2024-09-14T13:20:01.085248+0000, chain.objs.size()=1 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.ram0W12UyN7AwXLnDw4i1yzT3Tp95Sw_0 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16098860580931629587', time=2024-09-14T13:20:01.187416+0000, chain.objs.size()=1 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.09p12V4VzbDHmaA5h3k4E7KfWJ52Knw_0 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17854328658722686553', time=2024-09-14T13:20:41.217996+0000, chain.objs.size()=1 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.iV6GqDNTHNC5TGYdnOdtyIZttBb4jyn_0 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14415977833771370447', time=2024-09-14T13:20:41.281007+0000, chain.objs.size()=1 2024-09-14T11:24:10.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.UuDLAVXRcqU1vYcvQ87xOlXlJqQ6Ex4_0 2024-09-14T11:24:10.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11739287153563483388', time=2024-09-14T13:21:24.702939+0000, chain.objs.size()=1 2024-09-14T11:24:10.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.327+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.R3fwaHK89szYGSXNuwle5UCcqFjFjDb_0 2024-09-14T11:24:10.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.331+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17687189505915632027', time=2024-09-14T13:23:32.193063+0000, chain.objs.size()=1 2024-09-14T11:24:10.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.331+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18__shadow_.l-7h8S-VsAzkxm_NukukPX0luF6EWad_0 2024-09-14T11:24:10.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.335+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.335+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:24:10.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.398117509001952339', time=2024-09-14T13:14:14.389836+0000, chain.objs.size()=1 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.qtk-eY9msYfchr0ymwvQu7AJjK7jnC-_0 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5748058358941756678', time=2024-09-14T13:14:15.083510+0000, chain.objs.size()=3 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-STANDARD.2~Yhcxtp2WN74l8HZfNktf7Bm256YhsBb.1 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-STANDARD.2~Yhcxtp2WN74l8HZfNktf7Bm256YhsBb.2 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-STANDARD.2~Yhcxtp2WN74l8HZfNktf7Bm256YhsBb.3 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15384382919533868011', time=2024-09-14T13:14:15.419390+0000, chain.objs.size()=1 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9__shadow_.HxnTGi8NdNv2bCqm3aDqCJqdxK7sCBD_0 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6633994945470567031', time=2024-09-14T13:18:02.506165+0000, chain.objs.size()=1 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.nwIXb1ot66oyRtjW7FegjTxXREimsEJ_0 2024-09-14T11:24:10.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7331290947520420566', time=2024-09-14T13:18:37.421089+0000, chain.objs.size()=1 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.GW4ITqRs8GcIoH7Ry_df8h8vfil7DDj_0 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5892226030116728262', time=2024-09-14T13:18:42.129645+0000, chain.objs.size()=1 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.8NC8e5ZhTiyJlm8-1vgV1uMuDIdhPcb_0 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9609432812587840701', time=2024-09-14T13:19:25.429209+0000, chain.objs.size()=1 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.5UxhjKdXapyD_VLBSm7MD2wmDXATQ6w_0 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12462555994616219796', time=2024-09-14T13:20:50.153976+0000, chain.objs.size()=1 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.ijvf6s7PM2DikIJ_0HGSYRyKTl6sFCZ_0 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15973593641069776121', time=2024-09-14T13:21:24.575256+0000, chain.objs.size()=1 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.fhdZvIYzRha4YfgSFmHd1VXdWhZ0fX0_0 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18005528668026533785', time=2024-09-14T13:21:24.617437+0000, chain.objs.size()=1 2024-09-14T11:24:10.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.339+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.0rUAKedB4ZQWIfRDikLFeEQYjcqNlFJ_0 2024-09-14T11:24:10.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.347+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:24:10.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:24:10.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3480511152999843423', time=2024-09-14T13:14:14.645462+0000, chain.objs.size()=4 2024-09-14T11:24:10.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10__multipart_foo.2~iHDC-6vVg8Zu4QNqWj-Eo4aj-601IqY.1 2024-09-14T11:24:10.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10__multipart_foo.2~iHDC-6vVg8Zu4QNqWj-Eo4aj-601IqY.2 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10__multipart_foo.2~iHDC-6vVg8Zu4QNqWj-Eo4aj-601IqY.3 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10__multipart_foo.2~iHDC-6vVg8Zu4QNqWj-Eo4aj-601IqY.4 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18364270164922475387', time=2024-09-14T13:14:15.348349+0000, chain.objs.size()=1 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8__shadow_.ViJVqyKi7MyyaQ0MAQuPoha4lZt_x3b_0 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3737101099966387743', time=2024-09-14T13:15:51.057484+0000, chain.objs.size()=1 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.iHpG5OkU5nHAHHeAlOrSNzhMqsgg8-U_0 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10181685341525513109', time=2024-09-14T13:16:31.869081+0000, chain.objs.size()=1 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.Th5NGWE6VbaZiyp0wGwo4ciP1Ii6nXN_0 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15094706948486027885', time=2024-09-14T13:16:36.440743+0000, chain.objs.size()=1 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.pY_Bu_XwEr5QXzdmQQb9P-XikONJ0DJ_0 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7583565741436445038', time=2024-09-14T13:16:36.512549+0000, chain.objs.size()=1 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.vR5z6DfBD4bYzVOs_0w1JY6-Ax7moZd_0 2024-09-14T11:24:10.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17006381056707219267', time=2024-09-14T13:16:36.513956+0000, chain.objs.size()=1 2024-09-14T11:24:10.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.wifknP0aF9dDQpXkqBJ6i4l_FJBardb_0 2024-09-14T11:24:10.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11702921887700253098', time=2024-09-14T13:17:19.525679+0000, chain.objs.size()=1 2024-09-14T11:24:10.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.I04D03fkmEL6l6YOCOFiL95fekU1was_0 2024-09-14T11:24:10.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8848931132668815208', time=2024-09-14T13:17:19.584299+0000, chain.objs.size()=1 2024-09-14T11:24:10.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.351+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.SbdYciEOjjHi_Rrdk0PcmlEMbsVoaZs_0 2024-09-14T11:24:10.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.355+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1152088122495392314', time=2024-09-14T13:17:19.625459+0000, chain.objs.size()=1 2024-09-14T11:24:10.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.355+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.9v52Y9g6kqCHaV95kHgzHQoBWZ3HwgH_0 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3204138303009025891', time=2024-09-14T13:17:58.017522+0000, chain.objs.size()=1 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.pUqS_7WSywJpmTke8wDphBjAt9V5q5s_0 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7304421791220915494', time=2024-09-14T13:17:58.019625+0000, chain.objs.size()=1 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.kKYT2olkcoTH9Ri28SEvXVToJvbSnXs_0 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8529920782176297406', time=2024-09-14T13:18:46.088800+0000, chain.objs.size()=1 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.Ux9S_oBYLsh4Lun220ewcDc9SM-JkyN_0 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17281305694669962706', time=2024-09-14T13:19:22.027190+0000, chain.objs.size()=1 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.Mdr2MOzGorQN0uUH8BNm0ZzHgKEjYZQ_0 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12087232757656452486', time=2024-09-14T13:19:22.092944+0000, chain.objs.size()=1 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.9dvabOQv9ie3CMyl7Txa7zIt2B5Sd0z_0 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.98649758380517502', time=2024-09-14T13:20:01.191172+0000, chain.objs.size()=1 2024-09-14T11:24:10.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.-wY6nP9x2xHBeDdgYvozuG3T4RUrYGZ_0 2024-09-14T11:24:10.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5432186125091404012', time=2024-09-14T13:20:01.193020+0000, chain.objs.size()=1 2024-09-14T11:24:10.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.WZukgxUg-8tWfAWBka4KxhdjDwcF4Vb_0 2024-09-14T11:24:10.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17180529496373270133', time=2024-09-14T13:20:06.640881+0000, chain.objs.size()=1 2024-09-14T11:24:10.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.ulcBHfQga3kwafpkA26mBAwQmrxK-1r_0 2024-09-14T11:24:10.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18323802030723522011', time=2024-09-14T13:20:06.699828+0000, chain.objs.size()=1 2024-09-14T11:24:10.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.PxTF0v7JqNBD8ROpQcYwjOxDd-FVdc__0 2024-09-14T11:24:10.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.487284854576633857', time=2024-09-14T13:20:45.162294+0000, chain.objs.size()=1 2024-09-14T11:24:10.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.359+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.X1z3M-2NgtCYPYzldgWRyHFVpMec6n1_0 2024-09-14T11:24:10.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.367+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:24:10.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:24:10.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7977657990621562064', time=2024-09-14T13:14:14.461183+0000, chain.objs.size()=4 2024-09-14T11:24:10.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12__multipart_foo.2~MkohyRXQHGWZaoA8vnUmyLmrNuTDv3f.1 2024-09-14T11:24:10.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12__multipart_foo.2~MkohyRXQHGWZaoA8vnUmyLmrNuTDv3f.2 2024-09-14T11:24:10.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12__multipart_foo.2~MkohyRXQHGWZaoA8vnUmyLmrNuTDv3f.3 2024-09-14T11:24:10.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12__multipart_foo.2~MkohyRXQHGWZaoA8vnUmyLmrNuTDv3f.4 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14570808763826336349', time=2024-09-14T13:17:19.578295+0000, chain.objs.size()=1 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.XWrFA_VaLzDjxDmcIvqAUAY_iuJRzvU_0 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16079543097090550059', time=2024-09-14T13:17:23.607625+0000, chain.objs.size()=1 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.rf_04xIUFvp2lpgwRKhJwJGH6yndtgR_0 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8027272275562868907', time=2024-09-14T13:17:57.982730+0000, chain.objs.size()=1 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.zjZCwbbOm2zR-eV9DVMS4UEV6KeeJGY_0 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6746099887267666798', time=2024-09-14T13:18:37.567712+0000, chain.objs.size()=1 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.PXWW92Pz4vSpO60ad8fmEdk7qvhZ-GE_0 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2358395632051307632', time=2024-09-14T13:18:42.111023+0000, chain.objs.size()=1 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.ukxl0MCYUKq5kUIeAGau5P3qfJxWyCM_0 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5762568581413475984', time=2024-09-14T13:18:42.218071+0000, chain.objs.size()=1 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.Pn69ana4JXOcoG7sFttegi1sYnJfXvU_0 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9344477049971082683', time=2024-09-14T13:18:45.854848+0000, chain.objs.size()=1 2024-09-14T11:24:10.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.Hgx1fT5AnvOZYx5h16--8T6692Tf8_y_0 2024-09-14T11:24:10.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14637886206769948185', time=2024-09-14T13:19:26.334971+0000, chain.objs.size()=1 2024-09-14T11:24:10.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.371+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.lqrHuVAyoEI15ZmU6VAw47LfvGHxBo3_0 2024-09-14T11:24:10.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16791867940824055559', time=2024-09-14T13:19:26.437065+0000, chain.objs.size()=1 2024-09-14T11:24:10.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.Amgcv53TWxlcsKR5FneiPsYdi9sJslU_0 2024-09-14T11:24:10.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14615459537412839949', time=2024-09-14T13:20:06.483622+0000, chain.objs.size()=1 2024-09-14T11:24:10.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.3GJJpP3Lnl2lCcOeKpaWR3iLOj0LNRy_0 2024-09-14T11:24:10.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5268658754511447826', time=2024-09-14T13:20:06.765785+0000, chain.objs.size()=1 2024-09-14T11:24:10.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.yFd5VIot_d-Y73brJMPAiK1tFwQZ6ji_0 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3982372151869602327', time=2024-09-14T13:20:41.271197+0000, chain.objs.size()=1 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.S387jf32IEpc06eXJ8KfLQeXaSfYMw6_0 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3801374684713377505', time=2024-09-14T13:20:45.922228+0000, chain.objs.size()=1 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.gZW-2JYqrRyxkZhzhZjseMS5nfFbOcL_0 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12762877574237814227', time=2024-09-14T13:20:46.013682+0000, chain.objs.size()=1 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.Pf6idU9kEb9vO504yuXlT9mXwrVW3-Q_0 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10328226127403727674', time=2024-09-14T13:20:46.193210+0000, chain.objs.size()=1 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.tEv8MvMUTl9QfdkVyjgaW7fT9JnKKfL_0 2024-09-14T11:24:10.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6269465737283379021', time=2024-09-14T13:20:50.125687+0000, chain.objs.size()=1 2024-09-14T11:24:10.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.F2fNc_68DPxXap3ezX8cl0SGWvtBmTU_0 2024-09-14T11:24:10.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10502706652244846360', time=2024-09-14T13:21:24.761772+0000, chain.objs.size()=1 2024-09-14T11:24:10.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.WFoEy4BXsKd124T9S-FmRw8-awJSvu8_0 2024-09-14T11:24:10.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11339153306993564482', time=2024-09-14T13:21:24.788170+0000, chain.objs.size()=1 2024-09-14T11:24:10.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.375+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.BoKAvsY-Xonrn_J-GJT_zXq8Hjzwgtq_0 2024-09-14T11:24:10.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.383+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.387+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:24:10.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.387+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.387+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:24:10.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12656125943045276704', time=2024-09-14T13:14:14.359730+0000, chain.objs.size()=1 2024-09-14T11:24:10.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.-uUCEgeMRuAsZBChpBYztgbnDjZ26Sd_0 2024-09-14T11:24:10.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_C6tGa-AonH7-s6jaAd9EG5MyVy-Wns-', time=2024-09-14T13:14:14.883233+0000, chain.objs.size()=1 2024-09-14T11:24:10.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.4WIGJNExebA6cBY5UQtlzK_Dw7Cl493_0 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.112552195273995136', time=2024-09-14T13:15:55.700734+0000, chain.objs.size()=1 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.93bagqAUbywISss8OKZvaFUTV0W6FAe_0 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3785149867814875821', time=2024-09-14T13:16:31.895798+0000, chain.objs.size()=1 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.5u7ZjdAbV_cDhFlBziO516AsEjVDJXs_0 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1293018028712195462', time=2024-09-14T13:17:14.809569+0000, chain.objs.size()=1 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.vZq6MKiFgvWaKSzXUQ3QL9jts4pqrWj_0 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1336388950011139263', time=2024-09-14T13:17:19.372857+0000, chain.objs.size()=1 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.WVTHRi9JnkqgmDkln92sExsUZaWRTs8_0 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5921242824309396774', time=2024-09-14T13:17:58.182888+0000, chain.objs.size()=1 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.jDnZqKE54hj-BA728bUT3CP7BIHSxKi_0 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5023647651095584339', time=2024-09-14T13:18:37.543558+0000, chain.objs.size()=1 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.IPzh4wNNODUoci0lqD1F0RLmJQm5vVm_0 2024-09-14T11:24:10.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14073697965091384198', time=2024-09-14T13:18:42.031895+0000, chain.objs.size()=1 2024-09-14T11:24:10.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.RITpNRl2yHQir7QikSjNclUnN_thhay_0 2024-09-14T11:24:10.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14478522828831125630', time=2024-09-14T13:18:42.209323+0000, chain.objs.size()=1 2024-09-14T11:24:10.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31__shadow_.c3dRKemEU9p50NgyELzPh53f1tSRbwN_0 2024-09-14T11:24:10.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5893169371230786608', time=2024-09-14T13:20:01.093125+0000, chain.objs.size()=1 2024-09-14T11:24:10.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.edsm0i-tJIZ994dhXO3onCBL61mMlI5_0 2024-09-14T11:24:10.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16734930249837474354', time=2024-09-14T13:20:01.123549+0000, chain.objs.size()=1 2024-09-14T11:24:10.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.391+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.HGxMFvnV3xkjsk0ey4AX6UM7_7xuA2d_0 2024-09-14T11:24:10.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15741065139590302117', time=2024-09-14T13:20:01.284351+0000, chain.objs.size()=1 2024-09-14T11:24:10.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.k7mAol2uPwYl3KC1SArKoJmdAfFBsQQ_0 2024-09-14T11:24:10.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2243900230189789197', time=2024-09-14T13:20:06.586553+0000, chain.objs.size()=1 2024-09-14T11:24:10.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.EDRztKS1v_K44NbGY4mxYLYofFjlx_Y_0 2024-09-14T11:24:10.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3558167969160754491', time=2024-09-14T13:20:06.720821+0000, chain.objs.size()=1 2024-09-14T11:24:10.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.Jzpoxq_ckMfDcfsKzwj55jNfv5ZvDVS_0 2024-09-14T11:24:10.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16264655482207539750', time=2024-09-14T13:20:06.722696+0000, chain.objs.size()=1 2024-09-14T11:24:10.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.of5QXmStYyfHaZha9nTVl5dqISZEI_D_0 2024-09-14T11:24:10.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16073925323952684512', time=2024-09-14T13:20:50.145130+0000, chain.objs.size()=1 2024-09-14T11:24:10.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.395+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.0c6DwsGBKkWClBCNm3yPw8bu_klrkUg_0 2024-09-14T11:24:10.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.399+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:24:10.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4861743451553125415', time=2024-09-14T13:14:14.379030+0000, chain.objs.size()=1 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.BoI2USrSwOnlJpoJIH9kHbGSF9HICmj_0 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13075471219146370121', time=2024-09-14T13:14:14.400046+0000, chain.objs.size()=1 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5__shadow_.-G50GJ2NDzqYqI0WlvNkz9ErDBpoOlA_0 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Wxsh5ToD8e7vVSKrE5TweMnUrc0ZT0J', time=2024-09-14T13:14:14.917177+0000, chain.objs.size()=3 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.H4JZa8ve6y81GhJe5aVwwhb0p3m50Ft_0 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.H4JZa8ve6y81GhJe5aVwwhb0p3m50Ft_1 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.H4JZa8ve6y81GhJe5aVwwhb0p3m50Ft_2 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_a9pABYjvxoN0rM2prVdjKELcW3aClvV', time=2024-09-14T13:14:14.929387+0000, chain.objs.size()=3 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.W_lVNzEHzu1H3KrstiGJ-_e4fuie-Ga_0 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.W_lVNzEHzu1H3KrstiGJ-_e4fuie-Ga_1 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17__shadow_.W_lVNzEHzu1H3KrstiGJ-_e4fuie-Ga_2 2024-09-14T11:24:10.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7609004533584140900', time=2024-09-14T13:14:15.160331+0000, chain.objs.size()=3 2024-09-14T11:24:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.m-2MC78ZvGMZG5A6r6o7v73YD-CHOwX_0 2024-09-14T11:24:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.m-2MC78ZvGMZG5A6r6o7v73YD-CHOwX_1 2024-09-14T11:24:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14__shadow_.m-2MC78ZvGMZG5A6r6o7v73YD-CHOwX_2 2024-09-14T11:24:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10620411536483567221', time=2024-09-14T13:15:51.038632+0000, chain.objs.size()=1 2024-09-14T11:24:10.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.403+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.pPVzrJ7DaDsL7RXhVkmPFxHbRQO4bCa_0 2024-09-14T11:24:10.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16306340759533308066', time=2024-09-14T13:15:55.718877+0000, chain.objs.size()=1 2024-09-14T11:24:10.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.nP3kSrNAXGU29A_INiSRks6_hNqHX-8_0 2024-09-14T11:24:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8685556350586046484', time=2024-09-14T13:15:55.839171+0000, chain.objs.size()=1 2024-09-14T11:24:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.TmwkYrOPrFpRiahnl4EdRhH1qG48-qX_0 2024-09-14T11:24:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12185256966334964294', time=2024-09-14T13:17:19.694047+0000, chain.objs.size()=1 2024-09-14T11:24:10.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.hCmdxeg5D0G4G1EdddfNoJzxSDnz_OQ_0 2024-09-14T11:24:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17389865209856478186', time=2024-09-14T13:18:01.412806+0000, chain.objs.size()=1 2024-09-14T11:24:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.zNPcPrb3RfTt73FbaOygaUtpif7_FXo_0 2024-09-14T11:24:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2191010440117319284', time=2024-09-14T13:18:02.483487+0000, chain.objs.size()=1 2024-09-14T11:24:10.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.407+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.tkPVIgOVdG33HnZTEpABuievwNUe3z-_0 2024-09-14T11:24:10.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.411+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:24:10.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:24:10.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_2k2iCVPPTQ4Ojo0QxgO6eY5bBhkNpKJ', time=2024-09-14T13:14:14.767301+0000, chain.objs.size()=2 2024-09-14T11:24:10.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.Cb3P82SVKTmJ_4qKFWsTXH-IdXFZC_U_0 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.Cb3P82SVKTmJ_4qKFWsTXH-IdXFZC_U_1 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10148464894653361768', time=2024-09-14T13:14:14.802375+0000, chain.objs.size()=2 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.PzBaaSWxhmj3fFfBtFOJdmVKG1pc6W2_0 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.PzBaaSWxhmj3fFfBtFOJdmVKG1pc6W2_1 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11101033904049393320', time=2024-09-14T13:15:51.038341+0000, chain.objs.size()=1 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.GmcE5sUbxBXULuhLb6jgpZfn9Hs9dT2_0 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14918981801102297671', time=2024-09-14T13:15:55.721561+0000, chain.objs.size()=1 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.a8x8aUvQc-Aviy0N6RxoLVUsYqtCTeX_0 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578449815810332688', time=2024-09-14T13:15:59.463178+0000, chain.objs.size()=1 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.UPbRiFLFOhyN73quxUjyv5B2SMw4s2V_0 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5945197775248986014', time=2024-09-14T13:16:31.950678+0000, chain.objs.size()=1 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.LmskDttw9PvQBPk9IuGuiNwX48D5LsK_0 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9218606428404336421', time=2024-09-14T13:16:36.706085+0000, chain.objs.size()=1 2024-09-14T11:24:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.HkoT0i7Sv0kYR2BlmeSgETxTPMjfSda_0 2024-09-14T11:24:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13398927170456924803', time=2024-09-14T13:17:23.545783+0000, chain.objs.size()=1 2024-09-14T11:24:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.3YT4PMA3ipKSMHYu59sfsN_WkbrZNAG_0 2024-09-14T11:24:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.533067575651980981', time=2024-09-14T13:17:23.707385+0000, chain.objs.size()=1 2024-09-14T11:24:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.lUoAcLhEFoEQq3jzNgqSaTVtoV7Wuj9_0 2024-09-14T11:24:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15622509194479505579', time=2024-09-14T13:18:02.482677+0000, chain.objs.size()=1 2024-09-14T11:24:10.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.415+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.q-uX7sUBxQIIgNJ_GmRjNTEych2J5Ql_0 2024-09-14T11:24:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.419+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17438619470258818530', time=2024-09-14T13:19:21.867976+0000, chain.objs.size()=1 2024-09-14T11:24:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.419+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.I_ugsWj66XvKH5GpO5Srh2QPJ0Wfily_0 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2042168912448645097', time=2024-09-14T13:19:21.914899+0000, chain.objs.size()=1 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.BP0P28XDOHPhC-Bq9-1dZsUWQX-b07B_0 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14389131398026658115', time=2024-09-14T13:20:01.279438+0000, chain.objs.size()=1 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.r6O6SoSUbTR4icRz3xsveX3oxIr77bA_0 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15973287463340173293', time=2024-09-14T13:20:06.719689+0000, chain.objs.size()=1 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.PPboHqqiYGz9jfcSB3GENnwBlDY6PHj_0 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1635780189486434616', time=2024-09-14T13:20:46.012914+0000, chain.objs.size()=1 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.Z6bEW9o46mQ_wJmClNWdjFscTfpTbVC_0 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.836308147412000981', time=2024-09-14T13:20:46.017059+0000, chain.objs.size()=1 2024-09-14T11:24:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.423+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.dnMrO3ZHk2Ztc_7kUKtx-RQQRCnmFaE_0 2024-09-14T11:24:10.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.427+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.427+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:24:10.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14350530418834185496', time=2024-09-14T13:14:15.071905+0000, chain.objs.size()=5 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.1 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__shadow_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.1_1 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.2 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__shadow_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.2_1 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15__multipart_foo-FROZEN.2~xkhbbnFWfZD8OwiaZkZDR4LdXDlPqfv.3 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14629933563764407134', time=2024-09-14T13:16:31.884853+0000, chain.objs.size()=1 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.JR1VwHAAyYsLlQvphV-dqz_7_NTGyFz_0 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2694581985375523467', time=2024-09-14T13:16:40.247551+0000, chain.objs.size()=1 2024-09-14T11:24:10.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.v6pnhnhiH1oU3mH_-llswApEPnsdGJT_0 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11602843652820824573', time=2024-09-14T13:16:40.445599+0000, chain.objs.size()=1 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.24__shadow_.ciMTmnHE23K2Qg571wydZBMpgPzxNtf_0 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11392164639149189642', time=2024-09-14T13:17:19.628610+0000, chain.objs.size()=1 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.26__shadow_.7SC0DfMIcUEgmvK3oMN-QFwXmG2ytgH_0 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18291125124806060394', time=2024-09-14T13:17:58.025377+0000, chain.objs.size()=1 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.-7AJaqzWjHgUPkVUbEy3loJkOTZYspz_0 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6058416241128559824', time=2024-09-14T13:18:45.938863+0000, chain.objs.size()=1 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.32__shadow_.G3dszOhIDTrfYNm1VJkYHq57xkTytgc_0 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17770138409590707568', time=2024-09-14T13:20:01.212328+0000, chain.objs.size()=1 2024-09-14T11:24:10.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.431+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.4COVp-nuLNbWikqRKDBZx2kHZPqp93b_0 2024-09-14T11:24:10.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.435+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14347666722684941030', time=2024-09-14T13:20:06.748015+0000, chain.objs.size()=1 2024-09-14T11:24:10.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.435+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.ULzi69kR7fGW7qisOgCE6fT42uJWAgE_0 2024-09-14T11:24:10.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.435+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8423167961268508921', time=2024-09-14T13:21:24.697830+0000, chain.objs.size()=1 2024-09-14T11:24:10.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.435+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.sPMWmsXXq9syPDj_WSp2XZqBUp720F3_0 2024-09-14T11:24:10.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.439+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.439+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:24:10.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:24:10.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5395723102860052709', time=2024-09-14T13:14:15.452500+0000, chain.objs.size()=1 2024-09-14T11:24:10.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9__shadow_.ccaQ98QIRy1euSl2h_-gdhqLIgL31n8_0 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1646325589246550582', time=2024-09-14T13:16:32.010466+0000, chain.objs.size()=1 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22__shadow_.OuWjP1pTVZ_WQpD8y31nL3ZZxPfj489_0 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13291985781829342488', time=2024-09-14T13:16:36.638768+0000, chain.objs.size()=1 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.23__shadow_.wMUt2f16Jy6-VNEO09NtmIHCnrqddFC_0 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13845529673369434435', time=2024-09-14T13:17:23.751736+0000, chain.objs.size()=1 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.ulb_ojG4jbsgjDXNUrz1uyK1V_MiAwJ_0 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2037807143605791978', time=2024-09-14T13:17:58.161929+0000, chain.objs.size()=1 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.28__shadow_.35yRGy9VkdztM4D5zxXlg12aUwMstm3_0 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10982246492749753824', time=2024-09-14T13:18:02.442118+0000, chain.objs.size()=1 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.29__shadow_.cykhuqEFSNrOacOHtoKwqlUwPEA-c6k_0 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1329591724526892573', time=2024-09-14T13:18:37.436024+0000, chain.objs.size()=1 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.rFH6RlfTe3wg88VfqQIikAE-zws7RoM_0 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.807576721669562533', time=2024-09-14T13:19:21.914735+0000, chain.objs.size()=1 2024-09-14T11:24:10.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.33__shadow_.e-GWThFAvar7kVLv_KYlNlDn5huTPSr_0 2024-09-14T11:24:10.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13043040056000763006', time=2024-09-14T13:19:26.324047+0000, chain.objs.size()=1 2024-09-14T11:24:10.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.aXbNSG000k1Hn0qh2oKPwSKmSl-GlwH_0 2024-09-14T11:24:10.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14192423513345474123', time=2024-09-14T13:20:01.087383+0000, chain.objs.size()=1 2024-09-14T11:24:10.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.vMmNeitNPncLCyjaDKad0XYEl1AkIBm_0 2024-09-14T11:24:10.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12860151076887936307', time=2024-09-14T13:20:01.187340+0000, chain.objs.size()=1 2024-09-14T11:24:10.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35__shadow_.BtTvjNThEvck5YANR59EY3o-BstoWlr_0 2024-09-14T11:24:10.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3858703484924994041', time=2024-09-14T13:20:06.643208+0000, chain.objs.size()=1 2024-09-14T11:24:10.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.443+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.Etpu533oRBQAj_KD2oIe2Ivrwm0wOll_0 2024-09-14T11:24:10.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2596757099099057307', time=2024-09-14T13:20:46.025814+0000, chain.objs.size()=1 2024-09-14T11:24:10.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.ZDSWYOGuNMLiUivnaZopq5TMxH3jOu3_0 2024-09-14T11:24:10.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2870882229085599787', time=2024-09-14T13:20:46.027971+0000, chain.objs.size()=1 2024-09-14T11:24:10.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.38__shadow_.o8GAghyw68VQZb3T5bI9v8IW5zveyMo_0 2024-09-14T11:24:10.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9271607087482710172', time=2024-09-14T13:20:50.162225+0000, chain.objs.size()=1 2024-09-14T11:24:10.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.H2ZBzXlbHZ_66fiCTuxCRZCfdKV25TK_0 2024-09-14T11:24:10.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13882053729711160451', time=2024-09-14T13:20:50.164574+0000, chain.objs.size()=1 2024-09-14T11:24:10.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.vP3RZyPB1HVo6rgiuufxFtVeiiwit8G_0 2024-09-14T11:24:10.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10341368304039283377', time=2024-09-14T13:20:50.260240+0000, chain.objs.size()=1 2024-09-14T11:24:10.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.39__shadow_.SkhyJWD61jO_70Iz5wF5mYvPgtYC1C1_0 2024-09-14T11:24:10.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1419105721772214610', time=2024-09-14T13:21:24.596561+0000, chain.objs.size()=1 2024-09-14T11:24:10.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.447+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.CpnwHSB2563uURCm0mFN4_H2ySr7VvO_0 2024-09-14T11:24:10.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.451+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:24:10.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:24:10.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='_uDtu_hrRjZM5r2a1P47Jy9ZZj2jbDks', time=2024-09-14T13:14:14.712377+0000, chain.objs.size()=2 2024-09-14T11:24:10.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.BvKk86B6FqTHEhQd-CBAbUtVAiIxakW_0 2024-09-14T11:24:10.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16__shadow_.BvKk86B6FqTHEhQd-CBAbUtVAiIxakW_1 2024-09-14T11:24:10.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9959737198966029458', time=2024-09-14T13:15:51.010398+0000, chain.objs.size()=1 2024-09-14T11:24:10.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.6ZJeRR0nJ7_7Qu5euRO9ilAk60pVLxE_0 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5989691478504856741', time=2024-09-14T13:15:51.023931+0000, chain.objs.size()=1 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.p-jdf7M9x35FkVvlXgJMyisOk6eb_W-_0 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6670191505845693288', time=2024-09-14T13:15:51.156912+0000, chain.objs.size()=1 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.20__shadow_.yQfzjOKHLdLqNpwDCGAoqxGUp4q7von_0 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.731864370531440222', time=2024-09-14T13:15:55.575961+0000, chain.objs.size()=1 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21__shadow_.FdHEHK7yU8ixIi3xP9O6q-9OWzWqBnR_0 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1115551273493467777', time=2024-09-14T13:17:14.667476+0000, chain.objs.size()=1 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.25__shadow_.eO5iLMZN97aKvuf_4niXKwyEFP6MYtk_0 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16569943066431996969', time=2024-09-14T13:17:23.545721+0000, chain.objs.size()=1 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.27__shadow_.ohj3YWUuaxfQXuNLk-mt34DXy0wUKe0_0 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16596708328807069548', time=2024-09-14T13:18:37.483169+0000, chain.objs.size()=1 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.30__shadow_.CVHShBQmcV_wiM-QNlwepQMh9VvfhQ5_0 2024-09-14T11:24:10.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4116251934358794887', time=2024-09-14T13:19:26.324959+0000, chain.objs.size()=1 2024-09-14T11:24:10.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.34__shadow_.nDNOLcTVZ2dpuWgBQVekSTDCPn5w5VW_0 2024-09-14T11:24:10.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2656141422319406301', time=2024-09-14T13:20:06.729376+0000, chain.objs.size()=1 2024-09-14T11:24:10.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.36__shadow_.aSNfv06guPm5wrdONRpJvv41OjrJVGH_0 2024-09-14T11:24:10.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9232105678530247859', time=2024-09-14T13:20:10.177116+0000, chain.objs.size()=1 2024-09-14T11:24:10.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.455+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.vjIdfozAjHH_Hwz9zd-K7naFXJtt9On_0 2024-09-14T11:24:10.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.459+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7897662016034570851', time=2024-09-14T13:20:41.216699+0000, chain.objs.size()=1 2024-09-14T11:24:10.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.459+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.Mtorf_GsZX5MdMH8ekLGyfCKzOZafvR_0 2024-09-14T11:24:10.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.459+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7201654733301630746', time=2024-09-14T13:20:41.272132+0000, chain.objs.size()=1 2024-09-14T11:24:10.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.459+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37__shadow_.wzTl0JYn5necJymfouk3OVO-RmXuAeD_0 2024-09-14T11:24:10.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.459+0000 7f20a6b4f9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12555833920200734317', time=2024-09-14T13:20:53.492295+0000, chain.objs.size()=1 2024-09-14T11:24:10.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.459+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.40__shadow_.m1h9WDZCvx0ofyxQavsVMDVcU9TaSpa_0 2024-09-14T11:24:10.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.463+0000 7f20a6b4f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:24:10.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.467+0000 7f1f5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:10.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.471+0000 7f20a6b4f9c0 20 remove_watcher() i=0 2024-09-14T11:24:10.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.471+0000 7f20a6b4f9c0 2 removed watcher, disabling cache 2024-09-14T11:24:10.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.471+0000 7f20a6b4f9c0 20 remove_watcher() i=1 2024-09-14T11:24:10.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.471+0000 7f20a6b4f9c0 20 remove_watcher() i=2 2024-09-14T11:24:10.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.471+0000 7f20a6b4f9c0 20 remove_watcher() i=3 2024-09-14T11:24:10.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.475+0000 7f20a6b4f9c0 20 remove_watcher() i=4 2024-09-14T11:24:10.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.475+0000 7f20a6b4f9c0 20 remove_watcher() i=5 2024-09-14T11:24:10.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.475+0000 7f20a6b4f9c0 20 remove_watcher() i=6 2024-09-14T11:24:10.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.475+0000 7f20a6b4f9c0 20 remove_watcher() i=7 2024-09-14T11:24:10.486 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:24:10.548 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:10.549 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:10.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:10.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 20 realm 2024-09-14T11:24:10.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:10.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:10.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:10.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.591+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.595+0000 7fb58c6c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:10.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.595+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.595+0000 7fb58c6c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:10.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.595+0000 7fb58c6c89c0 20 searching for the correct realm 2024-09-14T11:24:10.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.599+0000 7fb5899cd640 0 -- 172.21.15.148:0/3797658913 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fb58402e070 msgr2=0x7fb584060fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:10.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.811+0000 7fb58a9cf640 0 -- 172.21.15.148:0/3797658913 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55964fe917c0 msgr2=0x55964fe93c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:10.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:10.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:24:10.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:10.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:10.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:10.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:24:10.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:10.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 zone default found 2024-09-14T11:24:10.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 4 Realm: () 2024-09-14T11:24:10.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:24:10.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:24:10.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:10.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 zonegroup default 2024-09-14T11:24:10.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.823+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.827+0000 7fb58c6c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:10.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.827+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.827+0000 7fb58c6c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:10.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.827+0000 7fb58c6c89c0 20 rados->read ofs=0 len=0 2024-09-14T11:24:10.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.827+0000 7fb58c6c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:10.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.827+0000 7fb58c6c89c0 20 started sync module instance, tier type = 2024-09-14T11:24:10.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.827+0000 7fb58c6c89c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:24:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.847+0000 7fb58c6c89c0 20 add_watcher() i=0 2024-09-14T11:24:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.851+0000 7fb58c6c89c0 20 add_watcher() i=1 2024-09-14T11:24:10.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.851+0000 7fb58c6c89c0 20 add_watcher() i=2 2024-09-14T11:24:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.851+0000 7fb58c6c89c0 20 add_watcher() i=3 2024-09-14T11:24:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.851+0000 7fb58c6c89c0 20 add_watcher() i=4 2024-09-14T11:24:10.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.851+0000 7fb58c6c89c0 20 add_watcher() i=5 2024-09-14T11:24:10.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.851+0000 7fb58c6c89c0 20 add_watcher() i=6 2024-09-14T11:24:10.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.851+0000 7fb58c6c89c0 20 add_watcher() i=7 2024-09-14T11:24:10.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.851+0000 7fb58c6c89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:10.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.855+0000 7fb4417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:10.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.855+0000 7fb58c6c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:10.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.855+0000 7fb58c6c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:10.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.951+0000 7fb43b7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:10.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.951+0000 7fb58c6c89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:24:10.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.951+0000 7fb58c6c89c0 20 Filter name: none 2024-09-14T11:24:10.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.951+0000 7fb4397fa640 20 reqs_thread_entry: start 2024-09-14T11:24:10.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.951+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:24:10.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.955+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.955+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.955+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.959+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:24:10.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.963+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.967+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.967+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.967+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:24:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.971+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.971+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.971+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.975+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:24:10.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.979+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.979+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.979+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.983+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:24:10.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.987+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.987+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.987+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.991+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:24:10.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.995+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.995+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.995+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.999+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:24:10.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:10.999+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:10.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.003+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:10.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.003+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.007+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:24:11.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.011+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.011+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.011+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.015+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:24:11.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.019+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.019+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.019+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.023+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:24:11.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.027+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.027+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.027+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.031+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:24:11.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.035+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.035+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.035+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.039+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:24:11.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.039+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.043+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.043+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.043+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:24:11.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.047+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.047+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.047+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.051+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:24:11.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.055+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.055+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.055+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.059+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:24:11.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.063+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.063+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.067+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.067+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:24:11.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.071+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.075+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.075+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.079+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:24:11.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.083+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.083+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.083+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.087+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:24:11.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.091+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.091+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.091+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.095+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:24:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.099+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.099+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.103+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.103+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:24:11.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.107+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.111+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.111+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.111+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:24:11.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.115+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.119+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.119+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.123+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:24:11.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.127+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.127+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.127+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.131+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:24:11.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.135+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.135+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.135+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.139+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:24:11.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.143+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.143+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.147+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.147+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:24:11.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.151+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.155+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.155+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.159+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:24:11.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.163+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.163+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.163+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.167+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:24:11.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.171+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.171+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.171+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.175+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:24:11.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.179+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.179+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.179+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.183+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:24:11.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.187+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.187+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.191+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.191+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:24:11.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.195+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.199+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.199+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.199+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:24:11.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.203+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.207+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.207+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.207+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:24:11.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.211+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.215+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:24:11.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.215+0000 7fb58c6c89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:24:11.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.219+0000 7fb4417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:11.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.223+0000 7fb58c6c89c0 20 remove_watcher() i=0 2024-09-14T11:24:11.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.223+0000 7fb58c6c89c0 2 removed watcher, disabling cache 2024-09-14T11:24:11.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.227+0000 7fb58c6c89c0 20 remove_watcher() i=1 2024-09-14T11:24:11.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.227+0000 7fb58c6c89c0 20 remove_watcher() i=2 2024-09-14T11:24:11.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.231+0000 7fb58c6c89c0 20 remove_watcher() i=3 2024-09-14T11:24:11.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.231+0000 7fb58c6c89c0 20 remove_watcher() i=4 2024-09-14T11:24:11.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.235+0000 7fb58c6c89c0 20 remove_watcher() i=5 2024-09-14T11:24:11.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.239+0000 7fb58c6c89c0 20 remove_watcher() i=6 2024-09-14T11:24:11.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:24:11.239+0000 7fb58c6c89c0 20 remove_watcher() i=7 2024-09-14T11:24:11.257 DEBUG:teuthology.orchestra.run.smithi148:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:24:11.886 INFO:teuthology.orchestra.run.smithi148.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:24:16.286 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:24:34.285 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :compileJava 2024-09-14T11:24:34.285 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :processResources 2024-09-14T11:24:34.285 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :classes 2024-09-14T11:24:35.084 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:35.085 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :compileTestJava 2024-09-14T11:24:35.085 INFO:teuthology.orchestra.run.smithi148.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:24:35.085 INFO:teuthology.orchestra.run.smithi148.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:24:35.086 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:35.086 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:24:35.086 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :testClasses 2024-09-14T11:24:41.585 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:41.585 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :test 2024-09-14T11:24:41.585 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:24:41.585 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:25:01.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:01.785 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:25:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:02.584 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:25:02.884 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:02.884 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:25:03.684 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:03.685 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:25:24.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:24.784 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:25:25.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:25.584 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:25:25.684 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:25.684 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:25:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:25.884 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:25:26.084 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:26.084 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:25:26.884 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:26.885 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:25:39.885 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:39.885 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:25:41.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:41.484 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:25:41.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:25:41.985 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:25:41.985 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:25:41,953 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:26:40.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:40.985 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:26:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:42.484 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:26:42.684 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:42.684 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:26:43.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:43.484 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:26:43.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:43.784 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:26:45.084 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:45.084 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:26:58.184 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:58.184 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:26:59.184 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:59.184 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:26:59.284 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:59.284 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:26:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:26:59.484 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:27:15.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:27:15.485 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STANDARD_OUT 2024-09-14T11:27:15.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:27:15,462 [s3-transfer-manager-worker-2] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:27:15.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:27:15,467 [s3-transfer-manager-worker-4] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:27:15.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:27:15,470 [s3-transfer-manager-worker-3] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:27:15.486 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:27:15,477 [s3-transfer-manager-worker-5] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:27:15.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:27:15.584 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:27:17.284 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:27:17.285 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-14T11:27:17.285 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:27:17,187 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:27:17.285 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:27:17,231 [s3-transfer-manager-worker-8] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:27:17.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:27:17.784 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:27:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:27:33.585 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:27:34.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:27:34.784 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:27:41.084 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:27:41.084 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:27:41.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:27:41.984 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:30:40.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:30:40.485 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:30:41.383 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:30:41.384 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:30:57.184 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:30:57.184 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:30:57.983 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:30:57.984 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:31:09.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:09.784 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:31:10.683 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:10.684 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:31:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:15.784 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:31:37.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:37.584 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:31:37.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:37.784 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:31:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:38.684 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:31:38.984 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:38.984 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:31:39.884 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:39.884 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:31:40.184 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:40.184 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:31:41.084 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:41.084 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:31:41.283 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:41.283 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:31:42.284 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:42.284 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:31:42.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:42.484 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:31:43.283 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:43.284 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:31:43.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:43.584 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:31:44.483 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:44.484 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:31:44.784 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:44.784 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:31:45.584 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:31:45.584 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:32:13.683 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:13.684 INFO:teuthology.orchestra.run.smithi148.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:32:14.683 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:14.683 INFO:teuthology.orchestra.run.smithi148.stdout:---------------------------------------------------------------------- 2024-09-14T11:32:14.684 INFO:teuthology.orchestra.run.smithi148.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:32:14.684 INFO:teuthology.orchestra.run.smithi148.stdout:---------------------------------------------------------------------- 2024-09-14T11:32:14.727 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:32:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:32:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:32:14.728 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:BUILD SUCCESSFUL in 8m 3s 2024-09-14T11:32:14.728 INFO:teuthology.orchestra.run.smithi148.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:32:15.052 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:32:15.084 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:15.084 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:15.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.132+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 realm 2024-09-14T11:32:15.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:15.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:15.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.136+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.140+0000 7f8dce2019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:15.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.140+0000 7f8dce2019c0 20 searching for the correct realm 2024-09-14T11:32:15.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.144+0000 7f8dcb506640 0 -- 172.21.15.148:0/3402271325 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f8dc4106f00 msgr2=0x7f8dc411da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:15.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.148+0000 7f8dcbd07640 0 -- 172.21.15.148:0/3402271325 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f8dc40c3bb0 msgr2=0x7f8dc41068d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:15.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:15.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:32:15.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:15.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:15.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:15.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:32:15.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:15.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 zone default found 2024-09-14T11:32:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 4 Realm: () 2024-09-14T11:32:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:32:15.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:32:15.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:15.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 zonegroup default 2024-09-14T11:32:15.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.160+0000 7f8dce2019c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.164+0000 7f8dce2019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.164+0000 7f8dce2019c0 20 started sync module instance, tier type = 2024-09-14T11:32:15.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.164+0000 7f8dce2019c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:32:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.180+0000 7f8dce2019c0 20 add_watcher() i=0 2024-09-14T11:32:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.180+0000 7f8dce2019c0 20 add_watcher() i=1 2024-09-14T11:32:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.180+0000 7f8dce2019c0 20 add_watcher() i=2 2024-09-14T11:32:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.180+0000 7f8dce2019c0 20 add_watcher() i=3 2024-09-14T11:32:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.180+0000 7f8dce2019c0 20 add_watcher() i=4 2024-09-14T11:32:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.180+0000 7f8dce2019c0 20 add_watcher() i=5 2024-09-14T11:32:15.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.180+0000 7f8dce2019c0 20 add_watcher() i=6 2024-09-14T11:32:15.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.184+0000 7f8dce2019c0 20 add_watcher() i=7 2024-09-14T11:32:15.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.184+0000 7f8dce2019c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:15.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.188+0000 7f8c81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:15.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.188+0000 7f8dce2019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:15.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.188+0000 7f8dce2019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:15.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.260+0000 7f8c80fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:15.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.260+0000 7f8dce2019c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:15.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.260+0000 7f8dce2019c0 20 Filter name: none 2024-09-14T11:32:15.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.260+0000 7f8bfa7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:15.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.260+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:15.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:30.931696+0000, chain.objs.size()=1 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.16 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:31.053872+0000, chain.objs.size()=1 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.17 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:31.115358+0000, chain.objs.size()=1 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.18 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:31.346937+0000, chain.objs.size()=1 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.19 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:31.870614+0000, chain.objs.size()=1 2024-09-14T11:32:15.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.20 2024-09-14T11:32:15.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:32.280662+0000, chain.objs.size()=62 2024-09-14T11:32:15.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.1 2024-09-14T11:32:15.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.2 2024-09-14T11:32:15.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.3 2024-09-14T11:32:15.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.264+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.4 2024-09-14T11:32:15.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.268+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.5 2024-09-14T11:32:15.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.268+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.6 2024-09-14T11:32:15.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.268+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.7 2024-09-14T11:32:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.272+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.8 2024-09-14T11:32:15.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.9 2024-09-14T11:32:15.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.10 2024-09-14T11:32:15.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.11 2024-09-14T11:32:15.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.12 2024-09-14T11:32:15.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.13 2024-09-14T11:32:15.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.14 2024-09-14T11:32:15.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.15 2024-09-14T11:32:15.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.WuLfKPQVY5BKuGlYASOJABLK6LtAR1ju.16 2024-09-14T11:32:15.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.q1PUa4Ol1S8LBI9BPjSFxdU3Zk6rQ0c8.17 2024-09-14T11:32:15.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.276+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2nGA2VvPfT5RtvSFELO06iwsmUFcDAMF.18 2024-09-14T11:32:15.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.284+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.uPYbL93mV9OnlIiXGF7KyrJ9UrTR8LfL.19 2024-09-14T11:32:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.288+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.sVA8AcN69S6NBDC00anxaxBwT2bzpZaL.20 2024-09-14T11:32:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.288+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.21 2024-09-14T11:32:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.288+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.22 2024-09-14T11:32:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.288+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.23 2024-09-14T11:32:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.288+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.24 2024-09-14T11:32:15.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.288+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.25 2024-09-14T11:32:15.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.288+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.26 2024-09-14T11:32:15.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.288+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.27 2024-09-14T11:32:15.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.296+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.28 2024-09-14T11:32:15.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.296+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.29 2024-09-14T11:32:15.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.296+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.30 2024-09-14T11:32:15.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.296+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.31 2024-09-14T11:32:15.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.296+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.32 2024-09-14T11:32:15.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.300+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.33 2024-09-14T11:32:15.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.300+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.34 2024-09-14T11:32:15.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.300+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.35 2024-09-14T11:32:15.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.300+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.36 2024-09-14T11:32:15.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.300+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.37 2024-09-14T11:32:15.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.300+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.38 2024-09-14T11:32:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.304+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.39 2024-09-14T11:32:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.304+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.40 2024-09-14T11:32:15.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.304+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.41 2024-09-14T11:32:15.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.308+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.42 2024-09-14T11:32:15.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.308+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.43 2024-09-14T11:32:15.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.308+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.44 2024-09-14T11:32:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.312+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.45 2024-09-14T11:32:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.312+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.46 2024-09-14T11:32:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.312+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.47 2024-09-14T11:32:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.312+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.48 2024-09-14T11:32:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.312+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.49 2024-09-14T11:32:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.312+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.50 2024-09-14T11:32:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.312+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.51 2024-09-14T11:32:15.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.312+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.52 2024-09-14T11:32:15.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.316+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.53 2024-09-14T11:32:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.54 2024-09-14T11:32:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.55 2024-09-14T11:32:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.56 2024-09-14T11:32:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.57 2024-09-14T11:32:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.58 2024-09-14T11:32:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.59 2024-09-14T11:32:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.60 2024-09-14T11:32:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.61 2024-09-14T11:32:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.62 2024-09-14T11:32:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:34.534572+0000, chain.objs.size()=12 2024-09-14T11:32:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.320+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.63 2024-09-14T11:32:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.324+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.64 2024-09-14T11:32:15.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.324+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.65 2024-09-14T11:32:15.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.66 2024-09-14T11:32:15.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.67 2024-09-14T11:32:15.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.68 2024-09-14T11:32:15.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.69 2024-09-14T11:32:15.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.70 2024-09-14T11:32:15.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.71 2024-09-14T11:32:15.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.72 2024-09-14T11:32:15.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.73 2024-09-14T11:32:15.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.75 2024-09-14T11:32:15.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:36.146687+0000, chain.objs.size()=7 2024-09-14T11:32:15.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.74 2024-09-14T11:32:15.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.332+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.76 2024-09-14T11:32:15.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.336+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.77 2024-09-14T11:32:15.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.336+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.78 2024-09-14T11:32:15.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.336+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.79 2024-09-14T11:32:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.336+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.80 2024-09-14T11:32:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.336+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.81 2024-09-14T11:32:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.336+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:36.952501+0000, chain.objs.size()=8 2024-09-14T11:32:15.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.336+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.82 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.83 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.84 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.85 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.86 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.87 2024-09-14T11:32:15.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.88 2024-09-14T11:32:15.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.89 2024-09-14T11:32:15.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BON0EuPonckoFlj2QNf9RuSmMWENS_8', time=2024-09-14T13:31:37.162204+0000, chain.objs.size()=3 2024-09-14T11:32:15.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.90 2024-09-14T11:32:15.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.344+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.91 2024-09-14T11:32:15.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.348+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59__multipart_key1.2~BON0EuPonckoFlj2QNf9RuSmMWENS_8.92 2024-09-14T11:32:15.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.352+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:15.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF', time=2024-09-14T13:25:01.730369+0000, chain.objs.size()=9 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__multipart_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.1 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__shadow_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.1_1 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__multipart_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.2 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__shadow_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.2_1 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__multipart_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.3 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__shadow_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.3_1 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__multipart_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.4 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__shadow_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.4_1 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.41__multipart_key1.2~7hboMduxx0LGnlNCGqTYN6r4J11P9PF.5 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1811199294433090541', time=2024-09-14T13:26:27.506900+0000, chain.objs.size()=9 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.1 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.1_1 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.356+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.2 2024-09-14T11:32:15.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.364+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.2_1 2024-09-14T11:32:15.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.364+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.3 2024-09-14T11:32:15.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.364+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.3_1 2024-09-14T11:32:15.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.364+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.4 2024-09-14T11:32:15.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.364+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.4_1 2024-09-14T11:32:15.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.364+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~6y7eJB4dcW-J6jbzKlKv5DSQn7I291d.5 2024-09-14T11:32:15.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.368+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.372+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:15.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14367319137139171797', time=2024-09-14T13:30:57.403956+0000, chain.objs.size()=9 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__multipart_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.1 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__shadow_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.1_1 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__multipart_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.2 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__shadow_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.2_1 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__multipart_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.3 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__shadow_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.3_1 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__multipart_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.4 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__shadow_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.4_1 2024-09-14T11:32:15.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.376+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__multipart_key1.2~HkzI7YKAVJXbNGfl-jmBaA4e6ydBG3_.5 2024-09-14T11:32:15.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.380+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.384+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:15.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.388+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.388+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.388+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.388+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:15.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.388+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.392+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.392+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.392+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2262150161490608859', time=2024-09-14T13:31:39.240532+0000, chain.objs.size()=1 2024-09-14T11:32:15.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.392+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.61__shadow_.aAWAoKG1pJYPhws2Dz-NAKgkLx8Eccc_0 2024-09-14T11:32:15.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.392+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13299272852166952090', time=2024-09-14T13:31:43.829070+0000, chain.objs.size()=1 2024-09-14T11:32:15.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.392+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.65__shadow_.bvdNswAkfXHQEBNTvhdFTB9Uqx42lml_0 2024-09-14T11:32:15.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.392+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.396+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:15.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.396+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18132445429406489437', time=2024-09-14T13:26:32.115869+0000, chain.objs.size()=9 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.1 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.1_1 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.2 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.2_1 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.3 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.3_1 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.4 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.4_1 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~E0gETzgqQigJs5VoXN6r07woiJfgjNO.5 2024-09-14T11:32:15.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5631629268214739446', time=2024-09-14T13:27:34.087221+0000, chain.objs.size()=1 2024-09-14T11:32:15.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.400+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_.BPSxzqezDjbTbha8FzTeHkPM0h_yMeI_0 2024-09-14T11:32:15.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.404+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.408+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:15.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.408+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.408+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.408+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:15.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.408+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12510687016027058680', time=2024-09-14T13:31:42.708659+0000, chain.objs.size()=1 2024-09-14T11:32:15.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.408+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.64__shadow_.xzi4omJZqhSGzU8sND6tUdQI_K-J5sQ_0 2024-09-14T11:32:15.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.412+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.412+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:15.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3400007807808309171', time=2024-09-14T13:26:22.039394+0000, chain.objs.size()=9 2024-09-14T11:32:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.1 2024-09-14T11:32:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.1_1 2024-09-14T11:32:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.2 2024-09-14T11:32:15.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.2_1 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.3 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.3_1 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.4 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.4_1 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~jIDFdNL8AH1XUcNRdDAjxkoINMFnvQd.5 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3819947892142406781', time=2024-09-14T13:26:41.226691+0000, chain.objs.size()=6 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.47__shadow_.yNA5r-6y9KlGg4dl25skvxHoXiBc5F9_0 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.47__shadow_.yNA5r-6y9KlGg4dl25skvxHoXiBc5F9_1 2024-09-14T11:32:15.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.416+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.47__shadow_.yNA5r-6y9KlGg4dl25skvxHoXiBc5F9_2 2024-09-14T11:32:15.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.420+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.47__shadow_.yNA5r-6y9KlGg4dl25skvxHoXiBc5F9_3 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.47__shadow_.yNA5r-6y9KlGg4dl25skvxHoXiBc5F9_4 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.47__shadow_.yNA5r-6y9KlGg4dl25skvxHoXiBc5F9_5 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2803329546439205892', time=2024-09-14T13:32:13.971744+0000, chain.objs.size()=21 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.1 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.1_1 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.2 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.2_1 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.3 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.3_1 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.4 2024-09-14T11:32:15.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.4_1 2024-09-14T11:32:15.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.424+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.5 2024-09-14T11:32:15.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.428+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.5_1 2024-09-14T11:32:15.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.428+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.6 2024-09-14T11:32:15.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.6_1 2024-09-14T11:32:15.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.7 2024-09-14T11:32:15.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.7_1 2024-09-14T11:32:15.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.8 2024-09-14T11:32:15.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.8_1 2024-09-14T11:32:15.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.9 2024-09-14T11:32:15.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.9_1 2024-09-14T11:32:15.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.10 2024-09-14T11:32:15.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__shadow_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.10_1 2024-09-14T11:32:15.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.432+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.67__multipart_key1.2~qdz2nN8AO-4UzVcdqyx0mR-09P3HP1c.11 2024-09-14T11:32:15.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.440+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.444+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:15.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.444+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.444+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.444+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.444+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:15.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15783642338279265341', time=2024-09-14T13:30:40.395941+0000, chain.objs.size()=16 2024-09-14T11:32:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.1 2024-09-14T11:32:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.1_1 2024-09-14T11:32:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.1_2 2024-09-14T11:32:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.2 2024-09-14T11:32:15.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.2_1 2024-09-14T11:32:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.2_2 2024-09-14T11:32:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.3 2024-09-14T11:32:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.3_1 2024-09-14T11:32:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.3_2 2024-09-14T11:32:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.4 2024-09-14T11:32:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.4_1 2024-09-14T11:32:15.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.448+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.4_2 2024-09-14T11:32:15.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.452+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.5 2024-09-14T11:32:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.452+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.5_1 2024-09-14T11:32:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.452+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.5_2 2024-09-14T11:32:15.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.452+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hBu-JMcY2LtN9Vprge2-I9bTAl8_47M.6 2024-09-14T11:32:15.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.460+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.460+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:15.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.464+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.464+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.464+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.464+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:15.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.464+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.464+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:15.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17182837028560162141', time=2024-09-14T13:26:36.570255+0000, chain.objs.size()=7 2024-09-14T11:32:15.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~teHVxQ5uWmrIXnotLytayp2QkvYkIHT.1 2024-09-14T11:32:15.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~teHVxQ5uWmrIXnotLytayp2QkvYkIHT.1_1 2024-09-14T11:32:15.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~teHVxQ5uWmrIXnotLytayp2QkvYkIHT.1_2 2024-09-14T11:32:15.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~teHVxQ5uWmrIXnotLytayp2QkvYkIHT.2 2024-09-14T11:32:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~teHVxQ5uWmrIXnotLytayp2QkvYkIHT.2_1 2024-09-14T11:32:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~teHVxQ5uWmrIXnotLytayp2QkvYkIHT.2_2 2024-09-14T11:32:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.468+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~teHVxQ5uWmrIXnotLytayp2QkvYkIHT.3 2024-09-14T11:32:15.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.472+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.472+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:15.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.476+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.476+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.476+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.476+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.480+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.480+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.480+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.480+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:15.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11851820027775886077', time=2024-09-14T13:25:40.874503+0000, chain.objs.size()=9 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.1 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__shadow_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.1_1 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.2 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__shadow_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.2_1 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.3 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__shadow_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.3_1 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.4 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__shadow_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.4_1 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.5 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15026028357122064302', time=2024-09-14T13:27:33.799633+0000, chain.objs.size()=9 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__multipart_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.1 2024-09-14T11:32:15.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.1_1 2024-09-14T11:32:15.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.484+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__multipart_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.2 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.2_1 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__multipart_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.3 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.3_1 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__multipart_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.4 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.4_1 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__multipart_file.mpg.2~nSgcAnzzNPY8sFLZSghebzBX0lgWSn5.5 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8271046556157766162', time=2024-09-14T13:30:40.772864+0000, chain.objs.size()=16 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.1 2024-09-14T11:32:15.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.1_1 2024-09-14T11:32:15.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.1_2 2024-09-14T11:32:15.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.2 2024-09-14T11:32:15.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.488+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.2_1 2024-09-14T11:32:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.2_2 2024-09-14T11:32:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.3 2024-09-14T11:32:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.3_1 2024-09-14T11:32:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.3_2 2024-09-14T11:32:15.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.4 2024-09-14T11:32:15.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.4_1 2024-09-14T11:32:15.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.4_2 2024-09-14T11:32:15.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.5 2024-09-14T11:32:15.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.5_1 2024-09-14T11:32:15.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.5_2 2024-09-14T11:32:15.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.496+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~z_bFZ_ua-it3OejQLWTv8VLKtgodj7R.6 2024-09-14T11:32:15.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.504+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.508+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:15.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.508+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.508+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.508+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.508+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:15.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7156922603807965694', time=2024-09-14T13:29:02.957201+0000, chain.objs.size()=21 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.1 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.1_1 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.2 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.2_1 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.3 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.3_1 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.4 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.4_1 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.5 2024-09-14T11:32:15.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.5_1 2024-09-14T11:32:15.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.6 2024-09-14T11:32:15.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.512+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.6_1 2024-09-14T11:32:15.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.516+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.7 2024-09-14T11:32:15.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.516+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.7_1 2024-09-14T11:32:15.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.516+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.8 2024-09-14T11:32:15.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.520+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.8_1 2024-09-14T11:32:15.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.520+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.9 2024-09-14T11:32:15.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.520+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.9_1 2024-09-14T11:32:15.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.520+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.10 2024-09-14T11:32:15.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.520+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.10_1 2024-09-14T11:32:15.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.520+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hD-fDdIZx-lA5HTIYOZgVqSBv3EiCRF.11 2024-09-14T11:32:15.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.524+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.528+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:15.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.528+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.528+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.528+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.528+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6130649718842619965', time=2024-09-14T13:29:52.677273+0000, chain.objs.size()=16 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.528+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.1 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.528+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.1_1 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.1_2 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.2 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.2_1 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.2_2 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.3 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.3_1 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.3_2 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.4 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.4_1 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.4_2 2024-09-14T11:32:15.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.532+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.5 2024-09-14T11:32:15.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.536+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.5_1 2024-09-14T11:32:15.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.536+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.5_2 2024-09-14T11:32:15.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.536+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~7Vp5kElN4bl51ALr85liThQ58BikBXL.6 2024-09-14T11:32:15.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.536+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7321580966239080625', time=2024-09-14T13:31:40.414029+0000, chain.objs.size()=1 2024-09-14T11:32:15.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.536+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.62__shadow_.mVWqheVJsQS7fPrP4ndvPUKAZnCbP9Z_0 2024-09-14T11:32:15.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.540+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.544+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.544+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.544+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.544+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:15.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8C0Vr-aa-2TweZM5_EeJvV_5Z57xRjo', time=2024-09-14T13:27:41.625109+0000, chain.objs.size()=5 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.55__multipart_key1.2~8C0Vr-aa-2TweZM5_EeJvV_5Z57xRjo.7 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.55__shadow_key1.2~8C0Vr-aa-2TweZM5_EeJvV_5Z57xRjo.7_1 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.55__multipart_key1.2~8C0Vr-aa-2TweZM5_EeJvV_5Z57xRjo.10 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.55__shadow_key1.2~8C0Vr-aa-2TweZM5_EeJvV_5Z57xRjo.10_1 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.55__multipart_key1.2~8C0Vr-aa-2TweZM5_EeJvV_5Z57xRjo.13 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7039035701725849459', time=2024-09-14T13:28:36.083341+0000, chain.objs.size()=21 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.1 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.1_1 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.2 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.2_1 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.3 2024-09-14T11:32:15.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.3_1 2024-09-14T11:32:15.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.548+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.4 2024-09-14T11:32:15.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.552+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.4_1 2024-09-14T11:32:15.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.552+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.5 2024-09-14T11:32:15.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.552+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.5_1 2024-09-14T11:32:15.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.6 2024-09-14T11:32:15.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.6_1 2024-09-14T11:32:15.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.7 2024-09-14T11:32:15.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.7_1 2024-09-14T11:32:15.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.8 2024-09-14T11:32:15.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.8_1 2024-09-14T11:32:15.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.9 2024-09-14T11:32:15.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.9_1 2024-09-14T11:32:15.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.10 2024-09-14T11:32:15.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.556+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.10_1 2024-09-14T11:32:15.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.560+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~hvZhhkVhhcymJ7oLLdiCN-0b8aMJBWA.11 2024-09-14T11:32:15.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.564+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.568+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.568+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.572+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.572+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.572+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:15.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.572+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.572+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:15.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15007178837252232069', time=2024-09-14T13:25:40.161835+0000, chain.objs.size()=9 2024-09-14T11:32:15.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.1 2024-09-14T11:32:15.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__shadow_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.1_1 2024-09-14T11:32:15.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.2 2024-09-14T11:32:15.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__shadow_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.2_1 2024-09-14T11:32:15.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.3 2024-09-14T11:32:15.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__shadow_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.3_1 2024-09-14T11:32:15.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.4 2024-09-14T11:32:15.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__shadow_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.4_1 2024-09-14T11:32:15.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.45__multipart_key1.2~hdXMq7V6_S28XCAyAPY0VLHnnBN8qWZ.5 2024-09-14T11:32:15.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9599576221450574450', time=2024-09-14T13:27:33.905402+0000, chain.objs.size()=1 2024-09-14T11:32:15.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.576+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_.aJPr-GdWbywzRSJhfxKziVGu7PgEW89_0 2024-09-14T11:32:15.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.580+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.584+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:15.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.588+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.588+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.588+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.588+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12549041187287452109', time=2024-09-14T13:27:34.183363+0000, chain.objs.size()=1 2024-09-14T11:32:15.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.588+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_.Q0nmEoScNFwNe5a3dMYST8LqkQt2GHn_0 2024-09-14T11:32:15.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.588+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16607250024128920895', time=2024-09-14T13:31:38.066221+0000, chain.objs.size()=1 2024-09-14T11:32:15.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.588+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.60__shadow_.7hvOSMyXUG6EYDqI71CWEvWRZzgUSHH_0 2024-09-14T11:32:15.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.588+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.592+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:15.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.592+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.592+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.592+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.596+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:15.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.596+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.596+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.596+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:15.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5345476379035286948', time=2024-09-14T13:26:41.886934+0000, chain.objs.size()=7 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~QqNC6NB5CfHiDIpM_MkcGEsOjx2j55b.1 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~QqNC6NB5CfHiDIpM_MkcGEsOjx2j55b.1_1 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~QqNC6NB5CfHiDIpM_MkcGEsOjx2j55b.1_2 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~QqNC6NB5CfHiDIpM_MkcGEsOjx2j55b.2 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~QqNC6NB5CfHiDIpM_MkcGEsOjx2j55b.2_1 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~QqNC6NB5CfHiDIpM_MkcGEsOjx2j55b.2_2 2024-09-14T11:32:15.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~QqNC6NB5CfHiDIpM_MkcGEsOjx2j55b.3 2024-09-14T11:32:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6663561218456661006', time=2024-09-14T13:30:53.105145+0000, chain.objs.size()=1 2024-09-14T11:32:15.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.600+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.57__shadow_.FJ1wM2MU4u5RU7HG7jYCmsJ3jBvSY75_0 2024-09-14T11:32:15.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.604+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.608+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:15.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.608+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.658077253549550053', time=2024-09-14T13:27:33.988110+0000, chain.objs.size()=2 2024-09-14T11:32:15.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_.fwQ_UsaykwQI8wffbvVWBW_5lNlYcrr_0 2024-09-14T11:32:15.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.54__shadow_.fwQ_UsaykwQI8wffbvVWBW_5lNlYcrr_1 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5531901956384352457', time=2024-09-14T13:31:10.012882+0000, chain.objs.size()=9 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__multipart_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.1 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__shadow_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.1_1 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__multipart_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.2 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__shadow_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.2_1 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__multipart_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.3 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__shadow_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.3_1 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__multipart_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.4 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__shadow_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.4_1 2024-09-14T11:32:15.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.612+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.58__multipart_key1.2~H2KYF87jzc84PatcBylJXkHeJEkA4CZ.5 2024-09-14T11:32:15.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.616+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:15.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:15.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18061482685693048851', time=2024-09-14T13:26:58.563481+0000, chain.objs.size()=9 2024-09-14T11:32:15.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__multipart_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.1 2024-09-14T11:32:15.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__shadow_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.1_1 2024-09-14T11:32:15.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__multipart_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.2 2024-09-14T11:32:15.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__shadow_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.2_1 2024-09-14T11:32:15.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__multipart_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.3 2024-09-14T11:32:15.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__shadow_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.3_1 2024-09-14T11:32:15.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__multipart_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.4 2024-09-14T11:32:15.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__shadow_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.4_1 2024-09-14T11:32:15.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.620+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.52__multipart_key1.2~dchTt_iUb_Y_yGf8dGHWfIkcnvHIcyw.5 2024-09-14T11:32:15.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.628+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.628+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:15.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.632+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.632+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.632+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.632+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:15.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:15.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4562138857907790899', time=2024-09-14T13:26:40.889093+0000, chain.objs.size()=7 2024-09-14T11:32:15.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~XWAOEig_HUUqYbTYVkIZgKecl5ZymeJ.1 2024-09-14T11:32:15.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~XWAOEig_HUUqYbTYVkIZgKecl5ZymeJ.1_1 2024-09-14T11:32:15.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~XWAOEig_HUUqYbTYVkIZgKecl5ZymeJ.1_2 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~XWAOEig_HUUqYbTYVkIZgKecl5ZymeJ.2 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~XWAOEig_HUUqYbTYVkIZgKecl5ZymeJ.2_1 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__shadow_key1.2~XWAOEig_HUUqYbTYVkIZgKecl5ZymeJ.2_2 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48__multipart_key1.2~XWAOEig_HUUqYbTYVkIZgKecl5ZymeJ.3 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16797857444142868565', time=2024-09-14T13:27:16.930214+0000, chain.objs.size()=9 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__multipart_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.1 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__shadow_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.1_1 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__multipart_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.2 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__shadow_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.2_1 2024-09-14T11:32:15.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.636+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__multipart_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.3 2024-09-14T11:32:15.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.640+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__shadow_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.3_1 2024-09-14T11:32:15.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.640+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__multipart_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.4 2024-09-14T11:32:15.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.640+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__shadow_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.4_1 2024-09-14T11:32:15.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.640+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.53__multipart_key1.2~6vetWCB9ipTvY3Njyf2k9XtPB5iE6iv.5 2024-09-14T11:32:15.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.640+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14967555360079020330', time=2024-09-14T13:31:41.601357+0000, chain.objs.size()=1 2024-09-14T11:32:15.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.640+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.63__shadow_.j27IhfrGhzqEuX085muifoGwWrecP3H_0 2024-09-14T11:32:15.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.644+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.648+0000 7f8dce2019c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:15.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.648+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4216736734024002178', time=2024-09-14T13:25:24.974359+0000, chain.objs.size()=9 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__multipart_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.1 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__shadow_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.1_1 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__multipart_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.2 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__shadow_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.2_1 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__multipart_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.3 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__shadow_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.3_1 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__multipart_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.4 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__shadow_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.4_1 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.43__multipart_key1.2~mMPKGTqCNZty_mmRStrRSGMO_w-0lH2.5 2024-09-14T11:32:15.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10742403821624453811', time=2024-09-14T13:29:27.506461+0000, chain.objs.size()=19 2024-09-14T11:32:15.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.1 2024-09-14T11:32:15.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.1_1 2024-09-14T11:32:15.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.652+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.2 2024-09-14T11:32:15.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.2_1 2024-09-14T11:32:15.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.3 2024-09-14T11:32:15.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.3_1 2024-09-14T11:32:15.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.4 2024-09-14T11:32:15.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.4_1 2024-09-14T11:32:15.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.5 2024-09-14T11:32:15.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.5_1 2024-09-14T11:32:15.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.6 2024-09-14T11:32:15.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.6_1 2024-09-14T11:32:15.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.7 2024-09-14T11:32:15.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.656+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.7_1 2024-09-14T11:32:15.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.660+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.8 2024-09-14T11:32:15.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.660+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.8_1 2024-09-14T11:32:15.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.660+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.9 2024-09-14T11:32:15.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.660+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__shadow_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.9_1 2024-09-14T11:32:15.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.660+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56__multipart_key1.2~YeEMGpjj2gD6xRSWtUcyd1IuLZ52ixR.10 2024-09-14T11:32:15.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.668+0000 7f8dce2019c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:15.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.672+0000 7f8c81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.672+0000 7f8dce2019c0 20 remove_watcher() i=0 2024-09-14T11:32:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.672+0000 7f8dce2019c0 2 removed watcher, disabling cache 2024-09-14T11:32:15.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.672+0000 7f8dce2019c0 20 remove_watcher() i=1 2024-09-14T11:32:15.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.676+0000 7f8dce2019c0 20 remove_watcher() i=2 2024-09-14T11:32:15.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.676+0000 7f8dce2019c0 20 remove_watcher() i=3 2024-09-14T11:32:15.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.676+0000 7f8dce2019c0 20 remove_watcher() i=4 2024-09-14T11:32:15.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.680+0000 7f8dce2019c0 20 remove_watcher() i=5 2024-09-14T11:32:15.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.680+0000 7f8dce2019c0 20 remove_watcher() i=6 2024-09-14T11:32:15.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.680+0000 7f8dce2019c0 20 remove_watcher() i=7 2024-09-14T11:32:15.687 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:32:15.754 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:15.754 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:15.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.796+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 realm 2024-09-14T11:32:15.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:15.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:15.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:15.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.800+0000 7f4a0ac379c0 20 searching for the correct realm 2024-09-14T11:32:15.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.808+0000 7f4a07f3c640 0 -- 172.21.15.148:0/3056545474 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x5578856d8440 msgr2=0x5578856da850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:15.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.812+0000 7f4a0873d640 0 -- 172.21.15.148:0/3056545474 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f49f807d430 msgr2=0x7f49f801ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:32:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:15.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:32:15.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 zone default found 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 4 Realm: () 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:15.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 zonegroup default 2024-09-14T11:32:15.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.820+0000 7f4a0ac379c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.824+0000 7f4a0ac379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.824+0000 7f4a0ac379c0 20 started sync module instance, tier type = 2024-09-14T11:32:15.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.824+0000 7f4a0ac379c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:32:15.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.840+0000 7f4a0ac379c0 20 add_watcher() i=0 2024-09-14T11:32:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.840+0000 7f4a0ac379c0 20 add_watcher() i=1 2024-09-14T11:32:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.840+0000 7f4a0ac379c0 20 add_watcher() i=2 2024-09-14T11:32:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.840+0000 7f4a0ac379c0 20 add_watcher() i=3 2024-09-14T11:32:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.840+0000 7f4a0ac379c0 20 add_watcher() i=4 2024-09-14T11:32:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.840+0000 7f4a0ac379c0 20 add_watcher() i=5 2024-09-14T11:32:15.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.840+0000 7f4a0ac379c0 20 add_watcher() i=6 2024-09-14T11:32:15.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.844+0000 7f4a0ac379c0 20 add_watcher() i=7 2024-09-14T11:32:15.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.844+0000 7f4a0ac379c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.844+0000 7f48befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.844+0000 7f4a0ac379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:15.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.844+0000 7f4a0ac379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:15.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.916+0000 7f48bdfdb640 20 reqs_thread_entry: start 2024-09-14T11:32:15.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.916+0000 7f4a0ac379c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:15.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.916+0000 7f4a0ac379c0 20 Filter name: none 2024-09-14T11:32:15.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.916+0000 7f482f7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:15.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.916+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:15.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.916+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.916+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.916+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.920+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:15.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.924+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.924+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.924+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.928+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:15.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.928+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.928+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.928+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.932+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:15.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.932+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.936+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.936+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.936+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:15.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.940+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.940+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.940+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.944+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:15.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.944+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.944+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.944+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.948+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:15.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.948+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.948+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.948+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.952+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:15.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.956+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.956+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.956+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.960+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:15.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.960+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.960+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.960+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.964+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:15.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.964+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.968+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.968+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.972+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:15.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.972+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.976+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.976+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.976+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:15.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.980+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.980+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.980+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.984+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:15.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.984+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.988+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.988+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.988+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:15.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.992+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.992+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.992+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.996+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:15.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:15.996+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.000+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:15.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.000+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:15.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.000+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:15.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.004+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.004+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.004+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.008+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:16.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.008+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.012+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.012+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.012+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:16.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.016+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.016+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.016+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.016+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:16.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.020+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.020+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.024+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.024+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:16.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.028+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.028+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.028+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.028+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:16.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.032+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.036+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.036+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.040+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:16.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.044+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.044+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.048+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.048+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:16.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.052+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.056+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.056+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.060+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.060+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.060+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.064+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.064+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:16.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.068+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.068+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.068+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.072+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.076+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.076+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.076+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.080+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:16.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.084+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.084+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.084+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.088+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:16.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.092+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.092+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.096+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.096+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:16.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.100+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.100+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.100+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.104+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:16.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.108+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.112+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.112+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.112+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:16.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.116+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.120+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.120+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.124+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:16.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.128+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.128+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.128+0000 7f4a0ac379c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.132+0000 7f48befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:16.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.136+0000 7f4a0ac379c0 20 remove_watcher() i=0 2024-09-14T11:32:16.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.136+0000 7f4a0ac379c0 2 removed watcher, disabling cache 2024-09-14T11:32:16.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.140+0000 7f4a0ac379c0 20 remove_watcher() i=1 2024-09-14T11:32:16.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.144+0000 7f4a0ac379c0 20 remove_watcher() i=2 2024-09-14T11:32:16.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.144+0000 7f4a0ac379c0 20 remove_watcher() i=3 2024-09-14T11:32:16.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.148+0000 7f4a0ac379c0 20 remove_watcher() i=4 2024-09-14T11:32:16.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.148+0000 7f4a0ac379c0 20 remove_watcher() i=5 2024-09-14T11:32:16.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.152+0000 7f4a0ac379c0 20 remove_watcher() i=6 2024-09-14T11:32:16.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.156+0000 7f4a0ac379c0 20 remove_watcher() i=7 2024-09-14T11:32:16.168 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:32:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:16.243 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:16.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.292+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 realm 2024-09-14T11:32:16.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:16.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:16.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:16.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.296+0000 7f43e5a909c0 20 searching for the correct realm 2024-09-14T11:32:16.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.304+0000 7f43e2d95640 0 -- 172.21.15.148:0/1156599723 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f43dc008040 msgr2=0x7f43dc05cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:16.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.308+0000 7f43e3596640 0 -- 172.21.15.148:0/1156599723 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f43dc05e0a0 msgr2=0x7f43dc066c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:16.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:16.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:32:16.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:16.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:16.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:16.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:32:16.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.316+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:16.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 zone default found 2024-09-14T11:32:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 4 Realm: () 2024-09-14T11:32:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:32:16.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:32:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 zonegroup default 2024-09-14T11:32:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 started sync module instance, tier type = 2024-09-14T11:32:16.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.320+0000 7f43e5a909c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:32:16.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 20 add_watcher() i=0 2024-09-14T11:32:16.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 20 add_watcher() i=1 2024-09-14T11:32:16.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 20 add_watcher() i=2 2024-09-14T11:32:16.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 20 add_watcher() i=3 2024-09-14T11:32:16.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 20 add_watcher() i=4 2024-09-14T11:32:16.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 20 add_watcher() i=5 2024-09-14T11:32:16.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 20 add_watcher() i=6 2024-09-14T11:32:16.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 20 add_watcher() i=7 2024-09-14T11:32:16.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.340+0000 7f43e5a909c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.344+0000 7f4299fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.344+0000 7f43e5a909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.344+0000 7f43e5a909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:16.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.424+0000 7f4298fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:16.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.424+0000 7f43e5a909c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:16.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.424+0000 7f43e5a909c0 20 Filter name: none 2024-09-14T11:32:16.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.424+0000 7f42127fc640 20 reqs_thread_entry: start 2024-09-14T11:32:16.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.424+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:16.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.428+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.428+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.428+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.428+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:16.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.432+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.432+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.436+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.436+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:16.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.440+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.440+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.440+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.440+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:16.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.444+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.448+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.448+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.452+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:16.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.456+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.456+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.456+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.460+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:16.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.464+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.464+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.464+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.464+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:16.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.468+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.472+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.472+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.476+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:16.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.480+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.484+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.484+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.488+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:16.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.492+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.492+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.492+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.496+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:16.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.500+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.500+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.504+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.504+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:16.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.508+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.512+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.512+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.516+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:16.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.516+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.520+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.520+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.520+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:16.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.524+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.528+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.528+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.532+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:16.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.536+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.536+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.536+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.540+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:16.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.544+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.544+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.544+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.548+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:16.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.552+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.552+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.552+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.556+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:16.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.560+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.564+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.564+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.564+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:16.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.568+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.572+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.572+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.572+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:16.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.576+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.580+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.580+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.584+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:16.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.588+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.588+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.588+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.592+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.596+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.596+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.596+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.600+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:16.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.604+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.604+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.608+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.608+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:16.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.612+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.616+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.616+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.620+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:16.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.624+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.624+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.624+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.628+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:16.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.632+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.632+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.636+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.640+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:16.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.640+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.644+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.644+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.644+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:16.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.648+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.648+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.652+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.652+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:16.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.656+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.656+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.660+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.660+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:16.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.664+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.668+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.668+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.668+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:16.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.672+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.676+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.676+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.680+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:16.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.684+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.684+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.684+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.688+0000 7f43e5a909c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:16.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.692+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.692+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.696+0000 7f43e5a909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.700+0000 7f4299fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:16.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.704+0000 7f43e5a909c0 20 remove_watcher() i=0 2024-09-14T11:32:16.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.704+0000 7f43e5a909c0 2 removed watcher, disabling cache 2024-09-14T11:32:16.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.708+0000 7f43e5a909c0 20 remove_watcher() i=1 2024-09-14T11:32:16.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.708+0000 7f43e5a909c0 20 remove_watcher() i=2 2024-09-14T11:32:16.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.712+0000 7f43e5a909c0 20 remove_watcher() i=3 2024-09-14T11:32:16.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.712+0000 7f43e5a909c0 20 remove_watcher() i=4 2024-09-14T11:32:16.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.716+0000 7f43e5a909c0 20 remove_watcher() i=5 2024-09-14T11:32:16.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.720+0000 7f43e5a909c0 20 remove_watcher() i=6 2024-09-14T11:32:16.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.720+0000 7f43e5a909c0 20 remove_watcher() i=7 2024-09-14T11:32:16.735 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:32:16.808 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:16.809 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:16.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 20 realm 2024-09-14T11:32:16.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:16.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.864+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.868+0000 7fd5fca239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:16.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.868+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.868+0000 7fd5fca239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:16.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.868+0000 7fd5fca239c0 20 searching for the correct realm 2024-09-14T11:32:16.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.872+0000 7fd5f9d28640 0 -- 172.21.15.148:0/2151873733 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fd5f4029060 msgr2=0x7fd5f405f230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:16.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.880+0000 7fd5fad2a640 0 -- 172.21.15.148:0/2151873733 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5643850dd3c0 msgr2=0x5643850df7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:16.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:16.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:32:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:32:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 zone default found 2024-09-14T11:32:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 4 Realm: () 2024-09-14T11:32:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:32:16.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:32:16.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:16.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 zonegroup default 2024-09-14T11:32:16.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.888+0000 7fd5fca239c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.892+0000 7fd5fca239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.892+0000 7fd5fca239c0 20 started sync module instance, tier type = 2024-09-14T11:32:16.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.892+0000 7fd5fca239c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:32:16.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.908+0000 7fd5fca239c0 20 add_watcher() i=0 2024-09-14T11:32:16.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.908+0000 7fd5fca239c0 20 add_watcher() i=1 2024-09-14T11:32:16.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.908+0000 7fd5fca239c0 20 add_watcher() i=2 2024-09-14T11:32:16.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.908+0000 7fd5fca239c0 20 add_watcher() i=3 2024-09-14T11:32:16.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.908+0000 7fd5fca239c0 20 add_watcher() i=4 2024-09-14T11:32:16.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.908+0000 7fd5fca239c0 20 add_watcher() i=5 2024-09-14T11:32:16.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.908+0000 7fd5fca239c0 20 add_watcher() i=6 2024-09-14T11:32:16.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.912+0000 7fd5fca239c0 20 add_watcher() i=7 2024-09-14T11:32:16.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.912+0000 7fd5fca239c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.916+0000 7fd4b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.916+0000 7fd5fca239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:16.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.916+0000 7fd5fca239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.984+0000 7fd4ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.984+0000 7fd5fca239c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.984+0000 7fd5fca239c0 20 Filter name: none 2024-09-14T11:32:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.984+0000 7fd4a97fa640 20 reqs_thread_entry: start 2024-09-14T11:32:16.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.984+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.988+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.988+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.988+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.992+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:16.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.996+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.996+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.996+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:16.996+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:16.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.000+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:16.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.000+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:16.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.004+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.004+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:17.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.008+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.008+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.008+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.012+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:17.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.016+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.016+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.016+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.020+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:17.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.024+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.024+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.024+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.024+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:17.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.028+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.028+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.028+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.032+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.032+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.036+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.036+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.040+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:17.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.044+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.044+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.044+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.044+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.048+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.052+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.052+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.056+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:17.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.060+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.060+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.060+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.064+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:17.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.068+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.068+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.068+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.072+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:17.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.072+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.072+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.072+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.076+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:17.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.080+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.080+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.084+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.084+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:17.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.088+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.088+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.088+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.092+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:17.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.096+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.096+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.096+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.100+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:17.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.104+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.104+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.104+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.108+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.112+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.112+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.112+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.112+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:17.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.116+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.120+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.120+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.124+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:17.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.124+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.128+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.128+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.128+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:17.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.132+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.136+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.136+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.140+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:17.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.144+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.144+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.144+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.148+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:17.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.152+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.152+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.152+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.156+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:17.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.160+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.160+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.160+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.164+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:17.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.168+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.168+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.168+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.172+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:17.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.176+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.180+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.180+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.180+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:17.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.184+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.188+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.188+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.188+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:17.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.192+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.196+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.196+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.196+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:17.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.200+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.204+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.204+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.208+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:17.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.208+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.212+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.212+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.212+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.216+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.220+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.220+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.220+0000 7fd5fca239c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:17.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.224+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.228+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:17.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.228+0000 7fd5fca239c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:17.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.232+0000 7fd4b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:17.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.236+0000 7fd5fca239c0 20 remove_watcher() i=0 2024-09-14T11:32:17.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.236+0000 7fd5fca239c0 2 removed watcher, disabling cache 2024-09-14T11:32:17.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.236+0000 7fd5fca239c0 20 remove_watcher() i=1 2024-09-14T11:32:17.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.240+0000 7fd5fca239c0 20 remove_watcher() i=2 2024-09-14T11:32:17.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.244+0000 7fd5fca239c0 20 remove_watcher() i=3 2024-09-14T11:32:17.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.244+0000 7fd5fca239c0 20 remove_watcher() i=4 2024-09-14T11:32:17.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.248+0000 7fd5fca239c0 20 remove_watcher() i=5 2024-09-14T11:32:17.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.248+0000 7fd5fca239c0 20 remove_watcher() i=6 2024-09-14T11:32:17.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:17.252+0000 7fd5fca239c0 20 remove_watcher() i=7 2024-09-14T11:32:17.270 DEBUG:teuthology.orchestra.run.smithi148:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:32:17.960 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :clean 2024-09-14T11:32:18.757 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :compileJava 2024-09-14T11:32:18.757 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :processResources 2024-09-14T11:32:18.857 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :classes 2024-09-14T11:32:19.457 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:19.457 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :compileTestJava 2024-09-14T11:32:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:32:19.458 INFO:teuthology.orchestra.run.smithi148.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:32:19.459 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:19.459 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:32:19.459 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :testClasses 2024-09-14T11:32:21.458 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:21.458 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :test 2024-09-14T11:32:21.458 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:21.458 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:32:21.459 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:32:20,871 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:32:21.459 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:21.459 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:32:21.460 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:21.460 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:32:22.057 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:22.057 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:32:22.857 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:22.857 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:32:22.957 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:22.957 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:32:23.657 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:23.657 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:32:24.257 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:24.257 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:32:24.357 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:24.357 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:32:24.757 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:24.757 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:32:25.557 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:25.557 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:32:25.657 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:25.657 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:32:25.757 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:25.757 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:32:26.257 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:26.257 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:32:27.557 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:27.557 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:32:27.757 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:27.757 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:32:28.457 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:28.457 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:32:28.557 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:28.557 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:32:28.754 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:28.754 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------- 2024-09-14T11:32:28.754 INFO:teuthology.orchestra.run.smithi148.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:32:28.754 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------- 2024-09-14T11:32:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:28.755 INFO:teuthology.orchestra.run.smithi148.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:32:28.755 INFO:teuthology.orchestra.run.smithi148.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:32:28.755 INFO:teuthology.orchestra.run.smithi148.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:32:28.755 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:28.755 INFO:teuthology.orchestra.run.smithi148.stdout:BUILD SUCCESSFUL in 11s 2024-09-14T11:32:28.755 INFO:teuthology.orchestra.run.smithi148.stdout:5 actionable tasks: 5 executed 2024-09-14T11:32:28.764 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:32:28.794 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:28.794 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:28.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.859+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:28.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:28.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 realm 2024-09-14T11:32:28.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:28.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:28.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:28.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:28.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:28.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:28.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:28.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.863+0000 7fe07fcdf9c0 20 searching for the correct realm 2024-09-14T11:32:28.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:28.871+0000 7fe07cfe4640 0 -- 172.21.15.148:0/3016148186 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fe078062480 msgr2=0x7fe078060ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:29.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.083+0000 7fe07d7e5640 0 -- 172.21.15.148:0/3016148186 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fdf48081b70 msgr2=0x7fdf48083fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:29.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.299+0000 7fe07fcdf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.299+0000 7fe07fcdf9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:32:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.299+0000 7fe07fcdf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.299+0000 7fe07fcdf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.299+0000 7fe07fcdf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.299+0000 7fe07fcdf9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:32:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.299+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:29.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:29.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:29.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 zone default found 2024-09-14T11:32:29.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 4 Realm: () 2024-09-14T11:32:29.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:32:29.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:32:29.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 zonegroup default 2024-09-14T11:32:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:29.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.303+0000 7fe07fcdf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.307+0000 7fe07fcdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:29.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.307+0000 7fe07fcdf9c0 20 started sync module instance, tier type = 2024-09-14T11:32:29.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.307+0000 7fe07fcdf9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:32:29.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 20 add_watcher() i=0 2024-09-14T11:32:29.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 20 add_watcher() i=1 2024-09-14T11:32:29.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 20 add_watcher() i=2 2024-09-14T11:32:29.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 20 add_watcher() i=3 2024-09-14T11:32:29.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 20 add_watcher() i=4 2024-09-14T11:32:29.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 20 add_watcher() i=5 2024-09-14T11:32:29.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 20 add_watcher() i=6 2024-09-14T11:32:29.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 20 add_watcher() i=7 2024-09-14T11:32:29.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.331+0000 7fe07fcdf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:29.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.339+0000 7fdf337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:29.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.339+0000 7fe07fcdf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:29.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.339+0000 7fe07fcdf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:29.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.423+0000 7fdf327e4640 20 reqs_thread_entry: start 2024-09-14T11:32:29.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.423+0000 7fe07fcdf9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:29.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.423+0000 7fe07fcdf9c0 20 Filter name: none 2024-09-14T11:32:29.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.423+0000 7fdea3fff640 20 reqs_thread_entry: start 2024-09-14T11:32:29.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.423+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:29.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.427+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.427+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.431+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.431+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:29.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.435+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.439+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.439+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.443+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:29.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.443+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.447+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.447+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.447+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:29.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.451+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.451+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.451+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.455+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:29.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.455+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.459+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.459+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.463+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:29.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.463+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.463+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.467+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.467+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:29.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.471+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.471+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.471+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.475+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:29.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.475+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.479+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.479+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.479+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:29.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.483+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.483+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.483+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.483+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:29.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.487+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.487+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.487+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.491+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:29.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.495+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.495+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.499+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.499+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:29.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.503+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.503+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.503+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.507+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:29.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.511+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.511+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.511+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.515+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:29.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.519+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.519+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.523+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.523+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:29.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.527+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.527+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.527+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.531+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:29.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.531+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.531+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.535+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.535+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:29.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.539+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.539+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.539+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.543+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:29.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.547+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.547+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.547+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.551+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:29.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.551+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.555+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.555+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.559+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:29.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.563+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.563+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.563+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.563+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:29.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.567+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.567+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.567+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.571+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:29.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.575+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.575+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.575+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.579+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:29.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.583+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.583+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.583+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.583+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:29.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.587+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.591+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.591+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.595+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:29.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.599+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.599+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.599+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.603+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:29.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.607+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.607+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.607+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.611+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:29.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.615+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.615+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.615+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.615+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:29.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.619+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.623+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.623+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.627+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:29.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.627+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.627+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.631+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.631+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:29.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.639+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.639+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.639+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.643+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:29.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.647+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.647+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.651+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:29.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.651+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12492763912820214700', time=2024-09-14T13:32:24.989514+0000, chain.objs.size()=1 2024-09-14T11:32:29.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.651+0000 7fe07fcdf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.72__shadow_.uFPzmMn2kOlgg14O9AXycg67AkpYWaJ_0 2024-09-14T11:32:29.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.651+0000 7fe07fcdf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:29.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.659+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:29.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.663+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:29.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.663+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:29.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.663+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:29.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.663+0000 7fe07fcdf9c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15951549699243418351', time=2024-09-14T13:32:26.938105+0000, chain.objs.size()=1 2024-09-14T11:32:29.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.663+0000 7fe07fcdf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.73__shadow_.nY_AR2-FIVH7qdFo1b4DraR9XSnm7B6_0 2024-09-14T11:32:29.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.667+0000 7fe07fcdf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:29.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.675+0000 7fdf337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:29.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.679+0000 7fe07fcdf9c0 20 remove_watcher() i=0 2024-09-14T11:32:29.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.679+0000 7fe07fcdf9c0 2 removed watcher, disabling cache 2024-09-14T11:32:29.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.683+0000 7fe07fcdf9c0 20 remove_watcher() i=1 2024-09-14T11:32:29.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.683+0000 7fe07fcdf9c0 20 remove_watcher() i=2 2024-09-14T11:32:29.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.687+0000 7fe07fcdf9c0 20 remove_watcher() i=3 2024-09-14T11:32:29.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.687+0000 7fe07fcdf9c0 20 remove_watcher() i=4 2024-09-14T11:32:29.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.691+0000 7fe07fcdf9c0 20 remove_watcher() i=5 2024-09-14T11:32:29.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.691+0000 7fe07fcdf9c0 20 remove_watcher() i=6 2024-09-14T11:32:29.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.695+0000 7fe07fcdf9c0 20 remove_watcher() i=7 2024-09-14T11:32:29.713 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:32:29.784 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:29.784 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:29.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:29.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 20 realm 2024-09-14T11:32:29.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:29.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:29.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:29.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.835+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.839+0000 7fcbbc5d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:29.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.839+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:29.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.839+0000 7fcbbc5d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:29.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.839+0000 7fcbbc5d49c0 20 searching for the correct realm 2024-09-14T11:32:29.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.843+0000 7fcbba0da640 0 -- 172.21.15.148:0/154118244 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fcbac10e040 msgr2=0x7fcbac0f7b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:29.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:29.851+0000 7fcbba0da640 0 -- 172.21.15.148:0/154118244 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7fcbb406ce60 msgr2=0x7fcbb406c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:32:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:30.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:30.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:30.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:32:30.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:30.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:30.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 zone default found 2024-09-14T11:32:30.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 4 Realm: () 2024-09-14T11:32:30.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:32:30.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:32:30.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:30.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 zonegroup default 2024-09-14T11:32:30.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.071+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.075+0000 7fcbbc5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.075+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.075+0000 7fcbbc5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.075+0000 7fcbbc5d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.075+0000 7fcbbc5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.075+0000 7fcbbc5d49c0 20 started sync module instance, tier type = 2024-09-14T11:32:30.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.075+0000 7fcbbc5d49c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:32:30.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.099+0000 7fcbbc5d49c0 20 add_watcher() i=0 2024-09-14T11:32:30.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.099+0000 7fcbbc5d49c0 20 add_watcher() i=1 2024-09-14T11:32:30.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.099+0000 7fcbbc5d49c0 20 add_watcher() i=2 2024-09-14T11:32:30.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.099+0000 7fcbbc5d49c0 20 add_watcher() i=3 2024-09-14T11:32:30.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.099+0000 7fcbbc5d49c0 20 add_watcher() i=4 2024-09-14T11:32:30.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.099+0000 7fcbbc5d49c0 20 add_watcher() i=5 2024-09-14T11:32:30.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.099+0000 7fcbbc5d49c0 20 add_watcher() i=6 2024-09-14T11:32:30.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.103+0000 7fcbbc5d49c0 20 add_watcher() i=7 2024-09-14T11:32:30.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.103+0000 7fcbbc5d49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:30.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.107+0000 7fca70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:30.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.107+0000 7fcbbc5d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:30.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.107+0000 7fcbbc5d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:30.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.195+0000 7fc9eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:30.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.195+0000 7fcbbc5d49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:30.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.195+0000 7fcbbc5d49c0 20 Filter name: none 2024-09-14T11:32:30.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.195+0000 7fc9e97fa640 20 reqs_thread_entry: start 2024-09-14T11:32:30.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.195+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:30.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.199+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.199+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.199+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.203+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:30.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.207+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.207+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.207+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.207+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:30.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.211+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.215+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.215+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.215+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:30.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.219+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.223+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.223+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.223+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:30.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.227+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.227+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.231+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.231+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:30.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.235+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.235+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.235+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.235+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:30.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.239+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.239+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.243+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.243+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:30.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.247+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.247+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.247+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.251+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:30.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.255+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.259+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.259+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.263+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:30.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.267+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.267+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.267+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.271+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:30.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.275+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.275+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.275+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.279+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:30.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.283+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.283+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.283+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.287+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:30.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.291+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.291+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.291+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.295+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:30.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.299+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.299+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.299+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.303+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:30.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.307+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.307+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.307+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.311+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:30.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.315+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.315+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.319+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.319+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:30.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.323+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.327+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.327+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.327+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:30.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.331+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.335+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.335+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.339+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:30.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.339+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.343+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.343+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.347+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:30.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.351+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.351+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.351+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.355+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:30.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.359+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.359+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.359+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.363+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:30.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.367+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.367+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.367+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.371+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:30.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.375+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.375+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.375+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.379+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:30.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.383+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.383+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.387+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.387+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:30.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.391+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.395+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.395+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.399+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:30.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.403+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.403+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.403+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.407+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:30.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.411+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.411+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.411+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.415+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:30.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.419+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.423+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.423+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.427+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:30.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.431+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.431+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.431+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.435+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:30.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.439+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.443+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.443+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.447+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:30.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.451+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.451+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.451+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.455+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:30.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.459+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.459+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.459+0000 7fcbbc5d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.463+0000 7fca70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:30.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.471+0000 7fcbbc5d49c0 20 remove_watcher() i=0 2024-09-14T11:32:30.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.471+0000 7fcbbc5d49c0 2 removed watcher, disabling cache 2024-09-14T11:32:30.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.471+0000 7fcbbc5d49c0 20 remove_watcher() i=1 2024-09-14T11:32:30.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.475+0000 7fcbbc5d49c0 20 remove_watcher() i=2 2024-09-14T11:32:30.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.475+0000 7fcbbc5d49c0 20 remove_watcher() i=3 2024-09-14T11:32:30.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.479+0000 7fcbbc5d49c0 20 remove_watcher() i=4 2024-09-14T11:32:30.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.483+0000 7fcbbc5d49c0 20 remove_watcher() i=5 2024-09-14T11:32:30.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.483+0000 7fcbbc5d49c0 20 remove_watcher() i=6 2024-09-14T11:32:30.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.487+0000 7fcbbc5d49c0 20 remove_watcher() i=7 2024-09-14T11:32:30.501 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:32:30.572 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:30.572 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:30.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 20 realm 2024-09-14T11:32:30.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:30.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.623+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.627+0000 7f533e3aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:30.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.627+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.627+0000 7f533e3aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:30.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.627+0000 7f533e3aa9c0 20 searching for the correct realm 2024-09-14T11:32:30.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.631+0000 7f533b6af640 0 -- 172.21.15.148:0/2039742277 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f533406cf50 msgr2=0x7f53340620d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:30.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.843+0000 7f533c6b1640 0 -- 172.21.15.148:0/2039742277 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55eab3e23250 msgr2=0x55eab3e256c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:30.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:30.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:32:30.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:30.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:30.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:30.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:32:30.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:30.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.855+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 zone default found 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 4 Realm: () 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 zonegroup default 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:30.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:30.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 started sync module instance, tier type = 2024-09-14T11:32:30.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.859+0000 7f533e3aa9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:32:30.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 20 add_watcher() i=0 2024-09-14T11:32:30.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 20 add_watcher() i=1 2024-09-14T11:32:30.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 20 add_watcher() i=2 2024-09-14T11:32:30.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 20 add_watcher() i=3 2024-09-14T11:32:30.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 20 add_watcher() i=4 2024-09-14T11:32:30.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 20 add_watcher() i=5 2024-09-14T11:32:30.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 20 add_watcher() i=6 2024-09-14T11:32:30.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 20 add_watcher() i=7 2024-09-14T11:32:30.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.883+0000 7f533e3aa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:30.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.887+0000 7f51f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:30.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.891+0000 7f533e3aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:30.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.891+0000 7f533e3aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:30.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.979+0000 7f51f0fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:30.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.979+0000 7f533e3aa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:30.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.979+0000 7f533e3aa9c0 20 Filter name: none 2024-09-14T11:32:30.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.979+0000 7f516a7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:30.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.979+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:30.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.983+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.987+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.987+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.987+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:30.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.991+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.991+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.991+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.991+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:30.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.995+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.995+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:30.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.995+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:30.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:30.999+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:30.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.003+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.003+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.007+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.007+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:31.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.011+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.011+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.011+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.015+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:31.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.015+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.019+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.019+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.023+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:31.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.027+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.027+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.027+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.031+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:31.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.035+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.035+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.035+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.039+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.039+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.043+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.043+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.043+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:31.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.047+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.051+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.051+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.055+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:31.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.059+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.059+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.059+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.063+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:31.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.067+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.067+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.067+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.071+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:31.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.071+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.075+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.075+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.075+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:31.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.079+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.079+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.083+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.083+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:31.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.087+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.091+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.091+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.095+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:31.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.099+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.099+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.099+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.103+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:31.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.107+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.107+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.111+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.115+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:31.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.115+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.119+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.119+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.123+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:31.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.123+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.127+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.127+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.131+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:31.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.131+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.135+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.135+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.135+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:31.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.139+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.139+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.139+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.143+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:31.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.143+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.147+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.147+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.147+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:31.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.151+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.151+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.155+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.155+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:31.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.159+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.163+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.163+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.167+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:31.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.167+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.171+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.171+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.171+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:31.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.175+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.179+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.179+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.183+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:31.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.187+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.187+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.187+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.191+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:31.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.195+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.195+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.195+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.199+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:31.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.203+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.203+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.203+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.207+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:31.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.211+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.211+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.211+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.215+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:31.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.219+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.219+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.223+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.223+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:31.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.227+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.231+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.231+0000 7f533e3aa9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.235+0000 7f51f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:31.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.243+0000 7f533e3aa9c0 20 remove_watcher() i=0 2024-09-14T11:32:31.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.243+0000 7f533e3aa9c0 2 removed watcher, disabling cache 2024-09-14T11:32:31.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.247+0000 7f533e3aa9c0 20 remove_watcher() i=1 2024-09-14T11:32:31.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.247+0000 7f533e3aa9c0 20 remove_watcher() i=2 2024-09-14T11:32:31.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.251+0000 7f533e3aa9c0 20 remove_watcher() i=3 2024-09-14T11:32:31.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.255+0000 7f533e3aa9c0 20 remove_watcher() i=4 2024-09-14T11:32:31.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.255+0000 7f533e3aa9c0 20 remove_watcher() i=5 2024-09-14T11:32:31.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.259+0000 7f533e3aa9c0 20 remove_watcher() i=6 2024-09-14T11:32:31.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.263+0000 7f533e3aa9c0 20 remove_watcher() i=7 2024-09-14T11:32:31.279 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:32:31.353 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:31.353 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:31.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.403+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.403+0000 7f9360ee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:31.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.403+0000 7f9360ee39c0 20 realm 2024-09-14T11:32:31.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.403+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.403+0000 7f9360ee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:31.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.403+0000 7f9360ee39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:31.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.403+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.407+0000 7f9360ee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:31.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.407+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.407+0000 7f9360ee39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:31.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.407+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.407+0000 7f9360ee39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:31.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.407+0000 7f9360ee39c0 20 searching for the correct realm 2024-09-14T11:32:31.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.415+0000 7f935e1e8640 0 -- 172.21.15.148:0/344668080 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x56147aaae590 msgr2=0x56147aab0980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:31.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.419+0000 7f935e9e9640 0 -- 172.21.15.148:0/344668080 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f9358031420 msgr2=0x7f93580318a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:31.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:31.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:32:31.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:31.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:31.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:31.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:32:31.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:31.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:31.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.427+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:31.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 zone default found 2024-09-14T11:32:31.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 4 Realm: () 2024-09-14T11:32:31.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:32:31.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:32:31.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:31.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 zonegroup default 2024-09-14T11:32:31.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:31.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:31.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:31.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:31.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 started sync module instance, tier type = 2024-09-14T11:32:31.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.431+0000 7f9360ee39c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:32:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.447+0000 7f9360ee39c0 20 add_watcher() i=0 2024-09-14T11:32:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.447+0000 7f9360ee39c0 20 add_watcher() i=1 2024-09-14T11:32:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.447+0000 7f9360ee39c0 20 add_watcher() i=2 2024-09-14T11:32:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.447+0000 7f9360ee39c0 20 add_watcher() i=3 2024-09-14T11:32:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.447+0000 7f9360ee39c0 20 add_watcher() i=4 2024-09-14T11:32:31.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.447+0000 7f9360ee39c0 20 add_watcher() i=5 2024-09-14T11:32:31.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.451+0000 7f9360ee39c0 20 add_watcher() i=6 2024-09-14T11:32:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.451+0000 7f9360ee39c0 20 add_watcher() i=7 2024-09-14T11:32:31.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.451+0000 7f9360ee39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.455+0000 7f92157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.455+0000 7f9360ee39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:31.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.455+0000 7f9360ee39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:31.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.535+0000 7f918ffff640 20 reqs_thread_entry: start 2024-09-14T11:32:31.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.539+0000 7f9360ee39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:31.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.539+0000 7f9360ee39c0 20 Filter name: none 2024-09-14T11:32:31.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.539+0000 7f918dffb640 20 reqs_thread_entry: start 2024-09-14T11:32:31.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.539+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:31.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.539+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.543+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.543+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.547+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:31.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.547+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.551+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.551+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.555+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:31.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.555+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.559+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.559+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.559+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:31.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.563+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.563+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.567+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.567+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:31.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.571+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.571+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.571+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.575+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:31.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.575+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.579+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.579+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.583+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:31.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.583+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.587+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.587+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.587+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:31.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.591+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.591+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.591+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.595+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:31.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.595+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.595+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.599+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.599+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:31.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.603+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.603+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.607+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.607+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:31.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.611+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.611+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.611+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.615+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:31.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.619+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.619+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.619+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.623+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:31.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.627+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.627+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.627+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.631+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:31.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.631+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.631+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.635+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.635+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:31.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.639+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.639+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.639+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.643+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:31.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.647+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.647+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.647+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.651+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:31.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.655+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.655+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.655+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.655+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:31.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.659+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.659+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.663+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.663+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:31.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.667+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.671+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.671+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.675+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:31.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.675+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.675+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.679+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.679+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:31.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.683+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.683+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.683+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.687+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:31.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.691+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.691+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.691+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.695+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:31.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.699+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.699+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.703+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.703+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:31.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.707+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.711+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.711+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.715+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:31.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.715+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.719+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.719+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.723+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:31.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.723+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.727+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.727+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.727+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:31.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.731+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.731+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.731+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.735+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:31.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.739+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.739+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.739+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.743+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:31.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.747+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.747+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.747+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.751+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:31.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.755+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.755+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.755+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.759+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:31.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.763+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.763+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.763+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.767+0000 7f9360ee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:31.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.771+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.771+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:31.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.771+0000 7f9360ee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:31.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.775+0000 7f92157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:31.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.779+0000 7f9360ee39c0 20 remove_watcher() i=0 2024-09-14T11:32:31.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.779+0000 7f9360ee39c0 2 removed watcher, disabling cache 2024-09-14T11:32:31.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.783+0000 7f9360ee39c0 20 remove_watcher() i=1 2024-09-14T11:32:31.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.787+0000 7f9360ee39c0 20 remove_watcher() i=2 2024-09-14T11:32:31.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.787+0000 7f9360ee39c0 20 remove_watcher() i=3 2024-09-14T11:32:31.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.791+0000 7f9360ee39c0 20 remove_watcher() i=4 2024-09-14T11:32:31.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.791+0000 7f9360ee39c0 20 remove_watcher() i=5 2024-09-14T11:32:31.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.795+0000 7f9360ee39c0 20 remove_watcher() i=6 2024-09-14T11:32:31.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:32:31.799+0000 7f9360ee39c0 20 remove_watcher() i=7 2024-09-14T11:32:31.816 DEBUG:teuthology.orchestra.run.smithi148:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:32:32.508 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :clean 2024-09-14T11:32:33.205 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :compileJava 2024-09-14T11:32:33.205 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :processResources 2024-09-14T11:32:33.205 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :classes 2024-09-14T11:32:33.605 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:33.605 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :compileTestJava 2024-09-14T11:32:33.606 INFO:teuthology.orchestra.run.smithi148.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:32:33.606 INFO:teuthology.orchestra.run.smithi148.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:32:33.607 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:33.607 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:32:33.607 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :testClasses 2024-09-14T11:32:35.607 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:35.607 INFO:teuthology.orchestra.run.smithi148.stdout:> Task :test 2024-09-14T11:32:35.607 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:35.607 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:32:35.608 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14 11:32:35,020 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:32:35.608 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:35.608 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:32:35.608 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:35.608 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:32:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:36.906 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:32:37.105 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:37.105 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:32:37.905 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:37.905 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:32:38.105 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:38.105 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:32:38.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:38.805 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:32:50.506 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:50.506 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:32:51.405 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:51.405 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:32:52.105 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:52.105 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:32:52.505 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:52.505 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:32:53.305 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:53.306 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:32:53.306 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:53.306 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:32:53.505 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:53.505 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:32:53.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:53.705 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:32:54.405 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:32:54.405 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:33:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:33:03.605 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:03.605 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:33:03.905 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:03.905 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:33:04.605 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:04.605 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:33:05.005 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:05.006 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:33:05.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:05.705 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:33:06.005 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:06.005 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:33:06.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:06.705 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:33:06.905 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:06.905 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:33:07.605 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:07.605 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:33:07.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:07.805 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:33:08.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:08.705 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:33:09.405 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:09.405 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:33:09.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:09.806 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:33:32.405 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:32.406 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:33:33.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:33:33.805 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:34:22.305 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:22.306 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:34:23.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:23.705 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:34:23.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:23.805 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:34:24.505 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:24.505 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:34:24.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:24.805 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:34:26.005 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:26.005 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:34:39.005 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:39.005 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:34:39.705 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:39.705 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:34:39.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:39.805 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:34:40.005 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:34:40.005 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:35:06.805 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:35:06.805 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:35:12.205 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:35:12.205 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:35:36.405 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:35:36.405 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:35:37.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:35:37.505 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:35:57.405 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:35:57.405 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:35:58.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:35:58.105 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:37:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:37:14.205 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:37:15.004 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:37:15.004 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:37:30.004 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:37:30.005 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:37:30.704 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:37:30.705 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:37:51.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:37:51.505 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:37:52.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:37:52.305 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:37:57.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:37:57.105 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:38:48.204 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:48.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:38:48.205 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:48.205 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:38:48.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:48.404 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:38:48.604 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:48.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:38:49.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:49.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:38:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:49.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:38:50.204 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:50.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:38:50.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:50.404 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:38:51.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:51.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:38:51.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:51.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:38:52.004 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:52.004 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:38:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:52.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:38:52.904 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:52.904 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:38:53.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:53.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:38:53.904 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:53.904 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:38:54.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:54.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:38:55.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:55.404 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:38:56.004 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:56.004 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:38:57.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:57.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:38:57.604 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:57.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:38:58.604 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:58.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:38:59.204 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:38:59.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:39:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:00.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:39:00.604 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:00.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:39:01.604 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:01.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:39:02.204 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:02.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:39:03.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:03.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:39:03.804 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:03.804 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:39:04.804 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:04.804 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:39:05.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:05.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:39:06.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:06.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:39:06.904 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:06.904 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:39:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:07.904 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:39:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:08.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:39:09.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:09.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:39:10.003 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:10.004 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:39:11.004 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:11.004 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:39:11.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:11.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:39:12.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:12.404 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:39:12.904 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:12.904 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:39:13.804 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:13.804 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:39:14.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:14.404 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:39:15.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:15.404 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:39:15.904 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:15.904 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:39:17.004 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:17.004 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:39:17.604 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:17.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:39:18.603 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:18.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:39:19.204 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:19.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:39:20.103 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:20.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:39:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:20.704 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:39:21.703 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:21.704 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:39:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:22.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:39:23.204 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:23.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:39:23.704 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:23.704 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:39:24.603 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:24.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:39:25.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:25.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:39:26.003 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:26.004 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:39:26.503 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:26.503 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:39:27.403 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:27.404 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:39:27.603 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:27.603 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:39:28.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:28.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:39:28.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:28.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:39:29.203 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:29.204 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:39:29.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:29.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:39:30.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:30.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:39:30.604 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:30.604 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:39:31.404 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:31.404 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:39:32.103 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:32.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:39:32.804 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:32.804 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:39:32.804 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:32.804 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:39:33.003 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:33.003 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:39:33.303 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:33.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:39:34.003 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:34.004 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:39:34.303 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:34.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:39:35.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:35.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:39:35.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:35.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:39:36.104 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:36.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:39:36.303 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:36.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:39:37.103 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:37.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:39:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:49.504 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:39:50.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:39:50.304 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:40:03.103 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:03.104 INFO:teuthology.orchestra.run.smithi148.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout:---------------------------------------------------------------------- 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout:---------------------------------------------------------------------- 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:04.068 INFO:teuthology.orchestra.run.smithi148.stdout:BUILD SUCCESSFUL in 7m 32s 2024-09-14T11:40:04.069 INFO:teuthology.orchestra.run.smithi148.stdout:5 actionable tasks: 5 executed 2024-09-14T11:40:04.089 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:40:04.123 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:04.123 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:04.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.182+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.182+0000 7fd2d88429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.182+0000 7fd2d88429c0 20 realm 2024-09-14T11:40:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.182+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.182+0000 7fd2d88429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.182+0000 7fd2d88429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.182+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.186+0000 7fd2d88429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.186+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.186+0000 7fd2d88429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:04.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.186+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.186+0000 7fd2d88429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.186+0000 7fd2d88429c0 20 searching for the correct realm 2024-09-14T11:40:04.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.194+0000 7fd2cdb47640 0 -- 172.21.15.148:0/3911848617 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fd2d0011960 msgr2=0x7fd2d0027400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:04.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.198+0000 7fd2d6b49640 0 -- 172.21.15.148:0/3911848617 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55bb266de7d0 msgr2=0x55bb266e0bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 zone default found 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 4 Realm: () 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 zonegroup default 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.206+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.210+0000 7fd2d88429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.210+0000 7fd2d88429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.210+0000 7fd2d88429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.210+0000 7fd2d88429c0 20 started sync module instance, tier type = 2024-09-14T11:40:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.210+0000 7fd2d88429c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:04.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.226+0000 7fd2d88429c0 20 add_watcher() i=0 2024-09-14T11:40:04.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.226+0000 7fd2d88429c0 20 add_watcher() i=1 2024-09-14T11:40:04.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.226+0000 7fd2d88429c0 20 add_watcher() i=2 2024-09-14T11:40:04.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.226+0000 7fd2d88429c0 20 add_watcher() i=3 2024-09-14T11:40:04.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.226+0000 7fd2d88429c0 20 add_watcher() i=4 2024-09-14T11:40:04.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.226+0000 7fd2d88429c0 20 add_watcher() i=5 2024-09-14T11:40:04.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.226+0000 7fd2d88429c0 20 add_watcher() i=6 2024-09-14T11:40:04.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.230+0000 7fd2d88429c0 20 add_watcher() i=7 2024-09-14T11:40:04.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.230+0000 7fd2d88429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.234+0000 7fd18cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.234+0000 7fd2d88429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.234+0000 7fd2d88429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.302+0000 7fd1077fe640 20 reqs_thread_entry: start 2024-09-14T11:40:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.302+0000 7fd2d88429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.302+0000 7fd2d88429c0 20 Filter name: none 2024-09-14T11:40:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.302+0000 7fd1057fa640 20 reqs_thread_entry: start 2024-09-14T11:40:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.302+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.306+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.310+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.310+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.310+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13423938747454469045', time=2024-09-14T13:39:08.734961+0000, chain.objs.size()=1 2024-09-14T11:40:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.310+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.122__shadow_.ae1IZ9LyZZ_vhGFmlxALogQaOr8p0o7_0 2024-09-14T11:40:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.310+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10940044428029939258', time=2024-09-14T13:39:19.418343+0000, chain.objs.size()=1 2024-09-14T11:40:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.310+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.129__shadow_.8SBiwW1zAYbZ8l_Q-c3YY51G8jaS071_0 2024-09-14T11:40:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.310+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8310270954731778293', time=2024-09-14T13:39:26.821420+0000, chain.objs.size()=1 2024-09-14T11:40:04.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.310+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.134__shadow_.kIcysfsvKsFMtnr1kiHh3Ylk6rX5a-L_0 2024-09-14T11:40:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.314+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.318+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.322+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.326+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.326+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:04.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.326+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12417252934947070652', time=2024-09-14T13:39:05.502622+0000, chain.objs.size()=1 2024-09-14T11:40:04.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.326+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.120__shadow_.xMyYd0pyuA3YVvtC7_rPdI--IrGqYAK_0 2024-09-14T11:40:04.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.330+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.334+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:04.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.338+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.338+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.338+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.338+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8700121478201864447', time=2024-09-14T13:39:25.261794+0000, chain.objs.size()=1 2024-09-14T11:40:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.338+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.133__shadow_.S6LdPOLEZJYtfWz0N2-ycY-mMAKQNV4_0 2024-09-14T11:40:04.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.342+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.346+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:04.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:40:04.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6715624422719718083', time=2024-09-14T13:33:33.235149+0000, chain.objs.size()=9 2024-09-14T11:40:04.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.1 2024-09-14T11:40:04.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__shadow_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.1_1 2024-09-14T11:40:04.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.2 2024-09-14T11:40:04.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__shadow_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.2_1 2024-09-14T11:40:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.3 2024-09-14T11:40:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__shadow_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.3_1 2024-09-14T11:40:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.4 2024-09-14T11:40:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.350+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__shadow_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.4_1 2024-09-14T11:40:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.354+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.5 2024-09-14T11:40:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.354+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7444694585921555207', time=2024-09-14T13:37:14.434079+0000, chain.objs.size()=7 2024-09-14T11:40:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.354+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~aIbyaA8c4rSfRK-xvr4NcqwsG7taaIT.1 2024-09-14T11:40:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.354+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~aIbyaA8c4rSfRK-xvr4NcqwsG7taaIT.1_1 2024-09-14T11:40:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.354+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~aIbyaA8c4rSfRK-xvr4NcqwsG7taaIT.1_2 2024-09-14T11:40:04.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.362+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~aIbyaA8c4rSfRK-xvr4NcqwsG7taaIT.2 2024-09-14T11:40:04.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.362+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~aIbyaA8c4rSfRK-xvr4NcqwsG7taaIT.2_1 2024-09-14T11:40:04.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.362+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~aIbyaA8c4rSfRK-xvr4NcqwsG7taaIT.2_2 2024-09-14T11:40:04.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.362+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~aIbyaA8c4rSfRK-xvr4NcqwsG7taaIT.3 2024-09-14T11:40:04.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.362+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13337409520286447967', time=2024-09-14T13:38:56.305323+0000, chain.objs.size()=1 2024-09-14T11:40:04.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.362+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.114__shadow_.YZ5DNcTO6H6lR7_QB4po7EJq7aDDlX5_0 2024-09-14T11:40:04.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.366+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14601487027579580925', time=2024-09-14T13:38:56.461254+0000, chain.objs.size()=1 2024-09-14T11:40:04.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.366+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.114__shadow_.R172CXwwJmE8aRsE-FuwTimEarjpbmB_0 2024-09-14T11:40:04.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.366+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12852514423541567841', time=2024-09-14T13:39:05.641850+0000, chain.objs.size()=1 2024-09-14T11:40:04.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.366+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.120__shadow_.G7Yzh9IFMu9wIFM8aXLHcicbWIUiZV3_0 2024-09-14T11:40:04.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.374+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.382+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:04.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.382+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:40:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4441126921756269204', time=2024-09-14T13:35:36.900499+0000, chain.objs.size()=1 2024-09-14T11:40:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__shadow_.s8AUIgB9PmUBXouMxUlwlCIo2_axVF5_0 2024-09-14T11:40:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10792750726345352022', time=2024-09-14T13:38:48.763547+0000, chain.objs.size()=1 2024-09-14T11:40:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.107__shadow_.SzQsicHU00GeuGuVoSLteUj8yzI0zL9_0 2024-09-14T11:40:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12890951209144388180', time=2024-09-14T13:38:59.378537+0000, chain.objs.size()=1 2024-09-14T11:40:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.116__shadow_.h8DPu-kboUo3thb-u19ZQvrCh28rB4e_0 2024-09-14T11:40:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9981456567573904002', time=2024-09-14T13:39:02.573066+0000, chain.objs.size()=1 2024-09-14T11:40:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.118__shadow_.Kq-wYjFUWaovj8R5E_z0KhUS3Gqqagv_0 2024-09-14T11:40:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11015449529835732694', time=2024-09-14T13:39:07.101201+0000, chain.objs.size()=1 2024-09-14T11:40:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.386+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.121__shadow_.ORCkYWoi_gC7l6O51xvmHa-YifoSD8P_0 2024-09-14T11:40:04.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.390+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.394+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:04.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16087628627424139556', time=2024-09-14T13:35:09.577176+0000, chain.objs.size()=9 2024-09-14T11:40:04.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__multipart_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.1 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__shadow_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.1_1 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__multipart_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.2 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__shadow_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.2_1 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__multipart_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.3 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__shadow_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.3_1 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__multipart_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.4 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__shadow_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.4_1 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.100__multipart_key1.2~EQFD3bI2CKrXiowiAbSyOLkS_xNQu_b.5 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.398+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3130205787361448098', time=2024-09-14T13:39:11.849267+0000, chain.objs.size()=1 2024-09-14T11:40:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.402+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.124__shadow_.szOR9l6g3mhEU14Ndnvdfun0gzH58lp_0 2024-09-14T11:40:04.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.410+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:04.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15933679564135247616', time=2024-09-14T13:38:59.487833+0000, chain.objs.size()=1 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.116__shadow_.VF7OrW63E9SEJgAH_gefLKQ78JzgIdr_0 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16420548617526637548', time=2024-09-14T13:39:05.575672+0000, chain.objs.size()=1 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.120__shadow_.c-4agcexJOB7vmeoMtbFZZCY5U7k83I_0 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3662908221363888230', time=2024-09-14T13:39:10.438980+0000, chain.objs.size()=1 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.123__shadow_.NJBnt3xNHc1Wr3mD9n0GcSs9L-d_nB3_0 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6522863106996286931', time=2024-09-14T13:39:19.361790+0000, chain.objs.size()=1 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.129__shadow_.kcNVJvMmTDERN8hfGoh9uPMMEUiemXG_0 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15653318840162964242', time=2024-09-14T13:39:22.535443+0000, chain.objs.size()=1 2024-09-14T11:40:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.418+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.131__shadow_.BobBVH_MwNHgS0-yiduswpb6tPajFHJ_0 2024-09-14T11:40:04.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.422+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.426+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:04.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:40:04.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7747036896897043043', time=2024-09-14T13:38:56.388419+0000, chain.objs.size()=1 2024-09-14T11:40:04.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.114__shadow_.Zw4aZh1Xo2KvTsYThIVSBGL9OVYE62D_0 2024-09-14T11:40:04.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2224525481101646777', time=2024-09-14T13:39:02.495768+0000, chain.objs.size()=1 2024-09-14T11:40:04.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.118__shadow_.6fsht72kVSFuTn6IcGJOV0-p8lQDgMm_0 2024-09-14T11:40:04.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.720234487337476132', time=2024-09-14T13:39:17.856769+0000, chain.objs.size()=1 2024-09-14T11:40:04.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.128__shadow_.TwkVeg0nrfLfMkDb1TFVa4huMGxrDym_0 2024-09-14T11:40:04.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16261338725740191809', time=2024-09-14T13:39:23.889170+0000, chain.objs.size()=1 2024-09-14T11:40:04.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.430+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.132__shadow_.rbx6dsltg2tSoMrBYX84T8ajQrlj5pw_0 2024-09-14T11:40:04.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.434+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.438+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:04.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:40:04.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8283894280416192417', time=2024-09-14T13:33:04.074500+0000, chain.objs.size()=1 2024-09-14T11:40:04.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.85__shadow_.idjahaaLkkJQYRxbNNW4aZr2CxapGK3_0 2024-09-14T11:40:04.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.260278319797315711', time=2024-09-14T13:34:22.515302+0000, chain.objs.size()=6 2024-09-14T11:40:04.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.94__shadow_.YqfhJ0uHBKXWfG0J6jaiD0DVP8XRwpr_0 2024-09-14T11:40:04.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.94__shadow_.YqfhJ0uHBKXWfG0J6jaiD0DVP8XRwpr_1 2024-09-14T11:40:04.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.94__shadow_.YqfhJ0uHBKXWfG0J6jaiD0DVP8XRwpr_2 2024-09-14T11:40:04.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.94__shadow_.YqfhJ0uHBKXWfG0J6jaiD0DVP8XRwpr_3 2024-09-14T11:40:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.94__shadow_.YqfhJ0uHBKXWfG0J6jaiD0DVP8XRwpr_4 2024-09-14T11:40:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.94__shadow_.YqfhJ0uHBKXWfG0J6jaiD0DVP8XRwpr_5 2024-09-14T11:40:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9752318728789867934', time=2024-09-14T13:37:51.702967+0000, chain.objs.size()=9 2024-09-14T11:40:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__multipart_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.1 2024-09-14T11:40:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__shadow_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.1_1 2024-09-14T11:40:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__multipart_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.2 2024-09-14T11:40:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__shadow_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.2_1 2024-09-14T11:40:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.442+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__multipart_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.3 2024-09-14T11:40:04.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__shadow_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.3_1 2024-09-14T11:40:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__multipart_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.4 2024-09-14T11:40:04.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__shadow_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.4_1 2024-09-14T11:40:04.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.105__multipart_key1.2~UJY7asFePVMUoW2pHIJ1krx-fo3gI6H.5 2024-09-14T11:40:04.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9065100800336517610', time=2024-09-14T13:39:04.080750+0000, chain.objs.size()=1 2024-09-14T11:40:04.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.119__shadow_.BtVyb5xsUAV9WxWp95J5wxzRvQyeUtc_0 2024-09-14T11:40:04.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4985665517108686342', time=2024-09-14T13:39:10.383664+0000, chain.objs.size()=1 2024-09-14T11:40:04.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.123__shadow_.PVURr7FyHmt3H8VOrFYzpvyTWD_qO-q_0 2024-09-14T11:40:04.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18138452853616582728', time=2024-09-14T13:39:14.759519+0000, chain.objs.size()=1 2024-09-14T11:40:04.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.126__shadow_.ebdLHUTk1vSE5smjOaI5rZfsGsGZwBt_0 2024-09-14T11:40:04.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15262429220681120925', time=2024-09-14T13:40:03.339247+0000, chain.objs.size()=1 2024-09-14T11:40:04.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.450+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__shadow_.G_HaiXo6QhCX9LK2NjWeJ9BKOSgUyWQ_0 2024-09-14T11:40:04.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.458+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.462+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:04.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:04.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4522035502430818621', time=2024-09-14T13:36:42.833361+0000, chain.objs.size()=9 2024-09-14T11:40:04.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.1 2024-09-14T11:40:04.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.1_1 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.2 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.2_1 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.3 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.3_1 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.4 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.4_1 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~W9rJYRDZPP4s7dVf4fdzhWSgL7Rk9xR.5 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11773157870015338100', time=2024-09-14T13:39:13.130353+0000, chain.objs.size()=1 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.125__shadow_.3Ocl_ZUqq12jsXk4vvRHz-d31Y7glvQ_0 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11343401410784940764', time=2024-09-14T13:39:30.780510+0000, chain.objs.size()=1 2024-09-14T11:40:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.466+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.138__shadow_.LnBL5_kjR2SC0AX6kCSZRgRtlHwlLod_0 2024-09-14T11:40:04.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.474+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.478+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:04.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.478+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15547704394212875110', time=2024-09-14T13:32:52.730483+0000, chain.objs.size()=1 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.82__shadow_.50hi3mCjfbzJCQZyBlv86eTNs2mHyPB_0 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:10.219558+0000, chain.objs.size()=1 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.15 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:10.553583+0000, chain.objs.size()=1 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.16 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:10.812492+0000, chain.objs.size()=1 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.17 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:10.919292+0000, chain.objs.size()=1 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.18 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:11.092339+0000, chain.objs.size()=1 2024-09-14T11:40:04.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.19 2024-09-14T11:40:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:11.623150+0000, chain.objs.size()=1 2024-09-14T11:40:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.20 2024-09-14T11:40:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:12.030269+0000, chain.objs.size()=55 2024-09-14T11:40:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.1 2024-09-14T11:40:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.2 2024-09-14T11:40:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.3 2024-09-14T11:40:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.4 2024-09-14T11:40:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.482+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.5 2024-09-14T11:40:04.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.486+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.6 2024-09-14T11:40:04.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.486+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.7 2024-09-14T11:40:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.486+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.8 2024-09-14T11:40:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.486+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.9 2024-09-14T11:40:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.486+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.10 2024-09-14T11:40:04.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.490+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.11 2024-09-14T11:40:04.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.490+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.12 2024-09-14T11:40:04.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.490+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.13 2024-09-14T11:40:04.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.490+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.14 2024-09-14T11:40:04.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.490+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.oo3mcCzaam3qaSFiQJl6GaRrujV6-OoK.15 2024-09-14T11:40:04.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.490+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.F1h7D-i7vJWtdgTwzG06TRy6s0b-bFxd.16 2024-09-14T11:40:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.490+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.0ZLALZXR1in_bKMIBhoTKaHa08c6Ptwi.17 2024-09-14T11:40:04.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.494+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.ijwyXHCPC5Sb_gaGl9FyqDN2tsGY0_Yb.18 2024-09-14T11:40:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.494+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.rH0KjS8k3xN84vMWOjfkgKxL0OQ4RnPT.19 2024-09-14T11:40:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.494+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.ROo5A3CB0StgDS_53QizIdJTDXWlA-Ff.20 2024-09-14T11:40:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.494+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.21 2024-09-14T11:40:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.494+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.22 2024-09-14T11:40:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.494+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.23 2024-09-14T11:40:04.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.498+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.24 2024-09-14T11:40:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.498+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.25 2024-09-14T11:40:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.498+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.26 2024-09-14T11:40:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.498+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.27 2024-09-14T11:40:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.498+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.28 2024-09-14T11:40:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.502+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.29 2024-09-14T11:40:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.502+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.30 2024-09-14T11:40:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.502+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.31 2024-09-14T11:40:04.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.502+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.32 2024-09-14T11:40:04.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.502+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.33 2024-09-14T11:40:04.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.502+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.34 2024-09-14T11:40:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.506+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.35 2024-09-14T11:40:04.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.506+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.36 2024-09-14T11:40:04.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.506+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.37 2024-09-14T11:40:04.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.506+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.38 2024-09-14T11:40:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.39 2024-09-14T11:40:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.40 2024-09-14T11:40:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.41 2024-09-14T11:40:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.42 2024-09-14T11:40:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.43 2024-09-14T11:40:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.44 2024-09-14T11:40:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.45 2024-09-14T11:40:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.46 2024-09-14T11:40:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.510+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.47 2024-09-14T11:40:04.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.514+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.48 2024-09-14T11:40:04.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.514+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.49 2024-09-14T11:40:04.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.514+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.50 2024-09-14T11:40:04.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.514+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.51 2024-09-14T11:40:04.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.514+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.52 2024-09-14T11:40:04.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.514+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.53 2024-09-14T11:40:04.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.514+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.54 2024-09-14T11:40:04.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.514+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.55 2024-09-14T11:40:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.518+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:13.227195+0000, chain.objs.size()=16 2024-09-14T11:40:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.518+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.56 2024-09-14T11:40:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.518+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.57 2024-09-14T11:40:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.518+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.58 2024-09-14T11:40:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.522+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.59 2024-09-14T11:40:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.522+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.60 2024-09-14T11:40:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.522+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.61 2024-09-14T11:40:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.522+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.62 2024-09-14T11:40:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.522+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.63 2024-09-14T11:40:04.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.522+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.64 2024-09-14T11:40:04.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.522+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.65 2024-09-14T11:40:04.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.522+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.66 2024-09-14T11:40:04.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.67 2024-09-14T11:40:04.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.68 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.69 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.70 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.71 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:14.624792+0000, chain.objs.size()=2 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.72 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.73 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:15.944306+0000, chain.objs.size()=8 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.74 2024-09-14T11:40:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.526+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.75 2024-09-14T11:40:04.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.76 2024-09-14T11:40:04.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.77 2024-09-14T11:40:04.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.78 2024-09-14T11:40:04.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.79 2024-09-14T11:40:04.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.80 2024-09-14T11:40:04.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.81 2024-09-14T11:40:04.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:17.367754+0000, chain.objs.size()=3 2024-09-14T11:40:04.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.82 2024-09-14T11:40:04.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.530+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.83 2024-09-14T11:40:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.534+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.84 2024-09-14T11:40:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.534+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:18.716371+0000, chain.objs.size()=9 2024-09-14T11:40:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.534+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.85 2024-09-14T11:40:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.534+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.86 2024-09-14T11:40:04.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.87 2024-09-14T11:40:04.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.88 2024-09-14T11:40:04.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.89 2024-09-14T11:40:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.90 2024-09-14T11:40:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.91 2024-09-14T11:40:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.92 2024-09-14T11:40:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.93 2024-09-14T11:40:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:20.241577+0000, chain.objs.size()=6 2024-09-14T11:40:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.94 2024-09-14T11:40:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.95 2024-09-14T11:40:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.96 2024-09-14T11:40:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.538+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.97 2024-09-14T11:40:04.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.542+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.98 2024-09-14T11:40:04.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.542+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.99 2024-09-14T11:40:04.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:22.551451+0000, chain.objs.size()=9 2024-09-14T11:40:04.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.100 2024-09-14T11:40:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.101 2024-09-14T11:40:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.102 2024-09-14T11:40:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.103 2024-09-14T11:40:04.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.104 2024-09-14T11:40:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.105 2024-09-14T11:40:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.106 2024-09-14T11:40:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.107 2024-09-14T11:40:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.109 2024-09-14T11:40:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:24.208602+0000, chain.objs.size()=3 2024-09-14T11:40:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.546+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.108 2024-09-14T11:40:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.550+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.110 2024-09-14T11:40:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.111 2024-09-14T11:40:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:26.075944+0000, chain.objs.size()=10 2024-09-14T11:40:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.112 2024-09-14T11:40:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.113 2024-09-14T11:40:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.114 2024-09-14T11:40:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.115 2024-09-14T11:40:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.116 2024-09-14T11:40:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.117 2024-09-14T11:40:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.118 2024-09-14T11:40:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.554+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.119 2024-09-14T11:40:04.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.558+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.120 2024-09-14T11:40:04.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.558+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.121 2024-09-14T11:40:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.558+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:27.555227+0000, chain.objs.size()=6 2024-09-14T11:40:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.558+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.122 2024-09-14T11:40:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.558+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.123 2024-09-14T11:40:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.558+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.124 2024-09-14T11:40:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.558+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.125 2024-09-14T11:40:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.562+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.126 2024-09-14T11:40:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.562+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.127 2024-09-14T11:40:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.562+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:29.712902+0000, chain.objs.size()=11 2024-09-14T11:40:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.562+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.128 2024-09-14T11:40:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.562+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.129 2024-09-14T11:40:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.562+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.130 2024-09-14T11:40:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.131 2024-09-14T11:40:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.132 2024-09-14T11:40:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.133 2024-09-14T11:40:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.134 2024-09-14T11:40:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.135 2024-09-14T11:40:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.136 2024-09-14T11:40:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.137 2024-09-14T11:40:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.139 2024-09-14T11:40:04.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:31.503184+0000, chain.objs.size()=2 2024-09-14T11:40:04.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.566+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.138 2024-09-14T11:40:04.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.570+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.140 2024-09-14T11:40:04.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.570+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:33.066612+0000, chain.objs.size()=10 2024-09-14T11:40:04.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.570+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.141 2024-09-14T11:40:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.570+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.142 2024-09-14T11:40:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.570+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.143 2024-09-14T11:40:04.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.574+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.144 2024-09-14T11:40:04.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.574+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.145 2024-09-14T11:40:04.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.574+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.146 2024-09-14T11:40:04.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.574+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.147 2024-09-14T11:40:04.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.574+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.148 2024-09-14T11:40:04.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.574+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.149 2024-09-14T11:40:04.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.574+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.150 2024-09-14T11:40:04.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.578+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:34.473751+0000, chain.objs.size()=4 2024-09-14T11:40:04.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.578+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.151 2024-09-14T11:40:04.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.578+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.152 2024-09-14T11:40:04.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.578+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.153 2024-09-14T11:40:04.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.578+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.154 2024-09-14T11:40:04.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:47.246597+0000, chain.objs.size()=1 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.15 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:47.283434+0000, chain.objs.size()=1 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.16 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:47.300528+0000, chain.objs.size()=1 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.17 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:47.316714+0000, chain.objs.size()=1 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.18 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:47.340795+0000, chain.objs.size()=1 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.19 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:47.445243+0000, chain.objs.size()=1 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.20 2024-09-14T11:40:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:47.633678+0000, chain.objs.size()=207 2024-09-14T11:40:04.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.1 2024-09-14T11:40:04.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.582+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.2 2024-09-14T11:40:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.3 2024-09-14T11:40:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.4 2024-09-14T11:40:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.5 2024-09-14T11:40:04.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.6 2024-09-14T11:40:04.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.7 2024-09-14T11:40:04.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.8 2024-09-14T11:40:04.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.9 2024-09-14T11:40:04.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.10 2024-09-14T11:40:04.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.11 2024-09-14T11:40:04.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.12 2024-09-14T11:40:04.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.13 2024-09-14T11:40:04.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.586+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.14 2024-09-14T11:40:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.oo3mcCzaam3qaSFiQJl6GaRrujV6-OoK.15 2024-09-14T11:40:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.F1h7D-i7vJWtdgTwzG06TRy6s0b-bFxd.16 2024-09-14T11:40:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.0ZLALZXR1in_bKMIBhoTKaHa08c6Ptwi.17 2024-09-14T11:40:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.ijwyXHCPC5Sb_gaGl9FyqDN2tsGY0_Yb.18 2024-09-14T11:40:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.rH0KjS8k3xN84vMWOjfkgKxL0OQ4RnPT.19 2024-09-14T11:40:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.ROo5A3CB0StgDS_53QizIdJTDXWlA-Ff.20 2024-09-14T11:40:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.21 2024-09-14T11:40:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.22 2024-09-14T11:40:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.23 2024-09-14T11:40:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.24 2024-09-14T11:40:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.590+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.25 2024-09-14T11:40:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.26 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.27 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.28 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.29 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.30 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.31 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.32 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.33 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.34 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.35 2024-09-14T11:40:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.594+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.36 2024-09-14T11:40:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.37 2024-09-14T11:40:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.38 2024-09-14T11:40:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.39 2024-09-14T11:40:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.40 2024-09-14T11:40:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.41 2024-09-14T11:40:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.42 2024-09-14T11:40:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.43 2024-09-14T11:40:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.44 2024-09-14T11:40:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.45 2024-09-14T11:40:04.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.46 2024-09-14T11:40:04.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.598+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.47 2024-09-14T11:40:04.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.602+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.48 2024-09-14T11:40:04.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.602+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.49 2024-09-14T11:40:04.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.602+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.50 2024-09-14T11:40:04.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.602+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.51 2024-09-14T11:40:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.602+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.52 2024-09-14T11:40:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.53 2024-09-14T11:40:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.54 2024-09-14T11:40:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.55 2024-09-14T11:40:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.56 2024-09-14T11:40:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.57 2024-09-14T11:40:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.58 2024-09-14T11:40:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.59 2024-09-14T11:40:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.60 2024-09-14T11:40:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.61 2024-09-14T11:40:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.62 2024-09-14T11:40:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.63 2024-09-14T11:40:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.64 2024-09-14T11:40:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.65 2024-09-14T11:40:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.606+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.66 2024-09-14T11:40:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.610+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.67 2024-09-14T11:40:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.610+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.68 2024-09-14T11:40:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.610+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.69 2024-09-14T11:40:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.610+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.70 2024-09-14T11:40:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.610+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.71 2024-09-14T11:40:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.610+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.72 2024-09-14T11:40:04.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.610+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.73 2024-09-14T11:40:04.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.74 2024-09-14T11:40:04.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.75 2024-09-14T11:40:04.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.76 2024-09-14T11:40:04.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.77 2024-09-14T11:40:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.78 2024-09-14T11:40:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.79 2024-09-14T11:40:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.80 2024-09-14T11:40:04.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.81 2024-09-14T11:40:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.82 2024-09-14T11:40:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.83 2024-09-14T11:40:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.84 2024-09-14T11:40:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.85 2024-09-14T11:40:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.614+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.86 2024-09-14T11:40:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.87 2024-09-14T11:40:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.88 2024-09-14T11:40:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.89 2024-09-14T11:40:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.90 2024-09-14T11:40:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.91 2024-09-14T11:40:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.92 2024-09-14T11:40:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.93 2024-09-14T11:40:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.94 2024-09-14T11:40:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.95 2024-09-14T11:40:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.96 2024-09-14T11:40:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.618+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.97 2024-09-14T11:40:04.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.98 2024-09-14T11:40:04.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.99 2024-09-14T11:40:04.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.100 2024-09-14T11:40:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.101 2024-09-14T11:40:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.102 2024-09-14T11:40:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.103 2024-09-14T11:40:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.104 2024-09-14T11:40:04.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.105 2024-09-14T11:40:04.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.106 2024-09-14T11:40:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.107 2024-09-14T11:40:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.622+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.108 2024-09-14T11:40:04.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.109 2024-09-14T11:40:04.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.110 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.111 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.112 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.113 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.114 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.115 2024-09-14T11:40:04.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.116 2024-09-14T11:40:04.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.626+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.117 2024-09-14T11:40:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.118 2024-09-14T11:40:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.119 2024-09-14T11:40:04.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.120 2024-09-14T11:40:04.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.121 2024-09-14T11:40:04.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.122 2024-09-14T11:40:04.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.123 2024-09-14T11:40:04.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.124 2024-09-14T11:40:04.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.125 2024-09-14T11:40:04.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.126 2024-09-14T11:40:04.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.127 2024-09-14T11:40:04.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.128 2024-09-14T11:40:04.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.129 2024-09-14T11:40:04.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.630+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.130 2024-09-14T11:40:04.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.131 2024-09-14T11:40:04.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.132 2024-09-14T11:40:04.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.133 2024-09-14T11:40:04.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.134 2024-09-14T11:40:04.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.135 2024-09-14T11:40:04.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.136 2024-09-14T11:40:04.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.137 2024-09-14T11:40:04.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.138 2024-09-14T11:40:04.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.139 2024-09-14T11:40:04.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.140 2024-09-14T11:40:04.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.634+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.141 2024-09-14T11:40:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.638+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.142 2024-09-14T11:40:04.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.638+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.143 2024-09-14T11:40:04.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.638+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.144 2024-09-14T11:40:04.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.145 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.146 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.147 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.148 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.149 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.150 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.151 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.152 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.153 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.154 2024-09-14T11:40:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.155 2024-09-14T11:40:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.642+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.156 2024-09-14T11:40:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.646+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.157 2024-09-14T11:40:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.646+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.158 2024-09-14T11:40:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.646+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.159 2024-09-14T11:40:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.646+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.160 2024-09-14T11:40:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.646+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.161 2024-09-14T11:40:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.646+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.162 2024-09-14T11:40:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.163 2024-09-14T11:40:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.164 2024-09-14T11:40:04.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.165 2024-09-14T11:40:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.166 2024-09-14T11:40:04.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.167 2024-09-14T11:40:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.168 2024-09-14T11:40:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.169 2024-09-14T11:40:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.170 2024-09-14T11:40:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.171 2024-09-14T11:40:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.172 2024-09-14T11:40:04.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.650+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.173 2024-09-14T11:40:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.654+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.174 2024-09-14T11:40:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.654+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.175 2024-09-14T11:40:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.654+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.176 2024-09-14T11:40:04.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.654+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.177 2024-09-14T11:40:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.654+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.178 2024-09-14T11:40:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.654+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.179 2024-09-14T11:40:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.658+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.180 2024-09-14T11:40:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.658+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.181 2024-09-14T11:40:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.658+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.182 2024-09-14T11:40:04.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.658+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.183 2024-09-14T11:40:04.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.658+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.184 2024-09-14T11:40:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.185 2024-09-14T11:40:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.186 2024-09-14T11:40:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.187 2024-09-14T11:40:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.188 2024-09-14T11:40:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.189 2024-09-14T11:40:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.190 2024-09-14T11:40:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.191 2024-09-14T11:40:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.192 2024-09-14T11:40:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.193 2024-09-14T11:40:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.194 2024-09-14T11:40:04.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.662+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.195 2024-09-14T11:40:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.666+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.196 2024-09-14T11:40:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.666+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.197 2024-09-14T11:40:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.666+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.198 2024-09-14T11:40:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.666+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.199 2024-09-14T11:40:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.670+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.200 2024-09-14T11:40:04.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.670+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.201 2024-09-14T11:40:04.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.670+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.202 2024-09-14T11:40:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.670+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.203 2024-09-14T11:40:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.670+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.204 2024-09-14T11:40:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.670+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.205 2024-09-14T11:40:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.670+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.206 2024-09-14T11:40:04.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.674+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.208 2024-09-14T11:40:04.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.674+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-', time=2024-09-14T13:38:47.916224+0000, chain.objs.size()=5 2024-09-14T11:40:04.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.674+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.207 2024-09-14T11:40:04.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.674+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.209 2024-09-14T11:40:04.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.674+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.210 2024-09-14T11:40:04.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.674+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.211 2024-09-14T11:40:04.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.678+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.106__multipart_key1.2~1wbOA9PzfrQtJK7UvAPXTm13E0MDaL-.212 2024-09-14T11:40:04.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.678+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12590956730349293350', time=2024-09-14T13:39:00.961607+0000, chain.objs.size()=1 2024-09-14T11:40:04.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.678+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.117__shadow_.zYPd2o_AHsPnffrYYec1Vm34L5pfmib_0 2024-09-14T11:40:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.678+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4961707119430870037', time=2024-09-14T13:39:22.459238+0000, chain.objs.size()=1 2024-09-14T11:40:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.678+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.131__shadow_.kDcoDCNPgPhNll8oIBfJ39PX98gtah9_0 2024-09-14T11:40:04.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.682+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.686+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:04.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:40:04.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18244176469899700568', time=2024-09-14T13:38:54.721192+0000, chain.objs.size()=1 2024-09-14T11:40:04.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.113__shadow_.XyEDeS3lnBQ0QxbuA97wVc0m4DTpB34_0 2024-09-14T11:40:04.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5105170126987164213', time=2024-09-14T13:39:00.812298+0000, chain.objs.size()=1 2024-09-14T11:40:04.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.117__shadow_.S5CLShecaNnKXUXAjBgjdshxgQ1v27h_0 2024-09-14T11:40:04.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6056710006921040975', time=2024-09-14T13:39:07.178119+0000, chain.objs.size()=1 2024-09-14T11:40:04.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.121__shadow_.nrt2lPNuiRtETf7xO72xayn1nwVXWHU_0 2024-09-14T11:40:04.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9947229368194334937', time=2024-09-14T13:39:17.932780+0000, chain.objs.size()=1 2024-09-14T11:40:04.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.690+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.128__shadow_.quA9E2URg4hDz5ERMbcFS2HRG1FDFZE_0 2024-09-14T11:40:04.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.694+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.694+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:04.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1858252281353975272', time=2024-09-14T13:34:39.156327+0000, chain.objs.size()=9 2024-09-14T11:40:04.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__multipart_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.1 2024-09-14T11:40:04.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__shadow_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.1_1 2024-09-14T11:40:04.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__multipart_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.2 2024-09-14T11:40:04.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__shadow_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.2_1 2024-09-14T11:40:04.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__multipart_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.3 2024-09-14T11:40:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__shadow_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.3_1 2024-09-14T11:40:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__multipart_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.4 2024-09-14T11:40:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__shadow_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.4_1 2024-09-14T11:40:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.99__multipart_key1.2~z9leRMKC9-Mib-sr3oakyzm7d1iykqY.5 2024-09-14T11:40:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17819578719077815522', time=2024-09-14T13:35:36.594086+0000, chain.objs.size()=9 2024-09-14T11:40:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.1 2024-09-14T11:40:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__shadow_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.1_1 2024-09-14T11:40:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.698+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.2 2024-09-14T11:40:04.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.702+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__shadow_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.2_1 2024-09-14T11:40:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.702+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.3 2024-09-14T11:40:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.702+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__shadow_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.3_1 2024-09-14T11:40:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.706+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.4 2024-09-14T11:40:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.706+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__shadow_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.4_1 2024-09-14T11:40:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.706+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file.mpg.2~R0OwRiLKDhAEXdutjr_Y2aER2qrsXuV.5 2024-09-14T11:40:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.710+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.710+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:40:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4289952214302776024', time=2024-09-14T13:34:22.188961+0000, chain.objs.size()=7 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~h01V1vsIsc0L7TGfT6wPLYIsj22ONls.1 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~h01V1vsIsc0L7TGfT6wPLYIsj22ONls.1_1 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~h01V1vsIsc0L7TGfT6wPLYIsj22ONls.1_2 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~h01V1vsIsc0L7TGfT6wPLYIsj22ONls.2 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~h01V1vsIsc0L7TGfT6wPLYIsj22ONls.2_1 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~h01V1vsIsc0L7TGfT6wPLYIsj22ONls.2_2 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~h01V1vsIsc0L7TGfT6wPLYIsj22ONls.3 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6903658875195765233', time=2024-09-14T13:39:16.374252+0000, chain.objs.size()=1 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.127__shadow_.HJOh0ENJPam6sRZRwIwq86PR7lEoxXl_0 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14963334546723400772', time=2024-09-14T13:39:25.416401+0000, chain.objs.size()=1 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.133__shadow_.Ua6YFwmqI5D6I-3ct5r6Z9U1UpzhILC_0 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7716404630456001274', time=2024-09-14T13:40:03.260788+0000, chain.objs.size()=9 2024-09-14T11:40:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__multipart_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.1 2024-09-14T11:40:04.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__shadow_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.1_1 2024-09-14T11:40:04.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.714+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__multipart_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.2 2024-09-14T11:40:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.718+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__shadow_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.2_1 2024-09-14T11:40:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.718+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__multipart_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.3 2024-09-14T11:40:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.718+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__shadow_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.3_1 2024-09-14T11:40:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.722+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__multipart_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.4 2024-09-14T11:40:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.722+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__shadow_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.4_1 2024-09-14T11:40:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.722+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.145__multipart_key1/data/file.mpg.2~z3qbFCX8Gzaqqne1D1UPEqOHmsJyOLD.5 2024-09-14T11:40:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.726+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:04.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10937881774813608442', time=2024-09-14T13:32:37.331047+0000, chain.objs.size()=1 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.78__shadow_.unKtpjvxsZLECBuAWTBnVZpKJwB-CK8_0 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13571846793183681415', time=2024-09-14T13:33:05.163441+0000, chain.objs.size()=1 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.86__shadow_.3YI1-r-fVNTZK2lMwtNDnhnFx1dTPuW_0 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17351398969137444499', time=2024-09-14T13:39:11.700512+0000, chain.objs.size()=1 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.124__shadow_.ZbCBd2MHJ4kInCGFV0m4tzHYk2E6LZF_0 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10969845397045557503', time=2024-09-14T13:39:20.964946+0000, chain.objs.size()=1 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.130__shadow_.Q-079ZKcBEbxJYZDXaehBc4uvWXD1-6_0 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13806470937275350823', time=2024-09-14T13:39:25.339133+0000, chain.objs.size()=1 2024-09-14T11:40:04.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.730+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.133__shadow_.oQ2L5ShAmF0jd5eM5AObr6tFXmKtW0b_0 2024-09-14T11:40:04.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.734+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.738+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.738+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.738+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:04.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.818820855799621980', time=2024-09-14T13:37:30.093269+0000, chain.objs.size()=9 2024-09-14T11:40:04.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__multipart_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.1 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__shadow_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.1_1 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__multipart_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.2 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__shadow_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.2_1 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__multipart_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.3 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__shadow_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.3_1 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__multipart_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.4 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__shadow_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.4_1 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__multipart_key1.2~aG4lNwinlbk5RoZAF9Sa6gM6LXuuh_X.5 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5929404704726591780', time=2024-09-14T13:38:54.870893+0000, chain.objs.size()=1 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.113__shadow_.fh50paoWby4Q2oF9jlwEa4ikXwisKd3_0 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4266113209060144707', time=2024-09-14T13:39:26.747212+0000, chain.objs.size()=1 2024-09-14T11:40:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.742+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.134__shadow_.R3tojkgUa0HUqqdSn1VhdRIDy06rJj3_0 2024-09-14T11:40:04.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.746+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.750+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:04.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.750+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM', time=2024-09-14T13:35:57.836440+0000, chain.objs.size()=9 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__multipart_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.7 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__shadow_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.7_1 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__multipart_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.8 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__shadow_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.8_1 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__multipart_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.9 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__shadow_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.9_1 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__multipart_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.10 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__shadow_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.10_1 2024-09-14T11:40:04.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.754+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.102__multipart_key1.2~80iapyZ2GkHPcCnAxJI3Rjj8xI_HMDM.11 2024-09-14T11:40:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.758+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:04.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3', time=2024-09-14T13:32:50.427822+0000, chain.objs.size()=9 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__multipart_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.1 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__shadow_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.1_1 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__multipart_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.2 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__shadow_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.2_1 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__multipart_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.3 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__shadow_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.3_1 2024-09-14T11:40:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__multipart_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.4 2024-09-14T11:40:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__shadow_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.4_1 2024-09-14T11:40:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.80__multipart_key1.2~mtD5FN6dBaTk9dYkXuLL5a2glzB9bD3.5 2024-09-14T11:40:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.249272534595051087', time=2024-09-14T13:38:54.642028+0000, chain.objs.size()=1 2024-09-14T11:40:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.113__shadow_.q8JfRXpxL-YLkGGC63fERRtMc5qPEXv_0 2024-09-14T11:40:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14872300151369777500', time=2024-09-14T13:39:10.307328+0000, chain.objs.size()=1 2024-09-14T11:40:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.123__shadow_.tMl9RDOSvpxikPnLNy4bysJZS9gZO8q_0 2024-09-14T11:40:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12139251311090073981', time=2024-09-14T13:39:31.747967+0000, chain.objs.size()=1 2024-09-14T11:40:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.762+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.139__shadow_.SPOqT28wlEj49T4GobmYfY_feb2n0zA_0 2024-09-14T11:40:04.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.770+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:04.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:04.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6628932561047373603', time=2024-09-14T13:39:04.233703+0000, chain.objs.size()=1 2024-09-14T11:40:04.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.119__shadow_.1z41ohWb9_utsyLREjqYyVOxIdv2Dn4_0 2024-09-14T11:40:04.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10562533227413502074', time=2024-09-14T13:39:13.286111+0000, chain.objs.size()=1 2024-09-14T11:40:04.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.125__shadow_.X1gzaypoIwSrt8NrEhHI9ATDsrpw80z_0 2024-09-14T11:40:04.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17448329629782712876', time=2024-09-14T13:39:16.272998+0000, chain.objs.size()=1 2024-09-14T11:40:04.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.774+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.127__shadow_.QWTm7Hp_5EOoXYzGD0dBu99ZBiw9jG9_0 2024-09-14T11:40:04.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.778+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.778+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:40:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4550626520298639023', time=2024-09-14T13:38:57.989720+0000, chain.objs.size()=1 2024-09-14T11:40:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.115__shadow_.9yf_cbYZ1CKmd0AUfJQWDm6wgCOLxS1_0 2024-09-14T11:40:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2058814611518462504', time=2024-09-14T13:39:16.191601+0000, chain.objs.size()=1 2024-09-14T11:40:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.127__shadow_.K0tEgKJkbLAX5kxm6zr5EroxH21Be2y_0 2024-09-14T11:40:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10040974628532464024', time=2024-09-14T13:39:24.032488+0000, chain.objs.size()=1 2024-09-14T11:40:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.132__shadow_.5qkHqgS--U341U-73HCv7Xu3CcE9ubl_0 2024-09-14T11:40:04.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.782+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.786+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.786+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.786+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.786+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.786+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4421249389124517741', time=2024-09-14T13:36:31.881127+0000, chain.objs.size()=9 2024-09-14T11:40:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.786+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.1 2024-09-14T11:40:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.786+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.1_1 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.2 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.2_1 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.3 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.3_1 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.4 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.4_1 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~suwI765St6UDh9lhovSnjiIOyUv3QWP.5 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12829466123670780636', time=2024-09-14T13:39:11.776381+0000, chain.objs.size()=1 2024-09-14T11:40:04.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.790+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.124__shadow_.PCNVSabszDqPrDVV9q_gQ7gQd4f5Nxv_0 2024-09-14T11:40:04.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.794+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3519041163744828945', time=2024-09-14T13:34:14.130592+0000, chain.objs.size()=9 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.1 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.1_1 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.2 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.2_1 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.3 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.3_1 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.4 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.4_1 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~lWSOmRKmla6XRKTsdQX3z266Sr5eIor.5 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16067839666301088431', time=2024-09-14T13:36:20.397873+0000, chain.objs.size()=9 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.1 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.1_1 2024-09-14T11:40:04.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.798+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.2 2024-09-14T11:40:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.802+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.2_1 2024-09-14T11:40:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.802+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.3 2024-09-14T11:40:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.802+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.3_1 2024-09-14T11:40:04.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.802+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.4 2024-09-14T11:40:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.802+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.4_1 2024-09-14T11:40:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.802+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~xDnqQflD48DdTzC9qtp1g-p-fidnzrB.5 2024-09-14T11:40:04.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15288428304287039911', time=2024-09-14T13:38:57.838669+0000, chain.objs.size()=1 2024-09-14T11:40:04.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.115__shadow_.roRA_p6AVm9l1O_PKi-sMV-jHJFt_Y5_0 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9261083486999692609', time=2024-09-14T13:39:04.002530+0000, chain.objs.size()=1 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.119__shadow_.T9mV-QmuG2Zev1G1_ds6sX-LuSVTnYn_0 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9335720168045842714', time=2024-09-14T13:39:07.255664+0000, chain.objs.size()=1 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.121__shadow_.h6Y-fBtxhT98ralhnCV33IDhcqOABb4_0 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5952709012421398827', time=2024-09-14T13:39:49.709518+0000, chain.objs.size()=9 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__multipart_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.1 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__shadow_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.1_1 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__multipart_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.2 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__shadow_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.2_1 2024-09-14T11:40:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.806+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__multipart_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.3 2024-09-14T11:40:04.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.810+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__shadow_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.3_1 2024-09-14T11:40:04.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.810+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__multipart_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.4 2024-09-14T11:40:04.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.814+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__shadow_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.4_1 2024-09-14T11:40:04.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.814+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.144__multipart_key1.2~yhvb4AT_F97yuiahH0KvGGC5kj-kWqN.5 2024-09-14T11:40:04.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.818+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.818+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:04.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:40:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16065667375102724551', time=2024-09-14T13:38:57.915442+0000, chain.objs.size()=1 2024-09-14T11:40:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.115__shadow_.jRQRVoScR4p0k3-p4ZZIOg-OfVNVpqV_0 2024-09-14T11:40:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16603951407597899445', time=2024-09-14T13:39:00.886515+0000, chain.objs.size()=1 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.117__shadow_.P3MoPksZ_J1elETX0KZguDLjl81NDGQ_0 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15034477815767438703', time=2024-09-14T13:39:08.888546+0000, chain.objs.size()=1 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.122__shadow_.tDgHbHtvePh52Wzq0A4dF2F92x1emHp_0 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7602369399286603003', time=2024-09-14T13:39:14.683494+0000, chain.objs.size()=1 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.126__shadow_.U1Kt-lkWj5g9ojhJ6mzjv29mc2EsKZP_0 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2770333876291986414', time=2024-09-14T13:39:14.830888+0000, chain.objs.size()=1 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.126__shadow_.wAFcD0orkV7gCJ6hKcmsKoDtPJuO2wM_0 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15584592600058949495', time=2024-09-14T13:39:17.769864+0000, chain.objs.size()=1 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.128__shadow_.UM-4yt2dwhcd31rZ9CxmjFAgEmSKHt1_0 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6475873237261216323', time=2024-09-14T13:39:19.496889+0000, chain.objs.size()=1 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.129__shadow_.Bvsk6uh5Q3saVATp4C0QWXmehEfz8g1_0 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10155509065509716640', time=2024-09-14T13:39:23.966591+0000, chain.objs.size()=1 2024-09-14T11:40:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.132__shadow_.qFRv9Jy0YSL-TT2kiwU3p5dYlTywzaB_0 2024-09-14T11:40:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16788933660629921889', time=2024-09-14T13:39:33.481381+0000, chain.objs.size()=1 2024-09-14T11:40:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.822+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.140__shadow_.jo3QoLHuJx6xdTHyLokoHSbDPnVFKLJ_0 2024-09-14T11:40:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.826+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3778014198406719978', time=2024-09-14T13:35:36.745740+0000, chain.objs.size()=5 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file2.mpg.2~OSZAUcQILu7zdVgqiZnM-JGiSpKYY-R.1 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file2.mpg.2~OSZAUcQILu7zdVgqiZnM-JGiSpKYY-R.2 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file2.mpg.2~OSZAUcQILu7zdVgqiZnM-JGiSpKYY-R.3 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file2.mpg.2~OSZAUcQILu7zdVgqiZnM-JGiSpKYY-R.4 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__multipart_file2.mpg.2~OSZAUcQILu7zdVgqiZnM-JGiSpKYY-R.5 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8531047848396611261', time=2024-09-14T13:39:26.661297+0000, chain.objs.size()=1 2024-09-14T11:40:04.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.830+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.134__shadow_.IjrAGk6cs3CBMjrfapEfgG2GZR5QIVv_0 2024-09-14T11:40:04.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.834+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.838+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:04.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.838+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.838+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.838+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.838+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14283710113299831780', time=2024-09-14T13:33:32.587176+0000, chain.objs.size()=9 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.838+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.1 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.838+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__shadow_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.1_1 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.838+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.2 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__shadow_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.2_1 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.3 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__shadow_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.3_1 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.4 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__shadow_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.4_1 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.92__multipart_key1.2~oaeOdnJf3NFqlhvYiinyh3xondMuiks.5 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9166269486553519534', time=2024-09-14T13:34:09.959959+0000, chain.objs.size()=9 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.1 2024-09-14T11:40:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.1_1 2024-09-14T11:40:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.842+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.2 2024-09-14T11:40:04.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.846+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.2_1 2024-09-14T11:40:04.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.846+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.3 2024-09-14T11:40:04.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.846+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.3_1 2024-09-14T11:40:04.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.846+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.4 2024-09-14T11:40:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.850+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.4_1 2024-09-14T11:40:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.850+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~j1SyRG3uV4hRJMwceMTYWftFiyqEvlB.5 2024-09-14T11:40:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.850+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11383660717744826708', time=2024-09-14T13:39:04.155932+0000, chain.objs.size()=1 2024-09-14T11:40:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.850+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.119__shadow_.6s3EJfIlsKOvh_KJGMWuzlHmbIkH2HB_0 2024-09-14T11:40:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.850+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10840538890718850838', time=2024-09-14T13:39:05.718386+0000, chain.objs.size()=1 2024-09-14T11:40:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.850+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.120__shadow_.LoteFy4e_SLWjQBWhSRZv4VMxbNOGDz_0 2024-09-14T11:40:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.850+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15477407558177453447', time=2024-09-14T13:39:20.887531+0000, chain.objs.size()=1 2024-09-14T11:40:04.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.850+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.130__shadow_.hkn5SCNi1MJ4-0PDGT4Qs7-zVUd-N9E_0 2024-09-14T11:40:04.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.854+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:04.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:40:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2359608643387251000', time=2024-09-14T13:34:23.116806+0000, chain.objs.size()=7 2024-09-14T11:40:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~jsFTH4rVHBIawThWy4cZZ9HiGHaMkvF.1 2024-09-14T11:40:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~jsFTH4rVHBIawThWy4cZZ9HiGHaMkvF.1_1 2024-09-14T11:40:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~jsFTH4rVHBIawThWy4cZZ9HiGHaMkvF.1_2 2024-09-14T11:40:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~jsFTH4rVHBIawThWy4cZZ9HiGHaMkvF.2 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~jsFTH4rVHBIawThWy4cZZ9HiGHaMkvF.2_1 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~jsFTH4rVHBIawThWy4cZZ9HiGHaMkvF.2_2 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~jsFTH4rVHBIawThWy4cZZ9HiGHaMkvF.3 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1363438472726191352', time=2024-09-14T13:35:36.658538+0000, chain.objs.size()=1 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__shadow_.KfxIX54G1qON3rOjqpRTyjAgejtjnWq_0 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8805043630135868645', time=2024-09-14T13:36:54.007856+0000, chain.objs.size()=7 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~P3iTn_pbhGllflZCPmAKnc0YUtKVaRI.1 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~P3iTn_pbhGllflZCPmAKnc0YUtKVaRI.1_1 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~P3iTn_pbhGllflZCPmAKnc0YUtKVaRI.1_2 2024-09-14T11:40:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.858+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~P3iTn_pbhGllflZCPmAKnc0YUtKVaRI.2 2024-09-14T11:40:04.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.862+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~P3iTn_pbhGllflZCPmAKnc0YUtKVaRI.2_1 2024-09-14T11:40:04.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.862+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~P3iTn_pbhGllflZCPmAKnc0YUtKVaRI.2_2 2024-09-14T11:40:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~P3iTn_pbhGllflZCPmAKnc0YUtKVaRI.3 2024-09-14T11:40:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2746692035213462286', time=2024-09-14T13:38:56.224126+0000, chain.objs.size()=1 2024-09-14T11:40:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.114__shadow_.dkA6SZ85gH-v-FYg5VRTzCAY8LnJK1t_0 2024-09-14T11:40:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10439370389168128379', time=2024-09-14T13:38:59.435255+0000, chain.objs.size()=1 2024-09-14T11:40:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.116__shadow_.Tn0Ba6QMXx1CoIz-An1lDyhGM7Dz__N_0 2024-09-14T11:40:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6265955832477771001', time=2024-09-14T13:39:01.029275+0000, chain.objs.size()=1 2024-09-14T11:40:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.117__shadow_.WFGZIscoSEJ-G03BnF13uwBVJjPbmLv_0 2024-09-14T11:40:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18322728297676975217', time=2024-09-14T13:39:21.115320+0000, chain.objs.size()=1 2024-09-14T11:40:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.130__shadow_.VfavQJ0PvmxpV5fulh_9iw8QRX1WKsE_0 2024-09-14T11:40:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18373026984570202219', time=2024-09-14T13:39:22.611080+0000, chain.objs.size()=1 2024-09-14T11:40:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.866+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.131__shadow_.3kDHNWY2o225fvI9fuxoGM-BF3GmsSr_0 2024-09-14T11:40:04.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.870+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.874+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:04.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.874+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.874+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.874+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.874+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2689801971491910909', time=2024-09-14T13:39:02.647456+0000, chain.objs.size()=1 2024-09-14T11:40:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.874+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.118__shadow_.F2jDJzRknKIe9OMtF6AH_jHGmq1OLui_0 2024-09-14T11:40:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.874+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17339362439552684429', time=2024-09-14T13:39:08.810530+0000, chain.objs.size()=1 2024-09-14T11:40:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.874+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.122__shadow_.4H-fLiKxasWuD3QHd6XKIyqo3-sGsEp_0 2024-09-14T11:40:04.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.878+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.878+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:04.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:40:04.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8394064549792569107', time=2024-09-14T13:39:08.659951+0000, chain.objs.size()=1 2024-09-14T11:40:04.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.122__shadow_.pxU1m3IVvqfAIEI6ngttVEXRUuNLkRk_0 2024-09-14T11:40:04.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2099072249870479661', time=2024-09-14T13:39:10.233393+0000, chain.objs.size()=1 2024-09-14T11:40:04.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.123__shadow_.R7OffNzzgESkfeeUNNvrC-1IFHdxQZc_0 2024-09-14T11:40:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11637918058309172986', time=2024-09-14T13:39:13.208249+0000, chain.objs.size()=1 2024-09-14T11:40:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.125__shadow_.LwxvXbALpTfZgYi8qIvbDUEKVxkD8oB_0 2024-09-14T11:40:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13974018426556091453', time=2024-09-14T13:39:31.916816+0000, chain.objs.size()=1 2024-09-14T11:40:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.139__shadow_.UCimI81frnBWkf0jMeVgMdiui2ZSvK1_0 2024-09-14T11:40:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3489434646600245750', time=2024-09-14T13:39:34.545310+0000, chain.objs.size()=1 2024-09-14T11:40:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.882+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.141__shadow_.hOOR4x4GOROpogs94r3ez2dmCw-OP5A_0 2024-09-14T11:40:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.886+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.890+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:04.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.890+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:40:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2454143780162049341', time=2024-09-14T13:35:36.821369+0000, chain.objs.size()=1 2024-09-14T11:40:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.101__shadow_.ugKcMJcPzIfOhWaUiYeUzD6aMoQ8gzY_0 2024-09-14T11:40:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14628928662402379896', time=2024-09-14T13:39:07.332731+0000, chain.objs.size()=1 2024-09-14T11:40:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.121__shadow_.cjg3UpjEktkBoBcJWMsONjWZVEEl5rT_0 2024-09-14T11:40:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.283407494535162896', time=2024-09-14T13:39:14.605288+0000, chain.objs.size()=1 2024-09-14T11:40:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.126__shadow_.IguBmQ7fKJbVYuWbx0sCk-fY3x30FUq_0 2024-09-14T11:40:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1239448883313886746', time=2024-09-14T13:39:19.571588+0000, chain.objs.size()=1 2024-09-14T11:40:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.129__shadow_.tgEtVzKkOfdz09QHZoG1VR26LgHqwt1_0 2024-09-14T11:40:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12653107124348293430', time=2024-09-14T13:39:21.037892+0000, chain.objs.size()=1 2024-09-14T11:40:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.130__shadow_.WJyhMWy_OXCtTmH69txMxU-jQliivFx_0 2024-09-14T11:40:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.894+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.898+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:04.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.898+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.898+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.898+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:40:04.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.898+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9456233529754660052', time=2024-09-14T13:33:09.679562+0000, chain.objs.size()=1 2024-09-14T11:40:04.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.91__shadow_.nhObD_KSohEELDgqXHX0qitb6ZwLDnG_0 2024-09-14T11:40:04.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4161138482020050163', time=2024-09-14T13:33:55.498941+0000, chain.objs.size()=9 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.1 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.1_1 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.2 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.2_1 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.3 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.3_1 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.4 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.4_1 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~zx1NyGrRco124QFigL1PNH-npKaSeRL.5 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2019082107894735602', time=2024-09-14T13:37:14.119911+0000, chain.objs.size()=7 2024-09-14T11:40:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~ZT9IMBhclSzhXER6XBGcOnzkj9RB9OK.1 2024-09-14T11:40:04.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.902+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~ZT9IMBhclSzhXER6XBGcOnzkj9RB9OK.1_1 2024-09-14T11:40:04.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~ZT9IMBhclSzhXER6XBGcOnzkj9RB9OK.1_2 2024-09-14T11:40:04.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~ZT9IMBhclSzhXER6XBGcOnzkj9RB9OK.2 2024-09-14T11:40:04.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~ZT9IMBhclSzhXER6XBGcOnzkj9RB9OK.2_1 2024-09-14T11:40:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__shadow_key1.2~ZT9IMBhclSzhXER6XBGcOnzkj9RB9OK.2_2 2024-09-14T11:40:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.103__multipart_key1.2~ZT9IMBhclSzhXER6XBGcOnzkj9RB9OK.3 2024-09-14T11:40:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8808765611348712680', time=2024-09-14T13:37:26.197254+0000, chain.objs.size()=1 2024-09-14T11:40:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.104__shadow_.EkU_9bbqetJ7kopYKjfnUDZoikeEGL0_0 2024-09-14T11:40:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5552559955105771322', time=2024-09-14T13:38:59.559136+0000, chain.objs.size()=1 2024-09-14T11:40:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.906+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.116__shadow_.hGxDz6tkGZvlmVu4QKT2B3K_3rPcDaD_0 2024-09-14T11:40:04.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.910+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.914+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:04.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.914+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.918+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.918+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:40:04.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.918+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8214568378728132891', time=2024-09-14T13:38:58.065548+0000, chain.objs.size()=1 2024-09-14T11:40:04.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.918+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.115__shadow_.dTAOclzMeHjNWTVDAAvOSHMs_KELxPB_0 2024-09-14T11:40:04.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.918+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6732386516314088090', time=2024-09-14T13:39:29.744662+0000, chain.objs.size()=1 2024-09-14T11:40:04.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.918+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.137__shadow_.YxkHbj718o2BPWexQIm4GINWYng02w__0 2024-09-14T11:40:04.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.918+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:04.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:40:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11312183233205271581', time=2024-09-14T13:33:03.025289+0000, chain.objs.size()=3 2024-09-14T11:40:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.84__shadow_.UJj6AGt01M8x4x3GvFAmt4-EHtvy6gl_0 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.84__shadow_.UJj6AGt01M8x4x3GvFAmt4-EHtvy6gl_1 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.84__shadow_.UJj6AGt01M8x4x3GvFAmt4-EHtvy6gl_2 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1166466509914301950', time=2024-09-14T13:34:18.092089+0000, chain.objs.size()=7 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~Kjygdk08zPSyR8H_kq7ZczaQpEUahrz.1 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~Kjygdk08zPSyR8H_kq7ZczaQpEUahrz.1_1 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~Kjygdk08zPSyR8H_kq7ZczaQpEUahrz.1_2 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~Kjygdk08zPSyR8H_kq7ZczaQpEUahrz.2 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~Kjygdk08zPSyR8H_kq7ZczaQpEUahrz.2_1 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__shadow_key1.2~Kjygdk08zPSyR8H_kq7ZczaQpEUahrz.2_2 2024-09-14T11:40:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.95__multipart_key1.2~Kjygdk08zPSyR8H_kq7ZczaQpEUahrz.3 2024-09-14T11:40:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9088551481662201137', time=2024-09-14T13:38:54.795067+0000, chain.objs.size()=1 2024-09-14T11:40:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.113__shadow_.sbdwPWP6TInKEoE11KFqmEU9TQsFqwg_0 2024-09-14T11:40:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9290370320784340865', time=2024-09-14T13:39:02.424083+0000, chain.objs.size()=1 2024-09-14T11:40:04.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.922+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.118__shadow_.aGjI-XR7Z63H9NFhwuHAJ3j84xXt6Z7_0 2024-09-14T11:40:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.926+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15057526070540716395', time=2024-09-14T13:39:16.117547+0000, chain.objs.size()=1 2024-09-14T11:40:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.926+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.127__shadow_.7mWJLnj4JdKIF3ZTcCxm-Z68R1MgrIm_0 2024-09-14T11:40:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.930+0000 7fd2d88429c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7056520098507634622', time=2024-09-14T13:39:18.008982+0000, chain.objs.size()=1 2024-09-14T11:40:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.930+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.128__shadow_.D_PRZpaSxTZb8oJA0kupekp05Az8rbF_0 2024-09-14T11:40:04.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.930+0000 7fd2d88429c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:40:04.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.934+0000 7fd18cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:04.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.938+0000 7fd2d88429c0 20 remove_watcher() i=0 2024-09-14T11:40:04.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.938+0000 7fd2d88429c0 2 removed watcher, disabling cache 2024-09-14T11:40:04.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.938+0000 7fd2d88429c0 20 remove_watcher() i=1 2024-09-14T11:40:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.938+0000 7fd2d88429c0 20 remove_watcher() i=2 2024-09-14T11:40:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.938+0000 7fd2d88429c0 20 remove_watcher() i=3 2024-09-14T11:40:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.942+0000 7fd2d88429c0 20 remove_watcher() i=4 2024-09-14T11:40:04.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.942+0000 7fd2d88429c0 20 remove_watcher() i=5 2024-09-14T11:40:04.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.942+0000 7fd2d88429c0 20 remove_watcher() i=6 2024-09-14T11:40:04.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:04.946+0000 7fd2d88429c0 20 remove_watcher() i=7 2024-09-14T11:40:04.951 DEBUG:teuthology.orchestra.run.smithi148:> radosgw-admin gc process --include-all 2024-09-14T11:40:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:05.018 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:05.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.058+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 realm 2024-09-14T11:40:05.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:05.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.062+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.066+0000 7fed76a1c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:05.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.066+0000 7fed76a1c9c0 20 searching for the correct realm 2024-09-14T11:40:05.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.070+0000 7fed74d23640 0 -- 172.21.15.148:0/1532275490 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5562c15d8570 msgr2=0x5562c15da960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:05.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.074+0000 7fed74522640 0 -- 172.21.15.148:0/1532275490 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5562c15dc6a0 msgr2=0x5562c15dead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:05.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:05.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:05.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:05.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:05.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:05.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:05.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:05.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:05.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 zone default found 2024-09-14T11:40:05.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 4 Realm: () 2024-09-14T11:40:05.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:05.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:05.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:05.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 zonegroup default 2024-09-14T11:40:05.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.082+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.086+0000 7fed76a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.086+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.086+0000 7fed76a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.086+0000 7fed76a1c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:05.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.086+0000 7fed76a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:05.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.086+0000 7fed76a1c9c0 20 started sync module instance, tier type = 2024-09-14T11:40:05.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.086+0000 7fed76a1c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.102+0000 7fed76a1c9c0 20 add_watcher() i=0 2024-09-14T11:40:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.102+0000 7fed76a1c9c0 20 add_watcher() i=1 2024-09-14T11:40:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.102+0000 7fed76a1c9c0 20 add_watcher() i=2 2024-09-14T11:40:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.102+0000 7fed76a1c9c0 20 add_watcher() i=3 2024-09-14T11:40:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.102+0000 7fed76a1c9c0 20 add_watcher() i=4 2024-09-14T11:40:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.102+0000 7fed76a1c9c0 20 add_watcher() i=5 2024-09-14T11:40:05.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.102+0000 7fed76a1c9c0 20 add_watcher() i=6 2024-09-14T11:40:05.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.106+0000 7fed76a1c9c0 20 add_watcher() i=7 2024-09-14T11:40:05.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.106+0000 7fed76a1c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.110+0000 7fec2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.110+0000 7fed76a1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:05.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.110+0000 7fed76a1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:05.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.178+0000 7fec29fdb640 20 reqs_thread_entry: start 2024-09-14T11:40:05.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.178+0000 7fed76a1c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:05.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.178+0000 7fed76a1c9c0 20 Filter name: none 2024-09-14T11:40:05.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.178+0000 7feb9b7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:05.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.178+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:40:05.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.178+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.178+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.178+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.182+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:40:05.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.182+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.186+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.186+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.186+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:40:05.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.190+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.190+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.194+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.194+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:40:05.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.198+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.198+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.198+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.202+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:40:05.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.202+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.206+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.206+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.206+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:40:05.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.206+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.210+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.210+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.214+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:40:05.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.214+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.214+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.214+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.218+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:40:05.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.222+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.222+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.222+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.226+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:40:05.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.230+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.230+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.230+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.234+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:40:05.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.238+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.238+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.238+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.238+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:40:05.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.242+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.246+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.246+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.250+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:40:05.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.250+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.254+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.254+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.258+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:40:05.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.258+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.262+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.262+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.266+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:40:05.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.266+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.266+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.270+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.270+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:40:05.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.274+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.274+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.274+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.278+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:40:05.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.282+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.282+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.286+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.286+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:40:05.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.290+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.290+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.294+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.294+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:40:05.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.298+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.298+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.302+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.302+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:40:05.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.306+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.306+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.310+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.310+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:40:05.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.314+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.314+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.318+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.318+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:40:05.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.322+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.322+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.326+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.326+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:40:05.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.330+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.334+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.334+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.338+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:40:05.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.342+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.342+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.342+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.346+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:40:05.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.350+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.350+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.350+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.354+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:40:05.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.358+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.358+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.358+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.362+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:40:05.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.366+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.366+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.366+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.370+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:40:05.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.374+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.374+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.374+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.378+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:40:05.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.382+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.382+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.382+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.386+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:40:05.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.390+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.390+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.390+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.394+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:40:05.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.398+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.394 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.398+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.398+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.402+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:40:05.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.406+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.406+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.406+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.410+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:40:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.414+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.414+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:40:05.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.418+0000 7fed76a1c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:40:05.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.422+0000 7fec2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:05.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.426+0000 7fed76a1c9c0 20 remove_watcher() i=0 2024-09-14T11:40:05.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.426+0000 7fed76a1c9c0 2 removed watcher, disabling cache 2024-09-14T11:40:05.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.430+0000 7fed76a1c9c0 20 remove_watcher() i=1 2024-09-14T11:40:05.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.434+0000 7fed76a1c9c0 20 remove_watcher() i=2 2024-09-14T11:40:05.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.434+0000 7fed76a1c9c0 20 remove_watcher() i=3 2024-09-14T11:40:05.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.438+0000 7fed76a1c9c0 20 remove_watcher() i=4 2024-09-14T11:40:05.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.442+0000 7fed76a1c9c0 20 remove_watcher() i=5 2024-09-14T11:40:05.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.442+0000 7fed76a1c9c0 20 remove_watcher() i=6 2024-09-14T11:40:05.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:05.446+0000 7fed76a1c9c0 20 remove_watcher() i=7 2024-09-14T11:40:05.467 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:40:05.484 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:40:05.484 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:40:05.485 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:40:05.485 DEBUG:teuthology.orchestra.run.smithi148:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:40:05.513 INFO:teuthology.orchestra.run.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:40:06.416 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:40:06.416 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-14T11:40:06.504 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:06.504 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:06.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.550+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.550+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.550+0000 7fd94ab369c0 20 realm 2024-09-14T11:40:06.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.550+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:06.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:06.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:06.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.554+0000 7fd94ab369c0 20 searching for the correct realm 2024-09-14T11:40:06.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.562+0000 7fd947e3b640 0 -- 172.21.15.148:0/3966152214 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fd93801f040 msgr2=0x7fd93800f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:06.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.566+0000 7fd948e3d640 0 -- 172.21.15.148:0/3966152214 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x562e6ab70360 msgr2=0x562e6ab72820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:06.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:06.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:06.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:06.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:06.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:06.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:06.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:06.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:06.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 zone default found 2024-09-14T11:40:06.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 4 Realm: () 2024-09-14T11:40:06.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:06.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:06.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:06.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 zonegroup default 2024-09-14T11:40:06.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.574+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.578+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.578+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.578+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.578+0000 7fd94ab369c0 20 started sync module instance, tier type = 2024-09-14T11:40:06.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.578+0000 7fd94ab369c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:06.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.594+0000 7fd94ab369c0 20 add_watcher() i=0 2024-09-14T11:40:06.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.594+0000 7fd94ab369c0 20 add_watcher() i=1 2024-09-14T11:40:06.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.594+0000 7fd94ab369c0 20 add_watcher() i=2 2024-09-14T11:40:06.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.594+0000 7fd94ab369c0 20 add_watcher() i=3 2024-09-14T11:40:06.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.594+0000 7fd94ab369c0 20 add_watcher() i=4 2024-09-14T11:40:06.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.594+0000 7fd94ab369c0 20 add_watcher() i=5 2024-09-14T11:40:06.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.594+0000 7fd94ab369c0 20 add_watcher() i=6 2024-09-14T11:40:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.598+0000 7fd94ab369c0 20 add_watcher() i=7 2024-09-14T11:40:06.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.598+0000 7fd94ab369c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd7fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 5 note: GC not initialized 2024-09-14T11:40:06.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd7fdfdb640 20 reqs_thread_entry: start 2024-09-14T11:40:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 Filter name: none 2024-09-14T11:40:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd76f7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-14T11:40:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-14T11:40:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:40:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-14T11:40:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-14T11:40:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-14T11:40:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:40:06.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.602+0000 7fd94ab369c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-14T11:40:06.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.606+0000 7fd94ab369c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:40:06.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.606+0000 7fd94ab369c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:40:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.606+0000 7fd94ab369c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-14T11:40:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.606+0000 7fd81f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366381 cookie 94757358929536 notifier 9075 bl.length()=384 2024-09-14T11:40:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.606+0000 7fd81f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:40:06.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.606+0000 7fd81f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:40:06.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.610+0000 7fd94ab369c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:40:06.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.610+0000 7fd94ab369c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:40:06.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.610+0000 7fd94ab369c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-14T11:40:06.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.610+0000 7fd81f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366382 cookie 94757358935888 notifier 9075 bl.length()=225 2024-09-14T11:40:06.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.610+0000 7fd81f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:40:06.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.610+0000 7fd81f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:40:06.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.618+0000 7fd94ab369c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:40:06.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.618+0000 7fd94ab369c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:40:06.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.618+0000 7fd94ab369c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-14T11:40:06.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.618+0000 7fd81f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 94757358872496 notifier 9075 bl.length()=234 2024-09-14T11:40:06.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.618+0000 7fd81f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:40:06.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.618+0000 7fd81f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:40:06.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.622+0000 7fd7fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:06.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.626+0000 7fd94ab369c0 20 remove_watcher() i=0 2024-09-14T11:40:06.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.626+0000 7fd94ab369c0 2 removed watcher, disabling cache 2024-09-14T11:40:06.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.626+0000 7fd94ab369c0 20 remove_watcher() i=1 2024-09-14T11:40:06.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.630+0000 7fd94ab369c0 20 remove_watcher() i=2 2024-09-14T11:40:06.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.630+0000 7fd94ab369c0 20 remove_watcher() i=3 2024-09-14T11:40:06.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.634+0000 7fd94ab369c0 20 remove_watcher() i=4 2024-09-14T11:40:06.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.634+0000 7fd94ab369c0 20 remove_watcher() i=5 2024-09-14T11:40:06.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.638+0000 7fd94ab369c0 20 remove_watcher() i=6 2024-09-14T11:40:06.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.638+0000 7fd94ab369c0 20 remove_watcher() i=7 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "id": "RGW11111111111111111", 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "tenant": "", 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "Mr.RGW11111111111111111", 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "quota": { 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:06.648 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max_users": 1000, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max_roles": 1000, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max_groups": 1000, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout: "max_access_keys": 4 2024-09-14T11:40:06.649 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:06.651 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-14T11:40:06.651 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key WENESPCPUMGKEPAUBCOR --secret eY1XdErombx75a5RWq2ThwH44mi3atj07wRMAr0+u6+fMiyWhKO9GQ== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-14T11:40:06.740 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:06.741 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:06.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 20 realm 2024-09-14T11:40:06.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:06.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.786+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.790+0000 7fe89da7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:06.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.790+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.790+0000 7fe89da7b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:06.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.790+0000 7fe89da7b9c0 20 searching for the correct realm 2024-09-14T11:40:06.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.798+0000 7fe89bd82640 0 -- 172.21.15.148:0/3224875895 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55a44386b450 msgr2=0x55a44386d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:06.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.802+0000 7fe89bd82640 0 -- 172.21.15.148:0/3224875895 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55a443877f50 msgr2=0x55a44387a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:06.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:06.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:06.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:06.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:06.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:06.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:06.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:06.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:06.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 zone default found 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 4 Realm: () 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 zonegroup default 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 started sync module instance, tier type = 2024-09-14T11:40:06.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.810+0000 7fe89da7b9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.830+0000 7fe89da7b9c0 20 add_watcher() i=0 2024-09-14T11:40:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.830+0000 7fe89da7b9c0 20 add_watcher() i=1 2024-09-14T11:40:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.830+0000 7fe89da7b9c0 20 add_watcher() i=2 2024-09-14T11:40:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.830+0000 7fe89da7b9c0 20 add_watcher() i=3 2024-09-14T11:40:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.830+0000 7fe89da7b9c0 20 add_watcher() i=4 2024-09-14T11:40:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.830+0000 7fe89da7b9c0 20 add_watcher() i=5 2024-09-14T11:40:06.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.830+0000 7fe89da7b9c0 20 add_watcher() i=6 2024-09-14T11:40:06.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.834+0000 7fe89da7b9c0 20 add_watcher() i=7 2024-09-14T11:40:06.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.834+0000 7fe89da7b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:06.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.834+0000 7fe751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:06.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.834+0000 7fe89da7b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:06.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.834+0000 7fe89da7b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.834+0000 7fe89da7b9c0 5 note: GC not initialized 2024-09-14T11:40:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe750fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 Filter name: none 2024-09-14T11:40:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe6ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:40:06.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache get: name=default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR : miss 2024-09-14T11:40:06.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache put: name=default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR info.flags=0x0 2024-09-14T11:40:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 adding default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR to cache LRU end 2024-09-14T11:40:06.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-14T11:40:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:40:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:40:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:40:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache get: name=default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR : hit (negative entry) 2024-09-14T11:40:06.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.838+0000 7fe89da7b9c0 10 cache get: name=default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR : hit (negative entry) 2024-09-14T11:40:06.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.842+0000 7fe89da7b9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:40:06.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.842+0000 7fe89da7b9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:40:06.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.842+0000 7fe89da7b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:40:06.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.842+0000 7fe77effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366258 cookie 94163995957040 notifier 9093 bl.length()=673 2024-09-14T11:40:06.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.842+0000 7fe77effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:40:06.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.842+0000 7fe77effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:40:06.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.850+0000 7fe89da7b9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:40:06.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.850+0000 7fe89da7b9c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:40:06.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.850+0000 7fe89da7b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:40:06.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.850+0000 7fe77effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366383 cookie 94163995902128 notifier 9093 bl.length()=185 2024-09-14T11:40:06.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.850+0000 7fe77effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:40:06.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.850+0000 7fe77effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:40:06.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.854+0000 7fe89da7b9c0 10 cache put: name=default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR info.flags=0x7 2024-09-14T11:40:06.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.854+0000 7fe89da7b9c0 10 moving default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR to cache LRU end 2024-09-14T11:40:06.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.854+0000 7fe89da7b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:WENESPCPUMGKEPAUBCOR, ofs0, ns] 2024-09-14T11:40:06.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.854+0000 7fe77effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366443 cookie 94163995971696 notifier 9093 bl.length()=186 2024-09-14T11:40:06.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.854+0000 7fe77effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR info.flags=0x7 2024-09-14T11:40:06.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.854+0000 7fe77effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WENESPCPUMGKEPAUBCOR to cache LRU end 2024-09-14T11:40:06.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.862+0000 7fe89da7b9c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-14T11:40:06.856 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:06.856 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "foo.client.0", 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "foo+test@test.test", 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "foo.client.0", 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "WENESPCPUMGKEPAUBCOR", 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "eY1XdErombx75a5RWq2ThwH44mi3atj07wRMAr0+u6+fMiyWhKO9GQ==", 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:06.845168Z" 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:40:06.857 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:06.858 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:40:06.858 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:06.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "root", 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "RGW11111111111111111", 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:06.845153Z", 2024-09-14T11:40:06.861 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:40:06.862 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:40:06.862 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:06.862 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:06.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.862+0000 7fe751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:06.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.866+0000 7fe89da7b9c0 20 remove_watcher() i=0 2024-09-14T11:40:06.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.866+0000 7fe89da7b9c0 2 removed watcher, disabling cache 2024-09-14T11:40:06.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.866+0000 7fe89da7b9c0 20 remove_watcher() i=1 2024-09-14T11:40:06.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.870+0000 7fe89da7b9c0 20 remove_watcher() i=2 2024-09-14T11:40:06.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.870+0000 7fe89da7b9c0 20 remove_watcher() i=3 2024-09-14T11:40:06.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.874+0000 7fe89da7b9c0 20 remove_watcher() i=4 2024-09-14T11:40:06.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.874+0000 7fe89da7b9c0 20 remove_watcher() i=5 2024-09-14T11:40:06.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.878+0000 7fe89da7b9c0 20 remove_watcher() i=6 2024-09-14T11:40:06.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.882+0000 7fe89da7b9c0 20 remove_watcher() i=7 2024-09-14T11:40:06.893 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3424732632 --totp-seed YKZIFMOI3AXXWSEHPLUHPGLJIMAV25OJT23V2FYWOECEBDGUF42PGBZMJZZWPQNO --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:40:06.933 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:06.933 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:06.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.974+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 realm 2024-09-14T11:40:06.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:06.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:06.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.978+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.982+0000 7f2bb03199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:06.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.982+0000 7f2bb03199c0 20 searching for the correct realm 2024-09-14T11:40:06.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.986+0000 7f2bade1f640 0 -- 172.21.15.148:0/2907507628 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f2ba800f660 msgr2=0x7f2ba807a7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:06.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.990+0000 7f2bade1f640 0 -- 172.21.15.148:0/2907507628 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5563cf7435b0 msgr2=0x5563cf745a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:06.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:06.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:06.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:06.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:06.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:06.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:06.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:06.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:06.998+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 zone default found 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 4 Realm: () 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 zonegroup default 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:06.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:06.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 started sync module instance, tier type = 2024-09-14T11:40:06.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.002+0000 7f2bb03199c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.018+0000 7f2bb03199c0 20 add_watcher() i=0 2024-09-14T11:40:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.018+0000 7f2bb03199c0 20 add_watcher() i=1 2024-09-14T11:40:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.018+0000 7f2bb03199c0 20 add_watcher() i=2 2024-09-14T11:40:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.018+0000 7f2bb03199c0 20 add_watcher() i=3 2024-09-14T11:40:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.018+0000 7f2bb03199c0 20 add_watcher() i=4 2024-09-14T11:40:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.018+0000 7f2bb03199c0 20 add_watcher() i=5 2024-09-14T11:40:07.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.018+0000 7f2bb03199c0 20 add_watcher() i=6 2024-09-14T11:40:07.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.022+0000 7f2bb03199c0 20 add_watcher() i=7 2024-09-14T11:40:07.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.022+0000 7f2bb03199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2a5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2bb03199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2bb03199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2bb03199c0 5 note: GC not initialized 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2a5e7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2bb03199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2bb03199c0 20 Filter name: none 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f29cffff640 20 reqs_thread_entry: start 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2bb03199c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:40:07.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.026+0000 7f2bb03199c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:07.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.030+0000 7f2bb03199c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-14T11:40:07.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.030+0000 7f2bb03199c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:40:07.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.030+0000 7f2bb03199c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:40:07.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:07.030+0000 7f2bb03199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.950+0000 7f2bb03199c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:40:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.950+0000 7f2bb03199c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:40:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.950+0000 7f2bb03199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:40:08.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.954+0000 7f2a90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300851 cookie 93887170627664 notifier 8531 bl.length()=687 2024-09-14T11:40:08.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.954+0000 7f2a90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:40:08.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.954+0000 7f2a90ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:40:08.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.958+0000 7f2a5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:08.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.962+0000 7f2bb03199c0 20 remove_watcher() i=0 2024-09-14T11:40:08.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.962+0000 7f2bb03199c0 2 removed watcher, disabling cache 2024-09-14T11:40:08.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.966+0000 7f2bb03199c0 20 remove_watcher() i=1 2024-09-14T11:40:08.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.966+0000 7f2bb03199c0 20 remove_watcher() i=2 2024-09-14T11:40:08.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.970+0000 7f2bb03199c0 20 remove_watcher() i=3 2024-09-14T11:40:08.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.970+0000 7f2bb03199c0 20 remove_watcher() i=4 2024-09-14T11:40:08.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.974+0000 7f2bb03199c0 20 remove_watcher() i=5 2024-09-14T11:40:08.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.974+0000 7f2bb03199c0 20 remove_watcher() i=6 2024-09-14T11:40:08.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:08.978+0000 7f2bb03199c0 20 remove_watcher() i=7 2024-09-14T11:40:08.996 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:40:08.996 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key RUAZDJHYWCTCAAFHVYHT --secret sbEpvrNkYtNxDcW6Cp18e95BOP6nTfSEfV7LnfnpQuWKpmuUVcGqww== --cluster ceph 2024-09-14T11:40:09.084 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:09.084 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:09.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.130+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.130+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.130+0000 7f7b53af69c0 20 realm 2024-09-14T11:40:09.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.130+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.130+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.130+0000 7f7b53af69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:09.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.130+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.134+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.134+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.134+0000 7f7b53af69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.134+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.134+0000 7f7b53af69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:09.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.134+0000 7f7b53af69c0 20 searching for the correct realm 2024-09-14T11:40:09.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.138+0000 7f7b50dfb640 0 -- 172.21.15.148:0/196414038 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f7b4c043940 msgr2=0x7f7b4c07e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:09.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.350+0000 7f7b515fc640 0 -- 172.21.15.148:0/196414038 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f7b4c06abd0 msgr2=0x7f7b4c06c7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:09.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:09.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:09.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:09.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:09.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:09.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:09.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 zone default found 2024-09-14T11:40:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 4 Realm: () 2024-09-14T11:40:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:09.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 zonegroup default 2024-09-14T11:40:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.570+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.574+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.574+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.574+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.574+0000 7f7b53af69c0 20 started sync module instance, tier type = 2024-09-14T11:40:09.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.574+0000 7f7b53af69c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:09.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.598+0000 7f7b53af69c0 20 add_watcher() i=0 2024-09-14T11:40:09.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.598+0000 7f7b53af69c0 20 add_watcher() i=1 2024-09-14T11:40:09.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.598+0000 7f7b53af69c0 20 add_watcher() i=2 2024-09-14T11:40:09.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.598+0000 7f7b53af69c0 20 add_watcher() i=3 2024-09-14T11:40:09.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.598+0000 7f7b53af69c0 20 add_watcher() i=4 2024-09-14T11:40:09.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.598+0000 7f7b53af69c0 20 add_watcher() i=5 2024-09-14T11:40:09.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.598+0000 7f7b53af69c0 20 add_watcher() i=6 2024-09-14T11:40:09.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.602+0000 7f7b53af69c0 20 add_watcher() i=7 2024-09-14T11:40:09.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.602+0000 7f7b53af69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:09.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7a077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:09.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:09.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:09.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 5 note: GC not initialized 2024-09-14T11:40:09.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7a067e4640 20 reqs_thread_entry: start 2024-09-14T11:40:09.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:09.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 20 Filter name: none 2024-09-14T11:40:09.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7977fff640 20 reqs_thread_entry: start 2024-09-14T11:40:09.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:40:09.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:40:09.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:40:09.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:40:09.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.606+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:40:09.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:40:09.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 cache get: name=default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT : miss 2024-09-14T11:40:09.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 cache put: name=default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT info.flags=0x0 2024-09-14T11:40:09.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 adding default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT to cache LRU end 2024-09-14T11:40:09.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 cache get: name=default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT : hit (negative entry) 2024-09-14T11:40:09.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 cache get: name=default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT : hit (negative entry) 2024-09-14T11:40:09.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:40:09.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:40:09.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7b53af69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:40:09.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7a34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300976 cookie 94897159565504 notifier 9132 bl.length()=645 2024-09-14T11:40:09.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7a34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:40:09.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.610+0000 7f7a34ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:40:09.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.618+0000 7f7b53af69c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:40:09.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.618+0000 7f7b53af69c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:40:09.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.618+0000 7f7b53af69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:40:09.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.618+0000 7f7a34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301036 cookie 94897159576768 notifier 9132 bl.length()=185 2024-09-14T11:40:09.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.618+0000 7f7a34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:40:09.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.618+0000 7f7a34ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:40:09.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.622+0000 7f7b53af69c0 10 cache put: name=default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT info.flags=0x7 2024-09-14T11:40:09.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.622+0000 7f7b53af69c0 10 moving default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT to cache LRU end 2024-09-14T11:40:09.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.622+0000 7f7b53af69c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:RUAZDJHYWCTCAAFHVYHT, ofs0, ns] 2024-09-14T11:40:09.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.622+0000 7f7a34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300852 cookie 94897159562384 notifier 9132 bl.length()=186 2024-09-14T11:40:09.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.622+0000 7f7a34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT info.flags=0x7 2024-09-14T11:40:09.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.622+0000 7f7a34ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RUAZDJHYWCTCAAFHVYHT to cache LRU end 2024-09-14T11:40:09.620 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "bar.client.0", 2024-09-14T11:40:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:40:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "bar+test@test.test", 2024-09-14T11:40:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:40:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:40:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "bar.client.0", 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "RUAZDJHYWCTCAAFHVYHT", 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "sbEpvrNkYtNxDcW6Cp18e95BOP6nTfSEfV7LnfnpQuWKpmuUVcGqww==", 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:09.614289Z" 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:40:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "rgw", 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "", 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:09.614236Z", 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:09.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.626+0000 7f7a077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:09.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.630+0000 7f7b53af69c0 20 remove_watcher() i=0 2024-09-14T11:40:09.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.630+0000 7f7b53af69c0 2 removed watcher, disabling cache 2024-09-14T11:40:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.634+0000 7f7b53af69c0 20 remove_watcher() i=1 2024-09-14T11:40:09.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.634+0000 7f7b53af69c0 20 remove_watcher() i=2 2024-09-14T11:40:09.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.638+0000 7f7b53af69c0 20 remove_watcher() i=3 2024-09-14T11:40:09.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.638+0000 7f7b53af69c0 20 remove_watcher() i=4 2024-09-14T11:40:09.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.642+0000 7f7b53af69c0 20 remove_watcher() i=5 2024-09-14T11:40:09.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.642+0000 7f7b53af69c0 20 remove_watcher() i=6 2024-09-14T11:40:09.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.646+0000 7f7b53af69c0 20 remove_watcher() i=7 2024-09-14T11:40:09.660 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 9286306007 --totp-seed FVCCH5RHDAKR7BQROMPZPIA6SGZFQNM6R3JUN23U6RMUICYZO2XPRPJ2PXGBG2CQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:40:09.702 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:09.702 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:09.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.746+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.746+0000 7f9133a8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.746+0000 7f9133a8e9c0 20 realm 2024-09-14T11:40:09.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.746+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:09.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:09.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.750+0000 7f9133a8e9c0 20 searching for the correct realm 2024-09-14T11:40:09.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.758+0000 7f9131594640 0 -- 172.21.15.148:0/1888335023 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f9124026070 msgr2=0x7f91240637d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:09.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.762+0000 7f9131594640 0 -- 172.21.15.148:0/1888335023 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x561bdb169670 msgr2=0x561bdb16ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:09.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:09.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:09.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:09.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:09.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:09.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:09.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 zone default found 2024-09-14T11:40:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 4 Realm: () 2024-09-14T11:40:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 zonegroup default 2024-09-14T11:40:09.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.770+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.774+0000 7f9133a8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.774+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.774+0000 7f9133a8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.774+0000 7f9133a8e9c0 20 started sync module instance, tier type = 2024-09-14T11:40:09.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.774+0000 7f9133a8e9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.790+0000 7f9133a8e9c0 20 add_watcher() i=0 2024-09-14T11:40:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.790+0000 7f9133a8e9c0 20 add_watcher() i=1 2024-09-14T11:40:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.790+0000 7f9133a8e9c0 20 add_watcher() i=2 2024-09-14T11:40:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.790+0000 7f9133a8e9c0 20 add_watcher() i=3 2024-09-14T11:40:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.790+0000 7f9133a8e9c0 20 add_watcher() i=4 2024-09-14T11:40:09.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.790+0000 7f9133a8e9c0 20 add_watcher() i=5 2024-09-14T11:40:09.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.790+0000 7f9133a8e9c0 20 add_watcher() i=6 2024-09-14T11:40:09.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.794+0000 7f9133a8e9c0 20 add_watcher() i=7 2024-09-14T11:40:09.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.794+0000 7f9133a8e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.794+0000 7f8fe7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.794+0000 7f9133a8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.794+0000 7f9133a8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:09.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.794+0000 7f9133a8e9c0 5 note: GC not initialized 2024-09-14T11:40:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f8fe6fe5640 20 reqs_thread_entry: start 2024-09-14T11:40:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f9133a8e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f9133a8e9c0 20 Filter name: none 2024-09-14T11:40:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f8fe4fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f9133a8e9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:40:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f9133a8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f9133a8e9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:40:09.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f9133a8e9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:40:09.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f9133a8e9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:40:09.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.798+0000 7f9133a8e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.802+0000 7f9133a8e9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:40:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.802+0000 7f9133a8e9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:40:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.802+0000 7f9133a8e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:40:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.802+0000 7f9014ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300977 cookie 94677639843840 notifier 8564 bl.length()=659 2024-09-14T11:40:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.802+0000 7f9014ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:40:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.802+0000 7f9014ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:40:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.806+0000 7f8fe7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:09.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.810+0000 7f9133a8e9c0 20 remove_watcher() i=0 2024-09-14T11:40:09.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.810+0000 7f9133a8e9c0 2 removed watcher, disabling cache 2024-09-14T11:40:09.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.810+0000 7f9133a8e9c0 20 remove_watcher() i=1 2024-09-14T11:40:09.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.814+0000 7f9133a8e9c0 20 remove_watcher() i=2 2024-09-14T11:40:09.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.814+0000 7f9133a8e9c0 20 remove_watcher() i=3 2024-09-14T11:40:09.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.818+0000 7f9133a8e9c0 20 remove_watcher() i=4 2024-09-14T11:40:09.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.818+0000 7f9133a8e9c0 20 remove_watcher() i=5 2024-09-14T11:40:09.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.822+0000 7f9133a8e9c0 20 remove_watcher() i=6 2024-09-14T11:40:09.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.822+0000 7f9133a8e9c0 20 remove_watcher() i=7 2024-09-14T11:40:09.834 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-14T11:40:09.917 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:09.918 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:09.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.974+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.974+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.974+0000 7f00314a09c0 20 realm 2024-09-14T11:40:09.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.974+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.974+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.974+0000 7f00314a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:09.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.974+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.974+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.978+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.978+0000 7f00314a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.978+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.978+0000 7f00314a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:09.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.978+0000 7f00314a09c0 20 searching for the correct realm 2024-09-14T11:40:09.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:09.994+0000 7f002f7a7640 0 -- 172.21.15.148:0/2023311385 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55c2e9701b60 msgr2=0x55c2e9704020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.014+0000 7f002f7a7640 0 -- 172.21.15.148:0/2023311385 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55c2e970e650 msgr2=0x55c2e9710b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:10.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:10.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:10.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:10.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:10.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:10.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:10.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:10.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 zone default found 2024-09-14T11:40:10.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 4 Realm: () 2024-09-14T11:40:10.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:10.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:10.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:10.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 zonegroup default 2024-09-14T11:40:10.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.022+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.026+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.026+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.026+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.026+0000 7f00314a09c0 20 started sync module instance, tier type = 2024-09-14T11:40:10.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.026+0000 7f00314a09c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.042+0000 7f00314a09c0 20 add_watcher() i=0 2024-09-14T11:40:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.042+0000 7f00314a09c0 20 add_watcher() i=1 2024-09-14T11:40:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.042+0000 7f00314a09c0 20 add_watcher() i=2 2024-09-14T11:40:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.042+0000 7f00314a09c0 20 add_watcher() i=3 2024-09-14T11:40:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.042+0000 7f00314a09c0 20 add_watcher() i=4 2024-09-14T11:40:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.042+0000 7f00314a09c0 20 add_watcher() i=5 2024-09-14T11:40:10.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.042+0000 7f00314a09c0 20 add_watcher() i=6 2024-09-14T11:40:10.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.046+0000 7f00314a09c0 20 add_watcher() i=7 2024-09-14T11:40:10.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.046+0000 7f00314a09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7efee57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 5 note: GC not initialized 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7efe5ffff640 20 reqs_thread_entry: start 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 Filter name: none 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7efe5dffb640 20 reqs_thread_entry: start 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-14T11:40:10.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-14T11:40:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:40:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-14T11:40:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-14T11:40:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-14T11:40:10.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:40:10.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.050+0000 7f00314a09c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-14T11:40:10.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.054+0000 7f00314a09c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:40:10.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.054+0000 7f00314a09c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:40:10.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.054+0000 7f00314a09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-14T11:40:10.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.054+0000 7eff127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268274 cookie 94295628513744 notifier 8582 bl.length()=389 2024-09-14T11:40:10.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.054+0000 7eff127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:40:10.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.054+0000 7eff127fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:40:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.058+0000 7f00314a09c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:40:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.058+0000 7f00314a09c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:40:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.058+0000 7f00314a09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-14T11:40:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.058+0000 7eff127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268275 cookie 94295628519584 notifier 8582 bl.length()=230 2024-09-14T11:40:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.058+0000 7eff127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:40:10.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.058+0000 7eff127fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:40:10.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.062+0000 7f00314a09c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:40:10.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.062+0000 7f00314a09c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:40:10.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.062+0000 7f00314a09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-14T11:40:10.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.062+0000 7eff11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268143 cookie 94295628463856 notifier 8582 bl.length()=234 2024-09-14T11:40:10.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.062+0000 7eff11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:40:10.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.062+0000 7eff11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:40:10.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.066+0000 7efee57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.070+0000 7f00314a09c0 20 remove_watcher() i=0 2024-09-14T11:40:10.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.070+0000 7f00314a09c0 2 removed watcher, disabling cache 2024-09-14T11:40:10.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.070+0000 7f00314a09c0 20 remove_watcher() i=1 2024-09-14T11:40:10.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.074+0000 7f00314a09c0 20 remove_watcher() i=2 2024-09-14T11:40:10.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.074+0000 7f00314a09c0 20 remove_watcher() i=3 2024-09-14T11:40:10.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.078+0000 7f00314a09c0 20 remove_watcher() i=4 2024-09-14T11:40:10.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.078+0000 7f00314a09c0 20 remove_watcher() i=5 2024-09-14T11:40:10.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.082+0000 7f00314a09c0 20 remove_watcher() i=6 2024-09-14T11:40:10.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.086+0000 7f00314a09c0 20 remove_watcher() i=7 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "id": "RGW33333333333333333", 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "tenant": "testx", 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "Mr.RGW33333333333333333", 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "quota": { 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:10.093 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max_users": 1000, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max_roles": 1000, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max_groups": 1000, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout: "max_access_keys": 4 2024-09-14T11:40:10.094 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:10.095 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-14T11:40:10.096 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key CGWAUUYSBOFOUVIJCPUE --secret gFZwPFJ5TmUzBYtBCd5Ve/vxZxh1a7ZnteY7A2+fLDL/4sjmQ0ydDg== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-14T11:40:10.183 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:10.183 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:10.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.226+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 realm 2024-09-14T11:40:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:10.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.230+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.234+0000 7f17b35879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:10.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.234+0000 7f17b35879c0 20 searching for the correct realm 2024-09-14T11:40:10.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.238+0000 7f17b088c640 0 -- 172.21.15.148:0/1045581041 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f17ac018040 msgr2=0x7f17ac018420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.242+0000 7f17b188e640 0 -- 172.21.15.148:0/1045581041 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x564d548be4d0 msgr2=0x564d548c0990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:10.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.250+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:10.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 zone default found 2024-09-14T11:40:10.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 4 Realm: () 2024-09-14T11:40:10.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:10.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:10.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:10.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 zonegroup default 2024-09-14T11:40:10.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 started sync module instance, tier type = 2024-09-14T11:40:10.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.254+0000 7f17b35879c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:10.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 20 add_watcher() i=0 2024-09-14T11:40:10.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 20 add_watcher() i=1 2024-09-14T11:40:10.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 20 add_watcher() i=2 2024-09-14T11:40:10.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 20 add_watcher() i=3 2024-09-14T11:40:10.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 20 add_watcher() i=4 2024-09-14T11:40:10.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 20 add_watcher() i=5 2024-09-14T11:40:10.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 20 add_watcher() i=6 2024-09-14T11:40:10.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 20 add_watcher() i=7 2024-09-14T11:40:10.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.274+0000 7f17b35879c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:10.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.278+0000 7f16677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.278+0000 7f17b35879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:10.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.278+0000 7f17b35879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:10.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.278+0000 7f17b35879c0 5 note: GC not initialized 2024-09-14T11:40:10.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.278+0000 7f16667e4640 20 reqs_thread_entry: start 2024-09-14T11:40:10.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.278+0000 7f17b35879c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 Filter name: none 2024-09-14T11:40:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f15d7fff640 20 reqs_thread_entry: start 2024-09-14T11:40:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:40:10.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:40:10.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache get: name=default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE : miss 2024-09-14T11:40:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache put: name=default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE info.flags=0x0 2024-09-14T11:40:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 adding default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE to cache LRU end 2024-09-14T11:40:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-14T11:40:10.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:40:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:40:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:40:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache get: name=default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE : hit (negative entry) 2024-09-14T11:40:10.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.282+0000 7f17b35879c0 10 cache get: name=default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE : hit (negative entry) 2024-09-14T11:40:10.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.286+0000 7f17b35879c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:40:10.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.286+0000 7f17b35879c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:40:10.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.286+0000 7f17b35879c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:40:10.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.286+0000 7f1694ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268333 cookie 94890130999424 notifier 8597 bl.length()=732 2024-09-14T11:40:10.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.286+0000 7f1694ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:40:10.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.286+0000 7f1694ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:40:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.290+0000 7f17b35879c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:40:10.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.290+0000 7f17b35879c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:40:10.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.290+0000 7f17b35879c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:40:10.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.294+0000 7f1683fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268334 cookie 94890131006464 notifier 8597 bl.length()=215 2024-09-14T11:40:10.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.294+0000 7f1683fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:40:10.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.294+0000 7f1683fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:40:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.294+0000 7f17b35879c0 10 cache put: name=default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE info.flags=0x7 2024-09-14T11:40:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.294+0000 7f17b35879c0 10 moving default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE to cache LRU end 2024-09-14T11:40:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.294+0000 7f17b35879c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:CGWAUUYSBOFOUVIJCPUE, ofs0, ns] 2024-09-14T11:40:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.298+0000 7f1694ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268335 cookie 94890131000480 notifier 8597 bl.length()=201 2024-09-14T11:40:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.298+0000 7f1694ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE info.flags=0x7 2024-09-14T11:40:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.298+0000 7f1694ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CGWAUUYSBOFOUVIJCPUE to cache LRU end 2024-09-14T11:40:10.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.302+0000 7f17b35879c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-14T11:40:10.297 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "CGWAUUYSBOFOUVIJCPUE", 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "gFZwPFJ5TmUzBYtBCd5Ve/vxZxh1a7ZnteY7A2+fLDL/4sjmQ0ydDg==", 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:10.288120Z" 2024-09-14T11:40:10.298 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:10.299 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "root", 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "RGW33333333333333333", 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:10.288101Z", 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:40:10.300 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:40:10.301 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:10.301 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:10.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.302+0000 7f16677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.306+0000 7f17b35879c0 20 remove_watcher() i=0 2024-09-14T11:40:10.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.306+0000 7f17b35879c0 2 removed watcher, disabling cache 2024-09-14T11:40:10.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.310+0000 7f17b35879c0 20 remove_watcher() i=1 2024-09-14T11:40:10.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.310+0000 7f17b35879c0 20 remove_watcher() i=2 2024-09-14T11:40:10.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.314+0000 7f17b35879c0 20 remove_watcher() i=3 2024-09-14T11:40:10.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.314+0000 7f17b35879c0 20 remove_watcher() i=4 2024-09-14T11:40:10.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.318+0000 7f17b35879c0 20 remove_watcher() i=5 2024-09-14T11:40:10.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.318+0000 7f17b35879c0 20 remove_watcher() i=6 2024-09-14T11:40:10.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.322+0000 7f17b35879c0 20 remove_watcher() i=7 2024-09-14T11:40:10.333 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0338050533 --totp-seed EAANZJKZXLCZ5NEQ2TTGOWDVHW3SI2PTRXF6P7CMPCLRKP4YP5CI2SXTGIFUQM2A --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:40:10.374 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:10.374 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:10.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.418+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 realm 2024-09-14T11:40:10.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:10.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.422+0000 7f20296919c0 20 searching for the correct realm 2024-09-14T11:40:10.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.430+0000 7f2026996640 0 -- 172.21.15.148:0/2630844552 >> [v2:172.21.15.148:6816/2601521059,v1:172.21.15.148:6817/2601521059] conn(0x56519d9aa5d0 msgr2=0x56519d9ac9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.438+0000 7f2027197640 0 -- 172.21.15.148:0/2630844552 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f2018008040 msgr2=0x7f20180323f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.650+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:10.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 zone default found 2024-09-14T11:40:10.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 4 Realm: () 2024-09-14T11:40:10.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:10.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:10.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:10.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 zonegroup default 2024-09-14T11:40:10.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.654+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.658+0000 7f20296919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.658+0000 7f20296919c0 20 started sync module instance, tier type = 2024-09-14T11:40:10.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.658+0000 7f20296919c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:10.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.678+0000 7f20296919c0 20 add_watcher() i=0 2024-09-14T11:40:10.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.678+0000 7f20296919c0 20 add_watcher() i=1 2024-09-14T11:40:10.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.678+0000 7f20296919c0 20 add_watcher() i=2 2024-09-14T11:40:10.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.678+0000 7f20296919c0 20 add_watcher() i=3 2024-09-14T11:40:10.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.678+0000 7f20296919c0 20 add_watcher() i=4 2024-09-14T11:40:10.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.678+0000 7f20296919c0 20 add_watcher() i=5 2024-09-14T11:40:10.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.678+0000 7f20296919c0 20 add_watcher() i=6 2024-09-14T11:40:10.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.682+0000 7f20296919c0 20 add_watcher() i=7 2024-09-14T11:40:10.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.682+0000 7f20296919c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:10.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.686+0000 7f1eddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.686+0000 7f20296919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:10.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.686+0000 7f20296919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:10.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.686+0000 7f20296919c0 5 note: GC not initialized 2024-09-14T11:40:10.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.686+0000 7f1edcfe1640 20 reqs_thread_entry: start 2024-09-14T11:40:10.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f20296919c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:10.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f20296919c0 20 Filter name: none 2024-09-14T11:40:10.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f1e567fc640 20 reqs_thread_entry: start 2024-09-14T11:40:10.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f20296919c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:40:10.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f20296919c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f20296919c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-14T11:40:10.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f20296919c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:40:10.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f20296919c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:40:10.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.690+0000 7f20296919c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:10.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.698+0000 7f20296919c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:40:10.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.698+0000 7f20296919c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:40:10.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.698+0000 7f20296919c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:40:10.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.698+0000 7f1f0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268336 cookie 94908536539520 notifier 8615 bl.length()=746 2024-09-14T11:40:10.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.698+0000 7f1f0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:40:10.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.698+0000 7f1f0affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:40:10.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.702+0000 7f1eddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.706+0000 7f20296919c0 20 remove_watcher() i=0 2024-09-14T11:40:10.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.706+0000 7f20296919c0 2 removed watcher, disabling cache 2024-09-14T11:40:10.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.706+0000 7f20296919c0 20 remove_watcher() i=1 2024-09-14T11:40:10.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.710+0000 7f20296919c0 20 remove_watcher() i=2 2024-09-14T11:40:10.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.714+0000 7f20296919c0 20 remove_watcher() i=3 2024-09-14T11:40:10.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.714+0000 7f20296919c0 20 remove_watcher() i=4 2024-09-14T11:40:10.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.718+0000 7f20296919c0 20 remove_watcher() i=5 2024-09-14T11:40:10.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.718+0000 7f20296919c0 20 remove_watcher() i=6 2024-09-14T11:40:10.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.722+0000 7f20296919c0 20 remove_watcher() i=7 2024-09-14T11:40:10.734 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:40:10.734 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key PPYSCDQAGERFBBMSBOIL --secret ikp23PSZv54SWeLNzSe84US7N8n1/JcAKDtdE5PAL3sMXHiQll+08w== --cluster ceph 2024-09-14T11:40:10.823 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:10.823 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:10.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.866+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 realm 2024-09-14T11:40:10.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:10.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:10.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.870+0000 7fadbb7dd9c0 20 searching for the correct realm 2024-09-14T11:40:10.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.878+0000 7fadb8ae2640 0 -- 172.21.15.148:0/238429280 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7fadb4018070 msgr2=0x7fadb406d640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:10.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.886+0000 7fadb9ae4640 0 -- 172.21.15.148:0/238429280 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55e17fab0e00 msgr2=0x55e17fab3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:10.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:10.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:10.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:10.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:10.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:10.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.890+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 zone default found 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 4 Realm: () 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 zonegroup default 2024-09-14T11:40:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 started sync module instance, tier type = 2024-09-14T11:40:10.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.894+0000 7fadbb7dd9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:10.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 20 add_watcher() i=0 2024-09-14T11:40:10.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 20 add_watcher() i=1 2024-09-14T11:40:10.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 20 add_watcher() i=2 2024-09-14T11:40:10.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 20 add_watcher() i=3 2024-09-14T11:40:10.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 20 add_watcher() i=4 2024-09-14T11:40:10.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 20 add_watcher() i=5 2024-09-14T11:40:10.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 20 add_watcher() i=6 2024-09-14T11:40:10.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 20 add_watcher() i=7 2024-09-14T11:40:10.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.914+0000 7fadbb7dd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:10.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.918+0000 7fac6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.918+0000 7fadbb7dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:10.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.918+0000 7fadbb7dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:10.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.918+0000 7fadbb7dd9c0 5 note: GC not initialized 2024-09-14T11:40:10.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.918+0000 7fac6e7e4640 20 reqs_thread_entry: start 2024-09-14T11:40:10.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.918+0000 7fadbb7dd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:10.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 20 Filter name: none 2024-09-14T11:40:10.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fabdffff640 20 reqs_thread_entry: start 2024-09-14T11:40:10.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:40:10.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:40:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:40:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:40:10.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:40:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 cache get: name=default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL : miss 2024-09-14T11:40:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 cache put: name=default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL info.flags=0x0 2024-09-14T11:40:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 adding default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL to cache LRU end 2024-09-14T11:40:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 cache get: name=default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL : hit (negative entry) 2024-09-14T11:40:10.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.922+0000 7fadbb7dd9c0 10 cache get: name=default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL : hit (negative entry) 2024-09-14T11:40:10.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.926+0000 7fadbb7dd9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:40:10.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.926+0000 7fadbb7dd9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:10.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.926+0000 7fadbb7dd9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:40:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.926+0000 7fac9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268337 cookie 94426998003392 notifier 9225 bl.length()=660 2024-09-14T11:40:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.926+0000 7fac9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:40:10.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.926+0000 7fac9cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.930+0000 7fadbb7dd9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:40:10.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.930+0000 7fadbb7dd9c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:40:10.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.930+0000 7fadbb7dd9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:40:10.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.930+0000 7fac9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268276 cookie 94426997927296 notifier 9225 bl.length()=191 2024-09-14T11:40:10.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.930+0000 7fac9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:40:10.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.930+0000 7fac9cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:40:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.934+0000 7fadbb7dd9c0 10 cache put: name=default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL info.flags=0x7 2024-09-14T11:40:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.934+0000 7fadbb7dd9c0 10 moving default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL to cache LRU end 2024-09-14T11:40:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.934+0000 7fadbb7dd9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:PPYSCDQAGERFBBMSBOIL, ofs0, ns] 2024-09-14T11:40:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.934+0000 7fac9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268129 cookie 94426997990112 notifier 9225 bl.length()=189 2024-09-14T11:40:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.934+0000 7fac9cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL info.flags=0x7 2024-09-14T11:40:10.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.934+0000 7fac9cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PPYSCDQAGERFBBMSBOIL to cache LRU end 2024-09-14T11:40:10.932 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "foobar.client.0", 2024-09-14T11:40:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:40:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "foobar+test@test.test", 2024-09-14T11:40:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:40:10.933 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:40:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:40:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "foobar.client.0", 2024-09-14T11:40:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "PPYSCDQAGERFBBMSBOIL", 2024-09-14T11:40:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "ikp23PSZv54SWeLNzSe84US7N8n1/JcAKDtdE5PAL3sMXHiQll+08w==", 2024-09-14T11:40:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:40:10.934 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:10.927773Z" 2024-09-14T11:40:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:40:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:40:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:40:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:40:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:40:10.935 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:10.936 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "rgw", 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:40:10.937 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "", 2024-09-14T11:40:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:40:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:10.927752Z", 2024-09-14T11:40:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:40:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:40:10.938 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:10.938 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:10.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.938+0000 7fac6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.942+0000 7fadbb7dd9c0 20 remove_watcher() i=0 2024-09-14T11:40:10.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.942+0000 7fadbb7dd9c0 2 removed watcher, disabling cache 2024-09-14T11:40:10.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.946+0000 7fadbb7dd9c0 20 remove_watcher() i=1 2024-09-14T11:40:10.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.946+0000 7fadbb7dd9c0 20 remove_watcher() i=2 2024-09-14T11:40:10.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.950+0000 7fadbb7dd9c0 20 remove_watcher() i=3 2024-09-14T11:40:10.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.950+0000 7fadbb7dd9c0 20 remove_watcher() i=4 2024-09-14T11:40:10.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.950+0000 7fadbb7dd9c0 20 remove_watcher() i=5 2024-09-14T11:40:10.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.954+0000 7fadbb7dd9c0 20 remove_watcher() i=6 2024-09-14T11:40:10.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:10.958+0000 7fadbb7dd9c0 20 remove_watcher() i=7 2024-09-14T11:40:10.970 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 3170859102 --totp-seed 2VTURZEIX2IP5NV33426WDJ5TYFFZMG2TQIF6RMHFNXZ37HWLDBF5SO3NMP6XY35 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:40:11.013 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:11.013 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:11.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.054+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.058+0000 7f56b46c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.058+0000 7f56b46c79c0 20 realm 2024-09-14T11:40:11.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.058+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.058+0000 7f56b46c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.058+0000 7f56b46c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:11.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.058+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.058+0000 7f56b46c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.058+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.062+0000 7f56b46c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.062+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.062+0000 7f56b46c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:11.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.062+0000 7f56b46c79c0 20 searching for the correct realm 2024-09-14T11:40:11.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.066+0000 7f56b21cd640 0 -- 172.21.15.148:0/2556060379 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f56a4046070 msgr2=0x7f56a408d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:11.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.074+0000 7f56b21cd640 0 -- 172.21.15.148:0/2556060379 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7f56ac10f020 msgr2=0x7f56ac0fd2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:11.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:11.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:11.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:11.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:11.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:11.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:11.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.078+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 zone default found 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 4 Realm: () 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 zonegroup default 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 started sync module instance, tier type = 2024-09-14T11:40:11.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.082+0000 7f56b46c79c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 20 add_watcher() i=0 2024-09-14T11:40:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 20 add_watcher() i=1 2024-09-14T11:40:11.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 20 add_watcher() i=2 2024-09-14T11:40:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 20 add_watcher() i=3 2024-09-14T11:40:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 20 add_watcher() i=4 2024-09-14T11:40:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 20 add_watcher() i=5 2024-09-14T11:40:11.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 20 add_watcher() i=6 2024-09-14T11:40:11.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 20 add_watcher() i=7 2024-09-14T11:40:11.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.102+0000 7f56b46c79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:11.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f5568fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 5 note: GC not initialized 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f54e37fe640 20 reqs_thread_entry: start 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 20 Filter name: none 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f54e17fa640 20 reqs_thread_entry: start 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:40:11.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:40:11.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:40:11.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:11.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.106+0000 7f56b46c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:11.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.114+0000 7f56b46c79c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:40:11.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.114+0000 7f56b46c79c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:11.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.114+0000 7f56b46c79c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:40:11.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.114+0000 7f5595ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268338 cookie 94795263726336 notifier 8651 bl.length()=674 2024-09-14T11:40:11.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.114+0000 7f5595ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:40:11.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.114+0000 7f5595ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:11.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.118+0000 7f5568fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:11.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.122+0000 7f56b46c79c0 20 remove_watcher() i=0 2024-09-14T11:40:11.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.122+0000 7f56b46c79c0 2 removed watcher, disabling cache 2024-09-14T11:40:11.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.122+0000 7f56b46c79c0 20 remove_watcher() i=1 2024-09-14T11:40:11.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.126+0000 7f56b46c79c0 20 remove_watcher() i=2 2024-09-14T11:40:11.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.126+0000 7f56b46c79c0 20 remove_watcher() i=3 2024-09-14T11:40:11.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.130+0000 7f56b46c79c0 20 remove_watcher() i=4 2024-09-14T11:40:11.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.130+0000 7f56b46c79c0 20 remove_watcher() i=5 2024-09-14T11:40:11.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.134+0000 7f56b46c79c0 20 remove_watcher() i=6 2024-09-14T11:40:11.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.134+0000 7f56b46c79c0 20 remove_watcher() i=7 2024-09-14T11:40:11.146 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:40:11.220 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:11.220 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:11.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.266+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.266+0000 7f511a4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.266+0000 7f511a4589c0 20 realm 2024-09-14T11:40:11.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.266+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:11.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:11.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.270+0000 7f511a4589c0 20 searching for the correct realm 2024-09-14T11:40:11.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.274+0000 7f511775d640 0 -- 172.21.15.148:0/2053240447 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f5110017020 msgr2=0x7f5110030410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:11.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.282+0000 7f511875f640 0 -- 172.21.15.148:0/2053240447 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x559cb0e04830 msgr2=0x559cb0e06c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:11.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:11.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:11.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:11.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:11.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:11.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:11.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.290+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:11.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 zone default found 2024-09-14T11:40:11.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 4 Realm: () 2024-09-14T11:40:11.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:11.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:11.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 zonegroup default 2024-09-14T11:40:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 started sync module instance, tier type = 2024-09-14T11:40:11.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.294+0000 7f511a4589c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:11.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 20 add_watcher() i=0 2024-09-14T11:40:11.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 20 add_watcher() i=1 2024-09-14T11:40:11.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 20 add_watcher() i=2 2024-09-14T11:40:11.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 20 add_watcher() i=3 2024-09-14T11:40:11.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 20 add_watcher() i=4 2024-09-14T11:40:11.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 20 add_watcher() i=5 2024-09-14T11:40:11.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 20 add_watcher() i=6 2024-09-14T11:40:11.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 20 add_watcher() i=7 2024-09-14T11:40:11.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.314+0000 7f511a4589c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:11.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f4fcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f511a4589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f511a4589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f511a4589c0 5 note: GC not initialized 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f4fccfe1640 20 reqs_thread_entry: start 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f511a4589c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f511a4589c0 20 Filter name: none 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f4f467fc640 20 reqs_thread_entry: start 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f511a4589c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:40:11.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.318+0000 7f511a4589c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.322+0000 7f511a4589c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:40:11.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.322+0000 7f511a4589c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:40:11.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.322+0000 7f511a4589c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:11.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.322+0000 7f511a4589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:11.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.326+0000 7f511a4589c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:40:11.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.326+0000 7f511a4589c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:11.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.326+0000 7f511a4589c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:40:11.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.326+0000 7f4ff6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268339 cookie 94131470830048 notifier 9264 bl.length()=727 2024-09-14T11:40:11.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.326+0000 7f4ff6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:40:11.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.326+0000 7f4ff6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:40:11.323 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:11.323 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "foobar.client.0", 2024-09-14T11:40:11.323 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "foobar+test@test.test", 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "foobar.client.0", 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "PPYSCDQAGERFBBMSBOIL", 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "ikp23PSZv54SWeLNzSe84US7N8n1/JcAKDtdE5PAL3sMXHiQll+08w==", 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:10.927773Z" 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:40:11.324 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [ 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "oidc-provider", 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: "perm": "*" 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "roles", 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: "perm": "*" 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "user-policy", 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: "perm": "*" 2024-09-14T11:40:11.325 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:11.326 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "rgw", 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [ 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "3170859102" 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "", 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:10.927752Z", 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:11.327 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:11.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.330+0000 7f4fcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:11.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.334+0000 7f511a4589c0 20 remove_watcher() i=0 2024-09-14T11:40:11.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.334+0000 7f511a4589c0 2 removed watcher, disabling cache 2024-09-14T11:40:11.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.334+0000 7f511a4589c0 20 remove_watcher() i=1 2024-09-14T11:40:11.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.338+0000 7f511a4589c0 20 remove_watcher() i=2 2024-09-14T11:40:11.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.338+0000 7f511a4589c0 20 remove_watcher() i=3 2024-09-14T11:40:11.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.342+0000 7f511a4589c0 20 remove_watcher() i=4 2024-09-14T11:40:11.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.342+0000 7f511a4589c0 20 remove_watcher() i=5 2024-09-14T11:40:11.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.346+0000 7f511a4589c0 20 remove_watcher() i=6 2024-09-14T11:40:11.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.350+0000 7f511a4589c0 20 remove_watcher() i=7 2024-09-14T11:40:11.360 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:40:11.440 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:11.440 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:11.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.486+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 realm 2024-09-14T11:40:11.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:11.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.490+0000 7f80102259c0 20 searching for the correct realm 2024-09-14T11:40:11.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.498+0000 7f800d52a640 0 -- 172.21.15.148:0/319183115 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f800801f040 msgr2=0x7f800801f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:11.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.714+0000 7f800e52c640 0 -- 172.21.15.148:0/319183115 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55b2174bcd70 msgr2=0x55b2174bf230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:11.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.722+0000 7f80102259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:11.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.722+0000 7f80102259c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:11.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.722+0000 7f80102259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:11.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.722+0000 7f80102259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:11.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.722+0000 7f80102259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:11.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.722+0000 7f80102259c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:11.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.722+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 zone default found 2024-09-14T11:40:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 4 Realm: () 2024-09-14T11:40:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 zonegroup default 2024-09-14T11:40:11.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.726+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.730+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.730+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.730+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.730+0000 7f80102259c0 20 started sync module instance, tier type = 2024-09-14T11:40:11.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.730+0000 7f80102259c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:11.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.754+0000 7f80102259c0 20 add_watcher() i=0 2024-09-14T11:40:11.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.754+0000 7f80102259c0 20 add_watcher() i=1 2024-09-14T11:40:11.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.754+0000 7f80102259c0 20 add_watcher() i=2 2024-09-14T11:40:11.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.754+0000 7f80102259c0 20 add_watcher() i=3 2024-09-14T11:40:11.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.754+0000 7f80102259c0 20 add_watcher() i=4 2024-09-14T11:40:11.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.754+0000 7f80102259c0 20 add_watcher() i=5 2024-09-14T11:40:11.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.754+0000 7f80102259c0 20 add_watcher() i=6 2024-09-14T11:40:11.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.758+0000 7f80102259c0 20 add_watcher() i=7 2024-09-14T11:40:11.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.758+0000 7f80102259c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:11.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f7ec3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:11.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:11.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:11.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 5 note: GC not initialized 2024-09-14T11:40:11.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f7ec2fe5640 20 reqs_thread_entry: start 2024-09-14T11:40:11.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:11.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 Filter name: none 2024-09-14T11:40:11.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f7ec0fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:11.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:40:11.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:40:11.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:40:11.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:40:11.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:40:11.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:40:11.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:40:11.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.762+0000 7f80102259c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:40:11.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.766+0000 7f80102259c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:40:11.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.766+0000 7f80102259c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:40:11.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.766+0000 7f80102259c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:40:11.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.766+0000 7f7ef17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268277 cookie 94223383389664 notifier 9285 bl.length()=384 2024-09-14T11:40:11.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.766+0000 7f7ef17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:40:11.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.766+0000 7f7ef17fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:40:11.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.774+0000 7f80102259c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:40:11.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.774+0000 7f80102259c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:40:11.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.774+0000 7f80102259c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:40:11.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.774+0000 7f7ef17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268278 cookie 94223383455424 notifier 9285 bl.length()=225 2024-09-14T11:40:11.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.774+0000 7f7ef17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:40:11.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.774+0000 7f7ef17fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:40:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.778+0000 7f80102259c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:40:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.778+0000 7f80102259c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:40:11.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.778+0000 7f80102259c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:40:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.778+0000 7f7ef0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268144 cookie 94223383452720 notifier 9285 bl.length()=234 2024-09-14T11:40:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.778+0000 7f7ef0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:40:11.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.778+0000 7f7ef0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:40:11.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.782+0000 7f7ec3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.786+0000 7f80102259c0 20 remove_watcher() i=0 2024-09-14T11:40:11.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.786+0000 7f80102259c0 2 removed watcher, disabling cache 2024-09-14T11:40:11.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.790+0000 7f80102259c0 20 remove_watcher() i=1 2024-09-14T11:40:11.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.790+0000 7f80102259c0 20 remove_watcher() i=2 2024-09-14T11:40:11.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.794+0000 7f80102259c0 20 remove_watcher() i=3 2024-09-14T11:40:11.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.794+0000 7f80102259c0 20 remove_watcher() i=4 2024-09-14T11:40:11.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.798+0000 7f80102259c0 20 remove_watcher() i=5 2024-09-14T11:40:11.795 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.798+0000 7f80102259c0 20 remove_watcher() i=6 2024-09-14T11:40:11.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.802+0000 7f80102259c0 20 remove_watcher() i=7 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "id": "RGW88888888888888888", 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "tenant": "", 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "quota": { 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:11.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max_users": 1000, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max_roles": 1000, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max_groups": 1000, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout: "max_access_keys": 4 2024-09-14T11:40:11.815 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:11.817 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:40:11.817 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key DBUVKJKKGGATVPLTYFWS --secret M1GOTfLNRTl3wERuSLizUeOV1y+9UncrcRYmONg3+rglRS2hih7VoQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:40:11.908 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:11.908 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:11.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.950+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 realm 2024-09-14T11:40:11.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:11.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.954+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.958+0000 7fe13cc429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:11.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.958+0000 7fe13cc429c0 20 searching for the correct realm 2024-09-14T11:40:11.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.962+0000 7fe13af49640 0 -- 172.21.15.148:0/1482466022 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5628699a1510 msgr2=0x5628699a3980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:11.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.970+0000 7fe13a748640 0 -- 172.21.15.148:0/1482466022 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x5628699a5940 msgr2=0x5628699a7d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:11.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.974+0000 7fe13cc429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:11.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.974+0000 7fe13cc429c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:11.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.974+0000 7fe13cc429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:11.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.974+0000 7fe13cc429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:11.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.974+0000 7fe13cc429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:11.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.974+0000 7fe13cc429c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:11.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.974+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 zone default found 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 4 Realm: () 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 zonegroup default 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 started sync module instance, tier type = 2024-09-14T11:40:11.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.978+0000 7fe13cc429c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:11.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 20 add_watcher() i=0 2024-09-14T11:40:11.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 20 add_watcher() i=1 2024-09-14T11:40:11.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 20 add_watcher() i=2 2024-09-14T11:40:11.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 20 add_watcher() i=3 2024-09-14T11:40:11.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 20 add_watcher() i=4 2024-09-14T11:40:11.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 20 add_watcher() i=5 2024-09-14T11:40:11.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 20 add_watcher() i=6 2024-09-14T11:40:11.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 20 add_watcher() i=7 2024-09-14T11:40:11.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:11.998+0000 7fe13cc429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.002+0000 7fdff0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.002+0000 7fe13cc429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.002+0000 7fe13cc429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.002+0000 7fe13cc429c0 5 note: GC not initialized 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.002+0000 7fdf6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.002+0000 7fe13cc429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.002+0000 7fe13cc429c0 20 Filter name: none 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.002+0000 7fdf697fa640 20 reqs_thread_entry: start 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:40:12.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:40:12.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:40:12.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:40:12.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:40:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:40:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache get: name=default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS : miss 2024-09-14T11:40:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache put: name=default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS info.flags=0x0 2024-09-14T11:40:12.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 adding default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS to cache LRU end 2024-09-14T11:40:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:40:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:40:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:40:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:40:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache get: name=default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS : hit (negative entry) 2024-09-14T11:40:12.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.006+0000 7fe13cc429c0 10 cache get: name=default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS : hit (negative entry) 2024-09-14T11:40:12.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.010+0000 7fe13cc429c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:40:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.010+0000 7fe13cc429c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:40:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.010+0000 7fe13cc429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:40:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.014+0000 7fe01dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268279 cookie 94731570412000 notifier 9300 bl.length()=681 2024-09-14T11:40:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.014+0000 7fe01dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:40:12.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.014+0000 7fe01dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:40:12.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.018+0000 7fe13cc429c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:40:12.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.018+0000 7fe13cc429c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:40:12.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.018+0000 7fe13cc429c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:40:12.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.018+0000 7fe01dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268340 cookie 94731570450240 notifier 9300 bl.length()=189 2024-09-14T11:40:12.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.018+0000 7fe01dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:40:12.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.018+0000 7fe01dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:40:12.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.022+0000 7fe13cc429c0 10 cache put: name=default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS info.flags=0x7 2024-09-14T11:40:12.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.022+0000 7fe13cc429c0 10 moving default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS to cache LRU end 2024-09-14T11:40:12.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.022+0000 7fe13cc429c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:DBUVKJKKGGATVPLTYFWS, ofs0, ns] 2024-09-14T11:40:12.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.022+0000 7fe01dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268149 cookie 94731570409248 notifier 9300 bl.length()=188 2024-09-14T11:40:12.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.022+0000 7fe01dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS info.flags=0x7 2024-09-14T11:40:12.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.022+0000 7fe01dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DBUVKJKKGGATVPLTYFWS to cache LRU end 2024-09-14T11:40:12.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.026+0000 7fe13cc429c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:40:12.022 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "root1.client.0", 2024-09-14T11:40:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:40:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "root1+test@test.test", 2024-09-14T11:40:12.022 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "root1.client.0", 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "DBUVKJKKGGATVPLTYFWS", 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "M1GOTfLNRTl3wERuSLizUeOV1y+9UncrcRYmONg3+rglRS2hih7VoQ==", 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:12.012596Z" 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:12.023 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:40:12.024 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "root", 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:12.012578Z", 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:40:12.025 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:12.026 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:12.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.026+0000 7fdff0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:12.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.030+0000 7fe13cc429c0 20 remove_watcher() i=0 2024-09-14T11:40:12.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.030+0000 7fe13cc429c0 2 removed watcher, disabling cache 2024-09-14T11:40:12.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.034+0000 7fe13cc429c0 20 remove_watcher() i=1 2024-09-14T11:40:12.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.034+0000 7fe13cc429c0 20 remove_watcher() i=2 2024-09-14T11:40:12.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.038+0000 7fe13cc429c0 20 remove_watcher() i=3 2024-09-14T11:40:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.038+0000 7fe13cc429c0 20 remove_watcher() i=4 2024-09-14T11:40:12.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.042+0000 7fe13cc429c0 20 remove_watcher() i=5 2024-09-14T11:40:12.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.046+0000 7fe13cc429c0 20 remove_watcher() i=6 2024-09-14T11:40:12.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.046+0000 7fe13cc429c0 20 remove_watcher() i=7 2024-09-14T11:40:12.059 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0811466073 --totp-seed FSOSWDDY4PMVOXTWSZASQ66YAF76QVJGIG4HBDRQ4W6OCMLP3EFXQ3OESCJZQBLE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:40:12.100 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:12.100 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:12.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 20 realm 2024-09-14T11:40:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.146+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.150+0000 7f90bf04c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.150+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.150+0000 7f90bf04c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.150+0000 7f90bf04c9c0 20 searching for the correct realm 2024-09-14T11:40:12.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.154+0000 7f90bc351640 0 -- 172.21.15.148:0/1092720348 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f90b40be9e0 msgr2=0x7f90b40cf440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:12.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.162+0000 7f90bd353640 0 -- 172.21.15.148:0/1092720348 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x5630afad7290 msgr2=0x5630afad9720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:12.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:12.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:12.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:12.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:12.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:12.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:12.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:12.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:12.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 zone default found 2024-09-14T11:40:12.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 4 Realm: () 2024-09-14T11:40:12.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:12.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:12.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:12.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 zonegroup default 2024-09-14T11:40:12.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 started sync module instance, tier type = 2024-09-14T11:40:12.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.170+0000 7f90bf04c9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:12.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 20 add_watcher() i=0 2024-09-14T11:40:12.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 20 add_watcher() i=1 2024-09-14T11:40:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 20 add_watcher() i=2 2024-09-14T11:40:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 20 add_watcher() i=3 2024-09-14T11:40:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 20 add_watcher() i=4 2024-09-14T11:40:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 20 add_watcher() i=5 2024-09-14T11:40:12.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 20 add_watcher() i=6 2024-09-14T11:40:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 20 add_watcher() i=7 2024-09-14T11:40:12.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.194+0000 7f90bf04c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f8f72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f90bf04c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f90bf04c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f90bf04c9c0 5 note: GC not initialized 2024-09-14T11:40:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f8f71fe3640 20 reqs_thread_entry: start 2024-09-14T11:40:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f90bf04c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:12.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f90bf04c9c0 20 Filter name: none 2024-09-14T11:40:12.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f8ee37fe640 20 reqs_thread_entry: start 2024-09-14T11:40:12.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f90bf04c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:40:12.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.198+0000 7f90bf04c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.202+0000 7f90bf04c9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:40:12.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.202+0000 7f90bf04c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:40:12.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.202+0000 7f90bf04c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:40:12.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.202+0000 7f90bf04c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:12.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.206+0000 7f90bf04c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:40:12.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.206+0000 7f90bf04c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:40:12.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.206+0000 7f90bf04c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:40:12.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.206+0000 7f8f93fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268280 cookie 94767105803520 notifier 8723 bl.length()=695 2024-09-14T11:40:12.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.206+0000 7f8f93fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:40:12.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.206+0000 7f8f93fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:40:12.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.210+0000 7f8f72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:12.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.214+0000 7f90bf04c9c0 20 remove_watcher() i=0 2024-09-14T11:40:12.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.214+0000 7f90bf04c9c0 2 removed watcher, disabling cache 2024-09-14T11:40:12.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.218+0000 7f90bf04c9c0 20 remove_watcher() i=1 2024-09-14T11:40:12.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.218+0000 7f90bf04c9c0 20 remove_watcher() i=2 2024-09-14T11:40:12.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.222+0000 7f90bf04c9c0 20 remove_watcher() i=3 2024-09-14T11:40:12.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.226+0000 7f90bf04c9c0 20 remove_watcher() i=4 2024-09-14T11:40:12.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.226+0000 7f90bf04c9c0 20 remove_watcher() i=5 2024-09-14T11:40:12.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.230+0000 7f90bf04c9c0 20 remove_watcher() i=6 2024-09-14T11:40:12.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.230+0000 7f90bf04c9c0 20 remove_watcher() i=7 2024-09-14T11:40:12.242 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:40:12.322 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:12.322 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:12.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.366+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 realm 2024-09-14T11:40:12.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:12.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:12.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:12.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.370+0000 7f442b1399c0 20 searching for the correct realm 2024-09-14T11:40:12.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.378+0000 7f442843e640 0 -- 172.21.15.148:0/2318263508 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f44200c3040 msgr2=0x7f44200c3930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:12.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.382+0000 7f4429440640 0 -- 172.21.15.148:0/2318263508 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x559e7f7d0020 msgr2=0x559e7f7d24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:12.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:12.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:12.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:12.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:12.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:12.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:12.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:12.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 zone default found 2024-09-14T11:40:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 4 Realm: () 2024-09-14T11:40:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 zonegroup default 2024-09-14T11:40:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.390+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.394+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.394+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.394+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.394+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.394+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.394+0000 7f442b1399c0 20 started sync module instance, tier type = 2024-09-14T11:40:12.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.394+0000 7f442b1399c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.410+0000 7f442b1399c0 20 add_watcher() i=0 2024-09-14T11:40:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.410+0000 7f442b1399c0 20 add_watcher() i=1 2024-09-14T11:40:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.410+0000 7f442b1399c0 20 add_watcher() i=2 2024-09-14T11:40:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.410+0000 7f442b1399c0 20 add_watcher() i=3 2024-09-14T11:40:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.410+0000 7f442b1399c0 20 add_watcher() i=4 2024-09-14T11:40:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.410+0000 7f442b1399c0 20 add_watcher() i=5 2024-09-14T11:40:12.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.410+0000 7f442b1399c0 20 add_watcher() i=6 2024-09-14T11:40:12.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.414+0000 7f442b1399c0 20 add_watcher() i=7 2024-09-14T11:40:12.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.414+0000 7f442b1399c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:12.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f42df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:12.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 5 note: GC not initialized 2024-09-14T11:40:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f42de7e4640 20 reqs_thread_entry: start 2024-09-14T11:40:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 Filter name: none 2024-09-14T11:40:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f42d77fe640 20 reqs_thread_entry: start 2024-09-14T11:40:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:40:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:40:12.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.418+0000 7f442b1399c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:40:12.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.422+0000 7f442b1399c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:40:12.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.422+0000 7f442b1399c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:40:12.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.422+0000 7f442b1399c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:40:12.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.422+0000 7f42fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268281 cookie 94139232096928 notifier 9336 bl.length()=384 2024-09-14T11:40:12.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.422+0000 7f42fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:40:12.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.422+0000 7f42fffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:40:12.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.426+0000 7f442b1399c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:40:12.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.426+0000 7f442b1399c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:40:12.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.426+0000 7f442b1399c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:40:12.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.426+0000 7f42fffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268282 cookie 94139232163024 notifier 9336 bl.length()=225 2024-09-14T11:40:12.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.426+0000 7f42fffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:40:12.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.426+0000 7f42fffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:40:12.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.430+0000 7f442b1399c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:40:12.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.430+0000 7f442b1399c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:40:12.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.430+0000 7f442b1399c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:40:12.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.430+0000 7f42ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268145 cookie 94139232160688 notifier 9336 bl.length()=234 2024-09-14T11:40:12.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.430+0000 7f42ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:40:12.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.430+0000 7f42ff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:40:12.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.434+0000 7f42df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:12.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.442+0000 7f442b1399c0 20 remove_watcher() i=0 2024-09-14T11:40:12.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.442+0000 7f442b1399c0 2 removed watcher, disabling cache 2024-09-14T11:40:12.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.442+0000 7f442b1399c0 20 remove_watcher() i=1 2024-09-14T11:40:12.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.446+0000 7f442b1399c0 20 remove_watcher() i=2 2024-09-14T11:40:12.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.446+0000 7f442b1399c0 20 remove_watcher() i=3 2024-09-14T11:40:12.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.450+0000 7f442b1399c0 20 remove_watcher() i=4 2024-09-14T11:40:12.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.450+0000 7f442b1399c0 20 remove_watcher() i=5 2024-09-14T11:40:12.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.454+0000 7f442b1399c0 20 remove_watcher() i=6 2024-09-14T11:40:12.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.458+0000 7f442b1399c0 20 remove_watcher() i=7 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "id": "RGW99999999999999999", 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "tenant": "", 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "quota": { 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:12.465 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max_users": 1000, 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max_roles": 1000, 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max_groups": 1000, 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout: "max_access_keys": 4 2024-09-14T11:40:12.466 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:12.467 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:40:12.467 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key TEWHYJPOJDFVEFNIBLQC --secret blkNzMYpzqHoTaRza39D+EtzjVttKkxqOt+wpA9jJzqWFLKyHxQJLA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:40:12.556 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:12.556 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:12.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.602+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.602+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.602+0000 7fabc6a269c0 20 realm 2024-09-14T11:40:12.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.602+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.602+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.602+0000 7fabc6a269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:12.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.602+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.606+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.606+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.606+0000 7fabc6a269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.606+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.606+0000 7fabc6a269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:12.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.606+0000 7fabc6a269c0 20 searching for the correct realm 2024-09-14T11:40:12.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.614+0000 7fabc452c640 0 -- 172.21.15.148:0/1026395664 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fabb4120020 msgr2=0x7fabb4003ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:12.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.618+0000 7fabc452c640 0 -- 172.21.15.148:0/1026395664 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x56452f930470 msgr2=0x56452f9328a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:12.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:12.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:12.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:12.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:12.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:12.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:12.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:12.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:12.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 zone default found 2024-09-14T11:40:12.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 4 Realm: () 2024-09-14T11:40:12.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:12.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:12.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:12.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 zonegroup default 2024-09-14T11:40:12.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.626+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.630+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.630+0000 7fabc6a269c0 20 started sync module instance, tier type = 2024-09-14T11:40:12.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.630+0000 7fabc6a269c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.646+0000 7fabc6a269c0 20 add_watcher() i=0 2024-09-14T11:40:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.646+0000 7fabc6a269c0 20 add_watcher() i=1 2024-09-14T11:40:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.646+0000 7fabc6a269c0 20 add_watcher() i=2 2024-09-14T11:40:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.646+0000 7fabc6a269c0 20 add_watcher() i=3 2024-09-14T11:40:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.646+0000 7fabc6a269c0 20 add_watcher() i=4 2024-09-14T11:40:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.646+0000 7fabc6a269c0 20 add_watcher() i=5 2024-09-14T11:40:12.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.646+0000 7fabc6a269c0 20 add_watcher() i=6 2024-09-14T11:40:12.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.650+0000 7fabc6a269c0 20 add_watcher() i=7 2024-09-14T11:40:12.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.650+0000 7fabc6a269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:12.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.650+0000 7faa7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:12.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.650+0000 7fabc6a269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:12.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.650+0000 7fabc6a269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:12.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.650+0000 7fabc6a269c0 5 note: GC not initialized 2024-09-14T11:40:12.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7faa797e2640 20 reqs_thread_entry: start 2024-09-14T11:40:12.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:12.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 Filter name: none 2024-09-14T11:40:12.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fa9eaffd640 20 reqs_thread_entry: start 2024-09-14T11:40:12.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:40:12.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache get: name=default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC : miss 2024-09-14T11:40:12.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache put: name=default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC info.flags=0x0 2024-09-14T11:40:12.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 adding default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC to cache LRU end 2024-09-14T11:40:12.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:40:12.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:40:12.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:40:12.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:40:12.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:12.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.654+0000 7fabc6a269c0 10 cache get: name=default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC : hit (negative entry) 2024-09-14T11:40:12.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.658+0000 7fabc6a269c0 10 cache get: name=default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC : hit (negative entry) 2024-09-14T11:40:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.658+0000 7fabc6a269c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:40:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.658+0000 7fabc6a269c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:40:12.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.658+0000 7fabc6a269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:40:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.658+0000 7faaa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268283 cookie 94855150943456 notifier 9354 bl.length()=681 2024-09-14T11:40:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.658+0000 7faaa37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:40:12.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.658+0000 7faaa37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:40:12.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.666+0000 7fabc6a269c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:40:12.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.666+0000 7fabc6a269c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:40:12.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.666+0000 7fabc6a269c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:40:12.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.666+0000 7faaa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268341 cookie 94855150955152 notifier 9354 bl.length()=189 2024-09-14T11:40:12.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.666+0000 7faaa37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:40:12.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.666+0000 7faaa37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:40:12.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.670+0000 7fabc6a269c0 10 cache put: name=default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC info.flags=0x7 2024-09-14T11:40:12.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.670+0000 7fabc6a269c0 10 moving default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC to cache LRU end 2024-09-14T11:40:12.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.670+0000 7fabc6a269c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:TEWHYJPOJDFVEFNIBLQC, ofs0, ns] 2024-09-14T11:40:12.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.674+0000 7faaa2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268342 cookie 94855150955152 notifier 9354 bl.length()=188 2024-09-14T11:40:12.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.674+0000 7faaa2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC info.flags=0x7 2024-09-14T11:40:12.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.674+0000 7faaa2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TEWHYJPOJDFVEFNIBLQC to cache LRU end 2024-09-14T11:40:12.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.674+0000 7fabc6a269c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:40:12.671 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T11:40:12.671 INFO:teuthology.orchestra.run.smithi148.stdout: "user_id": "root2.client.0", 2024-09-14T11:40:12.671 INFO:teuthology.orchestra.run.smithi148.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "email": "root2+test@test.test", 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "suspended": 0, 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "max_buckets": 1000, 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "subusers": [], 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "keys": [ 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "user": "root2.client.0", 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "access_key": "TEWHYJPOJDFVEFNIBLQC", 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "secret_key": "blkNzMYpzqHoTaRza39D+EtzjVttKkxqOt+wpA9jJzqWFLKyHxQJLA==", 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "active": true, 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:12.661616Z" 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-14T11:40:12.672 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "swift_keys": [], 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": [], 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "op_mask": "read, write, delete", 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "default_placement": "", 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "default_storage_class": "", 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "placement_tags": [], 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "bucket_quota": { 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "user_quota": { 2024-09-14T11:40:12.673 INFO:teuthology.orchestra.run.smithi148.stdout: "enabled": false, 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "check_on_raw": false, 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size": -1, 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "max_size_kb": 0, 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "max_objects": -1 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "temp_url_keys": [], 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "root", 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "mfa_ids": [], 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "path": "/", 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "create_date": "2024-09-14T11:40:12.661598Z", 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "tags": [], 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout: "group_ids": [] 2024-09-14T11:40:12.674 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T11:40:12.675 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:40:12.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.678+0000 7faa7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:12.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.682+0000 7fabc6a269c0 20 remove_watcher() i=0 2024-09-14T11:40:12.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.682+0000 7fabc6a269c0 2 removed watcher, disabling cache 2024-09-14T11:40:12.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.682+0000 7fabc6a269c0 20 remove_watcher() i=1 2024-09-14T11:40:12.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.686+0000 7fabc6a269c0 20 remove_watcher() i=2 2024-09-14T11:40:12.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.686+0000 7fabc6a269c0 20 remove_watcher() i=3 2024-09-14T11:40:12.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.690+0000 7fabc6a269c0 20 remove_watcher() i=4 2024-09-14T11:40:12.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.690+0000 7fabc6a269c0 20 remove_watcher() i=5 2024-09-14T11:40:12.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.694+0000 7fabc6a269c0 20 remove_watcher() i=6 2024-09-14T11:40:12.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.698+0000 7fabc6a269c0 20 remove_watcher() i=7 2024-09-14T11:40:12.708 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 6258520127 --totp-seed VHM2ICPPAALGYMGGGWQXXGPH7KGZPZLGWQZQZZPLMOTBWBZUGF3VF7IRKQE5WKAD --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:40:12.749 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:12.749 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:12.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 20 realm 2024-09-14T11:40:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.794+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.798+0000 7f0d192689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:12.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.798+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.798+0000 7f0d192689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:12.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.798+0000 7f0d192689c0 20 searching for the correct realm 2024-09-14T11:40:12.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.802+0000 7f0d16d6e640 0 -- 172.21.15.148:0/3832591365 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7f0d080e0070 msgr2=0x7f0d080d1950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:12.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:12.806+0000 7f0d16d6e640 0 -- 172.21.15.148:0/3832591365 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x561a1b1b3d20 msgr2=0x7f0d1005f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:13.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:13.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:13.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:13.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:13.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:13.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:13.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 zone default found 2024-09-14T11:40:13.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 4 Realm: () 2024-09-14T11:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T11:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T11:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 zonegroup default 2024-09-14T11:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.026+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.030+0000 7f0d192689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.030+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:13.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.030+0000 7f0d192689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:13.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.030+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:13.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.030+0000 7f0d192689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:13.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.030+0000 7f0d192689c0 20 started sync module instance, tier type = 2024-09-14T11:40:13.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.030+0000 7f0d192689c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T11:40:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 20 add_watcher() i=0 2024-09-14T11:40:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 20 add_watcher() i=1 2024-09-14T11:40:13.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 20 add_watcher() i=2 2024-09-14T11:40:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 20 add_watcher() i=3 2024-09-14T11:40:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 20 add_watcher() i=4 2024-09-14T11:40:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 20 add_watcher() i=5 2024-09-14T11:40:13.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 20 add_watcher() i=6 2024-09-14T11:40:13.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 20 add_watcher() i=7 2024-09-14T11:40:13.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.062+0000 7f0d192689c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:13.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.066+0000 7f0bcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:13.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.066+0000 7f0d192689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:13.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.066+0000 7f0d192689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:13.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.066+0000 7f0d192689c0 5 note: GC not initialized 2024-09-14T11:40:13.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0b47fff640 20 reqs_thread_entry: start 2024-09-14T11:40:13.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0d192689c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:13.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0d192689c0 20 Filter name: none 2024-09-14T11:40:13.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0b45ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:13.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0d192689c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:40:13.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0d192689c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:13.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0d192689c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:40:13.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0d192689c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:40:13.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0d192689c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:40:13.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.070+0000 7f0d192689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:13.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.078+0000 7f0d192689c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:40:13.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.078+0000 7f0d192689c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:40:13.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.078+0000 7f0d192689c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:40:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.078+0000 7f0bfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268284 cookie 94670125308448 notifier 9372 bl.length()=695 2024-09-14T11:40:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.078+0000 7f0bfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:40:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.078+0000 7f0bfa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:40:13.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.082+0000 7f0bcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:13.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.086+0000 7f0d192689c0 20 remove_watcher() i=0 2024-09-14T11:40:13.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.086+0000 7f0d192689c0 2 removed watcher, disabling cache 2024-09-14T11:40:13.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.090+0000 7f0d192689c0 20 remove_watcher() i=1 2024-09-14T11:40:13.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.094+0000 7f0d192689c0 20 remove_watcher() i=2 2024-09-14T11:40:13.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.094+0000 7f0d192689c0 20 remove_watcher() i=3 2024-09-14T11:40:13.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.098+0000 7f0d192689c0 20 remove_watcher() i=4 2024-09-14T11:40:13.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.098+0000 7f0d192689c0 20 remove_watcher() i=5 2024-09-14T11:40:13.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.102+0000 7f0d192689c0 20 remove_watcher() i=6 2024-09-14T11:40:13.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T11:40:13.102+0000 7f0d192689c0 20 remove_watcher() i=7 2024-09-14T11:40:13.114 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:40:13.115 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T11:40:13.115 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:40:13.161 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:40:13.162 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T11:40:13.162 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:40:13.209 DEBUG:teuthology.orchestra.run.smithi148:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:40:13.385 INFO:teuthology.orchestra.run.smithi148.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:40:13.582 INFO:teuthology.orchestra.run.smithi148.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:40:13.887 INFO:teuthology.orchestra.run.smithi148.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:42:06.653 INFO:teuthology.orchestra.run.smithi148.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:42:08.545 INFO:teuthology.orchestra.run.smithi148.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=880e5e15c3120fddc70fb87f26e454b9c26b8eb95119625f61c28c345ca3ff65,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:42:08.546 INFO:teuthology.orchestra.run.smithi148.stdout:py run-test-pre: PYTHONHASHSEED='3806594846' 2024-09-14T11:42:08.546 INFO:teuthology.orchestra.run.smithi148.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:42:08.739 INFO:teuthology.orchestra.run.smithi148.stdout:============================= test session starts ============================== 2024-09-14T11:42:08.739 INFO:teuthology.orchestra.run.smithi148.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:42:08.740 INFO:teuthology.orchestra.run.smithi148.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:42:08.740 INFO:teuthology.orchestra.run.smithi148.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:42:08.740 INFO:teuthology.orchestra.run.smithi148.stdout:configfile: pytest.ini 2024-09-14T11:42:10.562 INFO:teuthology.orchestra.run.smithi148.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:42:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T11:42:12.014 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:42:12.893 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:42:13.807 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:42:14.673 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:42:15.555 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:42:16.272 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:42:17.310 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:42:18.022 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:42:18.200 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:42:18.383 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:42:19.256 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:42:20.111 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:42:20.964 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:42:21.850 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:42:22.039 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:42:22.226 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:42:22.357 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:42:22.487 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:42:22.619 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:42:22.752 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:42:22.888 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:42:23.024 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:42:23.182 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:42:23.314 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:42:23.448 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:42:23.580 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:42:23.709 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:42:23.971 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:42:24.098 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:42:24.232 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:42:24.363 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:42:24.497 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:42:24.629 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:42:24.758 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:42:24.889 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:42:25.025 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:42:25.159 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:42:25.291 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:42:25.424 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:42:25.557 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:42:25.690 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:42:25.822 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:42:25.951 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:42:26.084 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:42:26.216 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:42:26.347 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:42:26.479 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:42:26.610 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:42:26.739 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:42:26.886 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:42:27.017 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:42:27.150 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:42:28.856 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:42:46.127 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:43:05.199 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:43:32.473 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:44:07.439 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:44:18.666 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:44:28.711 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:44:32.393 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:44:33.384 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:44:36.403 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:44:39.190 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:44:41.287 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:44:42.606 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:44:43.608 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:44:43.610 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:44:43.612 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:44:43.614 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:44:43.620 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:44:43.623 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:44:43.625 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:44:43.627 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:44:43.629 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:44:43.632 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:44:43.634 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:44:43.637 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:44:43.639 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:44:43.641 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:44:43.642 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:44:43.644 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:44:43.646 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:44:43.648 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:44:43.649 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:44:43.651 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:44:43.653 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:44:43.655 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:44:43.656 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:44:43.658 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:44:43.660 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:44:43.661 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:44:43.663 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:44:43.664 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:44:43.765 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:44:43.775 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:44:46.370 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:44:51.339 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:44:53.226 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:44:55.478 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:44:57.710 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:44:59.946 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:45:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:45:04.022 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:45:06.338 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:45:08.362 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:45:10.422 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:45:12.290 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:45:13.974 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:45:15.690 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:45:16.810 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:45:18.682 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:45:20.802 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:45:22.882 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:45:24.755 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:45:26.583 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:45:28.439 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:45:30.302 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:45:32.142 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:45:33.810 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:45:35.469 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:45:36.630 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:45:37.814 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:45:38.946 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:45:40.130 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:45:41.266 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:45:43.170 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:45:44.306 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:45:45.570 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:45:47.078 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:45:48.490 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:45:49.654 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:45:51.138 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:45:52.570 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:45:54.258 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:45:55.618 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:45:57.046 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:45:58.501 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:46:00.594 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:46:02.950 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:46:04.978 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:46:07.474 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:10.038 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:14.890 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:19.599 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:22.402 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:24.981 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:46:27.106 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:46:29.497 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:46:31.201 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:46:34.323 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:46:36.398 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:46:38.894 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:46:43.298 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:46:48.934 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:46:52.458 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:46:55.646 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:46:58.286 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:47:00.113 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:47:03.086 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:47:05.314 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:47:08.218 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:47:10.301 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:47:13.978 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:47:17.401 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:47:21.210 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:47:24.990 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:47:27.946 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:47:30.582 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:47:32.758 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:47:37.254 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:47:40.725 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:47:44.497 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:47:48.129 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:47:51.742 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:47:55.341 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:47:58.482 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:48:00.794 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:48:03.333 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:48:07.654 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:48:12.869 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:48:15.405 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:48:18.933 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:48:22.429 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:48:26.073 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:48:30.178 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:48:34.498 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:48:38.514 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:48:42.326 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:48:44.854 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:48:46.954 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:48:48.994 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:48:51.086 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:48:55.010 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:48:58.986 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:49:02.918 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:49:06.878 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:49:10.810 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:49:14.882 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:49:18.851 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:49:22.826 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:49:26.710 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:49:30.662 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:49:34.694 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:49:38.599 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:49:41.538 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:49:44.546 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:49:47.430 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:49:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:49:52.698 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:49:55.442 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:49:57.958 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:50:00.426 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:50:03.370 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:50:06.197 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:50:08.890 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:50:11.465 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:50:13.938 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:50:18.037 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:50:22.146 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:50:24.293 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:50:26.474 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:50:28.957 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:50:31.430 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:50:35.517 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:50:39.589 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:50:41.985 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:50:44.614 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:50:47.110 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:50:49.661 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:50:52.130 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:50:54.757 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:50:57.278 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:50:59.781 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:51:02.238 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:51:04.782 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:51:07.270 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:51:09.818 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:51:12.198 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:51:14.606 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:51:16.933 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:51:19.486 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:51:22.018 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:53:36.366 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:53:38.758 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:53:41.222 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:53:43.590 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:53:45.998 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:53:48.363 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:53:50.782 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:53:53.106 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:53:55.490 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:53:57.834 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:54:00.230 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:54:02.562 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:54:04.910 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:54:07.430 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:54:09.946 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:54:12.398 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:54:14.886 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:54:17.474 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:54:19.938 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:54:22.394 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:54:24.957 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:54:27.513 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:54:30.014 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:54:32.570 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:54:35.218 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:54:37.678 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:54:40.170 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:54:42.782 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:54:45.294 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:54:46.493 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:54:48.602 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:54:54.354 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:55:00.190 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:55:02.698 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:55:05.234 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:55:07.786 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:55:10.258 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:55:12.886 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:55:15.478 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:55:18.018 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:55:20.522 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:55:23.106 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:55:25.626 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:55:28.098 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:55:30.566 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:55:33.522 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:55:37.317 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:55:39.353 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:55:41.490 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:55:43.322 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:55:45.122 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:55:46.302 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:55:47.421 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:55:48.605 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:55:50.690 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:55:59.982 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:56:01.134 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:56:03.230 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:56:05.153 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:56:07.045 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:56:08.954 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:56:14.937 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:56:18.065 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:56:20.737 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:58:35.530 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T12:00:51.314 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T12:00:53.546 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T12:00:55.571 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T12:00:57.738 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T12:00:59.826 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T12:01:02.215 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T12:01:04.358 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T12:01:06.507 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T12:01:08.927 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T12:01:11.154 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T12:01:13.375 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T12:01:15.551 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T12:01:17.906 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T12:01:19.950 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T12:01:21.778 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T12:01:23.766 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T12:01:25.754 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T12:01:29.550 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T12:01:31.798 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T12:01:33.830 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T12:01:35.819 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T12:01:38.083 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T12:01:40.275 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T12:01:42.162 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T12:01:44.035 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T12:01:45.891 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T12:01:47.795 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T12:01:49.751 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T12:01:51.582 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T12:01:53.803 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T12:01:55.595 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T12:01:57.475 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T12:01:59.327 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T12:02:01.171 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T12:02:03.779 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T12:02:05.627 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T12:02:07.603 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T12:02:09.459 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T12:02:11.343 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T12:02:13.199 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T12:02:15.056 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T12:02:16.907 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T12:02:21.003 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T12:02:22.963 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T12:02:25.107 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T12:02:27.207 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T12:02:29.435 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T12:02:31.591 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T12:02:33.811 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T12:02:37.023 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T12:02:39.171 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T12:02:41.279 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T12:02:43.727 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T12:02:46.031 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T12:02:48.427 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T12:02:50.535 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T12:02:52.951 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T12:02:55.243 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T12:02:57.380 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T12:02:59.827 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T12:03:01.851 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T12:03:03.907 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T12:03:05.927 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T12:03:08.199 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T12:03:10.047 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T12:03:11.179 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T12:03:13.959 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T12:03:16.127 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T12:03:18.179 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T12:03:23.340 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T12:03:25.399 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T12:03:27.459 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T12:03:29.564 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T12:03:31.687 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T12:03:33.763 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T12:03:35.848 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T12:03:38.099 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T12:03:40.351 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T12:03:42.415 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T12:03:44.524 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T12:03:46.591 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T12:03:48.855 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T12:03:51.035 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T12:03:53.087 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T12:03:55.292 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T12:03:57.476 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T12:03:59.688 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T12:04:00.820 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T12:04:01.964 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T12:04:03.075 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T12:04:04.880 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T12:04:06.539 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T12:04:08.236 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T12:04:09.963 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T12:04:11.784 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T12:04:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T12:04:14.132 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T12:04:15.815 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T12:04:16.959 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T12:04:18.075 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T12:04:19.248 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T12:04:20.400 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T12:04:22.244 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T12:04:24.084 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T12:04:25.896 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T12:04:27.671 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T12:04:29.584 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T12:04:31.412 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T12:04:33.215 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T12:04:35.220 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T12:04:36.996 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T12:04:38.804 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T12:04:40.964 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T12:04:43.092 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T12:04:45.500 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T12:04:47.600 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T12:04:49.748 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T12:04:52.436 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T12:04:54.740 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T12:04:57.120 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T12:04:59.660 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T12:05:01.500 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T12:05:03.840 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T12:05:06.076 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T12:05:08.460 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T12:05:10.828 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T12:05:13.088 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T12:05:16.296 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T12:05:19.184 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T12:05:22.184 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T12:05:25.180 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T12:05:27.992 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T12:05:30.112 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T12:05:32.224 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T12:05:34.432 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T12:05:36.672 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T12:05:38.739 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T12:05:41.120 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T12:05:44.364 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T12:05:47.560 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T12:05:50.788 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T12:05:53.932 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T12:05:56.932 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T12:06:00.280 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T12:06:03.508 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T12:06:06.640 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T12:06:09.808 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T12:06:12.968 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T12:06:16.284 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T12:06:19.332 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T12:06:23.793 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T12:06:28.120 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T12:06:29.260 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T12:06:30.440 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T12:06:31.616 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T12:06:33.656 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T12:06:35.672 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T12:06:37.428 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T12:06:39.068 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T12:06:41.900 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T12:06:47.968 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T12:06:50.844 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T12:06:53.265 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T12:07:01.704 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T12:07:04.036 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T12:07:06.372 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T12:07:08.625 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T12:07:10.904 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T12:07:14.120 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T12:07:16.808 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T12:07:19.696 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T12:07:22.488 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T12:07:26.988 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T12:07:31.052 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T12:07:32.940 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T12:07:34.800 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T12:07:41.116 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T12:07:43.912 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T12:08:25.462 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T12:08:27.568 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T12:08:30.289 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T12:08:37.760 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T12:08:40.232 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T12:08:44.320 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T12:09:07.376 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T12:09:42.564 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T12:10:31.701 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T12:13:59.509 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T12:14:27.345 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T12:15:02.929 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T12:15:06.556 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T12:15:20.185 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T12:15:31.053 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T12:15:38.117 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T12:15:40.313 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T12:15:50.413 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T12:15:53.021 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T12:15:55.337 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T12:15:57.549 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T12:16:27.109 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T12:16:33.817 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T12:16:36.113 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T12:16:38.286 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T12:16:40.565 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T12:16:50.825 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T12:16:56.309 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T12:17:01.501 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T12:17:03.729 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T12:17:06.049 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T12:17:08.361 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T12:17:10.557 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T12:17:12.821 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T12:17:15.097 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T12:17:17.328 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T12:17:21.533 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T12:17:29.385 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T12:17:41.957 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T12:17:47.157 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T12:17:56.073 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T12:18:12.258 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T12:18:16.721 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T12:18:25.333 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T12:18:40.409 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T12:18:45.017 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T12:18:47.517 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T12:18:50.881 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T12:18:53.113 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T12:19:07.793 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T12:19:09.946 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T12:19:12.208 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T12:19:14.369 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T12:19:16.533 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T12:19:19.593 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T12:19:44.449 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T12:19:48.241 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T12:19:51.033 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T12:19:54.241 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T12:19:57.645 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T12:20:09.177 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T12:20:12.749 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T12:20:25.497 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T12:21:10.189 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T12:22:05.577 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T12:22:11.693 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T12:22:17.754 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T12:22:20.829 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T12:22:24.161 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T12:22:26.605 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T12:22:30.265 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T12:22:33.673 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T12:22:39.421 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T12:22:41.457 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T12:22:43.506 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T12:22:45.537 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T12:22:47.417 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T12:22:49.253 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T12:22:51.325 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T12:22:53.209 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T12:22:55.133 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T12:22:57.345 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T12:22:59.313 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T12:23:01.233 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T12:23:03.177 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T12:23:05.213 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T12:23:07.033 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T12:23:09.242 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T12:23:11.313 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T12:23:14.293 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T12:23:16.629 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T12:23:18.924 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T12:23:21.085 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T12:23:23.245 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T12:23:25.141 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T12:23:27.097 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T12:23:28.981 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T12:23:30.909 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T12:24:39.437 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T12:25:47.509 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T12:26:07.913 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T12:26:10.245 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T12:27:13.417 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T12:28:16.413 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T12:28:18.733 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T12:28:20.972 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T12:28:22.881 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T12:28:24.721 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T12:29:14.017 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T12:29:32.493 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T12:29:51.088 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T12:29:53.312 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T12:29:55.465 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T12:29:57.593 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T12:30:00.529 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T12:30:02.704 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T12:30:05.212 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T12:30:07.849 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T12:30:10.288 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T12:30:12.740 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T12:30:15.328 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T12:30:17.648 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T12:30:19.928 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T12:30:23.597 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T12:30:27.384 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T12:30:33.384 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T12:30:38.797 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T12:30:44.253 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T12:30:49.624 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T12:30:54.928 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T12:31:00.485 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T12:31:05.956 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T12:31:11.928 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T12:31:17.712 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T12:31:19.928 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T12:31:22.216 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T12:31:24.444 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T12:31:30.048 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T12:31:35.644 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T12:31:41.793 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T12:31:46.633 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T12:32:34.124 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T12:32:37.416 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T12:32:40.624 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:32:43.843 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T12:32:51.584 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T12:32:53.928 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T12:32:57.640 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T12:32:59.484 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T12:33:01.444 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T12:33:03.376 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T12:33:05.248 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T12:33:07.584 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T12:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T12:33:12.779 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T12:33:14.736 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T12:33:16.548 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T12:33:18.372 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T12:33:20.132 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T12:33:21.952 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T12:33:23.984 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T12:33:25.776 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T12:33:27.640 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T12:33:29.493 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T12:33:31.280 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T12:33:33.580 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T12:33:35.564 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T12:33:37.876 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T12:33:40.024 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T12:33:42.268 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T12:33:44.312 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T12:33:46.876 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T12:33:49.252 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T12:33:51.600 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T12:33:53.936 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T12:33:56.264 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T12:33:58.536 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:34:00.989 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T12:34:03.580 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T12:34:06.028 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:34:08.339 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T12:34:10.460 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T12:34:12.628 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T12:34:15.108 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T12:34:17.164 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T12:34:19.521 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:34:22.092 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:34:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T12:34:26.628 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T12:34:28.884 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T12:34:40.495 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T12:34:42.639 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T12:34:53.419 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T12:34:55.771 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T12:34:58.096 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T12:34:59.940 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T12:35:01.879 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:35:03.908 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:35:05.987 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:35:08.335 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T12:35:10.407 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T12:35:12.268 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T12:35:14.239 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T12:35:16.432 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T12:35:18.383 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T12:35:20.655 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T12:35:22.808 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T12:35:24.788 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T12:35:26.871 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T12:35:29.723 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T12:35:56.407 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T12:35:58.327 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:36:00.480 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:36:02.627 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:36:04.967 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T12:36:10.199 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T12:36:12.483 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T12:36:15.935 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T12:36:26.979 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T12:36:31.195 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T12:36:56.751 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T12:37:19.995 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T12:37:22.363 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T12:37:25.771 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T12:37:45.771 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T12:38:14.319 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T12:38:21.883 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T12:38:26.927 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T12:38:32.183 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T12:38:36.375 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T12:38:39.191 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T12:38:46.911 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T12:38:55.635 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T12:39:17.635 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T12:39:24.855 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T12:39:29.467 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T12:39:33.570 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T12:39:36.403 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T12:39:45.386 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T12:39:51.495 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T12:39:55.022 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T12:39:58.614 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T12:40:09.258 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T12:40:16.423 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T12:40:32.450 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T12:40:41.139 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T12:40:42.175 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T12:41:05.066 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T12:41:12.686 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T12:41:17.646 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T12:41:24.479 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T12:41:30.486 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T12:42:22.970 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T12:42:23.946 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T12:42:26.281 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T12:42:28.114 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T12:42:30.074 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T12:42:32.566 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T12:42:32.610 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T12:42:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.610 INFO:teuthology.orchestra.run.smithi148.stdout:=============================== warnings summary =============================== 2024-09-14T12:42:32.610 INFO:teuthology.orchestra.run.smithi148.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-14T12:42:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-14T12:42:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: import imp 2024-09-14T12:42:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.611 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py:120 2024-09-14T12:42:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:42:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: if boto_type is 'S3Connection': 2024-09-14T12:42:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.611 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_headers.py:124 2024-09-14T12:42:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:42:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T12:42:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.612 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3.py:359 2024-09-14T12:42:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-14T12:42:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T12:42:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.612 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T12:42:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:42:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: if k is 'BucketName': 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: @pytest.mark.timeout(10) 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T12:42:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.614 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T12:42:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T12:42:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.615 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T12:42:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:42:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.615 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T12:42:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:42:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.616 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T12:42:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:42:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.617 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T12:42:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T12:42:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.617 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T12:42:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:42:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-14T12:42:32.619 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-14T12:42:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi148.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T12:42:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: warnings.warn( 2024-09-14T12:42:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.620 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T12:42:32.620 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T12:42:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: s = ssl.wrap_socket(s); 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: context = SSLContext(ssl_version) 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T12:42:32.621 INFO:teuthology.orchestra.run.smithi148.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 3623.87s (1:00:23) = 2024-09-14T12:42:32.788 INFO:teuthology.orchestra.run.smithi148.stdout:___________________________________ summary ____________________________________ 2024-09-14T12:42:32.788 INFO:teuthology.orchestra.run.smithi148.stdout: py: commands succeeded 2024-09-14T12:42:32.788 INFO:teuthology.orchestra.run.smithi148.stdout: congratulations :) 2024-09-14T12:42:32.827 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T12:42:32.827 DEBUG:teuthology.orchestra.run.smithi148:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:42:32.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:42:32.927 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T12:42:32.927 DEBUG:teuthology.orchestra.run.smithi148:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T12:42:32.933 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T12:42:32.934 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T12:42:33.126 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T12:42:33.138 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T12:42:33.139 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T12:42:33.139 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:42:33.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:42:33.145 INFO:teuthology.orchestra.run.smithi148.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T12:42:33.145 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:42:33.190 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T12:42:33.190 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T12:42:33.239 INFO:tasks.workunit:timeout=3h 2024-09-14T12:42:33.239 INFO:tasks.workunit:cleanup=True 2024-09-14T12:42:33.239 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T12:42:33.289 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T12:43:27.085 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T12:43:27.086 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:27.086 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T12:43:27.086 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T12:43:27.086 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T12:43:27.086 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:27.086 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T12:43:27.086 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T12:43:27.086 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:27.087 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T12:43:27.089 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T12:43:27.136 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T12:43:27.138 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T12:43:27.138 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T12:43:27.193 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T12:43:27.246 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T12:43:27.290 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T12:43:27.291 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T12:43:27.291 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T12:43:27.336 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T12:43:27.340 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-14T12:43:27.340 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T12:43:27.387 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T12:43:27.388 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T12:43:27.389 DEBUG:teuthology.orchestra.run.smithi148:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T12:43:27.438 INFO:tasks.workunit.client.0.smithi148.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T12:43:27.439 INFO:tasks.workunit.client.0.smithi148.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:43:27.439 INFO:tasks.workunit.client.0.smithi148.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ deactivate nondestructive 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ hash -r 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ unset VIRTUAL_ENV 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T12:43:30.519 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ export VIRTUAL_ENV 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ export PATH 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n '' ']' 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -z '' ']' 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ PS1='(rgw) ' 2024-09-14T12:43:30.521 INFO:tasks.workunit.client.0.smithi148.stderr:++ export PS1 2024-09-14T12:43:30.522 INFO:tasks.workunit.client.0.smithi148.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T12:43:30.522 INFO:tasks.workunit.client.0.smithi148.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T12:43:30.522 INFO:tasks.workunit.client.0.smithi148.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:43:30.522 INFO:tasks.workunit.client.0.smithi148.stderr:++ hash -r 2024-09-14T12:43:30.522 INFO:tasks.workunit.client.0.smithi148.stderr:+ pip install pip --upgrade 2024-09-14T12:43:30.879 INFO:tasks.workunit.client.0.smithi148.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T12:43:31.087 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting pip 2024-09-14T12:43:31.093 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T12:43:31.127 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: pip 2024-09-14T12:43:31.127 INFO:tasks.workunit.client.0.smithi148.stdout: Attempting uninstall: pip 2024-09-14T12:43:31.128 INFO:tasks.workunit.client.0.smithi148.stdout: Found existing installation: pip 22.0.2 2024-09-14T12:43:31.387 INFO:tasks.workunit.client.0.smithi148.stdout: Uninstalling pip-22.0.2: 2024-09-14T12:43:31.394 INFO:tasks.workunit.client.0.smithi148.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T12:43:32.141 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed pip-24.2 2024-09-14T12:43:32.201 INFO:tasks.workunit.client.0.smithi148.stderr:+ pip install boto3 2024-09-14T12:43:33.174 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting boto3 2024-09-14T12:43:33.175 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T12:43:33.747 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T12:43:33.749 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T12:43:33.800 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T12:43:33.802 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T12:43:33.847 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T12:43:33.848 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T12:43:33.904 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:43:33.905 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T12:43:34.006 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:43:34.007 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T12:43:34.195 INFO:tasks.workunit.client.0.smithi148.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:43:34.197 INFO:tasks.workunit.client.0.smithi148.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T12:43:34.200 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T12:43:34.201 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T12:43:34.210 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T12:43:34.211 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T12:43:34.213 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T12:43:34.214 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T12:43:34.215 INFO:tasks.workunit.client.0.smithi148.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T12:43:34.283 INFO:tasks.workunit.client.0.smithi148.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T12:43:35.385 INFO:tasks.workunit.client.0.smithi148.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T12:43:35.604 INFO:tasks.workunit.client.0.smithi148.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T12:43:35.732 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T12:43:35.769 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:43:35.769 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:43:35.808 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.813+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:35.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:35.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 realm 2024-09-14T12:43:35.810 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:35.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:35.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:43:35.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:35.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:35.811 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:35.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:35.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:35.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:43:35.812 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.817+0000 7fcfde3eb9c0 20 searching for the correct realm 2024-09-14T12:43:35.820 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:35.825+0000 7fcfdc6f2640 0 -- 172.21.15.148:0/2314524958 >> [v2:172.21.15.150:6800/2640697978,v1:172.21.15.150:6801/2640697978] conn(0x7fcfcc115700 msgr2=0x7fcfcc0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:43:36.033 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.037+0000 7fcfdc6f2640 0 -- 172.21.15.148:0/2314524958 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x5558e31371c0 msgr2=0x5558e3139680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:36.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.041+0000 7fcfde3eb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:43:36.037 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.041+0000 7fcfde3eb9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T12:43:36.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.041+0000 7fcfde3eb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:43:36.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.041+0000 7fcfde3eb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:43:36.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.041+0000 7fcfde3eb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:43:36.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.041+0000 7fcfde3eb9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T12:43:36.038 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.041+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:36.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:36.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:36.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:36.039 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:36.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:43:36.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 zone default found 2024-09-14T12:43:36.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 4 Realm: () 2024-09-14T12:43:36.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T12:43:36.040 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T12:43:36.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:43:36.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 zonegroup default 2024-09-14T12:43:36.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:36.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:36.041 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:36.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:36.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:36.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:36.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 started sync module instance, tier type = 2024-09-14T12:43:36.042 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.045+0000 7fcfde3eb9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T12:43:36.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.069+0000 7fcfde3eb9c0 20 add_watcher() i=0 2024-09-14T12:43:36.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.069+0000 7fcfde3eb9c0 20 add_watcher() i=1 2024-09-14T12:43:36.064 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.069+0000 7fcfde3eb9c0 20 add_watcher() i=2 2024-09-14T12:43:36.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.069+0000 7fcfde3eb9c0 20 add_watcher() i=3 2024-09-14T12:43:36.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.069+0000 7fcfde3eb9c0 20 add_watcher() i=4 2024-09-14T12:43:36.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.069+0000 7fcfde3eb9c0 20 add_watcher() i=5 2024-09-14T12:43:36.065 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.069+0000 7fcfde3eb9c0 20 add_watcher() i=6 2024-09-14T12:43:36.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.077+0000 7fcfde3eb9c0 20 add_watcher() i=7 2024-09-14T12:43:36.067 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.077+0000 7fcfde3eb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:43:36.072 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.077+0000 7fce91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:36.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.077+0000 7fcfde3eb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:43:36.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.077+0000 7fcfde3eb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:43:36.073 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.077+0000 7fcfde3eb9c0 5 note: GC not initialized 2024-09-14T12:43:36.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.077+0000 7fce90fe1640 20 reqs_thread_entry: start 2024-09-14T12:43:36.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.077+0000 7fcfde3eb9c0 20 init_complete bucket index max shards: 11 2024-09-14T12:43:36.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 20 Filter name: none 2024-09-14T12:43:36.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fce0a7fc640 20 reqs_thread_entry: start 2024-09-14T12:43:36.074 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T12:43:36.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:36.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:36.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T12:43:36.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:43:36.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T12:43:36.075 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:36.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:36.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T12:43:36.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:43:36.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T12:43:36.076 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T12:43:36.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T12:43:36.077 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:43:36.078 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.081+0000 7fcfde3eb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T12:43:36.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.085+0000 7fcebaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756270040 cookie 93840255212992 notifier 9384 bl.length()=613 2024-09-14T12:43:36.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.085+0000 7fcebaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T12:43:36.079 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.085+0000 7fcebaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:43:36.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.089+0000 7fcfde3eb9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T12:43:36.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.089+0000 7fcfde3eb9c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:43:36.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.089+0000 7fcfde3eb9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T12:43:36.085 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.089+0000 7fcebaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756270041 cookie 93840255203792 notifier 9384 bl.length()=191 2024-09-14T12:43:36.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.089+0000 7fcebaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T12:43:36.086 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.089+0000 7fcebaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:43:36.089 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.093+0000 7fce91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:36.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.097+0000 7fcfde3eb9c0 20 remove_watcher() i=0 2024-09-14T12:43:36.093 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.097+0000 7fcfde3eb9c0 2 removed watcher, disabling cache 2024-09-14T12:43:36.095 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.101+0000 7fcfde3eb9c0 20 remove_watcher() i=1 2024-09-14T12:43:36.097 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.101+0000 7fcfde3eb9c0 20 remove_watcher() i=2 2024-09-14T12:43:36.099 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.105+0000 7fcfde3eb9c0 20 remove_watcher() i=3 2024-09-14T12:43:36.101 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.105+0000 7fcfde3eb9c0 20 remove_watcher() i=4 2024-09-14T12:43:36.106 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.113+0000 7fcfde3eb9c0 20 remove_watcher() i=5 2024-09-14T12:43:36.108 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.113+0000 7fcfde3eb9c0 20 remove_watcher() i=6 2024-09-14T12:43:36.111 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:36.121+0000 7fcfde3eb9c0 20 remove_watcher() i=7 2024-09-14T12:43:36.356 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:36.356 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:36.427 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:36.427 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:36.544 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:36.544 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:36.673 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:36.673 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:36.750 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T12:43:36.750 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:36.760 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:36.760 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:36.866 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:36.866 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:36.970 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:36.970 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:37.093 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T12:43:37.125 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:43:37.125 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:43:37.169 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.173+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:37.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 realm 2024-09-14T12:43:37.172 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:37.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:43:37.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:37.173 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:37.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.177+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.181+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:43:37.174 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.181+0000 7f6c7d8ce9c0 20 searching for the correct realm 2024-09-14T12:43:37.179 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.185+0000 7f6c7abd3640 0 -- 172.21.15.148:0/1009236100 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f6c740c7070 msgr2=0x7f6c74112170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:37.391 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.401+0000 7f6c7abd3640 0 -- 172.21.15.148:0/1009236100 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x559c347a9720 msgr2=0x559c347abb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:37.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:43:37.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T12:43:37.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:43:37.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:43:37.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:43:37.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T12:43:37.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:37.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.413+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:37.406 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:43:37.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 zone default found 2024-09-14T12:43:37.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 4 Realm: () 2024-09-14T12:43:37.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T12:43:37.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T12:43:37.407 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:43:37.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 zonegroup default 2024-09-14T12:43:37.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:37.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:37.409 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:37.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 started sync module instance, tier type = 2024-09-14T12:43:37.410 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.417+0000 7f6c7d8ce9c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T12:43:37.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 20 add_watcher() i=0 2024-09-14T12:43:37.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 20 add_watcher() i=1 2024-09-14T12:43:37.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 20 add_watcher() i=2 2024-09-14T12:43:37.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 20 add_watcher() i=3 2024-09-14T12:43:37.434 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 20 add_watcher() i=4 2024-09-14T12:43:37.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 20 add_watcher() i=5 2024-09-14T12:43:37.435 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 20 add_watcher() i=6 2024-09-14T12:43:37.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 20 add_watcher() i=7 2024-09-14T12:43:37.437 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.445+0000 7f6c7d8ce9c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:43:37.441 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.449+0000 7f6b31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:37.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.449+0000 7f6c7d8ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:43:37.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.449+0000 7f6c7d8ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:43:37.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.449+0000 7f6c7d8ce9c0 5 note: GC not initialized 2024-09-14T12:43:37.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6b30fe1640 20 reqs_thread_entry: start 2024-09-14T12:43:37.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 init_complete bucket index max shards: 11 2024-09-14T12:43:37.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 Filter name: none 2024-09-14T12:43:37.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6aaa7fc640 20 reqs_thread_entry: start 2024-09-14T12:43:37.443 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:43:37.444 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:37.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:43:37.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T12:43:37.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T12:43:37.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=0 2024-09-14T12:43:37.446 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.453+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.0 2024-09-14T12:43:37.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=1 2024-09-14T12:43:37.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.1 2024-09-14T12:43:37.447 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=2 2024-09-14T12:43:37.448 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.2 2024-09-14T12:43:37.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=3 2024-09-14T12:43:37.449 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.457+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.3 2024-09-14T12:43:37.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=4 2024-09-14T12:43:37.450 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.4 2024-09-14T12:43:37.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=5 2024-09-14T12:43:37.451 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.5 2024-09-14T12:43:37.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=6 2024-09-14T12:43:37.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.6 2024-09-14T12:43:37.452 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=7 2024-09-14T12:43:37.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.7 2024-09-14T12:43:37.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=8 2024-09-14T12:43:37.453 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.461+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.8 2024-09-14T12:43:37.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.465+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.465+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=9 2024-09-14T12:43:37.454 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.465+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.9 2024-09-14T12:43:37.455 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.465+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.465+0000 7f6c7d8ce9c0 20 INFO: main: starting shard=10 2024-09-14T12:43:37.456 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.465+0000 7f6c7d8ce9c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.10 2024-09-14T12:43:37.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.465+0000 7f6c7d8ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:37.457 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.465+0000 7f6c7d8ce9c0 20 INFO: main: done 2024-09-14T12:43:37.458 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.469+0000 7f6b31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:37.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.473+0000 7f6c7d8ce9c0 20 remove_watcher() i=0 2024-09-14T12:43:37.463 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.473+0000 7f6c7d8ce9c0 2 removed watcher, disabling cache 2024-09-14T12:43:37.465 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.473+0000 7f6c7d8ce9c0 20 remove_watcher() i=1 2024-09-14T12:43:37.467 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.477+0000 7f6c7d8ce9c0 20 remove_watcher() i=2 2024-09-14T12:43:37.469 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.477+0000 7f6c7d8ce9c0 20 remove_watcher() i=3 2024-09-14T12:43:37.471 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.481+0000 7f6c7d8ce9c0 20 remove_watcher() i=4 2024-09-14T12:43:37.474 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.481+0000 7f6c7d8ce9c0 20 remove_watcher() i=5 2024-09-14T12:43:37.476 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.485+0000 7f6c7d8ce9c0 20 remove_watcher() i=6 2024-09-14T12:43:37.482 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.493+0000 7f6c7d8ce9c0 20 remove_watcher() i=7 2024-09-14T12:43:37.500 INFO:tasks.workunit.client.0.smithi148.stderr:rados -p default.rgw.buckets.data ls | grep 373c7641-0267-4d68-aaf7-492b571b256d 2024-09-14T12:43:37.523 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:43:37.523 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:43:37.676 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:37.685+0000 7fcb6b4a4640 0 -- 172.21.15.148:0/1502808323 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x7fcb640b2780 msgr2=0x7fcb640a7280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:37.715 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T12:43:37.716 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:37.716 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T12:43:39.169 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:39.170 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:39.260 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T12:43:39.705 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T12:43:39.734 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:43:39.734 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:43:39.776 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.785+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:39.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 realm 2024-09-14T12:43:39.779 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:39.780 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:43:39.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:39.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:39.781 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:43:39.782 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.789+0000 7fc64c2179c0 20 searching for the correct realm 2024-09-14T12:43:39.788 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.797+0000 7fc64a51e640 0 -- 172.21.15.148:0/2109336593 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55e3d9615120 msgr2=0x55e3d9617510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:39.794 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.805+0000 7fc649d1d640 0 -- 172.21.15.148:0/2109336593 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55e3d9619220 msgr2=0x55e3d961b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:39.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:43:39.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T12:43:39.801 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:43:39.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:43:39.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:43:39.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T12:43:39.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:39.802 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.809+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:39.803 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 zone default found 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 4 Realm: () 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 zonegroup default 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.804 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:39.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:39.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.805 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:39.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 started sync module instance, tier type = 2024-09-14T12:43:39.806 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.813+0000 7fc64c2179c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T12:43:39.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 20 add_watcher() i=0 2024-09-14T12:43:39.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 20 add_watcher() i=1 2024-09-14T12:43:39.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 20 add_watcher() i=2 2024-09-14T12:43:39.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 20 add_watcher() i=3 2024-09-14T12:43:39.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 20 add_watcher() i=4 2024-09-14T12:43:39.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 20 add_watcher() i=5 2024-09-14T12:43:39.823 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 20 add_watcher() i=6 2024-09-14T12:43:39.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 20 add_watcher() i=7 2024-09-14T12:43:39.825 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.833+0000 7fc64c2179c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:43:39.829 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc4fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:39.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc64c2179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:43:39.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc64c2179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:43:39.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc64c2179c0 5 note: GC not initialized 2024-09-14T12:43:39.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc4fa7fc640 20 reqs_thread_entry: start 2024-09-14T12:43:39.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc64c2179c0 20 init_complete bucket index max shards: 11 2024-09-14T12:43:39.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc64c2179c0 20 Filter name: none 2024-09-14T12:43:39.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc46bfff640 20 reqs_thread_entry: start 2024-09-14T12:43:39.830 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.837+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:43:39.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:39.831 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:43:39.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T12:43:39.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T12:43:39.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 INFO: main: starting shard=0 2024-09-14T12:43:39.832 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.0 2024-09-14T12:43:39.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 INFO: main: starting shard=1 2024-09-14T12:43:39.833 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.1 2024-09-14T12:43:39.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 INFO: main: starting shard=2 2024-09-14T12:43:39.834 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.841+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.2 2024-09-14T12:43:39.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: starting shard=3 2024-09-14T12:43:39.835 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.3 2024-09-14T12:43:39.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: starting shard=4 2024-09-14T12:43:39.836 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.4 2024-09-14T12:43:39.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: starting shard=5 2024-09-14T12:43:39.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.5 2024-09-14T12:43:39.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: starting shard=6 2024-09-14T12:43:39.837 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.6 2024-09-14T12:43:39.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 INFO: main: starting shard=7 2024-09-14T12:43:39.838 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.845+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.7 2024-09-14T12:43:39.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 INFO: main: starting shard=8 2024-09-14T12:43:39.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.8 2024-09-14T12:43:39.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.839 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 INFO: main: starting shard=9 2024-09-14T12:43:39.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.9 2024-09-14T12:43:39.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 INFO: main: starting shard=10 2024-09-14T12:43:39.840 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.10 2024-09-14T12:43:39.841 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:43:39.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.849+0000 7fc64c2179c0 20 INFO: main: done 2024-09-14T12:43:39.842 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.853+0000 7fc4fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:39.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.857+0000 7fc64c2179c0 20 remove_watcher() i=0 2024-09-14T12:43:39.847 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.857+0000 7fc64c2179c0 2 removed watcher, disabling cache 2024-09-14T12:43:39.849 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.857+0000 7fc64c2179c0 20 remove_watcher() i=1 2024-09-14T12:43:39.851 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.861+0000 7fc64c2179c0 20 remove_watcher() i=2 2024-09-14T12:43:39.853 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.861+0000 7fc64c2179c0 20 remove_watcher() i=3 2024-09-14T12:43:39.855 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.865+0000 7fc64c2179c0 20 remove_watcher() i=4 2024-09-14T12:43:39.857 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.865+0000 7fc64c2179c0 20 remove_watcher() i=5 2024-09-14T12:43:39.859 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.869+0000 7fc64c2179c0 20 remove_watcher() i=6 2024-09-14T12:43:39.861 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:39.869+0000 7fc64c2179c0 20 remove_watcher() i=7 2024-09-14T12:43:39.876 INFO:tasks.workunit.client.0.smithi148.stderr:rados -p default.rgw.buckets.data ls | grep 07912bf3-8865-4c9e-bdd1-f1c66ef095aa 2024-09-14T12:43:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:43:39.899 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:43:40.053 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:40.061+0000 7f8c4f756640 0 -- 172.21.15.148:0/2262618804 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x7f8c480b1c20 msgr2=0x7f8c480a7280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:40.082 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T12:43:40.082 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:40.085 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:40.085 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:40.155 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:40.155 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:40.264 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:40.264 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:40.345 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T12:43:41.793 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:41.794 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:41.979 INFO:tasks.workunit.client.0.smithi148.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T12:43:41.979 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T12:43:42.428 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:42.429 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:42.580 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:42.580 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:42.659 INFO:tasks.workunit.client.0.smithi148.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T12:43:42.659 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-09-14T12:43:42.663 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:42.663 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:42.790 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:42.790 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:42.962 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:42.963 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:43.061 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T12:43:44.507 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:44.507 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:44.660 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:44.660 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:46.817 INFO:tasks.workunit.client.0.smithi148.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T12:43:47.255 INFO:tasks.workunit.client.0.smithi148.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T12:43:47.282 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:43:47.282 INFO:tasks.workunit.client.0.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:43:47.323 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.333+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:47.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 realm 2024-09-14T12:43:47.326 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:47.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:43:47.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.327 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:47.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:47.328 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:43:47.329 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.337+0000 7fd8ee2169c0 20 searching for the correct realm 2024-09-14T12:43:47.335 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.345+0000 7fd8ebd1c640 0 -- 172.21.15.148:0/2011879886 >> [v2:172.21.15.148:6808/1063069618,v1:172.21.15.148:6809/1063069618] conn(0x7fd8dc018040 msgr2=0x7fd8dc027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:47.340 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.349+0000 7fd8ebd1c640 0 -- 172.21.15.148:0/2011879886 >> [v2:172.21.15.148:6824/1289265320,v1:172.21.15.148:6825/1289265320] conn(0x55af2ce51410 msgr2=0x55af2ce53800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:47.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:43:47.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T12:43:47.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:43:47.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:43:47.347 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:43:47.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T12:43:47.348 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:47.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:47.349 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 zone default found 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 4 Realm: () 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 zonegroup default 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:47.350 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.357+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.361+0000 7fd8ee2169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:47.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.361+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.361+0000 7fd8ee2169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:47.351 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.361+0000 7fd8ee2169c0 20 started sync module instance, tier type = 2024-09-14T12:43:47.352 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.361+0000 7fd8ee2169c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T12:43:47.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.377+0000 7fd8ee2169c0 20 add_watcher() i=0 2024-09-14T12:43:47.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.377+0000 7fd8ee2169c0 20 add_watcher() i=1 2024-09-14T12:43:47.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.377+0000 7fd8ee2169c0 20 add_watcher() i=2 2024-09-14T12:43:47.368 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.377+0000 7fd8ee2169c0 20 add_watcher() i=3 2024-09-14T12:43:47.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.377+0000 7fd8ee2169c0 20 add_watcher() i=4 2024-09-14T12:43:47.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.377+0000 7fd8ee2169c0 20 add_watcher() i=5 2024-09-14T12:43:47.369 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.377+0000 7fd8ee2169c0 20 add_watcher() i=6 2024-09-14T12:43:47.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.381+0000 7fd8ee2169c0 20 add_watcher() i=7 2024-09-14T12:43:47.371 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.381+0000 7fd8ee2169c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:43:47.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd7a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:47.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:43:47.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:43:47.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 5 note: GC not initialized 2024-09-14T12:43:47.375 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd7a0fe1640 20 reqs_thread_entry: start 2024-09-14T12:43:47.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 init_complete bucket index max shards: 11 2024-09-14T12:43:47.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 Filter name: none 2024-09-14T12:43:47.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd71a7fc640 20 reqs_thread_entry: start 2024-09-14T12:43:47.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T12:43:47.376 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:43:47.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T12:43:47.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T12:43:47.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783 : miss 2024-09-14T12:43:47.377 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:47.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:43:47.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783 info.flags=0x17 2024-09-14T12:43:47.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783 to cache LRU end 2024-09-14T12:43:47.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:43:47.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T12:43:47.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783 2024-09-14T12:43:47.378 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.385+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.0 2024-09-14T12:43:47.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.389+0000 7fd8ee2169c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T12:43:47.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.389+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.1 2024-09-14T12:43:47.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.389+0000 7fd8ee2169c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T12:43:47.379 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.389+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.2 2024-09-14T12:43:47.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.389+0000 7fd8ee2169c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T12:43:47.380 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.389+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.3 2024-09-14T12:43:47.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.389+0000 7fd8ee2169c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T12:43:47.381 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.389+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.4 2024-09-14T12:43:47.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T12:43:47.382 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.5 2024-09-14T12:43:47.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T12:43:47.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.6 2024-09-14T12:43:47.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T12:43:47.383 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.7 2024-09-14T12:43:47.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T12:43:47.384 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.8 2024-09-14T12:43:47.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T12:43:47.385 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.393+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.9 2024-09-14T12:43:47.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.397+0000 7fd8ee2169c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T12:43:47.386 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.397+0000 7fd8ee2169c0 20 bucket index object: :.dir.de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783.10 2024-09-14T12:43:47.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.397+0000 7fd8ee2169c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T12:43:47.387 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.397+0000 7fd8ee2169c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T12:43:47.388 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.397+0000 7fd7a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:47.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.401+0000 7fd8ee2169c0 20 remove_watcher() i=0 2024-09-14T12:43:47.393 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.401+0000 7fd8ee2169c0 2 removed watcher, disabling cache 2024-09-14T12:43:47.395 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.405+0000 7fd8ee2169c0 20 remove_watcher() i=1 2024-09-14T12:43:47.397 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.405+0000 7fd8ee2169c0 20 remove_watcher() i=2 2024-09-14T12:43:47.398 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.409+0000 7fd8ee2169c0 20 remove_watcher() i=3 2024-09-14T12:43:47.400 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.409+0000 7fd8ee2169c0 20 remove_watcher() i=4 2024-09-14T12:43:47.402 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.413+0000 7fd8ee2169c0 20 remove_watcher() i=5 2024-09-14T12:43:47.405 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.413+0000 7fd8ee2169c0 20 remove_watcher() i=6 2024-09-14T12:43:47.408 INFO:tasks.workunit.client.0.smithi148.stderr:2024-09-14T12:43:47.417+0000 7fd8ee2169c0 20 remove_watcher() i=7 2024-09-14T12:43:47.421 INFO:tasks.workunit.client.0.smithi148.stderr:Deleting bucket versioning-bucket 2024-09-14T12:43:47.422 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:47.423 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:47.458 INFO:tasks.workunit.client.0.smithi148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T12:43:47.458 INFO:tasks.workunit.client.0.smithi148.stderr: warnings.warn( 2024-09-14T12:43:47.708 INFO:tasks.workunit.client.0.smithi148.stderr:Completed bucket versioning tests 2024-09-14T12:43:47.708 INFO:tasks.workunit.client.0.smithi148.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T12:43:47.708 INFO:tasks.workunit.client.0.smithi148.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T12:43:47.708 INFO:tasks.workunit.client.0.smithi148.stdout:connected to https://localhost:443 2024-09-14T12:43:47.808 INFO:tasks.workunit.client.0.smithi148.stderr:+ deactivate 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ export PATH 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ hash -r 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' -n '' ']' 2024-09-14T12:43:47.809 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset VIRTUAL_ENV 2024-09-14T12:43:47.810 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T12:43:47.810 INFO:tasks.workunit.client.0.smithi148.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T12:43:47.810 INFO:tasks.workunit.client.0.smithi148.stderr:+ unset -f deactivate 2024-09-14T12:43:47.810 INFO:tasks.workunit.client.0.smithi148.stderr:+ echo OK. 2024-09-14T12:43:47.811 INFO:tasks.workunit.client.0.smithi148.stdout:OK. 2024-09-14T12:43:47.812 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T12:43:47.812 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T12:43:47.866 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T12:43:47.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T12:43:48.266 DEBUG:teuthology.parallel:result is None 2024-09-14T12:43:48.266 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:43:48.279 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:43:48.279 DEBUG:teuthology.orchestra.run.smithi148:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:43:48.330 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:43:48.331 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T12:43:48.342 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T12:43:48.351 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T12:43:48.351 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T12:43:48.351 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T12:43:48.424 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T12:43:48.425 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T12:43:48.460 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:43:48.461 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:43:48.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.509+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 realm 2024-09-14T12:43:48.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:48.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:43:48.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.513+0000 7f76346679c0 20 searching for the correct realm 2024-09-14T12:43:48.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.521+0000 7f763196c640 0 -- 172.21.15.148:0/3054113424 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7f762c0a9070 msgr2=0x7f762c0ce420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:48.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.525+0000 7f763296e640 0 -- 172.21.15.148:0/3054113424 >> [v2:172.21.15.150:6817/2245691891,v1:172.21.15.150:6820/2245691891] conn(0x55b0edde9ec0 msgr2=0x55b0eddec380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T12:43:48.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 zone default found 2024-09-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 4 Realm: () 2024-09-14T12:43:48.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 zonegroup default 2024-09-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.533+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.537+0000 7f76346679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:48.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.537+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.537+0000 7f76346679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.537+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.537+0000 7f76346679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.537+0000 7f76346679c0 20 started sync module instance, tier type = 2024-09-14T12:43:48.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.537+0000 7f76346679c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.553+0000 7f76346679c0 20 add_watcher() i=0 2024-09-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.553+0000 7f76346679c0 20 add_watcher() i=1 2024-09-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.553+0000 7f76346679c0 20 add_watcher() i=2 2024-09-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.553+0000 7f76346679c0 20 add_watcher() i=3 2024-09-14T12:43:48.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.553+0000 7f76346679c0 20 add_watcher() i=4 2024-09-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.553+0000 7f76346679c0 20 add_watcher() i=5 2024-09-14T12:43:48.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.553+0000 7f76346679c0 20 add_watcher() i=6 2024-09-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.557+0000 7f76346679c0 20 add_watcher() i=7 2024-09-14T12:43:48.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.557+0000 7f76346679c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.561+0000 7f74e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.561+0000 7f76346679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:43:48.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.561+0000 7f76346679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f74637fe640 20 reqs_thread_entry: start 2024-09-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f76346679c0 20 init_complete bucket index max shards: 11 2024-09-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f76346679c0 20 Filter name: none 2024-09-14T12:43:48.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f74617fa640 20 reqs_thread_entry: start 2024-09-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f76346679c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f76346679c0 20 rados->read ofs=0 len=0 2024-09-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f76346679c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f76346679c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f76346679c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T12:43:48.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.637+0000 7f76346679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:43:48.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.641+0000 7f76346679c0 10 removing key index: XVJPKUFPPQRQGNVOFPJW 2024-09-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.641+0000 7f76346679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:XVJPKUFPPQRQGNVOFPJW, ofs0, ns] 2024-09-14T12:43:48.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.641+0000 7f7515ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268542 cookie 94218393459968 notifier 9513 bl.length()=170 2024-09-14T12:43:48.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.645+0000 7f76346679c0 10 removing email index: tester.client.0_test@test.test 2024-09-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.645+0000 7f76346679c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T12:43:48.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.645+0000 7f75157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269295 cookie 94218393466064 notifier 9513 bl.length()=181 2024-09-14T12:43:48.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.649+0000 7f76346679c0 10 removing user buckets index 2024-09-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.649+0000 7f76346679c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T12:43:48.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.653+0000 7f75157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756270044 cookie 94218393475264 notifier 9513 bl.length()=172 2024-09-14T12:43:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.653+0000 7f76346679c0 10 removing user index: tester.client.0 2024-09-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.653+0000 7f76346679c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.653+0000 7f76346679c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T12:43:48.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.653+0000 7f75157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756270045 cookie 94218393468368 notifier 9513 bl.length()=164 2024-09-14T12:43:48.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.657+0000 7f74e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.661+0000 7f76346679c0 20 remove_watcher() i=0 2024-09-14T12:43:48.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.661+0000 7f76346679c0 2 removed watcher, disabling cache 2024-09-14T12:43:48.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.665+0000 7f76346679c0 20 remove_watcher() i=1 2024-09-14T12:43:48.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.665+0000 7f76346679c0 20 remove_watcher() i=2 2024-09-14T12:43:48.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.669+0000 7f76346679c0 20 remove_watcher() i=3 2024-09-14T12:43:48.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.669+0000 7f76346679c0 20 remove_watcher() i=4 2024-09-14T12:43:48.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.673+0000 7f76346679c0 20 remove_watcher() i=5 2024-09-14T12:43:48.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.673+0000 7f76346679c0 20 remove_watcher() i=6 2024-09-14T12:43:48.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:43:48.677+0000 7f76346679c0 20 remove_watcher() i=7 2024-09-14T12:43:48.684 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T12:43:48.694 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T12:43:48.703 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T12:43:48.765 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T12:43:48.776 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T12:43:48.776 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:43:48.829 INFO:tasks.rgw.client.0.smithi148.stdout:2024-09-14T12:43:48.829+0000 e574640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 39563) UID: 0 2024-09-14T12:43:48.829 INFO:tasks.rgw.client.0.smithi148.stdout:2024-09-14T12:43:48.837+0000 8edcf80 -1 shutting down 2024-09-14T12:44:00.757 INFO:tasks.rgw.client.0.smithi148.stderr:==00:01:54:23.788 39566== could not unlink /tmp/vgdb-pipe-from-vgdb-to-39566-by-root-on-??? 2024-09-14T12:44:00.757 INFO:tasks.rgw.client.0.smithi148.stderr:==00:01:54:23.788 39566== could not unlink /tmp/vgdb-pipe-to-vgdb-from-39566-by-root-on-??? 2024-09-14T12:44:00.757 INFO:tasks.rgw.client.0.smithi148.stderr:==00:01:54:23.788 39566== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-39566-by-root-on-??? 2024-09-14T12:44:00.980 INFO:tasks.rgw.client.0:Stopped 2024-09-14T12:44:00.981 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T12:44:00.987 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T12:44:01.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T12:44:01.098 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T12:44:01.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T12:44:01.099 DEBUG:teuthology.orchestra.run.smithi148:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T12:44:01.179 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:44:01.179 INFO:teuthology.orchestra.run.smithi148.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:44:01.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.229+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.229+0000 7ff7f7f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:44:01.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.229+0000 7ff7f7f799c0 20 realm 2024-09-14T12:44:01.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.229+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:44:01.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:44:01.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:44:01.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:44:01.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:44:01.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.233+0000 7ff7f7f799c0 20 searching for the correct realm 2024-09-14T12:44:01.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.237+0000 7ff7f527e640 0 -- 172.21.15.148:0/1251537213 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7ff7f0068370 msgr2=0x7ff7f005db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:44:01.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.449+0000 7ff7f5a7f640 0 -- 172.21.15.148:0/1251537213 >> [v2:172.21.15.148:6800/2615370688,v1:172.21.15.148:6801/2615370688] conn(0x7ff6c0082820 msgr2=0x7ff6c0084c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:44:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.665+0000 7ff7f7f799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:44:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.665+0000 7ff7f7f799c0 20 RGWRados::pool_iterate: got zonegroup_info.9b9b0efb-9b18-44de-85c3-ccb7827e65c9 2024-09-14T12:44:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.665+0000 7ff7f7f799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:44:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.665+0000 7ff7f7f799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:44:01.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.665+0000 7ff7f7f799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:44:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.665+0000 7ff7f7f799c0 20 RGWRados::pool_iterate: got zone_info.de8d1d51-bce5-4d5d-ab2e-644cf6365286 2024-09-14T12:44:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.665+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:44:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:44:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:44:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 zone default found 2024-09-14T12:44:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 4 Realm: () 2024-09-14T12:44:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 4 ZoneGroup: default (9b9b0efb-9b18-44de-85c3-ccb7827e65c9) 2024-09-14T12:44:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 4 Zone: default (de8d1d51-bce5-4d5d-ab2e-644cf6365286) 2024-09-14T12:44:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:44:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 zonegroup default 2024-09-14T12:44:01.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:44:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.669+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.673+0000 7ff7f7f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:44:01.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.673+0000 7ff7f7f799c0 20 rados->read ofs=0 len=0 2024-09-14T12:44:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.673+0000 7ff7f7f799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:44:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.673+0000 7ff7f7f799c0 20 started sync module instance, tier type = 2024-09-14T12:44:01.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.673+0000 7ff7f7f799c0 20 started zone id=de8d1d51-bce5-4d5d-ab2e-644cf6365286 (name=default) with tier type = 2024-09-14T12:44:01.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.693+0000 7ff7f7f799c0 20 add_watcher() i=0 2024-09-14T12:44:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.693+0000 7ff7f7f799c0 20 add_watcher() i=1 2024-09-14T12:44:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.693+0000 7ff7f7f799c0 20 add_watcher() i=2 2024-09-14T12:44:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.693+0000 7ff7f7f799c0 20 add_watcher() i=3 2024-09-14T12:44:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.693+0000 7ff7f7f799c0 20 add_watcher() i=4 2024-09-14T12:44:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.693+0000 7ff7f7f799c0 20 add_watcher() i=5 2024-09-14T12:44:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.693+0000 7ff7f7f799c0 20 add_watcher() i=6 2024-09-14T12:44:01.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.697+0000 7ff7f7f799c0 20 add_watcher() i=7 2024-09-14T12:44:01.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.697+0000 7ff7f7f799c0 2 all 8 watchers are set, enabling cache 2024-09-14T12:44:01.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.701+0000 7ff6a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:44:01.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.701+0000 7ff7f7f799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:44:01.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.701+0000 7ff7f7f799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:44:01.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.797+0000 7ff6a67fc640 20 reqs_thread_entry: start 2024-09-14T12:44:01.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.797+0000 7ff7f7f799c0 20 init_complete bucket index max shards: 11 2024-09-14T12:44:01.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.797+0000 7ff7f7f799c0 20 Filter name: none 2024-09-14T12:44:01.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T12:44:01.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.797+0000 7ff617fff640 20 reqs_thread_entry: start 2024-09-14T12:44:01.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:01.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50671' 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7309355901147033520', time=2024-09-14T13:50:10.321959+0000, chain.objs.size()=1 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.236__shadow_.lf5Mj04N2BaKYLtndCiPO7J_cRclKLj_0 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17082678204431233885', time=2024-09-14T13:50:16.881615+0000, chain.objs.size()=1 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.238__shadow_.o3mXYTH9gce6ctfyfjyHZTaJaDVGtOv_0 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1209954942438033911', time=2024-09-14T13:50:27.832211+0000, chain.objs.size()=1 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.242__shadow_.x5EuIX5kI15Cu72U4USEp1DXmFJO3UB_0 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15439027790859160711', time=2024-09-14T13:51:18.365642+0000, chain.objs.size()=1 2024-09-14T12:44:01.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.261__shadow_.VgtXNwfmd98B-LeMGQU4v6Fx4e27qGL_0 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2861811850749213166', time=2024-09-14T13:53:05.297256+0000, chain.objs.size()=1 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.m8cx0UQ-l87WvtDvY-7bImdXESptZiY_0 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1511336064423198518', time=2024-09-14T13:53:05.731179+0000, chain.objs.size()=1 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2owBkx4nQTDs46ogRiWNCrYJHy8a1m__0 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9124889319649645711', time=2024-09-14T13:53:05.775902+0000, chain.objs.size()=1 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.iqj37gkjIDamJ8aEeTaQU8RXgC9KSvF_0 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2002117833575200198', time=2024-09-14T13:53:06.636963+0000, chain.objs.size()=1 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.G2lM6PMVkAboMyd95K2xvDeTsjnZKSI_0 2024-09-14T12:44:01.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10443442705014906634', time=2024-09-14T13:53:06.639091+0000, chain.objs.size()=1 2024-09-14T12:44:01.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.DvKC676qA_SPQQ83Bjl-Al4yGnIzLnB_0 2024-09-14T12:44:01.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13348889117103693405', time=2024-09-14T13:53:07.495261+0000, chain.objs.size()=1 2024-09-14T12:44:01.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rFCWnn22SIiuqHz8MiUkd1Nazv0rRiG_0 2024-09-14T12:44:01.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8519302148355733234', time=2024-09-14T13:53:07.909769+0000, chain.objs.size()=1 2024-09-14T12:44:01.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7thsQ6rga1Any6SH4LYl-Va4nzfeVad_0 2024-09-14T12:44:01.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8816531368127331406', time=2024-09-14T13:53:08.006358+0000, chain.objs.size()=1 2024-09-14T12:44:01.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.DqhSbRNJlt8U4AXr7vCk4n2__Ikx0pv_0 2024-09-14T12:44:01.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11441479957667414831', time=2024-09-14T13:53:09.536969+0000, chain.objs.size()=1 2024-09-14T12:44:01.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.813+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.mkjBCcC2irfD3NBldzfesNYD-vCr6AK_0 2024-09-14T12:44:01.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5177227969229175296', time=2024-09-14T13:53:11.406587+0000, chain.objs.size()=1 2024-09-14T12:44:01.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.813+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ULyGl5WHmTRw6SrLbcIjUepKzoJUdDi_0 2024-09-14T12:44:01.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10056933406632329903', time=2024-09-14T13:53:11.969992+0000, chain.objs.size()=1 2024-09-14T12:44:01.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.813+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.IDPpg98OxOuIOQsDBTMZ5_ZazfFC7OZ_0 2024-09-14T12:44:01.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9110062233486069449', time=2024-09-14T13:53:14.596974+0000, chain.objs.size()=1 2024-09-14T12:44:01.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.813+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.I5wE_5q_CPBo8sWPYOVXRFWBIZDycCx_0 2024-09-14T12:44:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9589688233856668533', time=2024-09-14T13:53:15.308487+0000, chain.objs.size()=1 2024-09-14T12:44:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EjDfbf1x4l4aL-jbjLurFW7aaK24zi8_0 2024-09-14T12:44:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13312114904876681972', time=2024-09-14T13:53:17.727676+0000, chain.objs.size()=1 2024-09-14T12:44:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eSu_1kHr-mHZ2IONeRuEgVlm4N6ErXz_0 2024-09-14T12:44:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12818140330835979058', time=2024-09-14T13:53:18.136588+0000, chain.objs.size()=1 2024-09-14T12:44:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.suZY9A2JZqHkW6KvhiwmXsCd1iWXEWF_0 2024-09-14T12:44:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16259883774855696202', time=2024-09-14T13:53:18.644918+0000, chain.objs.size()=1 2024-09-14T12:44:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.F-wlxMxpYYrp7ca0VLJQSfYHfAnTuZq_0 2024-09-14T12:44:01.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5352663526176801654', time=2024-09-14T13:53:19.027351+0000, chain.objs.size()=1 2024-09-14T12:44:01.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8g90wwbt1Sy88Z7W9HyBqJ6lbLKUF8h_0 2024-09-14T12:44:01.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8448156323786156233', time=2024-09-14T13:53:20.573989+0000, chain.objs.size()=1 2024-09-14T12:44:01.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uSwvGxlhaIQC6CGP-lZBDUVm9v4gKIZ_0 2024-09-14T12:44:01.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16251484505443408864', time=2024-09-14T13:53:22.588330+0000, chain.objs.size()=1 2024-09-14T12:44:01.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5IYLkU9Kq8SdjAFbao1nW6JqM6SiKQo_0 2024-09-14T12:44:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12156923869714067357', time=2024-09-14T13:53:22.861551+0000, chain.objs.size()=1 2024-09-14T12:44:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FjYCZECuN60_zs6jRxANrznvQs2oGMF_0 2024-09-14T12:44:01.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.196825262760960872', time=2024-09-14T13:53:23.380141+0000, chain.objs.size()=1 2024-09-14T12:44:01.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TBbzcVRDYAf12Y_Zv2HNcSnDTDo3Kk3_0 2024-09-14T12:44:01.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2230849107573457500', time=2024-09-14T13:53:24.421500+0000, chain.objs.size()=1 2024-09-14T12:44:01.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ty8JqpQzwVYptQprZkiHvWZMM6pxmvB_0 2024-09-14T12:44:01.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.291784941047846848', time=2024-09-14T13:53:25.388230+0000, chain.objs.size()=1 2024-09-14T12:44:01.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EQHq32maoEc50pLjILSuu0Ngaa82--C_0 2024-09-14T12:44:01.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2447466593510640798', time=2024-09-14T13:53:26.014201+0000, chain.objs.size()=1 2024-09-14T12:44:01.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pd9LZRCS02-9ckYovUGfnohM8TGx5_K_0 2024-09-14T12:44:01.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2312477661397413762', time=2024-09-14T13:53:26.349811+0000, chain.objs.size()=1 2024-09-14T12:44:01.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.V8IhZBftRecTKyEI7EAyvZ6ix4QEL6d_0 2024-09-14T12:44:01.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17653405219914509206', time=2024-09-14T13:53:30.976647+0000, chain.objs.size()=1 2024-09-14T12:44:01.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-4NnxrGTS9UDRPMaL5vy2k8GnWnlfXa_0 2024-09-14T12:44:01.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2945818591672482395', time=2024-09-14T13:53:31.705636+0000, chain.objs.size()=1 2024-09-14T12:44:01.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yyNTy1nXWrv31vxcNbgksE0Him1SLGL_0 2024-09-14T12:44:01.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12523118876822727873', time=2024-09-14T13:53:32.028054+0000, chain.objs.size()=1 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ez_WzD8ZGNj8FTnj2zt7sM7bGdz6o8t_0 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11627556220445278101', time=2024-09-14T13:53:33.082018+0000, chain.objs.size()=1 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MlVk-AHnCUXiVPhZzDtbYDRXTsU12ij_0 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2161448874452218285', time=2024-09-14T13:53:33.143439+0000, chain.objs.size()=1 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.zgVSAplPxq2MFDHjaYtrovOZLCHdIEb_0 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13186388073497784038', time=2024-09-14T13:53:33.250115+0000, chain.objs.size()=1 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Zx0aHX4nm0ASFv-ngWZ7D0hbkm8TsK1_0 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13237495859104251903', time=2024-09-14T13:53:34.150443+0000, chain.objs.size()=1 2024-09-14T12:44:01.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vb7RU6-5SsQSJQ4rrhvqrBQLEfhmhq1_0 2024-09-14T12:44:01.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18019721189281202659', time=2024-09-14T13:53:52.045240+0000, chain.objs.size()=1 2024-09-14T12:44:01.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.270__shadow_.j2Ln4HxNYuD81l-Vz162aszs1r_X7Zu_0 2024-09-14T12:44:01.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10165802290734121369', time=2024-09-14T13:54:01.433608+0000, chain.objs.size()=1 2024-09-14T12:44:01.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.274__shadow_.juCsq-0XclzGUZG_eJPjYEljNlEJ8D2_0 2024-09-14T12:44:01.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.139077893236016494', time=2024-09-14T13:54:06.333009+0000, chain.objs.size()=1 2024-09-14T12:44:01.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.276__shadow_.Qf5_4YO7x09L6RuBAQB4COLxhMeZ7TC_0 2024-09-14T12:44:01.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14804775145709221869', time=2024-09-14T13:54:44.140440+0000, chain.objs.size()=1 2024-09-14T12:44:01.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.291__shadow_.yv6y4mVrUZht1xqUv1sbKKiN1gv-zE3_0 2024-09-14T12:44:01.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.267037457213527993', time=2024-09-14T13:54:58.864024+0000, chain.objs.size()=1 2024-09-14T12:44:01.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.IvGnEYxarFWQI51spYKac2h3zmOFnIU_0 2024-09-14T12:44:01.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10186885833850339420', time=2024-09-14T13:55:01.586395+0000, chain.objs.size()=1 2024-09-14T12:44:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.295__shadow_.SuhrHRszv5-9I0pElmRXXv8AM1CHaH0_0 2024-09-14T12:44:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11015667559114224425', time=2024-09-14T13:55:19.398015+0000, chain.objs.size()=1 2024-09-14T12:44:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.302__shadow_.qx1xEnIm-5r6YNSC-7DengLfCLT8gwE_0 2024-09-14T12:44:01.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11117619281978969604', time=2024-09-14T13:56:18.935105+0000, chain.objs.size()=1 2024-09-14T12:44:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.323__shadow_.tL_IZ82sxQ9C8mP75Jj_42jd2TSpqrl_0 2024-09-14T12:44:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13099164542253270824', time=2024-09-14T13:58:06.364520+0000, chain.objs.size()=1 2024-09-14T12:44:01.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YALYpvvmy3wui7V_JbNNFflUh7uh_HY_0 2024-09-14T12:44:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5782012404853705955', time=2024-09-14T13:58:06.718039+0000, chain.objs.size()=1 2024-09-14T12:44:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wdVSab8icDKVxjV5IauvvpS0d9djehB_0 2024-09-14T12:44:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10116320865203340277', time=2024-09-14T13:58:06.766264+0000, chain.objs.size()=1 2024-09-14T12:44:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EujsXAWi8O3MGGgzyRo-mzZUKOrhYCV_0 2024-09-14T12:44:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10311414057178815451', time=2024-09-14T13:58:08.196128+0000, chain.objs.size()=1 2024-09-14T12:44:01.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JNYn-K_Kt6az--1hdufx_JjdB44OzSc_0 2024-09-14T12:44:01.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12616214857578879228', time=2024-09-14T13:58:08.308538+0000, chain.objs.size()=1 2024-09-14T12:44:01.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HoHrN4OV8ir-IZCHDD1yUT3nwPnQ6zr_0 2024-09-14T12:44:01.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.905999953112262171', time=2024-09-14T13:58:09.482792+0000, chain.objs.size()=1 2024-09-14T12:44:01.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PqTxnAd59wKBSTOADDxVH__HhYCiS_8_0 2024-09-14T12:44:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1833206829684285408', time=2024-09-14T13:58:09.916046+0000, chain.objs.size()=1 2024-09-14T12:44:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6F20LkWLD5gDM6As8ZZAUqn0dk_qs5v_0 2024-09-14T12:44:01.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8811695089731850248', time=2024-09-14T13:58:10.020050+0000, chain.objs.size()=1 2024-09-14T12:44:01.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gWSLWoUnddxc_hSMeyqIhkSnG9-D-00_0 2024-09-14T12:44:01.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10553054628568470618', time=2024-09-14T13:58:10.538770+0000, chain.objs.size()=1 2024-09-14T12:44:01.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.t7CPLdCLqPtEbC-Ec2KFt4SpOuKn4IN_0 2024-09-14T12:44:01.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2431259860713453827', time=2024-09-14T13:58:12.236533+0000, chain.objs.size()=1 2024-09-14T12:44:01.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pAt8Gx5rCmO4uwGs8VeGUL1pBRQaVHK_0 2024-09-14T12:44:01.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14961998077733914887', time=2024-09-14T13:58:12.316924+0000, chain.objs.size()=1 2024-09-14T12:44:01.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Dq8rY_5wrn154iG_oqu-Kj5M94NPoFD_0 2024-09-14T12:44:01.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15461403628880563243', time=2024-09-14T13:58:14.229764+0000, chain.objs.size()=1 2024-09-14T12:44:01.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._oEW0IGF8HTi0oBvte57pejoG7XrGlS_0 2024-09-14T12:44:01.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4697104897666205762', time=2024-09-14T13:58:14.416402+0000, chain.objs.size()=1 2024-09-14T12:44:01.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.q_z78ZkATG7-658l6b5ATjfODWMqrJp_0 2024-09-14T12:44:01.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17745891671322034247', time=2024-09-14T13:58:15.209487+0000, chain.objs.size()=1 2024-09-14T12:44:01.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VGOufd8_61wD60jELPj5BkyOozb7Hdv_0 2024-09-14T12:44:01.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3014457989005695081', time=2024-09-14T13:58:17.760278+0000, chain.objs.size()=1 2024-09-14T12:44:01.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.AOR4ob_Stxf7ejI4ttsMYihw32o5VtT_0 2024-09-14T12:44:01.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.627072969162516929', time=2024-09-14T13:58:17.821163+0000, chain.objs.size()=1 2024-09-14T12:44:01.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FF373h9mZigf8YCoapQd09ktmnjgLjE_0 2024-09-14T12:44:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13724109128011669105', time=2024-09-14T13:58:19.341237+0000, chain.objs.size()=1 2024-09-14T12:44:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ysSJXDRne6b7nPwgC3JdVU_wagFrp8r_0 2024-09-14T12:44:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2094336012783618314', time=2024-09-14T13:58:19.552231+0000, chain.objs.size()=1 2024-09-14T12:44:01.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xMotb-pXaHFGoU33DPW0zVwNDRt0HOH_0 2024-09-14T12:44:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8302136751300421551', time=2024-09-14T13:58:19.554188+0000, chain.objs.size()=1 2024-09-14T12:44:01.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nb0q-7Bmp5qNrOvB-dcxzKH_gsjMIAX_0 2024-09-14T12:44:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.315041673017618133', time=2024-09-14T13:58:19.556209+0000, chain.objs.size()=1 2024-09-14T12:44:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.f8FEoZaFAFTUlUEZ7HPEIvXfOt0tkSi_0 2024-09-14T12:44:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17469500713607397019', time=2024-09-14T13:58:20.183187+0000, chain.objs.size()=1 2024-09-14T12:44:01.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tNQftvRNOPR4Y65x7iG7kOfppxEIPTk_0 2024-09-14T12:44:01.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1315471196077410071', time=2024-09-14T13:58:21.277460+0000, chain.objs.size()=1 2024-09-14T12:44:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6XdI2aiDS4lT0VmrOTOs8BMf1HBAflA_0 2024-09-14T12:44:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8107945878885334711', time=2024-09-14T13:58:21.279715+0000, chain.objs.size()=1 2024-09-14T12:44:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pCd6LweRUG-TphhIJJioShbRB1TQcQl_0 2024-09-14T12:44:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4645379357784393399', time=2024-09-14T13:58:22.408466+0000, chain.objs.size()=1 2024-09-14T12:44:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._J7Qmfim-H4FFEuYqb99iJlPDYG-zgj_0 2024-09-14T12:44:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7551669217856149962', time=2024-09-14T13:58:22.469216+0000, chain.objs.size()=1 2024-09-14T12:44:01.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wuJfK7mJ6TNYOs2Gi2Q3KGn89Eprd0z_0 2024-09-14T12:44:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10109128712238269628', time=2024-09-14T13:58:23.105194+0000, chain.objs.size()=1 2024-09-14T12:44:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tgUubeX4X0R3DMCpHKDybPOu-nQYt5k_0 2024-09-14T12:44:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14022992421352300016', time=2024-09-14T13:58:24.799561+0000, chain.objs.size()=1 2024-09-14T12:44:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Upvx3-B0qLPi3-LCDlr6wF6AT_ceFso_0 2024-09-14T12:44:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17761197886311712951', time=2024-09-14T13:58:24.934571+0000, chain.objs.size()=1 2024-09-14T12:44:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DpvM7FEyAqnNpqzxFh95AawIBMShp0G_0 2024-09-14T12:44:01.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8704173412121826473', time=2024-09-14T13:58:26.527186+0000, chain.objs.size()=1 2024-09-14T12:44:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.UBlO7qShapw7nveh_vqzghj7v3Wjhsz_0 2024-09-14T12:44:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9133050959546773175', time=2024-09-14T13:58:26.899505+0000, chain.objs.size()=1 2024-09-14T12:44:01.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ow2s6Ee_7idQUr9rvbaVyJIZ1eGurmU_0 2024-09-14T12:44:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16141354267622976547', time=2024-09-14T13:58:27.567335+0000, chain.objs.size()=1 2024-09-14T12:44:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7tpjCTfZ6tJGFISPiXvyuyTjYVSa0QB_0 2024-09-14T12:44:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8402610611598321260', time=2024-09-14T13:58:29.273929+0000, chain.objs.size()=1 2024-09-14T12:44:01.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._Xc-wcB2ZnpDtn7K918fMwyYDOIKIbJ_0 2024-09-14T12:44:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17590215832983790513', time=2024-09-14T13:58:30.038252+0000, chain.objs.size()=1 2024-09-14T12:44:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EcdhNLSkadh9mxvkptw4kYtuTd09oim_0 2024-09-14T12:44:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14270100969133238974', time=2024-09-14T13:58:30.162993+0000, chain.objs.size()=1 2024-09-14T12:44:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3MCf8wNskzlO-aTUVZdH85LuJ3-ZHvn_0 2024-09-14T12:44:01.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16234519475203714004', time=2024-09-14T13:58:30.276611+0000, chain.objs.size()=1 2024-09-14T12:44:01.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eHB_norrV63XehCKn7dGdzDs5kAvigR_0 2024-09-14T12:44:01.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8808640326172284660', time=2024-09-14T13:58:30.486269+0000, chain.objs.size()=1 2024-09-14T12:44:01.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Opb_g6CXH3EM_t8VpgrSDrGsrUHmHBX_0 2024-09-14T12:44:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16600156868787233093', time=2024-09-14T13:58:30.488085+0000, chain.objs.size()=1 2024-09-14T12:44:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mwtYP-NeGhM158hDs3sPze1tjFbFzCF_0 2024-09-14T12:44:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1014893722449303001', time=2024-09-14T13:58:30.489916+0000, chain.objs.size()=1 2024-09-14T12:44:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eaw_9JQ4Imn0EekhaCnyShc_0TyEZKI_0 2024-09-14T12:44:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12281596409367985894', time=2024-09-14T13:58:32.003524+0000, chain.objs.size()=1 2024-09-14T12:44:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.t4_BqHU6TsvxKpQgRShhR12FM0FpFiG_0 2024-09-14T12:44:01.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7307556538434853067', time=2024-09-14T13:58:32.223223+0000, chain.objs.size()=1 2024-09-14T12:44:01.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.MDEcYxNkf4PhfKwapWuJAIawarRLvwi_0 2024-09-14T12:44:01.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8756812279651349248', time=2024-09-14T13:58:32.505514+0000, chain.objs.size()=1 2024-09-14T12:44:01.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.x0sHHKU3rBRXix_dhaSGlKhadU8RBFF_0 2024-09-14T12:44:01.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1020641801619672488', time=2024-09-14T13:58:33.171734+0000, chain.objs.size()=1 2024-09-14T12:44:01.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.bzuHWmQPoSZMLzv9G3QmQf1C2Vn4RP-_0 2024-09-14T12:44:01.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9977488918751721320', time=2024-09-14T14:00:21.396571+0000, chain.objs.size()=1 2024-09-14T12:44:01.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cL6GGKq23pZnQWiKoZefbod1ik2gR08_0 2024-09-14T12:44:01.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1316886755361096299', time=2024-09-14T14:00:21.779746+0000, chain.objs.size()=1 2024-09-14T12:44:01.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HQ0-6b-CWylkgFZKGQkdOzwvYmsCHJA_0 2024-09-14T12:44:01.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5454109315114790045', time=2024-09-14T14:00:22.670491+0000, chain.objs.size()=1 2024-09-14T12:44:01.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ed_5c9ZYo_NTvL8NA1OWl2OHOnNw1-0_0 2024-09-14T12:44:01.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11763620674472946086', time=2024-09-14T14:00:26.408315+0000, chain.objs.size()=1 2024-09-14T12:44:01.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.0CR94e6kB6QQ2eXKjP_krW0Rk7V0UE8_0 2024-09-14T12:44:01.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17324937979659056131', time=2024-09-14T14:00:28.869899+0000, chain.objs.size()=1 2024-09-14T12:44:01.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Cn7n9zBOpIsllOswY089xz_X5b2EAti_0 2024-09-14T12:44:01.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8454098625045012299', time=2024-09-14T14:00:29.335787+0000, chain.objs.size()=1 2024-09-14T12:44:01.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.89tB-ZY42SvRrIcQMYfvpA4nYzbHtmO_0 2024-09-14T12:44:01.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11238004766478312151', time=2024-09-14T14:00:29.956323+0000, chain.objs.size()=1 2024-09-14T12:44:01.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yZNR6Q-gxsVe-wWx9xKfiWsQUjkrpZK_0 2024-09-14T12:44:01.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.463920895761743829', time=2024-09-14T14:00:30.040741+0000, chain.objs.size()=1 2024-09-14T12:44:01.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.d0QIvECl5Azgr1wcYJtMHDKDAAjlvLx_0 2024-09-14T12:44:01.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17279944417755226959', time=2024-09-14T14:00:30.537562+0000, chain.objs.size()=1 2024-09-14T12:44:01.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YPCa9f5eVdkMDkvFcSdhGrZYZ7UWo1B_0 2024-09-14T12:44:01.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12355219165255188449', time=2024-09-14T14:00:30.780031+0000, chain.objs.size()=1 2024-09-14T12:44:01.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Q6Bi9sNTNkmRsCmfmlyPYGo9bHNBv5d_0 2024-09-14T12:44:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.950797465404736067', time=2024-09-14T14:00:30.988731+0000, chain.objs.size()=1 2024-09-14T12:44:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lmIAQNkvYmPMH3Lht0j5AobmX7UKLZK_0 2024-09-14T12:44:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9521570554578542185', time=2024-09-14T14:00:31.319801+0000, chain.objs.size()=1 2024-09-14T12:44:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Oic6tSha2534VG5rOCtHwV0lskZSQV9_0 2024-09-14T12:44:01.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11765975017874729394', time=2024-09-14T14:00:31.696549+0000, chain.objs.size()=1 2024-09-14T12:44:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AAORMg75GkB2J52ms_uDCtFyPF4bWqK_0 2024-09-14T12:44:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8970154737202503654', time=2024-09-14T14:00:32.961977+0000, chain.objs.size()=1 2024-09-14T12:44:01.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.OME1X7noBocyJamWDwnEw5av6bDKv4q_0 2024-09-14T12:44:01.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50671 2024-09-14T12:44:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-14T12:44:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5868562963143726682', time=2024-09-14T14:00:33.307638+0000, chain.objs.size()=1 2024-09-14T12:44:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HYI8a46KBsg-6UNCiuH6dII9SDGMp0i_0 2024-09-14T12:44:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17622702133203528403', time=2024-09-14T14:00:35.212114+0000, chain.objs.size()=1 2024-09-14T12:44:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YMu1DDo85fMa-1oyOCIGnsWmCffTB1X_0 2024-09-14T12:44:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5791747907030429348', time=2024-09-14T14:00:35.738090+0000, chain.objs.size()=1 2024-09-14T12:44:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.U-W5HXlVH3GU-F2chkVC2WbW9oQjpPO_0 2024-09-14T12:44:01.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16862350370291143647', time=2024-09-14T14:00:35.739545+0000, chain.objs.size()=1 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Uvlc83739jbkXzW_7LKkE5jXOhswVZj_0 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14687888794153215094', time=2024-09-14T14:00:35.741644+0000, chain.objs.size()=1 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LtytnE_ejj_E7UqbtWs4rQ7HnuQ3kjP_0 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.973421410595975048', time=2024-09-14T14:00:38.652557+0000, chain.objs.size()=1 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wwE3-EQJdFOVdMTVXZOAnBIk-CPRIwV_0 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3275414598968624907', time=2024-09-14T14:00:39.031825+0000, chain.objs.size()=1 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vjVmzZmKnnVlwaBLR2P4_ztJrZr568p_0 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6693001181908627686', time=2024-09-14T14:00:40.463021+0000, chain.objs.size()=1 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WYT0f-moTkbX1DOeS6w0KAlIJ4OJgYA_0 2024-09-14T12:44:01.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12446244057919324002', time=2024-09-14T14:00:41.443676+0000, chain.objs.size()=1 2024-09-14T12:44:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tVc3hE51tEaqiAsBMbL-gf1fcc63lX9_0 2024-09-14T12:44:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17681889979459915168', time=2024-09-14T14:00:42.048007+0000, chain.objs.size()=1 2024-09-14T12:44:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Q56uRcZQK6NgjHPQEj_JBnpCHpPNcpS_0 2024-09-14T12:44:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6191515510283058210', time=2024-09-14T14:00:42.352185+0000, chain.objs.size()=1 2024-09-14T12:44:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QKUOgcKPAwvWCP20xnmlsyxsjutwjQU_0 2024-09-14T12:44:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5067565306682391475', time=2024-09-14T14:00:42.972324+0000, chain.objs.size()=1 2024-09-14T12:44:01.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qVxC_xo0nPqhYTO0AJd74Rt3Uzf5OYm_0 2024-09-14T12:44:01.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8312886646791191248', time=2024-09-14T14:00:44.234258+0000, chain.objs.size()=1 2024-09-14T12:44:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fN-A8kcWrZKBBaavR-PnU71n8v2CK0r_0 2024-09-14T12:44:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1831964498524640425', time=2024-09-14T14:00:45.385771+0000, chain.objs.size()=1 2024-09-14T12:44:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3Ptauxee-Gsa1e8sBw7esVIXeLKKjMg_0 2024-09-14T12:44:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11130716850735115591', time=2024-09-14T14:00:45.568593+0000, chain.objs.size()=1 2024-09-14T12:44:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.X9ex2x_guRMstoD_cqj6070bWFaxxNa_0 2024-09-14T12:44:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4505199459658332753', time=2024-09-14T14:00:46.490701+0000, chain.objs.size()=1 2024-09-14T12:44:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CrwUl4Vf5EdMugwyZjttqjlHROB8CS0_0 2024-09-14T12:44:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10890730602024512098', time=2024-09-14T14:00:47.731169+0000, chain.objs.size()=1 2024-09-14T12:44:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ouPZBE_Gf186BoojwIKNc0nrePn6fwY_0 2024-09-14T12:44:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12423942205583545032', time=2024-09-14T14:00:48.762723+0000, chain.objs.size()=1 2024-09-14T12:44:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HyslWhgt2fnnUOCJom8398GzSHxJJJh_0 2024-09-14T12:44:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8096815886551869473', time=2024-09-14T14:02:40.169703+0000, chain.objs.size()=1 2024-09-14T12:44:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.377__shadow_.eJmPob1_mUZTACjx6a_bJA5EEz4wQVS_0 2024-09-14T12:44:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4078562092363587426', time=2024-09-14T14:03:12.785745+0000, chain.objs.size()=1 2024-09-14T12:44:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.391__shadow_.v859EBATAFt5nGNaA4RJ-lxILu4aKZT_0 2024-09-14T12:44:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15656948362891304815', time=2024-09-14T14:03:22.212007+0000, chain.objs.size()=1 2024-09-14T12:44:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.395__shadow:opeCE5gBEyTF.6aBHiCx7NLJJslIcQL_.iO8gL5kbkOBDM6EWuML4haf9GWcGs4y_0 2024-09-14T12:44:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8153178500539608649', time=2024-09-14T14:04:55.974176+0000, chain.objs.size()=1 2024-09-14T12:44:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.437__shadow_.q8K8MRPDbno29Td92EyywCYzalKl4NZ_0 2024-09-14T12:44:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13693255653991465165', time=2024-09-14T14:05:43.201213+0000, chain.objs.size()=1 2024-09-14T12:44:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.456__shadow_.mpLIDpEdCoMKhvPUfM_cHkkfb5gQMQh_0 2024-09-14T12:44:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15470099773050474207', time=2024-09-14T14:06:17.525959+0000, chain.objs.size()=1 2024-09-14T12:44:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.467__shadow_.RBmWONz-PNyRi0KQ4ou1lA8CdibEUHR_0 2024-09-14T12:44:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10582937773836440167', time=2024-09-14T14:06:18.204938+0000, chain.objs.size()=1 2024-09-14T12:44:01.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.467__shadow_.dA2WU8rXtzMk_CgA3UbS1OZFb-Dfngl_0 2024-09-14T12:44:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8093151750411210640', time=2024-09-14T14:06:40.795227+0000, chain.objs.size()=1 2024-09-14T12:44:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.482__shadow_.CHw1DNHI8_I6XT6Px-1fb85SDeKN-ah_0 2024-09-14T12:44:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9683659351112457342', time=2024-09-14T14:06:49.668639+0000, chain.objs.size()=1 2024-09-14T12:44:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.485__shadow_.QnUh_MbkmaytQlgA2lSJEIkhC21nmUC_0 2024-09-14T12:44:01.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UZ7IDXvvOMD9F13R3k3NMR3dqQDFOFC', time=2024-09-14T14:15:48.787855+0000, chain.objs.size()=2 2024-09-14T12:44:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.532__multipart_mymultipart.2~UZ7IDXvvOMD9F13R3k3NMR3dqQDFOFC.1 2024-09-14T12:44:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.532__multipart_mymultipart.2~UZ7IDXvvOMD9F13R3k3NMR3dqQDFOFC.2 2024-09-14T12:44:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10197882642500710504', time=2024-09-14T14:17:46.022862+0000, chain.objs.size()=1 2024-09-14T12:44:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.554__shadow_.XwgjbPnzgr1DGBV6rLEMZaDifdRRtme_0 2024-09-14T12:44:01.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9739171271450698304', time=2024-09-14T14:20:23.882260+0000, chain.objs.size()=1 2024-09-14T12:44:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:oMW41HH0DBDTsr2.mVVBTbhrlPt3NEa_.OscDR6SppIksNnxEKcNwpAygJGXLN_c_0 2024-09-14T12:44:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17280268810583672133', time=2024-09-14T14:20:57.785021+0000, chain.objs.size()=1 2024-09-14T12:44:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:x-QTKnRszzWlt20ERFe4U8iylPancVB_.VWNhUX4mdEdHe6VHP5Wh_92Knp8n12j_0 2024-09-14T12:44:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6862975056788814802', time=2024-09-14T14:29:56.478054+0000, chain.objs.size()=1 2024-09-14T12:44:01.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.629__shadow_._heItpDDwcK2UJzinWUOWfXxtt0aehT_0 2024-09-14T12:44:01.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8071961953267579055', time=2024-09-14T14:36:11.328815+0000, chain.objs.size()=1 2024-09-14T12:44:01.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.742__shadow_.a86lkPkhNf1gFrFpEWGi_Df4U8euOpe_0 2024-09-14T12:44:01.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12817033747474985917', time=2024-09-14T14:38:25.813121+0000, chain.objs.size()=1 2024-09-14T12:44:01.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.756__shadow_.G-_cQH1c_gIr_Oml1neL2ZIbTP0auaX_0 2024-09-14T12:44:01.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:01.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T12:44:01.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:01.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:01.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/59048' 2024-09-14T12:44:01.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_FvjAF676Br6yfodZExiucWUB57-CkKY', time=2024-09-14T13:43:52.943777+0000, chain.objs.size()=3 2024-09-14T12:44:01.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.FSw_Ml66wQNKR8hiTxoIH5NQbYeT7v9_0 2024-09-14T12:44:01.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.FSw_Ml66wQNKR8hiTxoIH5NQbYeT7v9_1 2024-09-14T12:44:01.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.FSw_Ml66wQNKR8hiTxoIH5NQbYeT7v9_2 2024-09-14T12:44:01.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.368101162870885012', time=2024-09-14T13:44:30.235907+0000, chain.objs.size()=1 2024-09-14T12:44:01.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.167__shadow_.u3y_KF1gxiX2UkVs-LgPAmo_Kn6JaHG_0 2024-09-14T12:44:01.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17592231592874118417', time=2024-09-14T13:46:20.959478+0000, chain.objs.size()=1 2024-09-14T12:44:01.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.204__shadow_.B4ZZPijx4egqaA08lLJzOFwDBCGF09P_0 2024-09-14T12:44:01.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14378097205688401207', time=2024-09-14T13:50:30.285986+0000, chain.objs.size()=1 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.243__shadow_.gBA-sR8mmHUQEnw0jVsf3kwNAYzSGIi_0 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1629070126750591096', time=2024-09-14T13:50:50.978740+0000, chain.objs.size()=1 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.250__shadow_.TDXnDX-o_M6Qy59cfcnx1T2932jpeSe_0 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13705913895694904612', time=2024-09-14T13:50:53.623962+0000, chain.objs.size()=1 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.251__shadow_.FA0-8Rh7WrJNOIKWTSS4QlWsbapVt_U_0 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10704221239945255988', time=2024-09-14T13:51:15.870739+0000, chain.objs.size()=1 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.260__shadow_.dp1uODUnYRx4-yCANnYRIirdTwV_UpS_0 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16198895376171878022', time=2024-09-14T13:53:06.060712+0000, chain.objs.size()=1 2024-09-14T12:44:01.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2MgIfOqih0Awc8uFCnV-pto6LoQpWCF_0 2024-09-14T12:44:01.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15206880919537705690', time=2024-09-14T13:53:06.187787+0000, chain.objs.size()=1 2024-09-14T12:44:01.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UJklIA7mzhxPOndhMftfVKMshWCHbAt_0 2024-09-14T12:44:01.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8068200694271449650', time=2024-09-14T13:53:06.685315+0000, chain.objs.size()=1 2024-09-14T12:44:01.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cI-px4aU_2ptKs1QPUGZ6JnVzJhMe1u_0 2024-09-14T12:44:01.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3760499474623537549', time=2024-09-14T13:53:06.800104+0000, chain.objs.size()=1 2024-09-14T12:44:01.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.zsVPz9nSAO1Zb_amZSchbV5loU-sF9Q_0 2024-09-14T12:44:01.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15499821383334369096', time=2024-09-14T13:53:08.259419+0000, chain.objs.size()=1 2024-09-14T12:44:01.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oJuJ8c7H-2tItPxrDCGzs_mDcyHHtoD_0 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.418502504580783126', time=2024-09-14T13:53:09.898320+0000, chain.objs.size()=1 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.k8KMV4undGdI_cUsrAx0sKok1eLthNb_0 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3983188771129412790', time=2024-09-14T13:53:11.129265+0000, chain.objs.size()=1 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.NK4dbTcPnUcBRDEEQ_2XHecCD9YR0kD_0 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13982542064162113380', time=2024-09-14T13:53:11.888722+0000, chain.objs.size()=1 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.YGz8vcOSlXI_PPT25_ZSsXKyUzsBaLH_0 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5826029141829287', time=2024-09-14T13:53:12.244006+0000, chain.objs.size()=1 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hAoBlaqiKsWADQFI7JRNDqZYSr2egJe_0 2024-09-14T12:44:01.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15908027924627636306', time=2024-09-14T13:53:12.349886+0000, chain.objs.size()=1 2024-09-14T12:44:01.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jdUNNLXT9asiK5NVepKsvalhnmIZhGP_0 2024-09-14T12:44:01.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13317079535079238034', time=2024-09-14T13:53:12.678385+0000, chain.objs.size()=1 2024-09-14T12:44:01.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.inUPX8PMpVsBe0lUPuFtV-j7VDvsBKn_0 2024-09-14T12:44:01.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5266963803271309039', time=2024-09-14T13:53:13.676211+0000, chain.objs.size()=1 2024-09-14T12:44:01.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.V9Fb9nnDUd7SDNfC2ki2SN1Xdt4TqWr_0 2024-09-14T12:44:01.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5740861593145712985', time=2024-09-14T13:53:14.860107+0000, chain.objs.size()=1 2024-09-14T12:44:01.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fZjDwEUJQc835JpaK3fegg7YvdAEkk7_0 2024-09-14T12:44:01.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8092947834505696025', time=2024-09-14T13:53:15.919123+0000, chain.objs.size()=1 2024-09-14T12:44:01.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oZ5dktleXaob6fHEVKsRURu75SEDnUt_0 2024-09-14T12:44:01.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16087026775389649523', time=2024-09-14T13:53:17.729169+0000, chain.objs.size()=1 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1ex2c7LpuD3IDMGAd4MgnBR5iRPwhKL_0 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12339245002462077278', time=2024-09-14T13:53:17.730796+0000, chain.objs.size()=1 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.YISk3RK9Kb40z5s-Vgsv3ev_087WXJn_0 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7468127941213600736', time=2024-09-14T13:53:18.244232+0000, chain.objs.size()=1 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HS70tZpL5506hJYRb_pXHqM75vuvAhw_0 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12153055038125229470', time=2024-09-14T13:53:18.655931+0000, chain.objs.size()=1 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KJ1gP-JUw4HR93Ed0dINTTs798R_QMX_0 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7987001084335492867', time=2024-09-14T13:53:18.658099+0000, chain.objs.size()=1 2024-09-14T12:44:01.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Y9HoY50xlKn8eIa7JxqnR8NwjSmQDph_0 2024-09-14T12:44:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14031767793256440315', time=2024-09-14T13:53:19.288063+0000, chain.objs.size()=1 2024-09-14T12:44:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AyStB_QPJz9bUI0nWdWY3zLKNXxeJmG_0 2024-09-14T12:44:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15433331923867305013', time=2024-09-14T13:53:19.409168+0000, chain.objs.size()=1 2024-09-14T12:44:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WPNQSWNLOHd5gQe7WeAmg495UnbwbWn_0 2024-09-14T12:44:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.857249624783251270', time=2024-09-14T13:53:20.436727+0000, chain.objs.size()=1 2024-09-14T12:44:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-OjVCU0VFpf_U9daYQ0kWBc-kvi4tRr_0 2024-09-14T12:44:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3713555350943133553', time=2024-09-14T13:53:21.476791+0000, chain.objs.size()=1 2024-09-14T12:44:01.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UZKwQbweuMDpfY2izh4TYwQw0c7YAKS_0 2024-09-14T12:44:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9038211053802669174', time=2024-09-14T13:53:21.574367+0000, chain.objs.size()=1 2024-09-14T12:44:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wKUZnA9GhS_urEiCpazj2LMP8hMWCwf_0 2024-09-14T12:44:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8874272570030957962', time=2024-09-14T13:53:21.672347+0000, chain.objs.size()=1 2024-09-14T12:44:01.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CL3I_fZo_BLzxjpj_x2VhB54ruKK5ex_0 2024-09-14T12:44:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12855535548654037637', time=2024-09-14T13:53:21.673725+0000, chain.objs.size()=1 2024-09-14T12:44:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KbBibKZYim9dWen0wCUQoXK4mJrjhiA_0 2024-09-14T12:44:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11045562504897183209', time=2024-09-14T13:53:21.961770+0000, chain.objs.size()=1 2024-09-14T12:44:01.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0R0uwWZQDpEyWZAQN_DrIKdCQ93gU_-_0 2024-09-14T12:44:01.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8890503913183336313', time=2024-09-14T13:53:22.401433+0000, chain.objs.size()=1 2024-09-14T12:44:01.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6yG5cvNSVFZNvGRKKMwLuInniytwvjC_0 2024-09-14T12:44:01.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17563702611999384279', time=2024-09-14T13:53:22.472732+0000, chain.objs.size()=1 2024-09-14T12:44:01.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.r0DU8MdMLF1TXeAjHwFANQjHc9iHQEH_0 2024-09-14T12:44:01.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5102381745826306910', time=2024-09-14T13:53:23.634791+0000, chain.objs.size()=1 2024-09-14T12:44:01.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yfWARQqqm3ovI6nq6wlZGHx88mEmAnL_0 2024-09-14T12:44:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17483904772246705011', time=2024-09-14T13:53:23.788415+0000, chain.objs.size()=1 2024-09-14T12:44:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ZLYbG8wZGoRRgnKH5FdN70KX3a8j3FW_0 2024-09-14T12:44:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6356929702678643727', time=2024-09-14T13:53:23.790256+0000, chain.objs.size()=1 2024-09-14T12:44:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XsqiAbFwMe9cmwPR7Y1gyMwQ_GnZd3H_0 2024-09-14T12:44:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3630283579164951274', time=2024-09-14T13:53:26.870335+0000, chain.objs.size()=1 2024-09-14T12:44:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8ckzpIVBGhPCEdDUpmtPw5c4CAoMom6_0 2024-09-14T12:44:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1282156491115358848', time=2024-09-14T13:53:27.238570+0000, chain.objs.size()=1 2024-09-14T12:44:01.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4zGRpJSELU1SAUgzGWV_RhkpenFDZWL_0 2024-09-14T12:44:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3271848148328588944', time=2024-09-14T13:53:27.574491+0000, chain.objs.size()=1 2024-09-14T12:44:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.k_20eld_zlhsNFrawR163Xu9W2EU1Yz_0 2024-09-14T12:44:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3382161729000212942', time=2024-09-14T13:53:28.006372+0000, chain.objs.size()=1 2024-09-14T12:44:01.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8HS_uJZZsFdb2WpQnLX8lZEDjHuvpFJ_0 2024-09-14T12:44:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1946235379213764098', time=2024-09-14T13:53:28.079963+0000, chain.objs.size()=1 2024-09-14T12:44:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5kKKhDFpoqV9x1SwGkM1vaTH0J5S4WF_0 2024-09-14T12:44:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13510932616410536627', time=2024-09-14T13:53:30.296433+0000, chain.objs.size()=1 2024-09-14T12:44:01.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Szjc5ckpiiqiT2SEihNILAtlIPZ7uV5_0 2024-09-14T12:44:01.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3402310907554266187', time=2024-09-14T13:53:31.327975+0000, chain.objs.size()=1 2024-09-14T12:44:01.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wUkHMA3TzUXS4QgWzi03VJ3IfCtFM1I_0 2024-09-14T12:44:01.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17632742857472169845', time=2024-09-14T13:53:31.793747+0000, chain.objs.size()=1 2024-09-14T12:44:01.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4MX1CQbXfy4-Yo2D5zFLx0AcTHB1B1i_0 2024-09-14T12:44:01.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14730723785239074603', time=2024-09-14T13:53:32.017395+0000, chain.objs.size()=1 2024-09-14T12:44:01.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jU-g4fn6--yYGWg6jJPah1eCCa8DYhr_0 2024-09-14T12:44:01.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3194171766291033787', time=2024-09-14T13:53:34.511787+0000, chain.objs.size()=1 2024-09-14T12:44:01.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bQnthf_ybU8n9hTR43hCbtGwbL84dww_0 2024-09-14T12:44:01.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6901046445189540385', time=2024-09-14T13:53:35.174226+0000, chain.objs.size()=1 2024-09-14T12:44:01.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.iX3eSz3eSP-G_5mYcHnrfe2JfwexOvL_0 2024-09-14T12:44:01.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8883365232979545364', time=2024-09-14T13:54:13.748493+0000, chain.objs.size()=1 2024-09-14T12:44:01.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.279__shadow_.kReRpVpCSycrlBDheQpi7gW9XIF5YRw_0 2024-09-14T12:44:01.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12466859574786781621', time=2024-09-14T13:54:16.311545+0000, chain.objs.size()=1 2024-09-14T12:44:01.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.280__shadow_.F3PgpCR1qxG1nS39JnhOQBJ6_yCMyAg_0 2024-09-14T12:44:01.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8519582667749923618', time=2024-09-14T13:54:53.040580+0000, chain.objs.size()=1 2024-09-14T12:44:01.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.hYZblvvDfU4TwkrJdpeffs9luyQRZTi_0 2024-09-14T12:44:01.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12062416319730071448', time=2024-09-14T13:58:07.683787+0000, chain.objs.size()=1 2024-09-14T12:44:01.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.W1HAtkKMn-IW9SNYibvKy93PyYK4UGb_0 2024-09-14T12:44:01.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8569532433064531280', time=2024-09-14T13:58:07.906178+0000, chain.objs.size()=1 2024-09-14T12:44:01.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LhosIrXdNK4pSxs8u0-YKo0FI-YBTEc_0 2024-09-14T12:44:01.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3355117276533713580', time=2024-09-14T13:58:08.414931+0000, chain.objs.size()=1 2024-09-14T12:44:01.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mmbrBf0v6Z9b8z5snJl3E_GK1DfWy_Z_0 2024-09-14T12:44:01.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9197273489617993315', time=2024-09-14T13:58:09.446896+0000, chain.objs.size()=1 2024-09-14T12:44:01.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Jq0f2gE6thHPWBEjn2NSOnwResyoNc-_0 2024-09-14T12:44:01.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6574474335428969298', time=2024-09-14T13:58:10.518878+0000, chain.objs.size()=1 2024-09-14T12:44:01.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gXWaFhOLXWMX-NAzA8TJcdJU-LUDzUm_0 2024-09-14T12:44:01.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11281894083649141499', time=2024-09-14T13:58:10.770355+0000, chain.objs.size()=1 2024-09-14T12:44:01.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PwCjWNNV2M8VM7xGQywRyDBa9v4GBQc_0 2024-09-14T12:44:01.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3590060676632744586', time=2024-09-14T13:58:11.130272+0000, chain.objs.size()=1 2024-09-14T12:44:01.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VZLBsWAcAzEWrONbgnaKroPdLDZyy1y_0 2024-09-14T12:44:01.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13766639530518261006', time=2024-09-14T13:58:11.690508+0000, chain.objs.size()=1 2024-09-14T12:44:01.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8Xz-ITk1tWYN1GbYhoIbE5iU5qnsaAQ_0 2024-09-14T12:44:01.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5723998135382444119', time=2024-09-14T13:58:12.238596+0000, chain.objs.size()=1 2024-09-14T12:44:01.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CYbrSdVWZb8bPxajQzJJ7mSAd2aHh_P_0 2024-09-14T12:44:01.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15304520094269980510', time=2024-09-14T13:58:13.699563+0000, chain.objs.size()=1 2024-09-14T12:44:01.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ibIkHovwV-57fS632QgRuNxx_ZhZESe_0 2024-09-14T12:44:01.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11602261169092920147', time=2024-09-14T13:58:13.921001+0000, chain.objs.size()=1 2024-09-14T12:44:01.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eSGp-f-AT6EUzQGNEwxxP5hCxyQjE0U_0 2024-09-14T12:44:01.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4338860306605082923', time=2024-09-14T13:58:14.016297+0000, chain.objs.size()=1 2024-09-14T12:44:01.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xrf58ed_TYCQRKhCrNiakeBDN10jthf_0 2024-09-14T12:44:01.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6581405835526540266', time=2024-09-14T13:58:14.545096+0000, chain.objs.size()=1 2024-09-14T12:44:01.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EezmiLYCpurT_vSPdDI0fcaETQz1MZj_0 2024-09-14T12:44:01.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13366407918990236081', time=2024-09-14T13:58:15.230665+0000, chain.objs.size()=1 2024-09-14T12:44:01.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.UBbRAi9EW2MuyjPDAE73Hge2NK9kh2-_0 2024-09-14T12:44:01.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15393944918706492175', time=2024-09-14T13:58:15.232800+0000, chain.objs.size()=1 2024-09-14T12:44:01.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.MovF8MXFaNQhnUi8lkjd_VdDmtekJ6C_0 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2470501596058623027', time=2024-09-14T13:58:16.280037+0000, chain.objs.size()=1 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oYbnppsi4Rt_76oMiiqOjGxTHV4SC6Y_0 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15781521537699263042', time=2024-09-14T13:58:18.240251+0000, chain.objs.size()=1 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.d1J9aclyeQQOzLAsnUInkK2_z0Eya8f_0 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8375513221098171801', time=2024-09-14T13:58:18.748677+0000, chain.objs.size()=1 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EgXGQYCX61Gq9UEz-iU3F3dVVNxZ_tK_0 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2343719495842073193', time=2024-09-14T13:58:18.750507+0000, chain.objs.size()=1 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6aQbr_Rgz39z1O9uHO7EhSWH63-TSi2_0 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.583432031894098367', time=2024-09-14T13:58:18.914707+0000, chain.objs.size()=1 2024-09-14T12:44:01.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6RQrWu_gVvcJpv01wenvuyXV7lPf8Mv_0 2024-09-14T12:44:01.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13796932199827650361', time=2024-09-14T13:58:19.214943+0000, chain.objs.size()=1 2024-09-14T12:44:01.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pP5h7qRwBVWfNr-w-PPHAWd_E1swWip_0 2024-09-14T12:44:01.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1506400906516859428', time=2024-09-14T13:58:19.381938+0000, chain.objs.size()=1 2024-09-14T12:44:01.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.coaBVJRXvJjhW05Y49vUw3Q-MIngOAv_0 2024-09-14T12:44:01.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3674546509874608556', time=2024-09-14T13:58:20.141101+0000, chain.objs.size()=1 2024-09-14T12:44:01.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LhFxbTBwCRlU5ua01lDyMLiN81tajOW_0 2024-09-14T12:44:01.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9286825607143890168', time=2024-09-14T13:58:20.186124+0000, chain.objs.size()=1 2024-09-14T12:44:01.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Z14szLw0fnYw5tG5cL_1-i4kDULlMlP_0 2024-09-14T12:44:01.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16735652297472335603', time=2024-09-14T13:58:21.176320+0000, chain.objs.size()=1 2024-09-14T12:44:01.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.g42gKWOJ72tpOEVgBEV6Gx1_hoBxwXO_0 2024-09-14T12:44:01.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16601344752220375908', time=2024-09-14T13:58:22.091307+0000, chain.objs.size()=1 2024-09-14T12:44:01.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.m5RtOaibFw1j1QH_xcgG1JQiBTpojIO_0 2024-09-14T12:44:01.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11983548457196131507', time=2024-09-14T13:58:22.092982+0000, chain.objs.size()=1 2024-09-14T12:44:01.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jl0nF66VRpC2pFMBVkU9XNchk3SFJnb_0 2024-09-14T12:44:01.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5820092696791292870', time=2024-09-14T13:58:22.412307+0000, chain.objs.size()=1 2024-09-14T12:44:01.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WIV83T_A730dwhTCksxeysnjA94Hzyb_0 2024-09-14T12:44:01.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4399705028918576785', time=2024-09-14T13:58:23.947756+0000, chain.objs.size()=1 2024-09-14T12:44:01.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.H6GMvd5F9gVleJJSe0UmGU4SgYzbE4Y_0 2024-09-14T12:44:01.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15167502884486285033', time=2024-09-14T13:58:24.007994+0000, chain.objs.size()=1 2024-09-14T12:44:01.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1jXKKXoBPBDmtRb_VZBLtzfiJNpnYak_0 2024-09-14T12:44:01.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15427511147511600570', time=2024-09-14T13:58:25.277752+0000, chain.objs.size()=1 2024-09-14T12:44:01.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QKhgUpAq4YdUzZmI7VgwqFTyx95NzS8_0 2024-09-14T12:44:01.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16610895661700660780', time=2024-09-14T13:58:26.072903+0000, chain.objs.size()=1 2024-09-14T12:44:01.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.uI89w8j90RGfywSviledNPtlHN-zftY_0 2024-09-14T12:44:01.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4310364283419800976', time=2024-09-14T13:58:26.794133+0000, chain.objs.size()=1 2024-09-14T12:44:01.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.H9PSvRW2W_yq9hswwtCaJz6OLkO2MQu_0 2024-09-14T12:44:01.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3956648339166766593', time=2024-09-14T13:58:27.064652+0000, chain.objs.size()=1 2024-09-14T12:44:01.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZEgNJmgmiUgnkb02KYu591q2rA8ylwi_0 2024-09-14T12:44:01.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8607001503423151723', time=2024-09-14T13:58:27.322011+0000, chain.objs.size()=1 2024-09-14T12:44:01.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0WqaCLaASm8EmIQGocQNnm0kEW5zavr_0 2024-09-14T12:44:01.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5206535708930716701', time=2024-09-14T13:58:27.466989+0000, chain.objs.size()=1 2024-09-14T12:44:01.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qQPCk10e6ppHyRvGeKfqavN30VwjEqI_0 2024-09-14T12:44:01.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8522985992108032442', time=2024-09-14T13:58:27.468926+0000, chain.objs.size()=1 2024-09-14T12:44:01.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8vepQk4Af1eFHkULhrVCevHgMEi625h_0 2024-09-14T12:44:01.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5799050548893823653', time=2024-09-14T13:58:27.619993+0000, chain.objs.size()=1 2024-09-14T12:44:01.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Dthwt4lLnNHKdp09-Xo_NVAIMkB6pPg_0 2024-09-14T12:44:01.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8201401858027441980', time=2024-09-14T13:58:28.568234+0000, chain.objs.size()=1 2024-09-14T12:44:01.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6sPGtb_my1KHENYabf6DmrKJa05eCHm_0 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8264787797084638757', time=2024-09-14T13:58:33.989258+0000, chain.objs.size()=1 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ets0Iy-EnOBLroqvpNqKR-1mKRWy79Z_0 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14348698366870109477', time=2024-09-14T13:58:34.208922+0000, chain.objs.size()=1 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.taWAXlMvUqkPlT-vaoxdNEftuN-_mTS_0 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5838506615521721324', time=2024-09-14T14:00:21.384453+0000, chain.objs.size()=1 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BE0NebmCJsZeE0TV7_SBRRdCm9R4qw6_0 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7056657570749133417', time=2024-09-14T14:00:22.504943+0000, chain.objs.size()=1 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.umUMhgLqlVu58A2yd2cfwxl0GAUKOIf_0 2024-09-14T12:44:01.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18439511627193733417', time=2024-09-14T14:00:22.934460+0000, chain.objs.size()=1 2024-09-14T12:44:01.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FqIWwSwB33scOSjzHbIQbSFAXni2zuH_0 2024-09-14T12:44:01.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5952194894370415656', time=2024-09-14T14:00:23.897314+0000, chain.objs.size()=1 2024-09-14T12:44:01.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.D1MIyo2n7GSYiFS6uj9rnXSynC7FvVC_0 2024-09-14T12:44:01.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14174926474228522149', time=2024-09-14T14:00:25.066322+0000, chain.objs.size()=1 2024-09-14T12:44:01.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kup5A0KtxWpXUcjKM2QVQok1XJSzH-V_0 2024-09-14T12:44:01.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6253303245143024303', time=2024-09-14T14:00:25.165248+0000, chain.objs.size()=1 2024-09-14T12:44:01.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jT3jRXUbahmLLyKtpaMJ4CCc7BoD84n_0 2024-09-14T12:44:01.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/59048 2024-09-14T12:44:01.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=46, truncated=0, next_marker='' 2024-09-14T12:44:01.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15732783359927815215', time=2024-09-14T14:00:25.558708+0000, chain.objs.size()=1 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.sI3yplXcrc1toipRQTE1rPPgqL-jC0k_0 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17632661252454955845', time=2024-09-14T14:00:25.717805+0000, chain.objs.size()=1 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.0D-bQsaA7SdmZq-LHK_wKpCeYH132qN_0 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18223739047392327498', time=2024-09-14T14:00:26.662774+0000, chain.objs.size()=1 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.e_d4EwpWFR0NDDX7YVBMusiLBrrBrlB_0 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15667242290348374481', time=2024-09-14T14:00:27.331546+0000, chain.objs.size()=1 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xY0OwuG16ENpx_ZW9psX5ZObTxdYi8C_0 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11287585202517478808', time=2024-09-14T14:00:27.494348+0000, chain.objs.size()=1 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.T5TqUl_rv1R5cCBWjMV75zTjqKFsWQx_0 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10494915939363480127', time=2024-09-14T14:00:29.704161+0000, chain.objs.size()=1 2024-09-14T12:44:01.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AfbAhF8XbA5obS-WmmbfWeDW3n4UOyw_0 2024-09-14T12:44:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8377286055737239539', time=2024-09-14T14:00:30.052141+0000, chain.objs.size()=1 2024-09-14T12:44:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.J3Lj1KQckjjSVKLVxZEHgs_tFjfy4w3_0 2024-09-14T12:44:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17785889932421837611', time=2024-09-14T14:00:30.140451+0000, chain.objs.size()=1 2024-09-14T12:44:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ufopLEgmDr73sK8FFWranCY1y3bVg18_0 2024-09-14T12:44:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2992809846545345188', time=2024-09-14T14:00:31.689306+0000, chain.objs.size()=1 2024-09-14T12:44:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ncas7F00IgyAZm0IKLuSKYIKO2UOreF_0 2024-09-14T12:44:01.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12755935364555484148', time=2024-09-14T14:00:32.792836+0000, chain.objs.size()=1 2024-09-14T12:44:01.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.U_d_OKrEScFhtaX33JjwOH0wbrhK04v_0 2024-09-14T12:44:01.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15859259102024724169', time=2024-09-14T14:00:35.083197+0000, chain.objs.size()=1 2024-09-14T12:44:01.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.R-fE07scGANbtxutb-22olc40NxmEzd_0 2024-09-14T12:44:01.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3878234797533679232', time=2024-09-14T14:00:35.591187+0000, chain.objs.size()=1 2024-09-14T12:44:01.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:01.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9aTLhnkDSN3_J2Kyq1Y8lLtNijKtu1e_0 2024-09-14T12:44:01.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13386021321951237650', time=2024-09-14T14:00:38.353706+0000, chain.objs.size()=1 2024-09-14T12:44:01.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.J0k0MLPL9gv0kOsYTPBaZgrjQr8NUD9_0 2024-09-14T12:44:01.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17028724903414373458', time=2024-09-14T14:00:38.460694+0000, chain.objs.size()=1 2024-09-14T12:44:01.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NqgtgQkHsO8R-ksvepoG5LH9bpZku8E_0 2024-09-14T12:44:01.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1818748894553595746', time=2024-09-14T14:00:40.355066+0000, chain.objs.size()=1 2024-09-14T12:44:01.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ApG2oTsuQBNFO5-APNa89LF9IJ5S9DD_0 2024-09-14T12:44:01.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9486597743041641102', time=2024-09-14T14:00:42.152325+0000, chain.objs.size()=1 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.t_MyNJOcFPMY1RQ7eX8S8Zo_WD_503m_0 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12106247269986088709', time=2024-09-14T14:00:42.240102+0000, chain.objs.size()=1 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JP9XKP0N6qYHX2hKAa7NKpC3BjDHw95_0 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8364984316289018522', time=2024-09-14T14:00:42.526635+0000, chain.objs.size()=1 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.aQVritE9tW21dUTZWDZF3K6b8i8C0o3_0 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10313272179798390890', time=2024-09-14T14:00:43.182022+0000, chain.objs.size()=1 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ROEYrzBQaV5yXXB8bVcCkig3As_v_Nu_0 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2822396120622341000', time=2024-09-14T14:00:43.184017+0000, chain.objs.size()=1 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5vSvmm_Opuvt7QDG8Q05LRwnRW2_LHv_0 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16435748548423896376', time=2024-09-14T14:00:44.036937+0000, chain.objs.size()=1 2024-09-14T12:44:01.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KT8it-tcRo90y5E9t0kXEt4Bmt5mIJ0_0 2024-09-14T12:44:01.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12893487694944593136', time=2024-09-14T14:00:44.657495+0000, chain.objs.size()=1 2024-09-14T12:44:01.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kA7wLLBnLdHuY_-Qp0eR88s_jk5MGe0_0 2024-09-14T12:44:01.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15448116620519439508', time=2024-09-14T14:00:44.659532+0000, chain.objs.size()=1 2024-09-14T12:44:01.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yp-7nOP-TC6RiEIidirh5yM1qespImJ_0 2024-09-14T12:44:01.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18313046201689000675', time=2024-09-14T14:00:44.951827+0000, chain.objs.size()=1 2024-09-14T12:44:01.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iwL_QrE12t1P3bkjs1HaecYcGr65Ttm_0 2024-09-14T12:44:01.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5656055226133717882', time=2024-09-14T14:00:45.555237+0000, chain.objs.size()=1 2024-09-14T12:44:01.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.01O4Ae4GjzMZ47HPv6S0QtnnI_zcoyN_0 2024-09-14T12:44:01.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6812425453795142021', time=2024-09-14T14:00:45.831208+0000, chain.objs.size()=1 2024-09-14T12:44:01.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1wQ7LowKhndpj13L8G8rGZrNXmwV4m9_0 2024-09-14T12:44:01.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8064648262514370871', time=2024-09-14T14:00:46.406065+0000, chain.objs.size()=1 2024-09-14T12:44:01.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-3TuMobYiz8v33Bt5Fu-ubXd0ukKX3N_0 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2604831739457849641', time=2024-09-14T14:00:47.721228+0000, chain.objs.size()=1 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.C9pK_Bb50kLfUJpm9mwbcUd17FDtop6_0 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3398951332075385879', time=2024-09-14T14:00:48.034224+0000, chain.objs.size()=1 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.b0oRJwwx--X6xZARcXSlHtC8JBSQCQe_0 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5578263452454321676', time=2024-09-14T14:00:49.199781+0000, chain.objs.size()=1 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.sHSM26q9ASTOHsOARFoVgMtu64N3SvB_0 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3496619867433854115', time=2024-09-14T14:00:49.477189+0000, chain.objs.size()=1 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5dVts_zrik7Jhr2Q3h2RxkoeUNkvCgG_0 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5981890107578725463', time=2024-09-14T14:02:23.983542+0000, chain.objs.size()=1 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.370__shadow_.aAitNvPDaj_oEC1Ca5WrYID71I4QrmY_0 2024-09-14T12:44:02.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18251597035307970009', time=2024-09-14T14:09:05.587983+0000, chain.objs.size()=1 2024-09-14T12:44:02.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.518__shadow_.PQD1rOgwka4HJU0Ndv0P32YjRgNYG4f_0 2024-09-14T12:44:02.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2627268495624585618', time=2024-09-14T14:14:26.238042+0000, chain.objs.size()=2 2024-09-14T12:44:02.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~waL5X8Dl5VBg9TAlYG-aUdbWgs71IiY.1 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~waL5X8Dl5VBg9TAlYG-aUdbWgs71IiY.2 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14999835850297827253', time=2024-09-14T14:18:24.222805+0000, chain.objs.size()=1 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.558__shadow_.yq94K5DMNTH6-NzDttyKhfgUXSYmQ_7_0 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10069149295454941339', time=2024-09-14T14:18:51.911440+0000, chain.objs.size()=1 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.563__shadow_.7lPMYmiol4I5VvkFV0pk7Ro51_FFjSz_0 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.119234155818910698', time=2024-09-14T14:19:45.856194+0000, chain.objs.size()=1 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.571__shadow:h1HeZ-ajChxo85y6gzbWPT3khQDbeaT_.ASTJKF7H8eRiPWsBNcbfherJT2_VJsQ_0 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14152768830843163035', time=2024-09-14T14:20:28.548030+0000, chain.objs.size()=1 2024-09-14T12:44:02.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:zSSRlgTw.ArAYLeNtjK5aoeFD21d-Rs_.LX43cdZkuIkfXuzjO5oIBHPwGyx5YTK_0 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12172276638218566195', time=2024-09-14T14:20:55.546816+0000, chain.objs.size()=1 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:BEriI94zlGiyCkBLDubY3K2ENcynd2._.5PnXTXfZ0tW4Dvv56jtvR2kBhV2ItVk_0 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2884552675800123931', time=2024-09-14T14:22:09.826609+0000, chain.objs.size()=1 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:4XYK4zRKMGNaBTLE4TzcvGkbFnmfQds_.yYVJxgyXRGTrAr8kqU4MZdTCNy2JRew_0 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12454289827282009398', time=2024-09-14T14:22:56.210802+0000, chain.objs.size()=1 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.597__shadow_.C7z_dWRY5u5sAOgsPniKvsqLuP8eMV4_0 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3797376721774800275', time=2024-09-14T14:26:06.774401+0000, chain.objs.size()=12 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__multipart_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.1 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__shadow_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.1_1 2024-09-14T12:44:02.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__multipart_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.2 2024-09-14T12:44:02.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.017+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__shadow_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.2_1 2024-09-14T12:44:02.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.017+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__multipart_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.3 2024-09-14T12:44:02.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.017+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__shadow_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.3_1 2024-09-14T12:44:02.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__multipart_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.4 2024-09-14T12:44:02.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__shadow_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.4_1 2024-09-14T12:44:02.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__multipart_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.5 2024-09-14T12:44:02.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__shadow_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.5_1 2024-09-14T12:44:02.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__multipart_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.6 2024-09-14T12:44:02.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.616__shadow_multipart_enc.2~AypD41JqEGIfiwk37-Q32Q695U57EBt.6_1 2024-09-14T12:44:02.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~28usUVhIp7qGqmyyom1o249yR1UZ24V', time=2024-09-14T14:29:50.145385+0000, chain.objs.size()=12 2024-09-14T12:44:02.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__multipart_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.1 2024-09-14T12:44:02.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__shadow_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.1_1 2024-09-14T12:44:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__multipart_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.2 2024-09-14T12:44:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__shadow_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.2_1 2024-09-14T12:44:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__multipart_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.3 2024-09-14T12:44:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__shadow_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.3_1 2024-09-14T12:44:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__multipart_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.4 2024-09-14T12:44:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__shadow_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.4_1 2024-09-14T12:44:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__multipart_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.5 2024-09-14T12:44:02.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__shadow_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.5_1 2024-09-14T12:44:02.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.029+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__multipart_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.6 2024-09-14T12:44:02.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.029+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.626__shadow_multipart_enc.2~28usUVhIp7qGqmyyom1o249yR1UZ24V.6_1 2024-09-14T12:44:02.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.029+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10123367194297633608', time=2024-09-14T14:33:11.613599+0000, chain.objs.size()=1 2024-09-14T12:44:02.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.029+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.680__shadow_.s3g6aUB1MUswBqpYGvgcb85wUaSL8NE_0 2024-09-14T12:44:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3896206502970792314', time=2024-09-14T14:34:25.139974+0000, chain.objs.size()=1 2024-09-14T12:44:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.714__shadow:Rcu.-W0zhcfk4463rGdUX6GNoyvfw33_.3NWdaC2q_zGJCransAOcp68whpmXnFV_0 2024-09-14T12:44:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12830753883054991575', time=2024-09-14T14:39:16.482353+0000, chain.objs.size()=1 2024-09-14T12:44:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.762__shadow_.Fz3qGkp6V_ba2Xw7il0SDHkDIrF8vxi_0 2024-09-14T12:44:02.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:02.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.037+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T12:44:02.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:02.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45381' 2024-09-14T12:44:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10264106209199152780', time=2024-09-14T13:44:58.820953+0000, chain.objs.size()=1 2024-09-14T12:44:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.179__shadow_.lJSPYK0-OJJvU643dEFK_ZRyO3KmcaK_0 2024-09-14T12:44:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14741891378157971418', time=2024-09-14T13:46:05.993862+0000, chain.objs.size()=1 2024-09-14T12:44:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.200__shadow_.urWBzr9XViKqGQmI_aLXm7U4K5cX5K5_0 2024-09-14T12:44:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15088846941592048038', time=2024-09-14T13:51:08.682369+0000, chain.objs.size()=1 2024-09-14T12:44:02.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.257__shadow_.5zV5tVB7II2CrE5RQ4X63bk-3I6COsS_0 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11781875454829788622', time=2024-09-14T13:51:13.484935+0000, chain.objs.size()=1 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.259__shadow_.Fix6nNUvCaLS__BjNEFNliQpGVpx7aM_0 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.848777733348144831', time=2024-09-14T13:51:20.872762+0000, chain.objs.size()=1 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.262__shadow_.QLU1TuS1F7M5kAkO1YqWYHK2fT4doHu_0 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8070525872469563959', time=2024-09-14T13:53:05.384684+0000, chain.objs.size()=1 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VeaWdXJFlSEq2OVmRUIIlp1reHGdmk2_0 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12367916551596901986', time=2024-09-14T13:53:05.850769+0000, chain.objs.size()=1 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.IX2KKkqLMH6Ae9iOhCmQ0KTUtgsiJU4_0 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17217143206563907993', time=2024-09-14T13:53:06.184261+0000, chain.objs.size()=1 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oL4onKWQfkeBr9DE_Pe39qQqUCoT9BN_0 2024-09-14T12:44:02.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5157164531778191723', time=2024-09-14T13:53:06.349252+0000, chain.objs.size()=1 2024-09-14T12:44:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gmQ4JHoeybheQotIZsVrEtCJxHXAuui_0 2024-09-14T12:44:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13167338277735705025', time=2024-09-14T13:53:07.185688+0000, chain.objs.size()=1 2024-09-14T12:44:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-OKnfaF-cdDryiqNRoMnC4qxMsSMIf3_0 2024-09-14T12:44:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4580649755611159574', time=2024-09-14T13:53:07.834658+0000, chain.objs.size()=1 2024-09-14T12:44:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0mUpr9aL32FE-LGKHNZRGngHGlqXnhi_0 2024-09-14T12:44:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17293515362183761801', time=2024-09-14T13:53:08.056057+0000, chain.objs.size()=1 2024-09-14T12:44:02.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HJA2dzzuJYBIuPfbGCaoSPEMILJv9As_0 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1421817310464373086', time=2024-09-14T13:53:11.784954+0000, chain.objs.size()=1 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7jtO3CXz9NA9lWjb8SmsVUo_Z2WNCs__0 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6876083833349824996', time=2024-09-14T13:53:11.798544+0000, chain.objs.size()=1 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yRjuqDJUgSAYOW6eGGBbOYREYs2cnDL_0 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17168926504179995315', time=2024-09-14T13:53:11.816693+0000, chain.objs.size()=1 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gg6vTwaf-98INVTkUdWcXPgE92H2JRj_0 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14539805894642101752', time=2024-09-14T13:53:12.342699+0000, chain.objs.size()=1 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UDOfO7kCwJHdb9RlLuOE9RNM-sKUIzf_0 2024-09-14T12:44:02.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12999101442957035043', time=2024-09-14T13:53:14.103980+0000, chain.objs.size()=1 2024-09-14T12:44:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wh-zT7neTcgr5fvRtlNp9YxiiN4O7DG_0 2024-09-14T12:44:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14723055557193545678', time=2024-09-14T13:53:15.525990+0000, chain.objs.size()=1 2024-09-14T12:44:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.v0zRJxmRqiysnPSSkP7qbtjpHudHPsd_0 2024-09-14T12:44:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16305271048755092935', time=2024-09-14T13:53:16.345859+0000, chain.objs.size()=1 2024-09-14T12:44:02.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nmMzv5BPk21eoMwPawYh2iAt3QKAFXH_0 2024-09-14T12:44:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10600930561285500350', time=2024-09-14T13:53:18.721649+0000, chain.objs.size()=1 2024-09-14T12:44:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lglB5OF344BnC26F9PLEXd5f-F_pTFg_0 2024-09-14T12:44:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3160045140800180071', time=2024-09-14T13:53:19.039677+0000, chain.objs.size()=1 2024-09-14T12:44:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TYysb28apXEj9GX5JSgyBxbUetsErRi_0 2024-09-14T12:44:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14168790554328823603', time=2024-09-14T13:53:19.134221+0000, chain.objs.size()=1 2024-09-14T12:44:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ZsECggVo056wpV3w2Q9gvDvMHpKdYXZ_0 2024-09-14T12:44:02.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2956698507578195783', time=2024-09-14T13:53:20.241907+0000, chain.objs.size()=1 2024-09-14T12:44:02.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-JPkpyfppUt6fhlxV3sgCGJ5c_2Biem_0 2024-09-14T12:44:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2817125508112706527', time=2024-09-14T13:53:20.334906+0000, chain.objs.size()=1 2024-09-14T12:44:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.f5hKIlbzk6x2pZMpnA5R5PMXc_ty1zo_0 2024-09-14T12:44:02.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11287269481295862848', time=2024-09-14T13:53:20.572463+0000, chain.objs.size()=1 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3jtluY2bzCInnG3jVf-OFZ41e0zMXky_0 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11724288724781246809', time=2024-09-14T13:53:21.936386+0000, chain.objs.size()=1 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FnUwbR1SU9FA04TdApawabZfmn_4p68_0 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17444180190752166032', time=2024-09-14T13:53:22.075937+0000, chain.objs.size()=1 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7W2yjHEFyzzimlbq1MMgenbKeirFlmg_0 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14861895195991787281', time=2024-09-14T13:53:25.908583+0000, chain.objs.size()=1 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5IFWe51g4W2Sx38hdUa47tGL9Z4gGtf_0 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10409821822323252583', time=2024-09-14T13:53:25.910719+0000, chain.objs.size()=1 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vZU4m4c5fw1hR_ft_qLbyK5mka7YydK_0 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16879188388764046275', time=2024-09-14T13:53:26.278770+0000, chain.objs.size()=1 2024-09-14T12:44:02.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MOW5S3uJd3Ht7-DF60KmTvZxFlT01qE_0 2024-09-14T12:44:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17158594724879941071', time=2024-09-14T13:53:26.773901+0000, chain.objs.size()=1 2024-09-14T12:44:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LeJ8WniZq-FShOQ1aybUVbdfqXiosED_0 2024-09-14T12:44:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8533062210264161068', time=2024-09-14T13:53:27.413231+0000, chain.objs.size()=1 2024-09-14T12:44:02.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ko98PoVK2_OTz5iPAaqCUaci_Y9Musu_0 2024-09-14T12:44:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10475956265605394906', time=2024-09-14T13:53:27.559495+0000, chain.objs.size()=1 2024-09-14T12:44:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gqcLna-pbp2TfmS37oPrPSdm7UF816T_0 2024-09-14T12:44:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484574038984638461', time=2024-09-14T13:53:27.732990+0000, chain.objs.size()=1 2024-09-14T12:44:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.sSvZdNSi8-vbBlHAUam3-PhL87C_ujB_0 2024-09-14T12:44:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9735362121046949740', time=2024-09-14T13:53:27.978146+0000, chain.objs.size()=1 2024-09-14T12:44:02.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jpT0FtMCqcbVg6Z8WFyvx0YAvImLIAX_0 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9107210664271866268', time=2024-09-14T13:53:32.670576+0000, chain.objs.size()=1 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.DeIdoWzwdrKZYoGBci9FBzq83J6JiBa_0 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12234956481274266607', time=2024-09-14T13:53:33.157256+0000, chain.objs.size()=1 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qkIUR1FlwdeqwEUwSHuB_kO6aS_J6uc_0 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3203372620312460135', time=2024-09-14T13:53:33.898932+0000, chain.objs.size()=1 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QKvixpStHSs_BKii4oks6D7ufHyiPgd_0 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8754789321339502888', time=2024-09-14T13:53:34.313531+0000, chain.objs.size()=1 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8CbmRDkFth_LNyz8KlR1an70W7NkhkU_0 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15753961337228953488', time=2024-09-14T13:53:34.315239+0000, chain.objs.size()=1 2024-09-14T12:44:02.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8xM5yLL091pbGt4XMYXkjhfMIjh_Gpy_0 2024-09-14T12:44:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17314284657263657844', time=2024-09-14T13:53:47.202678+0000, chain.objs.size()=1 2024-09-14T12:44:02.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.268__shadow_.WwJKyM2jy1HKEEEFu-q_9xeSPGRQa9l_0 2024-09-14T12:44:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13096390014617819018', time=2024-09-14T13:54:34.112501+0000, chain.objs.size()=1 2024-09-14T12:44:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.287__shadow_.tI3AW_QdZ5rzeIg-NzYYIswd9OpQY7j_0 2024-09-14T12:44:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18134224414486871373', time=2024-09-14T13:54:36.589778+0000, chain.objs.size()=1 2024-09-14T12:44:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.288__shadow_.-R53nW8jUbEZ8WnHhpfnD5WXs_C1ir2_0 2024-09-14T12:44:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4134754622167931743', time=2024-09-14T13:54:59.046316+0000, chain.objs.size()=1 2024-09-14T12:44:02.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.Gsjd6XqwcEuAnxg27uvyIQkIuHeK4sX_0 2024-09-14T12:44:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15311979645401473713', time=2024-09-14T13:54:59.048284+0000, chain.objs.size()=1 2024-09-14T12:44:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_._NN-JVRtenokanuayjVRtp9eBQ2DJeR_0 2024-09-14T12:44:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15505217807158025768', time=2024-09-14T13:55:14.321328+0000, chain.objs.size()=1 2024-09-14T12:44:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.300__shadow_.HI8C2aIDhksmWPLa2elGVJJMFUrUSNF_0 2024-09-14T12:44:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263968245270914621', time=2024-09-14T13:55:16.931322+0000, chain.objs.size()=1 2024-09-14T12:44:02.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.301__shadow_.BQAZ5Y99FA16Z5pE7yQEcBD8qBonwWW_0 2024-09-14T12:44:02.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17491162101850541016', time=2024-09-14T13:56:11.713570+0000, chain.objs.size()=1 2024-09-14T12:44:02.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.320__shadow:aeYcAo1Be0PufbtDd6rocAL089toc9k_.D5HHgAM9oW9cSdRohZfT07sdNOsDC-z_0 2024-09-14T12:44:02.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16151184895479766028', time=2024-09-14T13:58:06.791983+0000, chain.objs.size()=1 2024-09-14T12:44:02.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nvxxNz7BBuZc7K3_GMVdxu-ZeeEw_yJ_0 2024-09-14T12:44:02.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4177848178750850617', time=2024-09-14T13:58:07.192183+0000, chain.objs.size()=1 2024-09-14T12:44:02.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.01Rj4yRZwm0yxpcP7RQ91N76Bc8cJrr_0 2024-09-14T12:44:02.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12791580135426680708', time=2024-09-14T13:58:08.305953+0000, chain.objs.size()=1 2024-09-14T12:44:02.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.g7t3ZVP9Sw9IMctCxdtWJAgL0VHuGgt_0 2024-09-14T12:44:02.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16561851944007227860', time=2024-09-14T13:58:08.424255+0000, chain.objs.size()=1 2024-09-14T12:44:02.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Av8gw_x9QYI2tRTYlu_d53fxgqJWWnd_0 2024-09-14T12:44:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7842606005747517689', time=2024-09-14T13:58:09.960688+0000, chain.objs.size()=1 2024-09-14T12:44:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0Su-JWtYaDXKe8bqGA1VJG35y1Wf40d_0 2024-09-14T12:44:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17765251158124474002', time=2024-09-14T13:58:10.797431+0000, chain.objs.size()=1 2024-09-14T12:44:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KwPDPgyZOS8_xljzJUh2tHONJAeZFqq_0 2024-09-14T12:44:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7139189782026277038', time=2024-09-14T13:58:13.923210+0000, chain.objs.size()=1 2024-09-14T12:44:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VROjHFxsOtHu4WuoRg7fGUml4KK2nHw_0 2024-09-14T12:44:02.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5050030903205057754', time=2024-09-14T13:58:14.605746+0000, chain.objs.size()=1 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3EtWYmDW_ycswpXaKgncKRWsw57TCik_0 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17008391789299003504', time=2024-09-14T13:58:15.230424+0000, chain.objs.size()=1 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-q9vMF_bXSLJBVS_jkBmNrJ-AD-D2Hs_0 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5743219424088215159', time=2024-09-14T13:58:15.577911+0000, chain.objs.size()=1 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.glbloNAMCVmt9rNvGMtKJS4HZz-3ED9_0 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2272833224619780743', time=2024-09-14T13:58:15.885858+0000, chain.objs.size()=1 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0DtX3EwyYwzXYTNzrcobVYjI6m91ttq_0 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17381341851425515149', time=2024-09-14T13:58:16.346103+0000, chain.objs.size()=1 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hu3GdUIwyKAkIifHR4cJtHhBM_AU6pl_0 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1874900954711903278', time=2024-09-14T13:58:17.441161+0000, chain.objs.size()=1 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.y_SKx-6cerkM3NlztJK2L0JVJuwzB-y_0 2024-09-14T12:44:02.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5477251873075460326', time=2024-09-14T13:58:19.687816+0000, chain.objs.size()=1 2024-09-14T12:44:02.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fx9LSFaGi8yNoxmC8MHqVAxTsutMYXP_0 2024-09-14T12:44:02.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15987609395119657206', time=2024-09-14T13:58:20.088588+0000, chain.objs.size()=1 2024-09-14T12:44:02.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.D3BKwCjpA0tmhGbi39OALjC3NiuIpOn_0 2024-09-14T12:44:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6397659694492834111', time=2024-09-14T13:58:21.889856+0000, chain.objs.size()=1 2024-09-14T12:44:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QgRVfv0nz3UxGgvs2meBf58oPrmAswj_0 2024-09-14T12:44:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2618297299596637608', time=2024-09-14T13:58:22.404790+0000, chain.objs.size()=1 2024-09-14T12:44:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ylYdocZevtdEoK4vQWVf1lhvkO9pBHh_0 2024-09-14T12:44:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6546104662580340059', time=2024-09-14T13:58:23.697383+0000, chain.objs.size()=1 2024-09-14T12:44:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7MTcdsmJ3euHlV7L5myajSL5-uPmx6s_0 2024-09-14T12:44:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1741861222859980670', time=2024-09-14T13:58:24.865228+0000, chain.objs.size()=1 2024-09-14T12:44:02.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.acHa2f7dQZGj2xwf0o16POUSvvtONk3_0 2024-09-14T12:44:02.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7959222435824069635', time=2024-09-14T13:58:26.434304+0000, chain.objs.size()=1 2024-09-14T12:44:02.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oBWLfrOIZMWDwnMX8qQu_b_7MuAWZ_I_0 2024-09-14T12:44:02.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8935196689731200140', time=2024-09-14T13:58:27.443154+0000, chain.objs.size()=1 2024-09-14T12:44:02.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.No4pULx8q6I-eqQfdshVM0N0Pe5KH1y_0 2024-09-14T12:44:02.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15243489535857269034', time=2024-09-14T13:58:29.285207+0000, chain.objs.size()=1 2024-09-14T12:44:02.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cfKaegLRG7CeByIH3Q4xjcRUiYkm1g2_0 2024-09-14T12:44:02.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2832813587337970397', time=2024-09-14T13:58:29.722230+0000, chain.objs.size()=1 2024-09-14T12:44:02.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wt2dz05LvRjbZ-eJbHPkuzHL_O1ntpm_0 2024-09-14T12:44:02.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3292987464179071858', time=2024-09-14T13:58:30.587588+0000, chain.objs.size()=1 2024-09-14T12:44:02.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NjjE3ExvgyRqGcCzqtstgW2p0vsbjF9_0 2024-09-14T12:44:02.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6302491251244410646', time=2024-09-14T13:58:30.705367+0000, chain.objs.size()=1 2024-09-14T12:44:02.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tKs_if4CTux664aOOa6bpS1v3MbLzen_0 2024-09-14T12:44:02.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16598973563825039268', time=2024-09-14T13:58:30.809304+0000, chain.objs.size()=1 2024-09-14T12:44:02.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.I7VW7DviOSRHcm2aN0pe9DmWGmq62yk_0 2024-09-14T12:44:02.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8690939219386860626', time=2024-09-14T13:58:32.216361+0000, chain.objs.size()=1 2024-09-14T12:44:02.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cU61uJJ1nZno8mlh_BAphY-zOCpogT1_0 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3247460707977735516', time=2024-09-14T13:58:32.554946+0000, chain.objs.size()=1 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IulX9s4bA2JntFpgqEPhbX2XNig4yFn_0 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14114232673951881027', time=2024-09-14T13:58:33.166959+0000, chain.objs.size()=1 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Yn66TSEfw3D-cXZWeG-g40oHhJZAhrv_0 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10385801499322373570', time=2024-09-14T13:58:33.270588+0000, chain.objs.size()=1 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mjPZe9tVz9oho8BkVBAaJNI4sveoLtB_0 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14140250490204251532', time=2024-09-14T13:58:33.272316+0000, chain.objs.size()=1 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.uVVv58v7fIIdx99AiZvtwI7DENYxO13_0 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8143280619411115761', time=2024-09-14T14:00:21.109287+0000, chain.objs.size()=1 2024-09-14T12:44:02.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vgu0SmbK3MM1TQO760u3V8t5dRPMUk7_0 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9413691159228043582', time=2024-09-14T14:00:21.426233+0000, chain.objs.size()=1 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BtdwHu2C_BfTKMjHgIQhI6pbe316e9Y_0 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10410307254063184580', time=2024-09-14T14:00:22.393197+0000, chain.objs.size()=1 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fDh1bzzs-39BN0jqpP_mADzoJzudNur_0 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.952064290954531162', time=2024-09-14T14:00:22.649174+0000, chain.objs.size()=1 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gEjqdDxitj4B3f77VoWkQAPxgtyLXao_0 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14402360123225470624', time=2024-09-14T14:00:22.892498+0000, chain.objs.size()=1 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rooIHTrLitWmmyGPpILLnLyXNyA1Nb-_0 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1570375080308190571', time=2024-09-14T14:00:23.527312+0000, chain.objs.size()=1 2024-09-14T12:44:02.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.J0p9Gnqvaoueyz9Suv2JnyBc8ecPI5Q_0 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15561274028666133622', time=2024-09-14T14:00:23.809610+0000, chain.objs.size()=1 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4PjCE5pvnVvZSRgctLkgYSlkbvVO0Xz_0 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13946931846573205590', time=2024-09-14T14:00:23.950745+0000, chain.objs.size()=1 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ai7GdEX8CXXbIAerDigxDftulU3wUoF_0 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.409802978097641881', time=2024-09-14T14:00:27.615865+0000, chain.objs.size()=1 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Bk7tqdB0UnDNSTRELiGeVKpS0golhw9_0 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5877630019296912512', time=2024-09-14T14:00:27.977792+0000, chain.objs.size()=1 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.82gxennMkGTHtL54uhg6owO0_nMZrtx_0 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4164486289196448031', time=2024-09-14T14:00:29.014056+0000, chain.objs.size()=1 2024-09-14T12:44:02.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2cAdLTHhWVI1mK1pTPoShfLXJsi8zcw_0 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3556672748347764228', time=2024-09-14T14:00:29.643417+0000, chain.objs.size()=1 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ylLDnEmR97tmXb00xdskkzpdDkXTNJk_0 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8383679785213837994', time=2024-09-14T14:00:30.219486+0000, chain.objs.size()=1 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xz4Wo7OYcjGjKnJb04WBMgbD7ALONoB_0 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.178107477011433824', time=2024-09-14T14:00:30.466312+0000, chain.objs.size()=1 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kRE21LcPnH3iIF8td3oTw-lLh522_WO_0 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14979708683623417258', time=2024-09-14T14:00:30.955292+0000, chain.objs.size()=1 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.P48XxfFW8CS0NctAwUBWgdr8gQTmMOZ_0 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16024795755633642011', time=2024-09-14T14:00:30.956782+0000, chain.objs.size()=1 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dDCKNcg0j6knFDltCGhhJmqYCUbEMxF_0 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4786877827631164627', time=2024-09-14T14:00:31.315680+0000, chain.objs.size()=1 2024-09-14T12:44:02.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yfvA1XJb7MveoTh6omq1qahsqTtJs4b_0 2024-09-14T12:44:02.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11790900432859098370', time=2024-09-14T14:00:35.336348+0000, chain.objs.size()=1 2024-09-14T12:44:02.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SFActOLdEvdNjvelDZbi4VOSCx7uI1i_0 2024-09-14T12:44:02.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15770710938813188394', time=2024-09-14T14:00:36.610037+0000, chain.objs.size()=1 2024-09-14T12:44:02.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xwWvdwRLQTA50_wclmrsxYMzFqv_Ln1_0 2024-09-14T12:44:02.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4837769259009460489', time=2024-09-14T14:00:37.777780+0000, chain.objs.size()=1 2024-09-14T12:44:02.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yePxXeB7brh6twbsDSjFw8pAlU6PBYZ_0 2024-09-14T12:44:02.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1008151674841712499', time=2024-09-14T14:00:38.123022+0000, chain.objs.size()=1 2024-09-14T12:44:02.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rCVwNHAmiVXwpt8sy9X4-_DMJfCHmbD_0 2024-09-14T12:44:02.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45381 2024-09-14T12:44:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T12:44:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15405835151970375267', time=2024-09-14T14:00:38.758477+0000, chain.objs.size()=1 2024-09-14T12:44:02.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3AL952gI-LUOq29OKHPCfhB3cFeb0GC_0 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.687298019482744958', time=2024-09-14T14:00:38.895693+0000, chain.objs.size()=1 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Rg1EonjmZuI5z7htmZZson3SnRRSKsY_0 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15147801831294277463', time=2024-09-14T14:00:39.307568+0000, chain.objs.size()=1 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IkoUR7-DKS96DnEcPhNb83bhFblWq9j_0 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3017732190604049568', time=2024-09-14T14:00:43.110555+0000, chain.objs.size()=1 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.L4C4UqTUi9R6mkEj-7nhW0IbBRLfozK_0 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7100709080039192849', time=2024-09-14T14:00:45.935752+0000, chain.objs.size()=1 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qMdWwmRral89y_0FGRynh7cDeY_8HWh_0 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6562996196764531447', time=2024-09-14T14:00:46.201338+0000, chain.objs.size()=1 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qcTWm7PVFBLi2BdIhg-KqExMngPM82G_0 2024-09-14T12:44:02.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5094159814853944665', time=2024-09-14T14:00:48.067433+0000, chain.objs.size()=1 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.sgYAklgRZho7gEH9-jccUoD9HhN12DD_0 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16422846116591429946', time=2024-09-14T14:00:48.231618+0000, chain.objs.size()=1 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.md1bFwuT6B960yYc8uj_guVr-5eSLYt_0 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7068695178379120893', time=2024-09-14T14:00:48.500588+0000, chain.objs.size()=1 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._Js3VsBrRE5CsqcW4_KcVWz3dGnjh4Y_0 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6699522913149727206', time=2024-09-14T14:00:49.924528+0000, chain.objs.size()=1 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8_KlOvEh128fPtFyJnwE8CZL1NEqs-d_0 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14166548658345777087', time=2024-09-14T14:01:12.242331+0000, chain.objs.size()=1 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.335__shadow_.j9eitS4XS1qi4KN9Az6FAG8dRIIEuwt_0 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16004109974698845879', time=2024-09-14T14:01:22.650142+0000, chain.objs.size()=1 2024-09-14T12:44:02.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.340__shadow_.57IrTIkn5wGTP0tAlnQzDEfTvdVGo1s_0 2024-09-14T12:44:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9385468349640410913', time=2024-09-14T14:06:11.862677+0000, chain.objs.size()=1 2024-09-14T12:44:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.465__shadow_.NE0QXi0VvQTAYcEyEqfmrI9_c_88aBl_0 2024-09-14T12:44:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2512278228053661963', time=2024-09-14T14:06:51.433461+0000, chain.objs.size()=1 2024-09-14T12:44:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.486__shadow_.d9zgEKqADAMRVpKFQuaC84jagV2Y3wH_0 2024-09-14T12:44:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8347648752026145330', time=2024-09-14T14:07:29.952919+0000, chain.objs.size()=1 2024-09-14T12:44:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.501__shadow_.v_BEG5B-1rvvCYIoVgavvDjCH9XmXky_0 2024-09-14T12:44:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3394488521188718657', time=2024-09-14T14:14:46.614890+0000, chain.objs.size()=3 2024-09-14T12:44:02.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~aip5jEhzIYtyGn5qKj3y5m4LhQcoJ4q.1 2024-09-14T12:44:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__shadow_mymultipart.2~aip5jEhzIYtyGn5qKj3y5m4LhQcoJ4q.1_1 2024-09-14T12:44:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~aip5jEhzIYtyGn5qKj3y5m4LhQcoJ4q.2 2024-09-14T12:44:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10859789284498261387', time=2024-09-14T14:18:42.996491+0000, chain.objs.size()=1 2024-09-14T12:44:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.560__shadow_.x5x9qqh78C2uQ2UQ5Vj2Dvd9NTlTXOJ_0 2024-09-14T12:44:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16213145463323706820', time=2024-09-14T14:19:46.669519+0000, chain.objs.size()=1 2024-09-14T12:44:02.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.571__shadow:.IT5cWAyar8xUZO39OQMuSigou8kLUB_.9zhtRek_L9-_RqzOf2ISsRzUU2ldz9X_0 2024-09-14T12:44:02.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6546370609036456385', time=2024-09-14T14:20:34.531135+0000, chain.objs.size()=1 2024-09-14T12:44:02.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:DHHgjvd24oYKNEWVhFOiewb7P4pIXF9_.Rx2tLYpL0jhCGYq6rlIoIncTTwjzhzb_0 2024-09-14T12:44:02.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2747723990786196418', time=2024-09-14T14:20:40.445407+0000, chain.objs.size()=1 2024-09-14T12:44:02.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:jDqsQnV5TEkShdzgICPE.T.0SvqaGeR_.9Fd4caTOMbqwmgr2GxdTKuPhWTR5MVu_0 2024-09-14T12:44:02.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7721307797048092023', time=2024-09-14T14:22:10.449200+0000, chain.objs.size()=1 2024-09-14T12:44:02.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:toOVzxnChYgELFbfxMTAil6dAlvan0y_.WcSHj0qvqLuOiL-pUsS201ObBavVPXK_0 2024-09-14T12:44:02.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.217470595524707943', time=2024-09-14T14:22:15.779165+0000, chain.objs.size()=1 2024-09-14T12:44:02.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:XuCf79op1d7ztspnFm-wKHQcryzZh-N_.53Om-h89BFBLC9ZUzdyGNRZ5snHKOsE_0 2024-09-14T12:44:02.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1944517619371313998', time=2024-09-14T14:22:16.635874+0000, chain.objs.size()=1 2024-09-14T12:44:02.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:oyGf-ISpU1S27FbBH8c8mY5OhK2luOv_.8c2cs3P3W1-2iU8fGMX5glYz9K8CNBm_0 2024-09-14T12:44:02.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15694653754937309255', time=2024-09-14T14:22:37.344938+0000, chain.objs.size()=1 2024-09-14T12:44:02.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:o.VqRiRaEQNYGg9MJmRBYeBo2BPArhm_.7GvsI2S0iYDg3ufVPUSUvxHHs3jTHES_0 2024-09-14T12:44:02.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9027776381313410341', time=2024-09-14T14:33:34.429919+0000, chain.objs.size()=1 2024-09-14T12:44:02.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.692__shadow_.LiC7OZMwIlZKI15pyXIpChBNb8BFVh3_0 2024-09-14T12:44:02.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13401366473271629697', time=2024-09-14T14:33:59.514807+0000, chain.objs.size()=1 2024-09-14T12:44:02.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.703__multipart_file1.2~CAtiUBI1ow_ynu6PzjQGUtiVtvSBYV2.1 2024-09-14T12:44:02.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12397480954110101398', time=2024-09-14T14:38:54.547359+0000, chain.objs.size()=1 2024-09-14T12:44:02.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.761__shadow_.6IaaY9t72rGfcACtqObWSDcF4exR_3__0 2024-09-14T12:44:02.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:02.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T12:44:02.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:02.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:02.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51849' 2024-09-14T12:44:02.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11491773980189674723', time=2024-09-14T13:43:04.692950+0000, chain.objs.size()=5 2024-09-14T12:44:02.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-LUKEWARM.2~mlIoMd0hbFdMD8FKZ1r9nSOzx8dIS2r.1 2024-09-14T12:44:02.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__shadow_mymultipart-LUKEWARM.2~mlIoMd0hbFdMD8FKZ1r9nSOzx8dIS2r.1_1 2024-09-14T12:44:02.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-LUKEWARM.2~mlIoMd0hbFdMD8FKZ1r9nSOzx8dIS2r.2 2024-09-14T12:44:02.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__shadow_mymultipart-LUKEWARM.2~mlIoMd0hbFdMD8FKZ1r9nSOzx8dIS2r.2_1 2024-09-14T12:44:02.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-LUKEWARM.2~mlIoMd0hbFdMD8FKZ1r9nSOzx8dIS2r.3 2024-09-14T12:44:02.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_V86JBHHe7egMDJqlqONIw6pERig3HKR', time=2024-09-14T13:44:07.007697+0000, chain.objs.size()=1 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.-ph_Z2oJ_MB3I6sUssylx5SeO_nbb7Y_0 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6812401348102557096', time=2024-09-14T13:50:04.835888+0000, chain.objs.size()=1 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.234__shadow_.022V1rkA7sPprLRJ7Bkk56tJU1BVArd_0 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17785190117859183077', time=2024-09-14T13:50:12.804692+0000, chain.objs.size()=1 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.237__shadow_.YBkTiAQDdRxV2E1grBZFPMK9lEH7LKe_0 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10181350769544920715', time=2024-09-14T13:51:03.624807+0000, chain.objs.size()=1 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.255__shadow_.OmuYDdx_ToW4zmu-WhXfPY6Hz8zbcyq_0 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18052054615386192838', time=2024-09-14T13:53:06.184938+0000, chain.objs.size()=1 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.NX1Ak0IxV-HkTvoClq5sqD-NrBBDKMK_0 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15846793276361873522', time=2024-09-14T13:53:07.750009+0000, chain.objs.size()=1 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5ElDkuNbq0TeNFeGcJzd2ICvIAbMzKY_0 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12522706271118174818', time=2024-09-14T13:53:08.152730+0000, chain.objs.size()=1 2024-09-14T12:44:02.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WmjjWF2npkLAoMfPUvnqju-tjDDow0s_0 2024-09-14T12:44:02.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3288930582418049314', time=2024-09-14T13:53:08.298226+0000, chain.objs.size()=1 2024-09-14T12:44:02.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.876cidRQ4fmrjCxWhduj9VqrISP7DSC_0 2024-09-14T12:44:02.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15847601846789986141', time=2024-09-14T13:53:09.789082+0000, chain.objs.size()=1 2024-09-14T12:44:02.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VG5o2S6bADOSBcL8f_9uORfSbYe9KQc_0 2024-09-14T12:44:02.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7645216085659929550', time=2024-09-14T13:53:10.198277+0000, chain.objs.size()=1 2024-09-14T12:44:02.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.B9p4z1pj9jxrfs3B5D3j30CnZP_w56m_0 2024-09-14T12:44:02.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9276515154670834667', time=2024-09-14T13:53:13.578165+0000, chain.objs.size()=1 2024-09-14T12:44:02.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3ErNxX3oaAByFUmT2dwA31gthm0YMr8_0 2024-09-14T12:44:02.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14158206308432996514', time=2024-09-14T13:53:14.114164+0000, chain.objs.size()=1 2024-09-14T12:44:02.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8kPuAXrRsQ6x4zjvPBx0pmyp7cDdplL_0 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2749421564124405124', time=2024-09-14T13:53:16.601737+0000, chain.objs.size()=1 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TIw3_y_rT39HEQ1vqIMIbErOJrJTPcy_0 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14858792616187118389', time=2024-09-14T13:53:18.241651+0000, chain.objs.size()=1 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.q9q79SSPZhQSkQ1yHM69vfHIoTL5Nai_0 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3340537079907233722', time=2024-09-14T13:53:18.462662+0000, chain.objs.size()=1 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.97LUkUGfzxmm0V1VLroYCwn8wkSWlIV_0 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.410503252225410163', time=2024-09-14T13:53:19.095678+0000, chain.objs.size()=1 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.mHmY_qe-kgov1hrm-hkfBMCwurKvXcP_0 2024-09-14T12:44:02.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5323848833251781778', time=2024-09-14T13:53:22.078632+0000, chain.objs.size()=1 2024-09-14T12:44:02.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qGOsLeHD2A-rwPSrvQPDg4aIa2Ui-1K_0 2024-09-14T12:44:02.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6615297045575234763', time=2024-09-14T13:53:23.260725+0000, chain.objs.size()=1 2024-09-14T12:44:02.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bVRCpek30_K1Poy3Lx4jvLGtD6HQfBh_0 2024-09-14T12:44:02.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17585825725724959606', time=2024-09-14T13:53:25.248081+0000, chain.objs.size()=1 2024-09-14T12:44:02.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.42j7xasDIhnTlvpACUO--jEN_DwafHq_0 2024-09-14T12:44:02.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7465450345306112797', time=2024-09-14T13:53:26.778081+0000, chain.objs.size()=1 2024-09-14T12:44:02.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kNYGoywkhH9bcDBMeAhAGkBElSc4KQ5_0 2024-09-14T12:44:02.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10447489905843887054', time=2024-09-14T13:53:27.824255+0000, chain.objs.size()=1 2024-09-14T12:44:02.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KJQ6qdtfAi_46za-WQYvLTWP-OFVbLz_0 2024-09-14T12:44:02.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10972598209156411767', time=2024-09-14T13:53:29.242493+0000, chain.objs.size()=1 2024-09-14T12:44:02.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0U_cqj4I855ITymUFaGUbakNNQWLzAN_0 2024-09-14T12:44:02.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8875088570810637961', time=2024-09-14T13:53:29.981433+0000, chain.objs.size()=1 2024-09-14T12:44:02.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.giZPk8p_w4RiDRLVl2TTIrZgtYDm_Ck_0 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15493551717106440904', time=2024-09-14T13:53:31.840117+0000, chain.objs.size()=1 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aUVRTAo7Hog9eda3BOC9HkVUWIuKzav_0 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17406129972410906123', time=2024-09-14T13:53:33.759159+0000, chain.objs.size()=1 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WUJM8UwbNLpgmTxUSL8m__Oqu1iyXqy_0 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7285776427776665418', time=2024-09-14T13:53:34.563622+0000, chain.objs.size()=1 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PjhCaImT6tl22q3mUxnFSGrpOj9qOsL_0 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5587088805284005097', time=2024-09-14T13:53:34.718033+0000, chain.objs.size()=1 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XEhiQsdOiaKgHKhBjakMN4M0uQsqoFF_0 2024-09-14T12:44:02.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16660019382375969762', time=2024-09-14T13:54:11.329724+0000, chain.objs.size()=1 2024-09-14T12:44:02.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.278__shadow_.aBVoPXyuJ73s-mcoFMUxtl29BzY-6fD_0 2024-09-14T12:44:02.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7177063789365349679', time=2024-09-14T13:54:13.736797+0000, chain.objs.size()=1 2024-09-14T12:44:02.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.279__shadow_.n6A7DWXhvKue1IbJ47bPsRNiLkObake_0 2024-09-14T12:44:02.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4941452917367146021', time=2024-09-14T13:54:28.874841+0000, chain.objs.size()=1 2024-09-14T12:44:02.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.285__shadow_.dd9QCI3smXSLosBqHXYrYf-vcq_TRYH_0 2024-09-14T12:44:02.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9530167080497456191', time=2024-09-14T13:54:58.847537+0000, chain.objs.size()=1 2024-09-14T12:44:02.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.nbA4DdL-U4Cb8epYQ4KbyIRS9oErbsH_0 2024-09-14T12:44:02.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15657664071104828808', time=2024-09-14T13:54:59.037469+0000, chain.objs.size()=1 2024-09-14T12:44:02.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.NE9zMfM4Wjs-xcep-nGBpzxwbb5bACc_0 2024-09-14T12:44:02.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5054684923237075996', time=2024-09-14T13:55:26.994220+0000, chain.objs.size()=1 2024-09-14T12:44:02.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.305__shadow_.gjvhP7W1OnaCgOVil6O42n1ly8XGa3f_0 2024-09-14T12:44:02.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5132204350908989130', time=2024-09-14T13:58:06.098772+0000, chain.objs.size()=1 2024-09-14T12:44:02.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XxjvlD9PENTEwnNwr4QZ_7DlhWh_BMO_0 2024-09-14T12:44:02.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2519259844369321398', time=2024-09-14T13:58:06.361351+0000, chain.objs.size()=1 2024-09-14T12:44:02.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1UyYjRtPgXO34AZUXuf1s0sIM20LFXg_0 2024-09-14T12:44:02.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13868415343030899144', time=2024-09-14T13:58:06.410241+0000, chain.objs.size()=1 2024-09-14T12:44:02.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.z5PijGHbPDJ9DcR-9gum3A4LPA0gugq_0 2024-09-14T12:44:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9878336168520067640', time=2024-09-14T13:58:06.688692+0000, chain.objs.size()=1 2024-09-14T12:44:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.SNvlIahJRHEIpYZey-SMXZn535KhThQ_0 2024-09-14T12:44:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11536540102468010312', time=2024-09-14T13:58:06.893157+0000, chain.objs.size()=1 2024-09-14T12:44:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jhKpCvoHn1ev7-Pp7ctnK-v-jWQuLAt_0 2024-09-14T12:44:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2511647464220573191', time=2024-09-14T13:58:11.261263+0000, chain.objs.size()=1 2024-09-14T12:44:02.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.AnHHShvQBbcEICojVk8T8FIbLt8SBlH_0 2024-09-14T12:44:02.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17413459586879990108', time=2024-09-14T13:58:11.397987+0000, chain.objs.size()=1 2024-09-14T12:44:02.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nwvw1TwRokmZw7MNg3rjDia0YyMLYlh_0 2024-09-14T12:44:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17197517416820293520', time=2024-09-14T13:58:11.987965+0000, chain.objs.size()=1 2024-09-14T12:44:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IzN8p1dy6S8dr_VUj2UqNDgEYOyxHc4_0 2024-09-14T12:44:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9732364502474438482', time=2024-09-14T13:58:12.390882+0000, chain.objs.size()=1 2024-09-14T12:44:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pHekECCLC2GHXq3R9NFdMsQrhFcfmrR_0 2024-09-14T12:44:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13837817947702229995', time=2024-09-14T13:58:14.016157+0000, chain.objs.size()=1 2024-09-14T12:44:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.D6eAi2JVl-E6rLAFP-lqnKbJqpSp6yj_0 2024-09-14T12:44:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13406550489972980592', time=2024-09-14T13:58:15.882757+0000, chain.objs.size()=1 2024-09-14T12:44:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IP3hf0iF5O7yE_qUGaVJivWFqSlEcKI_0 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1472852401032989642', time=2024-09-14T13:58:19.491992+0000, chain.objs.size()=1 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VIRjvmF8_qUNrqLwuBVIGOGgEQmLTLu_0 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13331473141833841275', time=2024-09-14T13:58:19.570584+0000, chain.objs.size()=1 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jwFsWnZidRGC-Y9pge6EYEevuFSaYrM_0 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6055302414864035377', time=2024-09-14T13:58:21.305183+0000, chain.objs.size()=1 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WvcPtwEGp_M5COQbHtRWehYOXrKTHCV_0 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8242587429177767208', time=2024-09-14T13:58:21.575687+0000, chain.objs.size()=1 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.p_WDO4CjUMvWKN4KZVJ8XxPBaokJ_d8_0 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17433367113650551816', time=2024-09-14T13:58:22.518329+0000, chain.objs.size()=1 2024-09-14T12:44:02.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NhLjOfQVGPfvzDVrv5ZvsjrGhAMV_PL_0 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6065121635198418522', time=2024-09-14T13:58:22.520665+0000, chain.objs.size()=1 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZUEl95uW9QXN4Z0zNF-lhG01uKkmsVE_0 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9460032956276357432', time=2024-09-14T13:58:22.611350+0000, chain.objs.size()=1 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3WOu9uJbfoctrrHUsqnTqKHKgtyyA4t_0 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6896573229663178378', time=2024-09-14T13:58:23.176805+0000, chain.objs.size()=1 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._6TFDXoTFUxPuPtxrd5ldUtu4WnhJUu_0 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5419540394725603743', time=2024-09-14T13:58:23.277338+0000, chain.objs.size()=1 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Kr4QQe7RRAyGJwaJo7nT2lqfQ6H-IQV_0 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1423621767047628055', time=2024-09-14T13:58:23.563024+0000, chain.objs.size()=1 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XCjvtPfmlhcsVe9zc5Q0u_bZ77BXGpH_0 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.110675833933072368', time=2024-09-14T13:58:25.455669+0000, chain.objs.size()=1 2024-09-14T12:44:02.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xauV-_tgkwD6OJKlv7oPcQ084D2ktWx_0 2024-09-14T12:44:02.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17120480212522618795', time=2024-09-14T13:58:26.143291+0000, chain.objs.size()=1 2024-09-14T12:44:02.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.aCJj26WDYzK4JXA3RJ0CI9fmu3tYj3i_0 2024-09-14T12:44:02.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11837461569161180281', time=2024-09-14T13:58:26.483621+0000, chain.objs.size()=1 2024-09-14T12:44:02.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oz4xNs5JFfj9853ai16VCZt1sSHBICh_0 2024-09-14T12:44:02.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2619149842244025855', time=2024-09-14T13:58:27.676291+0000, chain.objs.size()=1 2024-09-14T12:44:02.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZTDkucRjweTuRJrUphOkNdVu6N058fD_0 2024-09-14T12:44:02.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.374310269586038604', time=2024-09-14T13:58:28.568423+0000, chain.objs.size()=1 2024-09-14T12:44:02.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.RbAgehQfs2Xg9PqhqscWIWLuNEeegw0_0 2024-09-14T12:44:02.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4521726930238210698', time=2024-09-14T13:58:28.879507+0000, chain.objs.size()=1 2024-09-14T12:44:02.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WROdX4dG3C8RVkrOMZM6-964DQ6MXY3_0 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7314340292648758088', time=2024-09-14T13:58:29.016276+0000, chain.objs.size()=1 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.iDQLDaVgZ5puHRHOwNXQxn21d1wh89r_0 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6062282487126852299', time=2024-09-14T13:58:30.384721+0000, chain.objs.size()=1 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Te6EXRPlF0mijbQesptPOMk_ZUSjF7J_0 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13666527820401771117', time=2024-09-14T13:58:30.968696+0000, chain.objs.size()=1 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ki814feM6NabkDHtfX8fm5lQ06eEBmU_0 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7832378807572040898', time=2024-09-14T13:58:31.060608+0000, chain.objs.size()=1 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BizfgEssxPJInSaTFHHxS8Aq-tgGwof_0 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13957472807449902011', time=2024-09-14T13:58:32.214401+0000, chain.objs.size()=1 2024-09-14T12:44:02.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XJGYycICP8yWDu3xRgZH-wtSgzJYA8P_0 2024-09-14T12:44:02.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18308262981587228594', time=2024-09-14T13:58:32.588104+0000, chain.objs.size()=1 2024-09-14T12:44:02.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.iQUYWuBkqNqXZ5Ynvn0TD2_wjSKoEOj_0 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.330284854573983575', time=2024-09-14T13:58:32.841524+0000, chain.objs.size()=1 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LkVYWA7qO6J_-Tqlr4vN2AIMtAZTa3C_0 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13944821671825461541', time=2024-09-14T13:58:33.668086+0000, chain.objs.size()=1 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nXpmUB3vb5fGttHPcezzulYmA3Vbl7D_0 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5586322871329903146', time=2024-09-14T14:00:21.446108+0000, chain.objs.size()=1 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dsjhnfCAHSv2QvmzH-UewNp9gbE8lIH_0 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7919916629802885180', time=2024-09-14T14:00:21.875840+0000, chain.objs.size()=1 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.u6eMq5JtarXlKrR7YlpdtDqnqiaQDj8_0 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14417397088903336288', time=2024-09-14T14:00:22.649493+0000, chain.objs.size()=1 2024-09-14T12:44:02.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bJv9vEqMmefnj4Uni3u_8cJBfbzY1aY_0 2024-09-14T12:44:02.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5073461367961476739', time=2024-09-14T14:00:22.935742+0000, chain.objs.size()=1 2024-09-14T12:44:02.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.S4-N73ceqm00yGE9jBBm6ZkGCcnc7aK_0 2024-09-14T12:44:02.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17275660805043877128', time=2024-09-14T14:00:23.252940+0000, chain.objs.size()=1 2024-09-14T12:44:02.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hySSUa_AT7fJ1eKf4KJYqxCd3cAKbZJ_0 2024-09-14T12:44:02.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17242654633619425674', time=2024-09-14T14:00:23.413111+0000, chain.objs.size()=1 2024-09-14T12:44:02.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qxxE2UJVE4Lp1iyb2LGDpAoHdDCw6oz_0 2024-09-14T12:44:02.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3507750656489987416', time=2024-09-14T14:00:23.700555+0000, chain.objs.size()=1 2024-09-14T12:44:02.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8KxZkM8P3dXCWbUrTH6eMaSQcTZmLHP_0 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11288684011926832089', time=2024-09-14T14:00:24.943370+0000, chain.objs.size()=1 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ZjRrb0iC9-ypHcWWuS1ftmjFohVmyc7_0 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11618975644012245332', time=2024-09-14T14:00:25.357174+0000, chain.objs.size()=1 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Fk1A2WBImF1Dg7YWXfCjN_AlhjDkhB7_0 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6466005277256535084', time=2024-09-14T14:00:26.386541+0000, chain.objs.size()=1 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lOUMsRx8Hkr3t1p2FHo5c2GHA8kl2ZO_0 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6372567118073203615', time=2024-09-14T14:00:27.874397+0000, chain.objs.size()=1 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ef9UApxyY6ybW27wW7V3RvhIP6fRAgm_0 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.852572596431379586', time=2024-09-14T14:00:29.704089+0000, chain.objs.size()=1 2024-09-14T12:44:02.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1IjRPKxkf71Y_UgQ-v8YU2Rmi1-Q54g_0 2024-09-14T12:44:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15783714006811883310', time=2024-09-14T14:00:29.870299+0000, chain.objs.size()=1 2024-09-14T12:44:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lzlKi67r2L6DQAMAqxjjNwpTVaaVmkn_0 2024-09-14T12:44:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13996153907736775607', time=2024-09-14T14:00:30.951578+0000, chain.objs.size()=1 2024-09-14T12:44:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.MiOf_MhP_OwmmkuH_j30RoFWlxPgki6_0 2024-09-14T12:44:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1740896443248900025', time=2024-09-14T14:00:32.874595+0000, chain.objs.size()=1 2024-09-14T12:44:02.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fj_bUKByxY9uEW43n-XaUs7vGuqVP2A_0 2024-09-14T12:44:02.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4656004217208787624', time=2024-09-14T14:00:34.337412+0000, chain.objs.size()=1 2024-09-14T12:44:02.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KCP2UuFqdZr9ZsfKc_C8x1lBU6N4a3W_0 2024-09-14T12:44:02.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1186671336647593784', time=2024-09-14T14:00:34.701049+0000, chain.objs.size()=1 2024-09-14T12:44:02.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bMS_U5L_u1g5EgbyLLfsrUBnIaE2ATb_0 2024-09-14T12:44:02.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6847470286054752171', time=2024-09-14T14:00:34.922347+0000, chain.objs.size()=1 2024-09-14T12:44:02.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Gi_6sVi3AFCqBqFrLwmGy9PSbs-fzik_0 2024-09-14T12:44:02.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2436037495166547655', time=2024-09-14T14:00:35.653213+0000, chain.objs.size()=1 2024-09-14T12:44:02.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lmZIhtPNw0Y09A0uQRgfC2u2bbdnXmm_0 2024-09-14T12:44:02.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10988496002538413352', time=2024-09-14T14:00:36.696671+0000, chain.objs.size()=1 2024-09-14T12:44:02.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AGm7ZSrTObVdV80xiNUUY90wkTPPdwV_0 2024-09-14T12:44:02.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2642656496021516374', time=2024-09-14T14:00:37.805490+0000, chain.objs.size()=1 2024-09-14T12:44:02.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j0IlbFCC6N8pGW_Vh2Rq3pO9ntjle5I_0 2024-09-14T12:44:02.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16404480351263675917', time=2024-09-14T14:00:38.873438+0000, chain.objs.size()=1 2024-09-14T12:44:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AxoykoIzXD7VmN08VMAXW_SrZApitRc_0 2024-09-14T12:44:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2706157307025461380', time=2024-09-14T14:00:39.318540+0000, chain.objs.size()=1 2024-09-14T12:44:02.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.7SZn1rN00kFPHtVAtrAhAyZ6F1k6eaY_0 2024-09-14T12:44:02.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1189208058672848570', time=2024-09-14T14:00:39.519518+0000, chain.objs.size()=1 2024-09-14T12:44:02.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.XPA7UyV_qe-NK4wCs3PzdS01P7k96t__0 2024-09-14T12:44:02.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14099768088012288424', time=2024-09-14T14:00:41.032664+0000, chain.objs.size()=1 2024-09-14T12:44:02.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Lv7n_nTRZRwIU8F8oaRuV1Ynui0TBYP_0 2024-09-14T12:44:02.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11875641097094733938', time=2024-09-14T14:00:41.353640+0000, chain.objs.size()=1 2024-09-14T12:44:02.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.A1V-OlfGq0uHIJoqv81N1HraizlQkIB_0 2024-09-14T12:44:02.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2458506577657619447', time=2024-09-14T14:00:42.718817+0000, chain.objs.size()=1 2024-09-14T12:44:02.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.g_1tEcTi_Piaiky5biBDF0CxJMr9NEQ_0 2024-09-14T12:44:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.312400412817794954', time=2024-09-14T14:00:43.106495+0000, chain.objs.size()=1 2024-09-14T12:44:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KdcY5bc0Otbe_eLgV1wc1FO0VVNa6d0_0 2024-09-14T12:44:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9551131171048459764', time=2024-09-14T14:00:43.296614+0000, chain.objs.size()=1 2024-09-14T12:44:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.A3ny6iv84ZYujAQIN2wdWf9Q-GU9jIC_0 2024-09-14T12:44:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3641872765077813755', time=2024-09-14T14:00:45.092011+0000, chain.objs.size()=1 2024-09-14T12:44:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hD9U2tBZJ5sueLrtqrlybqTQIjOVk4i_0 2024-09-14T12:44:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8880214478297231129', time=2024-09-14T14:00:45.560792+0000, chain.objs.size()=1 2024-09-14T12:44:02.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FETrpHJOiYISjnX7xdPjkp4ZDzN4aqD_0 2024-09-14T12:44:02.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51849 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17699815176479700823', time=2024-09-14T14:00:46.406978+0000, chain.objs.size()=1 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mh-jbihVrWOAd8mLCS6SRBFJ7IIXH2g_0 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18235153854120889120', time=2024-09-14T14:00:46.566544+0000, chain.objs.size()=1 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.im80cYI9W12cZfq1U6WrlfXTY8dBJM__0 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5793448473984252730', time=2024-09-14T14:00:48.320301+0000, chain.objs.size()=1 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.75IHVXiebpAAX4gwnoosGrmsnRtJhrS_0 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7470898955538294628', time=2024-09-14T14:00:48.840774+0000, chain.objs.size()=1 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LIFimmiJfa2M223rsS9_sqh5NLJkOe__0 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5614599563851402038', time=2024-09-14T14:00:49.278205+0000, chain.objs.size()=1 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hIRAs0svQLlSq6VOu45L6PDvVPN3e7S_0 2024-09-14T12:44:02.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17053107327204151872', time=2024-09-14T14:00:49.837607+0000, chain.objs.size()=1 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vUDOOGS4CBZvjMlAqZ-6oUhjsuVZNlJ_0 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5029727536265962756', time=2024-09-14T14:00:49.847205+0000, chain.objs.size()=1 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VX5QdZOsw2b3yZ1QqZDE830Dasua-i8_0 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9702106465904871464', time=2024-09-14T14:01:00.721182+0000, chain.objs.size()=1 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.330__shadow_.4mLAPrWduVpq81Wfhrg9uFCOc356Ack_0 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6004893449527529113', time=2024-09-14T14:01:28.423260+0000, chain.objs.size()=1 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.342__shadow_.0wqHC5372yiAgKBRNe819RXQFe8JxGG_0 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4788266607584201945', time=2024-09-14T14:02:35.901972+0000, chain.objs.size()=1 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.375__shadow_.hCWBUNExf8VfYwdzxhI8gZmMSp3kN_n_0 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7488999517445089069', time=2024-09-14T14:07:00.516584+0000, chain.objs.size()=1 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.487__shadow_.8cfTYF3Ymp91DjSCmGuTl0wr0onk-vN_0 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17880231925153393585', time=2024-09-14T14:07:38.699708+0000, chain.objs.size()=1 2024-09-14T12:44:02.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.504__shadow:CRVCgFwmMB1yqxO5U8RjttqtM84H.gl_.-dyH_j79k-7Z8XYotXT1e1-rBoXsavU_0 2024-09-14T12:44:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2264526830307084749', time=2024-09-14T14:14:08.998938+0000, chain.objs.size()=2 2024-09-14T12:44:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~jFmEp3lN_gWHDc_J3q8e85iN57243wM.1 2024-09-14T12:44:02.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~jFmEp3lN_gWHDc_J3q8e85iN57243wM.2 2024-09-14T12:44:02.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11461778125507913116', time=2024-09-14T14:19:46.828909+0000, chain.objs.size()=1 2024-09-14T12:44:02.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.571__shadow:FwClTst6ccnER2ct2X-uZ-oYDKft-eE_.ijIWsAKh7Mae0mV8Qr4hmrfPwlMEVH4_0 2024-09-14T12:44:02.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5884275942636726281', time=2024-09-14T14:20:01.286382+0000, chain.objs.size()=1 2024-09-14T12:44:02.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow:92W1y5wL6p4c3xRHyLoVFNTEzcqRGHf_.nNt61ywS9fDN0rUu-k_kO9Wwc1d8ND1_0 2024-09-14T12:44:02.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10449845479763413125', time=2024-09-14T14:22:09.781362+0000, chain.objs.size()=1 2024-09-14T12:44:02.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:cNkddQBK0-nYy7TwiU0BIi0fcGDPxXz_.oWRkmFRGecPGuB5sSe-2M4_XKp3mi6A_0 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11238559117950282277', time=2024-09-14T14:22:16.617947+0000, chain.objs.size()=1 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:5i0pXNcrE9LLitUB5t.yPClN.qvtDqZ_.BZFJToQUEU6Ycfj5pGZYO6dUZW1vCf7_0 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4527302595187193821', time=2024-09-14T14:29:54.351384+0000, chain.objs.size()=1 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.628__shadow_.Eq3rdOoNA9ahOSb_ip3cKYxM-ec6G8p_0 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3146759932044452756', time=2024-09-14T14:30:06.541041+0000, chain.objs.size()=1 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.633__shadow_.a19tt5zi2jzM_TeJML3RBGaejzqOvVB_0 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6381120584460517712', time=2024-09-14T14:34:39.363782+0000, chain.objs.size()=1 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.716__shadow:dyCTERrKW56dkotYEaAZqMD3ma4N2hQ_.4vPz5m0tRXcPY61DzXIACnPRiBXUvPZ_0 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8289278523617279673', time=2024-09-14T14:38:35.255740+0000, chain.objs.size()=1 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.758__shadow_.7wjug4nDlBVnDJPwW3XyaGLUjKJ1YHK_0 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6327743371915212677', time=2024-09-14T14:41:03.926492+0000, chain.objs.size()=1 2024-09-14T12:44:02.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.775__shadow_.6zmNf1XtIJJHGFbaS8tPU5EzDxSROc2_0 2024-09-14T12:44:02.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:02.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.201+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T12:44:02.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.201+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:02.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.201+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56936' 2024-09-14T12:44:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11653631093637184363', time=2024-09-14T13:43:04.613070+0000, chain.objs.size()=5 2024-09-14T12:44:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-FROZEN.2~1dQV79m29YSKmSTMIpKXDiyzxvz-SoZ.1 2024-09-14T12:44:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__shadow_mymultipart-FROZEN.2~1dQV79m29YSKmSTMIpKXDiyzxvz-SoZ.1_1 2024-09-14T12:44:02.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-FROZEN.2~1dQV79m29YSKmSTMIpKXDiyzxvz-SoZ.2 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__shadow_mymultipart-FROZEN.2~1dQV79m29YSKmSTMIpKXDiyzxvz-SoZ.2_1 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-FROZEN.2~1dQV79m29YSKmSTMIpKXDiyzxvz-SoZ.3 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16706120667963532618', time=2024-09-14T13:43:04.768384+0000, chain.objs.size()=3 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-STANDARD.2~kUan12dvs2SRUHeiVe4mT_EcmXE7iGy.1 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-STANDARD.2~kUan12dvs2SRUHeiVe4mT_EcmXE7iGy.2 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.160__multipart_mymultipart-STANDARD.2~kUan12dvs2SRUHeiVe4mT_EcmXE7iGy.3 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9843367147321466102', time=2024-09-14T13:43:10.597889+0000, chain.objs.size()=1 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.q0sPCEi2MOIH26I2Q-5If_oDFcEFFsJ_0 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1861290910742637471', time=2024-09-14T13:50:12.804707+0000, chain.objs.size()=1 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.237__shadow_.BfvPfBfT4zftWy5BFKWYoPBMoVS32w7_0 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11143408279910555700', time=2024-09-14T13:50:34.340528+0000, chain.objs.size()=1 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.244__shadow_.ukJXWQzgXj-gThbO3qQ5ktdzQrBapUU_0 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5834622500172142630', time=2024-09-14T13:51:06.117163+0000, chain.objs.size()=1 2024-09-14T12:44:02.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.256__shadow_.6DGE1JCPQsvoZ_TUyfCt-Id5ATssA94_0 2024-09-14T12:44:02.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14822109563206853159', time=2024-09-14T13:51:08.682847+0000, chain.objs.size()=1 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.257__shadow_.mFeqz_N-sXCSnolBC-qe1nKc1vSOqkB_0 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17020131968116216868', time=2024-09-14T13:53:05.527050+0000, chain.objs.size()=1 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4im1j3w_KIUagkdzVf-Msa18MHawFCV_0 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.546452520771263781', time=2024-09-14T13:53:05.652140+0000, chain.objs.size()=1 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eIMrnwW_IFEwSPzJ6P7teKkRm4t3gBR_0 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10718335544938442502', time=2024-09-14T13:53:06.684683+0000, chain.objs.size()=1 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4M2bxn9eomkieamI8QPxqrOPPZhv9IT_0 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5559085532520198971', time=2024-09-14T13:53:07.047858+0000, chain.objs.size()=1 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.V9Em-vXG-LpIntvpsRTi_9ccHTk07_5_0 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14573261855741449956', time=2024-09-14T13:53:07.050862+0000, chain.objs.size()=1 2024-09-14T12:44:02.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Br_KaqO7RxtZFzkACMTvpTUQeY2D8o-_0 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1341275834254795366', time=2024-09-14T13:53:07.198797+0000, chain.objs.size()=1 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.h-KVIq9m3ZUapy4nOeZu3GHQyhli-HO_0 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3739419412605570617', time=2024-09-14T13:53:07.471642+0000, chain.objs.size()=1 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qvy5Cg3HBh_O02LeI0gp2kKYtylw50f_0 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1783802791479811818', time=2024-09-14T13:53:08.346688+0000, chain.objs.size()=1 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.iVZSt8ZGr5ftx4cBs0tm228-n_4NkXk_0 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15778067216647896827', time=2024-09-14T13:53:09.685139+0000, chain.objs.size()=1 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KSph50VD2aDEEqbir1R6h7a-KWNGeO2_0 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11492973687760311756', time=2024-09-14T13:53:10.132760+0000, chain.objs.size()=1 2024-09-14T12:44:02.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.djW6w3NYl7bVlJwEKjpfJt3H4wTUc8t_0 2024-09-14T12:44:02.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2035236334305846723', time=2024-09-14T13:53:11.130737+0000, chain.objs.size()=1 2024-09-14T12:44:02.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oRoiHo0ich7pAVoPSUGRMtho3GvgnyV_0 2024-09-14T12:44:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3370109952162236572', time=2024-09-14T13:53:12.512833+0000, chain.objs.size()=1 2024-09-14T12:44:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.SZgjSAPtYO1EWgIzfuKpU3Lu1QsgLvb_0 2024-09-14T12:44:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15840361072267159119', time=2024-09-14T13:53:15.552441+0000, chain.objs.size()=1 2024-09-14T12:44:02.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yTeKYopLN2LnqTcuCE6Ou9bj6pePc2u_0 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16908380953721292384', time=2024-09-14T13:53:15.647672+0000, chain.objs.size()=1 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qXKBOePaLNg3kfv28sVcJ-8aG9sslrB_0 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17578042462522664830', time=2024-09-14T13:53:15.804064+0000, chain.objs.size()=1 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OZVuqqcSvLXbw-1Ee_poCBm6Y3HY21R_0 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14500347055591119258', time=2024-09-14T13:53:17.623087+0000, chain.objs.size()=1 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RW0j5ojgfjbNUUrNe92ZOebLUOyYi_R_0 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15280788577867523202', time=2024-09-14T13:53:17.729702+0000, chain.objs.size()=1 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4XdfsK4t8hIciAD6Z1jrESIZ1h4LGJr_0 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1610678529139887930', time=2024-09-14T13:53:17.939845+0000, chain.objs.size()=1 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GFNqmIAZo5zoS9M7nmeR630RsZtQPGC_0 2024-09-14T12:44:02.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12276495606161688296', time=2024-09-14T13:53:18.788500+0000, chain.objs.size()=1 2024-09-14T12:44:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XbAIEspR8wTEIHUrP0oKqKu3hFwWkze_0 2024-09-14T12:44:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17036763609648068937', time=2024-09-14T13:53:20.653556+0000, chain.objs.size()=1 2024-09-14T12:44:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MNVmGl_QPvFU1Gt1iBOnQXjd6XcgrGl_0 2024-09-14T12:44:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7740244153246241764', time=2024-09-14T13:53:22.234569+0000, chain.objs.size()=1 2024-09-14T12:44:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._bTJntYpdmT0rQOeWjh6Y5kxz_5PIB6_0 2024-09-14T12:44:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3334220024786809179', time=2024-09-14T13:53:22.770539+0000, chain.objs.size()=1 2024-09-14T12:44:02.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pidRHIq_n3DU9qu4h3dl1EGJA5emgTM_0 2024-09-14T12:44:02.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16653678208677957576', time=2024-09-14T13:53:23.469122+0000, chain.objs.size()=1 2024-09-14T12:44:02.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.e0O0_cGYzQYPJtrvxpnZtQ8az14COmi_0 2024-09-14T12:44:02.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4326636143463242884', time=2024-09-14T13:53:24.096967+0000, chain.objs.size()=1 2024-09-14T12:44:02.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.og423VfhNKREIakfU7naQLYW-o2108B_0 2024-09-14T12:44:02.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1039997281186266945', time=2024-09-14T13:53:24.294113+0000, chain.objs.size()=1 2024-09-14T12:44:02.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-ldcUzMHQSj9nQpOUdoRilG6s1pBVeW_0 2024-09-14T12:44:02.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4088025864865474564', time=2024-09-14T13:53:25.247816+0000, chain.objs.size()=1 2024-09-14T12:44:02.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7n74zI-6si0QyPiKG7Llk8fKL4qrI6A_0 2024-09-14T12:44:02.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18061248498621148748', time=2024-09-14T13:53:25.844917+0000, chain.objs.size()=1 2024-09-14T12:44:02.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nK6oEdRe-0oZmpsYz0ox9ADZxFvYoMj_0 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1677245094610700172', time=2024-09-14T13:53:26.003911+0000, chain.objs.size()=1 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.tHGfDzLYScfbDetiZK6lZ5zO6Op6khS_0 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8313459567699578465', time=2024-09-14T13:53:26.776235+0000, chain.objs.size()=1 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3iqvHrTKGj4JjXauSd1TQ3JaR-8DTra_0 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1795085148970451018', time=2024-09-14T13:53:29.257355+0000, chain.objs.size()=1 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hE0agNWYvJWn23-BEFh8rkg79I5xBPv_0 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16429298636040429729', time=2024-09-14T13:53:29.503187+0000, chain.objs.size()=1 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ljwOFUE-QSY55_70lY-ehlOWba2oEi9_0 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7510285698704052200', time=2024-09-14T13:53:29.723862+0000, chain.objs.size()=1 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.e0aE-WZaeZ-CbSb8pZFHViC2qMbmJ2__0 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10239554199446084603', time=2024-09-14T13:53:32.017107+0000, chain.objs.size()=1 2024-09-14T12:44:02.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Fl49NTs1Rn-3Z-Xp9Fi5HuTh4nAIb0u_0 2024-09-14T12:44:02.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15703035629595910487', time=2024-09-14T13:53:32.605637+0000, chain.objs.size()=1 2024-09-14T12:44:02.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.U3B2s84482O6yhFczje7FrKmzKDpC4-_0 2024-09-14T12:44:02.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8797984274303810610', time=2024-09-14T13:53:33.078244+0000, chain.objs.size()=1 2024-09-14T12:44:02.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KD5uFHJkkJRxkkVyax3glqtMB3U8IWE_0 2024-09-14T12:44:02.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17253831718490341555', time=2024-09-14T13:53:33.920845+0000, chain.objs.size()=1 2024-09-14T12:44:02.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JaH236JxkpbhB3zoyzyvfWtrBQ5adez_0 2024-09-14T12:44:02.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3349664178025584979', time=2024-09-14T13:53:34.087566+0000, chain.objs.size()=1 2024-09-14T12:44:02.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9NzfrPDIQih3dDv7V-pfsuQKN_AtRE5_0 2024-09-14T12:44:02.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16095020412031337891', time=2024-09-14T13:53:44.862104+0000, chain.objs.size()=1 2024-09-14T12:44:02.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.267__shadow_.Y-Jql0vFnAwpuqf-xrSs6j-FXMVfXZ4_0 2024-09-14T12:44:02.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17719705183941583763', time=2024-09-14T13:54:06.292405+0000, chain.objs.size()=1 2024-09-14T12:44:02.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.276__shadow_.ue4RWdipIHmDHyrkRDhVdneBxUu0Cot_0 2024-09-14T12:44:02.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2758495707029085854', time=2024-09-14T13:54:34.103039+0000, chain.objs.size()=1 2024-09-14T12:44:02.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.287__shadow_.mW7LE8nRUN3qKINnhhJr0RJ5duIUUQc_0 2024-09-14T12:44:02.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3170986376433828421', time=2024-09-14T13:54:53.142072+0000, chain.objs.size()=1 2024-09-14T12:44:02.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.HV1q4zmc9sviE4eoQ6aWEytJavC9-K-_0 2024-09-14T12:44:02.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.21034801298436310', time=2024-09-14T13:54:58.843214+0000, chain.objs.size()=1 2024-09-14T12:44:02.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.4hA378FboylH5QdTeExzqO6ijWa6Lfx_0 2024-09-14T12:44:02.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5655211952098284783', time=2024-09-14T13:55:21.939790+0000, chain.objs.size()=1 2024-09-14T12:44:02.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.303__shadow_.LTFwGpj8kbX-AHwcFgQTtkb1Ji83yB3_0 2024-09-14T12:44:02.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6263720132033531390', time=2024-09-14T13:55:26.978423+0000, chain.objs.size()=1 2024-09-14T12:44:02.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.305__shadow_.KBX_Lbw0JqMdSMs-ZgYU68uiUBcRy_C_0 2024-09-14T12:44:02.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1970484518387943873', time=2024-09-14T13:58:06.892073+0000, chain.objs.size()=1 2024-09-14T12:44:02.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.J9kJPUYCMMq7w0RU9y88K6Q-jJRfknm_0 2024-09-14T12:44:02.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5755784073426911960', time=2024-09-14T13:58:07.202296+0000, chain.objs.size()=1 2024-09-14T12:44:02.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.q8CXxDSZx4jA0bc9sXEQOVY0Ypn_Sb6_0 2024-09-14T12:44:02.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16736651593858180511', time=2024-09-14T13:58:07.906141+0000, chain.objs.size()=1 2024-09-14T12:44:02.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.x3CEnNdWF9xDrwNIhvIv5qOcfsPuBKZ_0 2024-09-14T12:44:02.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18064807600514634545', time=2024-09-14T13:58:09.988699+0000, chain.objs.size()=1 2024-09-14T12:44:02.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ao8b4SFIMLSC193LpxJlvb97HXRK_be_0 2024-09-14T12:44:02.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9579352228275722785', time=2024-09-14T13:58:10.586071+0000, chain.objs.size()=1 2024-09-14T12:44:02.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1FCyG7x16hW3RsKTqBtN3w38fP2c83G_0 2024-09-14T12:44:02.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15750799806389349293', time=2024-09-14T13:58:11.257984+0000, chain.objs.size()=1 2024-09-14T12:44:02.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CsZdbpkbti1evzGDauggUfZTRMsUd21_0 2024-09-14T12:44:02.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11932668540715247825', time=2024-09-14T13:58:13.503735+0000, chain.objs.size()=1 2024-09-14T12:44:02.223 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.D1EBq9J3lWLuTQFic27L4bBq07yIGVH_0 2024-09-14T12:44:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11359613218125698174', time=2024-09-14T13:58:14.791006+0000, chain.objs.size()=1 2024-09-14T12:44:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IKzWMHd_29_IQQuZ2WWFBpGJpTM4B0A_0 2024-09-14T12:44:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9658983430583234259', time=2024-09-14T13:58:15.615550+0000, chain.objs.size()=1 2024-09-14T12:44:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9zxJIoqGSTfkSMYaS69x63KlDNLBHMm_0 2024-09-14T12:44:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16589506265127408304', time=2024-09-14T13:58:15.617120+0000, chain.objs.size()=1 2024-09-14T12:44:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-MzF5b91PSWE_zRTD8-NOcobDZeXtpC_0 2024-09-14T12:44:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15161601220378501086', time=2024-09-14T13:58:16.278602+0000, chain.objs.size()=1 2024-09-14T12:44:02.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Rlfk3QX6mJjLI337AuetfrasjaOlsae_0 2024-09-14T12:44:02.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.489336080436959862', time=2024-09-14T13:58:19.572058+0000, chain.objs.size()=1 2024-09-14T12:44:02.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.k4az-IPR9xBAIhD7R15-2_Ki1NUYKkJ_0 2024-09-14T12:44:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12664360247915249135', time=2024-09-14T13:58:19.920495+0000, chain.objs.size()=1 2024-09-14T12:44:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.41Ij8doc1r4pQy7JmdHzYv3-L8hJ1-3_0 2024-09-14T12:44:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1294379423739456124', time=2024-09-14T13:58:20.186079+0000, chain.objs.size()=1 2024-09-14T12:44:02.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nzwTQHAJ68k3-TPAtl52LBsiURiHFvt_0 2024-09-14T12:44:02.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2181450745212697995', time=2024-09-14T13:58:21.304169+0000, chain.objs.size()=1 2024-09-14T12:44:02.227 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NzZe_mXheZoV_x06acG-ADCUakxa9Dv_0 2024-09-14T12:44:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4832081324884294979', time=2024-09-14T13:58:22.092645+0000, chain.objs.size()=1 2024-09-14T12:44:02.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BqEKOXE6ZrtW3t9IGdntHJsmMZzBnOF_0 2024-09-14T12:44:02.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10062862846510972952', time=2024-09-14T13:58:22.988434+0000, chain.objs.size()=1 2024-09-14T12:44:02.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CXGuSASeQ3E2bhXJ2w9C9j4W8D3Olc3_0 2024-09-14T12:44:02.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9211730733253537111', time=2024-09-14T13:58:23.169183+0000, chain.objs.size()=1 2024-09-14T12:44:02.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eySultZ_6ZnLKlCQJ79KXQ5NIIA4nFO_0 2024-09-14T12:44:02.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9350702481984679981', time=2024-09-14T13:58:23.615456+0000, chain.objs.size()=1 2024-09-14T12:44:02.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EIUx_4EGumVtnleXs1qcwTrGKrLXbyo_0 2024-09-14T12:44:02.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10866401135595887858', time=2024-09-14T13:58:23.841734+0000, chain.objs.size()=1 2024-09-14T12:44:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.j5ifgECiVM6zUP1glfDSOC1srm5_rwn_0 2024-09-14T12:44:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14763948939432218920', time=2024-09-14T13:58:24.887817+0000, chain.objs.size()=1 2024-09-14T12:44:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.MmoznpVJbdpIQE22WYsJFt4cF65dIOS_0 2024-09-14T12:44:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12183685784135933709', time=2024-09-14T13:58:25.120374+0000, chain.objs.size()=1 2024-09-14T12:44:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Og5WEPEa_jS3H-lxlxhyqnY7p3A5i8p_0 2024-09-14T12:44:02.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18046117893333513666', time=2024-09-14T13:58:25.887653+0000, chain.objs.size()=1 2024-09-14T12:44:02.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1_l_RYpFbqIQhX1jqiD8Mn_i8ymhSBk_0 2024-09-14T12:44:02.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15901492137996055095', time=2024-09-14T13:58:27.170446+0000, chain.objs.size()=1 2024-09-14T12:44:02.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rhv6s4LKT0uTideIsCnRqvdnG9gSd-g_0 2024-09-14T12:44:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5274140446988108122', time=2024-09-14T13:58:29.016335+0000, chain.objs.size()=1 2024-09-14T12:44:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wJZuaRe-4kZnmFv67DC7Wa9crKVEGDA_0 2024-09-14T12:44:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14242573451472323627', time=2024-09-14T13:58:29.149361+0000, chain.objs.size()=1 2024-09-14T12:44:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.q6jEcGkpUcqbufX3nxxMNNIvg4OysDK_0 2024-09-14T12:44:02.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10493308565339315133', time=2024-09-14T13:58:33.665609+0000, chain.objs.size()=1 2024-09-14T12:44:02.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EDyIfAl4iWKVsng3RKQhetrrHQ4kA51_0 2024-09-14T12:44:02.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9599680959342668166', time=2024-09-14T13:58:34.116851+0000, chain.objs.size()=1 2024-09-14T12:44:02.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cAWbxHcW4lqnT6uORVMAsp9cyqTUDH3_0 2024-09-14T12:44:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5981487962348878971', time=2024-09-14T13:58:34.208763+0000, chain.objs.size()=1 2024-09-14T12:44:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mMoQ0wVRn5Rwz2ee8G_ivjJZr5mbLwh_0 2024-09-14T12:44:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14664995981905226901', time=2024-09-14T14:00:21.782251+0000, chain.objs.size()=1 2024-09-14T12:44:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WQax7jfM-J4Ug7ETycQpUJRVP-ofumT_0 2024-09-14T12:44:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10278834789516949932', time=2024-09-14T14:00:23.945077+0000, chain.objs.size()=1 2024-09-14T12:44:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.EVWGg55XMphq2eBqaX2rwkb9zJWU8W8_0 2024-09-14T12:44:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12817089095004177892', time=2024-09-14T14:00:25.545114+0000, chain.objs.size()=1 2024-09-14T12:44:02.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.PArkeoszIpmQV0NJk1P_iD6-JupzfEb_0 2024-09-14T12:44:02.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4824749895777328209', time=2024-09-14T14:00:25.717752+0000, chain.objs.size()=1 2024-09-14T12:44:02.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ivW6iOSr1L_-KIFDI3f18oDNqPBH9pP_0 2024-09-14T12:44:02.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2165302278397801820', time=2024-09-14T14:00:25.950352+0000, chain.objs.size()=1 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._zyIHW9tmweS18iclV8AT8nttzAGN3X_0 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10964268467218807563', time=2024-09-14T14:00:26.064338+0000, chain.objs.size()=1 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ulKCBN3_yQAe-4vmLnAw87qnorIr01c_0 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3289800144006527586', time=2024-09-14T14:00:26.282172+0000, chain.objs.size()=1 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vo-dk8K1fxeY_hMFub_xoCWWl_pOuRN_0 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.179428859810237384', time=2024-09-14T14:00:26.826987+0000, chain.objs.size()=1 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pa98ICo33Z-uxKNXsdk2Yxc5-JPt4Mh_0 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4855242267596343393', time=2024-09-14T14:00:26.913897+0000, chain.objs.size()=1 2024-09-14T12:44:02.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.F_g7XPlZZJq12mF8QK0jk9H3t9MpsQT_0 2024-09-14T12:44:02.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8764249844673204637', time=2024-09-14T14:00:27.229550+0000, chain.objs.size()=1 2024-09-14T12:44:02.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8FR_AhkjvOb38rUN3v2QMxiVTLMI37s_0 2024-09-14T12:44:02.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2249023768983382706', time=2024-09-14T14:00:29.946028+0000, chain.objs.size()=1 2024-09-14T12:44:02.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3j9I7gbWkxiFpgGm2lw8w9NGp7aj6rH_0 2024-09-14T12:44:02.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3729275889637744518', time=2024-09-14T14:00:30.611036+0000, chain.objs.size()=1 2024-09-14T12:44:02.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mvwdFAg9khN4GWVgSA1jGScpAgGjzHE_0 2024-09-14T12:44:02.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17781544121654850735', time=2024-09-14T14:00:31.842157+0000, chain.objs.size()=1 2024-09-14T12:44:02.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HnwxWGppdI8y1iryoA2WBiGsNQnhWlU_0 2024-09-14T12:44:02.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3296407375830679654', time=2024-09-14T14:00:33.566675+0000, chain.objs.size()=1 2024-09-14T12:44:02.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hDhaBR-51a_6srKPl5mL_bVRjF2gwEA_0 2024-09-14T12:44:02.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11199767932495170189', time=2024-09-14T14:00:34.340021+0000, chain.objs.size()=1 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Z1YsZMR9-IQy3Z81bAk0-pSIjwEh20z_0 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11136886462769421254', time=2024-09-14T14:00:34.924338+0000, chain.objs.size()=1 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NKsYwNAwigDN45cBD49pa5_6uu-KsNA_0 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9626935162473412944', time=2024-09-14T14:00:35.331521+0000, chain.objs.size()=1 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hesw-qVFC4MLpabnfxQJcotrGDFzm67_0 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1292963651853225049', time=2024-09-14T14:00:35.586983+0000, chain.objs.size()=1 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uP0t9DK4hjpMGJsfCKfyAkPJs1Z-CJx_0 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15561971736530843763', time=2024-09-14T14:00:37.305983+0000, chain.objs.size()=1 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.G0pCVavrpMhCE4FhgynHAG05Yr8eiPY_0 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4386037013174565437', time=2024-09-14T14:00:38.457015+0000, chain.objs.size()=1 2024-09-14T12:44:02.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1ptICaxTeb_x1BvcN6OhNAmWF-BXW5R_0 2024-09-14T12:44:02.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/56936 2024-09-14T12:44:02.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T12:44:02.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16827040768405682221', time=2024-09-14T14:00:40.488084+0000, chain.objs.size()=1 2024-09-14T12:44:02.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ztE2ZZHPfcNvOaOxUVMWimEpYW_tpTn_0 2024-09-14T12:44:02.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9525573370868160001', time=2024-09-14T14:00:40.890201+0000, chain.objs.size()=1 2024-09-14T12:44:02.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5yJLGkjn1iaeoD8AUraELfoQI9-U57n_0 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12924440613268290953', time=2024-09-14T14:00:41.274990+0000, chain.objs.size()=1 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.DpwNlgPc23tPZql8lUZdDITBSEro-0N_0 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11618719460093188344', time=2024-09-14T14:00:41.472099+0000, chain.objs.size()=1 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.q6nWOuGvRF6NMyJG2XD-fX8OfNNBK81_0 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14022209019629513363', time=2024-09-14T14:00:42.748669+0000, chain.objs.size()=1 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mxE59kgrLdviQXyAV6ncEpGITlhAEWX_0 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17883352689991881675', time=2024-09-14T14:00:44.827052+0000, chain.objs.size()=1 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JA8iOIiLn7nrWD76wDM08fV6Cs4BmpM_0 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5498270243847930733', time=2024-09-14T14:00:48.173529+0000, chain.objs.size()=1 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yWwXpDkjnMDJpyOwALSEmtzY-b3svx__0 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15697090820056542123', time=2024-09-14T14:00:48.426184+0000, chain.objs.size()=1 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KV2pQou4DGcbYU9OpKm_KUPmHv_rhVf_0 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8252413635331140768', time=2024-09-14T14:00:49.277098+0000, chain.objs.size()=1 2024-09-14T12:44:02.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Dth6lc5XNHU2fd0TbTJZPLhUsYGXrLM_0 2024-09-14T12:44:02.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2835774554520233498', time=2024-09-14T14:00:49.279236+0000, chain.objs.size()=1 2024-09-14T12:44:02.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.y_P_1hmV711lvxhrOX5dZMWBM9EjI-P_0 2024-09-14T12:44:02.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1204990872733096082', time=2024-09-14T14:00:49.380444+0000, chain.objs.size()=1 2024-09-14T12:44:02.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.eUOvF0cxMnK-fy9r2FWSRl0r7WqiIHX_0 2024-09-14T12:44:02.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16811066614202556056', time=2024-09-14T14:00:49.477310+0000, chain.objs.size()=1 2024-09-14T12:44:02.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.GAhf2qHw_s_VGgmjxhf2aRT3YNfsuNw_0 2024-09-14T12:44:02.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7701682829797151049', time=2024-09-14T14:01:03.203969+0000, chain.objs.size()=1 2024-09-14T12:44:02.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.331__shadow_.2BjhYVAozZd7HJPdUYNMXcgw1265Prk_0 2024-09-14T12:44:02.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.679628706949487268', time=2024-09-14T14:01:30.664758+0000, chain.objs.size()=1 2024-09-14T12:44:02.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.343__shadow_.qN4qG9I3Z4iMgKicumilQcTFSsiFgv7_0 2024-09-14T12:44:02.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.121396660857710257', time=2024-09-14T14:02:51.211845+0000, chain.objs.size()=1 2024-09-14T12:44:02.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.382__shadow_.6qvLjA0rhFpxnIsM3L9c2eLUHJb1duN_0 2024-09-14T12:44:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5714805134770191198', time=2024-09-14T14:05:59.022807+0000, chain.objs.size()=1 2024-09-14T12:44:02.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.461__shadow_.m_Jzh5QbUqrdD8fvpLyYuGD9QpntAkM_0 2024-09-14T12:44:02.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18299158062853555921', time=2024-09-14T14:06:02.371102+0000, chain.objs.size()=1 2024-09-14T12:44:02.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.462__shadow_.ZWClfkSNWDr20ur9_9e89chJ2lnrSb6_0 2024-09-14T12:44:02.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7648158056053202219', time=2024-09-14T14:06:10.932231+0000, chain.objs.size()=1 2024-09-14T12:44:02.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.465__shadow_.vf8AdSeZB2EprQVgl3JZbst6uVJX4jd_0 2024-09-14T12:44:02.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2207822289149701654', time=2024-09-14T14:07:09.244046+0000, chain.objs.size()=1 2024-09-14T12:44:02.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.491__shadow_.7H74NyHodwpPggTWkkiGRUShkXyDqJ__0 2024-09-14T12:44:02.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2207822289149701654', time=2024-09-14T14:07:09.758016+0000, chain.objs.size()=1 2024-09-14T12:44:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.491__shadow_.7H74NyHodwpPggTWkkiGRUShkXyDqJ__0 2024-09-14T12:44:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16461021937939184919', time=2024-09-14T14:19:24.760899+0000, chain.objs.size()=1 2024-09-14T12:44:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:hp4wthP.bKJx.-45mhVPcrvOii5vZFX_.T-4tWhdHBFUBvYbnCrVfs-TZ5h0a7EP_0 2024-09-14T12:44:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16730130612094722282', time=2024-09-14T14:19:33.309193+0000, chain.objs.size()=1 2024-09-14T12:44:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:qpiIpn3zaKBvIs2rTHTU-zvsLguZMxQ_.rxK9IFGk57MgF05QGKM7Bs1kiiUtXmB_0 2024-09-14T12:44:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16324131458599722331', time=2024-09-14T14:19:41.765177+0000, chain.objs.size()=1 2024-09-14T12:44:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:BwnXpc6eN8V1Op4eWfVB.tSZbKPcm6D_.9K1YisGmevd29-o5PecTMCTzrOUYIt0_0 2024-09-14T12:44:02.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1896469119960382545', time=2024-09-14T14:31:18.801432+0000, chain.objs.size()=1 2024-09-14T12:44:02.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.652__shadow_.nJMWrITPvoT6PSqQlXUSzAJUi6yMuQn_0 2024-09-14T12:44:02.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10096858122284119376', time=2024-09-14T14:33:43.192217+0000, chain.objs.size()=1 2024-09-14T12:44:02.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.696__shadow_.QmfBFZUn9xB9CLsEdDe-fEolMAAP1_w_0 2024-09-14T12:44:02.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6756993304508728197', time=2024-09-14T14:34:54.634510+0000, chain.objs.size()=1 2024-09-14T12:44:02.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.719__shadow_.vKy0VTYinIVBIRVnIrYT-PZIQKovZ1v_0 2024-09-14T12:44:02.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14994416132536756890', time=2024-09-14T14:37:24.645484+0000, chain.objs.size()=1 2024-09-14T12:44:02.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.749__shadow_.RYbEWMdZvn1rD_OoT8W6j413-4JnMYb_0 2024-09-14T12:44:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17356326877082254261', time=2024-09-14T14:41:11.490232+0000, chain.objs.size()=1 2024-09-14T12:44:02.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.776__shadow_.Bhq4UhVEj4fK9MINJBnZcOSJ2BqgBZi_0 2024-09-14T12:44:02.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:02.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T12:44:02.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:02.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45692' 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11752427081766047994', time=2024-09-14T13:45:01.038722+0000, chain.objs.size()=1 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.180__shadow_.wgHQupScKZg1lgIQZYf7Bsn8Pd74gYe_0 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1500568696868743213', time=2024-09-14T13:49:56.811483+0000, chain.objs.size()=1 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.231__shadow_.6PHaeGRVK3I1yOolHJJ48nUuLKaRfXL_0 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9037393929880252256', time=2024-09-14T13:50:07.666657+0000, chain.objs.size()=1 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.235__shadow_.bXf-lIQtuLRcFuumO-JjTQuuV8kCvYY_0 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12862901320588248783', time=2024-09-14T13:50:27.861557+0000, chain.objs.size()=1 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.242__shadow_._wPcRdOWJUJvAbAS1N5f2PtpGIQhtpN_0 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12944933159964792080', time=2024-09-14T13:50:48.516751+0000, chain.objs.size()=1 2024-09-14T12:44:02.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.249__shadow_.r4WMQR5pFF2AvaktXjmVY_5NZ-0ADjw_0 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10234817414746607741', time=2024-09-14T13:50:48.542866+0000, chain.objs.size()=1 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.249__shadow_.I3VjhmLi7DpiNEgjY-5JpouJdRNr_x9_0 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5182725613339200476', time=2024-09-14T13:53:05.897534+0000, chain.objs.size()=1 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.paYrwEFF08YwOh6UMNIoK33K6goPtPp_0 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11470821544123612775', time=2024-09-14T13:53:07.736117+0000, chain.objs.size()=1 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oSNO4cxGxs-ATKi2e0-WS2LDl6mUPZ0_0 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14125248021973662860', time=2024-09-14T13:53:08.150999+0000, chain.objs.size()=1 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.R_JE6EUf_HhmypminqQK8A2LXkSdd49_0 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4238894912136974089', time=2024-09-14T13:53:11.118418+0000, chain.objs.size()=1 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.SJZqcDREh_y9NVRaeLaL0t9muE-rkTh_0 2024-09-14T12:44:02.274 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10499047431732741250', time=2024-09-14T13:53:11.248853+0000, chain.objs.size()=1 2024-09-14T12:44:02.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GM4T51L-MPV5i8VszjHhHx19SqAAYYL_0 2024-09-14T12:44:02.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17474149154433238367', time=2024-09-14T13:53:11.869189+0000, chain.objs.size()=1 2024-09-14T12:44:02.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jyv3FUzOV9KYwiOgWK0TvUeFLa65Tin_0 2024-09-14T12:44:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15192193674308627882', time=2024-09-14T13:53:12.515750+0000, chain.objs.size()=1 2024-09-14T12:44:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LvKPmyIbrrSfM7XeyybdAE9CbSHHzx1_0 2024-09-14T12:44:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3186845471857666946', time=2024-09-14T13:53:12.600218+0000, chain.objs.size()=1 2024-09-14T12:44:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kytB81yDA0MAZyfxEfgF-c8rrS2i7ig_0 2024-09-14T12:44:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5207104203840670285', time=2024-09-14T13:53:12.628295+0000, chain.objs.size()=1 2024-09-14T12:44:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GcSQuE7W3HCwAXJ8Lrl4BeLpqmFGTfu_0 2024-09-14T12:44:02.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1058493898011623170', time=2024-09-14T13:53:15.681938+0000, chain.objs.size()=1 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BrVCXWF7E8yCToa0wr8SkJZBTl9Agol_0 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2857097412939450222', time=2024-09-14T13:53:17.682697+0000, chain.objs.size()=1 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.SpK1lFOrBYkDu13GNQg2qODKqbl_WR7_0 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5328525569543591854', time=2024-09-14T13:53:17.743639+0000, chain.objs.size()=1 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._uKifbkp4bDra6fbKcY55IHrLyCq-tG_0 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9079241407915235662', time=2024-09-14T13:53:19.150543+0000, chain.objs.size()=1 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0zBZVF427OyLDqvX0R3afuUjx39TAmb_0 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15008252593921300652', time=2024-09-14T13:53:20.558724+0000, chain.objs.size()=1 2024-09-14T12:44:02.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TdStka-dmCIHkg8x8xcB4HYuqhzHGN2_0 2024-09-14T12:44:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14258285975695227190', time=2024-09-14T13:53:23.337279+0000, chain.objs.size()=1 2024-09-14T12:44:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VhZZv7zJfdvKjY5sVEWdFUkN8iUNbiV_0 2024-09-14T12:44:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13729883750287637672', time=2024-09-14T13:53:23.641752+0000, chain.objs.size()=1 2024-09-14T12:44:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qZdIOb3I0HB-2JNeGEHxQJYcSISVWOZ_0 2024-09-14T12:44:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9991443350926166990', time=2024-09-14T13:53:24.375396+0000, chain.objs.size()=1 2024-09-14T12:44:02.279 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MB52vuBbgzL5XJ3u4_O2KVe4IMMX4f6_0 2024-09-14T12:44:02.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7205231491943857915', time=2024-09-14T13:53:25.501055+0000, chain.objs.size()=1 2024-09-14T12:44:02.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.NhEHFtUJPE-uaZtkSBC5Qz54Jw2BC7x_0 2024-09-14T12:44:02.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11881899783152829135', time=2024-09-14T13:53:25.835582+0000, chain.objs.size()=1 2024-09-14T12:44:02.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EsJdMbTgL74amfFrYO28181iY73QOOe_0 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.976789900349235759', time=2024-09-14T13:53:26.091533+0000, chain.objs.size()=1 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dtdijgUQgSRAPjrJgqKGG5S86b6HWQ0_0 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2158628641564625280', time=2024-09-14T13:53:26.148672+0000, chain.objs.size()=1 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uPM8j8umEDQqWAhoc0lc8865OPNyFJY_0 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14578403358376332810', time=2024-09-14T13:53:26.230162+0000, chain.objs.size()=1 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jldi-uY4BnG2oprwYuRukWVl_ox9ds3_0 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10409070175689664441', time=2024-09-14T13:53:27.240158+0000, chain.objs.size()=1 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yj1FyM5h40fyD_TpN66ZS-YUC1Zz3FN_0 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1950741904619669394', time=2024-09-14T13:53:27.723542+0000, chain.objs.size()=1 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.G69YH75cWi7GRTHDaTN0c6tnB8ha37Z_0 2024-09-14T12:44:02.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2686037358100073918', time=2024-09-14T13:53:28.883452+0000, chain.objs.size()=1 2024-09-14T12:44:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HYZNvjwD2IGdGxB4y-JSOw6BjilVhqV_0 2024-09-14T12:44:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13138364259604559820', time=2024-09-14T13:53:30.263131+0000, chain.objs.size()=1 2024-09-14T12:44:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7CFQ_ogsfrQImCSzV2oU02oeeKYPeWd_0 2024-09-14T12:44:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9508328413944399785', time=2024-09-14T13:53:33.554305+0000, chain.objs.size()=1 2024-09-14T12:44:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.R2aIirpbZaezp43QRk3lN0B2pN-MOBx_0 2024-09-14T12:44:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10039318656573047640', time=2024-09-14T13:53:34.062119+0000, chain.objs.size()=1 2024-09-14T12:44:02.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xhRLaMN_ehVotd-GRumE_5gj_WJ4IIg_0 2024-09-14T12:44:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11149648941997365674', time=2024-09-14T13:53:34.064142+0000, chain.objs.size()=1 2024-09-14T12:44:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GdAF0q601P9o7lqPxAvOizsNC897zFr_0 2024-09-14T12:44:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8435936331090195920', time=2024-09-14T13:53:35.017058+0000, chain.objs.size()=1 2024-09-14T12:44:02.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qCvcqw1IajeTQuUW-uFXz69mWHiSZYZ_0 2024-09-14T12:44:02.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17539203682015012903', time=2024-09-14T13:53:35.107940+0000, chain.objs.size()=1 2024-09-14T12:44:02.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.iBPTDZ9vOD1mXSJJgDshMTOC_VQEc4L_0 2024-09-14T12:44:02.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.784301119613310737', time=2024-09-14T13:53:40.057507+0000, chain.objs.size()=1 2024-09-14T12:44:02.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.265__shadow_.WpfMpncd8PFqk1tQwlljJV7eYwISGDS_0 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9872267504039556148', time=2024-09-14T13:54:44.141596+0000, chain.objs.size()=1 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.291__shadow_.cwIwMI-4sV7D-z-QqVOK5gGCOtXiHIh_0 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17594573270318229931', time=2024-09-14T13:54:52.939446+0000, chain.objs.size()=1 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.OBRuhH062HBBopTczsu2TRbclGzNTJI_0 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4160290535023614530', time=2024-09-14T13:54:58.772217+0000, chain.objs.size()=1 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.JmrGqAMqEQHhyOKiEX45SrX0rkWyHQJ_0 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2664267385791508076', time=2024-09-14T13:56:15.858323+0000, chain.objs.size()=1 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.322__shadow_.C-80aJf8LNhRZfMw2U_47ZMhYjG12pY_0 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10860027964141125972', time=2024-09-14T13:58:05.392140+0000, chain.objs.size()=1 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BWIquo87DQey7Lk-y4iicYVBjm4RiVJ_0 2024-09-14T12:44:02.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18082406864948150225', time=2024-09-14T13:58:06.425359+0000, chain.objs.size()=1 2024-09-14T12:44:02.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tZia2xSwNLjAxkYFuxWr4xYRJwDFad6_0 2024-09-14T12:44:02.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4169611960457974563', time=2024-09-14T13:58:06.925883+0000, chain.objs.size()=1 2024-09-14T12:44:02.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HpbsFcr2d_KWLnXYOPdhdoCOxGeqjY3_0 2024-09-14T12:44:02.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3637791721789194508', time=2024-09-14T13:58:07.554859+0000, chain.objs.size()=1 2024-09-14T12:44:02.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.umM_5af_qX4QTEGjQU0Bec347LBlsKY_0 2024-09-14T12:44:02.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18340480812037817883', time=2024-09-14T13:58:07.557681+0000, chain.objs.size()=1 2024-09-14T12:44:02.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pN1_6n_IBVnfxXPLs802Xj0zinhySbC_0 2024-09-14T12:44:02.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18284631987533492569', time=2024-09-14T13:58:07.908092+0000, chain.objs.size()=1 2024-09-14T12:44:02.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.I0LsagvxkEDnVHeeAsHXcwkviAxo1kZ_0 2024-09-14T12:44:02.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17250712804797243951', time=2024-09-14T13:58:08.005984+0000, chain.objs.size()=1 2024-09-14T12:44:02.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wl3mnCFch9tla4sa1l67SVn7ffWS8zK_0 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8284737859396689842', time=2024-09-14T13:58:10.709602+0000, chain.objs.size()=1 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rxi_NzVJW1xCVSRY1cYdhJqIgt70xH6_0 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16859161795978351629', time=2024-09-14T13:58:10.859316+0000, chain.objs.size()=1 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.crfxhd9BUzEtUEpVoq58mkmmrwEd8o4_0 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5978144664923415597', time=2024-09-14T13:58:13.593553+0000, chain.objs.size()=1 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.yHvyC50IVCtCk3GaHw3KrzfKaPIvItC_0 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18329285780505616281', time=2024-09-14T13:58:13.804441+0000, chain.objs.size()=1 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.v4m4foKhPtTJP_JT1AhzoeXE2Bte23f_0 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3796533703291921083', time=2024-09-14T13:58:13.901344+0000, chain.objs.size()=1 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.R8h7PIqG3LkhzQYxtbEnK5ccpk0mVXB_0 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12583450988630556570', time=2024-09-14T13:58:13.903583+0000, chain.objs.size()=1 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7loKD8-HAzJS7gycsA7h31VMkTpxe1f_0 2024-09-14T12:44:02.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12001573536609486645', time=2024-09-14T13:58:13.905724+0000, chain.objs.size()=1 2024-09-14T12:44:02.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.uucd0Ig8GK2SieyC-CHnbau_nSaEdNr_0 2024-09-14T12:44:02.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4706395203671501372', time=2024-09-14T13:58:14.648429+0000, chain.objs.size()=1 2024-09-14T12:44:02.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NGNg0jhhtX6OfOgWTm_Abx9o_e3Frho_0 2024-09-14T12:44:02.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17545880737668893813', time=2024-09-14T13:58:14.685294+0000, chain.objs.size()=1 2024-09-14T12:44:02.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ajjBCg690oDdqKhKWgYg3NsUiPrrBZ9_0 2024-09-14T12:44:02.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7265312739191234899', time=2024-09-14T13:58:15.590602+0000, chain.objs.size()=1 2024-09-14T12:44:02.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.OGGDcAXmgTc1mP4KfJt3OPiwwyfE4P3_0 2024-09-14T12:44:02.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.31000524113739921', time=2024-09-14T13:58:17.374378+0000, chain.objs.size()=1 2024-09-14T12:44:02.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NgU1Vq1LCWj0eu8U7DNFxZQ08m5mryF_0 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12675194802168876998', time=2024-09-14T13:58:17.376279+0000, chain.objs.size()=1 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eKCBJS8jZlz9_-mmQ76u3S_8dTOZmge_0 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4991094415434210086', time=2024-09-14T13:58:20.114977+0000, chain.objs.size()=1 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.dr1lqLH397mmBhQ-LHN_gXYRLLGXOzf_0 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.945003560722200013', time=2024-09-14T13:58:22.221860+0000, chain.objs.size()=1 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.slCTcWvdCIM0FL18qljGzYIxjTMDu0r_0 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9620865626107717534', time=2024-09-14T13:58:22.906168+0000, chain.objs.size()=1 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZZ8xH6yJ4HNeC9Jhyi5hRa8ahHK89xT_0 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4818402569490518178', time=2024-09-14T13:58:24.879725+0000, chain.objs.size()=1 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jxmKhhYdQYBFAszqqT53B3IKVnvyE7v_0 2024-09-14T12:44:02.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16164922022083372628', time=2024-09-14T13:58:24.883549+0000, chain.objs.size()=1 2024-09-14T12:44:02.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.z1-frZ1CoozfnNqJD712yNhnlCxvuoB_0 2024-09-14T12:44:02.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7271564340645352455', time=2024-09-14T13:58:25.189017+0000, chain.objs.size()=1 2024-09-14T12:44:02.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pQyw6zUf7sDdchpOpbGnHsGlP2QM1a-_0 2024-09-14T12:44:02.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17892553344295765894', time=2024-09-14T13:58:25.190898+0000, chain.objs.size()=1 2024-09-14T12:44:02.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7IB1qECu9d9tmCpefxmGWpXdi_QP_CI_0 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13657087887302412732', time=2024-09-14T13:58:26.920584+0000, chain.objs.size()=1 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0ftiaMpt7DzKzPeRZ6uznwaqeqmw0sL_0 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5295625817504105621', time=2024-09-14T13:58:29.573864+0000, chain.objs.size()=1 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IzLRU3s18gLKau9DFAF1SBOv6qRqFEV_0 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5399068938631034723', time=2024-09-14T13:58:31.271522+0000, chain.objs.size()=1 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.67yFUNnO5tqgy184v6ayy19SL9VHBqV_0 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14315305196536523346', time=2024-09-14T13:58:31.363051+0000, chain.objs.size()=1 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EfqSGYjVM7NyUOOR_hKdBV4sMlVB7o5_0 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7217879803605202690', time=2024-09-14T13:58:32.124796+0000, chain.objs.size()=1 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ywhm7fv1amGWY9d5HwUiH4mfvk8E4XV_0 2024-09-14T12:44:02.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8435794417817743515', time=2024-09-14T14:00:23.364091+0000, chain.objs.size()=1 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wBwJxBCeRsRWNdJWqjdfP2ob-fq5BQB_0 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5513542792472990950', time=2024-09-14T14:00:25.595586+0000, chain.objs.size()=1 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qI5tumU3ojGC4_saAcP7I2oek3xK3gI_0 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5086699716109835947', time=2024-09-14T14:00:26.085177+0000, chain.objs.size()=1 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9mj9yrtLejn-_J2-bWzqJNibcieOp5t_0 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8378443137571384975', time=2024-09-14T14:00:26.923473+0000, chain.objs.size()=1 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FuPB9H7hVHFpIO1d_CY8Z6TbQyjUHkB_0 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5704948588730417654', time=2024-09-14T14:00:27.175183+0000, chain.objs.size()=1 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.0hPqt3RNvRrkCVobYwP7n4hCy-wN7hz_0 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4257207872576089301', time=2024-09-14T14:00:29.381814+0000, chain.objs.size()=1 2024-09-14T12:44:02.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.f57aTehJmZHcsGFli4jnQPgUUPcF5ip_0 2024-09-14T12:44:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1609834726819326587', time=2024-09-14T14:00:29.521432+0000, chain.objs.size()=1 2024-09-14T12:44:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JV84QVRDZvuhuQcUvByweF8TFTBpjUs_0 2024-09-14T12:44:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13068705272006238182', time=2024-09-14T14:00:31.305791+0000, chain.objs.size()=1 2024-09-14T12:44:02.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CxRt4TEnAZhh7dlrsKhXujb_wIhxy00_0 2024-09-14T12:44:02.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1147393246267255747', time=2024-09-14T14:00:31.584347+0000, chain.objs.size()=1 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5ZowZtAtNTyZElWIdChDVvdYPJdyPLx_0 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.899109558320862076', time=2024-09-14T14:00:31.767532+0000, chain.objs.size()=1 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AyhlHOTxCunSODLduvduPyiYe2v9bLP_0 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.584520649266301710', time=2024-09-14T14:00:33.307124+0000, chain.objs.size()=1 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ZpUyklFe2jOGOae3IJ78rIdglzSBuuX_0 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7751002578608827583', time=2024-09-14T14:00:33.467504+0000, chain.objs.size()=1 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.D1wsJS2IRIW-CA9Se9CUO0dDq1Hg09K_0 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10200617963220375083', time=2024-09-14T14:00:33.936558+0000, chain.objs.size()=1 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CdStupbNPBLRdJY-fdYMGqHEQgtW6FZ_0 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2454470395653480176', time=2024-09-14T14:00:34.322391+0000, chain.objs.size()=1 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.J9z_PXiOdag9GWgqCwiqvjkFbGKGJe-_0 2024-09-14T12:44:02.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9497978176877952006', time=2024-09-14T14:00:35.698734+0000, chain.objs.size()=1 2024-09-14T12:44:02.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BRLElZjf0G3rD0b3vSFvm7ICiKjDnFl_0 2024-09-14T12:44:02.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12177266278211397895', time=2024-09-14T14:00:35.700720+0000, chain.objs.size()=1 2024-09-14T12:44:02.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j39lvdIDZVJ-BASHPn96ATuib5Z5KQX_0 2024-09-14T12:44:02.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6089180286787399485', time=2024-09-14T14:00:37.536750+0000, chain.objs.size()=1 2024-09-14T12:44:02.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.W4FB0E665-nGF4ByjG53TPJMosxIg_i_0 2024-09-14T12:44:02.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15794248310437175431', time=2024-09-14T14:00:37.783910+0000, chain.objs.size()=1 2024-09-14T12:44:02.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.s9KfMLJkFQBS1pTF6_WDokSafLXCiNS_0 2024-09-14T12:44:02.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6535857797595714694', time=2024-09-14T14:00:38.212755+0000, chain.objs.size()=1 2024-09-14T12:44:02.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wgK-E9cKRiyQ35zumbuffJcHXzO2s04_0 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11127822106024304845', time=2024-09-14T14:00:38.657035+0000, chain.objs.size()=1 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Blzh59942QrsDn7GN-5JOEioq7Vg8fH_0 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5002624755539659461', time=2024-09-14T14:00:40.885703+0000, chain.objs.size()=1 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wFN7XAd53NJv8sr7yIszc5Hg5PBh5I8_0 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13648454394310700784', time=2024-09-14T14:00:41.488249+0000, chain.objs.size()=1 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JCNrLTcN9BESObefYBmVblEfmIz_iZt_0 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17197098572626907694', time=2024-09-14T14:00:41.490325+0000, chain.objs.size()=1 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CffPc1xZZbwtC09Py6E9ffF6uO98BDe_0 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16421137178680823964', time=2024-09-14T14:00:41.583117+0000, chain.objs.size()=1 2024-09-14T12:44:02.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lx7sfGi4QYjo9AUgltu6lZbW_zkBhKx_0 2024-09-14T12:44:02.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15432533532591339614', time=2024-09-14T14:00:41.928096+0000, chain.objs.size()=1 2024-09-14T12:44:02.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LZYc5tpCDcOLDX--ADIpZbf6dx-3Xe1_0 2024-09-14T12:44:02.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.333+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15675642828933412736', time=2024-09-14T14:00:42.260758+0000, chain.objs.size()=1 2024-09-14T12:44:02.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.333+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mNLs1SQebsOqQo0uP3RFU7VKJa4iupd_0 2024-09-14T12:44:02.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.333+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17601733462034058581', time=2024-09-14T14:00:42.757010+0000, chain.objs.size()=1 2024-09-14T12:44:02.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.333+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VuK1PsLt3Y791agbVzZ3upQq15m9hwB_0 2024-09-14T12:44:02.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45692 2024-09-14T12:44:02.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T12:44:02.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.48244321387255517', time=2024-09-14T14:00:45.082076+0000, chain.objs.size()=1 2024-09-14T12:44:02.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Bqx3DEVMa47mHPhB61pgEruk3mHsvkN_0 2024-09-14T12:44:02.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5516044164493288903', time=2024-09-14T14:00:45.953557+0000, chain.objs.size()=1 2024-09-14T12:44:02.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ULB5TeW4vjA4qhoklqb9kDBB1sBJCHz_0 2024-09-14T12:44:02.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4016954779754180128', time=2024-09-14T14:00:46.777586+0000, chain.objs.size()=1 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WucgkeHCWe-2wHDKzhogXavXTfuRKCS_0 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17247017257167459087', time=2024-09-14T14:00:47.633000+0000, chain.objs.size()=1 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.m8lYPTArWAS4OyKHBzRqGXN5iDODwSn_0 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3061253129842155396', time=2024-09-14T14:00:47.983380+0000, chain.objs.size()=1 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CBAAOQKGl57vrOIqgPGLD7zqKQzWSqe_0 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17501457098762819470', time=2024-09-14T14:00:48.432605+0000, chain.objs.size()=1 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4V6iG0n1MyN8zZ7O9o249YVwNFqm5Fj_0 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8039689541945476318', time=2024-09-14T14:00:48.778729+0000, chain.objs.size()=1 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HdTPOAxO5l2LpT8hm0Rt77XXiN3F0cL_0 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13564578034582451350', time=2024-09-14T14:00:48.881310+0000, chain.objs.size()=1 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pO3HKogS71fjcnR2s6iKKqGvs8ZTSBb_0 2024-09-14T12:44:02.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1260352992029737576', time=2024-09-14T14:00:49.898993+0000, chain.objs.size()=1 2024-09-14T12:44:02.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yxqI5NseR0sEaZm69t0CsayXSXm1scU_0 2024-09-14T12:44:02.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8501594430854323342', time=2024-09-14T14:04:50.401167+0000, chain.objs.size()=1 2024-09-14T12:44:02.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.435__shadow_.Tp4KQZgMdFSbAqDkdeDexeKm7Dyi-NK_0 2024-09-14T12:44:02.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9194371518568175030', time=2024-09-14T14:05:02.700860+0000, chain.objs.size()=1 2024-09-14T12:44:02.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.440__shadow_.1dbRW5MVxMYnntX4UmeEqKTBmGkoxiO_0 2024-09-14T12:44:02.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10464926125600492809', time=2024-09-14T14:07:05.224951+0000, chain.objs.size()=1 2024-09-14T12:44:02.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.489__shadow_.eUxavrlBS9OCl9WVfQx3cSoLkCANOE8_0 2024-09-14T12:44:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7078172570328880957', time=2024-09-14T14:07:12.976166+0000, chain.objs.size()=1 2024-09-14T12:44:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.492__shadow_.jnNTECXChqIiWqZVEVq-YGg1XFENis0_0 2024-09-14T12:44:02.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.290194134989676749', time=2024-09-14T14:07:25.222932+0000, chain.objs.size()=1 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.498__shadow_.pLV7D0VYX7WE1RpDM9k6lqDO-xcJdur_0 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9470253759195485189', time=2024-09-14T14:14:14.212249+0000, chain.objs.size()=2 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~qhg1ncL71_b4DkTB8nLMch0D7kXV7Cq.1 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~qhg1ncL71_b4DkTB8nLMch0D7kXV7Cq.2 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6581358751579108241', time=2024-09-14T14:19:37.896343+0000, chain.objs.size()=1 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:j1NRndEr8vZAKjjj.fRcSBgikHW5Zbl_.cBfBwswyTZBLepnElgr9_CNLIrBAN8P_0 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17734116498984922442', time=2024-09-14T14:20:22.048864+0000, chain.objs.size()=1 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:64l48tu0OO2vNp4bcgflXZkjJ3ot29X_.Dbwie6U_7YXw7Ijjd2kUVq7IIykL5Zp_0 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10681567036472634237', time=2024-09-14T14:20:57.173794+0000, chain.objs.size()=1 2024-09-14T12:44:02.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:4FK4t505tANeau3nCsvFApDpKx2.Jcv_.iGNSnwpgXI1YtxfMHhC4fTIlTYau-xy_0 2024-09-14T12:44:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1447863763635284346', time=2024-09-14T14:22:32.434400+0000, chain.objs.size()=1 2024-09-14T12:44:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.587__shadow:Rc-UnAuxA3lhn1EKSehHoy5sHdn-0d2_.14TUKS4XhWI8FqxSkQCZF8JZhCOHo9s_0 2024-09-14T12:44:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14742573611134434047', time=2024-09-14T14:23:13.159598+0000, chain.objs.size()=1 2024-09-14T12:44:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.605__shadow_._vzlNAj_32RTrkDP7XmQaYHswVicDAk_0 2024-09-14T12:44:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10137813099130785564', time=2024-09-14T14:23:17.732809+0000, chain.objs.size()=1 2024-09-14T12:44:02.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.607__shadow_.Ajpk7c-Wt0rABrN5T2E2uZr7J1i2Ho5_0 2024-09-14T12:44:02.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17456662700346019230', time=2024-09-14T14:30:32.257803+0000, chain.objs.size()=1 2024-09-14T12:44:02.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.643__shadow_.dNEVdNkNFsgdyOw97wnnGg3Mt8usCs-_0 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6394130949665768728', time=2024-09-14T14:32:36.220875+0000, chain.objs.size()=1 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.664__shadow_.dvmyzdymwFuyMxvNZxuQhM1iERq7xQ6_0 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4754869698452310335', time=2024-09-14T14:34:20.941511+0000, chain.objs.size()=1 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.712__multipart_file1.2~24sRoMsU-aeCheJWWp44QdGxW36g_I8.1 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11416406835454388062', time=2024-09-14T14:34:52.230426+0000, chain.objs.size()=1 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.718__shadow:g3QS2HKkC4kmFdg2IwIM230qbrP4Ylm_.BsDgT4m47czDQpeZxlLii1ILwFuNrf9_0 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10185589076439213605', time=2024-09-14T14:35:55.251830+0000, chain.objs.size()=20 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.1 2024-09-14T12:44:02.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.1_1 2024-09-14T12:44:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.2 2024-09-14T12:44:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.2_1 2024-09-14T12:44:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.3 2024-09-14T12:44:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.3_1 2024-09-14T12:44:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.4 2024-09-14T12:44:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.4_1 2024-09-14T12:44:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.5 2024-09-14T12:44:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.5_1 2024-09-14T12:44:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.6 2024-09-14T12:44:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.6_1 2024-09-14T12:44:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.7 2024-09-14T12:44:02.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.7_1 2024-09-14T12:44:02.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.361+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.8 2024-09-14T12:44:02.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.361+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.8_1 2024-09-14T12:44:02.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.361+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.9 2024-09-14T12:44:02.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.361+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.9_1 2024-09-14T12:44:02.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.361+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__multipart_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.10 2024-09-14T12:44:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.736__shadow_foo.2~ooXkhcyPaXyYsPh5hxdZAKr0AAIE8m_.10_1 2024-09-14T12:44:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.365+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16756360869829422618', time=2024-09-14T14:36:25.868075+0000, chain.objs.size()=3 2024-09-14T12:44:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.744__multipart_mymultipart3.2~kSDHFR5PDxtlOQYvL2n7KQNEyx_1zxD.1 2024-09-14T12:44:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.744__multipart_mymultipart3.2~kSDHFR5PDxtlOQYvL2n7KQNEyx_1zxD.2 2024-09-14T12:44:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.744__multipart_mymultipart3.2~kSDHFR5PDxtlOQYvL2n7KQNEyx_1zxD.3 2024-09-14T12:44:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.365+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1517940955471873622', time=2024-09-14T14:39:28.370393+0000, chain.objs.size()=1 2024-09-14T12:44:02.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.764__shadow_.sXXDwSDdglkhZwmC27EK7lPTIjQaPc5_0 2024-09-14T12:44:02.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:02.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T12:44:02.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:02.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51253' 2024-09-14T12:44:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6591316644607760214', time=2024-09-14T13:42:28.414604+0000, chain.objs.size()=1 2024-09-14T12:44:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.158__shadow:GgPbV4hfXR0TBkxPWZ9fnTA1jqzbcq._.NddMZiLBeIVO-PoV9Q18iNQqxZ0vYFj_0 2024-09-14T12:44:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_I2aejFx6CcLn9zlDmuHyk4J-XcS9SeH', time=2024-09-14T13:43:32.025071+0000, chain.objs.size()=1 2024-09-14T12:44:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.jeeKMDgQ0sILQLLHN_jpZfDJkY56ckw_0 2024-09-14T12:44:02.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10575814933595990546', time=2024-09-14T13:45:19.694236+0000, chain.objs.size()=1 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.189__shadow_.gf8wt-gpxFRbnABjq9PRhitsI4wfky4_0 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10854959248886613906', time=2024-09-14T13:50:20.981354+0000, chain.objs.size()=1 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.239__shadow_.G-u7HaE8qo-aDEKzOWgURwLt5JaEe-9_0 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16763176316855013013', time=2024-09-14T13:50:45.976289+0000, chain.objs.size()=1 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.248__shadow_.TeqYztU4Pks7F5FRX9-dF4yh9Lv284E_0 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17845142066251785384', time=2024-09-14T13:50:51.002049+0000, chain.objs.size()=1 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.250__shadow_.7XpzGgFvgDNG-Ys9kipy9Certpr5X9P_0 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2806168176963162942', time=2024-09-14T13:51:13.487101+0000, chain.objs.size()=1 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.259__shadow_.SlJGjKibIH8mBfVEp9ujpC_VGrmus_w_0 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3842069940707757420', time=2024-09-14T13:53:07.419534+0000, chain.objs.size()=1 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.awe1_d5zPhYQVOKTq08KgQVKY-CyELz_0 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5779181593378881472', time=2024-09-14T13:53:08.122150+0000, chain.objs.size()=1 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.SozkS3Ce7xD8ZyOJjywqMlAWXMUM4y7_0 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9856908621601267619', time=2024-09-14T13:53:08.302556+0000, chain.objs.size()=1 2024-09-14T12:44:02.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TLYL3MqKbMPiG263UXLayZIBtcZ6lFL_0 2024-09-14T12:44:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18426285863398045595', time=2024-09-14T13:53:09.897225+0000, chain.objs.size()=1 2024-09-14T12:44:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.A8YM9NisrY52HFxavh1BIWvVkI_Efez_0 2024-09-14T12:44:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16286392155374064568', time=2024-09-14T13:53:10.054249+0000, chain.objs.size()=1 2024-09-14T12:44:02.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hga628svMzdXXQoOVJwLqeu5uudJ-bx_0 2024-09-14T12:44:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.377+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1337733420587329832', time=2024-09-14T13:53:10.663801+0000, chain.objs.size()=1 2024-09-14T12:44:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.K6LKDdJZQUU9-XP_dMhfPRGt1CHPYp0_0 2024-09-14T12:44:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.377+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1444298023817898326', time=2024-09-14T13:53:11.137681+0000, chain.objs.size()=1 2024-09-14T12:44:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.tBBUc4Qexhhi1WASLrNn4QrKXTPnDy2_0 2024-09-14T12:44:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6658047161000673547', time=2024-09-14T13:53:12.089066+0000, chain.objs.size()=1 2024-09-14T12:44:02.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6SnDVeW2VOhLXjKH5d5qKguRpEH_gFB_0 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9804392037042556376', time=2024-09-14T13:53:13.548927+0000, chain.objs.size()=1 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lMGvloSJ-h315Ckluofd0sVKWGxR-1-_0 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1450567260545735918', time=2024-09-14T13:53:16.162367+0000, chain.objs.size()=1 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.57Vgkwy6tKn9JRB2W71lklLLtJdkpV6_0 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8302946202203719900', time=2024-09-14T13:53:16.336341+0000, chain.objs.size()=1 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.DIq3Z5SqkUpo_cPsaA06pyqAlrRE7fi_0 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14650677653631503122', time=2024-09-14T13:53:18.138228+0000, chain.objs.size()=1 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Q8lBbXyaeyFf4pI55rBNYdZEnBxKSZS_0 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13211574465622221098', time=2024-09-14T13:53:18.456192+0000, chain.objs.size()=1 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1NgC7e1yc8xe-j_5go8wD4zR_DmyqLN_0 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.237106525765478288', time=2024-09-14T13:53:18.806449+0000, chain.objs.size()=1 2024-09-14T12:44:02.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ywKaKFc_lw4k0ZjBoXDhdeNm8blikLT_0 2024-09-14T12:44:02.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11710846709837425534', time=2024-09-14T13:53:19.802709+0000, chain.objs.size()=1 2024-09-14T12:44:02.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0DRoD9x-8vsT88Hk26UG7f3IPKDT4n__0 2024-09-14T12:44:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15345847007457620839', time=2024-09-14T13:53:20.024582+0000, chain.objs.size()=1 2024-09-14T12:44:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.opqS_16apldOv70aekgUrJzyB-kmJ-F_0 2024-09-14T12:44:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13562985589981435612', time=2024-09-14T13:53:20.684245+0000, chain.objs.size()=1 2024-09-14T12:44:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Goowmu95UtALzw7ZC5Pj1ChB16s7DUP_0 2024-09-14T12:44:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1823201408175590833', time=2024-09-14T13:53:21.953877+0000, chain.objs.size()=1 2024-09-14T12:44:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EogmurSHvhUArxo9oEQ22hZtrrrT2e7_0 2024-09-14T12:44:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14014312074195721320', time=2024-09-14T13:53:21.955399+0000, chain.objs.size()=1 2024-09-14T12:44:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FP1qPZL3CDS1HRPosCGQKvjsV7V-5NA_0 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15890032212282975943', time=2024-09-14T13:53:22.933112+0000, chain.objs.size()=1 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.O6PXBxfrfgIbNPHKekTy9NcmQ8EOCqK_0 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13283127359640183320', time=2024-09-14T13:53:23.434425+0000, chain.objs.size()=1 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qiKBLe-KqvqhTWRoOC29KVm09Rf3SwP_0 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7909792979804251143', time=2024-09-14T13:53:23.436790+0000, chain.objs.size()=1 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.To5R2hnseUBxzjrCvR3gFaB8l2ly3iW_0 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7540486865166622872', time=2024-09-14T13:53:25.224752+0000, chain.objs.size()=1 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PmhP2eg0pCf9yEjqyadQhT8RMrOkr6A_0 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10681011463072906354', time=2024-09-14T13:53:25.270944+0000, chain.objs.size()=1 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RYDfipC4NNQ727gKh0kzDFR0Owt8NXN_0 2024-09-14T12:44:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9081490897459883986', time=2024-09-14T13:53:27.147578+0000, chain.objs.size()=1 2024-09-14T12:44:02.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lzfYX_DIVeAvzRFK_thsRh86iCWn0ah_0 2024-09-14T12:44:02.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6222244759992057912', time=2024-09-14T13:53:30.279712+0000, chain.objs.size()=1 2024-09-14T12:44:02.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.O0Bs45Db3cBPJJgPZPAdcAZFzRR-tY6_0 2024-09-14T12:44:02.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.589+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9707961039622722027', time=2024-09-14T13:53:30.840532+0000, chain.objs.size()=1 2024-09-14T12:44:02.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4wvyM9pXLJP2RgLa-I1q3wa5zrn_2_j_0 2024-09-14T12:44:02.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10316936623031597696', time=2024-09-14T13:53:31.401004+0000, chain.objs.size()=1 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.IROpmMXigKf-abPwUzKzgr_i8LR6SM8_0 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11554116876129281723', time=2024-09-14T13:53:31.474819+0000, chain.objs.size()=1 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ypeTOXXCgqsEf0jci-EoBfmj8TLe6Zb_0 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13827804780159384642', time=2024-09-14T13:53:32.704715+0000, chain.objs.size()=1 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Pi7EMuZTFVW_fqiBB5Z72XqONEY24mu_0 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10206507760240638946', time=2024-09-14T13:53:33.632852+0000, chain.objs.size()=1 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.E27X0NFKjICUVzt0ZUQGZSPUgR7fLSU_0 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6785665124228593177', time=2024-09-14T13:53:34.408709+0000, chain.objs.size()=1 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._NqbbjqnNWZJhNmvsdBXpDBPAmRp79r_0 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13510679423959610668', time=2024-09-14T13:53:34.410222+0000, chain.objs.size()=1 2024-09-14T12:44:02.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.C0q5YmYdM2JPJ7nbA7et4Dm_fe2Uy-S_0 2024-09-14T12:44:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4782750417660264657', time=2024-09-14T13:53:35.012208+0000, chain.objs.size()=1 2024-09-14T12:44:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QV-oNX_BCaxTB3bqrZUDrXzmKcPL_Ug_0 2024-09-14T12:44:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15230855094901350186', time=2024-09-14T13:54:08.844065+0000, chain.objs.size()=1 2024-09-14T12:44:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.277__shadow_.w_EdCi_E_rtxBK46zsBMWp9srn0GMbR_0 2024-09-14T12:44:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5772474747598716546', time=2024-09-14T13:54:08.846268+0000, chain.objs.size()=1 2024-09-14T12:44:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.277__shadow_.c1oG4P-nzljEh2HXOyExWcNvt6Tvfh4_0 2024-09-14T12:44:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14964429821347008415', time=2024-09-14T13:54:39.029228+0000, chain.objs.size()=1 2024-09-14T12:44:02.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.289__shadow_.EJL28NCX90iBN3IkqSHsfzNmzovEE1f_0 2024-09-14T12:44:02.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3989553189372328248', time=2024-09-14T13:54:53.045934+0000, chain.objs.size()=1 2024-09-14T12:44:02.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.Jn8U3QYzZGzaaj_OZxm6F83XfegNsmV_0 2024-09-14T12:44:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4160054614918848856', time=2024-09-14T13:54:58.761419+0000, chain.objs.size()=1 2024-09-14T12:44:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.9Zgf0WS5hfHsgdlDS0s26qgr7Fvf0Lo_0 2024-09-14T12:44:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7601284971687783463', time=2024-09-14T13:55:06.640677+0000, chain.objs.size()=1 2024-09-14T12:44:02.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.297__shadow_.NsZAP7NtyDff-0-fZAwKRZkyEPO4akC_0 2024-09-14T12:44:02.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7986713551204822985', time=2024-09-14T13:55:09.114053+0000, chain.objs.size()=1 2024-09-14T12:44:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.298__shadow_.02J_FHZUTGHImVFWoJK4PfDWhoceQ-K_0 2024-09-14T12:44:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17726559404087853073', time=2024-09-14T13:55:14.286743+0000, chain.objs.size()=1 2024-09-14T12:44:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.300__shadow_.FJVbKDfAFIRPuhky5ICM21Y9IYr_ewh_0 2024-09-14T12:44:02.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13013808904755377393', time=2024-09-14T13:55:24.480269+0000, chain.objs.size()=1 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.304__shadow_.UwCoiP2Y71rztQxraHRK9vzDzQPSEcv_0 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10691223008117581228', time=2024-09-14T13:56:15.879444+0000, chain.objs.size()=1 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.322__shadow_.MkT5VzHCu_Q-SIE9egSF_WzV3gFDBW2_0 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4141401136070386893', time=2024-09-14T13:58:05.965831+0000, chain.objs.size()=1 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.vypuBrnio7mHcHjRKcUyA_YlCOyJfbm_0 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14126777699431438314', time=2024-09-14T13:58:06.365725+0000, chain.objs.size()=1 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.y9lNczo1BbwX57p23JHXncmvW_5Ufq-_0 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9627378466696958440', time=2024-09-14T13:58:08.197903+0000, chain.objs.size()=1 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FW0SAgWX6kK6YyeAm4jyPplGWbVbsNU_0 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14590856569621505729', time=2024-09-14T13:58:11.879724+0000, chain.objs.size()=1 2024-09-14T12:44:02.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7dVFZg_2RFjhe-N7AMfeDgL14tKi6Mu_0 2024-09-14T12:44:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14725730604017995906', time=2024-09-14T13:58:12.079956+0000, chain.objs.size()=1 2024-09-14T12:44:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.my4zmkK3SNEiELI6x2c_3J3sLqXJQKj_0 2024-09-14T12:44:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6019019887898258271', time=2024-09-14T13:58:12.396626+0000, chain.objs.size()=1 2024-09-14T12:44:02.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FSP1OlBrFsM_g2b2lTVYsUWzu_s3DQn_0 2024-09-14T12:44:02.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9747805861815141735', time=2024-09-14T13:58:13.386589+0000, chain.objs.size()=1 2024-09-14T12:44:02.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.U__li3bpsmhTKAVS1SmWddpXfUYM09f_0 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14686904609728041141', time=2024-09-14T13:58:13.672396+0000, chain.objs.size()=1 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JqGHbsMcJfzyGx5ox4NHTQTgCV1PfSs_0 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5048162214883253555', time=2024-09-14T13:58:14.096088+0000, chain.objs.size()=1 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eIbd9gMaXXIdvxb1rgYF1KBnJhWbKkw_0 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3050769485752566351', time=2024-09-14T13:58:14.823342+0000, chain.objs.size()=1 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kvkSKEdnQXLnVqVOxGZRQ3eRzf-TRmH_0 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7175792527079601880', time=2024-09-14T13:58:14.825342+0000, chain.objs.size()=1 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1JgGvVzalPaST0iKN09NBkewftckkkc_0 2024-09-14T12:44:02.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.904474224907836590', time=2024-09-14T13:58:15.119944+0000, chain.objs.size()=1 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6WcS7SonmHItKNaNWr7es3iF2_n3SUf_0 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1991174708141153208', time=2024-09-14T13:58:15.122302+0000, chain.objs.size()=1 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TbPTapbSY3Mslp8PKDdVFY4_2GghBMK_0 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7252593469819922098', time=2024-09-14T13:58:16.108055+0000, chain.objs.size()=1 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.48DmShhJvp3H2UDqSA9K-1DYFpENl1m_0 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5842023553391296113', time=2024-09-14T13:58:18.016795+0000, chain.objs.size()=1 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QtU__45zcK25JLCokJ9s7tZWPx9DomQ_0 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2820786309185161851', time=2024-09-14T13:58:18.143877+0000, chain.objs.size()=1 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CpLeLhhOX_VUcFViG-Elu2Hs8iF03i__0 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18296867345595194097', time=2024-09-14T13:58:20.052781+0000, chain.objs.size()=1 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jgqZhfZq0IvlKl8UfjRFtDSR3e5OzqJ_0 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3628092830200193859', time=2024-09-14T13:58:21.281598+0000, chain.objs.size()=1 2024-09-14T12:44:02.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ghbfrZZE0zZWBn4Z6QJf81AHs-ZEuL6_0 2024-09-14T12:44:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5177702719301837265', time=2024-09-14T13:58:21.626607+0000, chain.objs.size()=1 2024-09-14T12:44:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8ADDf12HJHPIvEVf2ZpS-AaBAUASUvK_0 2024-09-14T12:44:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13993048723014057226', time=2024-09-14T13:58:21.628641+0000, chain.objs.size()=1 2024-09-14T12:44:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.RkM6LOxABZ_FPzttneidouyQvT6hH_a_0 2024-09-14T12:44:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3520032772079068919', time=2024-09-14T13:58:21.864819+0000, chain.objs.size()=1 2024-09-14T12:44:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DPFegIWslt39YOP3HYvjI4pdghBzpB8_0 2024-09-14T12:44:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16450039734439394688', time=2024-09-14T13:58:22.566044+0000, chain.objs.size()=1 2024-09-14T12:44:02.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NT2aWzXemij352V_ida1PnksP_jg_2C_0 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18384425545457836896', time=2024-09-14T13:58:25.984043+0000, chain.objs.size()=1 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.RNqzh1yREd_gG8OXPFvRmb_Ebcjer5x_0 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6207712935813281879', time=2024-09-14T13:58:27.470263+0000, chain.objs.size()=1 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IrC9BJapB4uyyuGfdSkmgdS2eLqpf8S_0 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15254219156796278764', time=2024-09-14T13:58:28.685682+0000, chain.objs.size()=1 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.62cG-JTLLeZaCqjgB65ukOrCpNJUThe_0 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3498487713935480738', time=2024-09-14T13:58:28.998102+0000, chain.objs.size()=1 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pB7aueYhHmuJyP7iVY2x9ro_bYzYF75_0 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4716084781551037360', time=2024-09-14T13:58:29.811057+0000, chain.objs.size()=1 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.UpoQEndpKF-wlYrQ1NcTd-1_y_4l-PV_0 2024-09-14T12:44:02.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2789952261454038943', time=2024-09-14T13:58:29.951413+0000, chain.objs.size()=1 2024-09-14T12:44:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6SaJOJk9p2hTiRb3PT90f6QjWafQUrl_0 2024-09-14T12:44:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12789274527400177782', time=2024-09-14T13:58:30.278225+0000, chain.objs.size()=1 2024-09-14T12:44:02.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.E6y4vEi54tCGwAYF5n3qzgRR6c-_6Qr_0 2024-09-14T12:44:02.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.525865866309894482', time=2024-09-14T13:58:30.713250+0000, chain.objs.size()=1 2024-09-14T12:44:02.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.yb-6NjRQL7hViadSgDNRx-O8diXkPnJ_0 2024-09-14T12:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9908930638953136609', time=2024-09-14T13:58:31.119026+0000, chain.objs.size()=1 2024-09-14T12:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fY_0NNSY-ZpZlYLvYGCicn6KEw9aS8q_0 2024-09-14T12:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14734736353328232686', time=2024-09-14T13:58:31.204248+0000, chain.objs.size()=1 2024-09-14T12:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XIvgLhzYHi_pSgg6ruc82q94AL7iMxo_0 2024-09-14T12:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6438171283363453942', time=2024-09-14T13:58:32.418676+0000, chain.objs.size()=1 2024-09-14T12:44:02.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.uhSZqGBH91rZkE5RRYyfqPoNBvM5Wrf_0 2024-09-14T12:44:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1952356023942757261', time=2024-09-14T13:58:32.746710+0000, chain.objs.size()=1 2024-09-14T12:44:02.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TwZsM3zNMLIHEHifGKgeQ5Om5mYz45D_0 2024-09-14T12:44:02.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14506526644912546365', time=2024-09-14T13:58:32.823052+0000, chain.objs.size()=1 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eys0vdQbhVQ0_z3Z5gZ4lqXwSlStZiW_0 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13880885390679640389', time=2024-09-14T13:58:33.322099+0000, chain.objs.size()=1 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XgGeEEbytF1Xk3pOYCP9hdytD5S-2QL_0 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5071986619270304925', time=2024-09-14T13:58:33.795566+0000, chain.objs.size()=1 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EC5C466JWjBCuF6aRNvnRdbIoOhONLl_0 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3042285450202398197', time=2024-09-14T14:00:22.392761+0000, chain.objs.size()=1 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dGQCr5B4u5CWT4d7qHOU1TzqakJH8Um_0 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8874388346075396904', time=2024-09-14T14:00:23.977602+0000, chain.objs.size()=1 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yeEZ2WYmQIBrh9SXqDWaB6CFnnQ_Vcf_0 2024-09-14T12:44:02.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9008616768820649461', time=2024-09-14T14:00:25.098776+0000, chain.objs.size()=1 2024-09-14T12:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dhdKDQ9kZxcDz_njWwr1UTl04o-PAO1_0 2024-09-14T12:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9331626151706986894', time=2024-09-14T14:00:25.808599+0000, chain.objs.size()=1 2024-09-14T12:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JyGIInI-R8zZNlQLMFHhODZDA1QSrGS_0 2024-09-14T12:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8182227142163995151', time=2024-09-14T14:00:25.810818+0000, chain.objs.size()=1 2024-09-14T12:44:02.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5km_AlqL7ZLYuwKfC_fQ-ZLrWKg_JGe_0 2024-09-14T12:44:02.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1542101883917429163', time=2024-09-14T14:00:26.684981+0000, chain.objs.size()=1 2024-09-14T12:44:02.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ugf1wq4rHiaYIqVUbb4hQLAqYJiNSmv_0 2024-09-14T12:44:02.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12945775665195079811', time=2024-09-14T14:00:26.797872+0000, chain.objs.size()=1 2024-09-14T12:44:02.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.phz16k03gaW843iC8nRMX2xON-Rbdif_0 2024-09-14T12:44:02.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16819560255522250479', time=2024-09-14T14:00:27.223885+0000, chain.objs.size()=1 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tdf2ZTZ5KJM3id-D5nUXN_oTNvsZFlE_0 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1587919046605041501', time=2024-09-14T14:00:29.051880+0000, chain.objs.size()=1 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bPAvWDgIG95pKOPQRENPP1XIUY8usd2_0 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5380502208063371695', time=2024-09-14T14:00:29.337310+0000, chain.objs.size()=1 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9J2JMSKBjd3JzKGf0n_X2kZl7s3yAUD_0 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4229038922299817872', time=2024-09-14T14:00:29.737444+0000, chain.objs.size()=1 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.v7NiqXDNULLOLRadWcM_AVMHe_GKNCM_0 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4556747311057646184', time=2024-09-14T14:00:33.376218+0000, chain.objs.size()=1 2024-09-14T12:44:02.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j8m5HHYuEqMDvEsPJdQJPIlpNqwSQGH_0 2024-09-14T12:44:02.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51253 2024-09-14T12:44:02.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3571870037819449060', time=2024-09-14T14:00:33.576919+0000, chain.objs.size()=1 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.z9C0DhCE5a-xZ1u3PA4Lg1W9rdL4SB9_0 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9640942706629062210', time=2024-09-14T14:00:34.831069+0000, chain.objs.size()=1 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Wlm6xvdbmQe-5BASq-a61niMr7xhOTO_0 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3790062266511414017', time=2024-09-14T14:00:34.923639+0000, chain.objs.size()=1 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WccAA-Bqt-6zm2IEfH2K88cYG_89yog_0 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15017610374390829522', time=2024-09-14T14:00:34.925875+0000, chain.objs.size()=1 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-a-tIBBA9UMgafctaZsHDke1-wNUi0p_0 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1850583542203338533', time=2024-09-14T14:00:37.126449+0000, chain.objs.size()=1 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.sUXWFY3yatggc0jM5jTN0fdP3Ef4AQQ_0 2024-09-14T12:44:02.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16379650785667025690', time=2024-09-14T14:00:37.228836+0000, chain.objs.size()=1 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QgeNjUR1Ez6PsZu2yu3KE2yp3-au4Ef_0 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6477408743035221219', time=2024-09-14T14:00:37.230307+0000, chain.objs.size()=1 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iPx7yYvfTGmPJYdByhKt5vM-GpXIz6Z_0 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17481125505077770240', time=2024-09-14T14:00:37.906054+0000, chain.objs.size()=1 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-yCIlNSWBl_vUm_gCFTPOg5242DDZNZ_0 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6944904380936250044', time=2024-09-14T14:00:39.313790+0000, chain.objs.size()=1 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3Hcxi31MiBLvFZIsZmQroTdY2GxT0Pj_0 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14911582867466091299', time=2024-09-14T14:00:39.315896+0000, chain.objs.size()=1 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AqiGuPIze6s6BvQ4_MkV-oihVcHTU7s_0 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6561408390764494189', time=2024-09-14T14:00:39.489191+0000, chain.objs.size()=1 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2LiM8AuiDQKK-7vHVYTO8kx3CGgtWue_0 2024-09-14T12:44:02.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16617609115339719587', time=2024-09-14T14:00:40.366994+0000, chain.objs.size()=1 2024-09-14T12:44:02.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kTxXSWWS8OTADF4g4JOPL3ngYrbb4IR_0 2024-09-14T12:44:02.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11981812396354804135', time=2024-09-14T14:00:40.461200+0000, chain.objs.size()=1 2024-09-14T12:44:02.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YclyhnBhSAOxmey3QA-xNIFkxmNfx6c_0 2024-09-14T12:44:02.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6199178962287579663', time=2024-09-14T14:00:41.441534+0000, chain.objs.size()=1 2024-09-14T12:44:02.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3IWJ54VMBgPVqN2EczWKuzjDgxNR_BY_0 2024-09-14T12:44:02.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.636507829865805328', time=2024-09-14T14:00:41.912310+0000, chain.objs.size()=1 2024-09-14T12:44:02.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LkSLalZdv3gLgLfTCDGwoSnx2BTNLQw_0 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14299647122187605598', time=2024-09-14T14:00:42.427713+0000, chain.objs.size()=1 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Lwt3vCGOiw590uPUVxci9uKaM2Q_vdW_0 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11774538315519117325', time=2024-09-14T14:00:43.268042+0000, chain.objs.size()=1 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NbFo5koh7twLjLo6WiHf96DGrDWmX38_0 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7625919655913308040', time=2024-09-14T14:00:45.467352+0000, chain.objs.size()=1 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5UjtwJsaQwR2nTqGLH8pOW2zJ9irm2d_0 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17168109897805187570', time=2024-09-14T14:00:46.744308+0000, chain.objs.size()=1 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.aBQfKNGPQUNg0m5XllrxSiVsU9Si6Qy_0 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16178565335129656311', time=2024-09-14T14:00:46.824872+0000, chain.objs.size()=1 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ja7Kg_SmlCdruT-UUpwifaAiKo214Hj_0 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17603730296002894196', time=2024-09-14T14:00:48.875661+0000, chain.objs.size()=1 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Oh1xitHoml1CU-P1oFmYQvmO03jVI0I_0 2024-09-14T12:44:02.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16371836291365642935', time=2024-09-14T14:00:49.670349+0000, chain.objs.size()=1 2024-09-14T12:44:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rDAM82zC1ANhqWKAZGaWCglg7LrzCaw_0 2024-09-14T12:44:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5536912379886568291', time=2024-09-14T14:00:49.760242+0000, chain.objs.size()=1 2024-09-14T12:44:02.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UZqDebEBQkQU-56hb9D-NMcPZA_uUZy_0 2024-09-14T12:44:02.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14451600644302917823', time=2024-09-14T14:02:58.717002+0000, chain.objs.size()=1 2024-09-14T12:44:02.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.385__shadow_.br0NHpDBSRcHIh-OXUkIzNOIHPf1I0R_0 2024-09-14T12:44:02.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4697856460547293043', time=2024-09-14T14:05:52.803017+0000, chain.objs.size()=1 2024-09-14T12:44:02.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.459__shadow_.uZAbTgMw1UGGQ5IFTFvImVxuXwmcUMc_0 2024-09-14T12:44:02.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12060720844499822129', time=2024-09-14T14:06:14.307427+0000, chain.objs.size()=1 2024-09-14T12:44:02.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.466__shadow_.89AVKfSG5f_CMHKxGD204C0jMFjKjIP_0 2024-09-14T12:44:02.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7983417391414319767', time=2024-09-14T14:06:46.764158+0000, chain.objs.size()=1 2024-09-14T12:44:02.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.HzrrQ4CCy5gyg_dLNUtlxnU6ITbrXN2_0 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2876015465991239044', time=2024-09-14T14:06:46.766036+0000, chain.objs.size()=1 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.JN8KV53jpkvHXT3yll_qbVq-MUpEVPw_0 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13416705446233218463', time=2024-09-14T14:08:24.377535+0000, chain.objs.size()=6 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.1 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.2 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.3 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.4 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.5 2024-09-14T12:44:02.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.6 2024-09-14T12:44:02.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7040702127717471047', time=2024-09-14T14:17:45.071085+0000, chain.objs.size()=1 2024-09-14T12:44:02.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.554__shadow_.KlUInp4bRtUMQ7yQfs1jXfJz4RLhUGs_0 2024-09-14T12:44:02.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4470099571929609042', time=2024-09-14T14:20:05.593159+0000, chain.objs.size()=1 2024-09-14T12:44:02.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow:a4oZgIZyP5RpkyZchc9CTMIBVIfHkjv_.jhSvpR3WI78WMZNod8qrtO3RCzUZJWb_0 2024-09-14T12:44:02.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6141664405434262274', time=2024-09-14T14:22:18.980886+0000, chain.objs.size()=1 2024-09-14T12:44:02.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.583__shadow:12uo3Qxt34qWhvW-Fmsglnk3HkfEsCF_.2TRKiH4Sp9J6vDHMGnrPQDIKeHAKMtz_0 2024-09-14T12:44:02.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16196549133141820236', time=2024-09-14T14:22:29.006909+0000, chain.objs.size()=1 2024-09-14T12:44:02.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.586__shadow:7btJpHLKt.W0oyyuTc7CcGttdv9BBiN_.U5Ao3fywYeDqO4fRmax2QERQ3X8jT6B_0 2024-09-14T12:44:02.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8549771666474927592', time=2024-09-14T14:22:37.662653+0000, chain.objs.size()=1 2024-09-14T12:44:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:qC6bQncpNBxY4TmvOsXLuZGzF4NR2Tf_.s1otS0M7pi4wjvLtnx5P0df520gLEog_0 2024-09-14T12:44:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12170590416567752047', time=2024-09-14T14:22:37.709930+0000, chain.objs.size()=1 2024-09-14T12:44:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:08tVUhTnL.u0XdCal9He4Hhn4VNi8xY_.vcs7lJzVrnGrcJ3OAinzsdh95Z_QhtK_0 2024-09-14T12:44:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10514360954666444707', time=2024-09-14T14:26:09.096684+0000, chain.objs.size()=1 2024-09-14T12:44:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.617__shadow_.gWZ6I4D7eqX-4z1XwiXMb-DrE_YuEZo_0 2024-09-14T12:44:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2288295955884975446', time=2024-09-14T14:32:36.219658+0000, chain.objs.size()=1 2024-09-14T12:44:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.664__shadow_.NhTzOUVXFHZsnDn54bDkg2JIYM7tPO6_0 2024-09-14T12:44:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17764761238108595235', time=2024-09-14T14:33:36.687689+0000, chain.objs.size()=1 2024-09-14T12:44:02.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.693__shadow:l8qGJjXlSssBjGdu8g.CI0ioOnELPN._.BQzqu7cN6jisQpJlYrbrPe4VzjiRSjV_0 2024-09-14T12:44:02.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15986139714529554472', time=2024-09-14T14:34:41.474445+0000, chain.objs.size()=1 2024-09-14T12:44:02.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.717__shadow:dYzml2J8XC2565e69ve1CkevLzpuhwo_.AoFkJ6bEVgt4Ok_9xgakBs4lx6ZEe2o_0 2024-09-14T12:44:02.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4681164639610246555', time=2024-09-14T14:36:14.693736+0000, chain.objs.size()=1 2024-09-14T12:44:02.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.743__multipart_mymultipart3.2~81GqlZFMtd9NgsXb-L75uV7nyyXUpWK.1 2024-09-14T12:44:02.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2506632958319996204', time=2024-09-14T14:37:18.784479+0000, chain.objs.size()=1 2024-09-14T12:44:02.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.747__shadow_.bN4SvWEOxwPtH4N5ghItiM27SekX-sX_0 2024-09-14T12:44:02.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:02.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T12:44:02.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:02.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:02.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45247' 2024-09-14T12:44:02.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11213017956603492358', time=2024-09-14T13:44:02.616660+0000, chain.objs.size()=5 2024-09-14T12:44:02.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-FROZEN.2~WRHCn3XsVrsegODdivOeXMCvzXFU1q2.1 2024-09-14T12:44:02.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_foo-FROZEN.2~WRHCn3XsVrsegODdivOeXMCvzXFU1q2.1_1 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-FROZEN.2~WRHCn3XsVrsegODdivOeXMCvzXFU1q2.2 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_foo-FROZEN.2~WRHCn3XsVrsegODdivOeXMCvzXFU1q2.2_1 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-FROZEN.2~WRHCn3XsVrsegODdivOeXMCvzXFU1q2.3 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17772965091422144126', time=2024-09-14T13:49:56.816032+0000, chain.objs.size()=1 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.231__shadow_.heeRbqDgbKZI8HdGSAS4WlI7jBqDWZU_0 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7212353436676601829', time=2024-09-14T13:50:10.317751+0000, chain.objs.size()=1 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.236__shadow_.n94YGPY5uyCdxs3pzlzcE4D4LsfrqmI_0 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16787834782500554112', time=2024-09-14T13:50:53.507485+0000, chain.objs.size()=1 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.251__shadow_.gU4UrAvFEMk14kra0ZT8dFEbkWFwSWd_0 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9729491810445796399', time=2024-09-14T13:51:03.619499+0000, chain.objs.size()=1 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.255__shadow_.jk1kJRin93YqYYrmaQpKrwRnXCJXkpS_0 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17683813648088317073', time=2024-09-14T13:53:06.922141+0000, chain.objs.size()=1 2024-09-14T12:44:02.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.er6SBpOzkhoTprEA_za9-5n7UT7b3rg_0 2024-09-14T12:44:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17098738782642590582', time=2024-09-14T13:53:07.006573+0000, chain.objs.size()=1 2024-09-14T12:44:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xreJAzhDD5nkbNdahserBwV188GdFG5_0 2024-09-14T12:44:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6812770990913047433', time=2024-09-14T13:53:07.008189+0000, chain.objs.size()=1 2024-09-14T12:44:02.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.e7ikmEAmrQ1zxrF-MlT4Z0rNulsBnAD_0 2024-09-14T12:44:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14337618849387291551', time=2024-09-14T13:53:07.715189+0000, chain.objs.size()=1 2024-09-14T12:44:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.M903MVEeqOBhZHiJAS7_1-kuesHe11-_0 2024-09-14T12:44:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14129265855733948505', time=2024-09-14T13:53:10.028080+0000, chain.objs.size()=1 2024-09-14T12:44:02.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uxCqZMyjwNwmjChMm3uLAt7ugc2Y0kp_0 2024-09-14T12:44:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3333626425596560025', time=2024-09-14T13:53:10.050313+0000, chain.objs.size()=1 2024-09-14T12:44:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BqWwYxPzmLzEvrsp_RzkvoHrX11H0qB_0 2024-09-14T12:44:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9463871162361235086', time=2024-09-14T13:53:11.522635+0000, chain.objs.size()=1 2024-09-14T12:44:02.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6AotfFN9yL6IW-nMcnW4slF643J2Esw_0 2024-09-14T12:44:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6256081290384201317', time=2024-09-14T13:53:11.673808+0000, chain.objs.size()=1 2024-09-14T12:44:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LZb1JWrvGFX-50_I2GrG_oAjPUGxitg_0 2024-09-14T12:44:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13579443333369088294', time=2024-09-14T13:53:12.466115+0000, chain.objs.size()=1 2024-09-14T12:44:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.l2jPUQvxJHfaruZVNwHr4NjGbS66JBf_0 2024-09-14T12:44:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11674599900099199530', time=2024-09-14T13:53:13.692309+0000, chain.objs.size()=1 2024-09-14T12:44:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._bqFmLknMpj3B4W46OOc-VgRXI9MRHt_0 2024-09-14T12:44:02.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17910181389530352680', time=2024-09-14T13:53:15.779681+0000, chain.objs.size()=1 2024-09-14T12:44:02.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KCGJDveEqt07gS7j9CbRD6VHf5clmBl_0 2024-09-14T12:44:02.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4789907126130358541', time=2024-09-14T13:53:15.789017+0000, chain.objs.size()=1 2024-09-14T12:44:02.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.NWnvDmcQredCavAVMlVfuljWKNvtKSf_0 2024-09-14T12:44:02.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10823312067288915754', time=2024-09-14T13:53:16.615952+0000, chain.objs.size()=1 2024-09-14T12:44:02.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dQzCyoujd3SWZBjSWqo9_Ku_R4kMACE_0 2024-09-14T12:44:02.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1885327286309402659', time=2024-09-14T13:53:17.933966+0000, chain.objs.size()=1 2024-09-14T12:44:02.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._DK7FX4YIrbyBobjkCmXctHuZhYRtyQ_0 2024-09-14T12:44:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7521521710987398401', time=2024-09-14T13:53:18.233727+0000, chain.objs.size()=1 2024-09-14T12:44:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lE-v34cumMJozdyikQHu9ZnN7X4wvTL_0 2024-09-14T12:44:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2055197754747793725', time=2024-09-14T13:53:18.743044+0000, chain.objs.size()=1 2024-09-14T12:44:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PV8tVvQGvZuCmFNEH3oEqDDnU1h3Oaw_0 2024-09-14T12:44:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6815921189392761147', time=2024-09-14T13:53:18.762755+0000, chain.objs.size()=1 2024-09-14T12:44:02.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hqPgMbYp8iIHPIbrUY5Kye0BO-hX9du_0 2024-09-14T12:44:02.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7576544888140025646', time=2024-09-14T13:53:19.030901+0000, chain.objs.size()=1 2024-09-14T12:44:02.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.15u46x06-rrkKTcppTl6RtKR7p2sabE_0 2024-09-14T12:44:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3689683338618539626', time=2024-09-14T13:53:19.119099+0000, chain.objs.size()=1 2024-09-14T12:44:02.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cAUQSYCRAyfr3IuqaOIPkADA7udwL17_0 2024-09-14T12:44:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9137101302168916334', time=2024-09-14T13:53:19.535595+0000, chain.objs.size()=1 2024-09-14T12:44:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6EQ9SDfIk-WaWWvCpRza5qapnCp9iqU_0 2024-09-14T12:44:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4854018173010562092', time=2024-09-14T13:53:19.578608+0000, chain.objs.size()=1 2024-09-14T12:44:02.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Y7gqmOQzpAe5AKiTtGom2s_hAlQG750_0 2024-09-14T12:44:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8429805520094058255', time=2024-09-14T13:53:19.666213+0000, chain.objs.size()=1 2024-09-14T12:44:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8ZVUFPhXz2e-ujM1QhhpqtSgp_df9C__0 2024-09-14T12:44:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15758351843922868653', time=2024-09-14T13:53:19.937396+0000, chain.objs.size()=1 2024-09-14T12:44:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uK0YiiOeSLOZzY1H_pYEFmzlAQ5x9lm_0 2024-09-14T12:44:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3236592680634529936', time=2024-09-14T13:53:20.459044+0000, chain.objs.size()=1 2024-09-14T12:44:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.J-EAvF-m-K8LqHD775wLx4kECQlDf7t_0 2024-09-14T12:44:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13723308840492803707', time=2024-09-14T13:53:21.697070+0000, chain.objs.size()=1 2024-09-14T12:44:02.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7jgkLn9oPMMypUp6g4pSy5gKzXS2U7u_0 2024-09-14T12:44:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1187058281869250748', time=2024-09-14T13:53:22.034931+0000, chain.objs.size()=1 2024-09-14T12:44:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qBMBzxGzwUEBpLDPoIbnOON1AZ-azat_0 2024-09-14T12:44:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6067437952809680559', time=2024-09-14T13:53:22.480974+0000, chain.objs.size()=1 2024-09-14T12:44:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lFsaktM3mt0lkHgKBC7HW1OuS7tYrzq_0 2024-09-14T12:44:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4828964820686688835', time=2024-09-14T13:53:23.430843+0000, chain.objs.size()=1 2024-09-14T12:44:02.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._8M0En1Oe9afv8SZDMMbBUo_HyTdeZt_0 2024-09-14T12:44:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1862944264899001648', time=2024-09-14T13:53:25.290927+0000, chain.objs.size()=1 2024-09-14T12:44:02.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9ZElYM9KkkQaTtV_vwPXyqmatyOUpRO_0 2024-09-14T12:44:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11010537330856736627', time=2024-09-14T13:53:25.445476+0000, chain.objs.size()=1 2024-09-14T12:44:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VEpU-ro3MJbEbiD_cs1EgKijDqVAiud_0 2024-09-14T12:44:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6401352388094516938', time=2024-09-14T13:53:25.467150+0000, chain.objs.size()=1 2024-09-14T12:44:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Y0A3DDYleKmvBRqkgJP5-6MAsgJaO9G_0 2024-09-14T12:44:02.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7927593553077748302', time=2024-09-14T13:53:26.449240+0000, chain.objs.size()=1 2024-09-14T12:44:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-mxBVWztKk1TEpagf63_eM0btjhDjqK_0 2024-09-14T12:44:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10266698645976177004', time=2024-09-14T13:53:28.831008+0000, chain.objs.size()=1 2024-09-14T12:44:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Ou6ceatcB0xyslGd2pFflzXS9g8AwY7_0 2024-09-14T12:44:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4754120968124337367', time=2024-09-14T13:53:29.419967+0000, chain.objs.size()=1 2024-09-14T12:44:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FzBZv0GL54tcxn9eIZDvUeO69SiH_jf_0 2024-09-14T12:44:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3051932389460439870', time=2024-09-14T13:53:29.488558+0000, chain.objs.size()=1 2024-09-14T12:44:02.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vrAq0WgbIani9asGTgmUYxi6TNLuCQR_0 2024-09-14T12:44:02.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7535276717679759873', time=2024-09-14T13:53:34.895519+0000, chain.objs.size()=1 2024-09-14T12:44:02.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cfEZFfDAI5DUwMJsI6F9fZWiM4Ja20t_0 2024-09-14T12:44:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2336007675684848821', time=2024-09-14T13:53:35.121696+0000, chain.objs.size()=1 2024-09-14T12:44:02.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LNe8cUsbekDsSbUpf5Cs51u0scl-ST6_0 2024-09-14T12:44:02.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12931063927723335538', time=2024-09-14T13:53:35.154045+0000, chain.objs.size()=1 2024-09-14T12:44:02.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nshVM4iTQyxZNbz7gneQ061rEXCcRCc_0 2024-09-14T12:44:02.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7395403609320964773', time=2024-09-14T13:54:16.300107+0000, chain.objs.size()=1 2024-09-14T12:44:02.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.280__shadow_.53fyjPFmTR6L1ngvdla3cxyPd3XKx7U_0 2024-09-14T12:44:02.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13311538947402654213', time=2024-09-14T13:54:31.475092+0000, chain.objs.size()=1 2024-09-14T12:44:02.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.286__shadow_.qv8wVtZhHiWfELSe2NjDii6w5tYU6db_0 2024-09-14T12:44:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8894880506221816491', time=2024-09-14T13:54:52.930029+0000, chain.objs.size()=1 2024-09-14T12:44:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.LPhJ7rtRciISgnqiIujyFa2TdwGNgFe_0 2024-09-14T12:44:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10674030164587313963', time=2024-09-14T13:54:58.670938+0000, chain.objs.size()=1 2024-09-14T12:44:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.yKv7CVIBZBhyw5-RE0o9KpMY8VrWHjI_0 2024-09-14T12:44:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3163853219601202588', time=2024-09-14T13:54:58.751896+0000, chain.objs.size()=1 2024-09-14T12:44:02.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.juLcSwau0L3ompdgqQJMPr0lzmcsJAK_0 2024-09-14T12:44:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6146088640770309063', time=2024-09-14T13:54:58.830523+0000, chain.objs.size()=1 2024-09-14T12:44:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.ifIqLc5klEidwH8O9_mcgfWaFuIbLfO_0 2024-09-14T12:44:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2007992741974840218', time=2024-09-14T13:55:06.638269+0000, chain.objs.size()=1 2024-09-14T12:44:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.297__shadow_.onJlcuOw7vh_HXQD8NL4rFvOD6fG2vg_0 2024-09-14T12:44:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10706128314837657562', time=2024-09-14T13:55:14.297634+0000, chain.objs.size()=1 2024-09-14T12:44:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.300__shadow_.K4zXtbObRnmhEvbjJTcVHmCvKCzZAx-_0 2024-09-14T12:44:02.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9303459202901137661', time=2024-09-14T13:55:21.929665+0000, chain.objs.size()=1 2024-09-14T12:44:02.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.303__shadow_.Sg4gN9DFwO9X1EJ9q0vIT6XcGo10knd_0 2024-09-14T12:44:02.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13989886066884232465', time=2024-09-14T13:55:21.951521+0000, chain.objs.size()=1 2024-09-14T12:44:02.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.303__shadow_.fLhJIc5T4VR9WATW0vzEb87AdOyoRiz_0 2024-09-14T12:44:02.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2302787795752817072', time=2024-09-14T13:55:24.472872+0000, chain.objs.size()=1 2024-09-14T12:44:02.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.304__shadow_.Y6Wgm7OEAaWDQXQ82yNrQYHr29gg7_S_0 2024-09-14T12:44:02.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1622013811779174509', time=2024-09-14T13:58:05.526541+0000, chain.objs.size()=1 2024-09-14T12:44:02.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tvDfrxi4xZ1FcbiDnWbq7hkr1zM6xhB_0 2024-09-14T12:44:02.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11293484291772219608', time=2024-09-14T13:58:05.982129+0000, chain.objs.size()=1 2024-09-14T12:44:02.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-WDxaVWfQs-FIeDu4mH44lXsmnBZ9o8_0 2024-09-14T12:44:02.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8596290177040517906', time=2024-09-14T13:58:06.304706+0000, chain.objs.size()=1 2024-09-14T12:44:02.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1ouqodhT4ZRCMZp7HQbFqKYMyWXV_D7_0 2024-09-14T12:44:02.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17890428521447415126', time=2024-09-14T13:58:07.491541+0000, chain.objs.size()=1 2024-09-14T12:44:02.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.frGaD70QTQ1jRAnLtyo8w7cYPeBUj9f_0 2024-09-14T12:44:02.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3042238778575053148', time=2024-09-14T13:58:08.000610+0000, chain.objs.size()=1 2024-09-14T12:44:02.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lnZOq9zDdG2mbqfavc1ZurHTtIDi0SW_0 2024-09-14T12:44:02.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17852825335390487121', time=2024-09-14T13:58:09.523240+0000, chain.objs.size()=1 2024-09-14T12:44:02.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.p-Cj9CJSdWxPCvr02ZpJ9Xkx7Uqni33_0 2024-09-14T12:44:02.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.989+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8593421655457755549', time=2024-09-14T13:58:09.814394+0000, chain.objs.size()=1 2024-09-14T12:44:02.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.989+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YbD0B6-bUeKaKI2g1oruGGEnaZ7tYeH_0 2024-09-14T12:44:02.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.989+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18037660903404067400', time=2024-09-14T13:58:10.102593+0000, chain.objs.size()=1 2024-09-14T12:44:02.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.989+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3YVrH4pZH98kC4a7nqa7Qju_0KIMSSQ_0 2024-09-14T12:44:02.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.989+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10441071299722024241', time=2024-09-14T13:58:10.366572+0000, chain.objs.size()=1 2024-09-14T12:44:02.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.989+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ytpgGvpC6YKadw7j4I6tO0ZRY_PY9UY_0 2024-09-14T12:44:02.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1494756851967422797', time=2024-09-14T13:58:10.992315+0000, chain.objs.size()=1 2024-09-14T12:44:02.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HlZDQV57OveMIAHPkjAIftKWaBBpIPr_0 2024-09-14T12:44:02.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8180259600101338456', time=2024-09-14T13:58:11.149698+0000, chain.objs.size()=1 2024-09-14T12:44:02.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.U2wg6lVz7CVS7jYO045kW9MRbXCJbFG_0 2024-09-14T12:44:02.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14110353899435945750', time=2024-09-14T13:58:11.871824+0000, chain.objs.size()=1 2024-09-14T12:44:02.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oMC7scnNnvlwnkKkiYEw730NGyOOekU_0 2024-09-14T12:44:02.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1923434948140279865', time=2024-09-14T13:58:13.462084+0000, chain.objs.size()=1 2024-09-14T12:44:02.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PdD7lY9c8mcJqzLAX0wYh1Hmk93SvSK_0 2024-09-14T12:44:02.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4357055437989342931', time=2024-09-14T13:58:13.463884+0000, chain.objs.size()=1 2024-09-14T12:44:02.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.75eTTLh3lLQjWk2BGYCclk3vLqPi3h__0 2024-09-14T12:44:02.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9136887756871353661', time=2024-09-14T13:58:14.293705+0000, chain.objs.size()=1 2024-09-14T12:44:02.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Fkz487UWnJQ1S1lO4wFpHUio51Rb-Bu_0 2024-09-14T12:44:02.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6433008112449000318', time=2024-09-14T13:58:17.308550+0000, chain.objs.size()=1 2024-09-14T12:44:02.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HF-ZKjZUq6yXmEmSyJIMKpVzknONztr_0 2024-09-14T12:44:02.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13128069026467231536', time=2024-09-14T13:58:18.874197+0000, chain.objs.size()=1 2024-09-14T12:44:02.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.32xFDEIhDIO9YYCM3OMsAl9O-1njZuN_0 2024-09-14T12:44:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2013409648657817604', time=2024-09-14T13:58:19.060767+0000, chain.objs.size()=1 2024-09-14T12:44:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.k69n4rWwSlIeDA_ejasQ911X684v_Dg_0 2024-09-14T12:44:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17972551683280739054', time=2024-09-14T13:58:19.113216+0000, chain.objs.size()=1 2024-09-14T12:44:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.B_e04_MtYqEzuIsHi37Lh1ujv8OG3Fr_0 2024-09-14T12:44:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3189923804234704209', time=2024-09-14T13:58:19.466710+0000, chain.objs.size()=1 2024-09-14T12:44:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0wb6ZUs5KMVowuezWz3IgEjRDFe40JU_0 2024-09-14T12:44:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6935606756249410610', time=2024-09-14T13:58:20.019988+0000, chain.objs.size()=1 2024-09-14T12:44:02.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:02.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nKROURIY599MryGxo3kOw_E0AvQRGyD_0 2024-09-14T12:44:02.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5816048373612936276', time=2024-09-14T13:58:21.543030+0000, chain.objs.size()=1 2024-09-14T12:44:02.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-6Qzq-i2rTh1q2BPAkKCe0XEWHLGKHo_0 2024-09-14T12:44:02.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7117914604559618273', time=2024-09-14T13:58:22.096799+0000, chain.objs.size()=1 2024-09-14T12:44:02.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.s6WJxVJyeOB0yqEu2w7gs4-krlgVYMh_0 2024-09-14T12:44:02.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15806695250981025590', time=2024-09-14T13:58:22.190797+0000, chain.objs.size()=1 2024-09-14T12:44:02.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PAHPr9RraSSgRhVS7jn6tCjHSQRZsAO_0 2024-09-14T12:44:02.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9752272686380155614', time=2024-09-14T13:58:24.873522+0000, chain.objs.size()=1 2024-09-14T12:44:02.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3-cY-Zk0HjxTxd7ckRmTFlqz__GX4Q-_0 2024-09-14T12:44:02.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14762215702553987243', time=2024-09-14T13:58:24.875592+0000, chain.objs.size()=1 2024-09-14T12:44:02.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2-jPF6otSm8ndeoWwSpIWI0sUoBdxlb_0 2024-09-14T12:44:02.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10802304230006184118', time=2024-09-14T13:58:24.916657+0000, chain.objs.size()=1 2024-09-14T12:44:02.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ccJqyhrfZuCcx6ik0BRWwcUgf-DLRVa_0 2024-09-14T12:44:02.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10835929989671350126', time=2024-09-14T13:58:25.650404+0000, chain.objs.size()=1 2024-09-14T12:44:02.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.f8izYg--ntdaz3aN0G3TBogZKofuhRK_0 2024-09-14T12:44:02.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7048292322039039311', time=2024-09-14T13:58:25.971531+0000, chain.objs.size()=1 2024-09-14T12:44:02.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.zKC0P4M4mNWA3_Usn1IjgoXkDguYejC_0 2024-09-14T12:44:02.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10898631741526688850', time=2024-09-14T13:58:27.693390+0000, chain.objs.size()=1 2024-09-14T12:44:02.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wdQa5RoVL4UH9qBJ_O_DwEaTeTI9K4R_0 2024-09-14T12:44:02.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1965218703394338208', time=2024-09-14T13:58:32.915698+0000, chain.objs.size()=1 2024-09-14T12:44:02.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xGb6tK9jwgzesfXs4lymx9HgMDJse7h_0 2024-09-14T12:44:02.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11422048871052371603', time=2024-09-14T13:58:33.409674+0000, chain.objs.size()=1 2024-09-14T12:44:02.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.SMHAwKWZkLNCoKVxLjrGm5-1tqglRli_0 2024-09-14T12:44:02.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9619992467455980487', time=2024-09-14T13:58:33.780115+0000, chain.objs.size()=1 2024-09-14T12:44:02.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Ia8iHjemNrUSaTl-ZIb_K5JfVLerVxY_0 2024-09-14T12:44:02.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.248836031505440242', time=2024-09-14T13:58:33.974181+0000, chain.objs.size()=1 2024-09-14T12:44:02.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.iZ8rLrabWmy5siRaPpWIJn0FqJqXGkf_0 2024-09-14T12:44:02.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4589402834313097280', time=2024-09-14T14:00:21.643485+0000, chain.objs.size()=1 2024-09-14T12:44:02.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.aiemWqh_UqS9tobcR5t1RpeYvdCts4z_0 2024-09-14T12:44:02.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13700748884372562767', time=2024-09-14T14:00:22.508305+0000, chain.objs.size()=1 2024-09-14T12:44:02.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.R3zF7k119aofMAIpdvhUWv7NiXNOMBC_0 2024-09-14T12:44:03.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13336281199925869560', time=2024-09-14T14:00:22.510386+0000, chain.objs.size()=1 2024-09-14T12:44:03.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Q46H8D2gNpzP2ajvVf-2daHnvG1yfle_0 2024-09-14T12:44:03.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.529487542071579793', time=2024-09-14T14:00:23.935983+0000, chain.objs.size()=1 2024-09-14T12:44:03.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fZ9uPY9qNqPs2zBVTLqamT22ZmcGCZL_0 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13450821542529351120', time=2024-09-14T14:00:25.803582+0000, chain.objs.size()=1 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ntcLh-CIDkvXeEEsA-XVDr57ufMSPnZ_0 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4635777561133374239', time=2024-09-14T14:00:26.179174+0000, chain.objs.size()=1 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WsuL3ujBJg6qUTMsO5WTQ2aBvjBPihY_0 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9676391049928806960', time=2024-09-14T14:00:27.614034+0000, chain.objs.size()=1 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5wJwCsLCN-UFBjM-VUQyjhzYghnftCw_0 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6911029970783599366', time=2024-09-14T14:00:29.061879+0000, chain.objs.size()=1 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.n983Wm5BhvS9Ts42hzyTe5bJ2opIU3k_0 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.381466378903506101', time=2024-09-14T14:00:29.403432+0000, chain.objs.size()=1 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.7KYjy2NkcA2DwMAPZjNsXIQ3Acv0pI7_0 2024-09-14T12:44:03.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12922232845362443513', time=2024-09-14T14:00:30.006519+0000, chain.objs.size()=1 2024-09-14T12:44:03.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ikICS8QgCowUVZ_7x7jNKo2wqEuJ8AH_0 2024-09-14T12:44:03.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7623768577724418894', time=2024-09-14T14:00:31.476092+0000, chain.objs.size()=1 2024-09-14T12:44:03.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JdH8sq82YeX47sR3kL0ZoFfSHo21Y9V_0 2024-09-14T12:44:03.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12398354222284378354', time=2024-09-14T14:00:33.749179+0000, chain.objs.size()=1 2024-09-14T12:44:03.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.u955wr_PxhNx-d6kO6roOuxdnE8r_mF_0 2024-09-14T12:44:03.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.017+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45247 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.953817587634494312', time=2024-09-14T14:00:34.143628+0000, chain.objs.size()=1 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uH5cR82ipFxBCxLYZJ8QCLBcCKDksUJ_0 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17830465977287577717', time=2024-09-14T14:00:36.672306+0000, chain.objs.size()=1 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j21nTY4MgMIz6CY3vz-ywxP8XVTlmKm_0 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2231942269056619391', time=2024-09-14T14:00:36.743636+0000, chain.objs.size()=1 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fnIqBlQpSEQ5MgRYvV2oRaLuLvSqZJz_0 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5466757682611146598', time=2024-09-14T14:00:38.184745+0000, chain.objs.size()=1 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.p3dLTHu6ePQQCc3QHZaKexXGguvx0zu_0 2024-09-14T12:44:03.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1464867006498039888', time=2024-09-14T14:00:38.870221+0000, chain.objs.size()=1 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.C8apc6kg7775im-YIwxBgLDR6nnzXgi_0 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15205384060181869788', time=2024-09-14T14:00:40.469727+0000, chain.objs.size()=1 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YOSlW6SjVy1aIr3l1UqpwMdIJiMBlCI_0 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3794323366975531855', time=2024-09-14T14:00:41.087030+0000, chain.objs.size()=1 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.L9rPCwgNDYE_i3w_-NJZGofyi-95Hn7_0 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12838506686110877805', time=2024-09-14T14:00:41.574035+0000, chain.objs.size()=1 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iYQMZxKpcKujGUJ4A3I_KDZz6-jNL8B_0 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.167070793572634630', time=2024-09-14T14:00:42.030426+0000, chain.objs.size()=1 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.12shm14PVpSkKYgYO3GY14eFrMDeImM_0 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11798081296414287598', time=2024-09-14T14:00:44.556547+0000, chain.objs.size()=1 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qV7OldUXHqV9oNk7ZW1FDXAcoWZsYqI_0 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3334473758407849294', time=2024-09-14T14:00:44.746562+0000, chain.objs.size()=1 2024-09-14T12:44:03.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.V0tasHXH_rZVJD4Iup76b5tVrVsd_pF_0 2024-09-14T12:44:03.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14843243886118782848', time=2024-09-14T14:00:45.105533+0000, chain.objs.size()=1 2024-09-14T12:44:03.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Y1Pm0T8PSGfnS3DuZTbJLPlCMYcEQFf_0 2024-09-14T12:44:03.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14427111558460622999', time=2024-09-14T14:00:45.225120+0000, chain.objs.size()=1 2024-09-14T12:44:03.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fKO1384G-cKwDuB_Y9ANaidgMS_M0R8_0 2024-09-14T12:44:03.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14623529461860620689', time=2024-09-14T14:00:45.680292+0000, chain.objs.size()=1 2024-09-14T12:44:03.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2mCh-lBAYXujyyyRbHevdjhor-OdXAX_0 2024-09-14T12:44:03.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15391940581371056972', time=2024-09-14T14:00:45.682295+0000, chain.objs.size()=1 2024-09-14T12:44:03.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yE5B7A7EoQci2nO5_OlzmA2-xOVSuHF_0 2024-09-14T12:44:03.016 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8611681027170549793', time=2024-09-14T14:00:46.659589+0000, chain.objs.size()=1 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-G62G41xc5xRY8lQl5cG0V7XEEKNoCj_0 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.635435494842036631', time=2024-09-14T14:00:46.958271+0000, chain.objs.size()=1 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pS820NkikHQ1uZA3P6wQIaC1kbLaLo3_0 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18325731478275642939', time=2024-09-14T14:00:47.636064+0000, chain.objs.size()=1 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.z7DNDZZId8p5EgTzH98YKAOHpww33CV_0 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3891998460800383553', time=2024-09-14T14:00:49.045269+0000, chain.objs.size()=1 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.E3PLLhooNQa8WEN_SLbx1VwPnFSsFCa_0 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14018917105447405726', time=2024-09-14T14:00:49.623793+0000, chain.objs.size()=1 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gZ9BzYOyIIRE8d9yX9_ynm4QD6b3weW_0 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3651831411879124731', time=2024-09-14T14:00:49.935004+0000, chain.objs.size()=1 2024-09-14T12:44:03.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.F60vROPFAahqYpSDqZ1QzT8XhESzGeN_0 2024-09-14T12:44:03.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7177079803276227700', time=2024-09-14T14:06:08.714539+0000, chain.objs.size()=1 2024-09-14T12:44:03.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.464__shadow_.pen2JiMfIi9I-YQnEF1zzmVstpiIERV_0 2024-09-14T12:44:03.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16031399465557051159', time=2024-09-14T14:06:46.800680+0000, chain.objs.size()=1 2024-09-14T12:44:03.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.uy8Fwan9MSubYLKqJvzO7sgKBeegZ3F_0 2024-09-14T12:44:03.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.029+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14933075625383647118', time=2024-09-14T14:06:49.680492+0000, chain.objs.size()=1 2024-09-14T12:44:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.029+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.485__shadow_.5b8u0dW80hP0OKuS_M_siHOvDuQMcw7_0 2024-09-14T12:44:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.029+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12620294376142160039', time=2024-09-14T14:08:23.710703+0000, chain.objs.size()=6 2024-09-14T12:44:03.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.029+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.1 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.2 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.3 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.4 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.5 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.6 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13908035062078318133', time=2024-09-14T14:18:46.368139+0000, chain.objs.size()=1 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.561__shadow_.fzlztYx_1F2lkr3u-LwgGU3G7G5z9bP_0 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4473674977646550821', time=2024-09-14T14:20:22.772385+0000, chain.objs.size()=1 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:2AABmFY.75Mp-ACIUkxK83jxH-kyP7W_.YwzM5DZkGs2OMS3c4ze4NF91SzPZpyn_0 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16814074231537176482', time=2024-09-14T14:20:36.114104+0000, chain.objs.size()=1 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:FbpvjlDuBzGFy3OBsEHyixRKyA-emeO_.55OY43vtBnpkaKYAlRXBxaG1kEiOVD7_0 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6320706992190501289', time=2024-09-14T14:20:52.350065+0000, chain.objs.size()=1 2024-09-14T12:44:03.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:ocPiu7Fzyn5ZrNZfGt72Fs6.LzNFdJN_.wlSWgtd3YxPTZu4dzFGD6KbGh9D2ILK_0 2024-09-14T12:44:03.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.037+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17488854110098552066', time=2024-09-14T14:22:10.339611+0000, chain.objs.size()=1 2024-09-14T12:44:03.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:i2eO-faJxvFikdsbGS.aJ1h406M-es-_.5HwaG21qUP_gZ-Od-Ex-R9KcYGoxL9p_0 2024-09-14T12:44:03.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.037+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13291911757488727578', time=2024-09-14T14:36:09.040382+0000, chain.objs.size()=2 2024-09-14T12:44:03.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.741__shadow_.i06KsdAfwwVFb7_pAECq5wWVb1y7Lm3_0 2024-09-14T12:44:03.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.741__shadow_.i06KsdAfwwVFb7_pAECq5wWVb1y7Lm3_1 2024-09-14T12:44:03.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.035 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T12:44:03.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43916' 2024-09-14T12:44:03.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_hUfDvr_dFjpaprXfr84hnU0X3lJekr9', time=2024-09-14T13:44:28.296220+0000, chain.objs.size()=1 2024-09-14T12:44:03.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.166__shadow_.A1lHvLwCYqmw_EfHN6Svj7FyVvBJIma_0 2024-09-14T12:44:03.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10221614148165665547', time=2024-09-14T13:45:09.241988+0000, chain.objs.size()=1 2024-09-14T12:44:03.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.184__shadow_.SszLH6sNN75ZZp7JCfyn1lnRdk403cD_0 2024-09-14T12:44:03.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9529033588955770154', time=2024-09-14T13:49:59.343083+0000, chain.objs.size()=1 2024-09-14T12:44:03.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.232__shadow_.fj7VjFiljJM3FgZ6YDN0udntfCdh-n6_0 2024-09-14T12:44:03.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2485569966783113363', time=2024-09-14T13:50:38.446531+0000, chain.objs.size()=1 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.245__shadow_.3BfSOF3qxEzJEETTJPOSvQO0e1TpoQ8_0 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12625119908445374385', time=2024-09-14T13:50:40.888109+0000, chain.objs.size()=1 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.246__shadow_.85eRcUh5iZcBir7uANS01V68x8DVxB7_0 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12570145651353083286', time=2024-09-14T13:53:05.439378+0000, chain.objs.size()=1 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HVMHgwsZ5o5sLbpoJGzCzM1ctvgWaED_0 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4329019881851210050', time=2024-09-14T13:53:06.228486+0000, chain.objs.size()=1 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BS1ED5M56bJtGq1f2OzgJTNN0s5uHUF_0 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16655981924756544603', time=2024-09-14T13:53:06.229972+0000, chain.objs.size()=1 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.brdAdfXAvHw6N4xpuOxPj5sqzDjGPyT_0 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17604508365482072856', time=2024-09-14T13:53:07.250579+0000, chain.objs.size()=1 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.zj_zWI7Hloa_qd_O7kdIYLDswqgAgsJ_0 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17997626841324212073', time=2024-09-14T13:53:07.252397+0000, chain.objs.size()=1 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Kia6rzLPVGGfxIxZ3bkLQt37fKDuRgK_0 2024-09-14T12:44:03.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6319435418517187805', time=2024-09-14T13:53:08.326778+0000, chain.objs.size()=1 2024-09-14T12:44:03.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2OL9B-VI8iAj5bmIp8cYqC3Nt19B5rn_0 2024-09-14T12:44:03.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18084565274703585913', time=2024-09-14T13:53:10.332461+0000, chain.objs.size()=1 2024-09-14T12:44:03.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8yZsp4osu33UiL1utJGusF7VIFYIihA_0 2024-09-14T12:44:03.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11714464002550686272', time=2024-09-14T13:53:11.409376+0000, chain.objs.size()=1 2024-09-14T12:44:03.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wmAEdk0TZPClImEfVPgwc871nbJ_TOm_0 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1223479784326826943', time=2024-09-14T13:53:12.684077+0000, chain.objs.size()=1 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7Jtk3sKTxFPyXySROOh86BrrqEjzplf_0 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14394441273287057981', time=2024-09-14T13:53:13.718484+0000, chain.objs.size()=1 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.om2dKppY9Zo6zpnonj87_iRgK4pCnWU_0 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6448778402286605934', time=2024-09-14T13:53:14.892167+0000, chain.objs.size()=1 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1N60Yx5x2lad06MTPzlgnhHti8fcLUX_0 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4154314477205154563', time=2024-09-14T13:53:16.515556+0000, chain.objs.size()=1 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.zAL_SHYvQtWvyoXahe5eR22F2Y4UqhP_0 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3262349856904403478', time=2024-09-14T13:53:16.603762+0000, chain.objs.size()=1 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fxKooLkiXrlmGCk3Qwx5St0rdOzRYy1_0 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.539568946441302414', time=2024-09-14T13:53:17.871776+0000, chain.objs.size()=1 2024-09-14T12:44:03.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pESoG3kxBsAV_CAG4q90UdW5Sl6YIXq_0 2024-09-14T12:44:03.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10317344753345206699', time=2024-09-14T13:53:18.338292+0000, chain.objs.size()=1 2024-09-14T12:44:03.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wv7YiLfhbVXAW6zyph7HfqqFH5j0bip_0 2024-09-14T12:44:03.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7747982138549002294', time=2024-09-14T13:53:19.394049+0000, chain.objs.size()=1 2024-09-14T12:44:03.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8K0TK0dkNaAQkRDapHDv3Ts1J0Dfn2B_0 2024-09-14T12:44:03.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8150187040998396595', time=2024-09-14T13:53:19.630290+0000, chain.objs.size()=1 2024-09-14T12:44:03.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.v4OBJICzP5kvlpXX3YgXaokuCOcCyKg_0 2024-09-14T12:44:03.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13512899159885482677', time=2024-09-14T13:53:20.504703+0000, chain.objs.size()=1 2024-09-14T12:44:03.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aQbJ10Lne-a5Io4-jdPBCBw5NtxD3P3_0 2024-09-14T12:44:03.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2132879642976493568', time=2024-09-14T13:53:22.114538+0000, chain.objs.size()=1 2024-09-14T12:44:03.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TkHQspsLDTyfvL5AfgT7a-_etrpRgx2_0 2024-09-14T12:44:03.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5971348354274378691', time=2024-09-14T13:53:22.400049+0000, chain.objs.size()=1 2024-09-14T12:44:03.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xB7pSi4B2FL24aj9NqGw46dRg62zzpi_0 2024-09-14T12:44:03.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15193663277588731114', time=2024-09-14T13:53:23.762242+0000, chain.objs.size()=1 2024-09-14T12:44:03.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.F09Hupi4Ai6ajAZcJ6N4MRQddBVbTAj_0 2024-09-14T12:44:03.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4034185256082385765', time=2024-09-14T13:53:23.980112+0000, chain.objs.size()=1 2024-09-14T12:44:03.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.iSLPe-C4WBX0hqj87JqAAqRnGEKE_9w_0 2024-09-14T12:44:03.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8395466470300878332', time=2024-09-14T13:53:27.731076+0000, chain.objs.size()=1 2024-09-14T12:44:03.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dcA9jvfdvgEY7Q15nyLphO-2SHqT6Lw_0 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18337139438772777203', time=2024-09-14T13:53:27.976912+0000, chain.objs.size()=1 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.opOIEMqQDOqgOe8VTB0MCzlDLjsOJci_0 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3222559205410910695', time=2024-09-14T13:53:29.335730+0000, chain.objs.size()=1 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9bLdB6F6x-ozo9KFbqNMysFMZ9LMx-S_0 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10394419141613225119', time=2024-09-14T13:53:31.499543+0000, chain.objs.size()=1 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.83ihG83WivvAxWwrvDyw2mvph38Z9aG_0 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8379429441579506039', time=2024-09-14T13:53:33.073540+0000, chain.objs.size()=1 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.abb5WjiIoTDTxuTMCJBa8sDcJF8oAVA_0 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5424532622456481308', time=2024-09-14T13:53:33.135669+0000, chain.objs.size()=1 2024-09-14T12:44:03.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Erk-NmrhkmKLZqFbXLJSglqyErprEol_0 2024-09-14T12:44:03.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18362133167894056562', time=2024-09-14T13:53:33.493987+0000, chain.objs.size()=1 2024-09-14T12:44:03.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._4fhfNqxsjweZiqnD4X9V_snqmFRGgd_0 2024-09-14T12:44:03.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.749850303159037623', time=2024-09-14T13:53:40.052284+0000, chain.objs.size()=1 2024-09-14T12:44:03.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.265__shadow_.tWohhCC4Q3ZztrBrn8IkCQl9y94cdbd_0 2024-09-14T12:44:03.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3972162215302766750', time=2024-09-14T13:53:52.044057+0000, chain.objs.size()=1 2024-09-14T12:44:03.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.270__shadow_.0A8niMv30OKGjDrGUOWSxhYyjur79IM_0 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.712610317411257761', time=2024-09-14T13:54:34.095748+0000, chain.objs.size()=1 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.287__shadow_.FLkRAhxgwjU8BjCG07pGd56XBGmF17G_0 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10420508869065764782', time=2024-09-14T13:54:53.160510+0000, chain.objs.size()=1 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.JzED8m1XHH6dEIXcy3hWgaU2_S-RpPz_0 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11217962209174249903', time=2024-09-14T13:54:59.038781+0000, chain.objs.size()=1 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.nCmmoQ-iNt1R0nICG7domQT3xU27KaM_0 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8812946348050878352', time=2024-09-14T13:54:59.078155+0000, chain.objs.size()=1 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.ib3dQ-zThrtKd8mb3Z3atyeIfFZ9dsX_0 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16139119720386480197', time=2024-09-14T13:55:01.565044+0000, chain.objs.size()=1 2024-09-14T12:44:03.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.295__shadow_.jNzEzCf0nOpgtYPdhlHVAFWMyE5BUXG_0 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2733409839400853724', time=2024-09-14T13:55:11.742740+0000, chain.objs.size()=1 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.299__shadow_.0ftsqqaeZhWOCrqsKSR4cx4bywgK_0v_0 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7177854413132176577', time=2024-09-14T13:55:19.372225+0000, chain.objs.size()=1 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.302__shadow_.r_to4OXlTC4Vr-DZ49fMg9PN5kSGXRv_0 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11464100765360508785', time=2024-09-14T13:56:11.988971+0000, chain.objs.size()=1 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.320__shadow:oZYayj6ytrvI5elZorM6HOXDtd6l2Qk_.LJQ1bqFYMXs1_qaNf4hgbeqt_yGjSvd_0 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18323720674816360559', time=2024-09-14T13:58:05.666881+0000, chain.objs.size()=1 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.g8IJp6ynh3jUduyAyO-kYXpWITDHgwp_0 2024-09-14T12:44:03.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14814352806602632956', time=2024-09-14T13:58:11.263511+0000, chain.objs.size()=1 2024-09-14T12:44:03.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.OWT8pxMRo5jv6KUBY3c87bLahch0faa_0 2024-09-14T12:44:03.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14547868332903303334', time=2024-09-14T13:58:11.381502+0000, chain.objs.size()=1 2024-09-14T12:44:03.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GtjPCu0-0ppBtss9xAGECZOmgY0w1ua_0 2024-09-14T12:44:03.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10420234177987803840', time=2024-09-14T13:58:13.371840+0000, chain.objs.size()=1 2024-09-14T12:44:03.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.I9ihKmfNVxPb9qiV2oNZx_fXHz3D_QT_0 2024-09-14T12:44:03.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8809256622294821571', time=2024-09-14T13:58:13.373203+0000, chain.objs.size()=1 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oujc9jcBxAUt0eE_-BSduJXQtIaLlLX_0 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3376376055686896431', time=2024-09-14T13:58:14.701044+0000, chain.objs.size()=1 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9HVI1a75yjVTM8l_SyYXbDxPNmn5_Hd_0 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16822161632343660542', time=2024-09-14T13:58:14.752277+0000, chain.objs.size()=1 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tWO_0JdbZ-bdyjJLmOvyaZhnmarKU81_0 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7859026601672334377', time=2024-09-14T13:58:15.237836+0000, chain.objs.size()=1 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eMFzSK7bio9FbZ-jM8q4uRNe0KeMtHa_0 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2542229794833564545', time=2024-09-14T13:58:15.676293+0000, chain.objs.size()=1 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HrKyvBLASohCMGY16OtiIW9NveVBtyk_0 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3458022390814620339', time=2024-09-14T13:58:16.031962+0000, chain.objs.size()=1 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JO8eX80SzqubTtqlye3PrOTj-A6V9Zy_0 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11153857862495459712', time=2024-09-14T13:58:17.752257+0000, chain.objs.size()=1 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jFywb1Fi98KKqtThnUVhNmJjX3JOset_0 2024-09-14T12:44:03.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.259518184094420054', time=2024-09-14T13:58:21.220442+0000, chain.objs.size()=1 2024-09-14T12:44:03.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qgVXXVG4iVfnLQxzlZdH0GkxZVo7MtF_0 2024-09-14T12:44:03.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1604885543587528954', time=2024-09-14T13:58:23.474880+0000, chain.objs.size()=1 2024-09-14T12:44:03.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DIqPYKKY0MuCaVHgCtFdHIClEWpOfSx_0 2024-09-14T12:44:03.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6172814779982128888', time=2024-09-14T13:58:25.388602+0000, chain.objs.size()=1 2024-09-14T12:44:03.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.SjUe_wJf3xkTIAP9rFZ2wEZUlEbiBAs_0 2024-09-14T12:44:03.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12964930516679319584', time=2024-09-14T13:58:25.716590+0000, chain.objs.size()=1 2024-09-14T12:44:03.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wdijuH70qy6sX1vtpxCvrJFh_wYSH9z_0 2024-09-14T12:44:03.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13436036646159674496', time=2024-09-14T13:58:26.085431+0000, chain.objs.size()=1 2024-09-14T12:44:03.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Jvoxqr0QJiCfB7d360oZ8nqGO2shHuA_0 2024-09-14T12:44:03.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1609329108575153196', time=2024-09-14T13:58:26.367048+0000, chain.objs.size()=1 2024-09-14T12:44:03.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7Bg4717V-NwJ1s1yohkwR91AZ8svEAa_0 2024-09-14T12:44:03.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15251208921658606131', time=2024-09-14T13:58:26.821569+0000, chain.objs.size()=1 2024-09-14T12:44:03.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GSA42mshcVY2gaVbNA3AVr834AkoKhf_0 2024-09-14T12:44:03.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13108485387862508547', time=2024-09-14T13:58:27.293184+0000, chain.objs.size()=1 2024-09-14T12:44:03.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.twJETIqoECcFjXiG_0Rc-lrQ_A3HBMO_0 2024-09-14T12:44:03.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7577769992051019857', time=2024-09-14T13:58:28.477819+0000, chain.objs.size()=1 2024-09-14T12:44:03.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.owwg4UnAstNY2fDd8KeHgVFn2BcThW6_0 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15340247311978568646', time=2024-09-14T13:58:28.981479+0000, chain.objs.size()=1 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9iGUb1Q1EJZgbpN-g2gaV9eFA7HIagM_0 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16656662169147587754', time=2024-09-14T13:58:30.810114+0000, chain.objs.size()=1 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8DyfoszpDnxZ7IxB99ovWB5j8KR-hdy_0 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8177019593152680282', time=2024-09-14T13:58:30.825857+0000, chain.objs.size()=1 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rynCXmwboN71dvJCXBWNDb1Ixu_AHg3_0 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2410039631340902779', time=2024-09-14T13:58:32.103109+0000, chain.objs.size()=1 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4ZCIwlXi6POw7oSPtuZGEZ2kPiHvw85_0 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16610777323688181409', time=2024-09-14T13:58:32.396725+0000, chain.objs.size()=1 2024-09-14T12:44:03.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rZLJe9n8Fye2Tc0fdnBukqhOTNVo1st_0 2024-09-14T12:44:03.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8339903314896829696', time=2024-09-14T13:58:32.579600+0000, chain.objs.size()=1 2024-09-14T12:44:03.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kBTvQdqYdauD76CtVKqxnEKkAR3ZjlS_0 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4454217128880862307', time=2024-09-14T13:58:33.279103+0000, chain.objs.size()=1 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nFn5qib2bXYkkEQYXSRI9Mahi7XaG6__0 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2043664442501717398', time=2024-09-14T13:58:33.637277+0000, chain.objs.size()=1 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YxyCy1_7zerrUuAvJPj_fI1FRH-VeKd_0 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8609454782170804741', time=2024-09-14T13:58:33.640112+0000, chain.objs.size()=1 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Wa10lvnNscczf0y8neWrLSY3ZFam9Bl_0 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17055159034104579349', time=2024-09-14T14:00:21.054727+0000, chain.objs.size()=1 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jdxzlHbLH53xvRVs7-mI_c2_HqzHNv__0 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4381137437203232104', time=2024-09-14T14:00:21.192357+0000, chain.objs.size()=1 2024-09-14T12:44:03.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6qZAM6QUmBU1gSlL1-KIWNhC6WESrnK_0 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13999803778031908355', time=2024-09-14T14:00:22.079463+0000, chain.objs.size()=1 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.OxWcZl1pubYSKrezhFnCiBGMPAKzyLk_0 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15033396665254310441', time=2024-09-14T14:00:23.186139+0000, chain.objs.size()=1 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.y0mbKK08cirJTAu6vxlDUDfh6n4Jf_O_0 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10301059344721423620', time=2024-09-14T14:00:24.984887+0000, chain.objs.size()=1 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.L_j4GESes-_gBngYO3sAyGTA4mnylqR_0 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2407324533633004101', time=2024-09-14T14:00:24.994678+0000, chain.objs.size()=1 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FwCoNKsopbeF7a5kdCCjTu4HJL-IwSW_0 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10429023119947306646', time=2024-09-14T14:00:27.119914+0000, chain.objs.size()=1 2024-09-14T12:44:03.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TPaoDvuod1ROh5hJavvFhJGUGLhll8K_0 2024-09-14T12:44:03.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4096026077153550018', time=2024-09-14T14:00:27.786836+0000, chain.objs.size()=1 2024-09-14T12:44:03.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jdCTohPNLJwwMxvm9D7MKPAh4WzMMfk_0 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7286607098131939860', time=2024-09-14T14:00:27.788570+0000, chain.objs.size()=1 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TowjZTM7s0O6OwAOGG7bM6n7gqRZ4_9_0 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6867331289375500087', time=2024-09-14T14:00:33.099821+0000, chain.objs.size()=1 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FIrIpsHKJ7aqDztLJlp1b1Q2bwkmSHE_0 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8698304709998512429', time=2024-09-14T14:00:34.258315+0000, chain.objs.size()=1 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iKqfyNG1bqyD9UzX3GZPVgIFO-EyMHu_0 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16469203375642988590', time=2024-09-14T14:00:34.453166+0000, chain.objs.size()=1 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.DYQJ_X5eDYakdfeLcGUQdm5LpePbLdM_0 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9351518695366904827', time=2024-09-14T14:00:34.707776+0000, chain.objs.size()=1 2024-09-14T12:44:03.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tPlKHBzzilxQLx379i5Lx6-lXSQEjGq_0 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.56536834257023319', time=2024-09-14T14:00:34.848386+0000, chain.objs.size()=1 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pgo2tD494idpQjUbTzo36eA3jyLY1Xc_0 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9615021789892148777', time=2024-09-14T14:00:35.144830+0000, chain.objs.size()=1 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1sYpBnsowY0gipEiNV316VUWw6lQYAs_0 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14937576427700845169', time=2024-09-14T14:00:35.218392+0000, chain.objs.size()=1 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pjtknebsfQ185kag-XTEled77q1pF26_0 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3720620885133994869', time=2024-09-14T14:00:35.320294+0000, chain.objs.size()=1 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Sj0D6Tqm0GobSZi1H3wtWpYKt5ZECHo_0 2024-09-14T12:44:03.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18264261740987772986', time=2024-09-14T14:00:35.322194+0000, chain.objs.size()=1 2024-09-14T12:44:03.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kIwTOAYGKGLV-DL6UhB0R_-Au2i56Jr_0 2024-09-14T12:44:03.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14044467561176156229', time=2024-09-14T14:00:35.644135+0000, chain.objs.size()=1 2024-09-14T12:44:03.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AtkvPcUfFCCqkBuIW-9BN--LrfYr_iU_0 2024-09-14T12:44:03.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10969983152757132900', time=2024-09-14T14:00:37.871977+0000, chain.objs.size()=1 2024-09-14T12:44:03.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.DU1rsD4fxg_6CWK3RHGCDLaS1wNZOVf_0 2024-09-14T12:44:03.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3076805448383764706', time=2024-09-14T14:00:38.541307+0000, chain.objs.size()=1 2024-09-14T12:44:03.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bw5FfeOWxg3Ha8qPOYewQn8QwWiC0Of_0 2024-09-14T12:44:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2505424083069908508', time=2024-09-14T14:00:38.686540+0000, chain.objs.size()=1 2024-09-14T12:44:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cURONk_7IxBYtkuhYkd_rx_PJaEpuBy_0 2024-09-14T12:44:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15174892077060419791', time=2024-09-14T14:00:38.887763+0000, chain.objs.size()=1 2024-09-14T12:44:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zs0vIf61LNsNSUYGT7-OD-MbFdKWUK3_0 2024-09-14T12:44:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5665256997137820855', time=2024-09-14T14:00:39.126222+0000, chain.objs.size()=1 2024-09-14T12:44:03.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SuOjoT6rf_HDzW4r6jUYIna_ESl6O30_0 2024-09-14T12:44:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8152601602460382476', time=2024-09-14T14:00:39.564283+0000, chain.objs.size()=1 2024-09-14T12:44:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tAElo9NUHtN6K8G3Lb-dBpULYHEgGeG_0 2024-09-14T12:44:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6392037439521523153', time=2024-09-14T14:00:40.470349+0000, chain.objs.size()=1 2024-09-14T12:44:03.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.F1pqnB5ND922QLSIzwt246_UT7OhWM8_0 2024-09-14T12:44:03.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.105+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.180944138277475473', time=2024-09-14T14:00:41.021143+0000, chain.objs.size()=1 2024-09-14T12:44:03.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.105+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6QzzTQ0LIeq6xQbnwk9529SHqbC6awI_0 2024-09-14T12:44:03.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43916 2024-09-14T12:44:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T12:44:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13882964658600864862', time=2024-09-14T14:00:42.289304+0000, chain.objs.size()=1 2024-09-14T12:44:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UTcy5Q5eS_XH2SP-_NJ38LOGcP2z-Xn_0 2024-09-14T12:44:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6935127021828180422', time=2024-09-14T14:00:43.321439+0000, chain.objs.size()=1 2024-09-14T12:44:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Xe48mRmGhO5kyUoO5qCnRAUCvSJR8Lf_0 2024-09-14T12:44:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15331563936846334414', time=2024-09-14T14:00:44.093268+0000, chain.objs.size()=1 2024-09-14T12:44:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gq4SLd41cQas9ybLJA2shDnt6oL-MJk_0 2024-09-14T12:44:03.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4047430407512163271', time=2024-09-14T14:00:44.433422+0000, chain.objs.size()=1 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.38n0QJhZ116a0MIQhUvdELipGBAhLM0_0 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11185254971960373308', time=2024-09-14T14:00:45.952801+0000, chain.objs.size()=1 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YQ0QNQ23LmNCUxbVwsNfENq6MrmVR9x_0 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4908577668307845324', time=2024-09-14T14:00:45.998445+0000, chain.objs.size()=1 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.nm3fjYjFE08ZT75H7qOGFTj8zvVWjAd_0 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.645142181857698476', time=2024-09-14T14:00:48.160774+0000, chain.objs.size()=1 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yulCMm1jWvpnq8lXLjGGjNYP0zEXacS_0 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9424504816154780108', time=2024-09-14T14:00:49.175245+0000, chain.objs.size()=1 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.B-OLn_Vz-YdLKjdwKU8cJv0dBseIp7t_0 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18081995695921383421', time=2024-09-14T14:00:49.568481+0000, chain.objs.size()=1 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bi_gvcHAFNOFxFZ2neuUZhYtU8zpYmE_0 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9557651809211845513', time=2024-09-14T14:00:49.821560+0000, chain.objs.size()=1 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.voN4_rJXyXe4fMaW_5OT6buUhclk-C3_0 2024-09-14T12:44:03.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2478770490718391929', time=2024-09-14T14:00:49.853817+0000, chain.objs.size()=1 2024-09-14T12:44:03.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.oohEiyB4-4K6yJniCWzUTOBJvecqEfs_0 2024-09-14T12:44:03.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3291267531066146516', time=2024-09-14T14:00:56.592802+0000, chain.objs.size()=1 2024-09-14T12:44:03.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.328__shadow_.TqWVWkInLddfFeaoE6B3TAhMSUxCBY3_0 2024-09-14T12:44:03.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14251768223772450273', time=2024-09-14T14:02:30.454783+0000, chain.objs.size()=1 2024-09-14T12:44:03.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.373__shadow_.XIHHfwFLKOeJg932VVaDeUd41d6gAFf_0 2024-09-14T12:44:03.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15732499660085453938', time=2024-09-14T14:05:15.212497+0000, chain.objs.size()=1 2024-09-14T12:44:03.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.445__shadow_.r5lpHM5b9ICxR_HJj98NZOliswiutk5_0 2024-09-14T12:44:03.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6276193476095467990', time=2024-09-14T14:06:11.870054+0000, chain.objs.size()=1 2024-09-14T12:44:03.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.465__shadow_.fK2iXNHqtkBzun3LLSNqs162cGzCNY4_0 2024-09-14T12:44:03.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11893774036865858260', time=2024-09-14T14:08:22.991732+0000, chain.objs.size()=6 2024-09-14T12:44:03.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.1 2024-09-14T12:44:03.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.2 2024-09-14T12:44:03.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.3 2024-09-14T12:44:03.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.4 2024-09-14T12:44:03.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.5 2024-09-14T12:44:03.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.6 2024-09-14T12:44:03.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7271619166331917545', time=2024-09-14T14:09:05.606197+0000, chain.objs.size()=2 2024-09-14T12:44:03.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.518__shadow_.z0S49-ag32eKCRuhfpUPekUj-BjcMOF_0 2024-09-14T12:44:03.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.518__shadow_.z0S49-ag32eKCRuhfpUPekUj-BjcMOF_1 2024-09-14T12:44:03.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11877216668784673649', time=2024-09-14T14:09:06.218140+0000, chain.objs.size()=1 2024-09-14T12:44:03.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.519__multipart_mymultipart.2~QiGTRJ6CGbW0hAEJWcMsw1xYROYe3gD.1 2024-09-14T12:44:03.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8523487238041300331', time=2024-09-14T14:17:54.926855+0000, chain.objs.size()=1 2024-09-14T12:44:03.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.555__shadow_.5Da6MCv6odnUpKKFVDO-43VlrGL-v9q_0 2024-09-14T12:44:03.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6347779727237966661', time=2024-09-14T14:20:10.710808+0000, chain.objs.size()=1 2024-09-14T12:44:03.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.576__shadow_.3GdEWwc4TKu4KDRKhj3b-SDS9pvdhgA_0 2024-09-14T12:44:03.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18338048297472044922', time=2024-09-14T14:22:15.757752+0000, chain.objs.size()=1 2024-09-14T12:44:03.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:5i0pXNcrE9LLitUB5t.yPClN.qvtDqZ_.BZFJToQUEU6Ycfj5pGZYO6dUZW1vCf7_0 2024-09-14T12:44:03.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5818173546503844077', time=2024-09-14T14:23:22.127184+0000, chain.objs.size()=1 2024-09-14T12:44:03.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.609__shadow_.qxa0AEeNE-sQ5NxppRA_ZrfmuQE-XlN_0 2024-09-14T12:44:03.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8794030451089544342', time=2024-09-14T14:28:17.602325+0000, chain.objs.size()=1 2024-09-14T12:44:03.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.620__shadow_.05_jLIwuj92Vi08JXL0OTFdfhsxFo1q_0 2024-09-14T12:44:03.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1445880482541807614', time=2024-09-14T14:28:19.759613+0000, chain.objs.size()=1 2024-09-14T12:44:03.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.621__shadow_.9mZO4my_0iLKjsRhiqxOlnF458AdgSg_0 2024-09-14T12:44:03.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17610692855399533709', time=2024-09-14T14:32:46.188244+0000, chain.objs.size()=1 2024-09-14T12:44:03.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.667__shadow_.KOaBWzZ52lZd1viOt3XTbOBw27PKWoF_0 2024-09-14T12:44:03.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11752340221815225503', time=2024-09-14T14:34:13.975794+0000, chain.objs.size()=1 2024-09-14T12:44:03.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.709__shadow:7XpqNQt-sWQcpJynWuRBMxXzKfUuOD4_.Zh8p-Un_78yn5U02aLlRt52aJVKKim7_0 2024-09-14T12:44:03.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T12:44:03.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53682' 2024-09-14T12:44:03.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13194354355278702092', time=2024-09-14T13:50:07.688930+0000, chain.objs.size()=1 2024-09-14T12:44:03.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.235__shadow_.3_hBddL8y6Gh2ckOOKQF_uLRsMscI6M_0 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2971917707997002574', time=2024-09-14T13:50:38.436799+0000, chain.objs.size()=1 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.245__shadow_.zJnX2JqYYLuFlXzfrZgqvzySkyN2sc1_0 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9210055474592552334', time=2024-09-14T13:50:40.881327+0000, chain.objs.size()=1 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.246__shadow_.aztdVXYrCztXyfFlnXcAzMU-PeCw4Rs_0 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17132079197480048315', time=2024-09-14T13:50:56.121778+0000, chain.objs.size()=1 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.252__shadow_.7Sbau_0zUWcEK4HKdq0HxLrHwc8ICmE_0 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6617794302984664768', time=2024-09-14T13:51:11.047043+0000, chain.objs.size()=1 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.258__shadow_.Yckju3j1pSKOwSjDmPBrtPtjDEa31pP_0 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13094959931788569151', time=2024-09-14T13:53:05.282344+0000, chain.objs.size()=1 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nF92pJ7KhTMqEIF_jjtIdsQhHLcbk_b_0 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15278849180945803525', time=2024-09-14T13:53:06.001285+0000, chain.objs.size()=1 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uaZF-zMeSAnAW4l3a83QIrZ2mUi4nSp_0 2024-09-14T12:44:03.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9639843572947140526', time=2024-09-14T13:53:07.194831+0000, chain.objs.size()=1 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.snMZSq9TAbxPwL5r3JKpSbaZS6H2X3Z_0 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7063779962161988361', time=2024-09-14T13:53:07.749904+0000, chain.objs.size()=1 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aIZ3g9Lz-HIkKyMGFzeBq19c0Yd_yYE_0 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4086359052323771436', time=2024-09-14T13:53:09.544012+0000, chain.objs.size()=1 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ZaLIkiKvJ5bjDMQkdpxzRioLEoTbMdg_0 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14020588069107484503', time=2024-09-14T13:53:09.695163+0000, chain.objs.size()=1 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9pnTDi2VHw7ug5imoYzIFFZ_gLo3VsK_0 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4863359147141545784', time=2024-09-14T13:53:12.072740+0000, chain.objs.size()=1 2024-09-14T12:44:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rf171E-2G_atZxSeZVrxZ-tOUwyKM54_0 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4503785371412456830', time=2024-09-14T13:53:12.376173+0000, chain.objs.size()=1 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rxaos6-pK58UNOw3NBw6xaXT3RMAGno_0 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16786002088433842646', time=2024-09-14T13:53:14.117131+0000, chain.objs.size()=1 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.I1tgaZcfXUqb9vk4ytamqiRm-izEyNB_0 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7935229128378889362', time=2024-09-14T13:53:15.311308+0000, chain.objs.size()=1 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aNOKv2JC8NOMvQYAEpVLkKb_-yLxLon_0 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5578088001667294770', time=2024-09-14T13:53:15.553917+0000, chain.objs.size()=1 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kZOytgmui0qx7arMydvIjt7UV7QlB3G_0 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6475961641264881327', time=2024-09-14T13:53:16.672361+0000, chain.objs.size()=1 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RlsmWxiQz8Qnzn-dGjobGIvQqAqCELK_0 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6621161371092625593', time=2024-09-14T13:53:18.237398+0000, chain.objs.size()=1 2024-09-14T12:44:03.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.p1s5ill1IiGkkaIBZOglCqZ1wdn1Pqv_0 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12632204984890358001', time=2024-09-14T13:53:19.815511+0000, chain.objs.size()=1 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7EKEEjlNSBrevsRo9HzpZizxt-Zx6cn_0 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10264375707621018368', time=2024-09-14T13:53:20.438926+0000, chain.objs.size()=1 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EaNL4RRZYLEL5YPiyc1PMjg6RmysUhm_0 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1875715411438757570', time=2024-09-14T13:53:22.972460+0000, chain.objs.size()=1 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6ftrb3WK4WC-ersXJeVR49yUz7yZ71C_0 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14707909889337750060', time=2024-09-14T13:53:23.634706+0000, chain.objs.size()=1 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HluXZscuWi1ARjA_QZNexV0Uc4Y4K9R_0 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5512717484426347649', time=2024-09-14T13:53:23.790144+0000, chain.objs.size()=1 2024-09-14T12:44:03.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.145+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.himtH3f9u28WzXHk5G3Q0q8VzDB6aib_0 2024-09-14T12:44:03.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16058617350160134801', time=2024-09-14T13:53:24.295468+0000, chain.objs.size()=1 2024-09-14T12:44:03.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.novjwRIaJBcuHotcvfYT8p2bb6JoHzN_0 2024-09-14T12:44:03.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7959676181194817617', time=2024-09-14T13:53:25.334693+0000, chain.objs.size()=1 2024-09-14T12:44:03.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cX6G3_BNleDkA75NffY0eUf_Lkqh1uJ_0 2024-09-14T12:44:03.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7802307511199382207', time=2024-09-14T13:53:25.713018+0000, chain.objs.size()=1 2024-09-14T12:44:03.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xMdVUnkxPuKXWVZocMPl2EZK0umkuHp_0 2024-09-14T12:44:03.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8282371528647377888', time=2024-09-14T13:53:25.842760+0000, chain.objs.size()=1 2024-09-14T12:44:03.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2TEQdSt0cv0XKKcEw5yPNxjAC4jl5mn_0 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8810600113610805572', time=2024-09-14T13:53:25.846712+0000, chain.objs.size()=1 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.szNqUqB7tA6fizyxVM3YiamRxaZmSRK_0 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12095865853360563823', time=2024-09-14T13:53:26.774868+0000, chain.objs.size()=1 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.46yHhHA9PBcTW7Goi2l9e2Z2hLHT4_F_0 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4335902240695915019', time=2024-09-14T13:53:26.777987+0000, chain.objs.size()=1 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.W99n2ERSkAH6-ewMlkGy1SPpdab2lFB_0 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12877617604318435251', time=2024-09-14T13:53:29.255252+0000, chain.objs.size()=1 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oVseunMLrfrLyij_Sl4Y56tZb8-vIVt_0 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12725471120697402358', time=2024-09-14T13:53:30.029175+0000, chain.objs.size()=1 2024-09-14T12:44:03.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.imm5w29T6fWXGJFivy5SN07mSe8X3Un_0 2024-09-14T12:44:03.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5377016842745456912', time=2024-09-14T13:53:30.141815+0000, chain.objs.size()=1 2024-09-14T12:44:03.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CR9_yjkkjgRkZ6GkBgEAuz5u_O2_ggD_0 2024-09-14T12:44:03.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4982067586259509852', time=2024-09-14T13:53:32.054920+0000, chain.objs.size()=1 2024-09-14T12:44:03.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2mYjh-MTvCVcZG0E1x-FR_3vFgEeP88_0 2024-09-14T12:44:03.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13998843873246856020', time=2024-09-14T13:54:08.840452+0000, chain.objs.size()=1 2024-09-14T12:44:03.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.277__shadow_.h5QeG4c1mMzYMX6ZZWuUFrWRwYDRdkq_0 2024-09-14T12:44:03.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14733827170356396564', time=2024-09-14T13:54:13.738932+0000, chain.objs.size()=1 2024-09-14T12:44:03.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.279__shadow_.2V6n4hhKbDMvY-CifEYIVfHR8ja-A6T_0 2024-09-14T12:44:03.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14909422750447795476', time=2024-09-14T13:54:21.250260+0000, chain.objs.size()=1 2024-09-14T12:44:03.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.282__shadow_.qYFcGx_vD21avD7pcUMKVrcILi7yfja_0 2024-09-14T12:44:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16934824179075916730', time=2024-09-14T13:54:52.873990+0000, chain.objs.size()=1 2024-09-14T12:44:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.aHg7vOzqpkAU2iGaFRUVx5fsL4eJCpJ_0 2024-09-14T12:44:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12638251244498643344', time=2024-09-14T13:56:18.947452+0000, chain.objs.size()=1 2024-09-14T12:44:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.323__shadow_.6Adw6weP0gtT3IBMoUnrv8OOmmU0kFL_0 2024-09-14T12:44:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7717981683921270361', time=2024-09-14T13:58:05.535059+0000, chain.objs.size()=1 2024-09-14T12:44:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kSNSY5xsVp02Qqwd9P9dhqS2HqMslV-_0 2024-09-14T12:44:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6872534307160859126', time=2024-09-14T13:58:06.686277+0000, chain.objs.size()=1 2024-09-14T12:44:03.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KB_4gHNBOvY9xxSPp_1w4ZZPlCy5jpM_0 2024-09-14T12:44:03.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11555196454672078389', time=2024-09-14T13:58:06.893862+0000, chain.objs.size()=1 2024-09-14T12:44:03.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BiLmmusYzgLpKgX2JlcX58rfXa_wfva_0 2024-09-14T12:44:03.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12446827009802327182', time=2024-09-14T13:58:07.203671+0000, chain.objs.size()=1 2024-09-14T12:44:03.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZZskjEZAzBVJxgm4P07ta_s3hULnb2__0 2024-09-14T12:44:03.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13579192597658680567', time=2024-09-14T13:58:07.801248+0000, chain.objs.size()=1 2024-09-14T12:44:03.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.m4VE1y_AA0iwrYdhFwJlZI4H9SoZa3i_0 2024-09-14T12:44:03.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5042229667571471821', time=2024-09-14T13:58:09.481255+0000, chain.objs.size()=1 2024-09-14T12:44:03.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.W5EeNM_463Oln4JF9iC0vxUghuFEMEk_0 2024-09-14T12:44:03.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1638972882705112294', time=2024-09-14T13:58:09.765295+0000, chain.objs.size()=1 2024-09-14T12:44:03.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TPZW0uy9iG9kxK5HZXJErm5Rl9zvhoh_0 2024-09-14T12:44:03.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1583068474446545175', time=2024-09-14T13:58:09.877503+0000, chain.objs.size()=1 2024-09-14T12:44:03.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lqD_6CjGJfU3mw-7TaMWMyy0L967Jbv_0 2024-09-14T12:44:03.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4875885628954674610', time=2024-09-14T13:58:10.201002+0000, chain.objs.size()=1 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HiOwGiOvO_f96_MoXyf6qHlTu-Yq1CF_0 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14403469674432089811', time=2024-09-14T13:58:10.371857+0000, chain.objs.size()=1 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.bi01All8E-PjCeUXEywXJQii53LO2_D_0 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8943652019642813043', time=2024-09-14T13:58:11.131219+0000, chain.objs.size()=1 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.e05zlEQbxpUSenDOemjVrFFlj-qwTDl_0 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7814852751428967988', time=2024-09-14T13:58:11.517257+0000, chain.objs.size()=1 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wP0Z59KgPB7VFh8s2pUTPva90tZd7oS_0 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9002180789420121878', time=2024-09-14T13:58:11.690504+0000, chain.objs.size()=1 2024-09-14T12:44:03.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HpIdSWnre4czXTrtYGvcoBijqAKFRy6_0 2024-09-14T12:44:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15220106496500854101', time=2024-09-14T13:58:11.989740+0000, chain.objs.size()=1 2024-09-14T12:44:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6Vv42KahFe7dvCoxurv6RUNAKCBCeS-_0 2024-09-14T12:44:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5180974268737149103', time=2024-09-14T13:58:11.991677+0000, chain.objs.size()=1 2024-09-14T12:44:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IUU_JTkPuzpX_6l_-E8fViw9JGH-_Oj_0 2024-09-14T12:44:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14686356273404839868', time=2024-09-14T13:58:13.499344+0000, chain.objs.size()=1 2024-09-14T12:44:03.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DlniU8Ah_iiD3DHGTgGVJiaiy5KRDM0_0 2024-09-14T12:44:03.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7513652646552004463', time=2024-09-14T13:58:14.469147+0000, chain.objs.size()=1 2024-09-14T12:44:03.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YMWfXLftzvYM9bDlYOfxxJh6v-u4_PP_0 2024-09-14T12:44:03.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8642175866467585474', time=2024-09-14T13:58:18.968912+0000, chain.objs.size()=1 2024-09-14T12:44:03.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HKJAwVCIzJ0eWTVhbiqz-FBxczptgYU_0 2024-09-14T12:44:03.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11573893980902331835', time=2024-09-14T13:58:19.332208+0000, chain.objs.size()=1 2024-09-14T12:44:03.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.o3alThvcMmW8xpVfeIERRyw_nYdLfQ7_0 2024-09-14T12:44:03.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12550537011548069665', time=2024-09-14T13:58:19.831173+0000, chain.objs.size()=1 2024-09-14T12:44:03.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9tlISihSR4tU2TReHOweuk0c0QmiuNm_0 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7738001838500606913', time=2024-09-14T13:58:23.172312+0000, chain.objs.size()=1 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9DhEFALd9DsAXFa51z6ZWnsoR6rW64y_0 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12919644228988725176', time=2024-09-14T13:58:23.173781+0000, chain.objs.size()=1 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-JNEKSzb8boo9pKHvQmL1_k67L3xh18_0 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17868224936584864983', time=2024-09-14T13:58:23.277301+0000, chain.objs.size()=1 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZKUfc-T7ZhSrmGueRpmujRQTTThs168_0 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18003290326156720178', time=2024-09-14T13:58:23.793482+0000, chain.objs.size()=1 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LyZ80mSQiiCawcd-i2ABj_IBioUAUzf_0 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.975887967338928965', time=2024-09-14T13:58:23.947727+0000, chain.objs.size()=1 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.MPJ7KA9HyBvkiJctcyC7SQQPbc2-D5i_0 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12727146261245862220', time=2024-09-14T13:58:25.712115+0000, chain.objs.size()=1 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.85ymxsLo0LfXa--LQgZCeKah3SzgQHM_0 2024-09-14T12:44:03.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.545389574619475600', time=2024-09-14T13:58:27.064475+0000, chain.objs.size()=1 2024-09-14T12:44:03.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pmfx-K9QmYuTuMY1GJAddyslJk3uVeW_0 2024-09-14T12:44:03.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11517652874637723852', time=2024-09-14T13:58:28.506062+0000, chain.objs.size()=1 2024-09-14T12:44:03.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lZ_493VWexmYX9mN8_k1ZcP38ZXcQ75_0 2024-09-14T12:44:03.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1035052579787914723', time=2024-09-14T13:58:29.603239+0000, chain.objs.size()=1 2024-09-14T12:44:03.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.5OoEtDoIuniNGJfOhCGZ5vaB-qvv03x_0 2024-09-14T12:44:03.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4980711321610831407', time=2024-09-14T13:58:31.182841+0000, chain.objs.size()=1 2024-09-14T12:44:03.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mS7EQyBjAOt758t66IRwOz1XMQkpGUg_0 2024-09-14T12:44:03.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10059705237007195935', time=2024-09-14T13:58:32.841492+0000, chain.objs.size()=1 2024-09-14T12:44:03.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fSDWJOHdzLSOOXjoPF3XC3MAwsGJtiU_0 2024-09-14T12:44:03.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6370988518407608368', time=2024-09-14T13:58:34.113465+0000, chain.objs.size()=1 2024-09-14T12:44:03.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oaHeQ8naBGCeNR5D5Co80799FP1ICgP_0 2024-09-14T12:44:03.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17899186782067945921', time=2024-09-14T13:58:34.237646+0000, chain.objs.size()=1 2024-09-14T12:44:03.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Ea9HUEoJlYdl2PWLkSokgW9IqqCYvkO_0 2024-09-14T12:44:03.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5246516285364289610', time=2024-09-14T14:00:21.009193+0000, chain.objs.size()=1 2024-09-14T12:44:03.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wQYnsXOkZRw34h5s5epu-9HNb_RCZ_r_0 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15145580169060499113', time=2024-09-14T14:00:21.280255+0000, chain.objs.size()=1 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._OIylTb8mm1dMNIbn2m2CQys7PGItwP_0 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9509056021457933851', time=2024-09-14T14:00:21.563757+0000, chain.objs.size()=1 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1KxtQQ9SyMIDX_Gj5JNlH8zDQfE71V5_0 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12117147438968574340', time=2024-09-14T14:00:21.784584+0000, chain.objs.size()=1 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mzs_DLTw-ZPmU8ZEqkaf_QK-PPa3ZfJ_0 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13847130323569664280', time=2024-09-14T14:00:21.876296+0000, chain.objs.size()=1 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.femcgZC1ozq-PPUzNaPfbs7p5Ce0VzH_0 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3746316814690948851', time=2024-09-14T14:00:22.072877+0000, chain.objs.size()=1 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.A8sxj4HQqjjnHvE2ObA7W7MG5fgSejL_0 2024-09-14T12:44:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17910003177057743216', time=2024-09-14T14:00:25.081400+0000, chain.objs.size()=1 2024-09-14T12:44:03.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cs-3g7u2d8RqacSNOoVJM3W-7BQ9MVi_0 2024-09-14T12:44:03.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14972078569415928177', time=2024-09-14T14:00:25.558554+0000, chain.objs.size()=1 2024-09-14T12:44:03.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dUnho0GBLFDc73q8iuzoH7ZJjL6d1uQ_0 2024-09-14T12:44:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1361575410855590819', time=2024-09-14T14:00:26.284613+0000, chain.objs.size()=1 2024-09-14T12:44:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ak4lE5KKEPO7yeNj1rNqxQ-5avlIA-d_0 2024-09-14T12:44:03.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11056967989326295164', time=2024-09-14T14:00:26.390987+0000, chain.objs.size()=1 2024-09-14T12:44:03.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5TeI0GTy0eq9EHsqwlLmrIebzb4fG6T_0 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6591600056685060789', time=2024-09-14T14:00:27.227905+0000, chain.objs.size()=1 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-FeJ0iJ-w09fnZ8Y7dV6WCuqY4i788q_0 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12342231406787222970', time=2024-09-14T14:00:29.070356+0000, chain.objs.size()=1 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2wU5xKW-Nc4PeuduoVwFFkJOcO6qD26_0 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13387317643419771506', time=2024-09-14T14:00:29.622287+0000, chain.objs.size()=1 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vWMo8h6DpS3lsjUu9ocdd3Emm8T10Pz_0 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6159434159928758430', time=2024-09-14T14:00:30.319267+0000, chain.objs.size()=1 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.k0AeZFNr8SNYUGYSS5PdLRBARNAIMb__0 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8368305112204718556', time=2024-09-14T14:00:32.873101+0000, chain.objs.size()=1 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SAE2MLPbXuy49Zw-hV--YYatAXeRRIR_0 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13587323659296874570', time=2024-09-14T14:00:33.097965+0000, chain.objs.size()=1 2024-09-14T12:44:03.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WU2YUi5xHu0m06vHVijkub1N1RUoOAT_0 2024-09-14T12:44:03.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6574997655519393574', time=2024-09-14T14:00:34.024560+0000, chain.objs.size()=1 2024-09-14T12:44:03.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.RwbQX5eLNFZ2R71eppSvu4FqF90uACR_0 2024-09-14T12:44:03.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11139320592255534871', time=2024-09-14T14:00:34.627429+0000, chain.objs.size()=1 2024-09-14T12:44:03.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YZi2xbLYm_t6ihIDi9NFNnKG7hrq6nx_0 2024-09-14T12:44:03.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5491244474922957618', time=2024-09-14T14:00:35.462703+0000, chain.objs.size()=1 2024-09-14T12:44:03.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2j1Id56QW6Bn2C1SIJOJLzAhtezG6Sx_0 2024-09-14T12:44:03.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15538118849845284254', time=2024-09-14T14:00:37.265779+0000, chain.objs.size()=1 2024-09-14T12:44:03.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.soZEGs53NxbOn4ER-4lRi2LcXKHMCsn_0 2024-09-14T12:44:03.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2009690036137973228', time=2024-09-14T14:00:40.482322+0000, chain.objs.size()=1 2024-09-14T12:44:03.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WCMvXLLEw-oLiq0SfVgRc-6_PCxSjIL_0 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14754416406113310369', time=2024-09-14T14:00:40.485725+0000, chain.objs.size()=1 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1c1ib1Z8J-1IQ__G0aVf0xBR4RZpISa_0 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13461482308161319505', time=2024-09-14T14:00:41.127295+0000, chain.objs.size()=1 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yKD5nsVGPtwv_I1Pl_1Ns85fQpmTDiL_0 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4577630400039063050', time=2024-09-14T14:00:41.468309+0000, chain.objs.size()=1 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yEAK_5ayfQKiA3BXwrjNQ13pvBF-LAj_0 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9247890835513489594', time=2024-09-14T14:00:41.570106+0000, chain.objs.size()=1 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gXOJxoYxVSep1Miw9HwG5f_sgBh4b4q_0 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13394127592844202221', time=2024-09-14T14:00:43.106707+0000, chain.objs.size()=1 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qtZerQJjJIdcB2BtpqFpWZ65jqGFc6r_0 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.501568908743127756', time=2024-09-14T14:00:43.981098+0000, chain.objs.size()=1 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.aJaWeadN6PFWIuR987uIIAEcIKrutsh_0 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13032225044001257443', time=2024-09-14T14:00:44.017226+0000, chain.objs.size()=1 2024-09-14T12:44:03.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9wz5u3FDy8JdDGaTZINX1QPgPeK0FIY_0 2024-09-14T12:44:03.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53682 2024-09-14T12:44:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T12:44:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10916066614800510574', time=2024-09-14T14:00:45.087768+0000, chain.objs.size()=1 2024-09-14T12:44:03.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.XfGY3VGNsnXjlyF4PnvpaSwyt668wx5_0 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17657579494787794995', time=2024-09-14T14:00:46.146355+0000, chain.objs.size()=1 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j9jgBwx4jEsS-av7EoJroUKMmW1CyTU_0 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4010836389900679421', time=2024-09-14T14:00:47.717463+0000, chain.objs.size()=1 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Pt4qX4jqxlbkroLWC6iBp95sbbJ1s17_0 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.209514323243401322', time=2024-09-14T14:02:41.975065+0000, chain.objs.size()=1 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.378__shadow_.823elraFXLYzYLkZq_RN3k5s-mWbgTA_0 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7845746922730273537', time=2024-09-14T14:02:56.243634+0000, chain.objs.size()=1 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.384__shadow_.GqsnpfbQjo4U6PIGyJx7xmlE_BJTiap_0 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17042318939915262603', time=2024-09-14T14:07:38.699273+0000, chain.objs.size()=1 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.504__shadow:CRVCgFwmMB1yqxO5U8RjttqtM84H.gl_.-dyH_j79k-7Z8XYotXT1e1-rBoXsavU_0 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16943811799187346090', time=2024-09-14T14:10:30.012270+0000, chain.objs.size()=1 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.521__shadow:rolYmMwjyAAaAZabClLaPbHF2KfCZd0_._vXEsKFRKJ9Ga1Uo6aM2Wayh1UPIUXX_0 2024-09-14T12:44:03.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8505075037311251083', time=2024-09-14T14:15:01.261303+0000, chain.objs.size()=4 2024-09-14T12:44:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.525__shadow_.C99Q6b5xp8kjV-E7tE1iwygmWaMctNS_0 2024-09-14T12:44:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.525__shadow_.C99Q6b5xp8kjV-E7tE1iwygmWaMctNS_1 2024-09-14T12:44:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.525__shadow_.C99Q6b5xp8kjV-E7tE1iwygmWaMctNS_2 2024-09-14T12:44:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.525__shadow_.C99Q6b5xp8kjV-E7tE1iwygmWaMctNS_3 2024-09-14T12:44:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8475621136581344433', time=2024-09-14T14:19:25.640252+0000, chain.objs.size()=1 2024-09-14T12:44:03.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:-6vHpFBIB.9LQxvl6maHh9Enr9hXDU3_.HHI7GvPwWKTLpimc_FVW1iv0Gghgse3_0 2024-09-14T12:44:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17449959402236602660', time=2024-09-14T14:19:32.456768+0000, chain.objs.size()=1 2024-09-14T12:44:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:MDyfznVGp0OsN4.6yWNypOMePNneXwn_.vw98SEDfbi4VwjIaC0DUWuI5XAONhZY_0 2024-09-14T12:44:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4554367182617940511', time=2024-09-14T14:19:52.589471+0000, chain.objs.size()=1 2024-09-14T12:44:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.573__shadow_.RoE1oz3XKMcF3qgSqN9q5gyignQv1s__0 2024-09-14T12:44:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15934219782906736549', time=2024-09-14T14:20:03.602366+0000, chain.objs.size()=1 2024-09-14T12:44:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow:bbN9aVy5pggM16tM7tyTVRfx96-tA1t_.7lpZkTOidCSMVQLYoLYo0tPYGX2CS62_0 2024-09-14T12:44:03.196 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10075722347661883459', time=2024-09-14T14:20:11.262636+0000, chain.objs.size()=1 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.576__shadow:pZ8awk6.B9O2RIMTaZR..FXZwQgLT1k_.FQHAzmtE9lOLWelXnDh4nvSCkFIPPki_0 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3394905926556784167', time=2024-09-14T14:21:05.988099+0000, chain.objs.size()=1 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:tlQ6s.bNykMGPVFGx4xiDplEkGDFPMW_.X4ewedvrPkjfWEQFP9f5likg4VkioYk_0 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11936918446259504174', time=2024-09-14T14:22:10.477739+0000, chain.objs.size()=1 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:aX1t8YKk8lGUV9yL6KMS3WcFYJw8vq7_.8QjuRDJsamJFpBaO4o6wgcoKa7c8DO3_0 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16346501227784827879', time=2024-09-14T14:22:56.221314+0000, chain.objs.size()=1 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.597__shadow_.h_mUDC086G5VsFBXIfHGfHwLa6i3SCe_0 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15059281138908536464', time=2024-09-14T14:29:59.427132+0000, chain.objs.size()=1 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.630__shadow_.Hy5oIVG5I-nRAbpgOzCo_jGgpwh2Ahz_0 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4769073077469286383', time=2024-09-14T14:30:01.563597+0000, chain.objs.size()=1 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.631__shadow_.2cf41hpPDmvawODPvsCYgCffjLIO-sK_0 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14440914175238044287', time=2024-09-14T14:33:54.798257+0000, chain.objs.size()=1 2024-09-14T12:44:03.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.701__shadow:YKOJyBN-d5f.uGox2ApbspOwGvY7cRB_._uFdmczW-gnEV03PUMBozfK3RZGZDer_0 2024-09-14T12:44:03.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11498935524830788763', time=2024-09-14T14:34:11.479891+0000, chain.objs.size()=1 2024-09-14T12:44:03.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.708__shadow:qQgh0YRD97p5BxbfTbKikfR4BoN5q.r_.laxSU1Bu-u9kTYwv7HkPMM_tMU2PSCy_0 2024-09-14T12:44:03.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T12:44:03.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48200' 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11343500051923248413', time=2024-09-14T13:43:19.015445+0000, chain.objs.size()=3 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.XzePFGZwhRnfKyROu19ZcOxq46-M4w-_0 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.XzePFGZwhRnfKyROu19ZcOxq46-M4w-_1 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.XzePFGZwhRnfKyROu19ZcOxq46-M4w-_2 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2814575213884588781', time=2024-09-14T13:44:17.634361+0000, chain.objs.size()=3 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.163__shadow_.lK5zwOGnODn1B8NdOyg2EXf2RmcQJJK_0 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.163__shadow_.lK5zwOGnODn1B8NdOyg2EXf2RmcQJJK_1 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.163__shadow_.lK5zwOGnODn1B8NdOyg2EXf2RmcQJJK_2 2024-09-14T12:44:03.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15819919625343920321', time=2024-09-14T13:44:27.714456+0000, chain.objs.size()=2 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.165__multipart_foo.2~tk7Chwuutyskbo4tBjWHP5CN_iV7fim.1 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.165__multipart_foo.2~tk7Chwuutyskbo4tBjWHP5CN_iV7fim.2 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16126555388877850440', time=2024-09-14T13:50:21.023929+0000, chain.objs.size()=1 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.239__shadow_.elt431b1D18g9NpcCb_MN9_ZAkv17cb_0 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7001782135185188019', time=2024-09-14T13:50:58.640211+0000, chain.objs.size()=1 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.253__shadow_.EkDY-BX0lS-o3VFlqH3NrItAomxvDll_0 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18012414125714392433', time=2024-09-14T13:51:06.119635+0000, chain.objs.size()=1 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.256__shadow_.95WQw8pK8S_wXksHcd3yF6TlWumT-22_0 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8360945462794298913', time=2024-09-14T13:51:15.886746+0000, chain.objs.size()=1 2024-09-14T12:44:03.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.260__shadow_.tqvX3DRJmlFrcNI-nnKmM6idVEAk9tz_0 2024-09-14T12:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10305846664401577284', time=2024-09-14T13:51:20.854268+0000, chain.objs.size()=1 2024-09-14T12:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.262__shadow_.GgwnzBfCc2OnHoOGGNczhdH69rvJuyC_0 2024-09-14T12:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10583890933322569629', time=2024-09-14T13:53:05.429921+0000, chain.objs.size()=1 2024-09-14T12:44:03.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3xfzC8dhdAMZs1aQ4_n4-Bf5_fGsUf__0 2024-09-14T12:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1276149895840440415', time=2024-09-14T13:53:05.432305+0000, chain.objs.size()=1 2024-09-14T12:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.81UtGSdraHZ2n4XhZN13hGDtSH8a7wm_0 2024-09-14T12:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9386249292475195687', time=2024-09-14T13:53:05.711441+0000, chain.objs.size()=1 2024-09-14T12:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hZzrtU5xAf3G65VuJW7WJVjTm1G23-c_0 2024-09-14T12:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4488893063512622505', time=2024-09-14T13:53:07.751818+0000, chain.objs.size()=1 2024-09-14T12:44:03.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2JD1cWv4TWR8RG0_2fycUBAbRt6dK5m_0 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2706532529042128611', time=2024-09-14T13:53:07.846807+0000, chain.objs.size()=1 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2FXLsYAOzle-aai0v3fu2e4shhYrDZd_0 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1262244688671395217', time=2024-09-14T13:53:08.148953+0000, chain.objs.size()=1 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ga7Ro2chctb5DjJFBC6dcotzTYCfbSX_0 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18308009834233812148', time=2024-09-14T13:53:09.786734+0000, chain.objs.size()=1 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QPkOeAPNPCtD385gtumBTqbr2dsnxT1_0 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8343195117408913777', time=2024-09-14T13:53:10.727118+0000, chain.objs.size()=1 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.j8GwETauP4K0uKespl2ZWSGu3vEXcpJ_0 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3097742259236513820', time=2024-09-14T13:53:12.339736+0000, chain.objs.size()=1 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GGAtvc1vyjbtUC3I3RzX3eA_PeUUgJ7_0 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11189417594496217925', time=2024-09-14T13:53:13.687869+0000, chain.objs.size()=1 2024-09-14T12:44:03.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OCKU5aU6tIJM3JJYUqN2W8D1-1enoFL_0 2024-09-14T12:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18178227390266676199', time=2024-09-14T13:53:14.584565+0000, chain.objs.size()=1 2024-09-14T12:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0WaZMXHjPRi4lDywDtLB0inp3uyBQIL_0 2024-09-14T12:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.821229765040398759', time=2024-09-14T13:53:15.105413+0000, chain.objs.size()=1 2024-09-14T12:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Rj0_NlvfpEElmKX_1hrSDmByOkxQsF7_0 2024-09-14T12:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6439007215094838234', time=2024-09-14T13:53:15.680003+0000, chain.objs.size()=1 2024-09-14T12:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.87fwnVlx2GYscVeYKtY6K5S4Htbx8G5_0 2024-09-14T12:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13600561036775012216', time=2024-09-14T13:53:16.451878+0000, chain.objs.size()=1 2024-09-14T12:44:03.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JwsEdDkgr5ZVeaio_3dZll-kP9SGr6S_0 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8718413650836577813', time=2024-09-14T13:53:18.030182+0000, chain.objs.size()=1 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8souN6mm31ngOYQLHq2FtVn7z3jkDCJ_0 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13686525645271397375', time=2024-09-14T13:53:18.939981+0000, chain.objs.size()=1 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-VUNQU_VLcA6oy-Jmse2b0_jhCG9ipS_0 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5229006397752127337', time=2024-09-14T13:53:19.209939+0000, chain.objs.size()=1 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.l0bxUfFDY39-UKA7cLl6Y0tds_guAQO_0 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5292600459668242962', time=2024-09-14T13:53:19.908591+0000, chain.objs.size()=1 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ucNt7x6XdU1Y0JJyiGb2EanU6oC4CoB_0 2024-09-14T12:44:03.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11879014766619087285', time=2024-09-14T13:53:21.554305+0000, chain.objs.size()=1 2024-09-14T12:44:03.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RsOdPpGIokqnuAftnZaRU9mLvknyA1O_0 2024-09-14T12:44:03.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2608118362198841086', time=2024-09-14T13:53:22.272030+0000, chain.objs.size()=1 2024-09-14T12:44:03.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hD-ISu0gJsccwQKCF9QatsO-I7OW64Z_0 2024-09-14T12:44:03.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2483862130540256576', time=2024-09-14T13:53:22.915696+0000, chain.objs.size()=1 2024-09-14T12:44:03.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RlX_AGZDtbzSwHlH65t2n58_-nDr8hv_0 2024-09-14T12:44:03.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16030899458731544651', time=2024-09-14T13:53:25.833866+0000, chain.objs.size()=1 2024-09-14T12:44:03.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8RkWr-oSxmXGz_v6trwnoytzq2_RKyO_0 2024-09-14T12:44:03.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2054086249315745502', time=2024-09-14T13:53:27.822567+0000, chain.objs.size()=1 2024-09-14T12:44:03.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.sV4ztZaEcRub3MK0ygAIq9Q02O-7SFQ_0 2024-09-14T12:44:03.225 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16642533033516272822', time=2024-09-14T13:53:29.436138+0000, chain.objs.size()=1 2024-09-14T12:44:03.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OCM06d4HLIZgWjPfBV3utnjjNdrUGhO_0 2024-09-14T12:44:03.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9622677968312635919', time=2024-09-14T13:53:29.639181+0000, chain.objs.size()=1 2024-09-14T12:44:03.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HWeEpv4tvvHy0VdojxgZXxUeTG8J6tp_0 2024-09-14T12:44:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12264007498034154127', time=2024-09-14T13:53:30.265257+0000, chain.objs.size()=1 2024-09-14T12:44:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yUZcr81V0rxretYPsJZeZWFm5R0yFHd_0 2024-09-14T12:44:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14159702622323734160', time=2024-09-14T13:53:31.381732+0000, chain.objs.size()=1 2024-09-14T12:44:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OKAo_gK_Ju_hKc82evbaohE3i-BQMdl_0 2024-09-14T12:44:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11807300011196964741', time=2024-09-14T13:53:31.716502+0000, chain.objs.size()=1 2024-09-14T12:44:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ePMWmnDchp3l0qg1MeRN-yCcixzbM6W_0 2024-09-14T12:44:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2267920396423151947', time=2024-09-14T13:53:31.749826+0000, chain.objs.size()=1 2024-09-14T12:44:03.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pt-LiLMD3C2yhkEFkIUGtInis6kpoB-_0 2024-09-14T12:44:03.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12028292904752394967', time=2024-09-14T13:53:31.853342+0000, chain.objs.size()=1 2024-09-14T12:44:03.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EIlmQ_qcWLBWjE93okrJz7tWps3_xvu_0 2024-09-14T12:44:03.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18159457789626219167', time=2024-09-14T13:53:32.825228+0000, chain.objs.size()=1 2024-09-14T12:44:03.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JSLkZKXK37of48eHatDnHH3y7cfgDsE_0 2024-09-14T12:44:03.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9974361741476863766', time=2024-09-14T13:53:33.357717+0000, chain.objs.size()=1 2024-09-14T12:44:03.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eQiiHrpStiBj6wtP9RY2r_vgYz9uvId_0 2024-09-14T12:44:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10809466616467475734', time=2024-09-14T13:53:33.562126+0000, chain.objs.size()=1 2024-09-14T12:44:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.f6_Ufw6wRqCAjISsSTvtldqCyN5xOFh_0 2024-09-14T12:44:03.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16600497750124156401', time=2024-09-14T13:53:33.893643+0000, chain.objs.size()=1 2024-09-14T12:44:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cdbvztPPqEKqveaQRqkMdl_hzExUIup_0 2024-09-14T12:44:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16554826428487325005', time=2024-09-14T13:53:34.717907+0000, chain.objs.size()=1 2024-09-14T12:44:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0G-3_6NMjXP-vKbWs6Vw6ZNuvnJ3xsb_0 2024-09-14T12:44:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8372993829401555919', time=2024-09-14T13:53:34.770057+0000, chain.objs.size()=1 2024-09-14T12:44:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hHIhHEWUPb-ngi1sNrALuCnyPZNCIdK_0 2024-09-14T12:44:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17625008366152663152', time=2024-09-14T13:53:35.137601+0000, chain.objs.size()=1 2024-09-14T12:44:03.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Em3IHQ8BTbl7KYM12OuvsqaOAXHBQvK_0 2024-09-14T12:44:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10554509882250546904', time=2024-09-14T13:53:47.222618+0000, chain.objs.size()=1 2024-09-14T12:44:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.268__shadow_.Wf_nUd7n9xaVzbabbDAu93LdvU7DjcB_0 2024-09-14T12:44:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.631247381475831710', time=2024-09-14T13:54:39.030780+0000, chain.objs.size()=1 2024-09-14T12:44:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.289__shadow_.uuv829CzaqA0nAgcH_p1ve5a9_Vcqzu_0 2024-09-14T12:44:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18286501691623011037', time=2024-09-14T13:54:52.875533+0000, chain.objs.size()=1 2024-09-14T12:44:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.p2mHgs5cSfBzDTL9XkvtpcRi9iKBcO1_0 2024-09-14T12:44:03.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12554960767991498629', time=2024-09-14T13:54:53.195323+0000, chain.objs.size()=1 2024-09-14T12:44:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.z6l7Y6M8il4dtWz_sU-G6ABQc8YpOOZ_0 2024-09-14T12:44:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15442468969207771372', time=2024-09-14T13:55:04.086852+0000, chain.objs.size()=1 2024-09-14T12:44:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.296__shadow_.Po-lzaBa2ImuonKrnhQ8vc9nJr1UtdC_0 2024-09-14T12:44:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17416109943891715389', time=2024-09-14T13:55:09.130180+0000, chain.objs.size()=1 2024-09-14T12:44:03.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.298__shadow_.k1ZDkYrdJxugAGZgY3ncywlpvQiIZRk_0 2024-09-14T12:44:03.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8258923596122274201', time=2024-09-14T13:58:05.563405+0000, chain.objs.size()=1 2024-09-14T12:44:03.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Yapw-T7-0xGeBE1ib-E35LLCcxNSCmW_0 2024-09-14T12:44:03.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5927522321794398800', time=2024-09-14T13:58:07.244978+0000, chain.objs.size()=1 2024-09-14T12:44:03.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Ne4a7i3eVL9izGMU6I04iHPJt3v5ReU_0 2024-09-14T12:44:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7594080008882510669', time=2024-09-14T13:58:08.007716+0000, chain.objs.size()=1 2024-09-14T12:44:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KXG1AvZggsrtTuLADY-Rwb-QKjgCEQL_0 2024-09-14T12:44:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2749510543658174726', time=2024-09-14T13:58:11.006839+0000, chain.objs.size()=1 2024-09-14T12:44:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.E5neNAp9Wj2TPsYyrfR_6rVI3Li2eDj_0 2024-09-14T12:44:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2737054141227328649', time=2024-09-14T13:58:13.755106+0000, chain.objs.size()=1 2024-09-14T12:44:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tVCacR_VLerAMfiIQgA1I5un9dh5u9t_0 2024-09-14T12:44:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.245175052190464125', time=2024-09-14T13:58:13.907622+0000, chain.objs.size()=1 2024-09-14T12:44:03.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.R3ODi6jXw8u_JYwLs4AfRK_I86P7_B7_0 2024-09-14T12:44:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6528229796528671365', time=2024-09-14T13:58:15.096857+0000, chain.objs.size()=1 2024-09-14T12:44:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.otJKUgksZYBu_zQPfIvoFdaf9RpqTlW_0 2024-09-14T12:44:03.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14752521898393559751', time=2024-09-14T13:58:15.521523+0000, chain.objs.size()=1 2024-09-14T12:44:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jkSgvE5nwWDK2uDobr0M_vp_Ia5OJSy_0 2024-09-14T12:44:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9390671708878341979', time=2024-09-14T13:58:15.976001+0000, chain.objs.size()=1 2024-09-14T12:44:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.u0l2cQXLXhGC3HZZ6dYnI4hAyiFX8eT_0 2024-09-14T12:44:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5455765703691227', time=2024-09-14T13:58:18.103110+0000, chain.objs.size()=1 2024-09-14T12:44:03.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wPRv0JNhOViQIATIjR4-AQZcm7_DU6G_0 2024-09-14T12:44:03.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16415885670335236185', time=2024-09-14T13:58:21.289850+0000, chain.objs.size()=1 2024-09-14T12:44:03.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Bih354u5UCN0PiGbF8gbmf8nWrNBcxz_0 2024-09-14T12:44:03.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10111612816207425008', time=2024-09-14T13:58:21.966084+0000, chain.objs.size()=1 2024-09-14T12:44:03.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BbWozLIW9bZgdmS6SqdmSJuoO1nMaYv_0 2024-09-14T12:44:03.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15028216589216290801', time=2024-09-14T13:58:22.208710+0000, chain.objs.size()=1 2024-09-14T12:44:03.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.990BHI464DnMyiJ5Wu6puLWkwXlO_TH_0 2024-09-14T12:44:03.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11547372163473612242', time=2024-09-14T13:58:22.560102+0000, chain.objs.size()=1 2024-09-14T12:44:03.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oZWk-Mu7-Q01T4yba9x77RWgCM8Keh6_0 2024-09-14T12:44:03.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8977428600412310500', time=2024-09-14T13:58:23.670087+0000, chain.objs.size()=1 2024-09-14T12:44:03.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rPUJJ4b-AhlcCVxq3PKY31nT1JajGV1_0 2024-09-14T12:44:03.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14322348527720184289', time=2024-09-14T13:58:23.788341+0000, chain.objs.size()=1 2024-09-14T12:44:03.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DD8BhF_4_q_Mm-pd89XY942EjyZ8Iv-_0 2024-09-14T12:44:03.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16859567263391398912', time=2024-09-14T13:58:23.972542+0000, chain.objs.size()=1 2024-09-14T12:44:03.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mJsNhIoadng8xs9DpgUx1DC3gxa-fzE_0 2024-09-14T12:44:03.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2937333621959617186', time=2024-09-14T13:58:24.779892+0000, chain.objs.size()=1 2024-09-14T12:44:03.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.W2tYtOjwY4youme_5dfZeIHoUaFGniO_0 2024-09-14T12:44:03.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16526966391856233526', time=2024-09-14T13:58:24.881790+0000, chain.objs.size()=1 2024-09-14T12:44:03.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wC9WZkBAk0Wgp7qvRp2MFft02ySHw3O_0 2024-09-14T12:44:03.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10627061174999164680', time=2024-09-14T13:58:27.612273+0000, chain.objs.size()=1 2024-09-14T12:44:03.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KFgM0_5xoxwkXGJ9dN_BrlDBJvuCOk6_0 2024-09-14T12:44:03.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16255041324543913122', time=2024-09-14T13:58:27.677560+0000, chain.objs.size()=1 2024-09-14T12:44:03.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Yso8z8iNzP7cxwodRP3fhEcJsPAVxu2_0 2024-09-14T12:44:03.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9503064574651210880', time=2024-09-14T13:58:28.866123+0000, chain.objs.size()=1 2024-09-14T12:44:03.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TgIz--dW_8-BPN5456d2q_MScV8geHv_0 2024-09-14T12:44:03.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16419108173007701956', time=2024-09-14T13:58:30.606373+0000, chain.objs.size()=1 2024-09-14T12:44:03.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._4voDusyOwulPp0KNR4gCjgYUFGC6rD_0 2024-09-14T12:44:03.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17915264465120410763', time=2024-09-14T13:58:30.682739+0000, chain.objs.size()=1 2024-09-14T12:44:03.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tpg2hE4PpH4SYs1yGGcSO1tlZM32Z3D_0 2024-09-14T12:44:03.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13049324945859402515', time=2024-09-14T13:58:32.126640+0000, chain.objs.size()=1 2024-09-14T12:44:03.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hhB11C2-x_yisUDOQdfa_XdnYjilCGM_0 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9662593597889991943', time=2024-09-14T13:58:32.718137+0000, chain.objs.size()=1 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.yLsBDXkp3CS3u7M0zzPwYjxVxUuOzLz_0 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12733179973009000684', time=2024-09-14T13:58:33.303354+0000, chain.objs.size()=1 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xOXzLdUne3M-LsQhqEY30_8YHLbVq-g_0 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1658301857821099019', time=2024-09-14T13:58:33.733536+0000, chain.objs.size()=1 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fXQOhM4DHfS0rr7f36wFDUlduQQQ2Qr_0 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13520927871652086700', time=2024-09-14T13:58:34.052119+0000, chain.objs.size()=1 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.edi5xepT1anUZYTlCbgdHczMPhuZRWQ_0 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5438070493230522691', time=2024-09-14T14:00:21.017214+0000, chain.objs.size()=1 2024-09-14T12:44:03.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j31Y-ghMdtvwthAC0RQmpzcwlIb_sc4_0 2024-09-14T12:44:03.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10577420437147260977', time=2024-09-14T14:00:22.792137+0000, chain.objs.size()=1 2024-09-14T12:44:03.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.c2oybyN82zDx38V-YaTuvkQCydM9ykV_0 2024-09-14T12:44:03.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.632327353011211275', time=2024-09-14T14:00:22.796394+0000, chain.objs.size()=1 2024-09-14T12:44:03.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Khqev17t_wUPZf4GE_XbcJIQIslFd-9_0 2024-09-14T12:44:03.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13761727118936720092', time=2024-09-14T14:00:23.309358+0000, chain.objs.size()=1 2024-09-14T12:44:03.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UzUNG0c0RJSess7HpxCJUgKK2aAtZZV_0 2024-09-14T12:44:03.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8964791073498240691', time=2024-09-14T14:00:23.859411+0000, chain.objs.size()=1 2024-09-14T12:44:03.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.e4TRan_3osbhipGWIebvkzYIPaSYhsk_0 2024-09-14T12:44:03.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15841290869095843588', time=2024-09-14T14:00:26.308504+0000, chain.objs.size()=1 2024-09-14T12:44:03.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.oIX26mtFNbZchJC1Qiv20KCxq4r3qK7_0 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17048255380645382432', time=2024-09-14T14:00:26.820112+0000, chain.objs.size()=1 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.nKAQAUTfyEdRASTF4dnin6DgRFYTRi9_0 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6591561352284396370', time=2024-09-14T14:00:27.656230+0000, chain.objs.size()=1 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wlFVr2Ynu7jdQkKIlx7iRbctwoDqQeY_0 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16627422037055290889', time=2024-09-14T14:00:31.373145+0000, chain.objs.size()=1 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IlJU9TwmYj0w4kaZGD4GOSt8jJo7Gl4_0 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9492380925254415327', time=2024-09-14T14:00:31.684700+0000, chain.objs.size()=1 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.t2dnHiPGBtpVgI6jYi3HF1MLni2keGz_0 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7388031953235512407', time=2024-09-14T14:00:31.686639+0000, chain.objs.size()=1 2024-09-14T12:44:03.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.GAUysBNIHibWREnwsebDwiSmhC7Mvyj_0 2024-09-14T12:44:03.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15730258021802444976', time=2024-09-14T14:00:32.873611+0000, chain.objs.size()=1 2024-09-14T12:44:03.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CHy9UwPHtY5lTWwS360gr5T4Ms7ETJr_0 2024-09-14T12:44:03.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15861694940921181568', time=2024-09-14T14:00:33.303835+0000, chain.objs.size()=1 2024-09-14T12:44:03.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.peMMaY_Xy4-vsVu-iFLDUs7pNUvx3PU_0 2024-09-14T12:44:03.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3473178937907710855', time=2024-09-14T14:00:33.752958+0000, chain.objs.size()=1 2024-09-14T12:44:03.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uByIpTJrLUFTaRcl041uHpPn9zyf8Gz_0 2024-09-14T12:44:03.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15466280349004558491', time=2024-09-14T14:00:35.635401+0000, chain.objs.size()=1 2024-09-14T12:44:03.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zu0KIL9hRFGegaQUP0wJvZywqnt0tQ3_0 2024-09-14T12:44:03.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8537845748196000193', time=2024-09-14T14:00:35.728297+0000, chain.objs.size()=1 2024-09-14T12:44:03.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8tagwDfdmXOesjWdJvknw6Hm0yd0HRe_0 2024-09-14T12:44:03.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.469913433498696924', time=2024-09-14T14:00:37.083397+0000, chain.objs.size()=1 2024-09-14T12:44:03.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.eRj_QjeJRpbsK8MdkaZavwUnFsL0xxq_0 2024-09-14T12:44:03.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9686312061784695917', time=2024-09-14T14:00:37.239232+0000, chain.objs.size()=1 2024-09-14T12:44:03.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.njUuwRoAs__c09Bb-F3_dFjybIpx8BS_0 2024-09-14T12:44:03.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12464633892432155255', time=2024-09-14T14:00:37.384216+0000, chain.objs.size()=1 2024-09-14T12:44:03.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4uaUMiDkBrbrufF5vgjC9j6xIqqgz6l_0 2024-09-14T12:44:03.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.911356085532436463', time=2024-09-14T14:00:37.535111+0000, chain.objs.size()=1 2024-09-14T12:44:03.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ONh__B37euGgAU1E-5iPzpsF4Vis5pK_0 2024-09-14T12:44:03.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48200 2024-09-14T12:44:03.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17542925081255250981', time=2024-09-14T14:00:37.539162+0000, chain.objs.size()=1 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.oW7ItfkhrqsNtcG_jHIqJDa-4S_MSk6_0 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12479303240392457761', time=2024-09-14T14:00:38.443834+0000, chain.objs.size()=1 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.42UQHvkwMxI5N15y86DZlE8Gfejz1af_0 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2897445587763082212', time=2024-09-14T14:00:40.472742+0000, chain.objs.size()=1 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xOkiTkpCGJ1xqPByJTy7SnZ56yWprwp_0 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16142657572762966753', time=2024-09-14T14:00:41.383869+0000, chain.objs.size()=1 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ZHv_SCv5vjZdo2gCIY8x5FDcpKBRM7r_0 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5402110742025366456', time=2024-09-14T14:00:42.409934+0000, chain.objs.size()=1 2024-09-14T12:44:03.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xUunafb-AMEHxEbiJG7d2qMnmeLIz-9_0 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9005166177977553301', time=2024-09-14T14:00:43.182059+0000, chain.objs.size()=1 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jWhr2lWciqSdmrwC2yoR2aREF99MCGP_0 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6525698140456985206', time=2024-09-14T14:00:44.189262+0000, chain.objs.size()=1 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.drETYY-XGuDc6eDpMQOoYuyPE2BBUtJ_0 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12553292628294515547', time=2024-09-14T14:00:44.191855+0000, chain.objs.size()=1 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QIcx_DS_5Q-qZypzZG0Ja-EvbkILu6Z_0 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13454329409357029243', time=2024-09-14T14:00:44.193463+0000, chain.objs.size()=1 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.PUJ-gsGubwDjZfPucZkYreVm-qpca9e_0 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12304683076481866397', time=2024-09-14T14:00:44.546391+0000, chain.objs.size()=1 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.33TJeHWrKHMPSy6sTPAMl3rrrfvKdkI_0 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10324643106650196363', time=2024-09-14T14:00:45.209695+0000, chain.objs.size()=1 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KZilQ7M7e5RDBZ4ELxXrC2T1rMZ5VTz_0 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11817375924408029041', time=2024-09-14T14:00:46.569347+0000, chain.objs.size()=1 2024-09-14T12:44:03.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wdJ2ES-N_0WIlTcjR5rpPsIvtcp2Btz_0 2024-09-14T12:44:03.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14213422947458933170', time=2024-09-14T14:00:47.718212+0000, chain.objs.size()=1 2024-09-14T12:44:03.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fyiV99fG5fKOo4kLA6RdRrFwidff5wA_0 2024-09-14T12:44:03.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9238627502113883664', time=2024-09-14T14:00:47.771673+0000, chain.objs.size()=1 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bct5O8Z0FNPOraQugKfv181Ss0wJPz-_0 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4219715065894945043', time=2024-09-14T14:00:48.077746+0000, chain.objs.size()=1 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TRAB2XETmSN6UzELaPyH2NYzbjb8JTY_0 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10520864507316226388', time=2024-09-14T14:00:48.434292+0000, chain.objs.size()=1 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.S-_lxnsfslGurtWtxh0Sft_RkHizF2H_0 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11086991834528944367', time=2024-09-14T14:00:48.780388+0000, chain.objs.size()=1 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kR4tXJ_NBiB8BZr3d94qaHnoA5VkIXa_0 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6629607419507280630', time=2024-09-14T14:00:48.879685+0000, chain.objs.size()=1 2024-09-14T12:44:03.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.n7bQd4xYzKFW1c8355ojNUD3XOzvDO7_0 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1521523658395337889', time=2024-09-14T14:00:48.990387+0000, chain.objs.size()=1 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zrdVFwvjUq0f4Tmg8PjYzFwccOH6hSk_0 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6564810894777446773', time=2024-09-14T14:00:49.358920+0000, chain.objs.size()=1 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Nm_tRVoT-QhRyl5lKFrHOw2CuiKPMB8_0 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6507621959122833674', time=2024-09-14T14:00:49.643654+0000, chain.objs.size()=1 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fAx9h4dYVDXgdNmmzva0IXE7zfXGmRE_0 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7422062499556098903', time=2024-09-14T14:06:05.585255+0000, chain.objs.size()=1 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.463__shadow_.51As8hH-sRSyrkkjHxWcLXRZc63boHj_0 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.37294233756739901', time=2024-09-14T14:06:15.079261+0000, chain.objs.size()=1 2024-09-14T12:44:03.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.466__shadow_.A6r7W-hvxbSv1cxEFHdqynbB82CI5ol_0 2024-09-14T12:44:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16720472102104239845', time=2024-09-14T14:10:30.046986+0000, chain.objs.size()=1 2024-09-14T12:44:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.521__shadow:htkh8GOdnRQbNf.JyZHD5EzVdNE2HMt_.GR3Th_N9T07YnSRaAh2zF87bTRLb2fW_0 2024-09-14T12:44:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~L_roeQRVaq3V3Mv7yO73UUUG0uTpgfI', time=2024-09-14T14:15:48.885843+0000, chain.objs.size()=1 2024-09-14T12:44:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.532__multipart_mymultipart2.2~L_roeQRVaq3V3Mv7yO73UUUG0uTpgfI.1 2024-09-14T12:44:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6729417354270079535', time=2024-09-14T14:17:27.013326+0000, chain.objs.size()=1 2024-09-14T12:44:03.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.552__shadow_.wkuR_KQfz6dcE-YpkX__0hXIrTyyyt2_0 2024-09-14T12:44:03.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5300666443452692447', time=2024-09-14T14:17:39.086582+0000, chain.objs.size()=1 2024-09-14T12:44:03.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.553__shadow_.7TwPR0qls6vH2Xn7ceH1WJeBW8oe_ua_0 2024-09-14T12:44:03.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7659145626156624497', time=2024-09-14T14:18:22.624891+0000, chain.objs.size()=1 2024-09-14T12:44:03.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.558__shadow_.fH5V91sduVzAO-5AYySppFMvhQB4oP0_0 2024-09-14T12:44:03.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14570421818604679385', time=2024-09-14T14:18:22.960437+0000, chain.objs.size()=1 2024-09-14T12:44:03.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.558__shadow_.IQsNht4r77QRvbc1-VUfWqD2ex8fmn5_0 2024-09-14T12:44:03.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4705156207580059898', time=2024-09-14T14:20:21.212940+0000, chain.objs.size()=1 2024-09-14T12:44:03.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:N0a.xJ5YdFJp8-QBOQPxHb.4FYGYG6v_.s1ZRAO05Jgd0un_OSVHn7IhazWLC5GI_0 2024-09-14T12:44:03.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11407910763164180843', time=2024-09-14T14:21:02.745936+0000, chain.objs.size()=1 2024-09-14T12:44:03.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:wO-hc8HT9qqu6vPTatYYsZM753NsigY_.Z7UpH4Rs5m8cAoFdKBggJQ2qv1hdXJc_0 2024-09-14T12:44:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2893350581426517559', time=2024-09-14T14:21:59.499841+0000, chain.objs.size()=4 2024-09-14T12:44:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~FNo3aPeI1HLTtRR913l2Ol1gtblPypb.1 2024-09-14T12:44:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~FNo3aPeI1HLTtRR913l2Ol1gtblPypb.2 2024-09-14T12:44:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~FNo3aPeI1HLTtRR913l2Ol1gtblPypb.3 2024-09-14T12:44:03.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~FNo3aPeI1HLTtRR913l2Ol1gtblPypb.4 2024-09-14T12:44:03.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3965974882094706125', time=2024-09-14T14:22:04.095211+0000, chain.objs.size()=4 2024-09-14T12:44:03.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~Bqrx7hDn2BM86mCbPn0ezFrjvNo8-At.1 2024-09-14T12:44:03.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~Bqrx7hDn2BM86mCbPn0ezFrjvNo8-At.2 2024-09-14T12:44:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~Bqrx7hDn2BM86mCbPn0ezFrjvNo8-At.3 2024-09-14T12:44:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~Bqrx7hDn2BM86mCbPn0ezFrjvNo8-At.4 2024-09-14T12:44:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10956300046527438321', time=2024-09-14T14:23:15.334670+0000, chain.objs.size()=1 2024-09-14T12:44:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.606__shadow_.Q5lDnTIm824vvesghFO8WFLxz3aptp9_0 2024-09-14T12:44:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7569569106583097012', time=2024-09-14T14:30:22.466043+0000, chain.objs.size()=1 2024-09-14T12:44:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.640__shadow_.ulgewzUR6-u2PG3qIBPMVVPnU3vZLnF_0 2024-09-14T12:44:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7887222039219193108', time=2024-09-14T14:30:26.271678+0000, chain.objs.size()=1 2024-09-14T12:44:03.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.642__shadow_.ccPQqz92oHsZQ0VggRHUZRgg6eiSH_i_0 2024-09-14T12:44:03.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1563332573764686774', time=2024-09-14T14:32:50.469217+0000, chain.objs.size()=1 2024-09-14T12:44:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.669__shadow_.6Iv7tST2a_bt7bEq9AC6GLMw2lHQpzc_0 2024-09-14T12:44:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10735658260706105395', time=2024-09-14T14:33:11.625159+0000, chain.objs.size()=1 2024-09-14T12:44:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.680__shadow_.q556tmPV4A_o_ReBgnGDSr5UhLUXUXe_0 2024-09-14T12:44:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15760558862351057996', time=2024-09-14T14:33:45.706152+0000, chain.objs.size()=1 2024-09-14T12:44:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.697__shadow:pqE-bovudNNZv9zOa5Oi8RymqTI0EJj_._PUW-SZqDyVAEjDhkXhBZlsZq5I-HmW_0 2024-09-14T12:44:03.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10729168952426828463', time=2024-09-14T14:34:09.324301+0000, chain.objs.size()=1 2024-09-14T12:44:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.707__shadow_.FC-6mjHHpJ8XAu85kxpRVYdnUpxXnm__0 2024-09-14T12:44:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16272122388528084478', time=2024-09-14T14:40:39.991722+0000, chain.objs.size()=1 2024-09-14T12:44:03.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.774__shadow_.ZtStyWvqecoH82xEUk10cbKHzGvXhBO_0 2024-09-14T12:44:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T12:44:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48183' 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_HzXdOh7MEgw6cfa3y2E8Xxp9Z1GOEAk', time=2024-09-14T13:43:31.874145+0000, chain.objs.size()=3 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.VlXkiQ219Pf0gcdhPgIMLrwjUkfjqiA_0 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.VlXkiQ219Pf0gcdhPgIMLrwjUkfjqiA_1 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.VlXkiQ219Pf0gcdhPgIMLrwjUkfjqiA_2 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9787703911953789501', time=2024-09-14T13:50:04.870834+0000, chain.objs.size()=1 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.234__shadow_.Tq-1A9omornczqFK_g-J1TCvpCouxX5_0 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16986515408342991512', time=2024-09-14T13:50:40.898606+0000, chain.objs.size()=1 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.246__shadow_.MLQE1IDlMJ7JYApd8SKlZQlBP313hsa_0 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4039441733744021786', time=2024-09-14T13:50:45.987168+0000, chain.objs.size()=1 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.248__shadow_.9zloEnIwoXJZZTHdIBDL9R85Dl6j1WJ_0 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1181435698330353675', time=2024-09-14T13:51:20.877842+0000, chain.objs.size()=1 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.262__shadow_.oENwXXQBWTNX42Nc_bX9enpepA5wWsO_0 2024-09-14T12:44:03.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6402556390666059971', time=2024-09-14T13:53:06.635479+0000, chain.objs.size()=1 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HmUpJ4hieCWKglHfiqAQi7mvr_humbr_0 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16347053614293883510', time=2024-09-14T13:53:10.583984+0000, chain.objs.size()=1 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FMiUnh2WM_8xBI116aFf7IqE7F9H_5g_0 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15870297091143781981', time=2024-09-14T13:53:14.115059+0000, chain.objs.size()=1 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jLViAg40r-wc0WjAk_LvdL9xkLwlGPU_0 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11827814941290704293', time=2024-09-14T13:53:14.996684+0000, chain.objs.size()=1 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BfUd7X2j3TbwwXJwkxsp5zOgRcOWuDg_0 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4942143976570470480', time=2024-09-14T13:53:17.727985+0000, chain.objs.size()=1 2024-09-14T12:44:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Pfyy1t_Bf7pWbyVl5sQnEsIwJ1M-F6R_0 2024-09-14T12:44:03.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15410361694228002976', time=2024-09-14T13:53:23.884425+0000, chain.objs.size()=1 2024-09-14T12:44:03.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LSZwCkMKeyXFp-A3yYjnhmGUYnn6AcE_0 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8507107534820109669', time=2024-09-14T13:53:23.886925+0000, chain.objs.size()=1 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.M5IzVWGzxPwNuBcO9Z603MjdBYoZQMm_0 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1551077325553772754', time=2024-09-14T13:53:24.217528+0000, chain.objs.size()=1 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oQgQDaNpYAbh5BNghy91qbLHAIzr8Fq_0 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16744574315739909913', time=2024-09-14T13:53:24.377497+0000, chain.objs.size()=1 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.70hm2Q70Lsud59_P5X33-rpDFve6cw5_0 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11929498679721403249', time=2024-09-14T13:53:25.271342+0000, chain.objs.size()=1 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ayHTUxAicoUuK1_5-KJq4Qm7ym8da04_0 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1070290182425688418', time=2024-09-14T13:53:25.338951+0000, chain.objs.size()=1 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XZEf-HpCmZY4s-CH-wMWTKC-hSVUTX6_0 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17176751839063664814', time=2024-09-14T13:53:26.521083+0000, chain.objs.size()=1 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HsIZEuUw3cW9-2O--r-eqjYnOH4mPga_0 2024-09-14T12:44:03.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14667677106155959119', time=2024-09-14T13:53:27.842510+0000, chain.objs.size()=1 2024-09-14T12:44:03.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JUYCZKEiiuII6lXl7KA_ycx1v3ObaN__0 2024-09-14T12:44:03.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13271765838840361987', time=2024-09-14T13:53:27.976651+0000, chain.objs.size()=1 2024-09-14T12:44:03.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.iL0FciI96cGkalrD-WEA-RcJg29NEzN_0 2024-09-14T12:44:03.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13730303672526250904', time=2024-09-14T13:53:29.003312+0000, chain.objs.size()=1 2024-09-14T12:44:03.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.a4A1xmYXo-AVXzvX74gDxnLyNCM9aAx_0 2024-09-14T12:44:03.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13781303842590001227', time=2024-09-14T13:53:30.976555+0000, chain.objs.size()=1 2024-09-14T12:44:03.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rE7NmFFMJpuO88_Y4PazLk2W6DXA-Or_0 2024-09-14T12:44:03.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16951282158688619242', time=2024-09-14T13:53:31.107853+0000, chain.objs.size()=1 2024-09-14T12:44:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3DC-ivKFuKbdE5WqRO05YWWUuTfw3ur_0 2024-09-14T12:44:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6922306613775516327', time=2024-09-14T13:53:31.174639+0000, chain.objs.size()=1 2024-09-14T12:44:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GUW39VLiJBgv2ICh4udBLAmUyKRgdfN_0 2024-09-14T12:44:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14704267451541668339', time=2024-09-14T13:53:31.387276+0000, chain.objs.size()=1 2024-09-14T12:44:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.M1D9WO1EQlNgk8xtmdSy8LIkIOh_UiU_0 2024-09-14T12:44:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6776658359150642128', time=2024-09-14T13:53:33.368242+0000, chain.objs.size()=1 2024-09-14T12:44:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fzJGz1fXCG9Ag5_Ha8In7frtulNR3pw_0 2024-09-14T12:44:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14282213872424109536', time=2024-09-14T13:53:34.748830+0000, chain.objs.size()=1 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LTc-7cjRm3fVMqzNFfYhCtyhz0BDHD7_0 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7721352961130119066', time=2024-09-14T13:53:34.871286+0000, chain.objs.size()=1 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XkChzC29ngfR42Rc32kjFCKE-Z4nSVr_0 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10430723835078678091', time=2024-09-14T13:53:35.012078+0000, chain.objs.size()=1 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WvqN8_hCImLvn6IYabDTocWQD9_g09F_0 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15144524408445226670', time=2024-09-14T13:53:54.333351+0000, chain.objs.size()=1 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.271__shadow_.aw_7EOGA50MKpbsAK6J0FHuLHUuSwzq_0 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16629471237822689715', time=2024-09-14T13:54:03.769531+0000, chain.objs.size()=1 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.275__shadow_.hRdxDbkRZdUvTm1hHyklr4m31168gSa_0 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7657713597691964212', time=2024-09-14T13:54:16.317792+0000, chain.objs.size()=1 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.280__shadow_.LMBschnl07jWx6VpZRSpy5J6nsfVjYF_0 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12511623708479697732', time=2024-09-14T13:54:21.262610+0000, chain.objs.size()=1 2024-09-14T12:44:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.325+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.282__shadow_.9Z5CVFwQv1ApWUefJvWl0PgVD0zDQys_0 2024-09-14T12:44:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6549753489190269455', time=2024-09-14T13:58:05.670558+0000, chain.objs.size()=1 2024-09-14T12:44:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.enidpKdgVe8RqFIs9yikA7Ks0CfASBg_0 2024-09-14T12:44:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15101105675196197277', time=2024-09-14T13:58:06.012089+0000, chain.objs.size()=1 2024-09-14T12:44:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4UPIDue4ntkVskfQJ8zjj8uxvmTf1O7_0 2024-09-14T12:44:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15230089564677333399', time=2024-09-14T13:58:07.212158+0000, chain.objs.size()=1 2024-09-14T12:44:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qmfMxKWrnoq9Z18NnPMtyRSH_oCNeWq_0 2024-09-14T12:44:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17781334746803167788', time=2024-09-14T13:58:07.714355+0000, chain.objs.size()=1 2024-09-14T12:44:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eVFDZdqCP5FkoMijOXkGaVvqiyLMI1I_0 2024-09-14T12:44:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.197710713705290891', time=2024-09-14T13:58:08.061049+0000, chain.objs.size()=1 2024-09-14T12:44:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rNOH4MkcKt4akNHIPwyKPDeaqkKbXK8_0 2024-09-14T12:44:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2291463059488255176', time=2024-09-14T13:58:08.388547+0000, chain.objs.size()=1 2024-09-14T12:44:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Jk8LgKB5K3Vvq_cidOyJcu6ySw7xp2W_0 2024-09-14T12:44:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5065652203756218330', time=2024-09-14T13:58:10.020162+0000, chain.objs.size()=1 2024-09-14T12:44:03.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1m7NxsoSqvxaYLIamUpRo_G_pkEbVIH_0 2024-09-14T12:44:03.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14605494914117751468', time=2024-09-14T13:58:10.022659+0000, chain.objs.size()=1 2024-09-14T12:44:03.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._70yAgWNNICX9S8of5dRimLXNzT_GNb_0 2024-09-14T12:44:03.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15232540412454473621', time=2024-09-14T13:58:10.534641+0000, chain.objs.size()=1 2024-09-14T12:44:03.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0ice822bXI0B_EbNYfsGDy24SBdDakf_0 2024-09-14T12:44:03.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4488921769151177756', time=2024-09-14T13:58:11.046443+0000, chain.objs.size()=1 2024-09-14T12:44:03.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZE8cdHDSWf5B6XLqzZfDrhOBOx4u98b_0 2024-09-14T12:44:03.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.333+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2337029424187946650', time=2024-09-14T13:58:11.622986+0000, chain.objs.size()=1 2024-09-14T12:44:03.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.333+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Uka786bE4_L1UVA7Vhe_UeVKzs-WlXQ_0 2024-09-14T12:44:03.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.333+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4475129791091017436', time=2024-09-14T13:58:15.120247+0000, chain.objs.size()=1 2024-09-14T12:44:03.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.333+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jzMysJuZSJPckF2LzCSYD6MFy0eiygm_0 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13872825909526545782', time=2024-09-14T13:58:16.108431+0000, chain.objs.size()=1 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oTPYkFgviwI_2Pffp-sKYmM3rwmUZYC_0 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15993702717200386850', time=2024-09-14T13:58:18.794373+0000, chain.objs.size()=1 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.E-ur1N8t9CWgRXvQItGeOwqowFzumy2_0 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11014734794439913910', time=2024-09-14T13:58:19.013094+0000, chain.objs.size()=1 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1Q8mUDXhbrVKHRfUDyc5P5EHELDwc_S_0 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13372566857947290334', time=2024-09-14T13:58:19.832595+0000, chain.objs.size()=1 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.loQDsXXdZvxoSrudWouLfgkfQ6yGDeO_0 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17420274005252863516', time=2024-09-14T13:58:21.277562+0000, chain.objs.size()=1 2024-09-14T12:44:03.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.MhXK1gCJem64pmpW3MgZ7ys3mRTQngb_0 2024-09-14T12:44:03.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10559124356061723151', time=2024-09-14T13:58:21.503174+0000, chain.objs.size()=1 2024-09-14T12:44:03.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.zghIENoamh98hYYhlVC5Cw5CCqyBENG_0 2024-09-14T12:44:03.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9681435818405784429', time=2024-09-14T13:58:21.625154+0000, chain.objs.size()=1 2024-09-14T12:44:03.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.yDKama4p6FfpMoP8p5ZtueB8XQuqW30_0 2024-09-14T12:44:03.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7190819730220408206', time=2024-09-14T13:58:22.864819+0000, chain.objs.size()=1 2024-09-14T12:44:03.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XrF-sLZAR0YO3isHqmbzl4ZMAZ1IXKe_0 2024-09-14T12:44:03.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.123585689674604819', time=2024-09-14T13:58:23.982105+0000, chain.objs.size()=1 2024-09-14T12:44:03.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.awSdayLOzB-L4oFla56MRIkw7GBrZCW_0 2024-09-14T12:44:03.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2348151649012273387', time=2024-09-14T13:58:27.048349+0000, chain.objs.size()=1 2024-09-14T12:44:03.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7S_Ece_gSkJewuVqIhjpLhgdFQQhI6l_0 2024-09-14T12:44:03.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14102099285654189298', time=2024-09-14T13:58:29.321165+0000, chain.objs.size()=1 2024-09-14T12:44:03.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.B29aXJVCbSLiuMN_oi1E1h12r1ZacF0_0 2024-09-14T12:44:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16136335056548890231', time=2024-09-14T14:00:21.097796+0000, chain.objs.size()=1 2024-09-14T12:44:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lvfWV-W4p_S8o5YGVNbypfySaqo263V_0 2024-09-14T12:44:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4837361092188343785', time=2024-09-14T14:00:22.527780+0000, chain.objs.size()=1 2024-09-14T12:44:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1pb2DrH2aEJV2xqofSfnVuAuVWder4H_0 2024-09-14T12:44:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3155131545945889554', time=2024-09-14T14:00:23.024789+0000, chain.objs.size()=1 2024-09-14T12:44:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uTqvz-rYLalDRbWncU1TXkqX5jiSEYi_0 2024-09-14T12:44:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1224123935677756523', time=2024-09-14T14:00:25.399579+0000, chain.objs.size()=1 2024-09-14T12:44:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UyyR2dIZbhavKKinTU5B_DJJucu7UxI_0 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11899326723559994283', time=2024-09-14T14:00:25.430432+0000, chain.objs.size()=1 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-JYEDXzCXw3sK9tPhtK1Us-GILSGldV_0 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14988835470354202830', time=2024-09-14T14:00:26.798206+0000, chain.objs.size()=1 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IISsrEgLsryja7MY22n9Zmp-i4GbfdC_0 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11972113380210777212', time=2024-09-14T14:00:27.509637+0000, chain.objs.size()=1 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TE7RHp8eN_Y64kg-M7cxHhecvvUrscX_0 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12675447562972211904', time=2024-09-14T14:00:29.051864+0000, chain.objs.size()=1 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.P_s7iM0HNdR6y19oXvpnn6x9xS00D33_0 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1653514224605896023', time=2024-09-14T14:00:29.403570+0000, chain.objs.size()=1 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ZUj9CYj9ohWeHgsb8dxRsOnZGbcNFHy_0 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10696726293711296439', time=2024-09-14T14:00:30.537657+0000, chain.objs.size()=1 2024-09-14T12:44:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ONJ6kqqSE6Tl77escizn6QtLzWUukK__0 2024-09-14T12:44:03.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3762293857282167495', time=2024-09-14T14:00:31.123695+0000, chain.objs.size()=1 2024-09-14T12:44:03.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.twmRqIfz5PdXnsuwpT_KXV409cKuB8a_0 2024-09-14T12:44:03.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14551751058820072131', time=2024-09-14T14:00:31.505071+0000, chain.objs.size()=1 2024-09-14T12:44:03.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ISjdDZq5JMSpA5YrInleMmmmNl5FCNF_0 2024-09-14T12:44:03.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14794509681223156265', time=2024-09-14T14:00:33.115465+0000, chain.objs.size()=1 2024-09-14T12:44:03.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tMjYBde6gjJNXl6-Mgf3ps9B33T-YyS_0 2024-09-14T12:44:03.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5780338941503099886', time=2024-09-14T14:00:33.810978+0000, chain.objs.size()=1 2024-09-14T12:44:03.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TzwuPKgtfv_jQnIgA9N7OSc6-1g5E1K_0 2024-09-14T12:44:03.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4364922327006777980', time=2024-09-14T14:00:34.247147+0000, chain.objs.size()=1 2024-09-14T12:44:03.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VJdYWEsTFbnH-16YGxDvjZ11A5zaB5e_0 2024-09-14T12:44:03.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1458295232053867303', time=2024-09-14T14:00:34.249798+0000, chain.objs.size()=1 2024-09-14T12:44:03.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gyOkJsnO1jS8uCrZpQJxLa0y4qzP1Y5_0 2024-09-14T12:44:03.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14036174743361324101', time=2024-09-14T14:00:34.453609+0000, chain.objs.size()=1 2024-09-14T12:44:03.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uERvICs4M0SGFdC7iNHKVJls0HXyXfk_0 2024-09-14T12:44:03.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15846269700718895339', time=2024-09-14T14:00:36.693074+0000, chain.objs.size()=1 2024-09-14T12:44:03.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UTQAsqPxR_lOlK432pjvBfVQrraL8qA_0 2024-09-14T12:44:03.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17946333223913544306', time=2024-09-14T14:00:39.381088+0000, chain.objs.size()=1 2024-09-14T12:44:03.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NbGvVC1_Vub2b6C5N3GIKooJQLO3WEB_0 2024-09-14T12:44:03.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17936917989216879068', time=2024-09-14T14:00:39.489011+0000, chain.objs.size()=1 2024-09-14T12:44:03.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5WA5qdMAE960L35TPbS1HUIzknca3Y6_0 2024-09-14T12:44:03.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10668248990287463293', time=2024-09-14T14:00:40.461565+0000, chain.objs.size()=1 2024-09-14T12:44:03.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._sKzo0RMWeGuYv1gTsAsTNAHWgJIjAw_0 2024-09-14T12:44:03.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4759060515521602389', time=2024-09-14T14:00:40.463766+0000, chain.objs.size()=1 2024-09-14T12:44:03.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KwB7cBhxJub4Mlql6P7XZPLTQUYQdP__0 2024-09-14T12:44:03.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2585031697232444230', time=2024-09-14T14:00:40.714429+0000, chain.objs.size()=1 2024-09-14T12:44:03.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.X_bQiU9iuGrBgVEjqfm5Mdr62rsJogB_0 2024-09-14T12:44:03.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16148587293964169145', time=2024-09-14T14:00:40.897768+0000, chain.objs.size()=1 2024-09-14T12:44:03.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8Uo26WCbdRpQrWSwLtaO0rZgKczupGh_0 2024-09-14T12:44:03.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5218414837469774136', time=2024-09-14T14:00:40.998657+0000, chain.objs.size()=1 2024-09-14T12:44:03.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9xIpGWdnvnbDXZtEBOqPct8GoOQf78q_0 2024-09-14T12:44:03.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17511873966325822480', time=2024-09-14T14:00:41.140831+0000, chain.objs.size()=1 2024-09-14T12:44:03.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.MoqY-RgSdp_5SihDLUHwPKHWpwZck8P_0 2024-09-14T12:44:03.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.538761204948364653', time=2024-09-14T14:00:41.692123+0000, chain.objs.size()=1 2024-09-14T12:44:03.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jfZTXWVgzxhS2FU71pK75vUWVt9dwZ5_0 2024-09-14T12:44:03.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7066958237062624597', time=2024-09-14T14:00:42.048021+0000, chain.objs.size()=1 2024-09-14T12:44:03.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.OIGWbnw4ZvyOU1SWXnfsho3Q2ypGaAc_0 2024-09-14T12:44:03.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5846396306698966327', time=2024-09-14T14:00:44.992577+0000, chain.objs.size()=1 2024-09-14T12:44:03.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Bm2zlb4VKmpLB5QNQ3TimxHODaeKjT4_0 2024-09-14T12:44:03.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5181711550740223934', time=2024-09-14T14:00:45.229755+0000, chain.objs.size()=1 2024-09-14T12:44:03.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.0Tmn8DLykt5OVdgxUfo7rEqDPo_eLvK_0 2024-09-14T12:44:03.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2466522284161480102', time=2024-09-14T14:00:46.744321+0000, chain.objs.size()=1 2024-09-14T12:44:03.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.sJIPj81KrqAB75sYiEMNBWjZ4CICWuH_0 2024-09-14T12:44:03.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1289523253047278827', time=2024-09-14T14:00:49.188569+0000, chain.objs.size()=1 2024-09-14T12:44:03.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mZ6afHukwSx_e9njFlCDx6nrTcaMfvA_0 2024-09-14T12:44:03.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10120926991680255713', time=2024-09-14T14:01:00.515283+0000, chain.objs.size()=1 2024-09-14T12:44:03.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.330__shadow_.VuE2sKyH18y2ICHjw0d2Wd5a0HrUByr_0 2024-09-14T12:44:03.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3831245174761177525', time=2024-09-14T14:01:14.443120+0000, chain.objs.size()=1 2024-09-14T12:44:03.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.336__shadow_.ifay5cp_bcI1fn485bcybe9TCOrts2t_0 2024-09-14T12:44:03.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2956169470841565621', time=2024-09-14T14:01:39.163620+0000, chain.objs.size()=1 2024-09-14T12:44:03.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.347__shadow_.juawZYZmk1Zk8QwUjb3Npv1YswyUHev_0 2024-09-14T12:44:03.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.762033938672345452', time=2024-09-14T14:04:53.048459+0000, chain.objs.size()=1 2024-09-14T12:44:03.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.436__shadow_.JG0WVBmOKpFCR7BwGBLhnImlaPNVwJ8_0 2024-09-14T12:44:03.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.535579189101939291', time=2024-09-14T14:05:07.358288+0000, chain.objs.size()=1 2024-09-14T12:44:03.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.442__shadow_.zEVhXKVp-XpwW8QSNFSS3c7zlVqh9DY_0 2024-09-14T12:44:03.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1448689359446988349', time=2024-09-14T14:05:31.131023+0000, chain.objs.size()=1 2024-09-14T12:44:03.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.451__shadow_.fD3hmi3yf2sg_4-TEWunlSyDMZcSv09_0 2024-09-14T12:44:03.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11066683880528881761', time=2024-09-14T14:06:49.700256+0000, chain.objs.size()=1 2024-09-14T12:44:03.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.485__shadow_.m5wMNoEJeMPMXDeH8j2sIUA49yy-JsR_0 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6734972957269847538', time=2024-09-14T14:08:23.039791+0000, chain.objs.size()=6 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.1 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.2 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.3 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.4 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.5 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.6 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2463375440077473974', time=2024-09-14T14:08:36.065641+0000, chain.objs.size()=1 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.513__shadow_.uUjuwjAzvh-HNxFPZppSDH2dKPTY3Si_0 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12661687389393760514', time=2024-09-14T14:17:40.782531+0000, chain.objs.size()=1 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.553__shadow_.CUamF8alNs9ya3weEChiW3UTcGeh1Wq_0 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5431944653697950527', time=2024-09-14T14:18:43.894022+0000, chain.objs.size()=1 2024-09-14T12:44:03.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.560__shadow_.CWlYjPaau10E4qn6AT9xKV4ZJxx0VMZ_0 2024-09-14T12:44:03.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3735766765592335334', time=2024-09-14T14:19:26.370945+0000, chain.objs.size()=1 2024-09-14T12:44:03.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:XRrd.5wYfaoaU3010abKAETUTQCywSE_.if5_0gm-8hnap-cfuHIlndkW9k6lQeV_0 2024-09-14T12:44:03.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16414630432697885478', time=2024-09-14T14:20:07.571590+0000, chain.objs.size()=1 2024-09-14T12:44:03.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow:BQRYaQMZqCsuJNbypLVIJgdCX4iSHAI_._mbNPwu1tXIpBoaL6-SGh_oMBHgHxHR_0 2024-09-14T12:44:03.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48183 2024-09-14T12:44:03.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9366884149156579536', time=2024-09-14T14:20:16.571132+0000, chain.objs.size()=1 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:LPz9CLaLttMSrC14HopX.d3tIn3CcNs_.yQhDfhWppGUOAET4vWcUySg6ASl4Ueo_0 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2075992046732962688', time=2024-09-14T14:20:32.491377+0000, chain.objs.size()=1 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:W8roci5DtucDtlLH4gyoQ.1C1-YsJH1_.PCSmHcYd-QfX6JZi3Tz1DvZ9zi4884s_0 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3183645728395002069', time=2024-09-14T14:20:39.029663+0000, chain.objs.size()=1 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:z3pYWmqBNFSqppNw-OVal8mXkO1JIt0_.lITJSDmchl0ISDrIg8kA1GUY_X9xFAI_0 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15694249685547040069', time=2024-09-14T14:20:49.535578+0000, chain.objs.size()=1 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:uGHSadvtGkrn9VXZIF79c3BdmfRqafu_.Ou0eQaUT81YpIKy4envGgS9whfcJ8RW_0 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj', time=2024-09-14T14:29:31.562425+0000, chain.objs.size()=12 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__multipart_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.1 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__shadow_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.1_1 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__multipart_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.2 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__shadow_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.2_1 2024-09-14T12:44:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__multipart_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.3 2024-09-14T12:44:03.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__shadow_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.3_1 2024-09-14T12:44:03.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__multipart_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.4 2024-09-14T12:44:03.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.377+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__shadow_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.4_1 2024-09-14T12:44:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__multipart_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.5 2024-09-14T12:44:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__shadow_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.5_1 2024-09-14T12:44:03.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__multipart_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.6 2024-09-14T12:44:03.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.625__shadow_multipart_enc.2~XpDhV2kGHBkkdMKgfT-LTNDKNwiaNJj.6_1 2024-09-14T12:44:03.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17432865212729645762', time=2024-09-14T14:30:03.733583+0000, chain.objs.size()=1 2024-09-14T12:44:03.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.632__shadow_.tlWEu8SOKK0tMMkj6VhtyzIul3qOY03_0 2024-09-14T12:44:03.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1812256395088645656', time=2024-09-14T14:30:48.486162+0000, chain.objs.size()=1 2024-09-14T12:44:03.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.646__shadow_.W7RNtkToxvogOlaz_l6GYHbYIuSKBad_0 2024-09-14T12:44:03.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.292104757552826679', time=2024-09-14T14:32:31.723478+0000, chain.objs.size()=12 2024-09-14T12:44:03.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__multipart_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.1 2024-09-14T12:44:03.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__shadow_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.1_1 2024-09-14T12:44:03.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__multipart_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.2 2024-09-14T12:44:03.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__shadow_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.2_1 2024-09-14T12:44:03.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__multipart_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.3 2024-09-14T12:44:03.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__shadow_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.3_1 2024-09-14T12:44:03.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__multipart_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.4 2024-09-14T12:44:03.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__shadow_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.4_1 2024-09-14T12:44:03.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__multipart_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.5 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__shadow_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.5_1 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__multipart_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.6 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.661__shadow_bar.2~IbvfrWzxr_hzGAyeJKS4xmS3izWkeVb.6_1 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13409144500867820059', time=2024-09-14T14:33:50.132001+0000, chain.objs.size()=1 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.699__shadow:wiCfzw3D4zWpD3VlzCOFjls3km3E87s_.vSfwbteLPfwUrw1dzUH6hB-Q4i83ey1_0 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1057320085001448411', time=2024-09-14T14:34:07.129678+0000, chain.objs.size()=1 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.706__shadow:ERX9P9p-iAS03Y8MiqLT5JyKGpbY7DL_.olphJwtsDgPav8AEKzJWAtNZ42b3lAj_0 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7055431107470352457', time=2024-09-14T14:38:13.210419+0000, chain.objs.size()=1 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.753__shadow_.LAiA6rQaSZVDMKgAlBhh3_pD_oew6qg_0 2024-09-14T12:44:03.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13228490990269184047', time=2024-09-14T14:42:21.881012+0000, chain.objs.size()=8 2024-09-14T12:44:03.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.780__shadow_.fnt6n7WWnNMQzCfmrURoMj68ZUtj2hS_0 2024-09-14T12:44:03.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.780__shadow_.fnt6n7WWnNMQzCfmrURoMj68ZUtj2hS_1 2024-09-14T12:44:03.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.780__shadow_.fnt6n7WWnNMQzCfmrURoMj68ZUtj2hS_2 2024-09-14T12:44:03.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.780__shadow_.fnt6n7WWnNMQzCfmrURoMj68ZUtj2hS_3 2024-09-14T12:44:03.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.780__shadow_.fnt6n7WWnNMQzCfmrURoMj68ZUtj2hS_4 2024-09-14T12:44:03.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.780__shadow_.fnt6n7WWnNMQzCfmrURoMj68ZUtj2hS_5 2024-09-14T12:44:03.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.780__shadow_.fnt6n7WWnNMQzCfmrURoMj68ZUtj2hS_6 2024-09-14T12:44:03.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.780__shadow_.fnt6n7WWnNMQzCfmrURoMj68ZUtj2hS_7 2024-09-14T12:44:03.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T12:44:03.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49045' 2024-09-14T12:44:03.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_9f0G-IKO6YfTQgugSZb0dpoix-wV5ze', time=2024-09-14T13:43:20.946836+0000, chain.objs.size()=3 2024-09-14T12:44:03.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.gck0EPYx34-0-NlT8fCbZ0z6_jjIFEC_0 2024-09-14T12:44:03.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.gck0EPYx34-0-NlT8fCbZ0z6_jjIFEC_1 2024-09-14T12:44:03.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.gck0EPYx34-0-NlT8fCbZ0z6_jjIFEC_2 2024-09-14T12:44:03.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15353119279369608818', time=2024-09-14T13:50:43.438416+0000, chain.objs.size()=1 2024-09-14T12:44:03.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.247__shadow_.EAf6VCL1yeR_TfWJSCC9RWc5g4bUFaG_0 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4265450204802755046', time=2024-09-14T13:51:01.107103+0000, chain.objs.size()=1 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.254__shadow_.ne69_LqoeT_LWoeKHPCLPfoREnYK--l_0 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12958136312728227071', time=2024-09-14T13:53:05.373267+0000, chain.objs.size()=1 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.--R13TGHk0fayFuWCX8thjnf8ihomlX_0 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13703877311492667161', time=2024-09-14T13:53:09.976191+0000, chain.objs.size()=1 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.o259ovwZdEDB7ttX0TyTJzubX8RsXW7_0 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16461103474236384423', time=2024-09-14T13:53:10.527829+0000, chain.objs.size()=1 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0mzc2vmaRPtZk3s5F5xsRSed6l5B8Vp_0 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15207777329176847368', time=2024-09-14T13:53:10.575762+0000, chain.objs.size()=1 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.K0nrts-979mREAauJEye0LwPxAg8LNR_0 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1278847532222155750', time=2024-09-14T13:53:10.962422+0000, chain.objs.size()=1 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aI-bi0Wm_1yWXtA7fVde1P0rKSwJmBy_0 2024-09-14T12:44:03.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.726199453316113160', time=2024-09-14T13:53:11.144371+0000, chain.objs.size()=1 2024-09-14T12:44:03.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9RggikUSfnW5PQyH9i62UYmknqf4KAe_0 2024-09-14T12:44:03.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14486013198741619836', time=2024-09-14T13:53:11.292295+0000, chain.objs.size()=1 2024-09-14T12:44:03.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.zNuxTlCvM6ysX0rGzuYqAz2sG8GmwgL_0 2024-09-14T12:44:03.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10509909469697166607', time=2024-09-14T13:53:11.845266+0000, chain.objs.size()=1 2024-09-14T12:44:03.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7Llwz_c6RoDiySrAoufkx4nLaQN5vYx_0 2024-09-14T12:44:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15530178106139753276', time=2024-09-14T13:53:11.956668+0000, chain.objs.size()=1 2024-09-14T12:44:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aoHWajjmbng_22M0DMCeVkB-Ewle8Po_0 2024-09-14T12:44:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13750022187044441817', time=2024-09-14T13:53:12.101023+0000, chain.objs.size()=1 2024-09-14T12:44:03.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KP5aPmT1uGJR54w852yiIOfUZ059R3c_0 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14732003963946686452', time=2024-09-14T13:53:12.198006+0000, chain.objs.size()=1 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.z_VktYm69ZfVguRHxHSH8t1iP2mNr6a_0 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9743342595658378477', time=2024-09-14T13:53:12.200196+0000, chain.objs.size()=1 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.06SZA0sz3DBQXVJ5005vZ_i98D_sx4T_0 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3257420284646742641', time=2024-09-14T13:53:14.941070+0000, chain.objs.size()=1 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XvyESTglw4F8ONShch3ls8l7dYjDbyC_0 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8018428022581698633', time=2024-09-14T13:53:16.255669+0000, chain.objs.size()=1 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CBEvUl57j15dBGIWqRw1T1D-TR0gDzI_0 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14157281914715451793', time=2024-09-14T13:53:16.257699+0000, chain.objs.size()=1 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UnX4WSk2jMG3_3q30WceVlOtPDEKJmM_0 2024-09-14T12:44:03.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7861253787277277843', time=2024-09-14T13:53:16.754328+0000, chain.objs.size()=1 2024-09-14T12:44:03.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.68UxilGCfLWx2uBP60kGEeZA07xJzvE_0 2024-09-14T12:44:03.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1282454652225770627', time=2024-09-14T13:53:18.258679+0000, chain.objs.size()=1 2024-09-14T12:44:03.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wkcHs7kmUxr6dzOlg1LOgohAthn_IuH_0 2024-09-14T12:44:03.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4414149348896394427', time=2024-09-14T13:53:18.744340+0000, chain.objs.size()=1 2024-09-14T12:44:03.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.417+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lQvK42rHbcDewEY4oPzjyXgTahF9Ca9_0 2024-09-14T12:44:03.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13725676985879998446', time=2024-09-14T13:53:22.032673+0000, chain.objs.size()=1 2024-09-14T12:44:03.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1eB0KBIG569WQwFPzAmnMJ3pQDGoIv3_0 2024-09-14T12:44:03.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.663805659468269607', time=2024-09-14T13:53:22.073188+0000, chain.objs.size()=1 2024-09-14T12:44:03.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2vrBMCwOm9GI016gwUruOUFHGm1xriu_0 2024-09-14T12:44:03.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8377570676857295153', time=2024-09-14T13:53:22.182547+0000, chain.objs.size()=1 2024-09-14T12:44:03.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.naDc90nZej22r0nRBE_4yP3OgbDUuKa_0 2024-09-14T12:44:03.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3199101282713682846', time=2024-09-14T13:53:22.926140+0000, chain.objs.size()=1 2024-09-14T12:44:03.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MMvEaUIsDv8qNJPBWI538DGQfL-mAH9_0 2024-09-14T12:44:03.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10304626237746552901', time=2024-09-14T13:53:22.928178+0000, chain.objs.size()=1 2024-09-14T12:44:03.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.70uHBwDfktPo53k0clPLSPbf346rh6x_0 2024-09-14T12:44:03.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10244461106983964478', time=2024-09-14T13:53:23.137055+0000, chain.objs.size()=1 2024-09-14T12:44:03.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xvVIv4y5I6Mu61B1rODG9G86ZPNnzos_0 2024-09-14T12:44:03.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15929834887631505073', time=2024-09-14T13:53:24.079596+0000, chain.objs.size()=1 2024-09-14T12:44:03.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xNIZpOZeh5BjySiONCiDktFaCC-R6pc_0 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5961946322410498497', time=2024-09-14T13:53:24.104627+0000, chain.objs.size()=1 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ey0Ujc4g9eDpWvhlQb48VN4yB-KV-lj_0 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10672177064971314897', time=2024-09-14T13:53:27.161532+0000, chain.objs.size()=1 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wVTb83rRfhhab1TOKOvVo5rOTeiHCq6_0 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.905514057512249132', time=2024-09-14T13:53:27.407117+0000, chain.objs.size()=1 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.o2PU8D48IrKhzMNyzO-CKImO28d3NcB_0 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9261410285028645143', time=2024-09-14T13:53:28.855799+0000, chain.objs.size()=1 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.V1wHfMBXIKn74sYAKd4nyVDbV7ZK--C_0 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14571833061412471889', time=2024-09-14T13:53:28.857831+0000, chain.objs.size()=1 2024-09-14T12:44:03.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.u1TAHvnnFvALSMwmY6z3qzjcavHTiy9_0 2024-09-14T12:44:03.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14498257123182628381', time=2024-09-14T13:53:30.075154+0000, chain.objs.size()=1 2024-09-14T12:44:03.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PhFuI7flXSPsqpnyVIqVYPn_LlLUexl_0 2024-09-14T12:44:03.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.406513344561015330', time=2024-09-14T13:53:30.549358+0000, chain.objs.size()=1 2024-09-14T12:44:03.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QEYR8jLswwltVNiQNseWKkkZM6rZP2y_0 2024-09-14T12:44:03.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16549177127895292159', time=2024-09-14T13:53:31.006789+0000, chain.objs.size()=1 2024-09-14T12:44:03.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.W5U67v2sy4rKEC9Sto10mkMl_9bhug1_0 2024-09-14T12:44:03.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5030969798705593243', time=2024-09-14T13:53:31.299375+0000, chain.objs.size()=1 2024-09-14T12:44:03.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.DGgbu-vy45II3NrkI470TTv1ZvF0ZOM_0 2024-09-14T12:44:03.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11914202712603886261', time=2024-09-14T13:53:31.402651+0000, chain.objs.size()=1 2024-09-14T12:44:03.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8s-IJzWSNKZTyTKxo2yE92w_sx_fvYX_0 2024-09-14T12:44:03.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15365961512469376752', time=2024-09-14T13:53:31.694805+0000, chain.objs.size()=1 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nRLCd-NC8zLzCL9P7MTABXlXist0ar-_0 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2265927103682563329', time=2024-09-14T13:53:31.849444+0000, chain.objs.size()=1 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2DhzCWmkkdUwKgRJxcy71zlvdH9w1t8_0 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1617713656871818413', time=2024-09-14T13:53:32.802004+0000, chain.objs.size()=1 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Wia-SrShsPqOCIUvA5NHBbfFe5D1DQ1_0 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6233570161981760238', time=2024-09-14T13:53:33.639578+0000, chain.objs.size()=1 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.YaeLIFreVA4DqfwQVcQHNjP3xyh4S9e_0 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15143390216818409761', time=2024-09-14T13:53:34.024825+0000, chain.objs.size()=1 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ML7MCNPzOLc9CEE4XpkOpu81jfPDsgF_0 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7671708293352403179', time=2024-09-14T13:53:34.943594+0000, chain.objs.size()=1 2024-09-14T12:44:03.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.v8bQHRcGjH0UHRy1o-FO-o2gjIMup-q_0 2024-09-14T12:44:03.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.433+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.770689993303799812', time=2024-09-14T13:53:35.155650+0000, chain.objs.size()=1 2024-09-14T12:44:03.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.433+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.NQA50KjeLpiA9J_IHZiWfH73KP4K53l_0 2024-09-14T12:44:03.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.433+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16679544529510854390', time=2024-09-14T13:53:49.611521+0000, chain.objs.size()=1 2024-09-14T12:44:03.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.433+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.269__shadow_.SstJkJ76stfKBmIbG3XdI-mTBdT74d5_0 2024-09-14T12:44:03.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6753012798601316598', time=2024-09-14T13:53:54.312496+0000, chain.objs.size()=1 2024-09-14T12:44:03.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.271__shadow_.mUKCmSWe-qs5zl65mMlKS_PqSam9Sb0_0 2024-09-14T12:44:03.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16200405043220432422', time=2024-09-14T13:54:53.161104+0000, chain.objs.size()=1 2024-09-14T12:44:03.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.-edei2Mql-XdZ1d0O439lEEt2XOYDBT_0 2024-09-14T12:44:03.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6481989455991775853', time=2024-09-14T13:54:53.183259+0000, chain.objs.size()=1 2024-09-14T12:44:03.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.xjjuaneCL5XcMpqCoafs1xbWJPwRvPM_0 2024-09-14T12:44:03.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11672791902287697564', time=2024-09-14T13:54:58.746041+0000, chain.objs.size()=1 2024-09-14T12:44:03.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.trlNMgxl9R1pKqYZ1KD_pC2H0mgUn_T_0 2024-09-14T12:44:03.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11438636029259840230', time=2024-09-14T13:58:05.729579+0000, chain.objs.size()=1 2024-09-14T12:44:03.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.SR51ZSThaO5wUvfnP46128Unasd0wjH_0 2024-09-14T12:44:03.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7198376979737526997', time=2024-09-14T13:58:07.413642+0000, chain.objs.size()=1 2024-09-14T12:44:03.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.afBTQvWbTPUynO4BReN-Eulmm9p7I3m_0 2024-09-14T12:44:03.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18178507834498350728', time=2024-09-14T13:58:10.269171+0000, chain.objs.size()=1 2024-09-14T12:44:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.AajDl4c3aKrAhBRIHEZUM_aWPiyn-g0_0 2024-09-14T12:44:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12341104632626970723', time=2024-09-14T13:58:11.315663+0000, chain.objs.size()=1 2024-09-14T12:44:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7_Zb_mtoNVetFgijHZNXT57ZqcG44jY_0 2024-09-14T12:44:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11712622754989670507', time=2024-09-14T13:58:14.792371+0000, chain.objs.size()=1 2024-09-14T12:44:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6oj3YF6dy5hxxT-xFV4UeLRBWpjUHu5_0 2024-09-14T12:44:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10019306787050458762', time=2024-09-14T13:58:15.950717+0000, chain.objs.size()=1 2024-09-14T12:44:03.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.437+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JicvwZKGcxP64SkqXq4EbmdRAaUEAmd_0 2024-09-14T12:44:03.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.441+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18424088998351998036', time=2024-09-14T13:58:17.943428+0000, chain.objs.size()=1 2024-09-14T12:44:03.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.441+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pNcA3H0AZNGegu8AAHw1nKHsUCRhsM1_0 2024-09-14T12:44:03.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.441+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9413589206644037407', time=2024-09-14T13:58:18.482926+0000, chain.objs.size()=1 2024-09-14T12:44:03.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.441+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4dEK55tdQc6dvkfc7uoiJfNCAwSAPxu_0 2024-09-14T12:44:03.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10854121062279753964', time=2024-09-14T13:58:18.707800+0000, chain.objs.size()=1 2024-09-14T12:44:03.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZMFyX2-lcYZvqq0FhHOMmqasBQdPG9Q_0 2024-09-14T12:44:03.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12342213067133354350', time=2024-09-14T13:58:20.171950+0000, chain.objs.size()=1 2024-09-14T12:44:03.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._jwr94QA_2CoeD5hAsBPpwT6_QZ90ZW_0 2024-09-14T12:44:03.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12556393470771301156', time=2024-09-14T13:58:21.078750+0000, chain.objs.size()=1 2024-09-14T12:44:03.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Aqdouq3Z-WLy-jVen1Yb3YFDlvObfin_0 2024-09-14T12:44:03.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15292856093736319609', time=2024-09-14T13:58:21.204818+0000, chain.objs.size()=1 2024-09-14T12:44:03.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2xdFROOB-WANzlospza61YIEfaxhY1X_0 2024-09-14T12:44:03.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18328402541486752852', time=2024-09-14T13:58:21.696222+0000, chain.objs.size()=1 2024-09-14T12:44:03.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Yfv1vfKOOXWxVEIinhyTjQOG5xNTQbq_0 2024-09-14T12:44:03.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9513343761665154348', time=2024-09-14T13:58:25.273125+0000, chain.objs.size()=1 2024-09-14T12:44:03.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Bd1ShQ52MIyc_TaAqUTHgSC4idRiOmi_0 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3718120273328857278', time=2024-09-14T13:58:25.397250+0000, chain.objs.size()=1 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-GgGMTDTW6UsiNFaGdTrBgm3FgDk8oS_0 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17803853758679788636', time=2024-09-14T13:58:26.083442+0000, chain.objs.size()=1 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jBmD9psRI95Oqn-zOD6uQXEPLH_sQcU_0 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11722651521975789645', time=2024-09-14T13:58:26.488973+0000, chain.objs.size()=1 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7NT6Bald00c1Ewil9zton8GwplR9OQy_0 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4158230927469037272', time=2024-09-14T13:58:28.566320+0000, chain.objs.size()=1 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.B2bfBLx9oIGBeo_gnMOZb3g0Z3FGF0X_0 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9997159421602284512', time=2024-09-14T13:58:28.878176+0000, chain.objs.size()=1 2024-09-14T12:44:03.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8T9M9GVIxiZ-k3Q7SIj6Ls9FUfM5Ut9_0 2024-09-14T12:44:03.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.449+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10070314361695771029', time=2024-09-14T13:58:28.919069+0000, chain.objs.size()=1 2024-09-14T12:44:03.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.449+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6WD-iDWkHBWckDGarUk-xtFwVNDsdhO_0 2024-09-14T12:44:03.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16615968702021085188', time=2024-09-14T13:58:30.275127+0000, chain.objs.size()=1 2024-09-14T12:44:03.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XDXz6QRZx9ujqIVewFm_xB9STiI8tBP_0 2024-09-14T12:44:03.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3727064307771092550', time=2024-09-14T13:58:32.105887+0000, chain.objs.size()=1 2024-09-14T12:44:03.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4-ia6rD11CWiSYAhqM6X96kLTaxl_bt_0 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11750356528401661795', time=2024-09-14T13:58:34.051497+0000, chain.objs.size()=1 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FI6G92DaylswZ7a1fNa0BRlYkDJ9Gef_0 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4528845619360284670', time=2024-09-14T14:00:21.007851+0000, chain.objs.size()=1 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.7l6cfm82AV07WmW3MD1c4UjIr1ZeGri_0 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4106008496784892510', time=2024-09-14T14:00:21.433804+0000, chain.objs.size()=1 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1r_UlPk1h8v8MqAv54tTsN6pYEPHUaC_0 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12905386531095290946', time=2024-09-14T14:00:21.644623+0000, chain.objs.size()=1 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xpCp5PvP_RUbETYTE2KnsFd2amV9k9f_0 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11209724021623458448', time=2024-09-14T14:00:22.194750+0000, chain.objs.size()=1 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.oyO8rQH7RFVk3LPmD3YJChpUpxA3gik_0 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17211088094958755384', time=2024-09-14T14:00:23.418712+0000, chain.objs.size()=1 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-0erndY9IpWf_9BfsOsf2YozKKXfH5l_0 2024-09-14T12:44:03.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14481581052013921001', time=2024-09-14T14:00:26.824575+0000, chain.objs.size()=1 2024-09-14T12:44:03.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.p3L0-Jdcs4k0H4_RjTnXXMmuNJpRLms_0 2024-09-14T12:44:03.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6758602929113367935', time=2024-09-14T14:00:27.858868+0000, chain.objs.size()=1 2024-09-14T12:44:03.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kaQQkwkjj4hcuUFBzDgF-Hun0THVhaq_0 2024-09-14T12:44:03.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11582445770091792139', time=2024-09-14T14:00:28.921503+0000, chain.objs.size()=1 2024-09-14T12:44:03.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LfLLdMEkVV0UVJAw8sFj8oCsGX9EGTx_0 2024-09-14T12:44:03.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12722176799167286908', time=2024-09-14T14:00:29.433145+0000, chain.objs.size()=1 2024-09-14T12:44:03.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.g3g0jB0huCHZB4I23g4UEr75DiNKAm9_0 2024-09-14T12:44:03.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16225421593829025812', time=2024-09-14T14:00:29.656360+0000, chain.objs.size()=1 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gC1-JX5SrJBpRZJUobA6SaT9E10AsIA_0 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13616334034610672259', time=2024-09-14T14:00:29.765563+0000, chain.objs.size()=1 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ps0fAYVw48WCpPrjolgBVNLp4lrfor9_0 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12331894909428673485', time=2024-09-14T14:00:31.041547+0000, chain.objs.size()=1 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.XVWAqzfD4JgIWnzlkLZlgX1KIku4CeN_0 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10190602066204487580', time=2024-09-14T14:00:31.824390+0000, chain.objs.size()=1 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.l6WgCQpycIzMu5SRiFAeFhbIuq8--PT_0 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10212510290297199850', time=2024-09-14T14:00:33.059037+0000, chain.objs.size()=1 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4gGJZUOlYsUWyctk0mgKvK_mtXJcie3_0 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13602157452104365551', time=2024-09-14T14:00:34.254629+0000, chain.objs.size()=1 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2d4XVkDxFZvXIQN0tpflHZ8Ggb9nD3R_0 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8478000981551007116', time=2024-09-14T14:00:34.338934+0000, chain.objs.size()=1 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gbvYpasU_QGjag3NMHXp2ftqjUeajRE_0 2024-09-14T12:44:03.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7155125463758770902', time=2024-09-14T14:00:34.500920+0000, chain.objs.size()=1 2024-09-14T12:44:03.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.m0B20pI7_Vih_6wv7078x9m2nTT6KR2_0 2024-09-14T12:44:03.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10124296336138696718', time=2024-09-14T14:00:34.542780+0000, chain.objs.size()=1 2024-09-14T12:44:03.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kJ6NrT8eNJItzx6OCD919ysAfA5KuyD_0 2024-09-14T12:44:03.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17113381359862229184', time=2024-09-14T14:00:36.662786+0000, chain.objs.size()=1 2024-09-14T12:44:03.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bfxXhwvYbrbuX_3tnDGe_DyJZ0rgUbY_0 2024-09-14T12:44:03.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6986843535765588826', time=2024-09-14T14:00:36.700153+0000, chain.objs.size()=1 2024-09-14T12:44:03.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xw0y7qFO_AAx-55NAi-Joz-TCwTmjPO_0 2024-09-14T12:44:03.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12228253314162377670', time=2024-09-14T14:00:37.063623+0000, chain.objs.size()=1 2024-09-14T12:44:03.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.W_bYIyBPn997XeBzRtG9WrL6YXgAOWR_0 2024-09-14T12:44:03.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8662851317925202676', time=2024-09-14T14:00:38.017383+0000, chain.objs.size()=1 2024-09-14T12:44:03.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.EbnxlXG75g5AEyemTPRXOaXsqISZVFp_0 2024-09-14T12:44:03.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1150968965519246858', time=2024-09-14T14:00:38.305326+0000, chain.objs.size()=1 2024-09-14T12:44:03.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NQH8493DbEjooRNAfSMbKGkyfsQ4-7L_0 2024-09-14T12:44:03.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4369936626747311479', time=2024-09-14T14:00:42.063473+0000, chain.objs.size()=1 2024-09-14T12:44:03.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VqGpZfvSnhIg8uJfcNMGm9HQ0UCABYC_0 2024-09-14T12:44:03.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7276558419521620506', time=2024-09-14T14:00:44.993428+0000, chain.objs.size()=1 2024-09-14T12:44:03.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JkBNI9DuG6A7lHJeAGXuAj8WA__uz0D_0 2024-09-14T12:44:03.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16542583479011505316', time=2024-09-14T14:00:45.083283+0000, chain.objs.size()=1 2024-09-14T12:44:03.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.DOjMVAuifdK1ZcxVwAOiyIEMUjNIiTK_0 2024-09-14T12:44:03.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.469+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2327946760001468416', time=2024-09-14T14:00:46.347324+0000, chain.objs.size()=1 2024-09-14T12:44:03.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.469+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UM6HVLnSY50XtzaWi722nxfJd-eET8P_0 2024-09-14T12:44:03.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49045 2024-09-14T12:44:03.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T12:44:03.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12312091186387508438', time=2024-09-14T14:00:46.585339+0000, chain.objs.size()=1 2024-09-14T12:44:03.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dJhY45ffCDo6B0Og-1tybbLzr3xuFnd_0 2024-09-14T12:44:03.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.611805104235927899', time=2024-09-14T14:00:47.624246+0000, chain.objs.size()=1 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NTNvgcaiEnJhaTgnQqqM3MkgA1AVL3J_0 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13859739960895350978', time=2024-09-14T14:00:48.062846+0000, chain.objs.size()=1 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.W5VnputXwki0QiYFQ-KMB9GrRwnZDtE_0 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2096424916539392204', time=2024-09-14T14:00:48.397072+0000, chain.objs.size()=1 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KktitMwa0cISUHQhLJe4I5Muw-IcZRs_0 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4227479154065694982', time=2024-09-14T14:00:48.636534+0000, chain.objs.size()=1 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mY4XOzDb33kGBe6LN5uK0nKR1-cwN2K_0 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17656426452402001652', time=2024-09-14T14:00:48.780536+0000, chain.objs.size()=1 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9iyVriR5qfy3ESdgDVc_gu54aqeNLZu_0 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10098250512185418187', time=2024-09-14T14:02:38.044291+0000, chain.objs.size()=1 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.376__shadow_._aXKsYATkm-qRp9nOmLl6D3iCyd2Rui_0 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4885642299043380030', time=2024-09-14T14:05:39.969296+0000, chain.objs.size()=1 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.455__shadow_.e91g7CdnYHcrmHmObSXIPhOe3fhXwEU_0 2024-09-14T12:44:03.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13789340321865726945', time=2024-09-14T14:06:15.061015+0000, chain.objs.size()=1 2024-09-14T12:44:03.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.466__shadow_.MdOj2LV1nC5m_Gqy-NKrdSVIUBEo2sj_0 2024-09-14T12:44:03.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17065851990768338204', time=2024-09-14T14:06:18.228089+0000, chain.objs.size()=1 2024-09-14T12:44:03.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.467__shadow_.jhdjdVdgbCdPqtyCPaSMd3NQypniyIi_0 2024-09-14T12:44:03.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6876804547386904932', time=2024-09-14T14:06:40.735462+0000, chain.objs.size()=1 2024-09-14T12:44:03.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.482__shadow_.kx8rdDyDmlwPes_4Nr5jlY8lb9ACNxp_0 2024-09-14T12:44:03.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7340227727706108798', time=2024-09-14T14:06:49.679843+0000, chain.objs.size()=1 2024-09-14T12:44:03.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.485__shadow_.3RL0N9MpR3sP_naJ44W6OoT4R1mX43A_0 2024-09-14T12:44:03.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1398135654727450338', time=2024-09-14T14:07:21.338674+0000, chain.objs.size()=1 2024-09-14T12:44:03.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.497__shadow_.xtHgjA3oW0ZY3YdAHlz5OldOR66Z0CW_0 2024-09-14T12:44:03.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9841846665460630394', time=2024-09-14T14:07:25.821783+0000, chain.objs.size()=1 2024-09-14T12:44:03.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.499__shadow_.xoczWkLJ-wiRfCrAhKBOxH1iutgZ9mx_0 2024-09-14T12:44:03.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1', time=2024-09-14T14:12:03.786696+0000, chain.objs.size()=2 2024-09-14T12:44:03.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.3 2024-09-14T12:44:03.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__shadow_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.3_1 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~kOkbvPtoUjLsVzE4XSAeIOgvk5ZUBU4', time=2024-09-14T14:12:45.241621+0000, chain.objs.size()=1 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~kOkbvPtoUjLsVzE4XSAeIOgvk5ZUBU4.2 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~kOkbvPtoUjLsVzE4XSAeIOgvk5ZUBU4', time=2024-09-14T14:12:45.252258+0000, chain.objs.size()=1 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~kOkbvPtoUjLsVzE4XSAeIOgvk5ZUBU4.3 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~I-Y8_kygaAEDXRyU9SNj09_349NH90B', time=2024-09-14T14:16:09.470024+0000, chain.objs.size()=1 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.536__multipart_mymultipart.2~I-Y8_kygaAEDXRyU9SNj09_349NH90B.3 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11612242068293941915', time=2024-09-14T14:20:59.987134+0000, chain.objs.size()=1 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:vEXiPp50tSDajQAQP5q1NbDj60E-B36_.07QHCXyzj4R1kC83J-gcq3Oi8-Nm2yx_0 2024-09-14T12:44:03.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17663099664030088498', time=2024-09-14T14:22:18.934800+0000, chain.objs.size()=1 2024-09-14T12:44:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.583__shadow:SHR5gf1khWy0N28aS8pI8ice.x5MG-f_.umRKSgEWl9AIifGxpq2HxQTIAJHd6lZ_0 2024-09-14T12:44:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15872152059085191963', time=2024-09-14T14:22:22.224953+0000, chain.objs.size()=1 2024-09-14T12:44:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.584__shadow:PgcQ1YPh1FkfVEin.K0f5lPrdPOasmt_.arQnQqtRYNmvvTYlZsTayEfPgRENL3j_0 2024-09-14T12:44:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1737803381166255635', time=2024-09-14T14:22:32.372914+0000, chain.objs.size()=1 2024-09-14T12:44:03.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.587__shadow:OgU2uVNDvcSNGQzKNIuxSmdlpOtQBIM_.H8JT3vi6of5i1niKNmm_GOvhu4accJa_0 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.957683663980251000', time=2024-09-14T14:29:12.849504+0000, chain.objs.size()=12 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__multipart_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.1 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__shadow_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.1_1 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__multipart_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.2 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__shadow_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.2_1 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__multipart_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.3 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__shadow_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.3_1 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__multipart_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.4 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__shadow_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.4_1 2024-09-14T12:44:03.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__multipart_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.5 2024-09-14T12:44:03.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__shadow_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.5_1 2024-09-14T12:44:03.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__multipart_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.6 2024-09-14T12:44:03.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.624__shadow_multipart_enc.2~cT41xe-uQjtuXXK9c8bPNiKgALtY-4_.6_1 2024-09-14T12:44:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.493+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6670405302400792156', time=2024-09-14T14:30:25.685595+0000, chain.objs.size()=1 2024-09-14T12:44:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.641__shadow_.Lba-Hak7hJnt_kxCEPD4mVrqUN8T2qQ_0 2024-09-14T12:44:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.493+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2196617114972860533', time=2024-09-14T14:34:04.549203+0000, chain.objs.size()=1 2024-09-14T12:44:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.705__shadow:5D4MkyTDekIu98Q53fYplFElB6u4i2k_.5ZlHD8a-dOl2hoE-T4yD3k6uexgghxh_0 2024-09-14T12:44:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.493+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16889336668445375769', time=2024-09-14T14:41:16.457293+0000, chain.objs.size()=1 2024-09-14T12:44:03.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.777__shadow_.eqUTsfaZXZJ-n3xeeGYbATFW4CYmoRa_0 2024-09-14T12:44:03.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.501+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T12:44:03.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.501+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.501+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53040' 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13266970365100988282', time=2024-09-14T13:42:13.383117+0000, chain.objs.size()=1 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.148__shadow_.KlEczIyVOGCFUy-f-NaQFmQEf9BtVHl_0 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_ZHq6NJPJOsziZ8xYuLH2Z9NzKcMnd-e', time=2024-09-14T13:43:30.081077+0000, chain.objs.size()=3 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.4XJj8WAM7bu8x_auilfJTtyqhiHKWfX_0 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.4XJj8WAM7bu8x_auilfJTtyqhiHKWfX_1 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.4XJj8WAM7bu8x_auilfJTtyqhiHKWfX_2 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6840913572031256475', time=2024-09-14T13:44:54.339241+0000, chain.objs.size()=1 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.177__shadow_.FKUKI7EbmVVHsLZjuP63_lJtfOYXTOA_0 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6691003501824596783', time=2024-09-14T13:44:56.582407+0000, chain.objs.size()=1 2024-09-14T12:44:03.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.178__shadow_.lkXqPVyNJea-Bl9KRuxZCW7x9_JWGfL_0 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14943007086976723567', time=2024-09-14T13:46:09.102326+0000, chain.objs.size()=1 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.201__shadow_.OLL2cDEJ4HKnGzxB27Kk2dgWUjwO1Y3_0 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15161398479155717456', time=2024-09-14T13:50:12.787533+0000, chain.objs.size()=1 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.237__shadow_.qpUt0I_jfuOSK6EGGlpbKnJEFsWc4uh_0 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8621264232910147332', time=2024-09-14T13:50:20.995545+0000, chain.objs.size()=1 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.239__shadow_.YusfDrEdzOpN7_RUjBGaikH9hvjw82s_0 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7966616874741827878', time=2024-09-14T13:51:03.643277+0000, chain.objs.size()=1 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.255__shadow_.xoyO-lu2aT4cc0a9givDSOkzhjFGqZD_0 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11109468078934026914', time=2024-09-14T13:53:09.575514+0000, chain.objs.size()=1 2024-09-14T12:44:03.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HXKcQViR9iT9YvrPQl_PFpy-QYk-6oM_0 2024-09-14T12:44:03.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3049231549008048659', time=2024-09-14T13:53:10.472808+0000, chain.objs.size()=1 2024-09-14T12:44:03.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TFZrlSjoyuHTuYOi1khMBn02_VKMtJ4_0 2024-09-14T12:44:03.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9773944648915530183', time=2024-09-14T13:53:10.950906+0000, chain.objs.size()=1 2024-09-14T12:44:03.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8hppWI9A2rPvGu2D8HUI3svxfjwajGr_0 2024-09-14T12:44:03.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3175215064673592324', time=2024-09-14T13:53:13.685550+0000, chain.objs.size()=1 2024-09-14T12:44:03.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.sMs3L2kusZm2WstReK5yZVyYV9L5NxR_0 2024-09-14T12:44:03.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10290198049792138195', time=2024-09-14T13:53:14.584524+0000, chain.objs.size()=1 2024-09-14T12:44:03.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.d4v21aaH-v9cPfjhrAHqLTiLDsxlmL4_0 2024-09-14T12:44:03.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16728605676317963858', time=2024-09-14T13:53:14.985749+0000, chain.objs.size()=1 2024-09-14T12:44:03.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aMmNFXO7n-cwBHEyOpFr3fqN7eZjC16_0 2024-09-14T12:44:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12587473284896783549', time=2024-09-14T13:53:15.222320+0000, chain.objs.size()=1 2024-09-14T12:44:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MSwiNxldv-3Mui2XiA-r8faOm6jGvfm_0 2024-09-14T12:44:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17697393201846167992', time=2024-09-14T13:53:15.454867+0000, chain.objs.size()=1 2024-09-14T12:44:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OT1VzxFusa8TsL4jF023ArLka-wJ59v_0 2024-09-14T12:44:03.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13269854443177048977', time=2024-09-14T13:53:15.799237+0000, chain.objs.size()=1 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nZpNj4aXYI_Da6Ow9_Suq4BKgXFV8Bq_0 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3547873801183650895', time=2024-09-14T13:53:15.921446+0000, chain.objs.size()=1 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1ABkecL7wS2fHjZxY-VysOYvW9skNDd_0 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10543857264235297201', time=2024-09-14T13:53:16.735008+0000, chain.objs.size()=1 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1g2aajPiMt5EOdWE0fUtRV7kDLWz7c3_0 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7841468367382473715', time=2024-09-14T13:53:16.737173+0000, chain.objs.size()=1 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.IdOlkQkIj6BdVTBBMfNV-ORskVBh8nY_0 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8859021090532842128', time=2024-09-14T13:53:17.866679+0000, chain.objs.size()=1 2024-09-14T12:44:03.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GI-DjGGauBGDq9iwqz24u2jipNmi9vj_0 2024-09-14T12:44:03.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3932722126078239399', time=2024-09-14T13:53:17.869099+0000, chain.objs.size()=1 2024-09-14T12:44:03.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vOUSb9mGjUpqef-rnXVbRAwtFRmUyzA_0 2024-09-14T12:44:03.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4495428008324026140', time=2024-09-14T13:53:18.526322+0000, chain.objs.size()=1 2024-09-14T12:44:03.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.S02I4_25_UQ0_noIZt7qy1vdzksBKe0_0 2024-09-14T12:44:03.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13009720467622698467', time=2024-09-14T13:53:18.561620+0000, chain.objs.size()=1 2024-09-14T12:44:03.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OIvQxb1qUlJiEKdNnBYPZkanMzoeY0v_0 2024-09-14T12:44:03.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5664156038080514121', time=2024-09-14T13:53:19.584882+0000, chain.objs.size()=1 2024-09-14T12:44:03.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-SP9Uyg3nPdCoh6a-Zd6DKDF9tUI32n_0 2024-09-14T12:44:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3920412120900774785', time=2024-09-14T13:53:19.998306+0000, chain.objs.size()=1 2024-09-14T12:44:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bkfhuukkdYVESinSQFKe8dfRWLy2b2G_0 2024-09-14T12:44:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7905453895008683063', time=2024-09-14T13:53:20.119059+0000, chain.objs.size()=1 2024-09-14T12:44:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pcQlSsayQozVL8o6qiqROWHGWPqEzlg_0 2024-09-14T12:44:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7529213769845454267', time=2024-09-14T13:53:20.237958+0000, chain.objs.size()=1 2024-09-14T12:44:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vebV5y4svoW0b3WGYpnMFOVIKM4hst0_0 2024-09-14T12:44:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3053418670229044294', time=2024-09-14T13:53:20.617191+0000, chain.objs.size()=1 2024-09-14T12:44:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OfzhJUN5p3vhqh6rPuUZEN0B8-yIahs_0 2024-09-14T12:44:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4398607061329401080', time=2024-09-14T13:53:21.669850+0000, chain.objs.size()=1 2024-09-14T12:44:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.h-RI2h7YtXzYuRHPCK5MK8RbTCQB4Wk_0 2024-09-14T12:44:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11663421082195418078', time=2024-09-14T13:53:22.915406+0000, chain.objs.size()=1 2024-09-14T12:44:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.n0V1bqvUOe63bqzF3jAzQiMFE1k1UYE_0 2024-09-14T12:44:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10929141467296864727', time=2024-09-14T13:53:23.045958+0000, chain.objs.size()=1 2024-09-14T12:44:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.521+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.x8Ox3zAEaRosPQMWL59ZKyJu5FDROgU_0 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14335956394124007560', time=2024-09-14T13:53:25.328370+0000, chain.objs.size()=1 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MVISEuNr2gG0hV5CO4KJ0PZGyrzqp2M_0 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12130771576983313186', time=2024-09-14T13:53:25.330263+0000, chain.objs.size()=1 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0VGxoJdks20m3zOiigRK1u0QlpwAklf_0 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3170437224060455008', time=2024-09-14T13:53:25.712979+0000, chain.objs.size()=1 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.L3z0KWRIkTLQhDzS4Odnh9pt4lCUb8y_0 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9219422860831607473', time=2024-09-14T13:53:26.229827+0000, chain.objs.size()=1 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xT0mUVtcAqzX6XgjWeLEPpWMhR7rS-b_0 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5051613149326422195', time=2024-09-14T13:53:26.424917+0000, chain.objs.size()=1 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.D5scxeQwCVhd-IOCylFHhBN0wk2WKHD_0 2024-09-14T12:44:03.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12092653385957714921', time=2024-09-14T13:53:27.459785+0000, chain.objs.size()=1 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vrxn4uTIhOn-PPmjzHEI53kr5NzDzeg_0 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1503184940835789395', time=2024-09-14T13:53:29.335215+0000, chain.objs.size()=1 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kJfI5ogIKBZrcFys0op8D4vMkFHs73r_0 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5726882101788481258', time=2024-09-14T13:53:29.433389+0000, chain.objs.size()=1 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bqIyEY_7mWmll5EpAXyr0Y8vGfEB62n_0 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6578087139866283266', time=2024-09-14T13:53:29.830890+0000, chain.objs.size()=1 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JjHlumU9fCjc08TM0UELB26Xj33v66J_0 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2155870898792730928', time=2024-09-14T13:53:30.012481+0000, chain.objs.size()=1 2024-09-14T12:44:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eTN5YswMT8sqIf-5Rc63c4Zx4BrEA37_0 2024-09-14T12:44:03.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5206913415605424859', time=2024-09-14T13:53:31.217273+0000, chain.objs.size()=1 2024-09-14T12:44:03.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rea1lVWWgrdGAAZbBVQ75bDXbGf0tMz_0 2024-09-14T12:44:03.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4854547894799836761', time=2024-09-14T13:53:31.984849+0000, chain.objs.size()=1 2024-09-14T12:44:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6EzOjhjyYqbaPLGyhRfLrjcrlNc4QFE_0 2024-09-14T12:44:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9339108144218213947', time=2024-09-14T13:53:32.024267+0000, chain.objs.size()=1 2024-09-14T12:44:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nYo2Y86MmshubGCkQQb23UPLHWrFnDF_0 2024-09-14T12:44:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15869368211297774137', time=2024-09-14T13:53:32.824692+0000, chain.objs.size()=1 2024-09-14T12:44:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.84YiieLCndSStBgRKNIBLPYe3Rn1BNo_0 2024-09-14T12:44:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2036284140579441254', time=2024-09-14T13:53:33.636149+0000, chain.objs.size()=1 2024-09-14T12:44:03.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kFotS1Srk1OklpIAlOCpaccVlpe0P4K_0 2024-09-14T12:44:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3896485184104594930', time=2024-09-14T13:53:34.333291+0000, chain.objs.size()=1 2024-09-14T12:44:03.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1cAznReePll2A44efFkF76EA9CNIuZ__0 2024-09-14T12:44:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1566324033305898828', time=2024-09-14T13:53:37.627730+0000, chain.objs.size()=1 2024-09-14T12:44:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.264__shadow_.1T19A1WSNPWqACjOsNDtsoC4-LFUmzJ_0 2024-09-14T12:44:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10406913400182073486', time=2024-09-14T13:53:47.222638+0000, chain.objs.size()=1 2024-09-14T12:44:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.268__shadow_.nhQpcyUEvewMePmK94bDuTrXuxVXVAz_0 2024-09-14T12:44:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14852417393869423888', time=2024-09-14T13:54:53.147908+0000, chain.objs.size()=1 2024-09-14T12:44:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.mq3ODE_bfhji5AqLagLdTLKCJQ74dx6_0 2024-09-14T12:44:03.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12159512894112854958', time=2024-09-14T13:55:01.552668+0000, chain.objs.size()=1 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.295__shadow_.3rQrnlsrlXS-7ZqIxKnoT3g8tlSeslv_0 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6273355433986618256', time=2024-09-14T13:58:05.563397+0000, chain.objs.size()=1 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.yRfOZGWlZJugIRCRJzu3fgtiOIFAU_J_0 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11496112680582644910', time=2024-09-14T13:58:06.751849+0000, chain.objs.size()=1 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tsBCZtG2aoD69KLUBMa2R3kd9td-_ws_0 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2024124840541266821', time=2024-09-14T13:58:06.868186+0000, chain.objs.size()=1 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.a_g15SrKCufxMZsgutHim2VSbiCu1AG_0 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6183514531337321035', time=2024-09-14T13:58:07.346054+0000, chain.objs.size()=1 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Ng9WJ8EZi5I83A7VHj-D38f-QPVy_Iq_0 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4384635859323917933', time=2024-09-14T13:58:09.672146+0000, chain.objs.size()=1 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9b5ty8Qw7uvQiyF_b69KDyX-iPz5kCY_0 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3043183199881822547', time=2024-09-14T13:58:11.013796+0000, chain.objs.size()=1 2024-09-14T12:44:03.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-OLtSXlDSiGA6VUqA6iTgoArDycV68R_0 2024-09-14T12:44:03.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.541+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6099706956048564385', time=2024-09-14T13:58:11.851783+0000, chain.objs.size()=1 2024-09-14T12:44:03.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.yuKkvbb1oL_NQx5UnNbcoXFuAJxdO8n_0 2024-09-14T12:44:03.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.541+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16706566547040121261', time=2024-09-14T13:58:13.804161+0000, chain.objs.size()=1 2024-09-14T12:44:03.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6nDwTBvdcw4SjLPsYS1y6GBDebMN5l4_0 2024-09-14T12:44:03.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.541+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9007780882186774682', time=2024-09-14T13:58:14.925012+0000, chain.objs.size()=1 2024-09-14T12:44:03.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cvwWqOz-1D-lWqit7Lf13I7ds5BTUkg_0 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10780528130878825867', time=2024-09-14T13:58:15.521603+0000, chain.objs.size()=1 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.RdQL3MtG8n6frNkjzhXSpWVFz5VXCM9_0 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13061002348943390589', time=2024-09-14T13:58:16.355259+0000, chain.objs.size()=1 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WqFAZkJ2MvgQou2p3KT93Z07mPc1J3H_0 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11935255548611126865', time=2024-09-14T13:58:17.809864+0000, chain.objs.size()=1 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.RhvN6chUj0KX7Kjj0SGeLO7sYxDqj23_0 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10605145434654850104', time=2024-09-14T13:58:18.102376+0000, chain.objs.size()=1 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Q1iGPYkm7_6ubPGKjLACvpL9_olAaZV_0 2024-09-14T12:44:03.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5703383797492735197', time=2024-09-14T13:58:18.492010+0000, chain.objs.size()=1 2024-09-14T12:44:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._37c29ybdF9uX5l98ssf-ZoWs33wA1t_0 2024-09-14T12:44:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11750643992812317181', time=2024-09-14T13:58:19.120278+0000, chain.objs.size()=1 2024-09-14T12:44:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PsaRKbpLNlwgIKVxoB2jzugdgJYLQ88_0 2024-09-14T12:44:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7690403899717251643', time=2024-09-14T13:58:19.475050+0000, chain.objs.size()=1 2024-09-14T12:44:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NwdAuVWP0ORoKjkQ5_f4r1O1JeEv0hL_0 2024-09-14T12:44:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13156007313719829429', time=2024-09-14T13:58:19.477138+0000, chain.objs.size()=1 2024-09-14T12:44:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HQkQZfHhLFCd31Rt4u4dR0eMM6TXH_3_0 2024-09-14T12:44:03.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.796333128709617242', time=2024-09-14T13:58:19.736144+0000, chain.objs.size()=1 2024-09-14T12:44:03.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tGzhUinit4oYetDrv7yxSCj2iG0wnZh_0 2024-09-14T12:44:03.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5929261101371282864', time=2024-09-14T13:58:21.123877+0000, chain.objs.size()=1 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QnqbjO4GgWhfJfuilgEF64J0Q9McZCr_0 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5967609880258038810', time=2024-09-14T13:58:22.067669+0000, chain.objs.size()=1 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.34r2G3c7IIS9e_nQDOh5Db5I0kMYPPu_0 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11906742220867194644', time=2024-09-14T13:58:23.308113+0000, chain.objs.size()=1 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.D_QHKhTjre0TnyvRUuadVH7Vp9L4L8P_0 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3335276313687193060', time=2024-09-14T13:58:23.360996+0000, chain.objs.size()=1 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FNH6WEpazWdz3NSk8xy8pdH6S6q4_4N_0 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4824817101804004844', time=2024-09-14T13:58:25.372447+0000, chain.objs.size()=1 2024-09-14T12:44:03.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.549+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-HRyoFEcKm7nRRznhenOCoSHQAu069x_0 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15112530399081850853', time=2024-09-14T13:58:25.645599+0000, chain.objs.size()=1 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.aFyKzvsUllbmy4olIZ7rBV4jKd4_zMb_0 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15751209317545766381', time=2024-09-14T13:58:26.129972+0000, chain.objs.size()=1 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.MpzDXB_-qNzkQHUPrnRokATC4cXRAYq_0 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6882216336576302819', time=2024-09-14T13:58:26.523983+0000, chain.objs.size()=1 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.h9ZBinTWdRkUVqo95rW20KQ7hoTOFRF_0 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5657855226653516070', time=2024-09-14T13:58:26.642709+0000, chain.objs.size()=1 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VOAVY7rbjYtU6aEaMIMYL85SUx9Q8-9_0 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7529991688999601217', time=2024-09-14T13:58:29.112862+0000, chain.objs.size()=1 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TlK0D2kVTGifJFxC0AGZOZR7mzx0AnH_0 2024-09-14T12:44:03.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18280767143852995903', time=2024-09-14T13:58:30.362852+0000, chain.objs.size()=1 2024-09-14T12:44:03.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-zQncB_9_oxZVdld4AYb_O10ym37NF0_0 2024-09-14T12:44:03.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10604966577932121546', time=2024-09-14T13:58:31.363073+0000, chain.objs.size()=1 2024-09-14T12:44:03.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HxL8Z4oLZH4-2twPfi7tbHwqqi_K86I_0 2024-09-14T12:44:03.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4484198878779631804', time=2024-09-14T13:58:33.160066+0000, chain.objs.size()=1 2024-09-14T12:44:03.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.r-BCevr76bckBQ4ZbJMe8HxUfMrM3nh_0 2024-09-14T12:44:03.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2444809843390050130', time=2024-09-14T13:58:33.353477+0000, chain.objs.size()=1 2024-09-14T12:44:03.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.553+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3DhzvmHZrdV_FztJjHyzQcSR5oTAOgL_0 2024-09-14T12:44:03.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6848345751121975740', time=2024-09-14T13:58:33.876413+0000, chain.objs.size()=1 2024-09-14T12:44:03.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.vC_llgTTs_U_IogcqW4Qom5OaYVS6Mt_0 2024-09-14T12:44:03.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9957383270031850385', time=2024-09-14T13:58:34.051765+0000, chain.objs.size()=1 2024-09-14T12:44:03.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XF4q7vIPyWjw7bSgCYdjiy566_glmUU_0 2024-09-14T12:44:03.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12741205699749958231', time=2024-09-14T14:00:21.091540+0000, chain.objs.size()=1 2024-09-14T12:44:03.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kvumoURIuCe1449VjWR5zPgjbAmF9ht_0 2024-09-14T12:44:03.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5765933680263521408', time=2024-09-14T14:00:21.208013+0000, chain.objs.size()=1 2024-09-14T12:44:03.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VEcnFIQMHL5voe9Q-vzCPpFvthcsAnP_0 2024-09-14T12:44:03.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11259835493722177010', time=2024-09-14T14:00:22.121085+0000, chain.objs.size()=1 2024-09-14T12:44:03.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.J5kpuBm7wdx5QcMEfOQP9QrdGe837mz_0 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6367967535030168470', time=2024-09-14T14:00:22.681440+0000, chain.objs.size()=1 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ufD2z2J97S0_wqJMn72WTxYieJ8Qubz_0 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17436290868944982139', time=2024-09-14T14:00:23.526422+0000, chain.objs.size()=1 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.U1Z6SdHH3r7_vBH7X-bXdC-_p77IlSq_0 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15954684266067317872', time=2024-09-14T14:00:24.964458+0000, chain.objs.size()=1 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dZvpiiazEcUCd0AeyDywsWRd6VW_wO0_0 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.667199021571776964', time=2024-09-14T14:00:25.827022+0000, chain.objs.size()=1 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2qLUNtC6U4e7WnGQpPyTeJkCFSybtzi_0 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10395328895820198545', time=2024-09-14T14:00:27.336453+0000, chain.objs.size()=1 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rEpaDIbqxLIjYuyNmJpHylOEPWmGsJZ_0 2024-09-14T12:44:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14967821729592725897', time=2024-09-14T14:00:27.430246+0000, chain.objs.size()=1 2024-09-14T12:44:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ACh-s2TqXiLs7fEP09Nl3jjMDK8ukpj_0 2024-09-14T12:44:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11972156972322472659', time=2024-09-14T14:00:27.759394+0000, chain.objs.size()=1 2024-09-14T12:44:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dAS3-DbzCdNA6VTGeDrDAa_0unqhKhu_0 2024-09-14T12:44:03.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10055335941175271857', time=2024-09-14T14:00:29.105800+0000, chain.objs.size()=1 2024-09-14T12:44:03.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.euGClYtIb9rD3APp1L3fUUUwDyE1ufk_0 2024-09-14T12:44:03.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15107511654015379644', time=2024-09-14T14:00:29.381996+0000, chain.objs.size()=1 2024-09-14T12:44:03.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uwdYKVoIT22uunh-ITQD7s0n4B6uZm2_0 2024-09-14T12:44:03.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18269080036214460722', time=2024-09-14T14:00:30.583070+0000, chain.objs.size()=1 2024-09-14T12:44:03.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iLXAjVz9Y9Pex2hW1D--vfnYqRSHe-e_0 2024-09-14T12:44:03.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18438203268985160496', time=2024-09-14T14:00:31.684897+0000, chain.objs.size()=1 2024-09-14T12:44:03.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tgXkN1Mf98CUjNPKl3Ap3Y61J6CZjhB_0 2024-09-14T12:44:03.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53040 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6331208439058845704', time=2024-09-14T14:00:33.303851+0000, chain.objs.size()=1 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ph8yEfsUUweck8o9kyfx3cr7XNMp0FM_0 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3137982996759982673', time=2024-09-14T14:00:33.936117+0000, chain.objs.size()=1 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9dsWgJyiaSIMx1UmrSb91TFjUdesRwO_0 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16862078932676369000', time=2024-09-14T14:00:35.020357+0000, chain.objs.size()=1 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.EcbPVssoin6rgEw1B6lJPmIws_57fSv_0 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5493587273362305598', time=2024-09-14T14:00:35.380461+0000, chain.objs.size()=1 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4gUAf39tQtB0msMfy74lrFs5-IsULwk_0 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15958368599449737170', time=2024-09-14T14:00:35.382414+0000, chain.objs.size()=1 2024-09-14T12:44:03.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.z8ZqFBX4RIWgt8j_eX2cdkfE-NOrdB-_0 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9977114740420257441', time=2024-09-14T14:00:35.454833+0000, chain.objs.size()=1 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.24maM7Ig6BHpKJ69bI_oavPjdXNPJHC_0 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17200257973146062513', time=2024-09-14T14:00:37.384037+0000, chain.objs.size()=1 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._-duGBm_9xwUEtDMbHAIUJ6zfv-5Kld_0 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17611802367951144742', time=2024-09-14T14:00:42.408544+0000, chain.objs.size()=1 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HKlKlWz6BN80max2JFvQDotVthd7QUv_0 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3600109129755516375', time=2024-09-14T14:00:42.870164+0000, chain.objs.size()=1 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.eWaKgxTAhOmZyINWWP5E82iURi0SBKi_0 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4980518239845102177', time=2024-09-14T14:00:44.670698+0000, chain.objs.size()=1 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6HUeOB6kXrUwxOQmpn9YEoLyEXbfnK4_0 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12614288884682474448', time=2024-09-14T14:00:44.673264+0000, chain.objs.size()=1 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Jt4ugjSSaFhRbXcdkT4IQileoygKooA_0 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2963006723586755778', time=2024-09-14T14:00:46.016039+0000, chain.objs.size()=1 2024-09-14T12:44:03.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mWyiPPqrj744Svg53vQMCvsJ_uAqYdv_0 2024-09-14T12:44:03.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17404924535309060486', time=2024-09-14T14:00:47.631374+0000, chain.objs.size()=1 2024-09-14T12:44:03.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.aEvtQPjr_Ux0WRUw2XDZ0e7sy8bC4OO_0 2024-09-14T12:44:03.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3751269919258573662', time=2024-09-14T14:02:44.955348+0000, chain.objs.size()=1 2024-09-14T12:44:03.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.379__shadow_.ZGNJco1zZuLGAPQyv5BZiEXP0sSzoDI_0 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5514577376586296360', time=2024-09-14T14:03:12.796321+0000, chain.objs.size()=1 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.391__shadow_.gw5cD4hjsgbq6nx1Dci3dhmWmDUR2Yz_0 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5390827828332126735', time=2024-09-14T14:03:56.669747+0000, chain.objs.size()=1 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.411__shadow_.6d1b-GsNQqO_kK4VUHpn4bB5RgnyKus_0 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9861229602968016909', time=2024-09-14T14:04:44.356660+0000, chain.objs.size()=1 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.432__shadow_.e1-FhbohRar_e5NSvWSLeQBp5pZ5PCq_0 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3836724803489902488', time=2024-09-14T14:05:33.305893+0000, chain.objs.size()=1 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.452__shadow_.qsfpENfC7RQ-GlGRKXLCX7I-pU1m2Wl_0 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17767488217936500362', time=2024-09-14T14:14:38.123321+0000, chain.objs.size()=2 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~ztA0dvbzlbu5uBOFYbw7oxf6lOOUgnb.1 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__shadow_mymultipart.2~ztA0dvbzlbu5uBOFYbw7oxf6lOOUgnb.1_1 2024-09-14T12:44:03.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12785424009695203079', time=2024-09-14T14:15:28.031186+0000, chain.objs.size()=1 2024-09-14T12:44:03.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.529__shadow_.rCnCVs5a09JmjFxITzkn4CQoDHfPN--_0 2024-09-14T12:44:03.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16354980644061521630', time=2024-09-14T14:19:23.237088+0000, chain.objs.size()=1 2024-09-14T12:44:03.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:xrz43aayi8i0A2C.MM36WWK6SphbK-g_.0w9l-MfVsdqvKpPHr0XY_c0EnsymiLM_0 2024-09-14T12:44:03.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.530027586895532033', time=2024-09-14T14:19:55.534655+0000, chain.objs.size()=1 2024-09-14T12:44:03.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.574__shadow_.6uuOJHZ1c0h6M98WAynjm6Es9jC27QJ_0 2024-09-14T12:44:03.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13744468061524985478', time=2024-09-14T14:20:44.103157+0000, chain.objs.size()=1 2024-09-14T12:44:03.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:Fit163xGWyi6tNV5SeZAKn6ekYbOkSI_.n6kNSSSYkvpQI5iMaflUfvtUB5C5X9c_0 2024-09-14T12:44:03.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13828719310407348734', time=2024-09-14T14:21:06.862790+0000, chain.objs.size()=1 2024-09-14T12:44:03.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:ES6jguny9fmb9NJookbniudP1LI9.AZ_.-XuhUsbC8i49j0C-48en0PP50Qa1D4k_0 2024-09-14T12:44:03.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12155014357408651628', time=2024-09-14T14:22:10.130162+0000, chain.objs.size()=1 2024-09-14T12:44:03.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:2qtwaxANlLvfMv2hTP0JOpq1KGLQ6FK_.U1FGgGRspESaICLAFj2OcffFPG8eGXc_0 2024-09-14T12:44:03.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2549288845720558254', time=2024-09-14T14:22:37.405319+0000, chain.objs.size()=1 2024-09-14T12:44:03.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:OYD0u32wdb.EFUnrmgXN3kHc42cscEa_.IUvrfXcckFZg1_ryGA5Bh6_uLhek6y7_0 2024-09-14T12:44:03.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7043809384778109767', time=2024-09-14T14:32:46.169197+0000, chain.objs.size()=1 2024-09-14T12:44:03.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.667__shadow_.8kTdtaCbvlHiaDXigvuqpTR8r6q318n_0 2024-09-14T12:44:03.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10864532638401640782', time=2024-09-14T14:38:20.792676+0000, chain.objs.size()=1 2024-09-14T12:44:03.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.754__shadow_.w8xX3y60j3GhXvJDNkzAM2gy9SNDSho_0 2024-09-14T12:44:03.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12527315659648278361', time=2024-09-14T14:43:42.929897+0000, chain.objs.size()=1 2024-09-14T12:44:03.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783__shadow_.ARVzB8GBoxHlx7R4jSM4wtUW0N9eplY_0 2024-09-14T12:44:03.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.583 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T12:44:03.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=97, truncated=0, next_marker='' 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BF8QEekDZ3tE_PrJDbkMh8Ax8dbvbCy', time=2024-09-14T13:46:13.376393+0000, chain.objs.size()=2 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.202__multipart_mymultipart.2~BF8QEekDZ3tE_PrJDbkMh8Ax8dbvbCy.1 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.202__shadow_mymultipart.2~BF8QEekDZ3tE_PrJDbkMh8Ax8dbvbCy.1_1 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8450591469039984119', time=2024-09-14T13:50:07.684087+0000, chain.objs.size()=1 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.235__shadow_.7sAlYZPgQwSYBohxKSvcn7a3mFvqTpU_0 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4811873440110341267', time=2024-09-14T13:50:10.341880+0000, chain.objs.size()=1 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.236__shadow_.ZPhR1PiBHGU3vI9fVz2MlYCsiyR4hbD_0 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3876465884230438672', time=2024-09-14T13:50:16.852759+0000, chain.objs.size()=1 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.238__shadow_.zNLLh4xwJdCzqzDdYT3s8yzpkLO3jjM_0 2024-09-14T12:44:03.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8056410467956162315', time=2024-09-14T13:51:13.464093+0000, chain.objs.size()=1 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.259__shadow_.aLmPoPUo_JF2AVMu0oqm-qplYmeEybr_0 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6139436803214230926', time=2024-09-14T13:53:06.567172+0000, chain.objs.size()=1 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gm-g5Q8XoATsRudrWHmkvtzu2r-GWzm_0 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8390027903928315182', time=2024-09-14T13:53:10.203488+0000, chain.objs.size()=1 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MZSMXeb5ZujgPkpUWo13V73h7cAnW_J_0 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8226426096687657110', time=2024-09-14T13:53:10.254245+0000, chain.objs.size()=1 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1fp-Rqi1JIQPG126KLVHoOa_J-kRAUh_0 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7232644897873185395', time=2024-09-14T13:53:11.517805+0000, chain.objs.size()=1 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ssKMyg77dgC8GscHJ3tDGNlHYOv4Uri_0 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5267997921376999342', time=2024-09-14T13:53:11.956517+0000, chain.objs.size()=1 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jahZQ1qpC57lG8GsazqedDqp4KySSdY_0 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6170396067401767358', time=2024-09-14T13:53:14.572775+0000, chain.objs.size()=1 2024-09-14T12:44:03.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hz3s0I46KoX1bms-Iyk_07ZgFuz3k2k_0 2024-09-14T12:44:03.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5460379213272767161', time=2024-09-14T13:53:14.932324+0000, chain.objs.size()=1 2024-09-14T12:44:03.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fZq8MWbegrZnGlpmfhfi7CKhD0CNKFV_0 2024-09-14T12:44:03.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10291621823265073954', time=2024-09-14T13:53:14.989612+0000, chain.objs.size()=1 2024-09-14T12:44:03.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qM_3OPxAGBhZl4OPPdaklB6Q52lKO-7_0 2024-09-14T12:44:03.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5532875817774848839', time=2024-09-14T13:53:22.508750+0000, chain.objs.size()=1 2024-09-14T12:44:03.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6It18dB5NpYGrO9wcNy11aNkmPDcTlV_0 2024-09-14T12:44:03.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16793955996317150514', time=2024-09-14T13:53:23.021002+0000, chain.objs.size()=1 2024-09-14T12:44:03.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QChOzuZ7AN6incX2JeiKLPbnnbi5rY4_0 2024-09-14T12:44:03.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12787144206950667334', time=2024-09-14T13:53:23.333653+0000, chain.objs.size()=1 2024-09-14T12:44:03.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uaC_-clTnj9Od3DWeu0M7h9owV6ANII_0 2024-09-14T12:44:03.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10673310358942942452', time=2024-09-14T13:53:23.982350+0000, chain.objs.size()=1 2024-09-14T12:44:03.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5EzLB7Fivv9p5yZMOFD3TVZ4AogzjKt_0 2024-09-14T12:44:03.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1520785502359578687', time=2024-09-14T13:53:27.682894+0000, chain.objs.size()=1 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0vYMs1LeDD3XnDj8G4RxHVCDX4Ox4R__0 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.221209909213724947', time=2024-09-14T13:53:30.310255+0000, chain.objs.size()=1 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5xYZlUknbtp041KIi1dogROzH3wiZy7_0 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14843752077068515739', time=2024-09-14T13:53:33.234411+0000, chain.objs.size()=1 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.NzSnFhGsNbckFmyT_WHuVxf5NPjb925_0 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14370218370125929313', time=2024-09-14T13:53:37.620662+0000, chain.objs.size()=1 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.264__shadow_.Maim83BsIpnEhpKOl0JMSkGcUPmL8dD_0 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8582091342134500406', time=2024-09-14T13:54:01.444412+0000, chain.objs.size()=1 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.274__shadow_.KMldOWNjSi91h8IiFD_hUMWI4MoxYxv_0 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4173983236285333113', time=2024-09-14T13:54:06.328691+0000, chain.objs.size()=1 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.276__shadow_.KhENgXKPWZiA52wLEbYBhcLqYQj9NkX_0 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5190316756855952160', time=2024-09-14T13:54:26.375250+0000, chain.objs.size()=1 2024-09-14T12:44:03.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.284__shadow_.fkFa57YWP6yTz_hafonxfxNqmWjd4gK_0 2024-09-14T12:44:03.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.316600569366540299', time=2024-09-14T13:54:41.635505+0000, chain.objs.size()=1 2024-09-14T12:44:03.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.290__shadow_.8JcRHkeB-G1Y5bHP93ouRKZoBHFtLgg_0 2024-09-14T12:44:03.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1070416749659903685', time=2024-09-14T13:54:44.134169+0000, chain.objs.size()=1 2024-09-14T12:44:03.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.291__shadow_.j0X0ONN138XKo2YhHCR_HetpyXjnLPN_0 2024-09-14T12:44:03.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10612535374559159312', time=2024-09-14T13:54:53.022016+0000, chain.objs.size()=1 2024-09-14T12:44:03.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.bOidc_KpUuFxO4Ud_IPa3vaTZOEqKtf_0 2024-09-14T12:44:03.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17613935465118724113', time=2024-09-14T13:54:58.746558+0000, chain.objs.size()=1 2024-09-14T12:44:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.afL5SGL9YzTfAFVxLzusgxFNSzwvK7g_0 2024-09-14T12:44:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.735046025597772674', time=2024-09-14T13:55:24.478178+0000, chain.objs.size()=1 2024-09-14T12:44:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.304__shadow_.B_PZX4DEfX6pVCF3CWNdA2NXSFSdV5z_0 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9291193230072978165', time=2024-09-14T13:58:07.286778+0000, chain.objs.size()=1 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.A6sgwVLbJOQydz9gdE_5IpnnurnGVl6_0 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2206281672324618618', time=2024-09-14T13:58:07.318192+0000, chain.objs.size()=1 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pZrwW_eXv4LchQmkE9STR4b1ikiafK4_0 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3068228252116428153', time=2024-09-14T13:58:11.383558+0000, chain.objs.size()=1 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ci7jAXaR4Gh94M3ObnAZPP0jaFroLB__0 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6466471795959977510', time=2024-09-14T13:58:19.859951+0000, chain.objs.size()=1 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.X7T22etrgVoaXeay2YJryow3IlRXaBX_0 2024-09-14T12:44:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5405950805698135955', time=2024-09-14T13:58:19.959203+0000, chain.objs.size()=1 2024-09-14T12:44:03.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Tkai2_6h6AcUL25_u479H5UjY5W2JkV_0 2024-09-14T12:44:03.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11011197904143613492', time=2024-09-14T13:58:21.166214+0000, chain.objs.size()=1 2024-09-14T12:44:03.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oSCPtHMq6t1CJIly9cU3mIfZBk83szi_0 2024-09-14T12:44:03.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7624185459102373872', time=2024-09-14T13:58:21.696181+0000, chain.objs.size()=1 2024-09-14T12:44:03.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.dLa1xehhmZCIYkPAUV08gEHxQ-cn9SS_0 2024-09-14T12:44:03.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6506197803394834087', time=2024-09-14T13:58:22.942018+0000, chain.objs.size()=1 2024-09-14T12:44:03.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._6Ofts0Hb4164dNn-vOzLrtVUzWXhYf_0 2024-09-14T12:44:03.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5845410960476064107', time=2024-09-14T13:58:23.354960+0000, chain.objs.size()=1 2024-09-14T12:44:03.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1SowKYhmyP1dXCKQpv3pne6xGxYgrEc_0 2024-09-14T12:44:03.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8850736020899644424', time=2024-09-14T13:58:23.671403+0000, chain.objs.size()=1 2024-09-14T12:44:03.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.p7L_u78A_LIQr80-pMf2-iQlLXPABJV_0 2024-09-14T12:44:03.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13608492741651136517', time=2024-09-14T13:58:23.691881+0000, chain.objs.size()=1 2024-09-14T12:44:03.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.5MlPpyQEm5d_qd0EGa17zzSCnGbCXdf_0 2024-09-14T12:44:03.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17748613252333800532', time=2024-09-14T13:58:25.382739+0000, chain.objs.size()=1 2024-09-14T12:44:03.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ncKwryiRaJb1OcUOgJb7iRg797DG7dv_0 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13753143656263078491', time=2024-09-14T13:58:25.719505+0000, chain.objs.size()=1 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YfZLn16PVyBEta6HMkAdq58r_j3SST3_0 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16708619508080796484', time=2024-09-14T13:58:26.863338+0000, chain.objs.size()=1 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Z_iL-ERfjbEYmMEUZMWL_n8nSUj2q_n_0 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17939937849451582047', time=2024-09-14T13:58:30.275032+0000, chain.objs.size()=1 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.slChu-a-M5NLpiQSb4ynKy3sjbO-TKM_0 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16714420138734751334', time=2024-09-14T13:58:32.275396+0000, chain.objs.size()=1 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hVIxJWCm_A8K1Dh_yKG1mPmo6RdeGC7_0 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13656930694564237232', time=2024-09-14T13:58:32.584783+0000, chain.objs.size()=1 2024-09-14T12:44:03.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.B0pVwkpzmkRxKJojRFZmIhR3Q3cPlD3_0 2024-09-14T12:44:03.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12254827977282227881', time=2024-09-14T13:58:33.149328+0000, chain.objs.size()=1 2024-09-14T12:44:03.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.zZ5SZZLb96vergsIL5zOgQSgGAm-MQJ_0 2024-09-14T12:44:03.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15559360601467392074', time=2024-09-14T13:58:33.255060+0000, chain.objs.size()=1 2024-09-14T12:44:03.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cX3pUHVtwCv5c6aloUEFYRHDwp36ojK_0 2024-09-14T12:44:03.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11189662899177980015', time=2024-09-14T13:58:33.642047+0000, chain.objs.size()=1 2024-09-14T12:44:03.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4vt9FW5Teh55X9YcyITpqaiPUK7w1hk_0 2024-09-14T12:44:03.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16144392791784116549', time=2024-09-14T13:58:33.646060+0000, chain.objs.size()=1 2024-09-14T12:44:03.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.20uOhLUp8pQhvFWqLYFNkkYdPrfjnPB_0 2024-09-14T12:44:03.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4123233084666839215', time=2024-09-14T13:58:34.196026+0000, chain.objs.size()=1 2024-09-14T12:44:03.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7ehFfrHkDnH4jNGLQmkX1as7BJ83j7Y_0 2024-09-14T12:44:03.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15487635434963073386', time=2024-09-14T14:00:22.346306+0000, chain.objs.size()=1 2024-09-14T12:44:03.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.GykUMNXCSTUb_LF8JhsJIsgiXLaki0x_0 2024-09-14T12:44:03.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7501182936060834339', time=2024-09-14T14:00:23.878476+0000, chain.objs.size()=1 2024-09-14T12:44:03.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WOKCtE7S4c1hQJ_S_FnhDN13J6hG-S3_0 2024-09-14T12:44:03.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7808801397949608129', time=2024-09-14T14:00:25.058280+0000, chain.objs.size()=1 2024-09-14T12:44:03.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Pu9d4OgIrrRPZ7UMDlVZG1_M9JT9RLu_0 2024-09-14T12:44:03.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.625+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4149607733889497912', time=2024-09-14T14:00:26.783915+0000, chain.objs.size()=1 2024-09-14T12:44:03.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.625+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YrF9i3nWcTEWxnZ22zotMEo2jEv0f-o_0 2024-09-14T12:44:03.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.625+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10873957959907916955', time=2024-09-14T14:00:27.127913+0000, chain.objs.size()=1 2024-09-14T12:44:03.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.625+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.k2GXLiLRBgFSGaBLt0_0B-HMU0vs23R_0 2024-09-14T12:44:03.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.625+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1489048866630510820', time=2024-09-14T14:00:27.489824+0000, chain.objs.size()=1 2024-09-14T12:44:03.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.625+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tSUU89xTPWMdaHzaXik0s0UtLMm_CCw_0 2024-09-14T12:44:03.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.625+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4941108084629389193', time=2024-09-14T14:00:29.498182+0000, chain.objs.size()=1 2024-09-14T12:44:03.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.625+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Jy0HCj-hsQIkLfg1MsM-DwsMzIm02F5_0 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13261847550015047434', time=2024-09-14T14:00:30.803345+0000, chain.objs.size()=1 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ro_chWXGuHoDQ6akhBHnFE2DBiPVEjA_0 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10889528437713356833', time=2024-09-14T14:00:31.761134+0000, chain.objs.size()=1 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iYjGHkUdb0y8KrhGImBWEaX0EiNtlSB_0 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9658306755337960800', time=2024-09-14T14:00:33.786386+0000, chain.objs.size()=1 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mD7uJ4b2Z9y35CLYKi5No_Vh727GEbp_0 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1422747573300672662', time=2024-09-14T14:00:34.826681+0000, chain.objs.size()=1 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3rcSYm8lL5p5Exdv4xHJerxMHHzoquU_0 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4979777328566261776', time=2024-09-14T14:00:36.663056+0000, chain.objs.size()=1 2024-09-14T12:44:03.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.i0JVT5AF_PaImSODLoKyqfvIju4A7Dd_0 2024-09-14T12:44:03.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10769307700858783440', time=2024-09-14T14:00:36.738825+0000, chain.objs.size()=1 2024-09-14T12:44:03.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.t6tNAKrwi5qQ8uKY2O8YZxALpxLHCCT_0 2024-09-14T12:44:03.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18045248344630038112', time=2024-09-14T14:00:36.988264+0000, chain.objs.size()=1 2024-09-14T12:44:03.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vmjx2CaMSE_XgiEHF4O7kuzThyXMnvt_0 2024-09-14T12:44:03.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14683096904592097446', time=2024-09-14T14:00:37.858329+0000, chain.objs.size()=1 2024-09-14T12:44:03.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6nXOKezyh5rpUliYcjpGVfqAiFSLyqE_0 2024-09-14T12:44:03.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.211482114416110565', time=2024-09-14T14:00:37.872826+0000, chain.objs.size()=1 2024-09-14T12:44:03.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cOO44GAt9pnRyec68phJ1rMqqrlX_EK_0 2024-09-14T12:44:03.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7020016662465258312', time=2024-09-14T14:00:38.412314+0000, chain.objs.size()=1 2024-09-14T12:44:03.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Df3oe8EJDX1L9tg-b3nS338Cy1I3ClO_0 2024-09-14T12:44:03.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11744753055469312775', time=2024-09-14T14:00:39.301763+0000, chain.objs.size()=1 2024-09-14T12:44:03.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-QXVcQCW77YnCqIpJ2qGm7FPnBl65WD_0 2024-09-14T12:44:03.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5890275985887762611', time=2024-09-14T14:00:42.436940+0000, chain.objs.size()=1 2024-09-14T12:44:03.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gaYgX15IoNHp1E3d5dFaA4Ws_q83qiO_0 2024-09-14T12:44:03.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13004191452826039057', time=2024-09-14T14:00:44.797205+0000, chain.objs.size()=1 2024-09-14T12:44:03.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._tDRK5RjBPfBDRuaruWwpPGOGC0lGL6_0 2024-09-14T12:44:03.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.358265082510428558', time=2024-09-14T14:00:45.181148+0000, chain.objs.size()=1 2024-09-14T12:44:03.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2OcGFWp2qylKEBscH5CbrC9bO72cPB3_0 2024-09-14T12:44:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9205545349975904616', time=2024-09-14T14:00:46.838384+0000, chain.objs.size()=1 2024-09-14T12:44:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.OqWzrJPUgPCbwJBTVKC67MXY6NQnBPF_0 2024-09-14T12:44:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.328733382134127430', time=2024-09-14T14:00:46.963561+0000, chain.objs.size()=1 2024-09-14T12:44:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bc5_Kd-DIetaH7Os7U1REF2HMVF3AjX_0 2024-09-14T12:44:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6897829371398219798', time=2024-09-14T14:00:47.035791+0000, chain.objs.size()=1 2024-09-14T12:44:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ok8Plh4jXMq1W39oSnOyzoo4Ky-0939_0 2024-09-14T12:44:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5479287886042560473', time=2024-09-14T14:00:48.548383+0000, chain.objs.size()=1 2024-09-14T12:44:03.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.637+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.F5CoXA4TIVu0X7vjwuIkSvHGY0rkrlg_0 2024-09-14T12:44:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6794981743556939396', time=2024-09-14T14:00:48.636313+0000, chain.objs.size()=1 2024-09-14T12:44:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.OK25IatFj1Hk58-M9CTQbjgaG5GtxE7_0 2024-09-14T12:44:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14423168558648639851', time=2024-09-14T14:00:49.718540+0000, chain.objs.size()=1 2024-09-14T12:44:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BQosUDCNtwZXSwERoFxfS9sxaQeXQx2_0 2024-09-14T12:44:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4567726048491705273', time=2024-09-14T14:05:04.978392+0000, chain.objs.size()=1 2024-09-14T12:44:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.441__shadow_.RcK0e91HMKdYToWCpfBv7W3rd3XP50z_0 2024-09-14T12:44:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11170707683630835222', time=2024-09-14T14:07:15.224451+0000, chain.objs.size()=1 2024-09-14T12:44:03.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.494__shadow_.164xZpjBviO7Y3zv3uvJ0bFNczXs334_0 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11746294866304630873', time=2024-09-14T14:07:39.987446+0000, chain.objs.size()=1 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.504__shadow:CRVCgFwmMB1yqxO5U8RjttqtM84H.gl_.-dyH_j79k-7Z8XYotXT1e1-rBoXsavU_0 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1498464399829739025', time=2024-09-14T14:08:23.016653+0000, chain.objs.size()=6 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.1 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.2 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.3 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.4 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.5 2024-09-14T12:44:03.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.6 2024-09-14T12:44:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.823103714738312808', time=2024-09-14T14:08:24.363761+0000, chain.objs.size()=6 2024-09-14T12:44:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.1 2024-09-14T12:44:03.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.2 2024-09-14T12:44:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.3 2024-09-14T12:44:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.4 2024-09-14T12:44:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.5 2024-09-14T12:44:03.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.508__multipart_srcmultipart.2~Nj8UA5m90AH9TZ6iyrRTVg8Xa17u87R.6 2024-09-14T12:44:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2896153967173039973', time=2024-09-14T14:08:29.170860+0000, chain.objs.size()=1 2024-09-14T12:44:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.512__multipart_mymultipart.2~tbS6wuL4PVMZLDXqGg0CHI_ahaqUZYJ.1 2024-09-14T12:44:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10979708014069111678', time=2024-09-14T14:08:53.811437+0000, chain.objs.size()=1 2024-09-14T12:44:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.519__multipart_mymultipart.2~_tGjfjBqEi3kdpqD-bGIHNQS4QwR7oX.1 2024-09-14T12:44:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15102400989487001870', time=2024-09-14T14:11:28.046221+0000, chain.objs.size()=6 2024-09-14T12:44:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.JBwCG5PutoTjGMaLxt06GiA8wxjSyKlD.1 2024-09-14T12:44:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~Lkc6gPbD2t-sfUfRw2oqfHLAbFyCeH-.2 2024-09-14T12:44:03.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~Lkc6gPbD2t-sfUfRw2oqfHLAbFyCeH-.3 2024-09-14T12:44:03.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~Lkc6gPbD2t-sfUfRw2oqfHLAbFyCeH-.4 2024-09-14T12:44:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~Lkc6gPbD2t-sfUfRw2oqfHLAbFyCeH-.5 2024-09-14T12:44:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~Lkc6gPbD2t-sfUfRw2oqfHLAbFyCeH-.6 2024-09-14T12:44:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1920475559370849719', time=2024-09-14T14:14:25.779708+0000, chain.objs.size()=3 2024-09-14T12:44:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~Z2JBihbmRP9R1py6x6sH2LC0G5sajU1.1 2024-09-14T12:44:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~Z2JBihbmRP9R1py6x6sH2LC0G5sajU1.2 2024-09-14T12:44:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~Z2JBihbmRP9R1py6x6sH2LC0G5sajU1.3 2024-09-14T12:44:03.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15853840818793939604', time=2024-09-14T14:18:37.594242+0000, chain.objs.size()=3 2024-09-14T12:44:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.559__shadow_.9bb1vy18puQAciEL9Tm5aPqE8VCI2cB_0 2024-09-14T12:44:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.559__shadow_.9bb1vy18puQAciEL9Tm5aPqE8VCI2cB_1 2024-09-14T12:44:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.559__shadow_.9bb1vy18puQAciEL9Tm5aPqE8VCI2cB_2 2024-09-14T12:44:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13827736670035017294', time=2024-09-14T14:19:08.832088+0000, chain.objs.size()=1 2024-09-14T12:44:03.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.565__shadow_.PWRQDNqFgbHfudziV3KOApWT1BHbfiC_0 2024-09-14T12:44:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13438781454536340429', time=2024-09-14T14:19:34.652724+0000, chain.objs.size()=1 2024-09-14T12:44:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:FnrYEyqOKYjIzMWZW8rJ.dU9cEzbOQF_.XGJP3hpoTHpth8LGFX3CbC92GoX0Qum_0 2024-09-14T12:44:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8117888103750698402', time=2024-09-14T14:19:36.307611+0000, chain.objs.size()=1 2024-09-14T12:44:03.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:TKFepvPcmfMoPFhpkNV9.bQ0f7gpMpo_.hd0VzDaPF-YqaGwEMGPNpEgnpszxDqF_0 2024-09-14T12:44:03.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10696992420557450817', time=2024-09-14T14:22:32.312605+0000, chain.objs.size()=1 2024-09-14T12:44:03.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.587__shadow:NDXOZjJgeUs3jHqxv5iz-f27Zcm3yhE_.AlfUgD4o5esO_Bkk_-RO2813WUoJK_R_0 2024-09-14T12:44:03.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13346219612977912370', time=2024-09-14T14:22:37.569123+0000, chain.objs.size()=1 2024-09-14T12:44:03.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:IbfwYAkBebxbykpLT3BdK3npNrCCcUi_.8n95vQ4ubgX8lgoCiW2wjPe7KRwkUHf_0 2024-09-14T12:44:03.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1370677849226240277', time=2024-09-14T14:31:34.465091+0000, chain.objs.size()=1 2024-09-14T12:44:03.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.656__shadow_.JzyjcpdFDEHauDE7rystW3jcojf0pb1_0 2024-09-14T12:44:03.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.661+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9806466391482761191', time=2024-09-14T14:32:46.186805+0000, chain.objs.size()=1 2024-09-14T12:44:03.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.661+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.667__shadow_.rYwdt9U-qISiXElIx-7rD2fRX1c77DX_0 2024-09-14T12:44:03.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.661+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18195153527125666776', time=2024-09-14T14:39:23.736320+0000, chain.objs.size()=1 2024-09-14T12:44:03.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.661+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.763__shadow_.rVslLI8xmd4vqr2viuq5sAf1QPOBUUh_0 2024-09-14T12:44:03.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.661+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8578000139021238016', time=2024-09-14T14:41:29.256367+0000, chain.objs.size()=1 2024-09-14T12:44:03.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.661+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.779__shadow_.SPZIrLmzJrTT5rIQ_AbwWeLb_kzZipf_0 2024-09-14T12:44:03.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T12:44:03.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45947' 2024-09-14T12:44:03.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8811662905142561137', time=2024-09-14T13:51:01.108123+0000, chain.objs.size()=1 2024-09-14T12:44:03.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.254__shadow_.pD4qdL8pQ8QmLWl57qV82K-HtY4ystX_0 2024-09-14T12:44:03.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17952601812096245092', time=2024-09-14T13:53:06.565251+0000, chain.objs.size()=1 2024-09-14T12:44:03.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.mn6MaU3hH_au1kHSjYRYW5nUvC14W-u_0 2024-09-14T12:44:03.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4952356956145447958', time=2024-09-14T13:53:07.503656+0000, chain.objs.size()=1 2024-09-14T12:44:03.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.d2XZYLjb2YDZEc40wFZYRTU7E4XswV0_0 2024-09-14T12:44:03.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1316776096810236856', time=2024-09-14T13:53:07.726401+0000, chain.objs.size()=1 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hYE2GKsPEq7FIDv2GWSZ26c12wUFC2l_0 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11373441014345914081', time=2024-09-14T13:53:08.114756+0000, chain.objs.size()=1 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RoG_p_HI_gwcXeG52S35jWppE_UB9Vg_0 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15464669369327149716', time=2024-09-14T13:53:10.682861+0000, chain.objs.size()=1 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.k2rOvqUl0tFAygnf5s_ka0-gnMsoOAL_0 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9164291647226190704', time=2024-09-14T13:53:10.798663+0000, chain.objs.size()=1 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.DeH74IY00rKN7dgzusxwp7Ww5JzfOSL_0 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4771764138204614632', time=2024-09-14T13:53:11.616773+0000, chain.objs.size()=1 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oMc2cMJXwh6i3uVk7DJ1uV_GDWsChCh_0 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5154345125678289929', time=2024-09-14T13:53:12.663697+0000, chain.objs.size()=1 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GoJQsdwp-yClUx6xCy1_C3DyFwBVLX3_0 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10920124948271839346', time=2024-09-14T13:53:13.583890+0000, chain.objs.size()=1 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CHvtNugSySUoEaOAOL3BLTsea3m4yd4_0 2024-09-14T12:44:03.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15505692142763117114', time=2024-09-14T13:53:16.367199+0000, chain.objs.size()=1 2024-09-14T12:44:03.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qg5OsG3WZbV22GNsXPn4n4UhcVr2_5P_0 2024-09-14T12:44:03.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5109781763950242047', time=2024-09-14T13:53:16.720869+0000, chain.objs.size()=1 2024-09-14T12:44:03.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7-c00CN5tCQSe3kqYE5gsCN5zS5qoy2_0 2024-09-14T12:44:03.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17039058385682270125', time=2024-09-14T13:53:21.873396+0000, chain.objs.size()=1 2024-09-14T12:44:03.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JphE80dMOhDIDUO0KSvJACL3OKcjA2I_0 2024-09-14T12:44:03.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13011179251795502679', time=2024-09-14T13:53:23.206606+0000, chain.objs.size()=1 2024-09-14T12:44:03.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yeHQ-Nu7Qrql4zcpp9ol6ze58JXWrIL_0 2024-09-14T12:44:03.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1729453119861806210', time=2024-09-14T13:53:25.552974+0000, chain.objs.size()=1 2024-09-14T12:44:03.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dEBr-fGAZLJCgfEar2EXta-Au_HVY_N_0 2024-09-14T12:44:03.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2031403146929527730', time=2024-09-14T13:53:26.453402+0000, chain.objs.size()=1 2024-09-14T12:44:03.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.D92vuFUIlQdnTmJPqDrR1zKhb4hfKwh_0 2024-09-14T12:44:03.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8025117797880779468', time=2024-09-14T13:53:27.106209+0000, chain.objs.size()=1 2024-09-14T12:44:03.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6fFKd_210tDlKr0xC7EWTmDkgR3NEtK_0 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3196813881196037260', time=2024-09-14T13:53:27.662833+0000, chain.objs.size()=1 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nPzTT8qF_-XK0Np4KAUrBrZ9HcHK2or_0 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8303702223295747609', time=2024-09-14T13:53:28.061625+0000, chain.objs.size()=1 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rOfbD8hHWUPp-g9fE5XU9-8OVI4dig0_0 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16776746290613326293', time=2024-09-14T13:53:28.969178+0000, chain.objs.size()=1 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1HAuidBGv_vrZBPUTdN9clAfycc4ml6_0 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18413761221992788184', time=2024-09-14T13:53:30.119049+0000, chain.objs.size()=1 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CqxnE94LwQTUdMpHgK9udXzVNbsymCQ_0 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16094328672070369831', time=2024-09-14T13:53:30.215706+0000, chain.objs.size()=1 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.mSaf9ABhDIU-KljXUj774iJ6a5TL9QZ_0 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4090701197307485041', time=2024-09-14T13:53:33.107202+0000, chain.objs.size()=1 2024-09-14T12:44:03.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.b-b4GZNvq06ZWY7cCgNG-yzCuI3brpS_0 2024-09-14T12:44:03.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7585421768095578349', time=2024-09-14T13:53:33.232650+0000, chain.objs.size()=1 2024-09-14T12:44:03.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._Xtuaa42g_t_13TKOKJbbZoYfIl5aw1_0 2024-09-14T12:44:03.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13733400868547267319', time=2024-09-14T13:54:16.324337+0000, chain.objs.size()=1 2024-09-14T12:44:03.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.280__shadow_.4w63ZrDMSlvOivc1GLBUd1vmJ3BHmTb_0 2024-09-14T12:44:03.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17647517729309731865', time=2024-09-14T13:54:52.859339+0000, chain.objs.size()=1 2024-09-14T12:44:03.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.LO5GvJh3jqafNJKyaJfNYX5C9Lx0mb__0 2024-09-14T12:44:03.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3565987591693235816', time=2024-09-14T13:54:53.020918+0000, chain.objs.size()=1 2024-09-14T12:44:03.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.slh4XI2aNjtWmL2Tp-7OrJIILehcody_0 2024-09-14T12:44:03.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15645220036129091558', time=2024-09-14T13:54:58.745641+0000, chain.objs.size()=1 2024-09-14T12:44:03.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.4gSHYL4AQFq5GQIBwyxmyjztzZmC39p_0 2024-09-14T12:44:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.980755414555984965', time=2024-09-14T13:54:58.753283+0000, chain.objs.size()=1 2024-09-14T12:44:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.u6ygkNsaprTtTRKJMNIglqMQUDYaGqn_0 2024-09-14T12:44:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1796294805910686800', time=2024-09-14T13:54:58.956904+0000, chain.objs.size()=1 2024-09-14T12:44:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.sBL6S2TxrEwohgh4TFZJ5DOfwk2wOb9_0 2024-09-14T12:44:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8854246642970403746', time=2024-09-14T13:55:04.092206+0000, chain.objs.size()=1 2024-09-14T12:44:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.296__shadow_.uRSdjwKtcNft9Iycd5SanXkI_Ao6kH__0 2024-09-14T12:44:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18289452365835602909', time=2024-09-14T13:55:11.732004+0000, chain.objs.size()=1 2024-09-14T12:44:03.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.299__shadow_.J31C0aT4N2KDxdn_C9aMCOuaAH2eLvS_0 2024-09-14T12:44:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9647538505160802506', time=2024-09-14T13:55:16.927506+0000, chain.objs.size()=1 2024-09-14T12:44:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.301__shadow_.pZcJJvfJXaYExnFaqjgfTE1pCYnv8Vq_0 2024-09-14T12:44:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.205790374920125533', time=2024-09-14T13:58:05.480164+0000, chain.objs.size()=1 2024-09-14T12:44:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lXbHk-z1K3NB_VIbgYZH2Jiq7sudiPW_0 2024-09-14T12:44:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8964492220892683046', time=2024-09-14T13:58:05.668756+0000, chain.objs.size()=1 2024-09-14T12:44:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.36_qLZVNrKFDUU23DoImMZc_1ZMiYRD_0 2024-09-14T12:44:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11368266809574132943', time=2024-09-14T13:58:05.938516+0000, chain.objs.size()=1 2024-09-14T12:44:03.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lgPUjFLADH3V5BbErhsOfQJXcd2S9vH_0 2024-09-14T12:44:03.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16394187488966830939', time=2024-09-14T13:58:07.706238+0000, chain.objs.size()=1 2024-09-14T12:44:03.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9oT8Pf3rR7XiyaPM57F2901U2ND8bz2_0 2024-09-14T12:44:03.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16852351859438923632', time=2024-09-14T13:58:11.732391+0000, chain.objs.size()=1 2024-09-14T12:44:03.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BGnr3IGQ88-Oo7lJy-ApI-TLRS355Eh_0 2024-09-14T12:44:03.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7763991683559577093', time=2024-09-14T13:58:14.323520+0000, chain.objs.size()=1 2024-09-14T12:44:03.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VYgZK9RA0rsKqu43i-WOlzkzKFajQ6t_0 2024-09-14T12:44:03.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4517165965695821852', time=2024-09-14T13:58:14.757690+0000, chain.objs.size()=1 2024-09-14T12:44:03.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NTmnxGNltiDBhLQSAXow6b0puRNxKXY_0 2024-09-14T12:44:03.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3943927903702707813', time=2024-09-14T13:58:14.864061+0000, chain.objs.size()=1 2024-09-14T12:44:03.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kG2-9kQ86wf83TOHf7clAP1te0FZUjb_0 2024-09-14T12:44:03.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3136316134825769126', time=2024-09-14T13:58:15.061011+0000, chain.objs.size()=1 2024-09-14T12:44:03.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7Hrtho3IwNLdR-fBqUODT2mxHSEqAId_0 2024-09-14T12:44:03.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11984945172163342660', time=2024-09-14T13:58:16.277739+0000, chain.objs.size()=1 2024-09-14T12:44:03.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PiXJqYnvaElk5-A2ga4XLLeL7hzCHdB_0 2024-09-14T12:44:03.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7570750691397427984', time=2024-09-14T13:58:16.386552+0000, chain.objs.size()=1 2024-09-14T12:44:03.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XNc0eXBbhNr6GIrmM0j7UA-wfdf8Zxm_0 2024-09-14T12:44:03.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15500395214782948385', time=2024-09-14T13:58:17.251430+0000, chain.objs.size()=1 2024-09-14T12:44:03.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nhv4hzFcMWthKIJcmU7IGjU7-j-zysl_0 2024-09-14T12:44:03.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7799870458965152057', time=2024-09-14T13:58:17.652273+0000, chain.objs.size()=1 2024-09-14T12:44:03.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JAxaH-q5AqqIV3wJg-10nuWgOns9IOb_0 2024-09-14T12:44:03.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2411151014365408375', time=2024-09-14T13:58:18.141905+0000, chain.objs.size()=1 2024-09-14T12:44:03.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZhUMxjEsIeW4Sdcrj1-k3WrGs0AAIGK_0 2024-09-14T12:44:03.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4966691953317687923', time=2024-09-14T13:58:19.235235+0000, chain.objs.size()=1 2024-09-14T12:44:03.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Jstvm7_BCqZU0hE_ijCO5Ju-rm-QWGl_0 2024-09-14T12:44:03.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6165220503262199471', time=2024-09-14T13:58:19.335470+0000, chain.objs.size()=1 2024-09-14T12:44:03.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.B2kG1OGkwmEXR-Duv29yeSiCQLKn-OD_0 2024-09-14T12:44:03.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16391506396928605516', time=2024-09-14T13:58:20.072574+0000, chain.objs.size()=1 2024-09-14T12:44:03.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VU4a7llLignmWrpkYyRmB8F6g8yJ_fK_0 2024-09-14T12:44:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17075855526771618239', time=2024-09-14T13:58:23.645050+0000, chain.objs.size()=1 2024-09-14T12:44:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ltLGcweRTYWbmN9azgcQuAFo0crZBdQ_0 2024-09-14T12:44:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15256114577203705101', time=2024-09-14T13:58:24.809490+0000, chain.objs.size()=1 2024-09-14T12:44:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DHG1AjWMkoyzZuDops9nq5pjfASu_TE_0 2024-09-14T12:44:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12085779629999824670', time=2024-09-14T13:58:26.018676+0000, chain.objs.size()=1 2024-09-14T12:44:03.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TXoFudfUPKNREp5fLTOqkZaY3YhdWOl_0 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2169611878012150210', time=2024-09-14T13:58:26.127452+0000, chain.objs.size()=1 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.X7R8DJNE3gfJsLIjPThyicHesdyAKKh_0 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13635831884867298804', time=2024-09-14T13:58:26.371659+0000, chain.objs.size()=1 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jk7J5iS7-2u3jmPlXHjlFZ244RU7NB9_0 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9494600474347747925', time=2024-09-14T13:58:28.512749+0000, chain.objs.size()=1 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4x0wq4uLSQcPH9P1RMo5jhWRoOyijwj_0 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10630665022212089185', time=2024-09-14T13:58:28.546673+0000, chain.objs.size()=1 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DlycHRTxxHdXXNIytGgtXsi3qdFUHqU_0 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8962772564807332947', time=2024-09-14T13:58:28.818848+0000, chain.objs.size()=1 2024-09-14T12:44:03.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.697+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.W8OITvRIWHU__bHpEOuCMqbKapnDuiy_0 2024-09-14T12:44:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18281434668598839129', time=2024-09-14T13:58:29.667152+0000, chain.objs.size()=1 2024-09-14T12:44:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1gxwgQ4tbVxoICto5XHUPvflGSu2_-t_0 2024-09-14T12:44:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11101238668217586870', time=2024-09-14T13:58:29.775183+0000, chain.objs.size()=1 2024-09-14T12:44:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.12G82lIdrkccvBsK_C6-OiTI-fsGuta_0 2024-09-14T12:44:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13419793017157204532', time=2024-09-14T13:58:32.033408+0000, chain.objs.size()=1 2024-09-14T12:44:03.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.aZdHXnR8Gm5GQTs8lHzZ0ngwePjI5o8_0 2024-09-14T12:44:03.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18033621912469318799', time=2024-09-14T13:58:32.301352+0000, chain.objs.size()=1 2024-09-14T12:44:03.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.85KjIi3vKXxOVlhwA5HevmRuFQJV9st_0 2024-09-14T12:44:03.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4358512089694197314', time=2024-09-14T13:58:32.916178+0000, chain.objs.size()=1 2024-09-14T12:44:03.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3BU56vrJtSZoRw91M8MBKetacY_a8y4_0 2024-09-14T12:44:03.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14273651697922458524', time=2024-09-14T13:58:33.046016+0000, chain.objs.size()=1 2024-09-14T12:44:03.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.erxewA7bntpPWo20m8x7L2RVT99tSgc_0 2024-09-14T12:44:03.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17680911374240918109', time=2024-09-14T14:00:21.049261+0000, chain.objs.size()=1 2024-09-14T12:44:03.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.RvE23sDrFTgkCmCDP9szwBLkk9nLs38_0 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2926381412598670812', time=2024-09-14T14:00:21.980927+0000, chain.objs.size()=1 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QxlaCTPxyGugDAYeIWyao9nQop2RtbM_0 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17203063010320433284', time=2024-09-14T14:00:23.770319+0000, chain.objs.size()=1 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mEHP8Jv-dmJ6GH1IXHhTJo4bWXnYD0k_0 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16983465420824433396', time=2024-09-14T14:00:25.824469+0000, chain.objs.size()=1 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8sl3WcNKD4sudP2RIsB4L93GlRoKw_P_0 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18232258054987372757', time=2024-09-14T14:00:27.466875+0000, chain.objs.size()=1 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LZrwVxliis7zy9NzsdpM1WTsELKC2hE_0 2024-09-14T12:44:03.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12784033833866871311', time=2024-09-14T14:00:27.863939+0000, chain.objs.size()=1 2024-09-14T12:44:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.u8gzUsap5Z9Zd3acLB3swtymk4awXON_0 2024-09-14T12:44:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2230249424514424997', time=2024-09-14T14:00:28.977128+0000, chain.objs.size()=1 2024-09-14T12:44:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BNS1ahVOWcsGqQSk43v-L2QuX7XimrA_0 2024-09-14T12:44:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16774710247581219804', time=2024-09-14T14:00:28.978997+0000, chain.objs.size()=1 2024-09-14T12:44:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Db_ifUnChVJTpuZhMsKFOThp9T1ZjqU_0 2024-09-14T12:44:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6238952539004970643', time=2024-09-14T14:00:28.980677+0000, chain.objs.size()=1 2024-09-14T12:44:03.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uelOOD6CuZQQ7iKlf-LFg8pB5DQkXZO_0 2024-09-14T12:44:03.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5705703843164783642', time=2024-09-14T14:00:29.226457+0000, chain.objs.size()=1 2024-09-14T12:44:03.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.oEXYfilttNu-2prtkjTAXBxmbP805uY_0 2024-09-14T12:44:03.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13285961233450636975', time=2024-09-14T14:00:30.200644+0000, chain.objs.size()=1 2024-09-14T12:44:03.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JMSMviXNyY9RdzejlMrOtK9DcfpB8Ih_0 2024-09-14T12:44:03.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13493705917535627817', time=2024-09-14T14:00:33.116175+0000, chain.objs.size()=1 2024-09-14T12:44:03.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Lm2vHNhkmlG5zpi8AT5iV4Uc66SeRRL_0 2024-09-14T12:44:03.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5100009603940769138', time=2024-09-14T14:00:34.449084+0000, chain.objs.size()=1 2024-09-14T12:44:03.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ut-hEUp3wrZF1gjGmu3TAuW-t28UA8A_0 2024-09-14T12:44:03.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17447493468268780113', time=2024-09-14T14:00:34.482586+0000, chain.objs.size()=1 2024-09-14T12:44:03.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.njPHtCP48TUM-7J_fYx5mrEpRq4sF5r_0 2024-09-14T12:44:03.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15818878514976738244', time=2024-09-14T14:00:34.828169+0000, chain.objs.size()=1 2024-09-14T12:44:03.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jVFiVo3rU93r6AK05jWVideDk5270VF_0 2024-09-14T12:44:03.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1633715827365837610', time=2024-09-14T14:00:34.993072+0000, chain.objs.size()=1 2024-09-14T12:44:03.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1zkVrK7FTJXz99GwxtQN1ODWA7hqHVG_0 2024-09-14T12:44:03.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.836073885177585023', time=2024-09-14T14:00:35.043602+0000, chain.objs.size()=1 2024-09-14T12:44:03.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fQdE8cPwN8wSks4_QUPdoJymBpIl8ww_0 2024-09-14T12:44:03.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3315554240760751526', time=2024-09-14T14:00:37.114593+0000, chain.objs.size()=1 2024-09-14T12:44:03.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.etQqqq8uTTJpR-sdXEodgQpWHg2jL3f_0 2024-09-14T12:44:03.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3037582239525003537', time=2024-09-14T14:00:37.336899+0000, chain.objs.size()=1 2024-09-14T12:44:03.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Hs-I3l6PEYaK4rNjp2Ywr6WQ_DIRsMN_0 2024-09-14T12:44:03.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15671888637361274154', time=2024-09-14T14:00:37.990866+0000, chain.objs.size()=1 2024-09-14T12:44:03.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4Rr6x13rVNbHffgwdYx61W_djKHcpYp_0 2024-09-14T12:44:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.358680460638083242', time=2024-09-14T14:00:38.182763+0000, chain.objs.size()=1 2024-09-14T12:44:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.svd5XkdGXR-HUk-18hTR0oECyD6LDek_0 2024-09-14T12:44:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.148734567113628422', time=2024-09-14T14:00:38.230088+0000, chain.objs.size()=1 2024-09-14T12:44:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Jlt7smTOhkflYBgUdQVNXSVil97OMaO_0 2024-09-14T12:44:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11015663450945857836', time=2024-09-14T14:00:42.425615+0000, chain.objs.size()=1 2024-09-14T12:44:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rtmdW2mxhwLXVe_rk53yUXeDM_l1Du4_0 2024-09-14T12:44:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11922392645819498806', time=2024-09-14T14:00:42.575314+0000, chain.objs.size()=1 2024-09-14T12:44:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.PAnrNzEKjoPAxQLqa7y8V1Qo42y9G6q_0 2024-09-14T12:44:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1427361102211632783', time=2024-09-14T14:00:42.741763+0000, chain.objs.size()=1 2024-09-14T12:44:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VDUtworeC5tJtKxV7bEbTWfJGdw-5fQ_0 2024-09-14T12:44:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15078349652284580631', time=2024-09-14T14:00:44.175768+0000, chain.objs.size()=1 2024-09-14T12:44:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LLNMLXILlz37Wp7X0wY342dNzU3zg1L_0 2024-09-14T12:44:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2677482596769969856', time=2024-09-14T14:00:44.590438+0000, chain.objs.size()=1 2024-09-14T12:44:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dkMnZFGsIpRq6P3xm6sJdEWC1TNH10C_0 2024-09-14T12:44:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11165048562519247613', time=2024-09-14T14:00:45.120352+0000, chain.objs.size()=1 2024-09-14T12:44:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.PTVElUEN62Zf9E8Cuo176bm-Mwx9MRf_0 2024-09-14T12:44:03.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7736784433378736707', time=2024-09-14T14:00:45.824836+0000, chain.objs.size()=1 2024-09-14T12:44:03.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ee_o10zgqeAld6ya_0AvmpLC0AkTjld_0 2024-09-14T12:44:03.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3750685676727798229', time=2024-09-14T14:00:45.827045+0000, chain.objs.size()=1 2024-09-14T12:44:03.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SYiArjyfeIPTIewVeNOVQeF_zvggC7U_0 2024-09-14T12:44:03.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16261840338896037161', time=2024-09-14T14:00:48.389536+0000, chain.objs.size()=1 2024-09-14T12:44:03.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zIGypEl3LNw4Iny7vCHhMhwoD6AS_PU_0 2024-09-14T12:44:03.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13606500252075717321', time=2024-09-14T14:00:49.296942+0000, chain.objs.size()=1 2024-09-14T12:44:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VClpdNnXacKROq9raW9RAFegbe_u9qp_0 2024-09-14T12:44:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.653908931547519980', time=2024-09-14T14:00:49.564766+0000, chain.objs.size()=1 2024-09-14T12:44:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ryTRgrrBd5q-f11w8ysVkoWplqsSPS8_0 2024-09-14T12:44:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9335512320066981850', time=2024-09-14T14:05:49.644170+0000, chain.objs.size()=1 2024-09-14T12:44:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.458__shadow_.ARe8RN91vNT5ZBWKYSMRDl620vUBDip_0 2024-09-14T12:44:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.878889602446878857', time=2024-09-14T14:06:46.733080+0000, chain.objs.size()=1 2024-09-14T12:44:03.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.UKJ099_XH9yIqLJ9dwrVNYvFn59pTtd_0 2024-09-14T12:44:03.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2835413488826552443', time=2024-09-14T14:07:25.210951+0000, chain.objs.size()=1 2024-09-14T12:44:03.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.498__shadow_.pLV7D0VYX7WE1RpDM9k6lqDO-xcJdur_0 2024-09-14T12:44:03.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45947 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12189893003198189114', time=2024-09-14T14:14:20.178538+0000, chain.objs.size()=5 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~Jw9A-PmWu4HxFYiwp0-vHQB-5_ZInsH.1 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__shadow_mymultipart.2~Jw9A-PmWu4HxFYiwp0-vHQB-5_ZInsH.1_1 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~Jw9A-PmWu4HxFYiwp0-vHQB-5_ZInsH.2 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__shadow_mymultipart.2~Jw9A-PmWu4HxFYiwp0-vHQB-5_ZInsH.2_1 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~Jw9A-PmWu4HxFYiwp0-vHQB-5_ZInsH.3 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15831830601314695746', time=2024-09-14T14:17:53.700184+0000, chain.objs.size()=2 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.555__shadow_.TX4DJ2izMWU5d7xIfWDV7-KiVeDzpHj_0 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.555__shadow_.TX4DJ2izMWU5d7xIfWDV7-KiVeDzpHj_1 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6438243102221103621', time=2024-09-14T14:19:11.032888+0000, chain.objs.size()=1 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.566__shadow_.u7M6n1e_6VGm9VBrBHG9uE4JVHOJ9bW_0 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17096143184744899542', time=2024-09-14T14:19:35.151409+0000, chain.objs.size()=1 2024-09-14T12:44:03.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:yGZtG2bqna5-8934gR41Sx.Jy09dJ09_.wVwv3ckEFcZmkJ4QI1cEBPf_Z7mNyZL_0 2024-09-14T12:44:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8997494309918756541', time=2024-09-14T14:20:46.685233+0000, chain.objs.size()=1 2024-09-14T12:44:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:dDcVUp-JNZCRhJ3Tik5e-klHDI6wCU5_.xOK8dGDjlcaSaZVdkeottXejF8oZwp7_0 2024-09-14T12:44:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2214410794769903562', time=2024-09-14T14:21:07.620286+0000, chain.objs.size()=1 2024-09-14T12:44:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:jdRP0l3CEgPryrzuAuf..J8Cod5IyxP_.6lI_jXbzTbz1fdCzpkOCZoRFi7aZKQD_0 2024-09-14T12:44:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6457738714782258140', time=2024-09-14T14:22:09.983538+0000, chain.objs.size()=1 2024-09-14T12:44:03.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:DThbJYuBU-.yZwruB092jb1xoAKoilk_.Jl7dSXweG55RFemQBRL9B6PXCUNAlnG_0 2024-09-14T12:44:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7331555976993843461', time=2024-09-14T14:27:12.273603+0000, chain.objs.size()=1 2024-09-14T12:44:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.618__shadow_.nF_AzFnkipIpaJxrAo-OkZIDSVhJ05f_0 2024-09-14T12:44:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14867846518900029594', time=2024-09-14T14:32:49.902800+0000, chain.objs.size()=1 2024-09-14T12:44:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.669__shadow_.6Iv7tST2a_bt7bEq9AC6GLMw2lHQpzc_0 2024-09-14T12:44:03.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2311747919268446220', time=2024-09-14T14:36:55.624093+0000, chain.objs.size()=1 2024-09-14T12:44:03.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.746__shadow_.O4ra5w4oNysbQc7dydN-ajXuG2T93VU_0 2024-09-14T12:44:03.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.741+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T12:44:03.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49289' 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16344250011649815343', time=2024-09-14T13:46:23.551972+0000, chain.objs.size()=1 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.205__shadow_.eNaGewDVS0nL6izUhM9raWuDvnYhYip_0 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4255083580160350424', time=2024-09-14T13:50:51.011374+0000, chain.objs.size()=1 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.250__shadow_.KhfOkB72u8sT4Jqc02P8mbWC7uz4SiF_0 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.808095403159008329', time=2024-09-14T13:51:18.355979+0000, chain.objs.size()=1 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.261__shadow_.kZDv3yl39uBB8qNOz_zGSvfst0a5_EO_0 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11883426355324949551', time=2024-09-14T13:53:05.736483+0000, chain.objs.size()=1 2024-09-14T12:44:03.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.deGiQd-4krLo0Cnzu8i5AWUrycdoAKk_0 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11719109202798344043', time=2024-09-14T13:53:09.870541+0000, chain.objs.size()=1 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QVdYqFANBE5tDUle3nSY1Zkqz7hcnek_0 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16101029612224305813', time=2024-09-14T13:53:10.699321+0000, chain.objs.size()=1 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eUah1VDuYfDAGzRJ7wbK0v-OFIZWEs9_0 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14778327116396067356', time=2024-09-14T13:53:10.856445+0000, chain.objs.size()=1 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oiLTXuTefMJaFD1W5NEqZOGcS4J5Zuz_0 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13230193833573487609', time=2024-09-14T13:53:11.144117+0000, chain.objs.size()=1 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-XcIbtZk1gV8QCyGug4DzM3PZnHIRwx_0 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15892394499288918092', time=2024-09-14T13:53:11.292151+0000, chain.objs.size()=1 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4rvWjxi2ZLgCqwTlZZ_nuE6LHcg8zSE_0 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14286981338462575215', time=2024-09-14T13:53:12.254495+0000, chain.objs.size()=1 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Ap69mGJ0HuYZrws6NzaqrndTWRfvsBY_0 2024-09-14T12:44:03.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3498281854542039352', time=2024-09-14T13:53:12.640888+0000, chain.objs.size()=1 2024-09-14T12:44:03.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.O763SWPovqRwxQXrxki_scf9_lwtnk8_0 2024-09-14T12:44:03.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15520493334366231102', time=2024-09-14T13:53:14.108111+0000, chain.objs.size()=1 2024-09-14T12:44:03.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ADsBDWyewI7vjS-uu10G87NJyW8uzt5_0 2024-09-14T12:44:03.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3434807953866270889', time=2024-09-14T13:53:14.109753+0000, chain.objs.size()=1 2024-09-14T12:44:03.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Hjjmmce9uZiLhJUnjbXESc5invRglbD_0 2024-09-14T12:44:03.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17046378177484282088', time=2024-09-14T13:53:15.120239+0000, chain.objs.size()=1 2024-09-14T12:44:03.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.B6HpS184nzVtVI1KEohbc4pa_MaVMhe_0 2024-09-14T12:44:03.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3048102026047216572', time=2024-09-14T13:53:16.657787+0000, chain.objs.size()=1 2024-09-14T12:44:03.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.txj1llHW7TA_jJ1e4KNlAjbHhKKkJoN_0 2024-09-14T12:44:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2353559085218269849', time=2024-09-14T13:53:16.659498+0000, chain.objs.size()=1 2024-09-14T12:44:03.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.i4-lqRDKjExwPMXOPaMi6vuk_Q3RSU1_0 2024-09-14T12:44:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13982572771271090827', time=2024-09-14T13:53:18.040797+0000, chain.objs.size()=1 2024-09-14T12:44:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qWi7MzK_LXo66waJ25JrBKaByTIMNGW_0 2024-09-14T12:44:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7538314704965786625', time=2024-09-14T13:53:18.947331+0000, chain.objs.size()=1 2024-09-14T12:44:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TRFSIvqbopy-XgU6G6B0MZGH0XN27Vy_0 2024-09-14T12:44:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13339755108328867588', time=2024-09-14T13:53:19.771321+0000, chain.objs.size()=1 2024-09-14T12:44:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1oJpPS9-jDnp_JN-5FpJ_XAOUk-xEvi_0 2024-09-14T12:44:03.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14287068634355989665', time=2024-09-14T13:53:20.329145+0000, chain.objs.size()=1 2024-09-14T12:44:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aeKyrBeXy_V425QNi6aVeLGlu8fWWBo_0 2024-09-14T12:44:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18255665586586454155', time=2024-09-14T13:53:21.547210+0000, chain.objs.size()=1 2024-09-14T12:44:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._IyV-nvpG0xuq0dE43H4tBLuy0rbA2D_0 2024-09-14T12:44:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6577626655639113770', time=2024-09-14T13:53:21.548785+0000, chain.objs.size()=1 2024-09-14T12:44:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.mojW9MZ3FgFdyhyVFuHirkmkdTnO2w9_0 2024-09-14T12:44:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17781757329794842287', time=2024-09-14T13:53:22.182543+0000, chain.objs.size()=1 2024-09-14T12:44:03.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qoTYEo4Bzpm1pAfwl1XSZ5ZtKmp58rm_0 2024-09-14T12:44:03.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15553518912752259511', time=2024-09-14T13:53:23.986557+0000, chain.objs.size()=1 2024-09-14T12:44:03.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WzV9GqsXb0jeg-VRQjnFbsHpeozYi8k_0 2024-09-14T12:44:03.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15057124127175895679', time=2024-09-14T13:53:25.690093+0000, chain.objs.size()=1 2024-09-14T12:44:03.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.tQULlpRnxD5C1bHXEr9agdsvN2JmuhW_0 2024-09-14T12:44:03.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5699412862994859425', time=2024-09-14T13:53:25.706986+0000, chain.objs.size()=1 2024-09-14T12:44:03.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QvENRhDKJ3i_z1gTYZ8ntHNJuhJKlHm_0 2024-09-14T12:44:03.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4332271558317329826', time=2024-09-14T13:53:26.851912+0000, chain.objs.size()=1 2024-09-14T12:44:03.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QigF3BMD8PhfHmpBPyDyeIbh4sbH2Nt_0 2024-09-14T12:44:03.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4697590696628715222', time=2024-09-14T13:53:27.071725+0000, chain.objs.size()=1 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lAiW-4CeS_s7dA-9N0JnxZxVI8lCooT_0 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12333888487786839158', time=2024-09-14T13:53:29.263838+0000, chain.objs.size()=1 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Jv6myM8EjsEvkAZT3dTmB7I0_M0WmiI_0 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12841914030589834645', time=2024-09-14T13:53:30.009083+0000, chain.objs.size()=1 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.G9kA4eTo4Uxhmu0C0Mml9bYIyYHG2pD_0 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1456698666399482258', time=2024-09-14T13:53:31.031015+0000, chain.objs.size()=1 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ZTSnBy8T98uBIvkXnbH9HFfowQTawm1_0 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16048603379452153639', time=2024-09-14T13:53:31.849329+0000, chain.objs.size()=1 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2jfSLg4TAqslQOYBSGDxWTpbS7Xw4LD_0 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1095491287075728981', time=2024-09-14T13:53:33.527970+0000, chain.objs.size()=1 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.k9numEk01-Nmzt5TR4nXMGu63IHhSEW_0 2024-09-14T12:44:03.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7260750445346082452', time=2024-09-14T13:53:34.482636+0000, chain.objs.size()=1 2024-09-14T12:44:03.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.SMX1azW3sbL_HoakPQGQUT8Lwp3em26_0 2024-09-14T12:44:03.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7677178915464211454', time=2024-09-14T13:54:36.583385+0000, chain.objs.size()=1 2024-09-14T12:44:03.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.288__shadow_.YSc2zMAZIG2XJmb_OheuUEIIQHhMOrx_0 2024-09-14T12:44:03.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11337113291085619943', time=2024-09-14T13:54:41.641314+0000, chain.objs.size()=1 2024-09-14T12:44:03.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.290__shadow_.5wNz2jo3TQDdlPbbtBuVWJdEHm5lQW9_0 2024-09-14T12:44:03.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1135780403489403018', time=2024-09-14T13:55:24.481835+0000, chain.objs.size()=1 2024-09-14T12:44:03.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.304__shadow_.C-_nStwew8DmM6LMBMHaw3QFRH-xVQb_0 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11049803732392108985', time=2024-09-14T13:55:36.140884+0000, chain.objs.size()=1 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.308__shadow:3eob-3FOB-3iCHrJ.s80xWmbLOSR6vv_.YNdARngXyNMZDqlox5v84Es0SakTzZb_0 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.627416481187495162', time=2024-09-14T13:55:49.612981+0000, chain.objs.size()=1 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.314__shadow_.AQyXSqXkTSksLjmn22H9kAr78gRGASi_0 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15305790411655512183', time=2024-09-14T13:58:05.678590+0000, chain.objs.size()=1 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jpkLX01jV8U3WfJI3xQNzCXxDFzOsvx_0 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9946263461145516467', time=2024-09-14T13:58:07.796926+0000, chain.objs.size()=1 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QqefBfrI4aUUIi-VIbYMl63JV8mRNxi_0 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14582875738525018600', time=2024-09-14T13:58:09.504255+0000, chain.objs.size()=1 2024-09-14T12:44:03.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LvTnTlA7uizbi8Mv4yqZpaOdwavq74-_0 2024-09-14T12:44:03.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6257721484657789510', time=2024-09-14T13:58:10.231320+0000, chain.objs.size()=1 2024-09-14T12:44:03.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hJaLN4rbqPnX_l4rZ3aWWA0aHq6qWJ6_0 2024-09-14T12:44:03.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3725235178555133064', time=2024-09-14T13:58:11.674770+0000, chain.objs.size()=1 2024-09-14T12:44:03.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.36AfUy5Y5ZQjnHdYBjcWe2Lwa65RmZ7_0 2024-09-14T12:44:03.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12360217219154811809', time=2024-09-14T13:58:16.274031+0000, chain.objs.size()=1 2024-09-14T12:44:03.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8E1liSwfcI1odCm_Cl5saU5UuQkyw7s_0 2024-09-14T12:44:03.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3593968693662348364', time=2024-09-14T13:58:16.397967+0000, chain.objs.size()=1 2024-09-14T12:44:03.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ReJnEm2FfIn8Sbd1vGsJ_Pn3f8t2JQ8_0 2024-09-14T12:44:03.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18156221766290901308', time=2024-09-14T13:58:17.375220+0000, chain.objs.size()=1 2024-09-14T12:44:03.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.13MOc4WqIVTrRlIY7ZCwaGct7QWtCNk_0 2024-09-14T12:44:03.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4853083851398406346', time=2024-09-14T13:58:17.378798+0000, chain.objs.size()=1 2024-09-14T12:44:03.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Dqq35XLnfsHmUXjWfUvmBNlLN3Nq5_j_0 2024-09-14T12:44:03.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5558813265970249466', time=2024-09-14T13:58:17.552672+0000, chain.objs.size()=1 2024-09-14T12:44:03.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KB0NVSU6a9G3kU5WCoF_zq0N53ks6uO_0 2024-09-14T12:44:03.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9862641771348487850', time=2024-09-14T13:58:17.811298+0000, chain.objs.size()=1 2024-09-14T12:44:03.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.y4wDzt5h-7y2cNFOmA11UKUjwqjDipN_0 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15524355701978705459', time=2024-09-14T13:58:17.835479+0000, chain.objs.size()=1 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7m2C9Tokihu9t-KPVLWmfm7nN3dSezg_0 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18055609763731344662', time=2024-09-14T13:58:17.837353+0000, chain.objs.size()=1 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oT5QGRmj44Xo2RBof48i3mIyB9n6W07_0 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15382995735173667272', time=2024-09-14T13:58:18.135882+0000, chain.objs.size()=1 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nO3Sq-vfswAbQikFF-GjlqeW1V-xZBR_0 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10140129517674568892', time=2024-09-14T13:58:18.255109+0000, chain.objs.size()=1 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.5MDTPJ2SoFsX3zIevj5XkyrCusfyqd1_0 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9906735208437391654', time=2024-09-14T13:58:18.256931+0000, chain.objs.size()=1 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QhDvhHb6lxy90zSd27Ar7cnpsSnwMiW_0 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2645163002715414256', time=2024-09-14T13:58:18.674086+0000, chain.objs.size()=1 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.RlvulpibudwDj01GIEUPsfZt3YfzMfz_0 2024-09-14T12:44:03.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1750083364287387309', time=2024-09-14T13:58:22.552501+0000, chain.objs.size()=1 2024-09-14T12:44:03.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.UVkzu69pVFiD32IdEcRLd7tegIeHYVi_0 2024-09-14T12:44:03.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18024308172939080053', time=2024-09-14T13:58:22.757892+0000, chain.objs.size()=1 2024-09-14T12:44:03.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.sU8oJoZ4ACVt8OXhljsWIMSaZoxkU_f_0 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2670113333000038938', time=2024-09-14T13:58:25.513477+0000, chain.objs.size()=1 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lzNqn_0ia7TWvOyPzMTpxtRs7vgNjkq_0 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15437581137916415496', time=2024-09-14T13:58:26.577542+0000, chain.objs.size()=1 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.SpEYf0reektP4KRr53ldQ87jaHd_vpO_0 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11270335037905136873', time=2024-09-14T13:58:26.698275+0000, chain.objs.size()=1 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BBWrbD9-ku72lQf9IoB9aRnAkiI64_r_0 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14820945978741336039', time=2024-09-14T13:58:26.928207+0000, chain.objs.size()=1 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wRxAyvr3unGfSL5ft-e3xYtMiYqanZ0_0 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.621513275174402767', time=2024-09-14T13:58:27.145711+0000, chain.objs.size()=1 2024-09-14T12:44:03.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3hzIz5eaaCO3zGFztDzpOORcGqy-jtn_0 2024-09-14T12:44:03.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.573057888852607792', time=2024-09-14T13:58:27.281120+0000, chain.objs.size()=1 2024-09-14T12:44:03.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.r8yNDhV7339HAZKwVMygg-xBHR9WQ69_0 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1217724547537447607', time=2024-09-14T13:58:29.412322+0000, chain.objs.size()=1 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rPXxpHQbj419DX-_54bqF-JN-1Vd8N6_0 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.35480070471454178', time=2024-09-14T13:58:29.588867+0000, chain.objs.size()=1 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KI8IeMmVhSl98uzdPZ3mllAVMSe6aiQ_0 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8701839673986906506', time=2024-09-14T13:58:29.633397+0000, chain.objs.size()=1 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.slQKR4Ki75o4k_9VZ9n3tBqhCgQ3GOb_0 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12879185114291691206', time=2024-09-14T13:58:30.501602+0000, chain.objs.size()=1 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CMGObLD5owRcihCoEEXsgrbTzEoWwCN_0 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5296242929676814672', time=2024-09-14T13:58:32.537412+0000, chain.objs.size()=1 2024-09-14T12:44:03.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.OWJ1ul2aGP_6YRVXk9QWlP94DX-V3SN_0 2024-09-14T12:44:03.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13280414299910214539', time=2024-09-14T14:00:21.677709+0000, chain.objs.size()=1 2024-09-14T12:44:03.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8YPYtRPglhuUmiojk781cJdB5WySSHU_0 2024-09-14T12:44:03.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12753888034260979885', time=2024-09-14T14:00:25.979198+0000, chain.objs.size()=1 2024-09-14T12:44:03.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iEZPfBgmnDz3h6ZOhTFTFK-SW1O4LAE_0 2024-09-14T12:44:03.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10266506270738080005', time=2024-09-14T14:00:26.513326+0000, chain.objs.size()=1 2024-09-14T12:44:03.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Srbc0L4nzHdY-AQwMQRH0Zn7PpI8oc3_0 2024-09-14T12:44:03.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4703275145360645513', time=2024-09-14T14:00:30.149620+0000, chain.objs.size()=1 2024-09-14T12:44:03.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.7f2Vt43Pe7n3mkSKOHOQXUb3q8i3U63_0 2024-09-14T12:44:03.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4548889211759565264', time=2024-09-14T14:00:30.296957+0000, chain.objs.size()=1 2024-09-14T12:44:03.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5GpEY-uHl1T0tb-NQfKFie3UKtuZS9X_0 2024-09-14T12:44:03.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16610837563223405318', time=2024-09-14T14:00:30.665000+0000, chain.objs.size()=1 2024-09-14T12:44:03.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5MbvxV5wehkaARqMjQaQC4zg_YfviW2_0 2024-09-14T12:44:03.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8462458979601574018', time=2024-09-14T14:00:31.032494+0000, chain.objs.size()=1 2024-09-14T12:44:03.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.L6SFxeqrRxpa05bQlSoHJQg6FRG4IhX_0 2024-09-14T12:44:03.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8577323575445988113', time=2024-09-14T14:00:33.854321+0000, chain.objs.size()=1 2024-09-14T12:44:03.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lv9qh9Vu1hgkupEMT2nCV2l0sgOTMKt_0 2024-09-14T12:44:03.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15399117665325465726', time=2024-09-14T14:00:37.773355+0000, chain.objs.size()=1 2024-09-14T12:44:03.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xLybMohnxYd-8PjZWyJbT2L1YRFvlJt_0 2024-09-14T12:44:03.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11481752388002569058', time=2024-09-14T14:00:37.872853+0000, chain.objs.size()=1 2024-09-14T12:44:03.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WeDAK-AkGf-QepNaz-gXRFugnHL1Dpq_0 2024-09-14T12:44:03.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12989039731166466432', time=2024-09-14T14:00:38.081010+0000, chain.objs.size()=1 2024-09-14T12:44:03.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IHkiE4CYZ9yinQnAbAoBo24_4RO9XBo_0 2024-09-14T12:44:03.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.212806999788169774', time=2024-09-14T14:00:38.536816+0000, chain.objs.size()=1 2024-09-14T12:44:03.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Tf7k7jijAoyFUZLW17NP7mrMpi6Wfqq_0 2024-09-14T12:44:03.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2672126206649758010', time=2024-09-14T14:00:39.100769+0000, chain.objs.size()=1 2024-09-14T12:44:03.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.o00YLk1QOo45ZLQmifTvz-MU8mTwKeJ_0 2024-09-14T12:44:03.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4571856656090779760', time=2024-09-14T14:00:40.730902+0000, chain.objs.size()=1 2024-09-14T12:44:03.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.liM3gI9U-HoE5g-hARl7KLsVKLOhg5q_0 2024-09-14T12:44:03.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17103777282565728938', time=2024-09-14T14:00:41.846005+0000, chain.objs.size()=1 2024-09-14T12:44:03.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9dPrBtAtRbQOXsBteFbvIuTes6cHwtw_0 2024-09-14T12:44:03.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8197049203176511393', time=2024-09-14T14:00:43.250139+0000, chain.objs.size()=1 2024-09-14T12:44:03.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TPTm95ibvqEEtNjXOlFDQMVf84GorTe_0 2024-09-14T12:44:03.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16984333367492571012', time=2024-09-14T14:00:46.202187+0000, chain.objs.size()=1 2024-09-14T12:44:03.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-IcOFH58n2zHSWmHT0qGRGcl7RGNKGj_0 2024-09-14T12:44:03.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11989633011032494746', time=2024-09-14T14:00:46.209481+0000, chain.objs.size()=1 2024-09-14T12:44:03.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.C4BGnKBFGiI-De4WIgO7-q69Ycc819p_0 2024-09-14T12:44:03.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10586261885492839633', time=2024-09-14T14:00:46.217504+0000, chain.objs.size()=1 2024-09-14T12:44:03.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LaITypnLH_rGVwpmJgt12bXqrZSzDq6_0 2024-09-14T12:44:03.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2700228309531911649', time=2024-09-14T14:00:47.035091+0000, chain.objs.size()=1 2024-09-14T12:44:03.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ra61n7G8N_Mdg6NOpHkLCsRkwcONmQR_0 2024-09-14T12:44:03.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9926549802125849787', time=2024-09-14T14:00:47.991139+0000, chain.objs.size()=1 2024-09-14T12:44:03.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-ye56E7zb_yfS-OMbdqgNH3ZgVcm7fO_0 2024-09-14T12:44:03.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.82718695921498041', time=2024-09-14T14:00:48.950377+0000, chain.objs.size()=1 2024-09-14T12:44:03.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.E-6ROcUTIn_HU5OsOuNBJKOrGuWbj-s_0 2024-09-14T12:44:03.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1608107983982481588', time=2024-09-14T14:00:54.452390+0000, chain.objs.size()=1 2024-09-14T12:44:03.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.789+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.327__shadow_.96QsLRSNS2JqQ3JjhJc9RQd_PXjhlMV_0 2024-09-14T12:44:03.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6420539391955555833', time=2024-09-14T14:01:24.643997+0000, chain.objs.size()=1 2024-09-14T12:44:03.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.341__shadow_.OzNfrxFc36YOoy10kFPjVwcclyK2ZEC_0 2024-09-14T12:44:03.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.690077174981656173', time=2024-09-14T14:05:11.973115+0000, chain.objs.size()=1 2024-09-14T12:44:03.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.444__shadow_.a_VYMfMe0EHBhHse5ys8lQBmaSJNHk9_0 2024-09-14T12:44:03.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7692589836133493885', time=2024-09-14T14:06:15.072641+0000, chain.objs.size()=1 2024-09-14T12:44:03.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.466__shadow_.-vBLn-J5bqgf_nMDQGKHRaX1izwdKSP_0 2024-09-14T12:44:03.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~aGAJA-12jScjxE_3Dq4IMiCunPKw4Nr', time=2024-09-14T14:11:27.990146+0000, chain.objs.size()=1 2024-09-14T12:44:03.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~aGAJA-12jScjxE_3Dq4IMiCunPKw4Nr.2 2024-09-14T12:44:03.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15852095931725750402', time=2024-09-14T14:15:01.823032+0000, chain.objs.size()=2 2024-09-14T12:44:03.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~TZnbMVb5fjO_QYYVloArT7g9EinsYMe.1 2024-09-14T12:44:03.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~TZnbMVb5fjO_QYYVloArT7g9EinsYMe.2 2024-09-14T12:44:03.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~waR6N_JlscNcbSDjJyA1XI3vZkntjqE', time=2024-09-14T14:15:36.549471+0000, chain.objs.size()=4 2024-09-14T12:44:03.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.530__multipart_mymultipart.2~waR6N_JlscNcbSDjJyA1XI3vZkntjqE.1 2024-09-14T12:44:03.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.530__shadow_mymultipart.2~waR6N_JlscNcbSDjJyA1XI3vZkntjqE.1_1 2024-09-14T12:44:03.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.530__multipart_mymultipart.2~waR6N_JlscNcbSDjJyA1XI3vZkntjqE.2 2024-09-14T12:44:03.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.530__shadow_mymultipart.2~waR6N_JlscNcbSDjJyA1XI3vZkntjqE.2_1 2024-09-14T12:44:03.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8BluIcK468IZohIHfCU_qXJNrpBAB7b', time=2024-09-14T14:15:56.612659+0000, chain.objs.size()=1 2024-09-14T12:44:03.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.535__multipart_mymultipart.2~8BluIcK468IZohIHfCU_qXJNrpBAB7b.1 2024-09-14T12:44:03.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10039828997170733984', time=2024-09-14T14:16:34.947405+0000, chain.objs.size()=1 2024-09-14T12:44:03.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.538__shadow_.X_Lw9t3N1dS420XUAgIoX7TI6JYa4mt_0 2024-09-14T12:44:03.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49289 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5912391813144300909', time=2024-09-14T14:18:39.299869+0000, chain.objs.size()=1 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.559__shadow_.F8DnZQc34H7zxDFnsJt5TWlM98Ql6O2_0 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7725821660463045220', time=2024-09-14T14:18:49.765207+0000, chain.objs.size()=1 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.562__multipart_mymultipart.uXO0TaSjVejvtWYy-w6yfZz_vGmlmDgE.1 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14130216947177124922', time=2024-09-14T14:20:00.260875+0000, chain.objs.size()=1 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow_.tI3hm3fhltDVyta5dX5sdaDdkYebQe8_0 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1336205731714973856', time=2024-09-14T14:20:50.954675+0000, chain.objs.size()=1 2024-09-14T12:44:03.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:g.T6qirDK5Gq4r5vlSKWsNDV3WZgVlr_.pkMl_jLqoaJEuZvugw_sFEEHOdKYXLL_0 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16205120123132830813', time=2024-09-14T14:22:15.752770+0000, chain.objs.size()=1 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:XuCf79op1d7ztspnFm-wKHQcryzZh-N_.53Om-h89BFBLC9ZUzdyGNRZ5snHKOsE_0 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10564496723585305317', time=2024-09-14T14:24:38.333649+0000, chain.objs.size()=12 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__multipart_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.1 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__shadow_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.1_1 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__multipart_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.2 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__shadow_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.2_1 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__multipart_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.3 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__shadow_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.3_1 2024-09-14T12:44:03.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__multipart_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.4 2024-09-14T12:44:03.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__shadow_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.4_1 2024-09-14T12:44:03.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__multipart_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.5 2024-09-14T12:44:03.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__shadow_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.5_1 2024-09-14T12:44:03.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__multipart_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.6 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.614__shadow_multipart_enc.2~8KmkkpV3THAaGvz0Z59-M-n1KRusrXb.6_1 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.383464709680157457', time=2024-09-14T14:30:16.546002+0000, chain.objs.size()=1 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.637__shadow_.QmFP5ZKYnz-sSgqau0lKfxD8Dfvu0Y4_0 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16644623614469900505', time=2024-09-14T14:30:21.881794+0000, chain.objs.size()=1 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.639__shadow_.sD6BBkK4jR0B87m8fwzFguDN5Pox9pu_0 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18393621730813278422', time=2024-09-14T14:30:59.283755+0000, chain.objs.size()=1 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.648__shadow_.E5uPDtOEr0ZNeb-xqz7gyTvF5YZwgPZ_0 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.90849738232187967', time=2024-09-14T14:32:39.543344+0000, chain.objs.size()=1 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.665__shadow_.KNEkfvtTir9eLilRnDBNMm_MBYFJny4_0 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13859992030203540018', time=2024-09-14T14:32:46.829072+0000, chain.objs.size()=1 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.667__shadow_.rYwdt9U-qISiXElIx-7rD2fRX1c77DX_0 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17681137024998534343', time=2024-09-14T14:40:07.934535+0000, chain.objs.size()=1 2024-09-14T12:44:03.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.771__shadow_.1ll7RfXAhY2JOMsDdMYu26UqfMFMsJR_0 2024-09-14T12:44:03.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T12:44:03.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52536' 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9886484154609331736', time=2024-09-14T13:43:50.845029+0000, chain.objs.size()=5 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-LUKEWARM.2~hvAUL1P88D4v3n6FQ7FhvxeERmiNI6k.1 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_foo-LUKEWARM.2~hvAUL1P88D4v3n6FQ7FhvxeERmiNI6k.1_1 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-LUKEWARM.2~hvAUL1P88D4v3n6FQ7FhvxeERmiNI6k.2 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_foo-LUKEWARM.2~hvAUL1P88D4v3n6FQ7FhvxeERmiNI6k.2_1 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-LUKEWARM.2~hvAUL1P88D4v3n6FQ7FhvxeERmiNI6k.3 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_r0hRHaIyAjmTOBKDnidl5ukg3vjjOxb', time=2024-09-14T13:44:18.227281+0000, chain.objs.size()=3 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.164__shadow_.htLEgxbY14rCqwEzzJkep7MoLFRRSDU_0 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.164__shadow_.htLEgxbY14rCqwEzzJkep7MoLFRRSDU_1 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.164__shadow_.htLEgxbY14rCqwEzzJkep7MoLFRRSDU_2 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4588996731239915909', time=2024-09-14T13:44:31.950189+0000, chain.objs.size()=1 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.167__shadow_.jcKLq751A4waP9IaIFdwTOKZPELfgAR_0 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7777515054410559820', time=2024-09-14T13:45:05.220462+0000, chain.objs.size()=1 2024-09-14T12:44:03.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.182__shadow_.BzvVl9kwQXG2yNpTPUB8c0K-VTB3vFB_0 2024-09-14T12:44:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8837557895106505501', time=2024-09-14T13:50:10.336471+0000, chain.objs.size()=1 2024-09-14T12:44:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.236__shadow_.XrYyCvEBz4S7gwxxFwTEfjrUVqM6NcJ_0 2024-09-14T12:44:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14307620168594950602', time=2024-09-14T13:51:01.107065+0000, chain.objs.size()=1 2024-09-14T12:44:03.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.254__shadow_.Em8jGoSQGCGj8uqDMMpHeCj_cLl6y60_0 2024-09-14T12:44:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18180793548080640256', time=2024-09-14T13:51:11.051492+0000, chain.objs.size()=1 2024-09-14T12:44:03.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.258__shadow_.uFyDkE4t4a68QdU2fTTStfuRX4CNEIC_0 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2943788507954132981', time=2024-09-14T13:53:05.324697+0000, chain.objs.size()=1 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PxSYcg7DQW--EB8VZjuyVS-iOzt7uRy_0 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.971957427324574123', time=2024-09-14T13:53:05.713264+0000, chain.objs.size()=1 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2XRnn16vGNqBbAX3s3dMFCDuAp9DzMk_0 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5612596149941161625', time=2024-09-14T13:53:05.868372+0000, chain.objs.size()=1 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-vaOW-3D8fe2ftYa5DqeAIBF5i1um87_0 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1506404372582590570', time=2024-09-14T13:53:06.083386+0000, chain.objs.size()=1 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.54jyTFOMk8A6vKdZRE6ycWR-7kdz-as_0 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4393214485826539378', time=2024-09-14T13:53:06.525058+0000, chain.objs.size()=1 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5-BBCpCI0GTXMDefy-QBtqhbNX2zYKh_0 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3192121472445921190', time=2024-09-14T13:53:06.939663+0000, chain.objs.size()=1 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0YwOwmgC8N_3JzR6Tn4pLzmaAVx7y8B_0 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4069975253819216903', time=2024-09-14T13:53:07.037773+0000, chain.objs.size()=1 2024-09-14T12:44:03.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.M15vRE6cSeKvj83o90j4uFQtcVwe4Hy_0 2024-09-14T12:44:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4894052428365458189', time=2024-09-14T13:53:07.356088+0000, chain.objs.size()=1 2024-09-14T12:44:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8EPy54y5rdQiIpZPVrPM1_n7LevPNZC_0 2024-09-14T12:44:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7445725360369056995', time=2024-09-14T13:53:07.526518+0000, chain.objs.size()=1 2024-09-14T12:44:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.IwLQ2wc9BjzQMnFvsJBViPADnP3zE2b_0 2024-09-14T12:44:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6185541535540020847', time=2024-09-14T13:53:07.528584+0000, chain.objs.size()=1 2024-09-14T12:44:03.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cImXOalixfJis92mkUP1uzuamWyMtxv_0 2024-09-14T12:44:03.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5568293990840729392', time=2024-09-14T13:53:09.784009+0000, chain.objs.size()=1 2024-09-14T12:44:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BHo1X7O6o2K1kH5NDaETxqVpelFMNqi_0 2024-09-14T12:44:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11950547856387871941', time=2024-09-14T13:53:10.079893+0000, chain.objs.size()=1 2024-09-14T12:44:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5r1Ls3H2zcF8A0wXG03htUhTJeCaWGD_0 2024-09-14T12:44:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4028485319577171632', time=2024-09-14T13:53:10.084593+0000, chain.objs.size()=1 2024-09-14T12:44:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.44XeEG5wT73yyMM5DtRXYFSO8I5AI4B_0 2024-09-14T12:44:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6659708250453669430', time=2024-09-14T13:53:10.353317+0000, chain.objs.size()=1 2024-09-14T12:44:03.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OwlhdeRSqTXIPS3wldV0WVfRAyvisLN_0 2024-09-14T12:44:03.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1155082418884702781', time=2024-09-14T13:53:11.636864+0000, chain.objs.size()=1 2024-09-14T12:44:03.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JXzpNo3xeqWbXFxPA1ZDVTOeC62FnKa_0 2024-09-14T12:44:03.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5945403160044827287', time=2024-09-14T13:53:12.402542+0000, chain.objs.size()=1 2024-09-14T12:44:03.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kyVUFH2eLM_J9Hyv6JekmrEbfJJ8Ku1_0 2024-09-14T12:44:03.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7863356218138405180', time=2024-09-14T13:53:12.647711+0000, chain.objs.size()=1 2024-09-14T12:44:03.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1Y8d5Jf5PC3IZcLcE2Sta-HdzV_pkna_0 2024-09-14T12:44:03.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9875866276708910214', time=2024-09-14T13:53:13.999533+0000, chain.objs.size()=1 2024-09-14T12:44:03.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.y5dI8VClFNNY2NlVeGGZ_onUTvEmhKW_0 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8459209296015891432', time=2024-09-14T13:53:14.102885+0000, chain.objs.size()=1 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4B6cUBj8Dy8PJLpnWxvcxfi_U97jAYq_0 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4740935255212097995', time=2024-09-14T13:53:14.584688+0000, chain.objs.size()=1 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.A6HKmRw4-Q85McJ5ueDpxVpKEzUfhYY_0 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13642206014107279534', time=2024-09-14T13:53:15.456024+0000, chain.objs.size()=1 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.z1DmKMZo2IXjcMzFF8x9S88AEmkLh-o_0 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14006456433785642279', time=2024-09-14T13:53:16.736452+0000, chain.objs.size()=1 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PWo6Fx-TbW2XQHCXgc_c32tTKvTrlgA_0 2024-09-14T12:44:03.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17178895641521019196', time=2024-09-14T13:53:18.561484+0000, chain.objs.size()=1 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2EvBNqXbKPhyQDQ9TQIo85AvI8yzzvk_0 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1209316398210803920', time=2024-09-14T13:53:19.389002+0000, chain.objs.size()=1 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.INqAj2-xjuauAkMernpWkn0PqmjTlwa_0 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15388144238660026906', time=2024-09-14T13:53:20.237825+0000, chain.objs.size()=1 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Qpt08f0hh9mFsjN7Mv5oyAv2EZ4pCHh_0 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12300263297209276389', time=2024-09-14T13:53:20.556557+0000, chain.objs.size()=1 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.p31Fwu_vqBwI3wt1IJ3pwhrzoxNmJsv_0 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11042496383207721704', time=2024-09-14T13:53:22.468699+0000, chain.objs.size()=1 2024-09-14T12:44:03.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._BzVbOC1kat_B-TDkhcjWHiCOZkkc0w_0 2024-09-14T12:44:03.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14275362351685909647', time=2024-09-14T13:53:22.915330+0000, chain.objs.size()=1 2024-09-14T12:44:03.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Lc2NPQPJIj_JZCvY4jKy1Y4qNvAECM-_0 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12640827358124707509', time=2024-09-14T13:53:25.833912+0000, chain.objs.size()=1 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ZRayHGTso2Z29-xfhkukrhVEQZZwiSk_0 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3258579355066307555', time=2024-09-14T13:53:26.229848+0000, chain.objs.size()=1 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2kUyYTVuO45nnDzdfLa-txlfs47nIGa_0 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17357955236480829165', time=2024-09-14T13:53:27.242087+0000, chain.objs.size()=1 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BTBwR9Jho6LJDex7vqpb9CKTmm7HeKR_0 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2519590563734101110', time=2024-09-14T13:53:28.055448+0000, chain.objs.size()=1 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3TZ-F1xfFDXj8vCJf4GqiCYUyWrfh8-_0 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4979257867534151541', time=2024-09-14T13:53:33.464096+0000, chain.objs.size()=1 2024-09-14T12:44:03.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.837+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.U-uCFAgSAuCXDqJqepcDf0lZAQ52YFq_0 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13268465165003906563', time=2024-09-14T13:53:34.062429+0000, chain.objs.size()=1 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RbGb_jtK8TLHJ1i1cjPGZVdcV4Kgbj6_0 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15993427957402411412', time=2024-09-14T13:53:42.482185+0000, chain.objs.size()=1 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.266__shadow_.bGJPgk-phBNph_VtUmAFJq-jpouBVRo_0 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13478571893427288365', time=2024-09-14T13:54:08.839527+0000, chain.objs.size()=1 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.277__shadow_.FNXg_BQ_VSPy8pgSLPAatfXsraB65fm_0 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15959432537746734637', time=2024-09-14T13:54:21.260075+0000, chain.objs.size()=1 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.282__shadow_.xvymX3CGTk3wbbuFnnilmD2OWhCmrG0_0 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13809146999867515320', time=2024-09-14T13:54:26.352251+0000, chain.objs.size()=1 2024-09-14T12:44:03.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.284__shadow_.QvBjkwUhdw3tQDhfxbsvo32jzpohOI9_0 2024-09-14T12:44:03.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13106751796646702125', time=2024-09-14T13:54:52.873306+0000, chain.objs.size()=1 2024-09-14T12:44:03.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.RNx2Aw0VV79Gf-M9qfrviDMHDnB8aXW_0 2024-09-14T12:44:03.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12644258108211118402', time=2024-09-14T13:55:16.915669+0000, chain.objs.size()=1 2024-09-14T12:44:03.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.301__shadow_.X1yPbs616SYJlvPSGOI4WB5TUB11il7_0 2024-09-14T12:44:03.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10574564315232114242', time=2024-09-14T13:55:21.958395+0000, chain.objs.size()=1 2024-09-14T12:44:03.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.303__shadow_.4DhRkUBkOpNvj_wgbE_j8yxHCqoO2mC_0 2024-09-14T12:44:03.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13026518892629732328', time=2024-09-14T13:58:06.086337+0000, chain.objs.size()=1 2024-09-14T12:44:03.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gKuHv53B4nH2fx6my7DKqVg29B71q34_0 2024-09-14T12:44:03.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9676845506122204885', time=2024-09-14T13:58:07.079095+0000, chain.objs.size()=1 2024-09-14T12:44:03.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.K2Oo_NMWco5KO5lXtwBFLLvxphH7Sqy_0 2024-09-14T12:44:03.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1051611850554483886', time=2024-09-14T13:58:07.554975+0000, chain.objs.size()=1 2024-09-14T12:44:03.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.G6ZNhkx2JGMl67Wf06vLyH6w2LIdNuK_0 2024-09-14T12:44:03.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.842062941816286999', time=2024-09-14T13:58:08.364570+0000, chain.objs.size()=1 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WpLjYU4r2r7tWiSSh59dMFPyUtXsvKa_0 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.641850753010693217', time=2024-09-14T13:58:10.009121+0000, chain.objs.size()=1 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mu8wRwli29_NUHENmZA1Ty_Dl-4HH7M_0 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16108581209520215502', time=2024-09-14T13:58:11.007031+0000, chain.objs.size()=1 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-rIQNmTIIVkeRTq0Bfuu0r9dAhCrQnS_0 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.862149138477071466', time=2024-09-14T13:58:15.381781+0000, chain.objs.size()=1 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6yFNEs5h_ZpSX0V8LUHRM6dP0zPsSLL_0 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18088896836805050328', time=2024-09-14T13:58:16.089477+0000, chain.objs.size()=1 2024-09-14T12:44:03.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xaszad5z9Qd3NSyQ1nZm8bkmxyCe3hB_0 2024-09-14T12:44:03.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9231979764136187110', time=2024-09-14T13:58:17.374241+0000, chain.objs.size()=1 2024-09-14T12:44:03.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HolCIjXUycmoBxTACwXKgpUXYM2MhqN_0 2024-09-14T12:44:03.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16359986871347852302', time=2024-09-14T13:58:18.102618+0000, chain.objs.size()=1 2024-09-14T12:44:03.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YJwPDUVXgh4mGjrk3bY7PtGeP8T0zCE_0 2024-09-14T12:44:03.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6594303373205474309', time=2024-09-14T13:58:19.921784+0000, chain.objs.size()=1 2024-09-14T12:44:03.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.n6qrqfgIGDbVpiWmahU6h8CJkoXBnvF_0 2024-09-14T12:44:03.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5490912651742945064', time=2024-09-14T13:58:22.067504+0000, chain.objs.size()=1 2024-09-14T12:44:03.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xpwuK3MKSFxcgmZqKsHb9osEFHZ-PBd_0 2024-09-14T12:44:03.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14040028289041954340', time=2024-09-14T13:58:23.527226+0000, chain.objs.size()=1 2024-09-14T12:44:03.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oolBgYzRf9fqS4dsdxBOrbZrmKYgQjX_0 2024-09-14T12:44:03.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13770542722114346893', time=2024-09-14T13:58:23.788609+0000, chain.objs.size()=1 2024-09-14T12:44:03.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qS9mgyCmSg28taq2BOK-2Rtrh9FLgQg_0 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12041052611557237758', time=2024-09-14T13:58:23.972833+0000, chain.objs.size()=1 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qsB5bKJwwZTSaDfyG_cbSZz32iYWk2I_0 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4262967814538961160', time=2024-09-14T13:58:25.645764+0000, chain.objs.size()=1 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TbB8VEEgf_icbz69V6Q9xZZ0JWu2beI_0 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12728705730977405337', time=2024-09-14T13:58:26.643426+0000, chain.objs.size()=1 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.J7CIv0Fa7Jm1tdu4ctUKk_MVPLlqhKe_0 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5668766416608326497', time=2024-09-14T13:58:26.920451+0000, chain.objs.size()=1 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TLK3b3Zbk0IELOBngbqIotq8qCs0mWq_0 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6832832025311007293', time=2024-09-14T13:58:27.524683+0000, chain.objs.size()=1 2024-09-14T12:44:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.853+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oBvb9qWH_5H1NQ-G077MZ2_IwZ2CFtw_0 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4821500332451654185', time=2024-09-14T13:58:28.564046+0000, chain.objs.size()=1 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NMIJpSSOG6XP0-BOWTdwlRh4t8Aq0O5_0 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9197398068266789104', time=2024-09-14T13:58:29.477109+0000, chain.objs.size()=1 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LdnsZZrMhUZFCr4NgY7g1pZ8C4NSOU5_0 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17341443927989377304', time=2024-09-14T13:58:30.218176+0000, chain.objs.size()=1 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IOlYpZQTGeiF1I9ndopj2IoX26Z-bYR_0 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.354427325253145581', time=2024-09-14T13:58:30.363073+0000, chain.objs.size()=1 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cbgYCvhs_mYg_Yp_vA8x__NLwBbCU_1_0 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4935991104302179146', time=2024-09-14T13:58:31.178393+0000, chain.objs.size()=1 2024-09-14T12:44:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2NDnOIEPB7wk112BP2K8EKbpSVFa2R8_0 2024-09-14T12:44:03.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17942227793609780791', time=2024-09-14T13:58:32.124823+0000, chain.objs.size()=1 2024-09-14T12:44:03.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LFzp8lUqMB3l6pAIxIRR5PkyjHzbSBk_0 2024-09-14T12:44:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11397090940763643754', time=2024-09-14T13:58:32.991272+0000, chain.objs.size()=1 2024-09-14T12:44:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9WmMVgadAtaubdX-KREMEuJtEUC4V-7_0 2024-09-14T12:44:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15966588977779271896', time=2024-09-14T13:58:33.412362+0000, chain.objs.size()=1 2024-09-14T12:44:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.86sd516Fv1rNHgfIveeDi3M2PfC1nU8_0 2024-09-14T12:44:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13020109256617261696', time=2024-09-14T13:58:34.051554+0000, chain.objs.size()=1 2024-09-14T12:44:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1baWvdY9dtNaNkHqRhZ8Ut6FmLjxcQj_0 2024-09-14T12:44:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5079810605523706746', time=2024-09-14T14:00:22.265203+0000, chain.objs.size()=1 2024-09-14T12:44:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NhXYhfiVdLmqiE-M0vxGfXNlV-6t_P8_0 2024-09-14T12:44:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9230370700029165605', time=2024-09-14T14:00:22.266881+0000, chain.objs.size()=1 2024-09-14T12:44:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IwNgr4tATGBgFItGlAanPW5YYrsZR1F_0 2024-09-14T12:44:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1870431387788810918', time=2024-09-14T14:00:25.051869+0000, chain.objs.size()=1 2024-09-14T12:44:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9-3cck5G2lRZQc8VIUq2KbB_R1-SE2D_0 2024-09-14T12:44:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2895560698697860581', time=2024-09-14T14:00:25.827107+0000, chain.objs.size()=1 2024-09-14T12:44:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.f4gct3clbdhpKbnjaM1qf8aNotqlxZa_0 2024-09-14T12:44:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9281399788334016026', time=2024-09-14T14:00:25.902544+0000, chain.objs.size()=1 2024-09-14T12:44:03.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hyzPtyYv970COvLfZmw7BCnNyEhkM4i_0 2024-09-14T12:44:03.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5590573676676832496', time=2024-09-14T14:00:26.923425+0000, chain.objs.size()=1 2024-09-14T12:44:03.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qR4k1NZtRqFA7ScHob6LV1efyTO7Z7V_0 2024-09-14T12:44:03.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13304990829823471876', time=2024-09-14T14:00:27.035831+0000, chain.objs.size()=1 2024-09-14T12:44:03.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TvXjqdz8RKQu5IfSDHyBO7RsWHvQn3c_0 2024-09-14T12:44:03.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3963600519693716757', time=2024-09-14T14:00:27.891399+0000, chain.objs.size()=1 2024-09-14T12:44:03.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.861+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cwL3mI1r1Hdbu6CIy0bmu2HkoKS7qna_0 2024-09-14T12:44:03.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17050181780894360553', time=2024-09-14T14:00:29.381797+0000, chain.objs.size()=1 2024-09-14T12:44:03.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vwJ4RTYuyn3p6e1Z1__Aclb6Jax8WHE_0 2024-09-14T12:44:03.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7271467108267341974', time=2024-09-14T14:00:29.812162+0000, chain.objs.size()=1 2024-09-14T12:44:03.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.caJYHw778f24x1fm1En-llJx9PsTgiT_0 2024-09-14T12:44:03.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7973535137646623360', time=2024-09-14T14:00:30.458777+0000, chain.objs.size()=1 2024-09-14T12:44:03.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Y1fkSNw3RNv2utHgFw98kpsxwzrt9Gk_0 2024-09-14T12:44:03.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15361925669770292249', time=2024-09-14T14:00:31.893016+0000, chain.objs.size()=1 2024-09-14T12:44:03.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HQ2vdEpBEs8D2gXqtRMdx5mylcHEC04_0 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6988974045195122332', time=2024-09-14T14:00:32.873844+0000, chain.objs.size()=1 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.RDv0tXungWZq2g0veu8-N4kpPUtiPB2_0 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9062587123138623967', time=2024-09-14T14:00:33.304343+0000, chain.objs.size()=1 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fWZ77c2yZFudOB-zHKSfIMbfykuDqeL_0 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12364949970848437937', time=2024-09-14T14:00:34.029089+0000, chain.objs.size()=1 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.T0mOyttXGEK10UIQE7EXkGsvW_33why_0 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16212158852223037783', time=2024-09-14T14:00:38.444068+0000, chain.objs.size()=1 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.O6y4CDSlDmDbL-cSsSrRqit-YR_Kx1D_0 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3165898507622759242', time=2024-09-14T14:00:39.484781+0000, chain.objs.size()=1 2024-09-14T12:44:03.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zkRF7_fD6TxGor4bdXnYMSEUDs0wd9G_0 2024-09-14T12:44:03.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6304041433036494538', time=2024-09-14T14:00:40.945229+0000, chain.objs.size()=1 2024-09-14T12:44:03.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ByLG9F0eJ553CcKU-2rY6S69BY38ixA_0 2024-09-14T12:44:03.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6129502524100560141', time=2024-09-14T14:00:40.979817+0000, chain.objs.size()=1 2024-09-14T12:44:03.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HNPwp1RCMlBDG3hFjrLliMeqToVMv6c_0 2024-09-14T12:44:03.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5135987170809683461', time=2024-09-14T14:00:41.675933+0000, chain.objs.size()=1 2024-09-14T12:44:03.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rYGnTnB0LzTSGnfvdy64ot-i5RtiNbZ_0 2024-09-14T12:44:03.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7035760574554782923', time=2024-09-14T14:00:42.064706+0000, chain.objs.size()=1 2024-09-14T12:44:03.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lRJLUzu_6ThWxELUbdhaeGzjMbU7FOu_0 2024-09-14T12:44:03.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15638352022587395823', time=2024-09-14T14:00:42.408466+0000, chain.objs.size()=1 2024-09-14T12:44:03.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3obpQ0dNbW_icpuUOZEqYq7DtlofOQq_0 2024-09-14T12:44:03.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17418692751276708361', time=2024-09-14T14:00:42.505549+0000, chain.objs.size()=1 2024-09-14T12:44:03.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FTKtd23mYuGzOqu1DxZ41UlpaJxivR2_0 2024-09-14T12:44:03.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9758789841297806597', time=2024-09-14T14:00:42.756739+0000, chain.objs.size()=1 2024-09-14T12:44:03.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Bq4_6L7pVZtd3Gg7qHMQycP2ipKYuBK_0 2024-09-14T12:44:03.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52536 2024-09-14T12:44:03.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18175116267705222079', time=2024-09-14T14:00:44.055206+0000, chain.objs.size()=1 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VbTH49F1VmP4iL_1f_Ci3kXzL3Az5tz_0 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16199513489079814977', time=2024-09-14T14:00:44.670701+0000, chain.objs.size()=1 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TNO4NPrBjvQ1R-g1Nng8HrSDfNOo84s_0 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17590155434533549888', time=2024-09-14T14:00:44.817418+0000, chain.objs.size()=1 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cRPF1lL-_EAFDtSUZRK7lMkw_u-ktKM_0 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9699162805428742284', time=2024-09-14T14:00:46.569467+0000, chain.objs.size()=1 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.OKPOvtLjmYmiKhc0XD-31nUjeZytNyu_0 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6233828291536227644', time=2024-09-14T14:00:46.845891+0000, chain.objs.size()=1 2024-09-14T12:44:03.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.x1V_HjpoLXpnL8ACrXdX_Ba497Y7tRR_0 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12734513776950441202', time=2024-09-14T14:00:48.077938+0000, chain.objs.size()=1 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ZtLSy9ZYxHJH0uXi60wl7Pl3wc8kIG8_0 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18004461263663805176', time=2024-09-14T14:00:49.748084+0000, chain.objs.size()=1 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BmtGuwvQLBxn21eVErIbxqBzYUvSkNm_0 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4060644963502986886', time=2024-09-14T14:01:52.714035+0000, chain.objs.size()=1 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.354__shadow_.pF62f_a4RkPCXvRl98FyWjiFrho-5_Z_0 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9842982718970356860', time=2024-09-14T14:05:24.034997+0000, chain.objs.size()=1 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.448__shadow_._9SDqu9396XWmwOYEYB3i3kdQaM4iuo_0 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.540927025727863644', time=2024-09-14T14:05:46.441891+0000, chain.objs.size()=1 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.457__shadow_.jrfZvSnF_Hw8euvdG5iOlfa5cd4XTeM_0 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10230079266384326418', time=2024-09-14T14:06:46.773979+0000, chain.objs.size()=1 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.kVTgwh6P4yqKcYDsyV2dwd1JwcA29ym_0 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15215948254865950410', time=2024-09-14T14:06:46.776032+0000, chain.objs.size()=1 2024-09-14T12:44:03.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.n26PENqt1IAkY7fAhZFbwf-UNAZNw8N_0 2024-09-14T12:44:03.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16387286030253096988', time=2024-09-14T14:08:39.069675+0000, chain.objs.size()=1 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.515__shadow_.n4uZHA7kMA4-Tk_can2eqa4wsNB-o3m_0 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8871463648028267714', time=2024-09-14T14:08:42.569880+0000, chain.objs.size()=1 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.516__shadow_.fDeTpgLi3nAT0rbI_ZLiOrWBAQcrfFE_0 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12950283096846159467', time=2024-09-14T14:19:39.001829+0000, chain.objs.size()=1 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:Tgb.VB3sjkScd2jxdOA3RfntuGrIrAs_.t27IOcbJKfwyH05alUPV7loRqLfZQl__0 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5338362128796649327', time=2024-09-14T14:19:42.383933+0000, chain.objs.size()=1 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:xWhj8GGleYrQnNRyfP2p80not4LPkjJ_.qunfzI0IxhG25Jke27FlbWfJQyH3eMR_0 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12034972545996821289', time=2024-09-14T14:20:37.283058+0000, chain.objs.size()=1 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:BL1ZZdUsNGCnB2w90WbD0tSFIWNAl5M_.udr0rwVlSrEo8quzqxY8441G5KbdbBe_0 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14247766470495573498', time=2024-09-14T14:21:01.405919+0000, chain.objs.size()=1 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:LqYx.C4LCDq0SU7O6nxU1AGgV-4mg0I_.yiHmnFbSPGEkPvULEesHRS7yjMU12sa_0 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5382474161091975658', time=2024-09-14T14:22:37.466843+0000, chain.objs.size()=1 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:M4Chak3DV2afkoZkl99co-htLMt01ip_.5_n02qFEuK7-Q3wtD1GoZnDNmZz2qtp_0 2024-09-14T12:44:03.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1021294001802299912', time=2024-09-14T14:33:52.362107+0000, chain.objs.size()=1 2024-09-14T12:44:03.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.700__shadow:YbBZ8-cSYAF3-zKQAvgCpdZLQbBxAE4_.dnRrsCNFTz-_BO9L_gx_pMnRtfMoXQh_0 2024-09-14T12:44:03.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10117238487851956689', time=2024-09-14T14:36:29.995074+0000, chain.objs.size()=1 2024-09-14T12:44:03.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.745__shadow_.XATMMqBkynJHzjPxw4pcbbl8GmRz1gP_0 2024-09-14T12:44:03.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T12:44:03.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51193' 2024-09-14T12:44:03.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10557301454597077365', time=2024-09-14T13:42:16.893224+0000, chain.objs.size()=1 2024-09-14T12:44:03.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.152__shadow_.7wPZaYUukB2IknqhKKaeDlqFLfEXHef_0 2024-09-14T12:44:03.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_IIcwv3F-Qj_tyyVKhlRvBUz1eOp_J_W', time=2024-09-14T13:44:06.933947+0000, chain.objs.size()=3 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.v4vLtvAoYTkQJ2n2V3D9rTnrbzF44_a_0 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.v4vLtvAoYTkQJ2n2V3D9rTnrbzF44_a_1 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.v4vLtvAoYTkQJ2n2V3D9rTnrbzF44_a_2 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15261936929824758852', time=2024-09-14T13:45:07.220352+0000, chain.objs.size()=1 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.183__shadow_.ba1oF_CMtWun0N8Wam5ym4tbM-iu2Fr_0 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9080529057776940304', time=2024-09-14T13:50:21.001306+0000, chain.objs.size()=1 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.239__shadow_.ova3yNG8hZ_S96hDqDlKBhI451pXZ2l_0 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3276164662894379188', time=2024-09-14T13:50:30.300429+0000, chain.objs.size()=1 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.243__shadow_.L2fvQhYsv2lp6WPxXoHfIyOVQUnG-ok_0 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14220683169745879366', time=2024-09-14T13:51:08.691705+0000, chain.objs.size()=1 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.257__shadow_.vEApkwDoeuNceI9QRJyyyk4_I4DrlMC_0 2024-09-14T12:44:03.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13525903516384466199', time=2024-09-14T13:51:20.868282+0000, chain.objs.size()=1 2024-09-14T12:44:03.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.262__shadow_.lJAy1M0kYSAhtMsAlXPRxLL7lvbvI42_0 2024-09-14T12:44:03.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3364778198167204736', time=2024-09-14T13:53:05.514958+0000, chain.objs.size()=1 2024-09-14T12:44:03.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lEn2ldjK5WA1SRnCeSGpPX_m2XgCQDa_0 2024-09-14T12:44:03.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18300825173897822016', time=2024-09-14T13:53:10.118812+0000, chain.objs.size()=1 2024-09-14T12:44:03.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oF3KmtVDguaP15sQNf4kWJYcZc3ExbZ_0 2024-09-14T12:44:03.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4544463889788306063', time=2024-09-14T13:53:11.517835+0000, chain.objs.size()=1 2024-09-14T12:44:03.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.zDjgxrvHsTsybx3OBgC-rrl3FtmRcJV_0 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.423595555310428588', time=2024-09-14T13:53:11.724117+0000, chain.objs.size()=1 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AsLBOZ4YDnPr2nk-whRNdYmla9bChAk_0 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2992026440527540823', time=2024-09-14T13:53:13.961262+0000, chain.objs.size()=1 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xbHRq6sAOotN3QQ_itA9OOPjLIR6b7p_0 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18327992111200158686', time=2024-09-14T13:53:14.325291+0000, chain.objs.size()=1 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pxZISncJmA9POn5jiQsiXiyVdF8BZkw_0 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8719312684721273057', time=2024-09-14T13:53:14.434724+0000, chain.objs.size()=1 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eZGj5NUXiDMEyvH6kclkBAAgIuIsjYR_0 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1483488730257303340', time=2024-09-14T13:53:15.568774+0000, chain.objs.size()=1 2024-09-14T12:44:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MVYUYh5P1vcFaDf9rYj5CZ_9_MZyJ9z_0 2024-09-14T12:44:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8168382146612651167', time=2024-09-14T13:53:16.344379+0000, chain.objs.size()=1 2024-09-14T12:44:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.l34vONcpeGeZ9oXi88L0p-Fh09ZoB4i_0 2024-09-14T12:44:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6795942913219758548', time=2024-09-14T13:53:16.695192+0000, chain.objs.size()=1 2024-09-14T12:44:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Ur1Y45zAYHtaG8TLdC3vAkM4nTKLxA0_0 2024-09-14T12:44:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7228543513460275332', time=2024-09-14T13:53:17.675670+0000, chain.objs.size()=1 2024-09-14T12:44:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Nq3l1CHyStd7fiKLKiN5eDFxQ70hkrp_0 2024-09-14T12:44:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12228180730794549917', time=2024-09-14T13:53:19.911968+0000, chain.objs.size()=1 2024-09-14T12:44:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9Ippy0xB1Mx9KXjD9Rt87Wxkw4of6IS_0 2024-09-14T12:44:03.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2871566712642537160', time=2024-09-14T13:53:20.550362+0000, chain.objs.size()=1 2024-09-14T12:44:03.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hPMFQ3HoSdhiTvQbEP2QyBMCkjWCsAJ_0 2024-09-14T12:44:03.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1118719992017088163', time=2024-09-14T13:53:21.583051+0000, chain.objs.size()=1 2024-09-14T12:44:03.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rJo_Hs2cfTTlKgCfBj-ky4D9lhqkZNA_0 2024-09-14T12:44:03.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13174581551949059339', time=2024-09-14T13:53:24.123250+0000, chain.objs.size()=1 2024-09-14T12:44:03.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Vs5z2znZ9A8xUQGyHWAQRGRt_qSbhgN_0 2024-09-14T12:44:03.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3516386649172226656', time=2024-09-14T13:53:24.406033+0000, chain.objs.size()=1 2024-09-14T12:44:03.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QHDTVraz7o2-t-oqV1sArOj6NKOsocM_0 2024-09-14T12:44:03.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11794280972237400864', time=2024-09-14T13:53:25.243493+0000, chain.objs.size()=1 2024-09-14T12:44:03.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cBxJmMaOdw-MXunhvnjHoctHRrb0uby_0 2024-09-14T12:44:03.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10565004996140055422', time=2024-09-14T13:53:25.606539+0000, chain.objs.size()=1 2024-09-14T12:44:03.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.zVKv0Ii3I9_AruxfwSeXSSk6UU3x2AV_0 2024-09-14T12:44:03.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10402705351569163366', time=2024-09-14T13:53:26.540783+0000, chain.objs.size()=1 2024-09-14T12:44:03.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.mn_yraqaw9rvX7KOhg5bDER36llsjTw_0 2024-09-14T12:44:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12582857215492770723', time=2024-09-14T13:53:26.643745+0000, chain.objs.size()=1 2024-09-14T12:44:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.A-Lvc0edZmiKNNCvErpzAXLuaWkP2RO_0 2024-09-14T12:44:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14021758179826878290', time=2024-09-14T13:53:27.002545+0000, chain.objs.size()=1 2024-09-14T12:44:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.awgPL8FRLJf-WDHwHP1oed4O1LePWSC_0 2024-09-14T12:44:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8338591527130033334', time=2024-09-14T13:53:29.701343+0000, chain.objs.size()=1 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LiH_9CODz6raeJYz8YMXvh_JD2wroXF_0 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11093350566190677087', time=2024-09-14T13:53:29.802457+0000, chain.objs.size()=1 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.p5dk55bt8LL-G3nuC58pbcetvoF5yFd_0 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.78465012923944865', time=2024-09-14T13:53:30.210406+0000, chain.objs.size()=1 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xLp2T3zqDKdRCf5E6SrZy76jT3b9GmA_0 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17491632879047381741', time=2024-09-14T13:53:30.548236+0000, chain.objs.size()=1 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.I3je4BC3eC8w5L4Vpn1MBINztEUFOX1_0 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12390427057224211695', time=2024-09-14T13:53:33.167840+0000, chain.objs.size()=1 2024-09-14T12:44:03.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VVrRIfDA0EOoP0CgzrBzYEPJ13IUAVI_0 2024-09-14T12:44:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7201184946102515660', time=2024-09-14T13:54:26.384319+0000, chain.objs.size()=1 2024-09-14T12:44:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.284__shadow_.qRz6fXbVf_JCeYrFVgJTr6MqT3TFeWb_0 2024-09-14T12:44:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12576490471506864666', time=2024-09-14T13:54:39.029207+0000, chain.objs.size()=1 2024-09-14T12:44:03.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.289__shadow_.E5GStjYtjdR3q5GafeyVfJZA9PIUQer_0 2024-09-14T12:44:03.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12408191333445035442', time=2024-09-14T13:55:06.645344+0000, chain.objs.size()=1 2024-09-14T12:44:03.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.297__shadow_.FFrICG3Y47OrjTNFWKzipfzZhhou-WD_0 2024-09-14T12:44:03.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5149210260967307298', time=2024-09-14T13:55:11.742765+0000, chain.objs.size()=1 2024-09-14T12:44:03.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.299__shadow_.y1cLlV6OU9Ymz4463Iz2VaGUh67-euQ_0 2024-09-14T12:44:03.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16673486993377690344', time=2024-09-14T13:58:05.430092+0000, chain.objs.size()=1 2024-09-14T12:44:03.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rb4YIfpuznx4wb0z3_E2PH56unz1FHT_0 2024-09-14T12:44:03.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1222775288213184869', time=2024-09-14T13:58:05.729639+0000, chain.objs.size()=1 2024-09-14T12:44:03.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TP9kfnilGcbAVKKUg3UmTecJD3rkVVo_0 2024-09-14T12:44:03.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17321956063609857209', time=2024-09-14T13:58:07.793238+0000, chain.objs.size()=1 2024-09-14T12:44:03.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hbI7zgO4ekFbkPwNEEUClfP2GCqinqZ_0 2024-09-14T12:44:03.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15410918719338037087', time=2024-09-14T13:58:08.027648+0000, chain.objs.size()=1 2024-09-14T12:44:03.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.S97Xq7LVwlkuSjtWJ-bgMviyYPNqfED_0 2024-09-14T12:44:03.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6611998834921798930', time=2024-09-14T13:58:08.200726+0000, chain.objs.size()=1 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XFM1lSyAIstsOYV7CWBHe41DgAYHquF_0 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16262037636205155630', time=2024-09-14T13:58:08.320228+0000, chain.objs.size()=1 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VdVA66x8SnKYhdW3OZ29oryIfhLIM5E_0 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16262259932567064278', time=2024-09-14T13:58:08.438228+0000, chain.objs.size()=1 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Q5xkVdnjwohgfgc7SILp1EiCMv3WUSO_0 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17803916388382999928', time=2024-09-14T13:58:11.602153+0000, chain.objs.size()=1 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IKSGxRRW7oZjyX035cDMwN1tOER3i7I_0 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13879131913609639187', time=2024-09-14T13:58:11.887658+0000, chain.objs.size()=1 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gmp2wO5pcCsuh4Gtv48bzLvJml7TD5T_0 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11203528691123710851', time=2024-09-14T13:58:12.066748+0000, chain.objs.size()=1 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LPOdzcZX_saTBsf4xb3EsdHbHGJpxhS_0 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11314696042812982212', time=2024-09-14T13:58:12.068763+0000, chain.objs.size()=1 2024-09-14T12:44:03.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gyTmuRv24V8sHuMiRDLKefnH43-xIIe_0 2024-09-14T12:44:03.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17148321555162250103', time=2024-09-14T13:58:12.359594+0000, chain.objs.size()=1 2024-09-14T12:44:03.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.aYWg7WjRsExZsyI9BNPGdY-aPIvYhCp_0 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1780145815105680093', time=2024-09-14T13:58:13.465549+0000, chain.objs.size()=1 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.h1lLWgv1qX1lVpsnMz4MRSWV_s__9PF_0 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14158941558900642807', time=2024-09-14T13:58:15.611400+0000, chain.objs.size()=1 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DwFo2IoipWR3scUUbnZ54c-Z7300s99_0 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9951454845920921605', time=2024-09-14T13:58:15.755550+0000, chain.objs.size()=1 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hnF97-sDV23cQ0dhdpIhCjAyBfJrlrS_0 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15912084593786114003', time=2024-09-14T13:58:16.159571+0000, chain.objs.size()=1 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NhzbPONSa3n1xpgXX5AWPISyIt-06yk_0 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3271336497755626270', time=2024-09-14T13:58:17.254688+0000, chain.objs.size()=1 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.UuHbCzmBdHyDUrLi_LO5jCUwTvyyiQF_0 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8212210923598193186', time=2024-09-14T13:58:18.483291+0000, chain.objs.size()=1 2024-09-14T12:44:03.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.InDg_Xc5t4fFhEomTESztjxt8bLmIbn_0 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10176989187534607007', time=2024-09-14T13:58:20.023457+0000, chain.objs.size()=1 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GlBpWGcdHgME4NDWrh0httGQV2kXqEX_0 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7150873258241529390', time=2024-09-14T13:58:21.101911+0000, chain.objs.size()=1 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8K82dAt75RG8jKtnjQbablrzJeNZddU_0 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18166962777572296944', time=2024-09-14T13:58:21.756944+0000, chain.objs.size()=1 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.P-iDmn_3MLI5Wu01Y-12Zth0gI2NK8T_0 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7604396137199246643', time=2024-09-14T13:58:22.192350+0000, chain.objs.size()=1 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NR9rAtr1N_RtqWNNrfWMN6FdL1Dfmhw_0 2024-09-14T12:44:03.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2462150080613925856', time=2024-09-14T13:58:23.478644+0000, chain.objs.size()=1 2024-09-14T12:44:03.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IgwJDNP8vqWLqWVm8wh1bxHrhmzXCj1_0 2024-09-14T12:44:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5209821427574017433', time=2024-09-14T13:58:23.480213+0000, chain.objs.size()=1 2024-09-14T12:44:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mDh8EJbpMv69tegXwbjCDLcmkpq2WwG_0 2024-09-14T12:44:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11229644033961653898', time=2024-09-14T13:58:25.397265+0000, chain.objs.size()=1 2024-09-14T12:44:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.02H58gSW76CMYBd7saIcZqfuVlLI0Tx_0 2024-09-14T12:44:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18363227377357439517', time=2024-09-14T13:58:26.998960+0000, chain.objs.size()=1 2024-09-14T12:44:03.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.igypYNuXUv9T15yeaUxJMjlnaCtEwaX_0 2024-09-14T12:44:03.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3142058971947532840', time=2024-09-14T13:58:27.723228+0000, chain.objs.size()=1 2024-09-14T12:44:03.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.aL89U_aGBv6uk2ygallbXeXKHi2DRPm_0 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17474673552568890049', time=2024-09-14T13:58:29.241639+0000, chain.objs.size()=1 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.bCPVGO45hnE2Rdxn6iY7Bx4IbRrLN10_0 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7104548239614271635', time=2024-09-14T13:58:29.693796+0000, chain.objs.size()=1 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Omi4-p20OLbHdZQ-3Eiq-ebRMKDbfVh_0 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5117183366929511498', time=2024-09-14T13:58:29.765207+0000, chain.objs.size()=1 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Ff6u4LdPweo6VZAmzp9QdYyeyUhz8l9_0 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7344141639624472867', time=2024-09-14T13:58:30.271161+0000, chain.objs.size()=1 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JXEUN5oOgeQfGRZ7IzvIUg1kwbOYmtF_0 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5310308138514644700', time=2024-09-14T13:58:32.102207+0000, chain.objs.size()=1 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.vRy2z2wnPuXTJqui16JRbeFZjQrOQh1_0 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.423479845838520495', time=2024-09-14T13:58:32.838892+0000, chain.objs.size()=1 2024-09-14T12:44:03.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.11jR3W0BZu2tc3hruIeozutqRNUEYuP_0 2024-09-14T12:44:03.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13463567290581266217', time=2024-09-14T13:58:33.695545+0000, chain.objs.size()=1 2024-09-14T12:44:03.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.n62jbxXKvJd08_Qe5XC5HQJoAl7DxIS_0 2024-09-14T12:44:03.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12732352251171848211', time=2024-09-14T13:58:33.697908+0000, chain.objs.size()=1 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9DXFplGR3VncYBiCMa30EGrHOVgl-np_0 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.971473236839903960', time=2024-09-14T14:00:21.897298+0000, chain.objs.size()=1 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.G9PzxQsGq658HMev_6uTDcODwrSEuFO_0 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14818644246953150778', time=2024-09-14T14:00:21.911542+0000, chain.objs.size()=1 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.glAhMQXXEBjX3WRmBzOKTldPDbBzQsF_0 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5978051534271270346', time=2024-09-14T14:00:22.290927+0000, chain.objs.size()=1 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.i_gsHM-tlyg-8u-QYDFNOtz5zgGI7_i_0 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7273162065949982120', time=2024-09-14T14:00:22.809057+0000, chain.objs.size()=1 2024-09-14T12:44:03.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.GTWPYZ_4bYHG3eM747ihrjWsqDLqgwy_0 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15707206855018553016', time=2024-09-14T14:00:23.878826+0000, chain.objs.size()=1 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.heZ6RC9pKWU42A4ZMzugfeQXiI9L1vg_0 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9563060364265561182', time=2024-09-14T14:00:25.949028+0000, chain.objs.size()=1 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lx5SCyz-eC6APnKSBTtTEDBOSfhHJ3a_0 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2825385357500567393', time=2024-09-14T14:00:26.977039+0000, chain.objs.size()=1 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iRN0zv1bj4exGw9oK0PBdvyjz5p7aqN_0 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9686445524642848961', time=2024-09-14T14:00:27.127878+0000, chain.objs.size()=1 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Q7BHRpljJBG1cvHXOnFwwl4eiXL7ttp_0 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12612881011302909507', time=2024-09-14T14:00:27.877210+0000, chain.objs.size()=1 2024-09-14T12:44:03.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AveWiDN9crseoHO-I_hoScCkjoWNIxl_0 2024-09-14T12:44:03.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1292219231558644446', time=2024-09-14T14:00:29.867829+0000, chain.objs.size()=1 2024-09-14T12:44:03.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9v7vwO6M1Ys3QRkfZdXiedmDqB9jdV1_0 2024-09-14T12:44:03.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11697571660906341362', time=2024-09-14T14:00:30.540480+0000, chain.objs.size()=1 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2swHNEiZHIKsSGQQLOfovNaiypR7FaE_0 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13528430166632596415', time=2024-09-14T14:00:30.869861+0000, chain.objs.size()=1 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FNtI7hgavREhwo0QunTZKQM7_YbwBEa_0 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1510251228799309714', time=2024-09-14T14:00:31.377841+0000, chain.objs.size()=1 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jW7cKtQcZnatSh2R1uF5lkSokDg-P2B_0 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.83504981737409879', time=2024-09-14T14:00:31.460959+0000, chain.objs.size()=1 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-aCm6V0eaUSFlqm5ya0cEOX2ZJPxIUH_0 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16651815879104994710', time=2024-09-14T14:00:33.350761+0000, chain.objs.size()=1 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LWqG6Ta03SlEXXyBfGcqEKBOZXFsSwx_0 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1386072214814513725', time=2024-09-14T14:00:33.569688+0000, chain.objs.size()=1 2024-09-14T12:44:03.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.DdZgsNGctRUwcj6ZxmkWdRkXHBBJIzY_0 2024-09-14T12:44:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7648061304715276404', time=2024-09-14T14:00:34.147919+0000, chain.objs.size()=1 2024-09-14T12:44:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UO8q8IHfV2PZAERx95a0TX2wvjoH0KX_0 2024-09-14T12:44:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4967919784554274250', time=2024-09-14T14:00:34.264151+0000, chain.objs.size()=1 2024-09-14T12:44:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dZbP9Po6Ui9nLpWR-H8_EVu0GpS0Pqi_0 2024-09-14T12:44:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9350349080720098877', time=2024-09-14T14:00:35.596297+0000, chain.objs.size()=1 2024-09-14T12:44:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uMBQs3SSXtWd7k6qARhWVtEDdlQjtQS_0 2024-09-14T12:44:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8145194869102530808', time=2024-09-14T14:00:37.013132+0000, chain.objs.size()=1 2024-09-14T12:44:03.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-euIYtqZ_Cjk1PumdhTkPIP9tX4b1hU_0 2024-09-14T12:44:03.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14597186423844630152', time=2024-09-14T14:00:38.195445+0000, chain.objs.size()=1 2024-09-14T12:44:03.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xAdXyt5fk6o_FocdP_0DyHj773nMCWn_0 2024-09-14T12:44:03.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14292369477229484213', time=2024-09-14T14:00:39.007133+0000, chain.objs.size()=1 2024-09-14T12:44:03.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zDj1ieMDN8O7FzjyA-uhsfd-MFjNBbF_0 2024-09-14T12:44:03.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11856994281940177634', time=2024-09-14T14:00:39.404076+0000, chain.objs.size()=1 2024-09-14T12:44:03.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6SDm6SPG9CxhH3_9Tina8yyKA98phYU_0 2024-09-14T12:44:03.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5755597039022441572', time=2024-09-14T14:00:40.821805+0000, chain.objs.size()=1 2024-09-14T12:44:03.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hgXrPKkl5uuLml3bV-M1E-5hJZJ09DD_0 2024-09-14T12:44:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12341367948395032124', time=2024-09-14T14:00:42.845215+0000, chain.objs.size()=1 2024-09-14T12:44:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.EaUO8LH6LpKYgHLM73QJCEjClpsqKqD_0 2024-09-14T12:44:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1549517138557078335', time=2024-09-14T14:00:43.298413+0000, chain.objs.size()=1 2024-09-14T12:44:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1WRrOPOjj_VqhQfeZwMEuf6zgB5NuaQ_0 2024-09-14T12:44:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7488097934477339308', time=2024-09-14T14:00:44.968123+0000, chain.objs.size()=1 2024-09-14T12:44:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Sw-SZnxP08bt2hgbPNKKmXtyS0nKajt_0 2024-09-14T12:44:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11020268961090143261', time=2024-09-14T14:00:45.426727+0000, chain.objs.size()=1 2024-09-14T12:44:03.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gvhPBVImk6OE9vDSGDdua9xLzSbqXu7_0 2024-09-14T12:44:03.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51193 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15194302032271005499', time=2024-09-14T14:00:45.544398+0000, chain.objs.size()=1 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mmvSPx2SEoP372VdSwX-tacklnHB6nb_0 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1078032746199397938', time=2024-09-14T14:00:45.947657+0000, chain.objs.size()=1 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dzMldvkh4fRAvc8XrU5pd6LnrhsKySi_0 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1117330894233983801', time=2024-09-14T14:00:48.007686+0000, chain.objs.size()=1 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VRzRCdj8um4VbJT2tTpxWYFqGUyb30W_0 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7311038085496979222', time=2024-09-14T14:00:49.771791+0000, chain.objs.size()=1 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YdRgWHecKkXvp9ru2Zt7zE_RER-BJBJ_0 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13865312151188617953', time=2024-09-14T14:03:49.926153+0000, chain.objs.size()=1 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.408__shadow_.pWQ_pp9wUsQFO5KlGxHz-UO2GnO984I_0 2024-09-14T12:44:03.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1795292419271673219', time=2024-09-14T14:05:09.732567+0000, chain.objs.size()=1 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.443__shadow_.FPSj_V0eswbhPnV17NjSuDlcYk7Q20u_0 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14490276384428660731', time=2024-09-14T14:07:00.489733+0000, chain.objs.size()=1 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.487__shadow_.8cfTYF3Ymp91DjSCmGuTl0wr0onk-vN_0 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10634290460394584958', time=2024-09-14T14:07:02.897813+0000, chain.objs.size()=1 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.488__shadow_.6f7Obv9nQFCxG7oVzG-aGf0nnZtIE1V_0 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17601185993301040320', time=2024-09-14T14:07:12.407097+0000, chain.objs.size()=1 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.492__shadow_.jnNTECXChqIiWqZVEVq-YGg1XFENis0_0 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11484791859211408833', time=2024-09-14T14:08:58.998984+0000, chain.objs.size()=1 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.519__multipart_mymultipart.2~xMMvgQlItutsw6FuBaomDKN-VdR6OcC.1 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13853443356421757160', time=2024-09-14T14:09:04.053444+0000, chain.objs.size()=1 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.519__multipart_mymultipart.2~FbUz1jso848-qWDYg682epCl7FQnjTZ.1 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1246096982071659404', time=2024-09-14T14:15:19.044660+0000, chain.objs.size()=7 2024-09-14T12:44:03.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.528__multipart_mymultipart.2~clAGvgHe1XPJEvBwq39qkXp3jl3LOrL.1 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.528__shadow_mymultipart.2~clAGvgHe1XPJEvBwq39qkXp3jl3LOrL.1_1 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.528__multipart_mymultipart.2~clAGvgHe1XPJEvBwq39qkXp3jl3LOrL.2 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.528__shadow_mymultipart.2~clAGvgHe1XPJEvBwq39qkXp3jl3LOrL.2_1 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.528__multipart_mymultipart.2~clAGvgHe1XPJEvBwq39qkXp3jl3LOrL.3 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.528__shadow_mymultipart.2~clAGvgHe1XPJEvBwq39qkXp3jl3LOrL.3_1 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.528__multipart_mymultipart.2~clAGvgHe1XPJEvBwq39qkXp3jl3LOrL.4 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12787991449566954383', time=2024-09-14T14:15:29.926017+0000, chain.objs.size()=2 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.529__multipart_mymultipart.2~DJfbeU3qphCheTj1GRGLl0AD0RPdfBe.1 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.529__multipart_mymultipart.2~DJfbeU3qphCheTj1GRGLl0AD0RPdfBe.2 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15258762488212431221', time=2024-09-14T14:17:20.354413+0000, chain.objs.size()=1 2024-09-14T12:44:03.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.551__shadow_.1QRNePA6dbNVv-O4uBQ-NU2Ah1Ryaaq_0 2024-09-14T12:44:03.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16142216860572484834', time=2024-09-14T14:19:06.691942+0000, chain.objs.size()=2 2024-09-14T12:44:03.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.564__shadow_.HFGxtWEVtaGVZmdxzTnxrXxTAFkIbmU_0 2024-09-14T12:44:03.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.564__shadow_.HFGxtWEVtaGVZmdxzTnxrXxTAFkIbmU_1 2024-09-14T12:44:03.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2314525751907078387', time=2024-09-14T14:19:34.039536+0000, chain.objs.size()=1 2024-09-14T12:44:03.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:Xs9H-X1KuuehwVyD3Ij8u1jYvxapRfn_.DzDzBbk9UQKB3D39EXESteh5NwpM1m9_0 2024-09-14T12:44:03.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12337181830056748040', time=2024-09-14T14:19:46.516420+0000, chain.objs.size()=1 2024-09-14T12:44:03.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.571__shadow:UkZ1R0sHnY-tjXUqC8ORmeMUpotgfWn_.McWgM2q43mU-AG6YMstLQqqYZiieqoZ_0 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6168707953803070923', time=2024-09-14T14:19:52.331305+0000, chain.objs.size()=1 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.573__shadow:Qxd-L1IRsex3jvSHuPK8eHZ.tiK.V4e_.SOX7vI8zV2SqchhEPDloCuriCRx7VXA_0 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12059651077886595220', time=2024-09-14T14:20:29.959558+0000, chain.objs.size()=1 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:Xd0cne-ZAd73hkWzJpTJEreJrk2DOOg_._yytYwJsqQOFqagQz8afrSxN94k-BYi_0 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9157793147644991738', time=2024-09-14T14:28:14.802089+0000, chain.objs.size()=1 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.619__shadow_.to8pPf5tH30dTS3o_Ir-SkkuXvBo4hW_0 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16270820724078423558', time=2024-09-14T14:30:09.204934+0000, chain.objs.size()=1 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.634__shadow_.UWclP-ZJBgAvlJSerMkXAziu1aCEcpa_0 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12183498726108958338', time=2024-09-14T14:30:14.148950+0000, chain.objs.size()=1 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.636__shadow_.ixC8o8wAFDgJnBw5E36X2cjeL2Du5qM_0 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5725228187134498848', time=2024-09-14T14:30:53.786421+0000, chain.objs.size()=1 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.647__shadow_.Bh3QXeZPC997LsxgnlLxFNHblGcx50D_0 2024-09-14T12:44:03.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9048239792871265617', time=2024-09-14T14:32:49.905218+0000, chain.objs.size()=1 2024-09-14T12:44:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.669__shadow_.mTi_N3244HC5IezgNEFJmn-2h2pTsGR_0 2024-09-14T12:44:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4127304646740958467', time=2024-09-14T14:32:52.798442+0000, chain.objs.size()=1 2024-09-14T12:44:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.671__shadow_.SVtUgwb20B4DSi7Yn6_p4QyFBj1B_nC_0 2024-09-14T12:44:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12800887260655524214', time=2024-09-14T14:37:23.834663+0000, chain.objs.size()=1 2024-09-14T12:44:03.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.749__shadow_.cOED3CzvH_CGg2unWA4sD6L6dK_tBpf_0 2024-09-14T12:44:03.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9347809446684229823', time=2024-09-14T14:39:35.327180+0000, chain.objs.size()=1 2024-09-14T12:44:03.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.766__shadow_.0xegeDfMriexOu-vI9qgZNnzsOyf3eN_0 2024-09-14T12:44:03.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:03.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T12:44:03.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:03.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/73367' 2024-09-14T12:44:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_99ETUjv1dYcTOnalmmzHGpuneZfHiGI', time=2024-09-14T13:43:31.952723+0000, chain.objs.size()=3 2024-09-14T12:44:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.5kZcNTnab5TIvi5ONX_TwJsH4_OqSrt_0 2024-09-14T12:44:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.5kZcNTnab5TIvi5ONX_TwJsH4_OqSrt_1 2024-09-14T12:44:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.5kZcNTnab5TIvi5ONX_TwJsH4_OqSrt_2 2024-09-14T12:44:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10190431975578591362', time=2024-09-14T13:50:07.690709+0000, chain.objs.size()=1 2024-09-14T12:44:03.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.235__shadow_.WaHkBidNKyYv73jL80_TXGJ7LzKDlZt_0 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8195123719910226703', time=2024-09-14T13:50:12.820263+0000, chain.objs.size()=1 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.237__shadow_.Yl5IkO9LET-OTJRcdZuURRSFFRVk5g__0 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9147928941471102343', time=2024-09-14T13:53:06.852452+0000, chain.objs.size()=1 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3ei1Y3BvN_yDMTN_OJOsNX7H86atHjj_0 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8212569612008889576', time=2024-09-14T13:53:07.738562+0000, chain.objs.size()=1 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wRl-dMJs_QHpzGIxEAEbUWQ2mcNvsMd_0 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10550018859650411815', time=2024-09-14T13:53:07.946663+0000, chain.objs.size()=1 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WUWeBB8RUBlVdSUamjShMxIsQI8c9k-_0 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7217619255965225206', time=2024-09-14T13:53:09.783830+0000, chain.objs.size()=1 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.YD6752qXQI3sxRm3xX_cVP6MXaySiRR_0 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3974719340729825489', time=2024-09-14T13:53:10.850283+0000, chain.objs.size()=1 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Ll0BPow6svYKl5E22Sw05B1GOVcMnri_0 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.258551564075467994', time=2024-09-14T13:53:12.647485+0000, chain.objs.size()=1 2024-09-14T12:44:03.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Gu0ds2xyX_rgGEcZHbQsR5KgCinylO3_0 2024-09-14T12:44:03.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5985613065904292419', time=2024-09-14T13:53:13.685546+0000, chain.objs.size()=1 2024-09-14T12:44:03.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QrtwJ_Z_JIqs2tRLqSHyND5c0dolgvJ_0 2024-09-14T12:44:03.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6320522165416496585', time=2024-09-14T13:53:14.986442+0000, chain.objs.size()=1 2024-09-14T12:44:03.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pWvxfMbzciN3msCDjcHctSCZ4-2H3Jt_0 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3317774294516690579', time=2024-09-14T13:53:15.921854+0000, chain.objs.size()=1 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-Q0GXdDL6UntYcbaYzy7XP2QI6Ecv0Z_0 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2202416130706474727', time=2024-09-14T13:53:17.679863+0000, chain.objs.size()=1 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fGmCudECLnN8E_lV2NA3L4uvb7vCqso_0 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3135443613981649814', time=2024-09-14T13:53:19.035389+0000, chain.objs.size()=1 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.NC_-HkdR8tJHf3hj_EbOGDLdNQx9Zly_0 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3343424364201453940', time=2024-09-14T13:53:19.906433+0000, chain.objs.size()=1 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HBF7PQoeynMrR9gXcfkxYfWFYDMMN1C_0 2024-09-14T12:44:03.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15991538118348645616', time=2024-09-14T13:53:20.118670+0000, chain.objs.size()=1 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qsnpbOKuylXN8GmAfMQddFkWQDfNs7k_0 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12712742945641694160', time=2024-09-14T13:53:20.238509+0000, chain.objs.size()=1 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2biwxxZXH_MzaMv4I5S4isUsDFibVey_0 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.809629433600185208', time=2024-09-14T13:53:20.556420+0000, chain.objs.size()=1 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.K5GtqDVPjkeU_yE5TlshArfzgog5-qo_0 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11896190501013228693', time=2024-09-14T13:53:22.077665+0000, chain.objs.size()=1 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XyQOURKgjebH6KM6sdigQqcMIGR8-p0_0 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14167250304726318030', time=2024-09-14T13:53:22.184726+0000, chain.objs.size()=1 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FTb06Px9pCSeWanCHKsyfL0SLFY5WTc_0 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1766650383235590896', time=2024-09-14T13:53:22.641091+0000, chain.objs.size()=1 2024-09-14T12:44:03.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ie9kS3g_ZTA-NX1In1LZRzJxseP84gP_0 2024-09-14T12:44:03.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10795999978283460361', time=2024-09-14T13:53:22.919446+0000, chain.objs.size()=1 2024-09-14T12:44:03.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-786Fr1VaCqcl9Km-aIgpzI71B0Za1j_0 2024-09-14T12:44:03.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7444225490217585987', time=2024-09-14T13:53:23.234734+0000, chain.objs.size()=1 2024-09-14T12:44:03.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FGo_z1IHwo_Pcn1nObE2briPvT6lRWd_0 2024-09-14T12:44:03.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.465458583396208973', time=2024-09-14T13:53:24.372902+0000, chain.objs.size()=1 2024-09-14T12:44:03.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GrAXS9nl_n-Cc8_B0iNyJQ7wcsJbHoT_0 2024-09-14T12:44:03.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12497773238949699051', time=2024-09-14T13:53:26.424958+0000, chain.objs.size()=1 2024-09-14T12:44:03.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GE6CXjIOXpLe6-hHmmtLHCIrciuVaLc_0 2024-09-14T12:44:03.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11120766714478083048', time=2024-09-14T13:53:28.989276+0000, chain.objs.size()=1 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-Y_qy3d-y8eQaedpR5CFsuxPNnTzHqB_0 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.653980039582519716', time=2024-09-14T13:53:28.991254+0000, chain.objs.size()=1 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wJrG7rcEe7NhGunoZtMBfvsLPyfrD4M_0 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8119796282458332818', time=2024-09-14T13:53:29.433311+0000, chain.objs.size()=1 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LfVsC8hPVjMKjEP33QgZcp39xaUjYPr_0 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13670620470930338829', time=2024-09-14T13:53:30.437793+0000, chain.objs.size()=1 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Lbm2QBu7bK6i4Apdhk9Un5G2z87T-tm_0 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2222954144282583576', time=2024-09-14T13:53:31.984897+0000, chain.objs.size()=1 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gu0nRZQU6wID2ead4gJ7uqwC94zPo1o_0 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16619833893596655240', time=2024-09-14T13:53:32.721802+0000, chain.objs.size()=1 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ncIZCDHkkqnEwH9G6h7Z5kJfO6lp1UH_0 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15113589026610228051', time=2024-09-14T13:53:32.723615+0000, chain.objs.size()=1 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ugyrQ5ca9x8GWIpWZPymozNLrHHZf31_0 2024-09-14T12:44:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6638381026166048563', time=2024-09-14T13:53:32.827983+0000, chain.objs.size()=1 2024-09-14T12:44:03.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1JUsyzOvGCI-3lgWaJXYMZXlyLztBen_0 2024-09-14T12:44:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.989+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12131256982953239747', time=2024-09-14T13:53:34.417710+0000, chain.objs.size()=1 2024-09-14T12:44:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.989+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HuO4HDqBAQUUkA-ttZO3fHxb5mpfNUh_0 2024-09-14T12:44:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.989+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14259134206161705813', time=2024-09-14T13:53:34.535037+0000, chain.objs.size()=1 2024-09-14T12:44:03.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.989+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LGAy3RQGL8OapqIW_-oNhG1k14axeI8_0 2024-09-14T12:44:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.989+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11866643671496236180', time=2024-09-14T13:54:06.314959+0000, chain.objs.size()=1 2024-09-14T12:44:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.989+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.276__shadow_._jspb3iJAWgMWu1PgbmxwcMB-R0gWOc_0 2024-09-14T12:44:03.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11631292411668636443', time=2024-09-14T13:54:18.826936+0000, chain.objs.size()=1 2024-09-14T12:44:03.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.281__shadow_.uYNYzFoSBehd2yBqDfvwo8hOGKbpjAb_0 2024-09-14T12:44:03.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14082514652756739764', time=2024-09-14T13:54:36.583895+0000, chain.objs.size()=1 2024-09-14T12:44:03.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.288__shadow_.91JnqZY4M0yZ4CeXXw7qCkQroA3hLmC_0 2024-09-14T12:44:03.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14337097648879814386', time=2024-09-14T13:54:59.055204+0000, chain.objs.size()=1 2024-09-14T12:44:03.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.9LsEK9WgO5OV4qh0HaUU6NXo7w7Ohra_0 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9587155265662188785', time=2024-09-14T13:55:29.452501+0000, chain.objs.size()=1 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.306__shadow_.H389Sxr9oa9atDTQ7kejxkGIUZQ8X4I_0 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10750020056536498347', time=2024-09-14T13:56:12.081538+0000, chain.objs.size()=1 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.320__shadow:mcTMctLXYPsDLFT3qdrrNRAZMiKK6QE_.Lscg4WuqI0L8T45CRq-RZYHXYKUQBSD_0 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.398232992986329673', time=2024-09-14T13:58:06.086383+0000, chain.objs.size()=1 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WVmHJFY1mNQALJhrVPQpzWcSXyI1xLN_0 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14115655826797169063', time=2024-09-14T13:58:06.317350+0000, chain.objs.size()=1 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tQbs_pFemzUEj95Fwh8OSZD8rn1Xj0C_0 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14998221685877246679', time=2024-09-14T13:58:07.078987+0000, chain.objs.size()=1 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.AvQFsgOVLzOETz6qUA6mFLvojW6V8MM_0 2024-09-14T12:44:03.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4247675850362288564', time=2024-09-14T13:58:07.209975+0000, chain.objs.size()=1 2024-09-14T12:44:03.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YsrsxXyCVRXNsbEblK1xW0maz0jeK1y_0 2024-09-14T12:44:03.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16890970448135110851', time=2024-09-14T13:58:07.592899+0000, chain.objs.size()=1 2024-09-14T12:44:03.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.993+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4ux701d42CaCoCA0qbXEUlpgPecaW58_0 2024-09-14T12:44:03.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1844477165467371908', time=2024-09-14T13:58:07.705859+0000, chain.objs.size()=1 2024-09-14T12:44:03.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8QZbAb8pMIojkisLnyP9MslAG9x8NbW_0 2024-09-14T12:44:03.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15552341683068864029', time=2024-09-14T13:58:08.267136+0000, chain.objs.size()=1 2024-09-14T12:44:03.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0YtRCjMG-AcNb4gS0CoGbP4hTwKos6o_0 2024-09-14T12:44:03.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1280418190431075803', time=2024-09-14T13:58:10.009029+0000, chain.objs.size()=1 2024-09-14T12:44:03.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fvAecfZrvEUcEnZi_1Vowax4ded5ZlY_0 2024-09-14T12:44:03.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3135448033537582088', time=2024-09-14T13:58:10.010748+0000, chain.objs.size()=1 2024-09-14T12:44:03.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eMKhOgdzhzgSypKhEx1uldW9qPxUCWg_0 2024-09-14T12:44:03.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11655457310842529581', time=2024-09-14T13:58:10.110271+0000, chain.objs.size()=1 2024-09-14T12:44:03.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.90nU6avnpQnGmGdW33IZzRoojw89FWh_0 2024-09-14T12:44:03.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3004821853822415645', time=2024-09-14T13:58:10.861279+0000, chain.objs.size()=1 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.SqvJG3Z4Keh1DxmsojrrFsPodFdYA44_0 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5984693375212722962', time=2024-09-14T13:58:12.320150+0000, chain.objs.size()=1 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._nvDg2osPu5klqMOI-9P6EkcsaxXh0V_0 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10531596093218133807', time=2024-09-14T13:58:13.681657+0000, chain.objs.size()=1 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FYWYmKBDw3ZPsTAY2RozoAwaYYQviWO_0 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2905116309056637070', time=2024-09-14T13:58:15.346390+0000, chain.objs.size()=1 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZY_lrAWWGCufKtOxNaxXi_qbliUzsnB_0 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2105732677428369798', time=2024-09-14T13:58:17.900039+0000, chain.objs.size()=1 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:03.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KMKuO5KU2cgZJDwIOqW208B2zJ2pbsT_0 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8301069671210261345', time=2024-09-14T13:58:18.750917+0000, chain.objs.size()=1 2024-09-14T12:44:03.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jGPTXqBkRaGeXfoTfo3zhfCBxuNymVS_0 2024-09-14T12:44:03.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17905943020358546653', time=2024-09-14T13:58:20.056283+0000, chain.objs.size()=1 2024-09-14T12:44:03.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1sQrQNlLiyNAkqeqHOOT0vnr_ImvBoL_0 2024-09-14T12:44:03.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8337144350197177587', time=2024-09-14T13:58:21.614762+0000, chain.objs.size()=1 2024-09-14T12:44:03.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CfUMpcTlM-rlhBSczLP1moYhGlVNwlR_0 2024-09-14T12:44:03.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7324925618737313036', time=2024-09-14T13:58:22.210749+0000, chain.objs.size()=1 2024-09-14T12:44:03.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.I5vpX7q_mcIxV10_PkE89jmi6my7TD-_0 2024-09-14T12:44:03.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2097395968999279256', time=2024-09-14T13:58:22.907773+0000, chain.objs.size()=1 2024-09-14T12:44:03.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GndMkmd8Wgvb6WkV-gc7Sda1GM1uiJi_0 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13756585339274295607', time=2024-09-14T13:58:23.790258+0000, chain.objs.size()=1 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0yMVUJ4iyZCdA33cnnoMojw7fiimeBR_0 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12074598147047997851', time=2024-09-14T13:58:23.908582+0000, chain.objs.size()=1 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cnTOYhOuzgEgWkLjT_onroDDmAT_cAA_0 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10694935050698345585', time=2024-09-14T13:58:25.561121+0000, chain.objs.size()=1 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9rrbImZ2SaUT9_-v7qJWiQhDjR3q9KV_0 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2585188546370547250', time=2024-09-14T13:58:26.769390+0000, chain.objs.size()=1 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Gy0MV-qX-0cm0uwr8hyUFnbM7cCWTs9_0 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16256510955741505437', time=2024-09-14T13:58:27.318239+0000, chain.objs.size()=1 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TtqIFic1Y1vmZwn4MyinVxzy8TI761t_0 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5280868056950153105', time=2024-09-14T13:58:28.469536+0000, chain.objs.size()=1 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jQySrdNJRQs154yrVK7-gYBrWti0F0F_0 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1990705575929676287', time=2024-09-14T13:58:28.471560+0000, chain.objs.size()=1 2024-09-14T12:44:03.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.005+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CswDuBY2IvO_zLjlhmo6kZxumDWdefh_0 2024-09-14T12:44:04.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6349817821133005765', time=2024-09-14T13:58:30.028884+0000, chain.objs.size()=1 2024-09-14T12:44:04.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Vgatu6J3yz0_hP9HegzPd5Mv9q5pF12_0 2024-09-14T12:44:04.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13904188167206607641', time=2024-09-14T13:58:30.604333+0000, chain.objs.size()=1 2024-09-14T12:44:04.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.USiQHQ2Elea2geoHiP69d3QLtqhkPAJ_0 2024-09-14T12:44:04.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.009+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13887957496221871079', time=2024-09-14T13:58:32.613456+0000, chain.objs.size()=1 2024-09-14T12:44:04.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.009+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tDTv1Tp0WdP0ASkOuzRaPYJehIqAETa_0 2024-09-14T12:44:04.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10157230360137912378', time=2024-09-14T13:58:33.108780+0000, chain.objs.size()=1 2024-09-14T12:44:04.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HP6sKfplXLzISHLlX1uiQRcVxqfVmlC_0 2024-09-14T12:44:04.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16021876868722738639', time=2024-09-14T13:58:34.054439+0000, chain.objs.size()=1 2024-09-14T12:44:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.j58xdbdoyIblsRw9RhbBwrkQJMmw71c_0 2024-09-14T12:44:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18084017580483020087', time=2024-09-14T14:00:21.548328+0000, chain.objs.size()=1 2024-09-14T12:44:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.X6wfG4bfilq-feUgxgSsgaqWCMXhYQ8_0 2024-09-14T12:44:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16337149449579065144', time=2024-09-14T14:00:22.517107+0000, chain.objs.size()=1 2024-09-14T12:44:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tHA04KZ1n9_gLbjliEQbFEACBuORM-c_0 2024-09-14T12:44:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9249129728524892518', time=2024-09-14T14:00:22.679800+0000, chain.objs.size()=1 2024-09-14T12:44:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VsEaOdnAgFfKTVUVZitmdgHVBf5DRPa_0 2024-09-14T12:44:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.946018136573768016', time=2024-09-14T14:00:22.794237+0000, chain.objs.size()=1 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.X1Sl4StWMRQuYh6GkFLsz9OBzML9SYz_0 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3768592753138761470', time=2024-09-14T14:00:22.906858+0000, chain.objs.size()=1 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FAYH38HGIEOpleXQw32hjIXuDiHXLRK_0 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14973962567268461813', time=2024-09-14T14:00:23.526530+0000, chain.objs.size()=1 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Fzbt11mSK_nm9vMTJgl8kL7vfa-3dee_0 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10807426965634591399', time=2024-09-14T14:00:23.956446+0000, chain.objs.size()=1 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NYgeDn_RxKaeFQPR563mqdOGJGDJ5N9_0 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4155952987838387604', time=2024-09-14T14:00:26.306171+0000, chain.objs.size()=1 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HllcZWS1Av8f6w2i4hn33JVuFXtSRux_0 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8415064269523605209', time=2024-09-14T14:00:26.818504+0000, chain.objs.size()=1 2024-09-14T12:44:04.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.013+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Y_rDexEM77MiRhDKYmmtf1Eme3bm-xB_0 2024-09-14T12:44:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.017+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10032562197089917055', time=2024-09-14T14:00:27.891437+0000, chain.objs.size()=1 2024-09-14T12:44:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.017+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.PpnnerDWGDYbP7Tu76RHf-JuKzH1UFB_0 2024-09-14T12:44:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.017+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9874261668665345490', time=2024-09-14T14:00:30.298500+0000, chain.objs.size()=1 2024-09-14T12:44:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.017+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cVU-UY16yjslrlKukDTUTCy4BqlKo_x_0 2024-09-14T12:44:04.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13208919538729531833', time=2024-09-14T14:00:31.130033+0000, chain.objs.size()=1 2024-09-14T12:44:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.b7p7tayqgyBM9B4_g4pcyAIv-1rHdv4_0 2024-09-14T12:44:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4346729955160616883', time=2024-09-14T14:00:31.247958+0000, chain.objs.size()=1 2024-09-14T12:44:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.H7y9BK8i70cxA0wW2a0qdPCyClYUEte_0 2024-09-14T12:44:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8112361418992030497', time=2024-09-14T14:00:31.914474+0000, chain.objs.size()=1 2024-09-14T12:44:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1HxuMlsdPX0TqBrtu8ZM7vX6oNVe0dP_0 2024-09-14T12:44:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9712515031231123176', time=2024-09-14T14:00:33.378746+0000, chain.objs.size()=1 2024-09-14T12:44:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tmNd09R44YG1NCUuZfgNiL_fRF82CFR_0 2024-09-14T12:44:04.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15669315025573220928', time=2024-09-14T14:00:35.637285+0000, chain.objs.size()=1 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qEIiuFWHadvUyx-5yHj_uATk2O1Ggpo_0 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2634073033347874773', time=2024-09-14T14:00:37.241474+0000, chain.objs.size()=1 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vUAtFnr05phcTnwH-QHbRRKIxz-r_X-_0 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2055766537422808011', time=2024-09-14T14:00:37.386776+0000, chain.objs.size()=1 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2HEjtHXhYjYqLex4fKv8Qz8ChYE0c5y_0 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3931606329940302888', time=2024-09-14T14:00:37.781711+0000, chain.objs.size()=1 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ojjp5dCa1-PvuQVCqlK2yFUr5GvAlDb_0 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17686151429966606845', time=2024-09-14T14:00:38.083106+0000, chain.objs.size()=1 2024-09-14T12:44:04.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.021+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Np-j7iC6HHo5thLyNUY23h0nN8DV_16_0 2024-09-14T12:44:04.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10561172274771334730', time=2024-09-14T14:00:38.909768+0000, chain.objs.size()=1 2024-09-14T12:44:04.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fafrdoUof7MzFsH0JMjpdU8nsN2b_jy_0 2024-09-14T12:44:04.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15175638954095518626', time=2024-09-14T14:00:38.911406+0000, chain.objs.size()=1 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pf2sENKDBUvEwEvstrjLLBuU96MKAWU_0 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8356753490369779951', time=2024-09-14T14:00:39.295311+0000, chain.objs.size()=1 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j8FaDhQjZ1dRzdaQCzmSEhpAP9bPfNT_0 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161655095932412283', time=2024-09-14T14:00:39.439468+0000, chain.objs.size()=1 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ZEzFMlNWkuZcTs0NiKgKmrUFaioEIqQ_0 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14188722747289588469', time=2024-09-14T14:00:40.471115+0000, chain.objs.size()=1 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.akyF4h1URtXpOXWKVqEuZYI0xA5sffG_0 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16165624710001633276', time=2024-09-14T14:00:41.925789+0000, chain.objs.size()=1 2024-09-14T12:44:04.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5vfSZYTT1PKw5i-JlBw8rRIPko4-1h2_0 2024-09-14T12:44:04.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6567718844468526210', time=2024-09-14T14:00:42.178661+0000, chain.objs.size()=1 2024-09-14T12:44:04.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.025+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JXeDIwqkjjEabFxko-jLF-1gnYCUcWL_0 2024-09-14T12:44:04.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.029+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/73367 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.757340514154515113', time=2024-09-14T14:00:42.408268+0000, chain.objs.size()=1 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.PZWjD6FjgJpGzBLv7LcDjAzbF-E3Ezh_0 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.562281862576325991', time=2024-09-14T14:00:42.612994+0000, chain.objs.size()=1 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-QMvs2APMW1LtKxdZxTowUZ7KO5wqho_0 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16552375692380208339', time=2024-09-14T14:00:42.614993+0000, chain.objs.size()=1 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5rAMwZOSPLDgF1Jen-fpOG6PABgVYPP_0 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.769082164009538782', time=2024-09-14T14:00:44.059940+0000, chain.objs.size()=1 2024-09-14T12:44:04.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AkM5ePzNxtXKgl2PpPmN1FcUllLrwuw_0 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8299014695814161208', time=2024-09-14T14:00:45.784264+0000, chain.objs.size()=1 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.paAlUjjTk-gmACUXNFYW4I4X4K1_Oze_0 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.729254783815798340', time=2024-09-14T14:00:46.254919+0000, chain.objs.size()=1 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IUvzIiyG9UnwSBOqTk__PK315d4thIv_0 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13629984189593416006', time=2024-09-14T14:00:46.729719+0000, chain.objs.size()=1 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Jy7es74HQ_RqdNHBe4-GE5DkU93GY1O_0 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15960506481248342631', time=2024-09-14T14:00:47.631278+0000, chain.objs.size()=1 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-P_LaGBjL5-trWJVWqhVcAAX1MfIWic_0 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4729576691520383637', time=2024-09-14T14:00:49.914088+0000, chain.objs.size()=1 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.GCyf6UVsxm5n-z_5HOACvyKPKlpBIRk_0 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2701656944945873000', time=2024-09-14T14:01:07.345529+0000, chain.objs.size()=1 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.333__shadow_.JEYuj_0NzVbaFwI8QoxchXgHGgM8DIT_0 2024-09-14T12:44:04.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2910931918526251595', time=2024-09-14T14:05:49.654715+0000, chain.objs.size()=1 2024-09-14T12:44:04.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.458__shadow_.zv_10x-idNfa-TZ7weJIOIWUuXqiZ5O_0 2024-09-14T12:44:04.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.932137739477456327', time=2024-09-14T14:06:46.799440+0000, chain.objs.size()=1 2024-09-14T12:44:04.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.033+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.UAPC_MLC-Ix_jgcYPIkYD140Ioh-PYQ_0 2024-09-14T12:44:04.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13684565739720351548', time=2024-09-14T14:06:49.694026+0000, chain.objs.size()=1 2024-09-14T12:44:04.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.485__shadow_.baM1OR2cz97SULAh7ToGYgAg2Lgqv9a_0 2024-09-14T12:44:04.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8', time=2024-09-14T14:13:37.470722+0000, chain.objs.size()=1 2024-09-14T12:44:04.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8.1 2024-09-14T12:44:04.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8', time=2024-09-14T14:13:37.481056+0000, chain.objs.size()=1 2024-09-14T12:44:04.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8.2 2024-09-14T12:44:04.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8', time=2024-09-14T14:13:37.490538+0000, chain.objs.size()=1 2024-09-14T12:44:04.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8.3 2024-09-14T12:44:04.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8', time=2024-09-14T14:13:37.500370+0000, chain.objs.size()=1 2024-09-14T12:44:04.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.037+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8.4 2024-09-14T12:44:04.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8', time=2024-09-14T14:13:37.510154+0000, chain.objs.size()=1 2024-09-14T12:44:04.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8.5 2024-09-14T12:44:04.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8', time=2024-09-14T14:13:37.519562+0000, chain.objs.size()=1 2024-09-14T12:44:04.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~eFmJoqNMvRj2OFuf7BHm337D2Dql7A8.6 2024-09-14T12:44:04.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6136582850274541721', time=2024-09-14T14:14:52.283651+0000, chain.objs.size()=5 2024-09-14T12:44:04.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~k7yM799qY5WVqDjRy6zILVF15YF-al-.1 2024-09-14T12:44:04.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__shadow_mymultipart.2~k7yM799qY5WVqDjRy6zILVF15YF-al-.1_1 2024-09-14T12:44:04.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~k7yM799qY5WVqDjRy6zILVF15YF-al-.2 2024-09-14T12:44:04.031 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__shadow_mymultipart.2~k7yM799qY5WVqDjRy6zILVF15YF-al-.2_1 2024-09-14T12:44:04.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~k7yM799qY5WVqDjRy6zILVF15YF-al-.3 2024-09-14T12:44:04.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12157072618480444855', time=2024-09-14T14:18:14.425265+0000, chain.objs.size()=1 2024-09-14T12:44:04.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.041+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.557__shadow_.MNF1Z9YYvq4Fr7WVktPxm5LAQshxOaD_0 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7817830733257337014', time=2024-09-14T14:19:59.970733+0000, chain.objs.size()=1 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow_.8ybbxiHDoIdlh2XiGMBw6-27x5btv5U_0 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7863172937564726636', time=2024-09-14T14:20:20.189454+0000, chain.objs.size()=1 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:Dwi2E1XwFs8wtJEEZvtFAMNP7aM4rqb_.zsLix1xOshwcGJuQxiHveYr9xzFReSz_0 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18222565953794787688', time=2024-09-14T14:22:15.775134+0000, chain.objs.size()=1 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:oyGf-ISpU1S27FbBH8c8mY5OhK2luOv_.8c2cs3P3W1-2iU8fGMX5glYz9K8CNBm_0 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17545044251882392647', time=2024-09-14T14:31:16.598355+0000, chain.objs.size()=2 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.651__shadow_.qWFAiwLZctDP3IWHR3XQUEGrtsUd0NV_0 2024-09-14T12:44:04.034 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.651__shadow_.qWFAiwLZctDP3IWHR3XQUEGrtsUd0NV_1 2024-09-14T12:44:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7006743636479584060', time=2024-09-14T14:31:40.653883+0000, chain.objs.size()=1 2024-09-14T12:44:04.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.045+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.657__shadow_.ktp9jazLHVPxwKeD-v_UT11eet6uJQB_0 2024-09-14T12:44:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1292133505488061139', time=2024-09-14T14:32:36.236262+0000, chain.objs.size()=1 2024-09-14T12:44:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.664__shadow_.wSG8vUdiP58RPFXDHKTA8joQoqy4lIk_0 2024-09-14T12:44:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5696329677266781576', time=2024-09-14T14:33:47.780078+0000, chain.objs.size()=1 2024-09-14T12:44:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.698__shadow:py98jrMKauS7hIsQCYrBczph1Ltt6ds_.Qiv2KDD7OZ2tTp8BRiI05hgOzGYEIFn_0 2024-09-14T12:44:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7648731507394201327', time=2024-09-14T14:35:28.547280+0000, chain.objs.size()=1 2024-09-14T12:44:04.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.735__shadow_.qMzPcI7kukm2K3RbNVhvKNfOEaYTkgD_0 2024-09-14T12:44:04.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.049+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~kx1icsnvzfIWbVFhYLp2F-1VJhilDMN', time=2024-09-14T14:36:14.987432+0000, chain.objs.size()=1 2024-09-14T12:44:04.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.049+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.743__multipart_mymultipart.2~kx1icsnvzfIWbVFhYLp2F-1VJhilDMN.1 2024-09-14T12:44:04.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.053+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T12:44:04.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47549' 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1408851033443438966', time=2024-09-14T13:42:14.270451+0000, chain.objs.size()=1 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.149__shadow_.MFOeS3cRb2sLq_s0Yr5F783pbnTxTuj_0 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_AHmD39ajGhu8eemozFPAiWl5U-foo3Q', time=2024-09-14T13:44:28.218553+0000, chain.objs.size()=1 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.166__shadow_.rZ0iUq-Nfb9p_2FdmsvT2Kj7QD_OBv5_0 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16010492706825641327', time=2024-09-14T13:50:04.840437+0000, chain.objs.size()=1 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.234__shadow_.VUA5Wckk8gCxbNv3QcIUDSk8sB849wz_0 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17747959286905817548', time=2024-09-14T13:50:30.285992+0000, chain.objs.size()=1 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.243__shadow_.bppfCfnzND57vgQA1CQ-QpIbr2lBTPV_0 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14517628416942558730', time=2024-09-14T13:50:38.434740+0000, chain.objs.size()=1 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.245__shadow_.2VP9ICETsQqYAgR4p6Ub9smikhJrtwV_0 2024-09-14T12:44:04.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15875073765664173318', time=2024-09-14T13:50:48.489403+0000, chain.objs.size()=1 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.249__shadow_.ZjOkSlVyjbMLQ18EAiohCnNxiVTxipO_0 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.650563651979138487', time=2024-09-14T13:50:53.623945+0000, chain.objs.size()=1 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.251__shadow_.xcPp8TK3h4ckTdMPS4cTlqevT7ogbzm_0 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.366915804898274925', time=2024-09-14T13:51:11.027947+0000, chain.objs.size()=1 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.258__shadow_.w3kQpx4I_nnnCG_f1us5uf_MIwZ2oYe_0 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1600752367577912679', time=2024-09-14T13:51:15.858318+0000, chain.objs.size()=1 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.260__shadow_.X2gGpN4DsTWuSkI2mpvzPSph87PZxox_0 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1115982390651942498', time=2024-09-14T13:53:05.523464+0000, chain.objs.size()=1 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LVf8Eo9lPZhKbhZHkj_PYfbmn8PaZWQ_0 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2039434203766609623', time=2024-09-14T13:53:05.527905+0000, chain.objs.size()=1 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cn7_mPfgDNpF6ntIk4myakv7GhVk6j__0 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12055361417813969741', time=2024-09-14T13:53:05.775441+0000, chain.objs.size()=1 2024-09-14T12:44:04.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.057+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fclhfuIM-N-Ydd_TPoU41oHCvVW51Hm_0 2024-09-14T12:44:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2321239093876113638', time=2024-09-14T13:53:05.895220+0000, chain.objs.size()=1 2024-09-14T12:44:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.tPk9E73CUJN539FS-LIunyfdy-V7sRk_0 2024-09-14T12:44:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1214974179282108857', time=2024-09-14T13:53:06.187193+0000, chain.objs.size()=1 2024-09-14T12:44:04.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TeMujfA5EqL0qTC4x6JBbFo4kf1DTJn_0 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6271325842045872579', time=2024-09-14T13:53:07.627655+0000, chain.objs.size()=1 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6Jn4N3WJt48XKiq6Yf2iDnBpww2X17Z_0 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.061+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6382665558564019885', time=2024-09-14T13:53:10.196201+0000, chain.objs.size()=1 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.061+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0s2XSIcZpinm7r01735JswcS3HESx2M_0 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1650697182903976176', time=2024-09-14T13:53:10.488576+0000, chain.objs.size()=1 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2nN2KxxzWwl2UfIKgUDQBdv8Chi4KTw_0 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.374009022517475864', time=2024-09-14T13:53:11.404894+0000, chain.objs.size()=1 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ggJwhMweXrVOHfVuWVx0coG8-S04Uay_0 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9457070208816201988', time=2024-09-14T13:53:12.567395+0000, chain.objs.size()=1 2024-09-14T12:44:04.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bjGHYs0CGfhyqIovSX2GmC6PlNjW78G_0 2024-09-14T12:44:04.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.690623421786916677', time=2024-09-14T13:53:13.674934+0000, chain.objs.size()=1 2024-09-14T12:44:04.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xhXZDJHaiC63L6qEGMYB2-axd-EHS9C_0 2024-09-14T12:44:04.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18236980752083877939', time=2024-09-14T13:53:14.117067+0000, chain.objs.size()=1 2024-09-14T12:44:04.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Cx_u6O2dLXB7FXnbNu2zzk7cdH-VYxl_0 2024-09-14T12:44:04.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14170303702475595510', time=2024-09-14T13:53:14.128194+0000, chain.objs.size()=1 2024-09-14T12:44:04.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.P6OtsfPa9Wzx4UfieoaEYIfu7tGdy3I_0 2024-09-14T12:44:04.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18330861730155652526', time=2024-09-14T13:53:19.665065+0000, chain.objs.size()=1 2024-09-14T12:44:04.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.065+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.E-A7r4TPL5VivNHamDPMEXN9Qu_MkHY_0 2024-09-14T12:44:04.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8141181727630751774', time=2024-09-14T13:53:19.811229+0000, chain.objs.size()=1 2024-09-14T12:44:04.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.04Pb7pQfrJXpJqbx8qgYWv1JKYv7MTF_0 2024-09-14T12:44:04.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8787587509492548133', time=2024-09-14T13:53:20.040769+0000, chain.objs.size()=1 2024-09-14T12:44:04.058 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TVawkiKK17O9HMXXWxdlN5MQ0-GXUcx_0 2024-09-14T12:44:04.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3899334910763392631', time=2024-09-14T13:53:21.574435+0000, chain.objs.size()=1 2024-09-14T12:44:04.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cKdRf1Cek9HXt-_iTorKwe5wvlXhQ-C_0 2024-09-14T12:44:04.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18137215158910415772', time=2024-09-14T13:53:21.911518+0000, chain.objs.size()=1 2024-09-14T12:44:04.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9SIr35mkCYUPqlmHbGqSEeWPd3J-Azz_0 2024-09-14T12:44:04.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14782336628592097626', time=2024-09-14T13:53:22.402751+0000, chain.objs.size()=1 2024-09-14T12:44:04.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OUU9OYhQFYYKtCfAgBbiZfvm4TYdzBD_0 2024-09-14T12:44:04.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8186421725949064961', time=2024-09-14T13:53:23.257146+0000, chain.objs.size()=1 2024-09-14T12:44:04.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bR7M9HAZbxiQxiFrTERY-Sn6oRp7YHC_0 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5155341303893493887', time=2024-09-14T13:53:23.258928+0000, chain.objs.size()=1 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.SujvQUPIIAlzWSo4InGQk60upn4auDg_0 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10291646397112757633', time=2024-09-14T13:53:23.374639+0000, chain.objs.size()=1 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yvvu0CAUHwsH1qWZAH3R2SfByw42LEJ_0 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12961166869662686443', time=2024-09-14T13:53:24.097273+0000, chain.objs.size()=1 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.069+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yq7vj6CAsIMEpyAZg7Zi8qzohZbiJat_0 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5244462519010944512', time=2024-09-14T13:53:25.240663+0000, chain.objs.size()=1 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8xaFhddCSDrLDAUHw8AzwGqcu70drDP_0 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4775537582118331165', time=2024-09-14T13:53:26.362933+0000, chain.objs.size()=1 2024-09-14T12:44:04.062 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ooo6Y1RPFna2vy9zSsEtrpfmLVDUKuy_0 2024-09-14T12:44:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.073+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5081323455167915686', time=2024-09-14T13:53:26.364766+0000, chain.objs.size()=1 2024-09-14T12:44:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.073+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ylEZE2PrkfWPPeBo7Z412SQb9uBZzzv_0 2024-09-14T12:44:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10085409026415807897', time=2024-09-14T13:53:27.574426+0000, chain.objs.size()=1 2024-09-14T12:44:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.a_cfyIX1yzZci6nlKQDRtOiZfLra0t8_0 2024-09-14T12:44:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3502890001816881061', time=2024-09-14T13:53:27.822084+0000, chain.objs.size()=1 2024-09-14T12:44:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OrvotxLGQLuPncnZsaCqqrEw8F5iVjE_0 2024-09-14T12:44:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1131192515733834911', time=2024-09-14T13:53:27.903471+0000, chain.objs.size()=1 2024-09-14T12:44:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GqSuN8-DnmjqnER0jjWkh8y6xMonIhP_0 2024-09-14T12:44:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5846890502388247017', time=2024-09-14T13:53:27.953002+0000, chain.objs.size()=1 2024-09-14T12:44:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.baWUL0w6bntTKnwI4S_3KNxEdoQym5Z_0 2024-09-14T12:44:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1338878727676491469', time=2024-09-14T13:53:29.138156+0000, chain.objs.size()=1 2024-09-14T12:44:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xXO5bOdVVJdOe0R7iK4mzMALcc9LEZ__0 2024-09-14T12:44:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5981344352551068696', time=2024-09-14T13:53:29.424713+0000, chain.objs.size()=1 2024-09-14T12:44:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Pk3XF1A6cp9MsTHMRN8X7t5-_fFz9v-_0 2024-09-14T12:44:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11586297971437121994', time=2024-09-14T13:53:29.837883+0000, chain.objs.size()=1 2024-09-14T12:44:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7x1YkzilVp4tCSYHOvBpuuXpsEWshc7_0 2024-09-14T12:44:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2130649646293457125', time=2024-09-14T13:53:30.459860+0000, chain.objs.size()=1 2024-09-14T12:44:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8Rl-9SEpjcWJlfNgFTVJds6NZDtExxc_0 2024-09-14T12:44:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10882276985818260689', time=2024-09-14T13:53:30.552878+0000, chain.objs.size()=1 2024-09-14T12:44:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cTzOaCt3asdH9ckzu3mpGlT7Sms-2VU_0 2024-09-14T12:44:04.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4161291326069791532', time=2024-09-14T13:53:31.370670+0000, chain.objs.size()=1 2024-09-14T12:44:04.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EFbjvkEvcYhQlMUj5Mch9lOQwSssIc0_0 2024-09-14T12:44:04.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12479550780622174618', time=2024-09-14T13:53:31.558972+0000, chain.objs.size()=1 2024-09-14T12:44:04.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.077+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._Vj2JTiCLf6rwQH-c6tHTqLpweNI2NV_0 2024-09-14T12:44:04.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1751689917966362451', time=2024-09-14T13:53:31.671561+0000, chain.objs.size()=1 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9IvlDFuyE9944OLy_sdXyAda_TE6q7-_0 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1605320818306880683', time=2024-09-14T13:53:32.038142+0000, chain.objs.size()=1 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OZkKXBStNIWNsquXJpoNT5H1OEwSGIP_0 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1743191595095680488', time=2024-09-14T13:53:32.807373+0000, chain.objs.size()=1 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XwVu1khrMCP-REu9AV_LReklYA6GvtL_0 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10929488134000008417', time=2024-09-14T13:53:33.517126+0000, chain.objs.size()=1 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UQ37t5zNUSdR7Di60THsTOBRicQcUJ4_0 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4882416560087731588', time=2024-09-14T13:53:33.762787+0000, chain.objs.size()=1 2024-09-14T12:44:04.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.081+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fuIiCqZQec1CHalCO2CM_OPu5Ya06W3_0 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2968137791516937505', time=2024-09-14T13:53:34.088929+0000, chain.objs.size()=1 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eyWbPfeU3FFrPofGdV6WRSh3NSve_6c_0 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2569522713102492813', time=2024-09-14T13:53:34.311789+0000, chain.objs.size()=1 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JwZ2rm88-Qi3o5yVk9wgwTRKBypdVLy_0 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12559300750442256063', time=2024-09-14T13:53:34.313930+0000, chain.objs.size()=1 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6vp2FH7LOenMivAzg6Ce4joyqK2oJ8W_0 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18051392027743891059', time=2024-09-14T13:53:34.998769+0000, chain.objs.size()=1 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.i_YlZW2CLBkd5hMbpvserOSIsVCb9mT_0 2024-09-14T12:44:04.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5857186388365729819', time=2024-09-14T13:53:49.599409+0000, chain.objs.size()=1 2024-09-14T12:44:04.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.269__shadow_.5qo-aR1-Ejx88gXztWyZX0f96-vkJQ-_0 2024-09-14T12:44:04.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16964357859447652330', time=2024-09-14T13:53:59.079356+0000, chain.objs.size()=1 2024-09-14T12:44:04.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.273__shadow_.8Ft4_LalSqWTyDPWqxtwkY0t7QCXBvz_0 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6845208257254941974', time=2024-09-14T13:53:59.080730+0000, chain.objs.size()=1 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.273__shadow_.VcNSjAct1aA8wzR2qXeV7F4ckgZcKsR_0 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.837124298516712690', time=2024-09-14T13:58:05.876485+0000, chain.objs.size()=1 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.AyaE-nvNSp80rUUjciPVTthNXwFG372_0 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4608691969000696755', time=2024-09-14T13:58:05.932315+0000, chain.objs.size()=1 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Ft7HE89tGfT7yq1otvqFTBJq2b2Tbzi_0 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7898729806947381000', time=2024-09-14T13:58:05.934021+0000, chain.objs.size()=1 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PEJ4HvztcKL7t_ercmr7-3Z8HDrbYQp_0 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11530915062188595007', time=2024-09-14T13:58:07.194478+0000, chain.objs.size()=1 2024-09-14T12:44:04.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.085+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xNTiifo-7wjvkdK2cNx7gf9o3vYaJun_0 2024-09-14T12:44:04.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11817423336923030375', time=2024-09-14T13:58:07.587801+0000, chain.objs.size()=1 2024-09-14T12:44:04.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.o1apCZ9A6SWhgLmR_N3nT78OjYarB5H_0 2024-09-14T12:44:04.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11470210004714579259', time=2024-09-14T13:58:09.677467+0000, chain.objs.size()=1 2024-09-14T12:44:04.080 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mWzkHSK_4nDk0zE0NGitdFQvZSsH2Wf_0 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10087409732327960271', time=2024-09-14T13:58:09.678709+0000, chain.objs.size()=1 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._hHo9cWMchlN7JUwD0Tldq87SZQZ6D3_0 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.380200141768818322', time=2024-09-14T13:58:09.988721+0000, chain.objs.size()=1 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pqwpZgwnBN51mBo0nfhx-S-smUnE0eN_0 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3632279721638641023', time=2024-09-14T13:58:10.484608+0000, chain.objs.size()=1 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.buX1S-hxuGCbwplPZ14xgppLeIYOfXf_0 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4447506632349910475', time=2024-09-14T13:58:10.519671+0000, chain.objs.size()=1 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.OVT9G9qT5IHoDBbZZzLqUbRfOWYBsai_0 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17137805634140852468', time=2024-09-14T13:58:12.337971+0000, chain.objs.size()=1 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hBNjTd4_ZpQpfrY3Ft-qio93TYeF41w_0 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15911405506897831825', time=2024-09-14T13:58:13.521068+0000, chain.objs.size()=1 2024-09-14T12:44:04.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.089+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7nctzcNLiuvkNGXSTzcg2cGy0fv5TIw_0 2024-09-14T12:44:04.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4002038533666796212', time=2024-09-14T13:58:15.391510+0000, chain.objs.size()=1 2024-09-14T12:44:04.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Jm-sCSKH0_7EnozfMIGuKLwYAarI55v_0 2024-09-14T12:44:04.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12823526616310013923', time=2024-09-14T13:58:17.549050+0000, chain.objs.size()=1 2024-09-14T12:44:04.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.z882dUprZdjrpIYsKZ_AAh4PH6Qa8Gc_0 2024-09-14T12:44:04.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4950154868378298703', time=2024-09-14T13:58:18.389977+0000, chain.objs.size()=1 2024-09-14T12:44:04.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qimu1Kaf-klFzWrFqgkiZXbW2fOS93o_0 2024-09-14T12:44:04.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.093+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16363650011048300943', time=2024-09-14T13:58:18.496699+0000, chain.objs.size()=1 2024-09-14T12:44:04.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.093+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QZjZTeEd1kq7_Rbuttg4VjmZfHUTmmR_0 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1724348406057200505', time=2024-09-14T13:58:18.508282+0000, chain.objs.size()=1 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.t3RwF4WBARjC-cFgT_5ReXwzi3OMxI__0 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2033377558846133572', time=2024-09-14T13:58:18.749926+0000, chain.objs.size()=1 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.5wNcOdz5mr6v5lbNjLoNNfqXvQmhkI3_0 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2064991896571886736', time=2024-09-14T13:58:19.830870+0000, chain.objs.size()=1 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.U0762pFYibUbUf5wH3n6_LOh55mDGZI_0 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18298344280441843871', time=2024-09-14T13:58:22.092680+0000, chain.objs.size()=1 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Sf-PAm11tboc8umMb1GCpTA5MC5-Cqf_0 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9689229722472823820', time=2024-09-14T13:58:22.867581+0000, chain.objs.size()=1 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZIkcLMb5XkXLhg_h7gSg58-16jUGaGi_0 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2815290453943014020', time=2024-09-14T13:58:24.887729+0000, chain.objs.size()=1 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2F_qsYv5UybPYveVxzdusNiJZMeDZkX_0 2024-09-14T12:44:04.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11263065190521160331', time=2024-09-14T13:58:25.211822+0000, chain.objs.size()=1 2024-09-14T12:44:04.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.RKlKVaywY8CSy2o0tvgUf9gGgW42oEK_0 2024-09-14T12:44:04.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12497448878333760672', time=2024-09-14T13:58:27.169843+0000, chain.objs.size()=1 2024-09-14T12:44:04.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.o5y-R3yKDrgjUPYEMUztjH_G416x7on_0 2024-09-14T12:44:04.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11322699671774278389', time=2024-09-14T13:58:29.149430+0000, chain.objs.size()=1 2024-09-14T12:44:04.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GxXdPv2YPOIYuceaAH4YUM5dVPJlUh-_0 2024-09-14T12:44:04.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9220953285619540571', time=2024-09-14T13:58:29.354326+0000, chain.objs.size()=1 2024-09-14T12:44:04.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.097+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EqkOVMzZjYqg7GQ8dR-xtGoglLD1AnN_0 2024-09-14T12:44:04.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2265065285980701769', time=2024-09-14T13:58:30.628137+0000, chain.objs.size()=1 2024-09-14T12:44:04.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kSTHbDfBZO2ox9kIqG3pNEWadv2ICey_0 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2941554160435178760', time=2024-09-14T13:58:32.216198+0000, chain.objs.size()=1 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VpIcxU8dDVH6zXmGps7AgKrsW_f_a9R_0 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16142210314991104090', time=2024-09-14T13:58:33.666266+0000, chain.objs.size()=1 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._pcQrafrmVO0QVdACah1PqkcxNL9lMj_0 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15488481172181526076', time=2024-09-14T14:00:21.004706+0000, chain.objs.size()=1 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qt2aCTPlf5YsMU-g-T6SoBEzhn3njn7_0 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2527572960358418476', time=2024-09-14T14:00:21.054322+0000, chain.objs.size()=1 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FkKGPyzrJ6oSEacCstJ55ErJknXZfZX_0 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.19951569857369091', time=2024-09-14T14:00:22.910179+0000, chain.objs.size()=1 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8a1xzl9QTozdfscVcLYTE3P6PZOMMCF_0 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10699895149674945817', time=2024-09-14T14:00:22.937727+0000, chain.objs.size()=1 2024-09-14T12:44:04.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UaTIPXNdK7THnmcCcwuk7rpjCm9JQai_0 2024-09-14T12:44:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6736812529780493157', time=2024-09-14T14:00:23.055604+0000, chain.objs.size()=1 2024-09-14T12:44:04.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.101+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.igu1Y9isLTnuFrs17anXv3KGmOv4Ar4_0 2024-09-14T12:44:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.245383430601936880', time=2024-09-14T14:00:25.063074+0000, chain.objs.size()=1 2024-09-14T12:44:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WHcIVsbiwSY85K8WlYHRWQETH2o1Lhh_0 2024-09-14T12:44:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3398246900386740589', time=2024-09-14T14:00:25.355505+0000, chain.objs.size()=1 2024-09-14T12:44:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VE5e77YEsQFf1Pl8YSnt2aKTriqkM6W_0 2024-09-14T12:44:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.302001498358579024', time=2024-09-14T14:00:26.193151+0000, chain.objs.size()=1 2024-09-14T12:44:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LEAaMdcfhw7jkIGQRXQQ5z5F8_HeMtR_0 2024-09-14T12:44:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3132676203162716056', time=2024-09-14T14:00:26.391777+0000, chain.objs.size()=1 2024-09-14T12:44:04.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HPEC4yav8Sezw5DwkAVLMcl6HfKbFhz_0 2024-09-14T12:44:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12682472571682024657', time=2024-09-14T14:00:27.331498+0000, chain.objs.size()=1 2024-09-14T12:44:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SRKPwhcIjCBgZvws5qDMw5AQGSRa074_0 2024-09-14T12:44:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1806276834696930040', time=2024-09-14T14:00:27.419472+0000, chain.objs.size()=1 2024-09-14T12:44:04.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.105+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.f1XTYVsntd6Rw6eOtt8dqotR-bp3ogV_0 2024-09-14T12:44:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16049243712547260979', time=2024-09-14T14:00:27.585496+0000, chain.objs.size()=1 2024-09-14T12:44:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uX9IOSYoQ0i9BUvAhxe-stu64g0ZBDL_0 2024-09-14T12:44:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.109+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11254430250114159867', time=2024-09-14T14:00:30.128460+0000, chain.objs.size()=1 2024-09-14T12:44:04.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.109+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.enzU6Y0bA9nrH4hlFLTOwuBlAlIFuKB_0 2024-09-14T12:44:04.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47549 2024-09-14T12:44:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=42, truncated=0, next_marker='' 2024-09-14T12:44:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3843152448441171978', time=2024-09-14T14:00:30.139810+0000, chain.objs.size()=1 2024-09-14T12:44:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SIh4Pbl10UEkLYk2IJHAGmD9iKz13fY_0 2024-09-14T12:44:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.851738079902793821', time=2024-09-14T14:00:31.195180+0000, chain.objs.size()=1 2024-09-14T12:44:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zynWJaBDHuIlN91h9oKMQAHy7FEOzXf_0 2024-09-14T12:44:04.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10164426863938900805', time=2024-09-14T14:00:31.690211+0000, chain.objs.size()=1 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CwYbYlPlLHyvCquN8_WPjc7atZSj7fY_0 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3718659682492675430', time=2024-09-14T14:00:33.696229+0000, chain.objs.size()=1 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.oE3kX6Yw5mKlWrZC7d8RfHa4g9rZeEV_0 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15592201372406919856', time=2024-09-14T14:00:34.080887+0000, chain.objs.size()=1 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8uTMzX51Dv_PomCqfYN0oOHAsl0zzpF_0 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4349538451958217437', time=2024-09-14T14:00:37.182762+0000, chain.objs.size()=1 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QSFNJ3-Js0zCAAnKefgPLUyoBaHVgPj_0 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16508701730849806737', time=2024-09-14T14:00:37.355151+0000, chain.objs.size()=1 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Bt6fIIF6U48ylUAC0RtY4eNMHYOvSrR_0 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7337819585122993740', time=2024-09-14T14:00:38.086299+0000, chain.objs.size()=1 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KkHZmnNgAfaT4aGArVzcFWZ8jP8kLNR_0 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3874607083000720085', time=2024-09-14T14:00:38.535497+0000, chain.objs.size()=1 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.7GY65Y_8kxgrG51lrfW1UPLsXrg9Zx-_0 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5824626033740353871', time=2024-09-14T14:00:39.123664+0000, chain.objs.size()=1 2024-09-14T12:44:04.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.MagVWe85Y6Eory-RJ8e8RXtTmzYblp3_0 2024-09-14T12:44:04.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8636012993289701325', time=2024-09-14T14:00:39.316677+0000, chain.objs.size()=1 2024-09-14T12:44:04.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wx1NQOpCXBFBTErSjCM9tZVwyVngTJS_0 2024-09-14T12:44:04.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7292703282830756547', time=2024-09-14T14:00:39.517367+0000, chain.objs.size()=1 2024-09-14T12:44:04.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.113+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zm6tacgtqLjmcSVpuJLHO4t2hYLP1Jr_0 2024-09-14T12:44:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11756391848642639556', time=2024-09-14T14:00:41.705868+0000, chain.objs.size()=1 2024-09-14T12:44:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fTzb37DWWeq0ZZ6lxevD4WYxWJtO3ba_0 2024-09-14T12:44:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.117+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11707987489079125120', time=2024-09-14T14:00:41.774864+0000, chain.objs.size()=1 2024-09-14T12:44:04.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.117+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-iDhSLRYettaIb5LGCUjtJT1d4iRz84_0 2024-09-14T12:44:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5679563213508989714', time=2024-09-14T14:00:42.748465+0000, chain.objs.size()=1 2024-09-14T12:44:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.8FuBQh-5Exe6RMO-SasgFJ8V_LDfKa8_0 2024-09-14T12:44:04.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15341447998809412247', time=2024-09-14T14:00:43.252246+0000, chain.objs.size()=1 2024-09-14T12:44:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JUZPytl6eg3fwKn8OtIJzCQ7LeGdkoG_0 2024-09-14T12:44:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17596649851716387701', time=2024-09-14T14:00:44.523973+0000, chain.objs.size()=1 2024-09-14T12:44:04.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JT1TowtUEgsv46cXLvwD6qlF_XCevm1_0 2024-09-14T12:44:04.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7530828237063615520', time=2024-09-14T14:00:45.555385+0000, chain.objs.size()=1 2024-09-14T12:44:04.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uCuCOaIi3_-Vu77Ndova5qsqsGfG_Yb_0 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11249809305884118731', time=2024-09-14T14:00:45.903413+0000, chain.objs.size()=1 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.0TYfioN7xJjB6OBz2ELrxjz9-NAxx_J_0 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5240592240006801303', time=2024-09-14T14:00:46.402887+0000, chain.objs.size()=1 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6YsrcI_hatH-Xq0ijyFVqYlE6nA37GS_0 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15778790194150437419', time=2024-09-14T14:00:46.468779+0000, chain.objs.size()=1 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.22jHYveUaRG4HQw69WNr7Vwo9fdkh6M_0 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3553091162124535521', time=2024-09-14T14:00:46.934267+0000, chain.objs.size()=1 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.eZ4k-1iYBypeSXTcOQ0aaGWdCSetusc_0 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9519264182041894797', time=2024-09-14T14:00:48.325920+0000, chain.objs.size()=1 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.51NpjzxRwgiKSEJ8KW_X3Lel3JghZGA_0 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8214952364694148815', time=2024-09-14T14:00:48.671163+0000, chain.objs.size()=1 2024-09-14T12:44:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.121+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.K0n128dqA00GxsWAR2QvXAmQMPBHLca_0 2024-09-14T12:44:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6957523525246442173', time=2024-09-14T14:00:49.477183+0000, chain.objs.size()=1 2024-09-14T12:44:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._FXBPIxG0z0NU4Vxzl9XXfc-oegUhCc_0 2024-09-14T12:44:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1847051932610652042', time=2024-09-14T14:00:49.727021+0000, chain.objs.size()=1 2024-09-14T12:44:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.RZgjWrIh3l999km8UYjg5YygH-fLRPg_0 2024-09-14T12:44:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7073570255665286402', time=2024-09-14T14:04:46.486272+0000, chain.objs.size()=1 2024-09-14T12:44:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.433__shadow_.CvuU6esuTB9O35xKvs8J9nw_xTsUAWW_0 2024-09-14T12:44:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.125+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15270631564301851357', time=2024-09-14T14:09:05.588276+0000, chain.objs.size()=1 2024-09-14T12:44:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.125+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.518__shadow_.6Ex8fOvBcEthgZdqdr-pmU8bdQAIKL0_0 2024-09-14T12:44:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9830019298125008424', time=2024-09-14T14:09:41.483149+0000, chain.objs.size()=6 2024-09-14T12:44:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.520__multipart_mymultipart.2~emWDr_qF_dX-0nCp3mPQkdjDqq9O82L.1 2024-09-14T12:44:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.520__multipart_mymultipart.2~emWDr_qF_dX-0nCp3mPQkdjDqq9O82L.2 2024-09-14T12:44:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.520__multipart_mymultipart.2~emWDr_qF_dX-0nCp3mPQkdjDqq9O82L.3 2024-09-14T12:44:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.520__multipart_mymultipart.2~emWDr_qF_dX-0nCp3mPQkdjDqq9O82L.4 2024-09-14T12:44:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.520__multipart_mymultipart.2~emWDr_qF_dX-0nCp3mPQkdjDqq9O82L.5 2024-09-14T12:44:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.520__multipart_mymultipart.2~emWDr_qF_dX-0nCp3mPQkdjDqq9O82L.6 2024-09-14T12:44:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15965334908382150815', time=2024-09-14T14:12:45.315556+0000, chain.objs.size()=12 2024-09-14T12:44:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.1 2024-09-14T12:44:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.129+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__shadow_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.1_1 2024-09-14T12:44:04.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.2 2024-09-14T12:44:04.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__shadow_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.2_1 2024-09-14T12:44:04.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.tr65vMRHMbLAvwrSLrMvBCrB33hClijN.3 2024-09-14T12:44:04.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__shadow_mymultipart.tr65vMRHMbLAvwrSLrMvBCrB33hClijN.3_1 2024-09-14T12:44:04.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.4 2024-09-14T12:44:04.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__shadow_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.4_1 2024-09-14T12:44:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.5 2024-09-14T12:44:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__shadow_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.5_1 2024-09-14T12:44:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.6 2024-09-14T12:44:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__shadow_mymultipart.2~0advcQhbQeXpst0bcDVGvZcKTcqqBE1.6_1 2024-09-14T12:44:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6612405835650169655', time=2024-09-14T14:18:15.584424+0000, chain.objs.size()=1 2024-09-14T12:44:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.133+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.557__shadow_.NigTVEPe-CggK3KyStEUaCLZbWRtSSk_0 2024-09-14T12:44:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.137+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18357429982986667338', time=2024-09-14T14:19:31.306481+0000, chain.objs.size()=1 2024-09-14T12:44:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.137+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:SlaOa4vcx59e3FK3bKKVCagHRIb7q.e_._F4L9-Zp4htUdZyGL5M5-Wr2b0hw3K-_0 2024-09-14T12:44:04.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16949304830466398226', time=2024-09-14T14:20:47.808920+0000, chain.objs.size()=1 2024-09-14T12:44:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:8wFNrC.VrCUxMURJ-7q0Gnf19EA8OYE_.TkxMqQlwJqdk-rNJ2QIf9KfkIEz3IQ-_0 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4928926691106571102', time=2024-09-14T14:22:10.289230+0000, chain.objs.size()=1 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:ZCPDViVIuc5SPENSYbahkVXBh5ejs3F_.cWiLbEqHJ12ljCL3rh6sjGuvLhT1i8J_0 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4539662338622650368', time=2024-09-14T14:31:23.354483+0000, chain.objs.size()=1 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.654__shadow_.-IpvXa_Yrq_j8rlKkJIuPm0cXVURzd1_0 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18252751091313993974', time=2024-09-14T14:32:39.556745+0000, chain.objs.size()=1 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.665__shadow_.ywDxUhNEqTXwsZfvY4PK7Kq_6uKGOQC_0 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15500919769686133136', time=2024-09-14T14:32:42.751596+0000, chain.objs.size()=1 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.666__shadow_.9MUP33q0WMleWmcbQLVlLWGOy_m46k0_0 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10398930591237669144', time=2024-09-14T14:33:45.201119+0000, chain.objs.size()=1 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.697__shadow:vMn9IO6SWqZFM8DmDJbePVJR3KVJcIG_.6645pBKPTrgper7oHkCu1EbdTELHkLI_0 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18334585105096307364', time=2024-09-14T14:34:04.381440+0000, chain.objs.size()=1 2024-09-14T12:44:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.705__shadow:TYhHr7vkfXvR3DmEVno5yRfprDets4Q_.WNT7qlPJTgBYsGFG1OuimPMHi2elmOm_0 2024-09-14T12:44:04.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12209638926264661666', time=2024-09-14T14:34:22.706281+0000, chain.objs.size()=1 2024-09-14T12:44:04.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.713__shadow:Z2y1fvG5Q6Y1z3n9v.5DGtg8xgh0qcN_.lhenjIZvxy-NN-rP6R4tFX8osR3DLUx_0 2024-09-14T12:44:04.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10574901717618303690', time=2024-09-14T14:34:56.962951+0000, chain.objs.size()=1 2024-09-14T12:44:04.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.720__shadow_.5cxRcQxEggldg3AQuCaX0pqXt_h-xTM_0 2024-09-14T12:44:04.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7391248698459246879', time=2024-09-14T14:41:23.425051+0000, chain.objs.size()=1 2024-09-14T12:44:04.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.141+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.778__shadow_.yzG1NtvkssDS3HnNWLMC1Nkg1UxHuDB_0 2024-09-14T12:44:04.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.149+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T12:44:04.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50275' 2024-09-14T12:44:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13640117565621601680', time=2024-09-14T13:43:28.205731+0000, chain.objs.size()=3 2024-09-14T12:44:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.O0RG6a80Hwmt_F-539TUZ-kSieKmwNm_0 2024-09-14T12:44:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.O0RG6a80Hwmt_F-539TUZ-kSieKmwNm_1 2024-09-14T12:44:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.O0RG6a80Hwmt_F-539TUZ-kSieKmwNm_2 2024-09-14T12:44:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_w4JTVTwOeYVJFH1HZRD0RwAPgcRfCXm', time=2024-09-14T13:43:41.237180+0000, chain.objs.size()=1 2024-09-14T12:44:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.Ux4NmP_bFMVGQcnpUsIZKQzSTPFkG5u_0 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17163161019518454263', time=2024-09-14T13:50:23.151581+0000, chain.objs.size()=1 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.240__shadow_.nkGiiPDFygMD5m2DPbKpvTlRY4cNw57_0 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14670537486564504153', time=2024-09-14T13:50:43.442476+0000, chain.objs.size()=1 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.247__shadow_.5zGkJK9fbLraLEBPjMurLF87CKFECcG_0 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11912840563803966596', time=2024-09-14T13:50:45.972389+0000, chain.objs.size()=1 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.248__shadow_.npvdrVOrbsag6K7rE8xdbX1VISKfd2a_0 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4712344183656749462', time=2024-09-14T13:51:03.632662+0000, chain.objs.size()=1 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.255__shadow_.ILItqVFAO-lLQo0NqeEeNPAv_6K6xmf_0 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5313190243037772282', time=2024-09-14T13:51:06.130206+0000, chain.objs.size()=1 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.256__shadow_.t6UDKTcLctHAZlMRz86fHXnLvTABqWM_0 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6795248817450793547', time=2024-09-14T13:53:06.899403+0000, chain.objs.size()=1 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.68vsf3jnPAoI_ikW3oJGIHaVfMMeza__0 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11856823306544094780', time=2024-09-14T13:53:07.725011+0000, chain.objs.size()=1 2024-09-14T12:44:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.q590D0w4wap3aeWtSEpso6_ooQthYPz_0 2024-09-14T12:44:04.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5491714571362154742', time=2024-09-14T13:53:09.666625+0000, chain.objs.size()=1 2024-09-14T12:44:04.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.153+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xfQwPvrHOy7z6CK2GeQRrVSxCnbr_TK_0 2024-09-14T12:44:04.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10119609794359818244', time=2024-09-14T13:53:09.775646+0000, chain.objs.size()=1 2024-09-14T12:44:04.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0Y-6QHDM9V9JebQCUdOTFbYUxZQICWg_0 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13970566781290272870', time=2024-09-14T13:53:12.068242+0000, chain.objs.size()=1 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.l8ujCX4w0BK_Sj9hd1d2N_Feh62leKv_0 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6425201697044321749', time=2024-09-14T13:53:12.393081+0000, chain.objs.size()=1 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jHwk2NwQdQx6kll6AEDzGm1xuUsirWe_0 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13644083404100919289', time=2024-09-14T13:53:13.985266+0000, chain.objs.size()=1 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WAPG6I5caeQwo5ivAXYqtgjA8xFCKOj_0 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1048088867471117096', time=2024-09-14T13:53:14.316064+0000, chain.objs.size()=1 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TDfCqvgqHmFkzwApcQ6zwzE9VyrTpRQ_0 2024-09-14T12:44:04.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10135880827615568941', time=2024-09-14T13:53:14.605988+0000, chain.objs.size()=1 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.D6nXE54nM_7sIni6eN00H93xKKr2dQ3_0 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5852837989860697078', time=2024-09-14T13:53:14.608481+0000, chain.objs.size()=1 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AqB7pC-ny3Rv18cbZkTZosNK2vjL_v2_0 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6843213454821534897', time=2024-09-14T13:53:16.213614+0000, chain.objs.size()=1 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dcrr4nKJM0s2UWx1VyiVtIdhouobrXr_0 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2188599542291123027', time=2024-09-14T13:53:16.336619+0000, chain.objs.size()=1 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GBJPcJxfM_HzhGBhMWyQAycyNclouZV_0 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7370275214741261884', time=2024-09-14T13:53:18.292190+0000, chain.objs.size()=1 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ur2R62YN8xzD1h5ekBfagU732q5l6cJ_0 2024-09-14T12:44:04.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9870396326764743728', time=2024-09-14T13:53:18.793850+0000, chain.objs.size()=1 2024-09-14T12:44:04.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.157+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rJOa0vt7W2WpUn6lb_lWMTPXIc-Wgt9_0 2024-09-14T12:44:04.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8120392112901552639', time=2024-09-14T13:53:18.953075+0000, chain.objs.size()=1 2024-09-14T12:44:04.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.U-wvhk1vXBBQN4pPoknmBgbabH7w4HV_0 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16729568731486163938', time=2024-09-14T13:53:21.624517+0000, chain.objs.size()=1 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.M19h5GByJTlQ0KGyGSLcsvWA4JAgJFf_0 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14510355713382996504', time=2024-09-14T13:53:21.694939+0000, chain.objs.size()=1 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JVfm1aPYCktWkL_xSSIHRMIh76x8fRI_0 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11173712758324919296', time=2024-09-14T13:53:21.952993+0000, chain.objs.size()=1 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.adYeKz8yYcXyyLXkDolJ9Hrt_xMS0oR_0 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15451189055860232833', time=2024-09-14T13:53:22.725597+0000, chain.objs.size()=1 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rHoLbVeqk8zOhVKI9RVCEloIVziJ3n__0 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13104015941199424749', time=2024-09-14T13:53:24.302362+0000, chain.objs.size()=1 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AcPAhxVzokQ8JYoBOx3KzWIxTRWJfqI_0 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14196582944695628776', time=2024-09-14T13:53:25.749462+0000, chain.objs.size()=1 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PWxYWt26YdcXtaaJMC7O02idAm5gsLQ_0 2024-09-14T12:44:04.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18292329412995180482', time=2024-09-14T13:53:26.161221+0000, chain.objs.size()=1 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ZsRRw-dcX9bW2FpfaHy6I-q3kvFeO2x_0 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1539983402637916104', time=2024-09-14T13:53:26.767156+0000, chain.objs.size()=1 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.161+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JnK4WjRkI7equl6fe_YnpuDWopH7npe_0 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14430664743990360781', time=2024-09-14T13:53:28.088746+0000, chain.objs.size()=1 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Az75YHeGXwC04knR54LHjwOqyGMjYFE_0 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13739453660851930688', time=2024-09-14T13:53:30.501133+0000, chain.objs.size()=1 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gKj5ynYrS08DCsCjpHZpvlFc_V_p63I_0 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.165+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1900587422381861342', time=2024-09-14T13:53:30.812516+0000, chain.objs.size()=1 2024-09-14T12:44:04.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.165+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5xuUT-cGs8xERxQ9wnUDMrRY8hjp8vN_0 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4501771550715037985', time=2024-09-14T13:53:34.012508+0000, chain.objs.size()=1 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-6JJ81UtVyK1bOuQkOOiS3-EsMbHqi6_0 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5225109620739894561', time=2024-09-14T13:53:34.262579+0000, chain.objs.size()=1 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XZ0-TyyYTD_svF77fbEoHTssnb-jOAq_0 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.562152995369125561', time=2024-09-14T13:53:34.393190+0000, chain.objs.size()=1 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VT81Rhk5uI68tdzaeu44zHpIATigCXR_0 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8215325589535411562', time=2024-09-14T13:53:44.841739+0000, chain.objs.size()=1 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.267__shadow_.aw6YbEREEPbXT7lTVbndbhzW7TCy811_0 2024-09-14T12:44:04.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5878911572404831087', time=2024-09-14T13:54:03.778574+0000, chain.objs.size()=1 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.275__shadow_.Empzrnf8Nbh2tDxi5PqfcpRIa6bHtcO_0 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3334555887415173826', time=2024-09-14T13:54:13.749313+0000, chain.objs.size()=1 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.279__shadow_.MpKDy1ZdsPAbO1oDo5npTD3lWXwNJFX_0 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3244997443352976048', time=2024-09-14T13:54:23.813533+0000, chain.objs.size()=1 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.283__shadow_.LVEoZ4Iz1oeRtDFBHDizAH9ZqPZe4Ej_0 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9518011128412487985', time=2024-09-14T13:54:36.563703+0000, chain.objs.size()=1 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.288__shadow_.uctt3oETcddbqEuFoiIpL8WEYRjKChW_0 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7342574404531274896', time=2024-09-14T13:54:52.927176+0000, chain.objs.size()=1 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.uUylhaYsb6HfbbgUZpD0P5SNnQfefyO_0 2024-09-14T12:44:04.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2054663102297478968', time=2024-09-14T13:55:06.661332+0000, chain.objs.size()=1 2024-09-14T12:44:04.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.297__shadow_.EK09PCwNssGPh-Kmto_2GuL9D6rdwc-_0 2024-09-14T12:44:04.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17829115010522516823', time=2024-09-14T13:55:32.417789+0000, chain.objs.size()=1 2024-09-14T12:44:04.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.169+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.307__shadow_.DE_try8LyKEyAf4qZeuNP-OWI9aJ1KJ_0 2024-09-14T12:44:04.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.173+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17716153843114735108', time=2024-09-14T13:58:05.445781+0000, chain.objs.size()=1 2024-09-14T12:44:04.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.173+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Yf4TYcF1GJGMjAFFS6Ig2SwsH8ydHqu_0 2024-09-14T12:44:04.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.173+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.417095528856407539', time=2024-09-14T13:58:05.875871+0000, chain.objs.size()=1 2024-09-14T12:44:04.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.173+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.o81qAlyqa8aRGAtopoOy3d_wXw9bXIL_0 2024-09-14T12:44:04.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.173+0000 7ff7f6280640 0 -- 172.21.15.148:0/1251537213 >> [v2:172.21.15.150:6800/2640697978,v1:172.21.15.150:6801/2640697978] conn(0x7ff7e801c040 msgr2=0x7ff7e80691b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:44:04.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.173+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14386368786871236812', time=2024-09-14T13:58:07.209664+0000, chain.objs.size()=1 2024-09-14T12:44:04.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.173+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.RV1tUOg6on4Ozq5RqA5r_Jd_vioViy8_0 2024-09-14T12:44:04.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8541315857670713670', time=2024-09-14T13:58:08.213972+0000, chain.objs.size()=1 2024-09-14T12:44:04.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.AxSKUr9S_0SvMHQ8dJ_ePz1IdbYQmv9_0 2024-09-14T12:44:04.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8074834400481186302', time=2024-09-14T13:58:09.596710+0000, chain.objs.size()=1 2024-09-14T12:44:04.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.POMxAkzD1w2jVd_XAs5Bf5Jkr_dufjR_0 2024-09-14T12:44:04.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3138839791458267860', time=2024-09-14T13:58:10.993422+0000, chain.objs.size()=1 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JocbTEwwbIplqvh8BI0MnqZVykxzV_o_0 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9997309291363898476', time=2024-09-14T13:58:12.118694+0000, chain.objs.size()=1 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.k_sM9TNQedzOtH6JIsbgIHYEToCOlDb_0 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11569839749156868293', time=2024-09-14T13:58:12.120241+0000, chain.objs.size()=1 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1kO5MPWWGrgQuZM6QvDKo27xo7UTz0n_0 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12684171749203054948', time=2024-09-14T13:58:12.221387+0000, chain.objs.size()=1 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6GvbKqRoBgSCtLWpLJUAlD-7I-w_5pz_0 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7296875616363649630', time=2024-09-14T13:58:12.223200+0000, chain.objs.size()=1 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-5swtGOeTqd3DDVF5vYgo7mlHdJrHR9_0 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7386294528731397380', time=2024-09-14T13:58:14.333494+0000, chain.objs.size()=1 2024-09-14T12:44:04.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.177+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.bueVsh1Pwe2CUHGkQeLIQb3e3YWGuUw_0 2024-09-14T12:44:04.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17906402503850488245', time=2024-09-14T13:58:14.605315+0000, chain.objs.size()=1 2024-09-14T12:44:04.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZHZ-MyKEu__0jLRKApSZih4ftEF6_Vt_0 2024-09-14T12:44:04.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7233462395460681135', time=2024-09-14T13:58:15.232008+0000, chain.objs.size()=1 2024-09-14T12:44:04.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.dbzZvHAYoZPE3QBMUoE5GkYBdNi73Gd_0 2024-09-14T12:44:04.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17180092039793458156', time=2024-09-14T13:58:15.316739+0000, chain.objs.size()=1 2024-09-14T12:44:04.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kjFuSIRz19M8oqmQI8znq0U5yO6BYo8_0 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7390382272221429987', time=2024-09-14T13:58:17.427050+0000, chain.objs.size()=1 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.w_2yHZIlunybtF1uVCTC74NUHCkeQBn_0 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12000082537782386980', time=2024-09-14T13:58:17.550776+0000, chain.objs.size()=1 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kmLADifTHa-nxAFZO7siEc5w52bL8yv_0 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8528481621862632708', time=2024-09-14T13:58:17.945939+0000, chain.objs.size()=1 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DQSuRQ4r9uGWaocjzZ758PpycjV_izl_0 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8698256623168368853', time=2024-09-14T13:58:18.581552+0000, chain.objs.size()=1 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Bs6otwNeG-dxBDZ8NCT3NlTfxrYGrya_0 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.332444610812203294', time=2024-09-14T13:58:18.584063+0000, chain.objs.size()=1 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.r8WM3k2VFkn2KjE4MzQc-BJ_vkjA9xF_0 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11098882651912967481', time=2024-09-14T13:58:19.004405+0000, chain.objs.size()=1 2024-09-14T12:44:04.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hWXFE_wBpOCS8eejZKw2fDiMHhFTwUH_0 2024-09-14T12:44:04.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3819283148409650190', time=2024-09-14T13:58:21.537043+0000, chain.objs.size()=1 2024-09-14T12:44:04.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2ikk-2cIS5BpCEAHNK5YIXoTvO6OllH_0 2024-09-14T12:44:04.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.499189153968500905', time=2024-09-14T13:58:21.696566+0000, chain.objs.size()=1 2024-09-14T12:44:04.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.181+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZmCLWoIvd4MKWobnqnG9pmW7d6rT7ao_0 2024-09-14T12:44:04.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11935195044933364043', time=2024-09-14T13:58:22.225421+0000, chain.objs.size()=1 2024-09-14T12:44:04.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VnQPtlA8KIV6-MLAfLRBTOAvzrK7ncd_0 2024-09-14T12:44:04.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13573424158036516187', time=2024-09-14T13:58:22.667046+0000, chain.objs.size()=1 2024-09-14T12:44:04.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.giHvM3NcPGboGV18FftTYLWH0nHBp6z_0 2024-09-14T12:44:04.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1379208661631275677', time=2024-09-14T13:58:25.598867+0000, chain.objs.size()=1 2024-09-14T12:44:04.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7q_sAvHR8U3i48n4jhQDjPBwaJpRj2T_0 2024-09-14T12:44:04.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.746583304277185692', time=2024-09-14T13:58:25.711588+0000, chain.objs.size()=1 2024-09-14T12:44:04.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.g0SfR7KkQQb027O6PP4aaDwSqxbFfV9_0 2024-09-14T12:44:04.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10890531150772422464', time=2024-09-14T13:58:26.246822+0000, chain.objs.size()=1 2024-09-14T12:44:04.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9r4Gev2sEwW9MqDopGJkKGvnxhXQIeD_0 2024-09-14T12:44:04.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1909472718391689352', time=2024-09-14T13:58:26.794292+0000, chain.objs.size()=1 2024-09-14T12:44:04.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.X6HL9iDqBgkrHNjrQXwbyDBvd7OMPJm_0 2024-09-14T12:44:04.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5502537187660764378', time=2024-09-14T13:58:27.411877+0000, chain.objs.size()=1 2024-09-14T12:44:04.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qlw_AJ2uK0NlWSKC2LFnnH8tVDpscsM_0 2024-09-14T12:44:04.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.132163242426999764', time=2024-09-14T13:58:27.673897+0000, chain.objs.size()=1 2024-09-14T12:44:04.177 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.185+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kGNkWHrAnYBnNf1ZsE071p4ylvkwOxc_0 2024-09-14T12:44:04.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.551921570912757266', time=2024-09-14T13:58:30.822929+0000, chain.objs.size()=1 2024-09-14T12:44:04.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.laGZVl42sruQBSpDnbNO7CoZhXbLnal_0 2024-09-14T12:44:04.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5864348175674395048', time=2024-09-14T13:58:32.818010+0000, chain.objs.size()=1 2024-09-14T12:44:04.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JnsfpW85zFZeIJKPcuXHr_BXQboLpnj_0 2024-09-14T12:44:04.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f6280640 0 -- 172.21.15.148:0/1251537213 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x55ba7e78b7b0 msgr2=0x7ff6c0088380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:44:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1423817589023952119', time=2024-09-14T13:58:32.934623+0000, chain.objs.size()=1 2024-09-14T12:44:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oH7edlErxRXHfVcC42G88aKS6rey0vF_0 2024-09-14T12:44:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8555149220212103753', time=2024-09-14T13:58:33.819977+0000, chain.objs.size()=1 2024-09-14T12:44:04.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.189+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FKezXyGFaI-_LKbyTjUTfvuorotSbDn_0 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1583828335269382848', time=2024-09-14T13:58:34.304508+0000, chain.objs.size()=1 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8ry69lPf-zF1TbDOGgI9k3vADBDp-N7_0 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2731244542611465265', time=2024-09-14T14:00:21.327566+0000, chain.objs.size()=1 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Fddcvx5yjI_zm1uCTA_60AHQgJ2gn0e_0 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5270201574671978834', time=2024-09-14T14:00:21.654152+0000, chain.objs.size()=1 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QDrOqfiSmYgSYddi5GvVrDhCZXwqBBm_0 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18265275361201656210', time=2024-09-14T14:00:21.769064+0000, chain.objs.size()=1 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-2MJmC-UQhCXjtEwxhttMIxxNeEBceO_0 2024-09-14T12:44:04.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14168814977851475572', time=2024-09-14T14:00:21.877478+0000, chain.objs.size()=1 2024-09-14T12:44:04.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AR0pv92bMDwCo1aRrGMle1XWCx3y6mY_0 2024-09-14T12:44:04.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14227224761071185036', time=2024-09-14T14:00:23.517820+0000, chain.objs.size()=1 2024-09-14T12:44:04.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vtIgta5Hgf8V8c5Ftuptl8fyZQCRSkw_0 2024-09-14T12:44:04.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1666651208585356372', time=2024-09-14T14:00:23.791293+0000, chain.objs.size()=1 2024-09-14T12:44:04.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.O3H0KT5x2Dv5LNhtGkaf2cvLMqbFpVG_0 2024-09-14T12:44:04.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7482514278679170572', time=2024-09-14T14:00:25.539293+0000, chain.objs.size()=1 2024-09-14T12:44:04.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qOxJ5HVSz6yJIHsXeU6s1THEDTrurW6_0 2024-09-14T12:44:04.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15412611495160216985', time=2024-09-14T14:00:25.720665+0000, chain.objs.size()=1 2024-09-14T12:44:04.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uu8trVFn8kqCRon5nwr40lJr6wEPa7W_0 2024-09-14T12:44:04.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3661143280936468914', time=2024-09-14T14:00:26.504969+0000, chain.objs.size()=1 2024-09-14T12:44:04.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.aJ9DU-Lv41yZnWAhSyecxD7jGzH_69z_0 2024-09-14T12:44:04.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6883808506297260573', time=2024-09-14T14:00:26.657044+0000, chain.objs.size()=1 2024-09-14T12:44:04.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YDK2lAeVDQB_tp7LXgPqFBuxIdxclr5_0 2024-09-14T12:44:04.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.193+0000 7ff7f527e640 0 -- 172.21.15.148:0/1251537213 >> [v2:172.21.15.150:6808/3664436114,v1:172.21.15.150:6809/3664436114] conn(0x7ff7f0068370 msgr2=0x7ff7f005db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:44:04.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6694219740238241153', time=2024-09-14T14:00:27.011679+0000, chain.objs.size()=1 2024-09-14T12:44:04.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hiAVtl94G1mAGlgRV_FxtByS1p3Uuf0_0 2024-09-14T12:44:04.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12359525479193843749', time=2024-09-14T14:00:27.134901+0000, chain.objs.size()=1 2024-09-14T12:44:04.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fev-6CSha91HBs4AN9-RqiRhjNNGAyc_0 2024-09-14T12:44:04.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2511958579053717466', time=2024-09-14T14:00:27.415206+0000, chain.objs.size()=1 2024-09-14T12:44:04.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.G3Etf7FqrheEeS5OJCUepeWnkJViIki_0 2024-09-14T12:44:04.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2828316598981576874', time=2024-09-14T14:00:28.903593+0000, chain.objs.size()=1 2024-09-14T12:44:04.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.OF7hAzR-6O2hZ_Ylm0I8-dvfGlrRaBi_0 2024-09-14T12:44:04.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11417585280623039942', time=2024-09-14T14:00:29.326423+0000, chain.objs.size()=1 2024-09-14T12:44:04.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.u0u9Vaj0HiMp_FwGs7JDJRVfmr3UB25_0 2024-09-14T12:44:04.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1540443556150015838', time=2024-09-14T14:00:29.549147+0000, chain.objs.size()=1 2024-09-14T12:44:04.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yNk-pftNjkpayF8AkFoXP4dtjB-8k3S_0 2024-09-14T12:44:04.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12380443009787525829', time=2024-09-14T14:00:29.640875+0000, chain.objs.size()=1 2024-09-14T12:44:04.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.197+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.atJdUd5-6WVJgImdS_iTkvMJttkiuuK_0 2024-09-14T12:44:04.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.201+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7911197885338190038', time=2024-09-14T14:00:30.402094+0000, chain.objs.size()=1 2024-09-14T12:44:04.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.201+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Z73iMs4Yp266IRH5E1KHkpvTs-_yvVR_0 2024-09-14T12:44:04.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.201+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.630909897484625048', time=2024-09-14T14:00:31.213135+0000, chain.objs.size()=1 2024-09-14T12:44:04.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.201+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Zm2Q3c4Ge7NPFaPGQMytr12ijc2RRT7_0 2024-09-14T12:44:04.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.201+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5116799724563551248', time=2024-09-14T14:00:31.841762+0000, chain.objs.size()=1 2024-09-14T12:44:04.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.201+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.0ktGe47CmEWZMVPVsorBUXK03FVzPTj_0 2024-09-14T12:44:04.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.201+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8020835976184790633', time=2024-09-14T14:00:31.877683+0000, chain.objs.size()=1 2024-09-14T12:44:04.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.201+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QtdKHaN690Eto0LaMtFwamCIb_YWQm-_0 2024-09-14T12:44:04.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.205+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50275 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6341877227752506497', time=2024-09-14T14:00:32.879384+0000, chain.objs.size()=1 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pHD8POPa5mTbOYNjSDHkLFrEdtJkku5_0 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15457254597875085663', time=2024-09-14T14:00:36.824716+0000, chain.objs.size()=1 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.aL8byaKD8CSDhYdqnyc0KfuLQ3duNOn_0 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6861836544391086457', time=2024-09-14T14:00:37.991645+0000, chain.objs.size()=1 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KIdK41kBcgJwqysOJAENubg2y5LW2Bu_0 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4224199469898667180', time=2024-09-14T14:00:38.385157+0000, chain.objs.size()=1 2024-09-14T12:44:04.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jWggUFNpkG45Sbb_ptH5Os4C4YOR6gQ_0 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6364483075957428047', time=2024-09-14T14:00:38.647341+0000, chain.objs.size()=1 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.RYGnsdjfSxh3IKWAaC11y2qzNRPApMc_0 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12924894566946566070', time=2024-09-14T14:00:38.890199+0000, chain.objs.size()=1 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YSt3Q5Qyg2F2NIrlOXkgQE2HkrlHKcp_0 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12197097429128348658', time=2024-09-14T14:00:39.139089+0000, chain.objs.size()=1 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.l1gFCmG2GoaGlDiqeAqYoZCNoOmUuEI_0 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16953729147407445423', time=2024-09-14T14:00:40.733336+0000, chain.objs.size()=1 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5DmkL2f8UE3IiJIfAA8yWaetkbYV7Nd_0 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12449113344012264433', time=2024-09-14T14:00:41.304845+0000, chain.objs.size()=1 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.GdXAy_ND4Gfu9SpI-NldamNoDWLqeMa_0 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11806103114704420685', time=2024-09-14T14:00:41.386771+0000, chain.objs.size()=1 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.govemSGVtplQAFgAY4b6DIpyPygESHC_0 2024-09-14T12:44:04.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13224402385631469787', time=2024-09-14T14:00:42.255846+0000, chain.objs.size()=1 2024-09-14T12:44:04.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pmMlSM546spP_9-enBgJXDz11M7QFAM_0 2024-09-14T12:44:04.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.931277156588355242', time=2024-09-14T14:00:42.848878+0000, chain.objs.size()=1 2024-09-14T12:44:04.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.209+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ksHDUsQLGu-ktcms1yZ52cJh3R7lC1f_0 2024-09-14T12:44:04.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13358546205448875956', time=2024-09-14T14:00:44.177603+0000, chain.objs.size()=1 2024-09-14T12:44:04.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uAY3EgsrAUVCBoL6JObGWIXZZmSvybA_0 2024-09-14T12:44:04.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4540246617660933502', time=2024-09-14T14:00:44.641320+0000, chain.objs.size()=1 2024-09-14T12:44:04.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.0NI1eb_Z_R-7E4jtPJ28rM3G62Kg5xi_0 2024-09-14T12:44:04.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8153151895156496432', time=2024-09-14T14:00:47.040650+0000, chain.objs.size()=1 2024-09-14T12:44:04.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jVSM1L7DfBOLo0wT11W25WlAgOKTumE_0 2024-09-14T12:44:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18145237705203219232', time=2024-09-14T14:00:48.192345+0000, chain.objs.size()=1 2024-09-14T12:44:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ft5EC7pZXTWHUtkcBU8A9B9QQasOidb_0 2024-09-14T12:44:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14826493436271869007', time=2024-09-14T14:00:58.693640+0000, chain.objs.size()=1 2024-09-14T12:44:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.329__shadow_.F8k-KvN3l_ab9nvlcVf4VLPuaM7izJN_0 2024-09-14T12:44:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16544562435039069706', time=2024-09-14T14:01:32.758961+0000, chain.objs.size()=1 2024-09-14T12:44:04.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.344__shadow_.33MpMWSwBf7OsQBL28iULVxYz7GXK7i_0 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6935645391930060533', time=2024-09-14T14:01:36.877437+0000, chain.objs.size()=1 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.346__shadow_.Kda7ldYhI9o4SPY03DKi3CLLSwVrwZN_0 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10363137567672682923', time=2024-09-14T14:02:51.756631+0000, chain.objs.size()=1 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.382__shadow_.24BGlVrla34A8lpUMUQC6E8s97aAYVk_0 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10897103174326647597', time=2024-09-14T14:03:51.941594+0000, chain.objs.size()=1 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.409__shadow_.1GqXPOCJWjxC30xUd8Wq6_GnAdruS1D_0 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17904188334245790412', time=2024-09-14T14:07:38.701251+0000, chain.objs.size()=1 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.504__shadow:CRVCgFwmMB1yqxO5U8RjttqtM84H.gl_.-dyH_j79k-7Z8XYotXT1e1-rBoXsavU_0 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6815283633015722730', time=2024-09-14T14:10:30.612528+0000, chain.objs.size()=3 2024-09-14T12:44:04.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.213+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~_pX3tYNnQYmezJaE7viB58v_qegB6-D.1 2024-09-14T12:44:04.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~_pX3tYNnQYmezJaE7viB58v_qegB6-D.2 2024-09-14T12:44:04.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~_pX3tYNnQYmezJaE7viB58v_qegB6-D.3 2024-09-14T12:44:04.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.217+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3472738747559839015', time=2024-09-14T14:13:37.573542+0000, chain.objs.size()=6 2024-09-14T12:44:04.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.217+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~kOkbvPtoUjLsVzE4XSAeIOgvk5ZUBU4.1 2024-09-14T12:44:04.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.21fxmg4-eHFTjwpNG98pg0MTl09WM_78.2 2024-09-14T12:44:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart._qaVMWIqL5pL_XT1bc1wvoDE6Ymnlrz6.3 2024-09-14T12:44:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~kOkbvPtoUjLsVzE4XSAeIOgvk5ZUBU4.4 2024-09-14T12:44:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~kOkbvPtoUjLsVzE4XSAeIOgvk5ZUBU4.5 2024-09-14T12:44:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~kOkbvPtoUjLsVzE4XSAeIOgvk5ZUBU4.6 2024-09-14T12:44:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6993315554518701849', time=2024-09-14T14:16:25.984783+0000, chain.objs.size()=4 2024-09-14T12:44:04.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.536__multipart_mymultipart.2~I-Y8_kygaAEDXRyU9SNj09_349NH90B.1 2024-09-14T12:44:04.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.536__multipart_mymultipart.2~I-Y8_kygaAEDXRyU9SNj09_349NH90B.2 2024-09-14T12:44:04.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.221+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.536__multipart_mymultipart.Ee-1oCbuKUTYuzJsJ0NUmV0Ny37dGRdS.3 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.536__multipart_mymultipart.2~I-Y8_kygaAEDXRyU9SNj09_349NH90B.4 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5590483835995381241', time=2024-09-14T14:18:48.488544+0000, chain.objs.size()=1 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.562__multipart_mymultipart.2~l_uoctUn11QdQM9zypscdYBp25_Gq8W.1 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15168175494513200963', time=2024-09-14T14:19:55.941997+0000, chain.objs.size()=1 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.574__shadow_.RseYwwAl-COPK2Z1lHn1T7qezpzXdYn_0 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3274095767400342705', time=2024-09-14T14:22:28.865295+0000, chain.objs.size()=1 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.586__shadow:gHaOBpXh2mXI7mgZM6MLwqD2NYVDXl4_.nZ7EYvBMrdzKzc_L5nkpDyz_sWhltE0_0 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4432311698686222584', time=2024-09-14T14:27:11.847535+0000, chain.objs.size()=1 2024-09-14T12:44:04.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.225+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.618__shadow_.9c3sOpha7ZlcJewCCmwUfRdyEyP4OHz_0 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8665521099078525342', time=2024-09-14T14:28:15.286849+0000, chain.objs.size()=1 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.619__shadow_.1sCiRYGMuXJTD5BAn-GbQqQyKC14-aT_0 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7453977025632691478', time=2024-09-14T14:30:37.641158+0000, chain.objs.size()=1 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.644__shadow_.U3p__iTyD9CQVAZ5N1O3AWn6Rl5mMr5_0 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17724686745037711277', time=2024-09-14T14:33:11.622665+0000, chain.objs.size()=1 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.680__shadow_.rPZG1wJJJOns5rbOTwBbuS3QBi0eE6Z_0 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13167180049902311179', time=2024-09-14T14:33:32.083593+0000, chain.objs.size()=1 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.691__shadow:qrahALvuSVzOAOEJL9rMe99Ey8SsYiA_.GiJAsiJnqT9A-H8GsApyRgDpgEHx_by_0 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5721912328322340261', time=2024-09-14T14:34:16.034292+0000, chain.objs.size()=1 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.710__shadow_.I_fx_kYAHtu9LsvgJ6EwUFSTigLy-e1_0 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11995224926117405720', time=2024-09-14T14:34:27.342611+0000, chain.objs.size()=1 2024-09-14T12:44:04.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.229+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.715__shadow:w9ohepaaC2dZbgttztpgiVd05aUCaeq_.ahNFrxqBV_Z-Xk87z3BG8UX5hlX0Mwf_0 2024-09-14T12:44:04.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.233+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.226 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T12:44:04.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46607' 2024-09-14T12:44:04.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15590302245413694835', time=2024-09-14T13:42:45.705922+0000, chain.objs.size()=1 2024-09-14T12:44:04.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.159__shadow_.HLwfETSVNiTe-Fmz7hPfmAiUB0k0bIp_0 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16630739959615384809', time=2024-09-14T13:44:42.166363+0000, chain.objs.size()=1 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.172__shadow_.xGl-eYOEYSIeN2kVt7HEIKeoESLgcCq_0 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8187802008242809758', time=2024-09-14T13:50:04.838001+0000, chain.objs.size()=1 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.234__shadow_.q5AKqEMFekFLJSXTQopyNZWqp5WyBd6_0 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16833559140956073249', time=2024-09-14T13:50:30.295141+0000, chain.objs.size()=1 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.243__shadow_.4O-KAW5thEJMszH-sA7ryvN7m_riPUN_0 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5597919012996732894', time=2024-09-14T13:51:08.703153+0000, chain.objs.size()=1 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.257__shadow_.N-gDOLAep3NvfWCWR68Z5LgehrmQqLg_0 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15534572763952044090', time=2024-09-14T13:53:08.004949+0000, chain.objs.size()=1 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4nGfqpvOFStZXQRm2LYmNwMY7NlK8EH_0 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10753604728717878015', time=2024-09-14T13:53:08.122401+0000, chain.objs.size()=1 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BW1xxGb2kCB4Pnj01xzaW9LyFY7n4vt_0 2024-09-14T12:44:04.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3866170264543028848', time=2024-09-14T13:53:09.684271+0000, chain.objs.size()=1 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BzOqdgbIg2twIBxkyeOWR3gD7tR8p-a_0 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2220794233424331241', time=2024-09-14T13:53:09.686680+0000, chain.objs.size()=1 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uod0jOvQAtBRHc6XzR132VqV82uIyt5_0 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11547825135744197144', time=2024-09-14T13:53:09.959344+0000, chain.objs.size()=1 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aKGAorOEgyY_kB-MDAbc1BdeQOa4FMG_0 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9797046812392679534', time=2024-09-14T13:53:11.614324+0000, chain.objs.size()=1 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VFdzdhW5jz06ZMnefHxYRPENUbhf1du_0 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11060662542663353483', time=2024-09-14T13:53:13.601845+0000, chain.objs.size()=1 2024-09-14T12:44:04.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.237+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vOSTCveHypGPqt4GWDSntpQhHwXuyiR_0 2024-09-14T12:44:04.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5360532382304668457', time=2024-09-14T13:53:14.596917+0000, chain.objs.size()=1 2024-09-14T12:44:04.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._PGQ0eF2v3W0btj8p8CvMxxW1eJ0sQ4_0 2024-09-14T12:44:04.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13214812932813054471', time=2024-09-14T13:53:15.544131+0000, chain.objs.size()=1 2024-09-14T12:44:04.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EzPevK-d7_65Mv2YyM-VfIPSgY3co7O_0 2024-09-14T12:44:04.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15240276724854364458', time=2024-09-14T13:53:15.925291+0000, chain.objs.size()=1 2024-09-14T12:44:04.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hLIzMaU3oDv93w38U22_doAL2amf_tm_0 2024-09-14T12:44:04.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.241+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7459334704253191930', time=2024-09-14T13:53:18.053520+0000, chain.objs.size()=1 2024-09-14T12:44:04.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.241+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.b3Te16-xWTfnpp1q0syj30f5EAA3AjB_0 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16220835022491235394', time=2024-09-14T13:53:18.136588+0000, chain.objs.size()=1 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xZbk4S7fLra53nVgpkxk8xVzVEU8CHo_0 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12786469339900775301', time=2024-09-14T13:53:19.296908+0000, chain.objs.size()=1 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Kfztz2xrqGM2bGE9RnovIxcQuOFOHXi_0 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2370935005309655817', time=2024-09-14T13:53:19.597843+0000, chain.objs.size()=1 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.f4S4BQ_I2riEB-Ncenq6yWubyDxssbd_0 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12185816615690551971', time=2024-09-14T13:53:21.953712+0000, chain.objs.size()=1 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.o8HszDyn9mAPczSpxHVMDXgBRrh-hEC_0 2024-09-14T12:44:04.234 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7068457776499025843', time=2024-09-14T13:53:23.654594+0000, chain.objs.size()=1 2024-09-14T12:44:04.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Af5bIQ5Aqv-UQb1HLA8Z3lYZzaIikJR_0 2024-09-14T12:44:04.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1127610225130457620', time=2024-09-14T13:53:23.884425+0000, chain.objs.size()=1 2024-09-14T12:44:04.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VoJg8xZyXwFe63IfLm4DhU-642W1qmP_0 2024-09-14T12:44:04.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5731209366741556026', time=2024-09-14T13:53:24.217475+0000, chain.objs.size()=1 2024-09-14T12:44:04.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.245+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CakSwt1XFNibS88u0pfPpvVSgGvzG9P_0 2024-09-14T12:44:04.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4571817775595078195', time=2024-09-14T13:53:24.377314+0000, chain.objs.size()=1 2024-09-14T12:44:04.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.7_sXGxHgYvnlMTmj9hChj5SiR-cnet6_0 2024-09-14T12:44:04.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2505663323210391326', time=2024-09-14T13:53:24.421513+0000, chain.objs.size()=1 2024-09-14T12:44:04.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.j4pD1UTG1T1eZ5pcdrwZ3f37LeSz7mu_0 2024-09-14T12:44:04.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8434070155343921731', time=2024-09-14T13:53:26.176708+0000, chain.objs.size()=1 2024-09-14T12:44:04.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kXaMDpf1PnO-QkZn_Y9jpJJFLcwWz6o_0 2024-09-14T12:44:04.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2752500289494025286', time=2024-09-14T13:53:27.584153+0000, chain.objs.size()=1 2024-09-14T12:44:04.238 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.05jIA-3sg2Ds19dtEZeM9Vxs5_UPEt8_0 2024-09-14T12:44:04.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2286426992683113263', time=2024-09-14T13:53:29.512738+0000, chain.objs.size()=1 2024-09-14T12:44:04.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eIYdXe9f1BYK1riVfxY0Bmf-V27Z0V4_0 2024-09-14T12:44:04.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12517654134567143106', time=2024-09-14T13:53:29.792682+0000, chain.objs.size()=1 2024-09-14T12:44:04.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pulwl28TtfX7jcn39hExCzxGpnLP0-X_0 2024-09-14T12:44:04.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2863138131996566825', time=2024-09-14T13:53:30.976598+0000, chain.objs.size()=1 2024-09-14T12:44:04.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EioS0xfIpQeMKRIkGbg8PUcLXBnVKaD_0 2024-09-14T12:44:04.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17437577846639044992', time=2024-09-14T13:53:31.107953+0000, chain.objs.size()=1 2024-09-14T12:44:04.240 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.i9Fyg6HFTbcGih3fZ4WWZ6Now4FKtLA_0 2024-09-14T12:44:04.241 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1103954526231510283', time=2024-09-14T13:53:31.303466+0000, chain.objs.size()=1 2024-09-14T12:44:04.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FiRz0zlKLl67tqjNkKWm8awO4uzLd7y_0 2024-09-14T12:44:04.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16980909706305155472', time=2024-09-14T13:53:31.994800+0000, chain.objs.size()=1 2024-09-14T12:44:04.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.F26zMxZhAm_1xIjVjhWCr984DZ9nrFc_0 2024-09-14T12:44:04.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3154049343157539322', time=2024-09-14T13:53:33.957689+0000, chain.objs.size()=1 2024-09-14T12:44:04.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.249+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TAPc1i8xOwQoFWjmWNZcqFJd5GjA-aL_0 2024-09-14T12:44:04.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14499481408895966805', time=2024-09-14T13:53:42.474182+0000, chain.objs.size()=1 2024-09-14T12:44:04.242 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.266__shadow_.3k9GxCk5CtIiLIaTjDYtTFPz_7m4deI_0 2024-09-14T12:44:04.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.865282178428148904', time=2024-09-14T13:53:49.610693+0000, chain.objs.size()=1 2024-09-14T12:44:04.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.269__shadow_.lVSg71frmjL3nKyuc2VzDPT-rbK096d_0 2024-09-14T12:44:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3962099754034540042', time=2024-09-14T13:54:01.461601+0000, chain.objs.size()=1 2024-09-14T12:44:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.274__shadow_.UTqSNILb1jCi1mv7MwlFZN66Dcyl_Ls_0 2024-09-14T12:44:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.180201126743192038', time=2024-09-14T13:54:26.366330+0000, chain.objs.size()=1 2024-09-14T12:44:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.284__shadow_.RnCwJyN2-x9q6qnjlRv0_qpBr1zpEE1_0 2024-09-14T12:44:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18425516633030731483', time=2024-09-14T13:54:28.882726+0000, chain.objs.size()=1 2024-09-14T12:44:04.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.285__shadow_.QRx9W627gJdfvkxpwP3d853Ab5Qiy_5_0 2024-09-14T12:44:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4730813600241384795', time=2024-09-14T13:54:39.029231+0000, chain.objs.size()=1 2024-09-14T12:44:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.289__shadow_.4IG0HfiKzkbNJM3SVkTVddteHAsez4h_0 2024-09-14T12:44:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10761850383127744551', time=2024-09-14T13:54:53.172351+0000, chain.objs.size()=1 2024-09-14T12:44:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.jg5q8xh6Dczix-VfAwRqr82rigJ5KS2_0 2024-09-14T12:44:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11818934071279309916', time=2024-09-14T13:54:58.759585+0000, chain.objs.size()=1 2024-09-14T12:44:04.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.253+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.54G7lEqR4dMphFfxbY9IufYiM-qPOMb_0 2024-09-14T12:44:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7333920194602709663', time=2024-09-14T13:55:09.146006+0000, chain.objs.size()=1 2024-09-14T12:44:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.298__shadow_.pOhOzpAeRXZhEIw3k6LPt72FtDEmWM7_0 2024-09-14T12:44:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.257+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12023670762217101057', time=2024-09-14T13:58:05.511870+0000, chain.objs.size()=1 2024-09-14T12:44:04.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.257+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Y4-TalY_SmZIMtoJol-hDwcOMvUf42k_0 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16617474548666333701', time=2024-09-14T13:58:05.516982+0000, chain.objs.size()=1 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.whuy33tdgvBjxCgG1VhiORUgEOC8PwO_0 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16730073617432699662', time=2024-09-14T13:58:06.104361+0000, chain.objs.size()=1 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZuoKoJwpsrWO2xUZImo9dFzudMZoJRY_0 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5111923691639700960', time=2024-09-14T13:58:07.989983+0000, chain.objs.size()=1 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.k1pTO9PifqN70S9fCkDOKkiussBsQk9_0 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7035271408311563159', time=2024-09-14T13:58:09.451177+0000, chain.objs.size()=1 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1EjdKsYDK96eR4hZ-_7IOUsFIlLmLEh_0 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13392503156928938142', time=2024-09-14T13:58:09.699311+0000, chain.objs.size()=1 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rFymOs32OTlXHS82ykPBdeV861-R5nV_0 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13948461655028508677', time=2024-09-14T13:58:11.518558+0000, chain.objs.size()=1 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HDgZWKsIAmgHgGZ4W7i7ugm2Yte--tX_0 2024-09-14T12:44:04.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9268394407477333229', time=2024-09-14T13:58:12.079956+0000, chain.objs.size()=1 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.p8Qa_k8caTYliXSjSm4MxdwH5n6NCPO_0 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1474687888997790461', time=2024-09-14T13:58:12.139337+0000, chain.objs.size()=1 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cDjg1neSOBnJG2FAPAbHe0JcT_Vag6O_0 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17343348477421246150', time=2024-09-14T13:58:13.672311+0000, chain.objs.size()=1 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9upSyUpRtOH21LP3Xn80YJJ1Xklgvb__0 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16725878921977606296', time=2024-09-14T13:58:14.632065+0000, chain.objs.size()=1 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.arxpt3FXbkp6-RCL-P1K86zLhcJvKKA_0 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13997160162024088235', time=2024-09-14T13:58:15.209720+0000, chain.objs.size()=1 2024-09-14T12:44:04.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.261+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Q0iAF5YlucXtrcVIaRrop_xglOPtCWe_0 2024-09-14T12:44:04.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9638215615131133527', time=2024-09-14T13:58:15.767838+0000, chain.objs.size()=1 2024-09-14T12:44:04.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7QynxU1ECsaZd3Lmd56zNgZRjQVEiKb_0 2024-09-14T12:44:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13816555732548288731', time=2024-09-14T13:58:15.981937+0000, chain.objs.size()=1 2024-09-14T12:44:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.liEXqyTJCmtWgrMKCJqchUzCPLV59ZB_0 2024-09-14T12:44:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6959985138443353284', time=2024-09-14T13:58:17.446751+0000, chain.objs.size()=1 2024-09-14T12:44:04.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4wpx5_0sbv4KMnkt6byEDtD40N7waIM_0 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5551337868432913576', time=2024-09-14T13:58:17.448495+0000, chain.objs.size()=1 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KUfbHqwcSmrAErLKgilSXswP_b7pMRv_0 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3315373827100177737', time=2024-09-14T13:58:19.013037+0000, chain.objs.size()=1 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.937g5JR-2bcrnknZArJ_jOSQSEpzp75_0 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10080317010781380781', time=2024-09-14T13:58:19.966391+0000, chain.objs.size()=1 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7abqw5IWY_760-DRlb17vEe2N6tn9iG_0 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12436114399214422471', time=2024-09-14T13:58:20.052516+0000, chain.objs.size()=1 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.S70oOWHEdttqZQyS51a-YPN1XsLjga0_0 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14156858552181112855', time=2024-09-14T13:58:22.469235+0000, chain.objs.size()=1 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YwC4w-mAiY8iwBRX8woWyacvwQJPDLH_0 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17822827958130921143', time=2024-09-14T13:58:23.774202+0000, chain.objs.size()=1 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YDZfXigbXljX5ebASuEhNul7VgAlhdK_0 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15558991422516982779', time=2024-09-14T13:58:25.775506+0000, chain.objs.size()=1 2024-09-14T12:44:04.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.u-EY6xhfC7wrmfAJICHTpPpoepMt-HS_0 2024-09-14T12:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16851663604871190791', time=2024-09-14T13:58:25.908233+0000, chain.objs.size()=1 2024-09-14T12:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.265+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.vjDjZa1HR09phU75MY_1CTxhy2OKqfT_0 2024-09-14T12:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.269+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9163408683087385259', time=2024-09-14T13:58:28.482921+0000, chain.objs.size()=1 2024-09-14T12:44:04.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.269+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qgIpDwwqg7xIdW2OgS4E54lAoG7SiGT_0 2024-09-14T12:44:04.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4978249820083943852', time=2024-09-14T13:58:28.886654+0000, chain.objs.size()=1 2024-09-14T12:44:04.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hzvpfgM3Gq_0eoVht7smm17KTFMuoIi_0 2024-09-14T12:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6498722569067532625', time=2024-09-14T13:58:28.997969+0000, chain.objs.size()=1 2024-09-14T12:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NPiNA3EpDYzGm2sIsDuzbSPGrgranuE_0 2024-09-14T12:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15450498754724585089', time=2024-09-14T13:58:29.507771+0000, chain.objs.size()=1 2024-09-14T12:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.D6t9f6eDJvnG6sVlEpmO_r2eZ06fMQH_0 2024-09-14T12:44:04.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6288612926486019296', time=2024-09-14T13:58:29.949398+0000, chain.objs.size()=1 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TfOWiOqZXa0sz5jbWGhVGH_hZcuLIEx_0 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17202498391648797365', time=2024-09-14T13:58:30.168264+0000, chain.objs.size()=1 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0gfDnRFnj9C1j70qdQso-610GNR6Wz2_0 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13903991842715194381', time=2024-09-14T13:58:30.486216+0000, chain.objs.size()=1 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.MeXy6qDVQ8R6V0-DbVgKKOUjfLT90UK_0 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8560095860803365034', time=2024-09-14T13:58:30.972287+0000, chain.objs.size()=1 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ps0zDe7Hx-nSIYkmuVx2PqEyFFnWSvs_0 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14387120334719804116', time=2024-09-14T13:58:31.051253+0000, chain.objs.size()=1 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xCLoYQh8q_MV8gFo-Vyvf8J7iP82TqH_0 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17014147395458443950', time=2024-09-14T13:58:32.957252+0000, chain.objs.size()=1 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6PzFZYZoCMwu6omSuXaejzxm_tSh24V_0 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10277288724483217635', time=2024-09-14T13:58:33.322253+0000, chain.objs.size()=1 2024-09-14T12:44:04.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cXpYJBLlvwc-LzTfYI5CordYMc-mYdc_0 2024-09-14T12:44:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6116807678251899309', time=2024-09-14T13:58:34.282321+0000, chain.objs.size()=1 2024-09-14T12:44:04.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.273+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tx3eSasQHa9_Nn2o1nYe8GVt2-79_fP_0 2024-09-14T12:44:04.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7926623479878067818', time=2024-09-14T14:00:21.396513+0000, chain.objs.size()=1 2024-09-14T12:44:04.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.qGNIW-ldH57_bHanIzEa4JPznYwqrCL_0 2024-09-14T12:44:04.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7056274905495896088', time=2024-09-14T14:00:23.488413+0000, chain.objs.size()=1 2024-09-14T12:44:04.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.639D1iucLU2GQ1A9LaHbjp8jvMDwAyF_0 2024-09-14T12:44:04.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5805547072774605859', time=2024-09-14T14:00:25.413164+0000, chain.objs.size()=1 2024-09-14T12:44:04.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.VmdQfkAh8gdDv_S1SNisA1_CGkLAgaW_0 2024-09-14T12:44:04.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8287210512893429826', time=2024-09-14T14:00:26.684886+0000, chain.objs.size()=1 2024-09-14T12:44:04.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j4heX8uFB9PvPmm40hPtYOYMHtg87ki_0 2024-09-14T12:44:04.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4346453193892219249', time=2024-09-14T14:00:27.426474+0000, chain.objs.size()=1 2024-09-14T12:44:04.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Qxk2eGxEcsaEleETXB3_DlZ1fnqw_n4_0 2024-09-14T12:44:04.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6215490570416889342', time=2024-09-14T14:00:27.626271+0000, chain.objs.size()=1 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.e01LWf5c4R5bHW7FEVyi303yY84uqE9_0 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5620964076584337428', time=2024-09-14T14:00:27.832019+0000, chain.objs.size()=1 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FRErlhcq5XKYPwCaNki7x0lkE1h159D_0 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.127300103095852482', time=2024-09-14T14:00:29.059068+0000, chain.objs.size()=1 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gAMDIdvcsfun5g8thvkJVjKtjnfz0pQ_0 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8687241530699140927', time=2024-09-14T14:00:29.903534+0000, chain.objs.size()=1 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rF98cRhN4W3khWIBXAKEozTT82YNJGk_0 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7065221029456055323', time=2024-09-14T14:00:32.843611+0000, chain.objs.size()=1 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.7VQiBhAPkTnPVKe5kxJZS9yHI68Y6Gg_0 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4266022260268459704', time=2024-09-14T14:00:34.082142+0000, chain.objs.size()=1 2024-09-14T12:44:04.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.277+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.357-tJOHQzxQ5yAMod1ryeS_3sreF-6_0 2024-09-14T12:44:04.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8192259967925970459', time=2024-09-14T14:00:35.762641+0000, chain.objs.size()=1 2024-09-14T12:44:04.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.7McZ6ejLC6-AFlqRJQcYNP7shlv7tqG_0 2024-09-14T12:44:04.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3849070253162343867', time=2024-09-14T14:00:36.692839+0000, chain.objs.size()=1 2024-09-14T12:44:04.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.EvBoIaiEEv_XGnHTVBNWoqseAboYAGd_0 2024-09-14T12:44:04.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17603977447535045866', time=2024-09-14T14:00:37.537169+0000, chain.objs.size()=1 2024-09-14T12:44:04.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pw7j2UMXdMWKfn9sJB8HQr66clI5MBj_0 2024-09-14T12:44:04.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17017856259738537867', time=2024-09-14T14:00:39.031848+0000, chain.objs.size()=1 2024-09-14T12:44:04.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TJSm6tw09i-04QVaUeA7kuBUPhKhX1Z_0 2024-09-14T12:44:04.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11648494906065939490', time=2024-09-14T14:00:40.366677+0000, chain.objs.size()=1 2024-09-14T12:44:04.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.HmvwTmU5o61ZdEnNsAtGYtlCdwtpPSA_0 2024-09-14T12:44:04.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15691723965166606002', time=2024-09-14T14:00:43.267883+0000, chain.objs.size()=1 2024-09-14T12:44:04.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.281+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1Jsy1QL19NSfUtpPD57-vdbFDB-1mmQ_0 2024-09-14T12:44:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10090843224772449645', time=2024-09-14T14:00:45.682227+0000, chain.objs.size()=1 2024-09-14T12:44:04.275 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.m8rGvJVA-qxuGYmlUoib7kBLu2BFAR2_0 2024-09-14T12:44:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11938780988435011887', time=2024-09-14T14:00:47.064216+0000, chain.objs.size()=1 2024-09-14T12:44:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kQR4J9dP8WXhZiyq7Fh1_xu_z5na37D_0 2024-09-14T12:44:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16697123684750128178', time=2024-09-14T14:00:47.730914+0000, chain.objs.size()=1 2024-09-14T12:44:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mXnWcMjEP85WHVCQWoW2-RttsA6yX42_0 2024-09-14T12:44:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12781887362066453850', time=2024-09-14T14:00:48.981929+0000, chain.objs.size()=1 2024-09-14T12:44:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bc1BsohZGHZPr--r8yRGpPxVsLZhMaJ_0 2024-09-14T12:44:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11920059221219628171', time=2024-09-14T14:00:49.361172+0000, chain.objs.size()=1 2024-09-14T12:44:04.276 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.285+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kArM78CZLOi0NuhrHnEd5_T8nc0K2xU_0 2024-09-14T12:44:04.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.289+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46607 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8553402479851040418', time=2024-09-14T14:02:54.166742+0000, chain.objs.size()=1 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.383__shadow_.XWi85uPS6vl_8R2La1-Pf9ZA0TTzUxI_0 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2239848511019855665', time=2024-09-14T14:03:12.785652+0000, chain.objs.size()=1 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.391__shadow_.82K3bL2KHbHi1l7-dKIR1nRu23jsPlp_0 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14508144099303837741', time=2024-09-14T14:04:58.460632+0000, chain.objs.size()=1 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.438__shadow_._AsYqb-mGK0GgNsQWdN7I9k2XDqVfTt_0 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4628392547595104213', time=2024-09-14T14:05:46.432759+0000, chain.objs.size()=1 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.457__shadow_.bSPeSqoZiI4ScJBAqlA4DMIkHxLzmsf_0 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9239895802996506776', time=2024-09-14T14:05:55.929349+0000, chain.objs.size()=1 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.460__shadow_.MRdqyR_pl-wZHQLTBbNon7e251eBl6y_0 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2603782082038864624', time=2024-09-14T14:06:14.063936+0000, chain.objs.size()=1 2024-09-14T12:44:04.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.466__shadow_.G3ej5SZnsKpcAPkKU1ic01uBbIABpIj_0 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16527216242796454617', time=2024-09-14T14:06:46.764161+0000, chain.objs.size()=1 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.hHoyOwkyO-Mo9c4-3ZM_DxPSrxdoqQW_0 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5249839941750593040', time=2024-09-14T14:07:18.545451+0000, chain.objs.size()=1 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.496__shadow_.ULJhEFCegGiu2wTZ4-EVebURDHG6El0_0 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.55964027166143305', time=2024-09-14T14:07:21.336275+0000, chain.objs.size()=1 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.497__shadow_.xtHgjA3oW0ZY3YdAHlz5OldOR66Z0CW_0 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~VnKJjIKaMJ8BjYC9rqKXhiFt0skvIWm', time=2024-09-14T14:15:54.412367+0000, chain.objs.size()=1 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.534__multipart_mymultipart.2~VnKJjIKaMJ8BjYC9rqKXhiFt0skvIWm.1 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15668498064860838438', time=2024-09-14T14:19:13.227253+0000, chain.objs.size()=1 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.567__shadow_.MCEcQGEZZbRdXdpTBIYsCGdJZwuzssW_0 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12249475214290281152', time=2024-09-14T14:19:30.806253+0000, chain.objs.size()=1 2024-09-14T12:44:04.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:jMtCY6yRc.zST978eb4uccRXQFv007u_.jn6JJ-Za1By0_Pw3btG0QKL6dRxVNpE_0 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11517383694045925308', time=2024-09-14T14:19:37.162316+0000, chain.objs.size()=1 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.293+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:5vs0OFUCO9.ALitgFlWoNrlI5DwCNQ0_.nxnqkEmVHMBAYxo2_KuOWs5ve8ncT2k_0 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.463177390302373010', time=2024-09-14T14:21:05.022184+0000, chain.objs.size()=1 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:VEHDqHAkiITd5KaMaESvhrcmZPbs.dP_.5YzFwDAM-0Vs92fU6uU3PqZ-VWoqJ-K_0 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12920157320534491813', time=2024-09-14T14:22:09.897033+0000, chain.objs.size()=1 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:ys4uqmJ2uBUyDm9KPb05VdGo.hBoVq-_.KtBwY8SvGLWmliDez8tq5_2AMBNwNBR_0 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14674815648919721076', time=2024-09-14T14:30:43.124282+0000, chain.objs.size()=1 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.645__shadow_.D3m1x1l_5zlpYrhxnotsCK3DtbFVvMf_0 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16739569913828964291', time=2024-09-14T14:37:21.273781+0000, chain.objs.size()=1 2024-09-14T12:44:04.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.748__shadow_.u_yz7Pb2BdbX6vei-R5ExTtKEYE_-17_0 2024-09-14T12:44:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15473697422577091354', time=2024-09-14T14:37:44.669099+0000, chain.objs.size()=1 2024-09-14T12:44:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.751__shadow_.kOHYt9Hup4hWOCPZy4vCTp4Pb4ka5Ly_0 2024-09-14T12:44:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6031074750694385602', time=2024-09-14T14:38:37.813658+0000, chain.objs.size()=1 2024-09-14T12:44:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.759__shadow_.RAP0HqEG5eB32WezFgi8vqw9UvqwBIj_0 2024-09-14T12:44:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1677415309791622664', time=2024-09-14T14:40:15.009931+0000, chain.objs.size()=1 2024-09-14T12:44:04.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.297+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.772__shadow_.TxqCtNqk06RLVwGQ7FgI2xmLK_CeDmu_0 2024-09-14T12:44:04.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.301+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T12:44:04.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48705' 2024-09-14T12:44:04.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_tpZm7RuwP_gvDFEyxYoFatns83nsf6K', time=2024-09-14T13:44:18.132410+0000, chain.objs.size()=3 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.164__shadow_.0OoHyYMvEPhoydm2JTZGICdBZS5PJ1N_0 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.164__shadow_.0OoHyYMvEPhoydm2JTZGICdBZS5PJ1N_1 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.164__shadow_.0OoHyYMvEPhoydm2JTZGICdBZS5PJ1N_2 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.576379271035931495', time=2024-09-14T13:50:45.953923+0000, chain.objs.size()=1 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.248__shadow_.-tOUzbR5UAV_SKuj9kFs6szmbVl-hdO_0 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13785630480472926913', time=2024-09-14T13:51:06.138310+0000, chain.objs.size()=1 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.256__shadow_.OwQ567dhQ2PisbuvwvmoMbcZmgxI1Pk_0 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8651739493445553012', time=2024-09-14T13:53:06.839799+0000, chain.objs.size()=1 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.YSKPaBroOwvFM8IexrQKjyZRDo-NyDW_0 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10989510245527427946', time=2024-09-14T13:53:07.327524+0000, chain.objs.size()=1 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.iXwNTcxOKqKzk0_Hv5nb5shMhb646jw_0 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4586431172578561433', time=2024-09-14T13:53:08.248208+0000, chain.objs.size()=1 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CE1ASzG47BliRKNE22e4ll65rTUj8Bh_0 2024-09-14T12:44:04.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7593286915490162821', time=2024-09-14T13:53:08.269501+0000, chain.objs.size()=1 2024-09-14T12:44:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3fTrxuYahNqFrVPIKQsYdSUaqmfv_ZZ_0 2024-09-14T12:44:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6146483853868693271', time=2024-09-14T13:53:08.298643+0000, chain.objs.size()=1 2024-09-14T12:44:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AYOOS_VrVNsyYoW0tpnAfSg7Fg2x3Vp_0 2024-09-14T12:44:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7676359266081278614', time=2024-09-14T13:53:10.804680+0000, chain.objs.size()=1 2024-09-14T12:44:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eHtPSgwKgioENK58vu59hca6SV77oF8_0 2024-09-14T12:44:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5076418985043049966', time=2024-09-14T13:53:11.043540+0000, chain.objs.size()=1 2024-09-14T12:44:04.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.305+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._TdMg6ldabmDFiuN08DRq761_6M5xp8_0 2024-09-14T12:44:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13440146221139312301', time=2024-09-14T13:53:12.150441+0000, chain.objs.size()=1 2024-09-14T12:44:04.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.39IyR81iygTUYMU_XXzwnOmA2l80cuO_0 2024-09-14T12:44:04.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14700509927048826701', time=2024-09-14T13:53:12.218637+0000, chain.objs.size()=1 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.A-Yf2T-kU05sRD99pD7jhsihDp6s0i0_0 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8526423173958300070', time=2024-09-14T13:53:13.693004+0000, chain.objs.size()=1 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.R5JLSM3hjVAjsP1HGIY420PHEWWeA4S_0 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.618413944537919264', time=2024-09-14T13:53:14.032441+0000, chain.objs.size()=1 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wGFA75kYpkc20aq5LxCMYYz_zPHKxgS_0 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14746767359541827640', time=2024-09-14T13:53:14.920012+0000, chain.objs.size()=1 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RoRU7xZ74dLZTW3cSiXj--9NjQOJ9TU_0 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.309+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3740494668229938588', time=2024-09-14T13:53:16.098991+0000, chain.objs.size()=1 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vDY25wfn3CVXsrjSwFv5khC5LP4GWhF_0 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13058429540320506785', time=2024-09-14T13:53:16.567733+0000, chain.objs.size()=1 2024-09-14T12:44:04.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Z_mboeYjl5uXHP4RYQjABv1-N7AQXO8_0 2024-09-14T12:44:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11942182317765199874', time=2024-09-14T13:53:18.240418+0000, chain.objs.size()=1 2024-09-14T12:44:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.J_AdS1WteVGD-ApJ6XkKb0rPQeXJ6CA_0 2024-09-14T12:44:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2828599089781183112', time=2024-09-14T13:53:19.368260+0000, chain.objs.size()=1 2024-09-14T12:44:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.evJD50YB6sqB1ZthR5sxPCRv0tvSvIM_0 2024-09-14T12:44:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2802411236590444520', time=2024-09-14T13:53:20.534062+0000, chain.objs.size()=1 2024-09-14T12:44:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Og-b6CVtNefjt4tvsywgf6uN6cRvaUN_0 2024-09-14T12:44:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.59239553772294099', time=2024-09-14T13:53:21.574838+0000, chain.objs.size()=1 2024-09-14T12:44:04.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.313+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._XKYdDFTs6mic3eRunkWvOpVtJom7UX_0 2024-09-14T12:44:04.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14906714559101353646', time=2024-09-14T13:53:21.960130+0000, chain.objs.size()=1 2024-09-14T12:44:04.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Lss_6mRMpud_bLp3RZaU0rhQBs-65ED_0 2024-09-14T12:44:04.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5857730777583098478', time=2024-09-14T13:53:22.351998+0000, chain.objs.size()=1 2024-09-14T12:44:04.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.L6W0W5Al7T6NWIMZMblJbcI708aIrhm_0 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11738978422455825137', time=2024-09-14T13:53:24.256632+0000, chain.objs.size()=1 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.IwEC3IumGzeBxZudb-wRkUDC2MEwx35_0 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14495900956552977282', time=2024-09-14T13:53:26.973304+0000, chain.objs.size()=1 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2lVMR1GlgdgoR7SX36t-FUCnnmaqCFZ_0 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2638378561301364275', time=2024-09-14T13:53:27.662301+0000, chain.objs.size()=1 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uULtwBaa50ZZVXRhfmu-4LcDaW8tFrq_0 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9656196707292726672', time=2024-09-14T13:53:28.991214+0000, chain.objs.size()=1 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.e-3krR00-TKpSjq8XKsG6RQNJ4-ROUf_0 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6533380675150532017', time=2024-09-14T13:53:29.322066+0000, chain.objs.size()=1 2024-09-14T12:44:04.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ic2S5CB5slNOCoVVSzbJpKTJz5xBPmN_0 2024-09-14T12:44:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3394452368018575596', time=2024-09-14T13:53:31.127747+0000, chain.objs.size()=1 2024-09-14T12:44:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9RMdXhBOAr6RsVSA-KrhYF-ci1l91jJ_0 2024-09-14T12:44:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1402448121254903483', time=2024-09-14T13:53:33.291569+0000, chain.objs.size()=1 2024-09-14T12:44:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.2aelRfsy0kQ1XclOyJ98NO-HIzslXBQ_0 2024-09-14T12:44:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7192194010250386868', time=2024-09-14T13:53:33.893151+0000, chain.objs.size()=1 2024-09-14T12:44:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aAjHkLus41fy5s22OIAMpgIYdTqHDbk_0 2024-09-14T12:44:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16067924413111465170', time=2024-09-14T13:53:34.966523+0000, chain.objs.size()=1 2024-09-14T12:44:04.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.317+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.zs8BStpfcaXVseb0jK-p_HJb3kBOQcf_0 2024-09-14T12:44:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18395125316140533120', time=2024-09-14T13:53:34.990141+0000, chain.objs.size()=1 2024-09-14T12:44:04.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ndwhqNDg2G2SlDcZbo56cAf_78-b2ft_0 2024-09-14T12:44:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14256965804086662316', time=2024-09-14T13:54:18.820298+0000, chain.objs.size()=1 2024-09-14T12:44:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.281__shadow_.e-9DCTptaN1Q-BFSwQorg2MW6linrLq_0 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2994740951967815832', time=2024-09-14T13:54:53.020937+0000, chain.objs.size()=1 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.JuCz386GxNvydik0Eg0yrMA1p9ixnm3_0 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16319746674994514411', time=2024-09-14T13:54:53.210670+0000, chain.objs.size()=1 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.-_u-S9MEeyUwPrbxZB2_88CKehtlnBe_0 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7646236586465264186', time=2024-09-14T13:55:36.104575+0000, chain.objs.size()=1 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.308__shadow:N.MBEbC6tdwjpeV5BIRDXRyKeYp2vwr_.XCSqoFGLBBkWZzOhh-Lwp6tVTKuA8NP_0 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15116240764464761417', time=2024-09-14T13:56:02.098745+0000, chain.objs.size()=1 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.316__shadow_.lMTXDu9IrzCth7MKbTTO_OZKi_68W7I_0 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5647003878946345747', time=2024-09-14T13:58:07.902301+0000, chain.objs.size()=1 2024-09-14T12:44:04.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pSZIS2Fn53hUU7L2og7s5Sm7UstkP3n_0 2024-09-14T12:44:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6950175388585951063', time=2024-09-14T13:58:08.351851+0000, chain.objs.size()=1 2024-09-14T12:44:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.81m35xbcFf-S712xo6gfkw0T8GdaVdG_0 2024-09-14T12:44:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17649273527827705954', time=2024-09-14T13:58:08.358613+0000, chain.objs.size()=1 2024-09-14T12:44:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KP1sTMvga31bSQvdkoeU9mddd1SpCtI_0 2024-09-14T12:44:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10210884016121548003', time=2024-09-14T13:58:09.679056+0000, chain.objs.size()=1 2024-09-14T12:44:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ZM3RfAmxaDa4i1VLI5rvm4Nem8D4WCh_0 2024-09-14T12:44:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1881232988648004302', time=2024-09-14T13:58:10.397613+0000, chain.objs.size()=1 2024-09-14T12:44:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.321+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.btP_FJo8F7wkKs9c7EGMXD1hYtMc5GP_0 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8454388763093731670', time=2024-09-14T13:58:11.054770+0000, chain.objs.size()=1 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.dUB0Ni2Pc5P6hFrfaL3uwu3fwaCMfl8_0 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4552126858605208785', time=2024-09-14T13:58:14.222248+0000, chain.objs.size()=1 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KPgvE7FkrOeSJPuO9OJcK7o0c1OWTS-_0 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8534059449344572002', time=2024-09-14T13:58:14.262267+0000, chain.objs.size()=1 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.dVhOwnkMJU_98yTFB3jEuLD3y2IfqU3_0 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6371156158735487713', time=2024-09-14T13:58:14.323512+0000, chain.objs.size()=1 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VgtOPe1KQoY5OKq0y7pGwI_tyX8yV84_0 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9893884391778313079', time=2024-09-14T13:58:15.022480+0000, chain.objs.size()=1 2024-09-14T12:44:04.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eKg4QPP_Bdfw0TE-4ztXB1zc_BQTYuy_0 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6619019363945649919', time=2024-09-14T13:58:15.756748+0000, chain.objs.size()=1 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3V9FoTFpdvpCHWkGUEiEfVHui7pPNbP_0 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7110150988838967994', time=2024-09-14T13:58:15.948179+0000, chain.objs.size()=1 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.hASHZ4zYMyytKrE-oRCZAr-sA_8VEQq_0 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14843482559319146074', time=2024-09-14T13:58:17.308441+0000, chain.objs.size()=1 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3b7iiOvcjGoc8JTY9kIR1uEw-gD9L-o_0 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1315185271424579486', time=2024-09-14T13:58:17.801028+0000, chain.objs.size()=1 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TeXpEw1D6lTWNZp0NI3zmmoefHt28BN_0 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.384277843546732701', time=2024-09-14T13:58:18.388373+0000, chain.objs.size()=1 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ApD8HlYFrj9AWarJ0IC4RIeqoxGIuLW_0 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.996783554772982291', time=2024-09-14T13:58:18.874130+0000, chain.objs.size()=1 2024-09-14T12:44:04.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.329+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3OkO4oFr2s0HvaY6XLeM2K7YattLFlL_0 2024-09-14T12:44:04.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3229343322552392273', time=2024-09-14T13:58:19.712819+0000, chain.objs.size()=1 2024-09-14T12:44:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Tit2RjsnP5B09lyc43O5IJLkJAwmIbm_0 2024-09-14T12:44:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8119861094022004358', time=2024-09-14T13:58:20.172541+0000, chain.objs.size()=1 2024-09-14T12:44:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ytMxd8NYg9Sv8QPQjFF3MZFrM5M4Br1_0 2024-09-14T12:44:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17860785801740178451', time=2024-09-14T13:58:21.637949+0000, chain.objs.size()=1 2024-09-14T12:44:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.vSFkl-tdJxH7e--pjWaaqPJ1OETCVH6_0 2024-09-14T12:44:04.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16233693119176849639', time=2024-09-14T13:58:22.436083+0000, chain.objs.size()=1 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.iHoK6K4q8xXL7alaoMZdbF1e418dE7d_0 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17042953743196703468', time=2024-09-14T13:58:23.191391+0000, chain.objs.size()=1 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0uEozi8Y2cffMqlWzn5imtFXl3IX2Kj_0 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18365758670501549119', time=2024-09-14T13:58:25.721716+0000, chain.objs.size()=1 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WoB9tFhcx57GTjfFn3oHabMdZH5R0LP_0 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1263244571324863794', time=2024-09-14T13:58:25.971572+0000, chain.objs.size()=1 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.qXgwJq4ocVkQUULU6hlkd4gghEF0PvA_0 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14953972428302956842', time=2024-09-14T13:58:26.378952+0000, chain.objs.size()=1 2024-09-14T12:44:04.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-60YCrNwDts6_41wVsNRDHsZAkTKW0b_0 2024-09-14T12:44:04.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9309354750927631464', time=2024-09-14T13:58:27.277135+0000, chain.objs.size()=1 2024-09-14T12:44:04.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.v1WWdbyzO63X11RsB20GFj66wKAFhVY_0 2024-09-14T12:44:04.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12785085814881346474', time=2024-09-14T13:58:27.410262+0000, chain.objs.size()=1 2024-09-14T12:44:04.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.iafDHdb1eqzOyR6UB7Ne8dAGakR13Vj_0 2024-09-14T12:44:04.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18369408102706606261', time=2024-09-14T13:58:27.583762+0000, chain.objs.size()=1 2024-09-14T12:44:04.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.337+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.T-OWNyx6_q3vQvTXBvthjgXIP1yuZOp_0 2024-09-14T12:44:04.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13585156741144644096', time=2024-09-14T13:58:28.474995+0000, chain.objs.size()=1 2024-09-14T12:44:04.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.p_E2GiGXCQjyUpHEZI2SH803hvAYmyY_0 2024-09-14T12:44:04.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12904082551640158498', time=2024-09-14T13:58:29.144350+0000, chain.objs.size()=1 2024-09-14T12:44:04.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.J16NBcmujWNbqA4HD4geoZcdCMr85Pg_0 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12542606459879688625', time=2024-09-14T13:58:30.052704+0000, chain.objs.size()=1 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.E9tdwVdW82ozDtZhMHabwU1ihXYu4_o_0 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9836726871907843723', time=2024-09-14T13:58:30.360716+0000, chain.objs.size()=1 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.S89wTNAHdSRBul6INMA885ud8S8eLwR_0 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13622452372924178900', time=2024-09-14T13:58:32.726928+0000, chain.objs.size()=1 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._5M_ywOhOPp_iRgSbseZEVkcpEhDUEA_0 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6017969910501722563', time=2024-09-14T14:00:22.233010+0000, chain.objs.size()=1 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.341+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yAObAWuaInVlc0y14TEBti3rhb43v1Z_0 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10224240635709855733', time=2024-09-14T14:00:23.188852+0000, chain.objs.size()=1 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.F7W8AOOOV-BomO6PCR0vdpiV0Cvebba_0 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15468641411935259236', time=2024-09-14T14:00:23.419415+0000, chain.objs.size()=1 2024-09-14T12:44:04.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2tmgSbQ43RetJHLYItzyGCLzJ_cxqN6_0 2024-09-14T12:44:04.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7770508838477228076', time=2024-09-14T14:00:25.430958+0000, chain.objs.size()=1 2024-09-14T12:44:04.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AdRD2ctTz5V4qXpVk0HIBBcO_y74Bdy_0 2024-09-14T12:44:04.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11979171651555106482', time=2024-09-14T14:00:26.171521+0000, chain.objs.size()=1 2024-09-14T12:44:04.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.waT96QGAwvpmo2tozmrto8xxiACjr9s_0 2024-09-14T12:44:04.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1568163479114034526', time=2024-09-14T14:00:27.784281+0000, chain.objs.size()=1 2024-09-14T12:44:04.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rN6SYpIX4kZzNz1sQzs6fT_cPSUfEqz_0 2024-09-14T12:44:04.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8158882482935676234', time=2024-09-14T14:00:27.959552+0000, chain.objs.size()=1 2024-09-14T12:44:04.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.345+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KHFkkwe9UdvaaTH9hUEtsBSj2p0dZid_0 2024-09-14T12:44:04.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3039452529882145674', time=2024-09-14T14:00:28.893221+0000, chain.objs.size()=1 2024-09-14T12:44:04.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5afWmCI7iBSnHR0OEstXPQ6h8YyiF21_0 2024-09-14T12:44:04.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8665816945183465593', time=2024-09-14T14:00:29.029939+0000, chain.objs.size()=1 2024-09-14T12:44:04.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bCvoxiaGhgkuTLRZwJOIv8nErBeJ1Hu_0 2024-09-14T12:44:04.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8918624458799397122', time=2024-09-14T14:00:31.847297+0000, chain.objs.size()=1 2024-09-14T12:44:04.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TtFARzERC9hkIdrB_QxylVr4DhnfKaV_0 2024-09-14T12:44:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4745625744096809083', time=2024-09-14T14:00:33.509073+0000, chain.objs.size()=1 2024-09-14T12:44:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FWWkajiT03_vR1-IwyyvqA8G1ah4SP9_0 2024-09-14T12:44:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1973386751432817424', time=2024-09-14T14:00:33.717855+0000, chain.objs.size()=1 2024-09-14T12:44:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.EXpBoysnEBoSZFUJ8a32rGNjrmpp7m2_0 2024-09-14T12:44:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8545298622748585019', time=2024-09-14T14:00:33.780058+0000, chain.objs.size()=1 2024-09-14T12:44:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rctpJeRbTLy0FK6qcwQLVRKC0RPEAdB_0 2024-09-14T12:44:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15718271627763277450', time=2024-09-14T14:00:34.613787+0000, chain.objs.size()=1 2024-09-14T12:44:04.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.349+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.MXNK1i-e_ruipw2BCUabRb0NhinW-3L_0 2024-09-14T12:44:04.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3247171736021762124', time=2024-09-14T14:00:34.706245+0000, chain.objs.size()=1 2024-09-14T12:44:04.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.MlE7Ki9PlKnesr5Fkq3QDhEuO-QgVad_0 2024-09-14T12:44:04.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14679670204691557717', time=2024-09-14T14:00:34.743554+0000, chain.objs.size()=1 2024-09-14T12:44:04.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lDz6J2uf1AYJP_u5wXLQfG7AntIACUs_0 2024-09-14T12:44:04.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5225856802720057722', time=2024-09-14T14:00:36.672314+0000, chain.objs.size()=1 2024-09-14T12:44:04.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ml7DGdpo-n66-sIaPx5mWw1SVTvAD5x_0 2024-09-14T12:44:04.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5530565240432297671', time=2024-09-14T14:00:36.756308+0000, chain.objs.size()=1 2024-09-14T12:44:04.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.AvkRMRzIzddRvkRtlFUlsLpO4IQpfXW_0 2024-09-14T12:44:04.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12462394395207114740', time=2024-09-14T14:00:37.512754+0000, chain.objs.size()=1 2024-09-14T12:44:04.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ppWH6pykB7WW73a43kvpeacl61rmUm1_0 2024-09-14T12:44:04.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14609986379102979875', time=2024-09-14T14:00:39.434317+0000, chain.objs.size()=1 2024-09-14T12:44:04.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IpLEPX7kGCgWakWzAybZn4C2tsCrRVI_0 2024-09-14T12:44:04.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6695979818724634877', time=2024-09-14T14:00:40.799913+0000, chain.objs.size()=1 2024-09-14T12:44:04.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fLEAcqJHEFIUxzZx_0UxaVyfC1Lcype_0 2024-09-14T12:44:04.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1372815662304831242', time=2024-09-14T14:00:41.470264+0000, chain.objs.size()=1 2024-09-14T12:44:04.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.353+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CEMmOQQd4vOJF-I8YVv2GZrXQLTzHgV_0 2024-09-14T12:44:04.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5431257451405439656', time=2024-09-14T14:00:41.790689+0000, chain.objs.size()=1 2024-09-14T12:44:04.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3G_QFk7yjOuNbEhHmcLYF-13oHrvVYo_0 2024-09-14T12:44:04.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11486156078201765190', time=2024-09-14T14:00:41.919272+0000, chain.objs.size()=1 2024-09-14T12:44:04.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.sY9_R3cM-tGQ2vCWTyUMeKxrSSaWdY-_0 2024-09-14T12:44:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18108441100988984368', time=2024-09-14T14:00:44.126318+0000, chain.objs.size()=1 2024-09-14T12:44:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hwnbp-GWyG3G_Jp3E_YqVTe7jj9EMdc_0 2024-09-14T12:44:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17692423080484936803', time=2024-09-14T14:00:44.365665+0000, chain.objs.size()=1 2024-09-14T12:44:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pIQciI-LQug-A4plhTLNOq-ura7ppxi_0 2024-09-14T12:44:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2360807378140182824', time=2024-09-14T14:00:45.287165+0000, chain.objs.size()=1 2024-09-14T12:44:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JQLkmjatap2HnAE1baXi1cpETudGYVu_0 2024-09-14T12:44:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11706093155306911195', time=2024-09-14T14:00:45.945991+0000, chain.objs.size()=1 2024-09-14T12:44:04.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SztJvoUo-SUiTYDxMxuTVjoTNTS5IM-_0 2024-09-14T12:44:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6003872978787200819', time=2024-09-14T14:00:47.744044+0000, chain.objs.size()=1 2024-09-14T12:44:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._r2QdYwvxi8ROKMZfROUTChL3HJHquP_0 2024-09-14T12:44:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4038042961471376659', time=2024-09-14T14:00:48.567321+0000, chain.objs.size()=1 2024-09-14T12:44:04.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.357+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.P1ilSk2ce6sodrvZBA_EdB8XkAaDSFc_0 2024-09-14T12:44:04.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.365+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48705 2024-09-14T12:44:04.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T12:44:04.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16349386882126221076', time=2024-09-14T14:00:49.138505+0000, chain.objs.size()=1 2024-09-14T12:44:04.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QSC1SEP2m5JUV_Re4WmuukI3DBAAIrI_0 2024-09-14T12:44:04.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14937257747223588169', time=2024-09-14T14:06:11.872821+0000, chain.objs.size()=1 2024-09-14T12:44:04.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.465__shadow_.WTDjwer4fUN0sGx67UbDeFIbMJDpGnY_0 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6493434825946784571', time=2024-09-14T14:19:23.739176+0000, chain.objs.size()=1 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:a2QnLKYN-4kwFq9sv1qBjT3xG7NQeUZ_.LtwpL1yqNJ0HwXMLfFAaDDbcQsUA2Us_0 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.944229425463851249', time=2024-09-14T14:19:30.145171+0000, chain.objs.size()=1 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:V9jQpS-egd7tSN7G7XWkJuVUGkwmJQ8_.hiYdCtZWp41WrWO59E0Sk44riBx_KFX_0 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3927424487275420727', time=2024-09-14T14:20:15.090681+0000, chain.objs.size()=1 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:5E3TtaCkev87DDqpuuoiVRe-NbiDjHo_.gsttb7wo66myLmg4spLqrAgbh3PK4AY_0 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7452418131431252959', time=2024-09-14T14:20:19.134550+0000, chain.objs.size()=1 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:8krtheopiM5HXFAADUMnOxI7Jd1bpm4_.CO8XRJAj3UV3_TZcHuCC424eh99dq4S_0 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6876199804816788355', time=2024-09-14T14:20:33.577808+0000, chain.objs.size()=1 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:H-tyny39y3BwgnPLPCU08m2lMBtzrzF_.4nrQsYaM3PBwny1LbofItQ81rzB1Rfb_0 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6853055881045829966', time=2024-09-14T14:21:52.768354+0000, chain.objs.size()=4 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~c4yxf4hh9bXrkxvYaxfebuGZh97E_0E.1 2024-09-14T12:44:04.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~c4yxf4hh9bXrkxvYaxfebuGZh97E_0E.2 2024-09-14T12:44:04.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~c4yxf4hh9bXrkxvYaxfebuGZh97E_0E.3 2024-09-14T12:44:04.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.579__multipart_testobj.2~c4yxf4hh9bXrkxvYaxfebuGZh97E_0E.4 2024-09-14T12:44:04.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2383473884642916618', time=2024-09-14T14:29:52.179532+0000, chain.objs.size()=1 2024-09-14T12:44:04.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.369+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.627__shadow_.dkbzfL0HVhoVkBmAhjowyXMrFMz8NZ3_0 2024-09-14T12:44:04.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4887410072023880047', time=2024-09-14T14:30:19.093898+0000, chain.objs.size()=1 2024-09-14T12:44:04.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.638__shadow_.RAV2u5joceDDa3ndO0F-dUV4z7cVhPi_0 2024-09-14T12:44:04.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3275383756567102115', time=2024-09-14T14:32:32.359354+0000, chain.objs.size()=6 2024-09-14T12:44:04.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.662__multipart_baz.2~P4nBgUB0qdTYonM0UJogjy9lNmIyMNd.1 2024-09-14T12:44:04.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.662__multipart_baz.2~P4nBgUB0qdTYonM0UJogjy9lNmIyMNd.2 2024-09-14T12:44:04.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.662__multipart_baz.2~P4nBgUB0qdTYonM0UJogjy9lNmIyMNd.3 2024-09-14T12:44:04.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.662__multipart_baz.2~P4nBgUB0qdTYonM0UJogjy9lNmIyMNd.4 2024-09-14T12:44:04.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.662__multipart_baz.2~P4nBgUB0qdTYonM0UJogjy9lNmIyMNd.5 2024-09-14T12:44:04.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.662__multipart_baz.2~P4nBgUB0qdTYonM0UJogjy9lNmIyMNd.6 2024-09-14T12:44:04.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8909486346151222428', time=2024-09-14T14:33:40.742866+0000, chain.objs.size()=1 2024-09-14T12:44:04.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.695__shadow:pJbjORWpLz6X7NjAHL1b-Ru16miyth5_.XQjFLvwrZyeQWgMvJNqxLsKtWemm29o_0 2024-09-14T12:44:04.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4775961382742745709', time=2024-09-14T14:36:03.790868+0000, chain.objs.size()=1 2024-09-14T12:44:04.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.373+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.740__shadow_.V9mEp4Jd_PdW3lHFwWPaRMr9zR0geTE_0 2024-09-14T12:44:04.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.381+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.381+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T12:44:04.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f6280640 0 -- 172.21.15.148:0/1251537213 >> [v2:172.21.15.150:6816/485011589,v1:172.21.15.150:6818/485011589] conn(0x7ff7e801c040 msgr2=0x7ff6c0092460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:44:04.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45337' 2024-09-14T12:44:04.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9982370292509215025', time=2024-09-14T13:43:39.658148+0000, chain.objs.size()=3 2024-09-14T12:44:04.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-STANDARD.2~PKwuZM8Vtd7Q00I3krXnGBMVzo4hwgN.1 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-STANDARD.2~PKwuZM8Vtd7Q00I3krXnGBMVzo4hwgN.2 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__multipart_foo-STANDARD.2~PKwuZM8Vtd7Q00I3krXnGBMVzo4hwgN.3 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13330124288209226133', time=2024-09-14T13:50:34.374927+0000, chain.objs.size()=1 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.244__shadow_.chnzKmw9spcAXEIZTxl0cFK6fE37mHd_0 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5594773221187948736', time=2024-09-14T13:51:01.090190+0000, chain.objs.size()=1 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.254__shadow_.tKqH55rXhsTiG_kqsLqyi-uEo_yjHcO_0 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1176222819222914460', time=2024-09-14T13:51:18.339452+0000, chain.objs.size()=1 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.261__shadow_.893CDH_fPHWMNeWxqXOpjgLmb7xSom9_0 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13042609368342378885', time=2024-09-14T13:53:06.157855+0000, chain.objs.size()=1 2024-09-14T12:44:04.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OfpUjmCl6jngN-nCLB4YsD1M3IDHHhB_0 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14491079607580645380', time=2024-09-14T13:53:06.186348+0000, chain.objs.size()=1 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.T_SK1qjwc6hioSPs1b7UEizcFY5_R3e_0 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11189872226784636190', time=2024-09-14T13:53:07.239020+0000, chain.objs.size()=1 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8eGBgPgUk969Ew0cNDgPaIszn8uAHlJ_0 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6868496724986407693', time=2024-09-14T13:53:09.477728+0000, chain.objs.size()=1 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BTm2G6IPRUD-4VnE-uv84Ed73q67foM_0 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15011188306498253279', time=2024-09-14T13:53:09.539686+0000, chain.objs.size()=1 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pJVf-UqIAUHlKud85fXD4D-kzeWl9lM_0 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12735212245030311705', time=2024-09-14T13:53:09.544696+0000, chain.objs.size()=1 2024-09-14T12:44:04.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.385+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KqCEoTIm316kkUvdbgKsaZprv8WvQsn_0 2024-09-14T12:44:04.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1349901817437406367', time=2024-09-14T13:53:10.481592+0000, chain.objs.size()=1 2024-09-14T12:44:04.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.58a5tdFS9Ge5ROdLS_3qg03ADC9ANag_0 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4085556746154480218', time=2024-09-14T13:53:10.682261+0000, chain.objs.size()=1 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.L-6mVs-y8IHSyK75s1MLn-eEZS_fN4i_0 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1656511836735905922', time=2024-09-14T13:53:10.684128+0000, chain.objs.size()=1 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vxSOal5F8ZXlWuJXvaIhKGzvtVQVMKB_0 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4233691415459014031', time=2024-09-14T13:53:13.602351+0000, chain.objs.size()=1 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dhOVhI_p5Tzx_tepHWhCbnU5-CkYzYv_0 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10873502238836752213', time=2024-09-14T13:53:13.604313+0000, chain.objs.size()=1 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vQZczX0ynOQ2QbBeYRXZdU_pGXjHWB6_0 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4910765352789439502', time=2024-09-14T13:53:13.692920+0000, chain.objs.size()=1 2024-09-14T12:44:04.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3EFcfLyBaMB1GESoKlfKH1sbiQAhodn_0 2024-09-14T12:44:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13032000752611427958', time=2024-09-14T13:53:14.431149+0000, chain.objs.size()=1 2024-09-14T12:44:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AN0HmnIcJrIqGcWnF67VoUoXnqhdxdV_0 2024-09-14T12:44:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10570170735465050834', time=2024-09-14T13:53:14.553832+0000, chain.objs.size()=1 2024-09-14T12:44:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.yqVu2ypls6HY-zfC4a1B2UlkYs07i8N_0 2024-09-14T12:44:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11526263715794640750', time=2024-09-14T13:53:14.919701+0000, chain.objs.size()=1 2024-09-14T12:44:04.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.389+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pG8wgA9nNW1Pa-LIAxNPW6Dn5_8SzL6_0 2024-09-14T12:44:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.393+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11587073940660857620', time=2024-09-14T13:53:15.382190+0000, chain.objs.size()=1 2024-09-14T12:44:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-LUVvcVD6rnka_KoI866T5dUkBFDjv__0 2024-09-14T12:44:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.393+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11157513872494387587', time=2024-09-14T13:53:15.849663+0000, chain.objs.size()=1 2024-09-14T12:44:04.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lppjdOKMiRYMnjwj_9tI_l5P-zWgABk_0 2024-09-14T12:44:04.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.393+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16479049255048012083', time=2024-09-14T13:53:18.233814+0000, chain.objs.size()=1 2024-09-14T12:44:04.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.393+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._6OFiZ1H8FXaNncLUavTgM8p2FqIqkE_0 2024-09-14T12:44:04.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3662175739024325854', time=2024-09-14T13:53:19.361336+0000, chain.objs.size()=1 2024-09-14T12:44:04.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.euIjr-BXI5pInBQ_8F1BguAARxqaB2u_0 2024-09-14T12:44:04.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4885173156094384038', time=2024-09-14T13:53:21.613257+0000, chain.objs.size()=1 2024-09-14T12:44:04.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dwq-gUXSwQM2I9iFbwF8yNRrMmamRQG_0 2024-09-14T12:44:04.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12115759599620735436', time=2024-09-14T13:53:25.553112+0000, chain.objs.size()=1 2024-09-14T12:44:04.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.P_5VakFjgjVab_Qo4e-H76peU9XbanE_0 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10017119733933980960', time=2024-09-14T13:53:25.612541+0000, chain.objs.size()=1 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UbBWHrgtOUc2Z6fPqWtvZiPVSYiqYN6_0 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17640879186928975057', time=2024-09-14T13:53:26.323584+0000, chain.objs.size()=1 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.F9UMSCsv6RVR0UxaeXosCKPWJV9Ytb8_0 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8902871473520441780', time=2024-09-14T13:53:28.078473+0000, chain.objs.size()=1 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.89u7E6_1AkOmKTo7xZ-vUYYPOCjCPbz_0 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17764547076478402551', time=2024-09-14T13:53:28.857300+0000, chain.objs.size()=1 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.XW5gIlVmPhVarEWjwHE7RYAwmba_P3g_0 2024-09-14T12:44:04.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17963617389900575396', time=2024-09-14T13:53:30.115236+0000, chain.objs.size()=1 2024-09-14T12:44:04.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8VSsfDjSGfpvClQlK0lHlHvrpB4haJE_0 2024-09-14T12:44:04.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7909061111649835131', time=2024-09-14T13:53:31.933088+0000, chain.objs.size()=1 2024-09-14T12:44:04.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.POGtfutA1kmARubG2yC0WCOri82RVxB_0 2024-09-14T12:44:04.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8384483064200834421', time=2024-09-14T13:53:32.803664+0000, chain.objs.size()=1 2024-09-14T12:44:04.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.397+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TuAgE3YiqUGpA9xeXGq5qagDDRJ5vyV_0 2024-09-14T12:44:04.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6823417686122047762', time=2024-09-14T13:53:33.423714+0000, chain.objs.size()=1 2024-09-14T12:44:04.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8SYwGeENEGR4oo64gFnQYC5KOx_CKJ__0 2024-09-14T12:44:04.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7685668349830518450', time=2024-09-14T13:53:33.801796+0000, chain.objs.size()=1 2024-09-14T12:44:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.pyxYQMm0VpNWTczJoOSsfUc8irjla_-_0 2024-09-14T12:44:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5517068674681969290', time=2024-09-14T13:53:33.912866+0000, chain.objs.size()=1 2024-09-14T12:44:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0IdvXU8g5mIKK3lN63CrxXqM9g4HPKn_0 2024-09-14T12:44:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18262042260614454884', time=2024-09-14T13:53:34.870606+0000, chain.objs.size()=1 2024-09-14T12:44:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jddj1t1tYh6td9lzGeHgr6mV9cpcmMd_0 2024-09-14T12:44:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7089138684755277312', time=2024-09-14T13:53:37.609039+0000, chain.objs.size()=1 2024-09-14T12:44:04.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.264__shadow_.HZQ0-QP0kioYmvqtpFKH14JISX2JVkD_0 2024-09-14T12:44:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9033158305214008357', time=2024-09-14T13:53:40.038578+0000, chain.objs.size()=1 2024-09-14T12:44:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.265__shadow_.FRMqp8PSf-yazbW2IyXTHNMm_wuzRNc_0 2024-09-14T12:44:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12451852218845161921', time=2024-09-14T13:54:03.773929+0000, chain.objs.size()=1 2024-09-14T12:44:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.275__shadow_.jQSAii-iChIo6mLsxY9ZJ1uwSXjDPQG_0 2024-09-14T12:44:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6271292953076434884', time=2024-09-14T13:54:11.310373+0000, chain.objs.size()=1 2024-09-14T12:44:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.278__shadow_.pBd0BjXBXklBM3PcclQ6CX6A1-xHQ4B_0 2024-09-14T12:44:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12102996821890228049', time=2024-09-14T13:54:18.798867+0000, chain.objs.size()=1 2024-09-14T12:44:04.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.401+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.281__shadow_.7F2MNwMFj_ba3DUHwNBoohdTeVe_tAl_0 2024-09-14T12:44:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14734580056097762893', time=2024-09-14T13:54:21.254493+0000, chain.objs.size()=1 2024-09-14T12:44:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.282__shadow_.U4ZsIkT4XSgPdE4clVuNrvKtSySJGIF_0 2024-09-14T12:44:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13433162115870644645', time=2024-09-14T13:54:23.823426+0000, chain.objs.size()=1 2024-09-14T12:44:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.283__shadow_.aQRW196rrwmLn-Uy3jFKdNvgEvgeVlf_0 2024-09-14T12:44:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6126348189534990755', time=2024-09-14T13:55:04.057253+0000, chain.objs.size()=1 2024-09-14T12:44:04.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.296__shadow_.h91FdH_z0r0D97NwU6Hq_GHXvDc6Dob_0 2024-09-14T12:44:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5826917038763759591', time=2024-09-14T13:55:09.138279+0000, chain.objs.size()=1 2024-09-14T12:44:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.298__shadow_.NTLwlJEtK0WkZlwg-KSJBHIpUmNmG8P_0 2024-09-14T12:44:04.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8650768123155598916', time=2024-09-14T13:55:16.901519+0000, chain.objs.size()=1 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.301__shadow_.xK_47ghv-OTKnqrZmSsSUpjSlc4A9wC_0 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1861959245096151478', time=2024-09-14T13:55:29.455826+0000, chain.objs.size()=1 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.306__shadow_.PCAml8TWfVmVDBn0sJHJ-JzNIDiyGy2_0 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1150756461759403890', time=2024-09-14T13:55:29.478834+0000, chain.objs.size()=1 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.306__shadow_.xzUbSDQeufVLNXhyHVuyeyslw_UkkCn_0 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1851789889845376242', time=2024-09-14T13:58:05.938517+0000, chain.objs.size()=1 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6JBzM5tpmrZ8uFbMnotGepMD7IJZlwE_0 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6183615891211202182', time=2024-09-14T13:58:06.009184+0000, chain.objs.size()=1 2024-09-14T12:44:04.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.405+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XDFd_Eqmi1lIAB5XTFDmwGqjMCFHbd__0 2024-09-14T12:44:04.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4635774750055281262', time=2024-09-14T13:58:06.442968+0000, chain.objs.size()=1 2024-09-14T12:44:04.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XsRcCRo8VjjoMNbad9mSdYhLqec4Y1y_0 2024-09-14T12:44:04.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7001827355102226840', time=2024-09-14T13:58:07.010951+0000, chain.objs.size()=1 2024-09-14T12:44:04.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LTFf_yvEIcdXf1n2VikhJb9RZ5Jt6rg_0 2024-09-14T12:44:04.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18160780731510351605', time=2024-09-14T13:58:07.535332+0000, chain.objs.size()=1 2024-09-14T12:44:04.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.uc0r2cz7fHAf1u641DEV5idr0nkLSJG_0 2024-09-14T12:44:04.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11295681753823393101', time=2024-09-14T13:58:10.703178+0000, chain.objs.size()=1 2024-09-14T12:44:04.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FniMBpaLeoIpqDqinBM1kgJm9cWh_TH_0 2024-09-14T12:44:04.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10163245352139602041', time=2024-09-14T13:58:10.773885+0000, chain.objs.size()=1 2024-09-14T12:44:04.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.409+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ih3sKefwyhlj8Q1on3LJzhooft6lJsI_0 2024-09-14T12:44:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3947429411781544603', time=2024-09-14T13:58:10.992543+0000, chain.objs.size()=1 2024-09-14T12:44:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.afUxF_Zdb1vt8GGf2JLIAyDnzv-LrNp_0 2024-09-14T12:44:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18146583122827109574', time=2024-09-14T13:58:11.443113+0000, chain.objs.size()=1 2024-09-14T12:44:04.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.UNk0uTu9cC_Q28mwVvzVuDOOphFygti_0 2024-09-14T12:44:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12490673800021685771', time=2024-09-14T13:58:13.798592+0000, chain.objs.size()=1 2024-09-14T12:44:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FCIQ5W2Y0lwYeFwFmTSzvccej506FDt_0 2024-09-14T12:44:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14961871847657270741', time=2024-09-14T13:58:14.757698+0000, chain.objs.size()=1 2024-09-14T12:44:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.MM8d__6P2E1CsdAjjufXrrUcbnEw-JA_0 2024-09-14T12:44:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6838774045247304016', time=2024-09-14T13:58:15.504650+0000, chain.objs.size()=1 2024-09-14T12:44:04.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.XI1ayNN-ecjfDc25XqD17rfhd4sHt7y_0 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1764170580709842875', time=2024-09-14T13:58:15.577480+0000, chain.objs.size()=1 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rXgsEjC7pr6Fo2N62VJ0rQKaGp56lQv_0 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1351401990386458054', time=2024-09-14T13:58:15.756679+0000, chain.objs.size()=1 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fHdwnNRFlBnGVdX91p7FVk_PANFl7ai_0 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2820259860186577554', time=2024-09-14T13:58:16.277765+0000, chain.objs.size()=1 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.shStzUxCmUFH19TkjFgxtBYUWFJJL8X_0 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5221395830093778268', time=2024-09-14T13:58:18.141676+0000, chain.objs.size()=1 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.w4bpArZ6L9COLBf5UcPzi5BS2BA28oO_0 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5247542322425792080', time=2024-09-14T13:58:18.711927+0000, chain.objs.size()=1 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.n0KqtPpy_kesd_LpO7dcaUKZfnLmRq4_0 2024-09-14T12:44:04.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18408193717545526461', time=2024-09-14T13:58:21.543623+0000, chain.objs.size()=1 2024-09-14T12:44:04.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.413+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3Y_IekVo0u3sz95k3yS_qJjdo8DoMq8_0 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17902165156888897846', time=2024-09-14T13:58:21.545330+0000, chain.objs.size()=1 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PM2Q10jmbr1iP2qzVXBh4v547kmDreE_0 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14885951487477753591', time=2024-09-14T13:58:22.586968+0000, chain.objs.size()=1 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lPbTKv6fH0QZoRPB7OMObgoyprWadYJ_0 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11717425072812987923', time=2024-09-14T13:58:22.803508+0000, chain.objs.size()=1 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WM_Y03CnvTMiiq3lNHSrHsc2C8wGsLj_0 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7965420708399437842', time=2024-09-14T13:58:22.945138+0000, chain.objs.size()=1 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PFrdapD7pKBjhRsaCfH7FBbMEPGy-Ag_0 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12214992125199200354', time=2024-09-14T13:58:23.098278+0000, chain.objs.size()=1 2024-09-14T12:44:04.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.zGVy7-pPjsg52gV90fdcsvib5nUtdlK_0 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10327354901502398327', time=2024-09-14T13:58:23.476410+0000, chain.objs.size()=1 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.A2MxcSI51nc0FS9jrHaUGiFHozZSwtQ_0 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16603958614609419713', time=2024-09-14T13:58:24.019401+0000, chain.objs.size()=1 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6tkNTEZdwUUyK6mopgmXqz4rwOfm5xs_0 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3865424710368209061', time=2024-09-14T13:58:25.390702+0000, chain.objs.size()=1 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kbUtFmRZ22q4rNIwMU_Svo8iBDO-K1s_0 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11314089204282440313', time=2024-09-14T13:58:25.392237+0000, chain.objs.size()=1 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lenDyIvlSwCR4mijzGu6bcYSYXZqBj3_0 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3786884818398468992', time=2024-09-14T13:58:26.484989+0000, chain.objs.size()=1 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.br1NkMj5LI8vtvC5t8Zls6p42AwXE1-_0 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8297938720777124676', time=2024-09-14T13:58:27.497842+0000, chain.objs.size()=1 2024-09-14T12:44:04.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.421+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YiMybLLC6-VA_6aNtKs8wXHD1UhzcFA_0 2024-09-14T12:44:04.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2975425132439587379', time=2024-09-14T13:58:29.351722+0000, chain.objs.size()=1 2024-09-14T12:44:04.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2BxLfZxvDWt0ByoqvG_3W7pPTD6H37N_0 2024-09-14T12:44:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17457046011996909718', time=2024-09-14T13:58:30.960745+0000, chain.objs.size()=1 2024-09-14T12:44:04.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jxVdeDzZgJVoPoAZI1Ks8u-6FrDosUr_0 2024-09-14T12:44:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17135263113864374582', time=2024-09-14T13:58:31.200993+0000, chain.objs.size()=1 2024-09-14T12:44:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nM5gCb7v7NHQZNahwACSm8A263AD77k_0 2024-09-14T12:44:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7417480203891710408', time=2024-09-14T13:58:31.253419+0000, chain.objs.size()=1 2024-09-14T12:44:04.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tM9rdDxk--dqZWEU7q4QunUaJuPXaQw_0 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8430237459745206475', time=2024-09-14T13:58:34.045911+0000, chain.objs.size()=1 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rs4BFrsewhuv3OIQDI_-A3ZT7C9VDKb_0 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13517001448396083453', time=2024-09-14T14:00:21.984510+0000, chain.objs.size()=1 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6T9eoz4nq3JIzbd6jRlXbnCrbyMH6vy_0 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3873471987276212463', time=2024-09-14T14:00:23.084224+0000, chain.objs.size()=1 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vOjmev7xzshAKRxz7vOe6pbEkuZZMiZ_0 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12464510028901027121', time=2024-09-14T14:00:23.643846+0000, chain.objs.size()=1 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WO3G1Jj7U-bSADPWuLiP-a11HvPcSJP_0 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13476120397105011337', time=2024-09-14T14:00:23.698595+0000, chain.objs.size()=1 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Db64st7u1k8Se4hs9r6lyGFcEpB5dIr_0 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6626894353334810490', time=2024-09-14T14:00:26.043672+0000, chain.objs.size()=1 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NEeJhkc8E7zk3rNbKFws0m-ZRXqcoev_0 2024-09-14T12:44:04.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.645626980084980032', time=2024-09-14T14:00:28.978222+0000, chain.objs.size()=1 2024-09-14T12:44:04.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.425+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CIwaOa_4bYe-6pDrp-OoWC4WYg3K_4y_0 2024-09-14T12:44:04.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.716708946581086625', time=2024-09-14T14:00:29.265807+0000, chain.objs.size()=1 2024-09-14T12:44:04.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._Sa-9Sa4xH_p81RwuN0IcAjnK9qfTQG_0 2024-09-14T12:44:04.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3893600133210829026', time=2024-09-14T14:00:29.800580+0000, chain.objs.size()=1 2024-09-14T12:44:04.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mk224fu0D-EpIQZSU91TQCSQyDLhtW5_0 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9047491504928385967', time=2024-09-14T14:00:30.004477+0000, chain.objs.size()=1 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.W9wvbDc-d6PZwrEzJ5NbiP8MWOCnIdP_0 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3885202175921335277', time=2024-09-14T14:00:30.507528+0000, chain.objs.size()=1 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5tlJr-AioA-EtswTzEC9rzEaIwt6gkL_0 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14601091479471109243', time=2024-09-14T14:00:31.476029+0000, chain.objs.size()=1 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.c-T26NhaoEGDbON6-L_azuh8TfyTgCA_0 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11295091266361300344', time=2024-09-14T14:00:32.819802+0000, chain.objs.size()=1 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YKhnCdG5VG2ZUBZgg1SrPzaoMF8ebSS_0 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16577819823214013553', time=2024-09-14T14:00:34.829341+0000, chain.objs.size()=1 2024-09-14T12:44:04.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.y5eBct_GWAyx40As1-0OKauNmQJ-HsQ_0 2024-09-14T12:44:04.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16811644334774455728', time=2024-09-14T14:00:37.443662+0000, chain.objs.size()=1 2024-09-14T12:44:04.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wFkQNwpnizg4JiDsx0jogjLkVkvndB9_0 2024-09-14T12:44:04.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8254199561132969994', time=2024-09-14T14:00:37.733528+0000, chain.objs.size()=1 2024-09-14T12:44:04.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6k9ssARBaBo21F4WAs_nrM0DpBU_XVh_0 2024-09-14T12:44:04.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.903427997047075014', time=2024-09-14T14:00:39.542805+0000, chain.objs.size()=1 2024-09-14T12:44:04.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.429+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JsEL5BduFxOZfOXswMjtv-Akmo2LU-W_0 2024-09-14T12:44:04.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.433+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16862381470392703993', time=2024-09-14T14:00:40.799317+0000, chain.objs.size()=1 2024-09-14T12:44:04.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.433+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.44JcJZz8qRnQcKTw_8MP8oaJ6WwOuEx_0 2024-09-14T12:44:04.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.433+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10130974643785341727', time=2024-09-14T14:00:41.662590+0000, chain.objs.size()=1 2024-09-14T12:44:04.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.433+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.In5UpFIHe8AM3GOjEMtYA4XsywN9rSU_0 2024-09-14T12:44:04.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.445+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45337 2024-09-14T12:44:04.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T12:44:04.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2041318401336685388', time=2024-09-14T14:00:41.919251+0000, chain.objs.size()=1 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gftakOLyEISGADIvMRKYqZ0I2Vb9mes_0 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6378701478887573283', time=2024-09-14T14:00:42.967633+0000, chain.objs.size()=1 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wScyWUHbefozw5x9RC3sM9veJhZbGTJ_0 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10918846951424687745', time=2024-09-14T14:00:43.331145+0000, chain.objs.size()=1 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.smRPQHHFImfN-V9f0SHrY4DlJaqffYx_0 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15608977124104170943', time=2024-09-14T14:00:44.550079+0000, chain.objs.size()=1 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._qamgWS3-EdZYXdxyBMIp4IBsJEnmGB_0 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16080246936069070321', time=2024-09-14T14:00:45.134542+0000, chain.objs.size()=1 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IopMVNx7I3K1GM6MfWm8xC0lJKxx8as_0 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14080798849287202347', time=2024-09-14T14:00:45.682368+0000, chain.objs.size()=1 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Dsl-LxLPIAtt66C95PmNUB4B3TZxfaw_0 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11564631525830411182', time=2024-09-14T14:00:46.980908+0000, chain.objs.size()=1 2024-09-14T12:44:04.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9SEKdEGSlm6Uj4cWKSwyv64BPubKha0_0 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5843311160302991695', time=2024-09-14T14:00:47.038174+0000, chain.objs.size()=1 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cs66FVLKpl-yNN5umFpirsR3-JpUJSk_0 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17223405655042813652', time=2024-09-14T14:00:48.567309+0000, chain.objs.size()=1 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ox5sBkZye41Qv2yIV_hS4rS0GN6PjuO_0 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3543581656452984489', time=2024-09-14T14:00:49.565042+0000, chain.objs.size()=1 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.aC6_Xs71sj1fSiUjmzEB_tX5CmVCQwe_0 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5479456299470602898', time=2024-09-14T14:02:32.681771+0000, chain.objs.size()=1 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.374__shadow_.QJA4gemH9eNvN8KyYTEpaSsdbt-0zYp_0 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1365319453340588523', time=2024-09-14T14:06:17.311211+0000, chain.objs.size()=1 2024-09-14T12:44:04.446 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.453+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.467__shadow_.s8tvZ9lnVqwK3bDiXpPUoSKDADVzRvD_0 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13249124440912924669', time=2024-09-14T14:06:46.765873+0000, chain.objs.size()=1 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.1VCN8RsTtiiLQ4umsh9JK7v5KHH3Kac_0 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5131812983983916245', time=2024-09-14T14:07:18.554189+0000, chain.objs.size()=1 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.496__shadow_.ULJhEFCegGiu2wTZ4-EVebURDHG6El0_0 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11869760527883899810', time=2024-09-14T14:16:32.693078+0000, chain.objs.size()=1 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.537__multipart_mymultipart.2~bbARRzuiRLHTBW3M61kqsRwpd9dtTpP.1 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18380025432994395462', time=2024-09-14T14:17:28.259524+0000, chain.objs.size()=2 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.552__shadow_.RV3o8kIw8sNC_eeIoUeMQRSlc1sr5wM_0 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.552__shadow_.RV3o8kIw8sNC_eeIoUeMQRSlc1sr5wM_1 2024-09-14T12:44:04.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13813125018969402345', time=2024-09-14T14:19:21.892302+0000, chain.objs.size()=1 2024-09-14T12:44:04.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:S22nQt3PsvC7qeLFAQ-VHhVZ-OB9UCK_.Qqdy-bQXQgUCExAwKlbnWLy639dhWft_0 2024-09-14T12:44:04.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5123022227386530654', time=2024-09-14T14:19:22.617474+0000, chain.objs.size()=1 2024-09-14T12:44:04.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:wc6WN9pFsnW0fnMxsYWebBr2S6F8SQU_.53UMHnde170m_2nBGZYdBlAQYIHB4xq_0 2024-09-14T12:44:04.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10466840637286963122', time=2024-09-14T14:20:35.377962+0000, chain.objs.size()=1 2024-09-14T12:44:04.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.457+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:yWY0adDR5-hi2lTild-FLcA6OBa4-MS_.ABmbXzcNinBpoaNE9-le-XZ5xjlRXkH_0 2024-09-14T12:44:04.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9484631229631701394', time=2024-09-14T14:30:11.678020+0000, chain.objs.size()=1 2024-09-14T12:44:04.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.635__shadow_.1jmWY9x_FQBpR8Sa_DPcSnpfRDxX10i_0 2024-09-14T12:44:04.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9348038737455113892', time=2024-09-14T14:39:32.476379+0000, chain.objs.size()=1 2024-09-14T12:44:04.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.765__shadow_.5gvAcScOL01eeC-a9BmWjgN5tIOKqsX_0 2024-09-14T12:44:04.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.461+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4290372443633937229', time=2024-09-14T14:39:50.404965+0000, chain.objs.size()=1 2024-09-14T12:44:04.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.461+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.768__shadow_.Rw761wl95FmC0bJgMmv7qU52kwgRA_m_0 2024-09-14T12:44:04.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.465+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17158858401428078576', time=2024-09-14T14:39:57.538142+0000, chain.objs.size()=1 2024-09-14T12:44:04.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.770__shadow_.jMP3YDU_4GZPEDrmHvL2jz3btyjRzy4_0 2024-09-14T12:44:04.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.465+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.469+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T12:44:04.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.469+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47102' 2024-09-14T12:44:04.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_59fLSUF-KTm_m8Yj16W7efbExO3HL9J', time=2024-09-14T13:44:06.859408+0000, chain.objs.size()=3 2024-09-14T12:44:04.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.8zQLxTBFyRoxZbmXM7zwVRw1GyVXXqx_0 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.8zQLxTBFyRoxZbmXM7zwVRw1GyVXXqx_1 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.8zQLxTBFyRoxZbmXM7zwVRw1GyVXXqx_2 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11277638729896235889', time=2024-09-14T13:49:59.322743+0000, chain.objs.size()=1 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.232__shadow_.CBPPeuHd9YtlwNbbIaUGmcCutylAHC7_0 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8130883921787863990', time=2024-09-14T13:50:16.860193+0000, chain.objs.size()=1 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.238__shadow_.PU4BZGa0VqwrvTlEwdL4i_jnpvN5nVk_0 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18229950475555453977', time=2024-09-14T13:50:20.977743+0000, chain.objs.size()=1 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.239__shadow_.-5h1GMTS06nEM8i8J_GUuZM2EZY0Vy3_0 2024-09-14T12:44:04.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9040979673664357971', time=2024-09-14T13:50:34.346966+0000, chain.objs.size()=1 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.244__shadow_.5cPD-1igKDb9lPtTM6WVd23gpMwimQe_0 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9903323395009992121', time=2024-09-14T13:50:40.879782+0000, chain.objs.size()=1 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.246__shadow_.l5c_QJ53nQ9ZNGebhVyu4lCsXI7LhRB_0 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5790270415981179053', time=2024-09-14T13:50:53.622672+0000, chain.objs.size()=1 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.251__shadow_.5CtHawJf1-jaVZ9uQbMDFotny5tiKWM_0 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11803788253098482588', time=2024-09-14T13:50:58.649651+0000, chain.objs.size()=1 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.253__shadow_.CW5h010QsSvYagJmuRqO_3CnqMHyXh8_0 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16949273455484779896', time=2024-09-14T13:53:06.272459+0000, chain.objs.size()=1 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.YbJVjqWLbpXT6J4DjCL8J8JR3mQcOcO_0 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5197068234138048591', time=2024-09-14T13:53:06.505642+0000, chain.objs.size()=1 2024-09-14T12:44:04.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.473+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PICCNmpxWiYXHQmRMzZkhfpuwBpn3Nm_0 2024-09-14T12:44:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2463340444410091886', time=2024-09-14T13:53:07.202753+0000, chain.objs.size()=1 2024-09-14T12:44:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dcA81uzl6no58jhZ-wjmdgrrLd9bFFb_0 2024-09-14T12:44:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18222540520946922809', time=2024-09-14T13:53:11.014228+0000, chain.objs.size()=1 2024-09-14T12:44:04.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BK_xT1ESnKa_Tv8toC9_yFg3TQ5BvHf_0 2024-09-14T12:44:04.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17676201467657110995', time=2024-09-14T13:53:11.888534+0000, chain.objs.size()=1 2024-09-14T12:44:04.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PicVZ01VA7W6fDv2T_rBnoGDNtfAN1k_0 2024-09-14T12:44:04.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5675520872473551239', time=2024-09-14T13:53:12.567456+0000, chain.objs.size()=1 2024-09-14T12:44:04.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3uvQOSr_T2unjewxEmEF7TwpVzgJV9c_0 2024-09-14T12:44:04.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16809891461152098625', time=2024-09-14T13:53:14.129520+0000, chain.objs.size()=1 2024-09-14T12:44:04.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.W5l7xfgxQXRsuR8c68tJNv6rLOIcv63_0 2024-09-14T12:44:04.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12176321796774599006', time=2024-09-14T13:53:15.013062+0000, chain.objs.size()=1 2024-09-14T12:44:04.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-ONGLhKeX5ukmm1egyGE8GYJlH0PNG6_0 2024-09-14T12:44:04.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11545878632743478490', time=2024-09-14T13:53:16.250603+0000, chain.objs.size()=1 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nA8LBqnsdfChQcadrV5sIlWOBgZPwme_0 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.653665969788752113', time=2024-09-14T13:53:16.252080+0000, chain.objs.size()=1 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.6BwtOW6MohXamCLT-CNwd5Gf9cVHmQy_0 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7891764228165121375', time=2024-09-14T13:53:16.601444+0000, chain.objs.size()=1 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JU_OF53wUlwftCa6CI7z4qKI832DtjS_0 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3287802231992464565', time=2024-09-14T13:53:19.580438+0000, chain.objs.size()=1 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CEFJEhgc18QTqsbYukMhFQWbQyYH4pL_0 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12441805165892702294', time=2024-09-14T13:53:19.811389+0000, chain.objs.size()=1 2024-09-14T12:44:04.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.477+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WnTaqAyEf_RbZQvNYxu6YAw3oCKjCa4_0 2024-09-14T12:44:04.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13389787853060995976', time=2024-09-14T13:53:20.440685+0000, chain.objs.size()=1 2024-09-14T12:44:04.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.SAgim-iDRhlpm-YU8AlgjnVd10MOgfh_0 2024-09-14T12:44:04.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13248589588745067783', time=2024-09-14T13:53:23.467086+0000, chain.objs.size()=1 2024-09-14T12:44:04.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Q395FppD8XBh26r29qVCU_B8YN5vral_0 2024-09-14T12:44:04.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3590929520956071556', time=2024-09-14T13:53:24.373283+0000, chain.objs.size()=1 2024-09-14T12:44:04.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EvAyfKQFxGRaftSkQ5zN02P6N2ygOLD_0 2024-09-14T12:44:04.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11592261030435356758', time=2024-09-14T13:53:25.716953+0000, chain.objs.size()=1 2024-09-14T12:44:04.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Ba-pfeg82loFp4BurbEQlaOxfUGCG_j_0 2024-09-14T12:44:04.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4141969850025386683', time=2024-09-14T13:53:26.864548+0000, chain.objs.size()=1 2024-09-14T12:44:04.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RnPV2-5oc5VqRWfVQrFIeiZwQFnscWz_0 2024-09-14T12:44:04.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11746387485851668310', time=2024-09-14T13:53:27.034111+0000, chain.objs.size()=1 2024-09-14T12:44:04.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.C9zjRN9MKnYb0C-lFObNc90O6x_ITgq_0 2024-09-14T12:44:04.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2599408830511089314', time=2024-09-14T13:53:27.241641+0000, chain.objs.size()=1 2024-09-14T12:44:04.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aA4cw_4D8JfKhxE0IoF7xNGIehzNVot_0 2024-09-14T12:44:04.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14883986395713113769', time=2024-09-14T13:53:27.243291+0000, chain.objs.size()=1 2024-09-14T12:44:04.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5OUyPco0uBbto47y7KkhE2bBiy2TcWy_0 2024-09-14T12:44:04.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1328276814294437549', time=2024-09-14T13:53:27.457777+0000, chain.objs.size()=1 2024-09-14T12:44:04.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.481+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.l1elkWse-dgWD49Q_IDLYQ6BEPuM46h_0 2024-09-14T12:44:04.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2125374146072791624', time=2024-09-14T13:53:27.830199+0000, chain.objs.size()=1 2024-09-14T12:44:04.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QUDD_lNWmBGB4nl_iuqxeXyNeOSmsyp_0 2024-09-14T12:44:04.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6730591882397921949', time=2024-09-14T13:53:29.980736+0000, chain.objs.size()=1 2024-09-14T12:44:04.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.24NFN6otyG5i-ToqRAvdvQno6L4VWqP_0 2024-09-14T12:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18238206927597598197', time=2024-09-14T13:53:30.553676+0000, chain.objs.size()=1 2024-09-14T12:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JQslYrhQ9wJYBT7f0wGVMXk4MhPqMGn_0 2024-09-14T12:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3604681196875247231', time=2024-09-14T13:53:31.370586+0000, chain.objs.size()=1 2024-09-14T12:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.j2lZbYkVvZW1I-15vGLZH7EaKoWWhTf_0 2024-09-14T12:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14095675050933639172', time=2024-09-14T13:53:31.840228+0000, chain.objs.size()=1 2024-09-14T12:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gZOrnjIAPP3LXwwOy3dhC4rQluEzutc_0 2024-09-14T12:44:04.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11283865003730010763', time=2024-09-14T13:53:32.689737+0000, chain.objs.size()=1 2024-09-14T12:44:04.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JH8j3jtVcPpXaM2Nf2hQdopFpY_hByV_0 2024-09-14T12:44:04.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18251096929697442663', time=2024-09-14T13:53:33.141481+0000, chain.objs.size()=1 2024-09-14T12:44:04.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.485+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-tbKQ2ckTnpbrbmoYWFp7YFETf_Y4ov_0 2024-09-14T12:44:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2954801723507964985', time=2024-09-14T13:53:56.717298+0000, chain.objs.size()=1 2024-09-14T12:44:04.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.272__shadow_.PkUsSoxPTyYLFomToAQYyNHpSfthXmq_0 2024-09-14T12:44:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18434427172908401314', time=2024-09-14T13:54:18.824027+0000, chain.objs.size()=1 2024-09-14T12:44:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.281__shadow_.lEfOXuQZBREMtyDf3Zed10oM8i-N6SE_0 2024-09-14T12:44:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7101295141502851973', time=2024-09-14T13:54:23.788806+0000, chain.objs.size()=1 2024-09-14T12:44:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.283__shadow_.3rlzL0OuxW-dISfJf5hvrw1lFAI7097_0 2024-09-14T12:44:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18191622920415691836', time=2024-09-14T13:54:23.790506+0000, chain.objs.size()=1 2024-09-14T12:44:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.283__shadow_.7NKcxxBjE3WmH7Jnh-ZXe90t1nFbrPo_0 2024-09-14T12:44:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16305077238986693332', time=2024-09-14T13:54:52.940739+0000, chain.objs.size()=1 2024-09-14T12:44:04.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.FIoWnevGoecdkekFQmv34zIRdtTLEQ0_0 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13922168125487961602', time=2024-09-14T13:54:58.759230+0000, chain.objs.size()=1 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.C9F0pCuUaDULw3eHRoEJb_vdwyERj1K_0 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3648888915348257883', time=2024-09-14T13:55:04.085578+0000, chain.objs.size()=1 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.489+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.296__shadow_.Y21djpZQ7vRP4ON3DYi0MGKhMfdAENP_0 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7878518649382736916', time=2024-09-14T13:55:26.994264+0000, chain.objs.size()=1 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.305__shadow_.bpffRdNIeFiUBUjL3vmR10LzcG5Lidm_0 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17632835670294248052', time=2024-09-14T13:56:11.981435+0000, chain.objs.size()=1 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.320__shadow:xF4i5GhKULP3caDpXbS8WF-qCAV7aWB_.zVHew5uhBrh1jrw0EQ7Zuu-8QCgwaVP_0 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1946986744524809703', time=2024-09-14T13:56:15.872110+0000, chain.objs.size()=1 2024-09-14T12:44:04.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.322__shadow_.QOKdhU_ZcJ78wyPAN6aUwOZKdDbE9bd_0 2024-09-14T12:44:04.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16734330268275878884', time=2024-09-14T13:58:05.931575+0000, chain.objs.size()=1 2024-09-14T12:44:04.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fMMekN3ejkDqV9QIx2C4h-5fVSH93Je_0 2024-09-14T12:44:04.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1423940499064879121', time=2024-09-14T13:58:06.480372+0000, chain.objs.size()=1 2024-09-14T12:44:04.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.493+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-vNpC4uOCCtLdqY3Z6vNkf1gOBOkOMB_0 2024-09-14T12:44:04.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2422246676756631955', time=2024-09-14T13:58:06.750443+0000, chain.objs.size()=1 2024-09-14T12:44:04.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nQD5ytnSGiwkkcv8nEAZRF32NcEqveZ_0 2024-09-14T12:44:04.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5897496898178916642', time=2024-09-14T13:58:06.751724+0000, chain.objs.size()=1 2024-09-14T12:44:04.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fDHKE1UB_tOw5d26NUb0k2DF0mboeEe_0 2024-09-14T12:44:04.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7919128237289028949', time=2024-09-14T13:58:06.895709+0000, chain.objs.size()=1 2024-09-14T12:44:04.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.B4qi_cB0mXWqxXnKKx8x8wt52GaoaFW_0 2024-09-14T12:44:04.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2478594258241216937', time=2024-09-14T13:58:07.683636+0000, chain.objs.size()=1 2024-09-14T12:44:04.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.LjORKauqAb5ZG3q0ZLut6WSjAedm6Dc_0 2024-09-14T12:44:04.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4336014881389692581', time=2024-09-14T13:58:08.059919+0000, chain.objs.size()=1 2024-09-14T12:44:04.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wySUzoWcrVOukKDKbnU7Xyk5hXtJl0O_0 2024-09-14T12:44:04.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3831675731422034013', time=2024-09-14T13:58:09.674150+0000, chain.objs.size()=1 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ceLyH6JsPKbnBKyLVoQgMyeDPP7cS-w_0 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11317120111259473524', time=2024-09-14T13:58:10.519774+0000, chain.objs.size()=1 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Xh65Bs3AswYvfGkiLG1tpjGb8_h212N_0 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11839863127507923247', time=2024-09-14T13:58:11.129178+0000, chain.objs.size()=1 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fRU8hfwqWYP9EgZa778-X9fuGxSo7dw_0 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14950565358704057986', time=2024-09-14T13:58:11.398144+0000, chain.objs.size()=1 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.NJhW9NPhebGVfmaRVGp-xMW_vlOO7-c_0 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9330116731621001395', time=2024-09-14T13:58:13.372756+0000, chain.objs.size()=1 2024-09-14T12:44:04.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JvjXhWNdJe8E9I7EUdSE__kAa9vcjQL_0 2024-09-14T12:44:04.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18426658648001698671', time=2024-09-14T13:58:13.523947+0000, chain.objs.size()=1 2024-09-14T12:44:04.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.u8keMEnLP7a22vnrgZJzM3TuVNNWZr__0 2024-09-14T12:44:04.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15984522273023265814', time=2024-09-14T13:58:14.339799+0000, chain.objs.size()=1 2024-09-14T12:44:04.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.497+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0w2k7KLkGn9eCc8MoREObas06emqEzy_0 2024-09-14T12:44:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.501+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13755607968868059023', time=2024-09-14T13:58:14.445278+0000, chain.objs.size()=1 2024-09-14T12:44:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.501+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BiBmNyhjCO0kL4YnhFu6grO2aVu6NgA_0 2024-09-14T12:44:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.501+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15894266335846386389', time=2024-09-14T13:58:15.613719+0000, chain.objs.size()=1 2024-09-14T12:44:04.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.501+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.zBEt0OTiK8CtqShDiMqBX0-r-HwCl3N_0 2024-09-14T12:44:04.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4317208000141354663', time=2024-09-14T13:58:16.368027+0000, chain.objs.size()=1 2024-09-14T12:44:04.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gzuo8iK1nQTyu6ol42pEwBlGFGLyNfr_0 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1261985824671772885', time=2024-09-14T13:58:18.240294+0000, chain.objs.size()=1 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.i9_FHSIurH725qXUiBtp-rXQ_4T36aG_0 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14146596220898224984', time=2024-09-14T13:58:19.009232+0000, chain.objs.size()=1 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.vogOQnNxb7KRoSViLnRqNcYnAlL2JmS_0 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5390946093329573898', time=2024-09-14T13:58:19.334194+0000, chain.objs.size()=1 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YWzVFZUcnp7uB9DOs1857FiZ8x7oIvs_0 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15221658379113313575', time=2024-09-14T13:58:19.574259+0000, chain.objs.size()=1 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.3kH7P1bb7n0Kv9pKU0uszt4APxI9NSC_0 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11306213147585554601', time=2024-09-14T13:58:19.677598+0000, chain.objs.size()=1 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QjVV3IT2RA0QDv1sZSb9Sn5jb-qXHHR_0 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2251658925986918459', time=2024-09-14T13:58:21.176233+0000, chain.objs.size()=1 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-Pn7DEuTp4XAhA6UGBH9Sa1ZeYBh0C7_0 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2829821659641659589', time=2024-09-14T13:58:22.867531+0000, chain.objs.size()=1 2024-09-14T12:44:04.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.j-ywEFs-MaEeIhzzD7QOpatEZdVPgqc_0 2024-09-14T12:44:04.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2617044407029764771', time=2024-09-14T13:58:23.976516+0000, chain.objs.size()=1 2024-09-14T12:44:04.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.505+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nFuOcbEHtR4BawHbdz5zWzxjeR9qnFh_0 2024-09-14T12:44:04.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1533614955684150818', time=2024-09-14T13:58:25.211880+0000, chain.objs.size()=1 2024-09-14T12:44:04.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0yPfc4AaQv0yc4i9ysWQrVDDnEZmylp_0 2024-09-14T12:44:04.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8907622120335359563', time=2024-09-14T13:58:25.709723+0000, chain.objs.size()=1 2024-09-14T12:44:04.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2nmQT1LTlHNmgXweGHqwhXnLrjgMYn4_0 2024-09-14T12:44:04.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10619639308205620721', time=2024-09-14T13:58:25.714389+0000, chain.objs.size()=1 2024-09-14T12:44:04.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.TkMDMwT_4uVJZmqrxcUm7Uybe_xxnqm_0 2024-09-14T12:44:04.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7670885708336334282', time=2024-09-14T13:58:26.483731+0000, chain.objs.size()=1 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.AtiRA2jm9Rm9wuxE2VVjlqAXifBgW5w_0 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5514458656318753161', time=2024-09-14T13:58:26.647114+0000, chain.objs.size()=1 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BPOqdskqGIpBYQ6ykLRzspPrHd-tFXt_0 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17937434789495928036', time=2024-09-14T13:58:27.172807+0000, chain.objs.size()=1 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.AqgDwdU28jImi6ZW4BDDvG5puPA5reO_0 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8710441059699328845', time=2024-09-14T13:58:27.676562+0000, chain.objs.size()=1 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7B-6bvU3qRzxgLbmO2G53j1mfvT4Bqc_0 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16383760341319159418', time=2024-09-14T13:58:28.410196+0000, chain.objs.size()=1 2024-09-14T12:44:04.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.509+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KAaKPOgdBN83s5F6-KlLU707rqDEfCm_0 2024-09-14T12:44:04.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6198318370808493572', time=2024-09-14T13:58:29.281435+0000, chain.objs.size()=1 2024-09-14T12:44:04.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-cl2iLmGEkpssUPfVWaL8mi69ORQLtK_0 2024-09-14T12:44:04.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8143612635866169085', time=2024-09-14T13:58:29.604862+0000, chain.objs.size()=1 2024-09-14T12:44:04.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jerlK78Xq1TDkhHoUGqYDep9vjc9BsU_0 2024-09-14T12:44:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2013378368166219206', time=2024-09-14T13:58:29.945496+0000, chain.objs.size()=1 2024-09-14T12:44:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PEzshHpljlWo13_2_9gVC9hrXkQ5QYK_0 2024-09-14T12:44:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8451421714190168867', time=2024-09-14T13:58:30.036425+0000, chain.objs.size()=1 2024-09-14T12:44:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ah49mSTiKmLe-_3qQJSPZo9OYxGDL-l_0 2024-09-14T12:44:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5639896691836698043', time=2024-09-14T13:58:30.709553+0000, chain.objs.size()=1 2024-09-14T12:44:04.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JWZQbwDhFr3bAXuBkUC3zBOnXKACvBP_0 2024-09-14T12:44:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14642798605466486381', time=2024-09-14T13:58:31.312603+0000, chain.objs.size()=1 2024-09-14T12:44:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7vG2VokkILaHYkV5Gbz1umw91wpybK6_0 2024-09-14T12:44:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3794537874353280666', time=2024-09-14T13:58:31.386035+0000, chain.objs.size()=1 2024-09-14T12:44:04.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.513+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8pigfpf-bowKX-dVwsRG5ucgviLP3xc_0 2024-09-14T12:44:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14505432068226585947', time=2024-09-14T14:00:21.284340+0000, chain.objs.size()=1 2024-09-14T12:44:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.YnheKvRpgiLHBgf-oUK-ckZvn0HWDab_0 2024-09-14T12:44:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15881548412957857619', time=2024-09-14T14:00:22.188536+0000, chain.objs.size()=1 2024-09-14T12:44:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2YNJIM7bW4WRlsGKakzMFTowrPznEWc_0 2024-09-14T12:44:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4220961511665457974', time=2024-09-14T14:00:22.291612+0000, chain.objs.size()=1 2024-09-14T12:44:04.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.eywsYZ1oKFX-epyN9qs9a94I16H1pMx_0 2024-09-14T12:44:04.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17584437744642090804', time=2024-09-14T14:00:23.310747+0000, chain.objs.size()=1 2024-09-14T12:44:04.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.y7pDWNGHVLEbYjYQwon3RHxJPbOc1Bq_0 2024-09-14T12:44:04.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6673587872302334392', time=2024-09-14T14:00:23.413087+0000, chain.objs.size()=1 2024-09-14T12:44:04.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fO1ui_IXSyZ5mStKX--iHz64rLGuv3a_0 2024-09-14T12:44:04.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4887993371801956613', time=2024-09-14T14:00:25.458073+0000, chain.objs.size()=1 2024-09-14T12:44:04.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ayNVIGs0IMdUlXxLAGAnDCa5rkv_4-W_0 2024-09-14T12:44:04.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7208538823031717639', time=2024-09-14T14:00:26.386504+0000, chain.objs.size()=1 2024-09-14T12:44:04.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.M22si9ULCWHteUgDMiM4QHoRJe-IYi8_0 2024-09-14T12:44:04.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11585826210685073795', time=2024-09-14T14:00:31.114265+0000, chain.objs.size()=1 2024-09-14T12:44:04.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.f0uTEbGn-n6TiaQ1GyXCRbTIVfInehC_0 2024-09-14T12:44:04.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17111113068951114845', time=2024-09-14T14:00:31.307585+0000, chain.objs.size()=1 2024-09-14T12:44:04.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.517+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4TySYVaG8tPZrCuGEiHK4WO_8kZQUwL_0 2024-09-14T12:44:04.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.521+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17700247384568405668', time=2024-09-14T14:00:33.094986+0000, chain.objs.size()=1 2024-09-14T12:44:04.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.521+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uOK9TuSb7CXn9_OleqnQ05JtlZl55lk_0 2024-09-14T12:44:04.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.521+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1108007057156615049', time=2024-09-14T14:00:33.099813+0000, chain.objs.size()=1 2024-09-14T12:44:04.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.521+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FJK3LiiSuax-ZxHdwk0DVCmbPytZ66K_0 2024-09-14T12:44:04.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.521+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14352767278928669727', time=2024-09-14T14:00:34.342782+0000, chain.objs.size()=1 2024-09-14T12:44:04.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.521+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jJTeT_1qX-Hs9LV16QSPUG6HiP1KnjX_0 2024-09-14T12:44:04.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.525+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2670378051085896148', time=2024-09-14T14:00:34.928873+0000, chain.objs.size()=1 2024-09-14T12:44:04.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-lpVG2dnNbmdcxY92-WSFkdaO80VOsw_0 2024-09-14T12:44:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.525+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47102 2024-09-14T12:44:04.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-14T12:44:04.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9402748944334188664', time=2024-09-14T14:00:36.696643+0000, chain.objs.size()=1 2024-09-14T12:44:04.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1ULeFDbwSyOfR_5tnzFjtoHdmHDD3pt_0 2024-09-14T12:44:04.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16911759137291597937', time=2024-09-14T14:00:36.828929+0000, chain.objs.size()=1 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.RJkYc1ppg5dzmU51IZDOs1sQs7oo5vz_0 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18089603637186695277', time=2024-09-14T14:00:38.472891+0000, chain.objs.size()=1 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ceq7OoK0fjn2-9wCf1YSyY1DyNe4-Zp_0 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15058854976033623620', time=2024-09-14T14:00:39.432717+0000, chain.objs.size()=1 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.JKlKRKrIzx4VjQkSCC0WeYUUMB2QLzr_0 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10990087205884167256', time=2024-09-14T14:00:40.887508+0000, chain.objs.size()=1 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kegMutm5pGtu9II4rBmLPQwQrfqiPp6_0 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11760700138281711616', time=2024-09-14T14:00:42.240152+0000, chain.objs.size()=1 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.RIEKuUVheFZhoM7xPCfR6Clc-qLr7Yi_0 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14485798437958800765', time=2024-09-14T14:00:43.002690+0000, chain.objs.size()=1 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pvWrH2LgVyTftrb3s4lRdtASaMDVVAY_0 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8110442419029613414', time=2024-09-14T14:00:43.237825+0000, chain.objs.size()=1 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-Sqi2ufbYwFJOzm7ZuGba1QzpuwSF1A_0 2024-09-14T12:44:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.323520528796693651', time=2024-09-14T14:00:44.219300+0000, chain.objs.size()=1 2024-09-14T12:44:04.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Cnd4o7jP1iH5J48HtHiCbsHX6KWXtsp_0 2024-09-14T12:44:04.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12499126430525229253', time=2024-09-14T14:00:44.222307+0000, chain.objs.size()=1 2024-09-14T12:44:04.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hmtazHvy6rsHv0wQXT4SzpDvv69f8-K_0 2024-09-14T12:44:04.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4115071114054641989', time=2024-09-14T14:00:45.559649+0000, chain.objs.size()=1 2024-09-14T12:44:04.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kHAZcn9ptshSeyIo4kJjMg0OnbTe_Be_0 2024-09-14T12:44:04.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6978089265200899705', time=2024-09-14T14:00:46.406902+0000, chain.objs.size()=1 2024-09-14T12:44:04.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.529+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mshGYchhNq53foHZuB30-9AJV8HM_5Y_0 2024-09-14T12:44:04.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4535141268196193709', time=2024-09-14T14:00:46.932873+0000, chain.objs.size()=1 2024-09-14T12:44:04.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hCIkcl_zNO8czcpnb1hhOlDPu1yIsty_0 2024-09-14T12:44:04.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11849008165845058866', time=2024-09-14T14:00:48.034736+0000, chain.objs.size()=1 2024-09-14T12:44:04.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.GcjgXs3VMdQhSWHJ5o0AlbcIcqYQZry_0 2024-09-14T12:44:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9661858102607310814', time=2024-09-14T14:00:49.065508+0000, chain.objs.size()=1 2024-09-14T12:44:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ha3JqCUBlGUy_EM52vee9rUiAQBkmcn_0 2024-09-14T12:44:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15054359065722457503', time=2024-09-14T14:00:49.378506+0000, chain.objs.size()=1 2024-09-14T12:44:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LgTGTWromsduaYgsxKL5h40kNspqOou_0 2024-09-14T12:44:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13695154538317138997', time=2024-09-14T14:02:28.255910+0000, chain.objs.size()=1 2024-09-14T12:44:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.372__shadow_.X78Sr432Uj-UK5zS9ReOJo2wGjzfWxC_0 2024-09-14T12:44:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12552484437973983109', time=2024-09-14T14:05:55.941520+0000, chain.objs.size()=1 2024-09-14T12:44:04.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.460__shadow_.z8DDJU3Jz_h3krHdVpIWiRprJLAhl02_0 2024-09-14T12:44:04.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7137014797862345096', time=2024-09-14T14:06:46.790454+0000, chain.objs.size()=1 2024-09-14T12:44:04.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.quHWbaxUAN7tTUfb1vK00Z3FcAO1Xk__0 2024-09-14T12:44:04.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.465187925324098765', time=2024-09-14T14:07:05.235610+0000, chain.objs.size()=1 2024-09-14T12:44:04.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.489__shadow_.eUxavrlBS9OCl9WVfQx3cSoLkCANOE8_0 2024-09-14T12:44:04.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2333118286840167857', time=2024-09-14T14:08:36.647352+0000, chain.objs.size()=1 2024-09-14T12:44:04.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.514__multipart_mymultipart.2~VOW8Iws1De4PVsdv56EzruK3p4eJ7mC.1 2024-09-14T12:44:04.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16772016431602810356', time=2024-09-14T14:09:05.604840+0000, chain.objs.size()=2 2024-09-14T12:44:04.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.518__shadow_.yJS8ovrZM9yfa1-GFVhgrN-JDpJIlNc_0 2024-09-14T12:44:04.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.533+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.518__shadow_.yJS8ovrZM9yfa1-GFVhgrN-JDpJIlNc_1 2024-09-14T12:44:04.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.537+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9361792790657274232', time=2024-09-14T14:10:24.869420+0000, chain.objs.size()=3 2024-09-14T12:44:04.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~m30ZawclRo-Yl3X2e8hONdxy4w9De27.1 2024-09-14T12:44:04.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~m30ZawclRo-Yl3X2e8hONdxy4w9De27.2 2024-09-14T12:44:04.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.537+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~m30ZawclRo-Yl3X2e8hONdxy4w9De27.3 2024-09-14T12:44:04.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11322583120482192720', time=2024-09-14T14:13:58.418523+0000, chain.objs.size()=6 2024-09-14T12:44:04.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.t8F6TlBtOJTFiNEPWnjjWnKxoDHWV0gB.1 2024-09-14T12:44:04.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.wC4woUWWU5lZyMP8MZ1cWweQ37ukJ0KL.2 2024-09-14T12:44:04.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.SlW0Ze36tggVG1N7AaH6ApxxpG6e8JLB.3 2024-09-14T12:44:04.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.yhBec5DmLRhcjzCF8xyyeUYu3lWaXDuy.4 2024-09-14T12:44:04.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.OMnp7r8SRnZ5CGVXsxgYo8AccuO3EdSE.5 2024-09-14T12:44:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.OFvIlsXrZEcL-k8GifaFxCwuz3s6EBA8.6 2024-09-14T12:44:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~afmHb2-rAQ-mc4-WTmnzsAbJladDh2S', time=2024-09-14T14:15:48.690790+0000, chain.objs.size()=1 2024-09-14T12:44:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.532__multipart_mymultipart.2~afmHb2-rAQ-mc4-WTmnzsAbJladDh2S.1 2024-09-14T12:44:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15172317945577273745', time=2024-09-14T14:19:46.373078+0000, chain.objs.size()=1 2024-09-14T12:44:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.571__shadow:sSmL96BKEiblmLWtabLluXiuOPWE.OX_.BIIYyELs2-WfTTNsMI0ju76UedSglvw_0 2024-09-14T12:44:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6153931424095159187', time=2024-09-14T14:20:02.474078+0000, chain.objs.size()=1 2024-09-14T12:44:04.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.541+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow:E-BfwkRVix39dDmbIrG8UshnXaM3Dg1_.GpAoHBSFxQCFZ4wG4ktaCDFVDOb6uOj_0 2024-09-14T12:44:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14899434130982661979', time=2024-09-14T14:20:06.408866+0000, chain.objs.size()=1 2024-09-14T12:44:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow:4gghCbrTvu5TeYVDUOTZOMPi8.0-Fsu_.dC99HpQeDXEC-RUNqDEDmwY8LoXk1gQ_0 2024-09-14T12:44:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2705942284247587043', time=2024-09-14T14:20:45.897074+0000, chain.objs.size()=1 2024-09-14T12:44:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:mjspwde188b2.FJ6n5v1jh96pLgtzP4_.H7M8KQaMXwT9rFxj1uW2Wn0sNR_FQw3_0 2024-09-14T12:44:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1504407856443821999', time=2024-09-14T14:20:56.387276+0000, chain.objs.size()=1 2024-09-14T12:44:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:ZEu8rTxanGUTKX8JZKIbK-uoVmp-9wL_.G6MOXBenVVwi_qOBvEF0_6QdtP3DG19_0 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2337172898693211580', time=2024-09-14T14:22:16.618096+0000, chain.objs.size()=1 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:XuCf79op1d7ztspnFm-wKHQcryzZh-N_.53Om-h89BFBLC9ZUzdyGNRZ5snHKOsE_0 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10417317975452483524', time=2024-09-14T14:23:10.236725+0000, chain.objs.size()=1 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.604__shadow_.co19mb3Td_Fa0A79LqfOuc4ZiV_3sE-_0 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16658103174164141579', time=2024-09-14T14:23:19.952551+0000, chain.objs.size()=1 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.608__shadow_.bTU5v1WoUkOUuFDJLL5F0SaMtdtJ53w_0 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15570064834656029632', time=2024-09-14T14:31:04.768607+0000, chain.objs.size()=1 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.649__shadow_.loBVy5hOfzVmf2c5zLLrpI-SmLbgHEP_0 2024-09-14T12:44:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1526454508415768261', time=2024-09-14T14:34:54.637070+0000, chain.objs.size()=1 2024-09-14T12:44:04.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.719__shadow_.vKy0VTYinIVBIRVnIrYT-PZIQKovZ1v_0 2024-09-14T12:44:04.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11729126126319464886', time=2024-09-14T14:40:31.270750+0000, chain.objs.size()=1 2024-09-14T12:44:04.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.545+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.773__shadow_.RDqMcrYOUXkOdn2DkpaX5uABHvwqWGn_0 2024-09-14T12:44:04.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.549+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T12:44:04.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.553+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53870' 2024-09-14T12:44:04.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_QE6dCwkLIgb9CahRsakgmwaQUHLvOiZ', time=2024-09-14T13:43:12.022744+0000, chain.objs.size()=1 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.161__shadow_.VrEOGJiErbX-4Gf_Vofyur_Q6ry_ek2_0 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16339932182813731057', time=2024-09-14T13:49:59.341827+0000, chain.objs.size()=1 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.232__shadow_.eIsz0mqmUOVEKufPV4Eee7sqoiJm1Ed_0 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6033449297780430734', time=2024-09-14T13:50:27.849472+0000, chain.objs.size()=1 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.242__shadow_.hzdP5nXKAlAhWzvVJzB9jBitID-Iga__0 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9695062142576001235', time=2024-09-14T13:50:34.361576+0000, chain.objs.size()=1 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.244__shadow_.9jE7indD0Hns9mmDr5vPgJVuNyCSlBV_0 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12337862089480277556', time=2024-09-14T13:50:43.464061+0000, chain.objs.size()=1 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.247__shadow_.wErBr9MZeaM1Y9CB7N2pj-Ii7RKj4QJ_0 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8960011830567307566', time=2024-09-14T13:50:56.149560+0000, chain.objs.size()=1 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.252__shadow_.vn7xPoxZdjKLRxrM-M-vhFB5Rn7NzEl_0 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14381716306597043371', time=2024-09-14T13:50:58.629223+0000, chain.objs.size()=1 2024-09-14T12:44:04.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.253__shadow_.9fVQFqJau25eZnUB_zpLLjgceihFk7N_0 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1807776004763270176', time=2024-09-14T13:53:06.276826+0000, chain.objs.size()=1 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.U9394TdipIYTQMYsaII8Qm4vc9T2Q4e_0 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11276606583195944634', time=2024-09-14T13:53:06.278554+0000, chain.objs.size()=1 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.iocLQnNvR8llsMsYOoJVfCpQP8Vo02i_0 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9915527210585039985', time=2024-09-14T13:53:06.635098+0000, chain.objs.size()=1 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UoAQLQmXiZ-qAoc1dCsbCFijTbLuFzl_0 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5425412107644552893', time=2024-09-14T13:53:07.043738+0000, chain.objs.size()=1 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8KlBp1YBsY1SUm3aensYJrTOaK7z5X__0 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6981256989431793546', time=2024-09-14T13:53:08.350452+0000, chain.objs.size()=1 2024-09-14T12:44:04.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.c-tj701m8QWliWDYZRlBuh-oN7PNbCM_0 2024-09-14T12:44:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1467786191911506227', time=2024-09-14T13:53:09.538817+0000, chain.objs.size()=1 2024-09-14T12:44:04.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.557+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wBiNz16ed7I4hnUD56ugWmk21R4Xr4i_0 2024-09-14T12:44:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9164022335636864527', time=2024-09-14T13:53:11.614289+0000, chain.objs.size()=1 2024-09-14T12:44:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bB8pIK8fDkoMfcUrAZWgRmb_HpHGr3L_0 2024-09-14T12:44:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10542155760971276311', time=2024-09-14T13:53:11.691773+0000, chain.objs.size()=1 2024-09-14T12:44:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.tVqwAO_40kk4XV1lDwXo9mJ44uw2nXc_0 2024-09-14T12:44:04.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17454149540695734760', time=2024-09-14T13:53:13.602018+0000, chain.objs.size()=1 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.E6eg0fVy706h_rVpEQLpp5UoaL9Ij3D_0 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1916165498043903934', time=2024-09-14T13:53:15.544022+0000, chain.objs.size()=1 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Mp6MCXx2HdrR3ZBWZm98KHTU9By1xV3_0 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11766044130881808293', time=2024-09-14T13:53:16.072436+0000, chain.objs.size()=1 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.YcQ-30eSXHhRpwPUtrZV1GYLAroKuyr_0 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11193499984267621203', time=2024-09-14T13:53:18.804883+0000, chain.objs.size()=1 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Pi9M8lygthNalhpkU_BWVe8XmddBE3k_0 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2433136640816964930', time=2024-09-14T13:53:20.023378+0000, chain.objs.size()=1 2024-09-14T12:44:04.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wO7UM0hzcv908CJ9nnfBQ7nM8HoDewg_0 2024-09-14T12:44:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8178272391229533187', time=2024-09-14T13:53:20.571746+0000, chain.objs.size()=1 2024-09-14T12:44:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.SM2Hy-eolSyBC_lO7ITiSKWIjb6OoBy_0 2024-09-14T12:44:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3006975844021919059', time=2024-09-14T13:53:20.675458+0000, chain.objs.size()=1 2024-09-14T12:44:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.W3eFuzPw4X-4SQZLdKHdTvlVhsoo-62_0 2024-09-14T12:44:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1743167850183171667', time=2024-09-14T13:53:22.400949+0000, chain.objs.size()=1 2024-09-14T12:44:04.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.561+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ZT39fJnwrv6SafFq4nO0zMFiJ1RMAVe_0 2024-09-14T12:44:04.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6460860306408437441', time=2024-09-14T13:53:23.787475+0000, chain.objs.size()=1 2024-09-14T12:44:04.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.RI6MIsofk2kmMolDsLTuDz1qVQ7vWd-_0 2024-09-14T12:44:04.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6689820780982542980', time=2024-09-14T13:53:23.789595+0000, chain.objs.size()=1 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9HCBKLT9u5o0gTTC1tQcL-QilySMNb2_0 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1595431241562639546', time=2024-09-14T13:53:26.012004+0000, chain.objs.size()=1 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.z3pJRdGjrnb5GP-tWDzPGXGJkgNaaLH_0 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9969317151242440702', time=2024-09-14T13:53:26.592155+0000, chain.objs.size()=1 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._HKZKvJfRit8vKgjfsazXHuVddqFppk_0 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13880606174818208170', time=2024-09-14T13:53:27.045874+0000, chain.objs.size()=1 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EWzJGUtzYDIclWLZm-RSb9A_GWsSmWS_0 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2866827771852588680', time=2024-09-14T13:53:27.264435+0000, chain.objs.size()=1 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GZM4zNd-BZvv7JSpvEKdIvZaqK42psI_0 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13096761519311218912', time=2024-09-14T13:53:27.465301+0000, chain.objs.size()=1 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HIUO6WKisfguoCKEfwvGz9vUnVv43iv_0 2024-09-14T12:44:04.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7435953649187178763', time=2024-09-14T13:53:27.681761+0000, chain.objs.size()=1 2024-09-14T12:44:04.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.565+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qACTskz2N_btPvOKe_kqGP_feIINTXN_0 2024-09-14T12:44:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17290105251724204691', time=2024-09-14T13:53:28.870747+0000, chain.objs.size()=1 2024-09-14T12:44:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.DtZA2nwKSdTGDbLZS6OG_EIRNW4oo2c_0 2024-09-14T12:44:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9556962358486360351', time=2024-09-14T13:53:29.122379+0000, chain.objs.size()=1 2024-09-14T12:44:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.jr3RVR2BV-OIXnSOEiqjVqi80szFCwN_0 2024-09-14T12:44:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.974643419958833292', time=2024-09-14T13:53:29.298240+0000, chain.objs.size()=1 2024-09-14T12:44:04.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hIPmVtpzw1036muSfLso2YJAueL6lJG_0 2024-09-14T12:44:04.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15129994038124257318', time=2024-09-14T13:53:31.025135+0000, chain.objs.size()=1 2024-09-14T12:44:04.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.U4ZoWBdc7Enf-M1mm9044wzMoQcnk2-_0 2024-09-14T12:44:04.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11617740577846649654', time=2024-09-14T13:53:33.080023+0000, chain.objs.size()=1 2024-09-14T12:44:04.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.aUbLPDpgKRY9a93ysN5lsiC3Rwr4CIC_0 2024-09-14T12:44:04.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16530352854040785394', time=2024-09-14T13:53:33.570945+0000, chain.objs.size()=1 2024-09-14T12:44:04.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9M4Vxc31QI0RlNfD24Orm6hjZePObma_0 2024-09-14T12:44:04.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7687937716639376548', time=2024-09-14T13:53:34.519447+0000, chain.objs.size()=1 2024-09-14T12:44:04.561 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UQWUk9BvheJ-G2dIr5Z3g5UKUUXzp_h_0 2024-09-14T12:44:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12073858751904477268', time=2024-09-14T13:53:34.749087+0000, chain.objs.size()=1 2024-09-14T12:44:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.M3iE2hFGkzIdylHNjbcUCynG3kfw0KE_0 2024-09-14T12:44:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17470247670100012615', time=2024-09-14T13:53:34.871300+0000, chain.objs.size()=1 2024-09-14T12:44:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dUpwt-RZhC17zPR1CNeoC1WWe80Cogb_0 2024-09-14T12:44:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2434995255214144106', time=2024-09-14T13:54:41.664416+0000, chain.objs.size()=1 2024-09-14T12:44:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.290__shadow_.pqjnRnhS6sukfXB2HVFlDQtMjw1H2XJ_0 2024-09-14T12:44:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2473751732766918002', time=2024-09-14T13:54:47.475839+0000, chain.objs.size()=1 2024-09-14T12:44:04.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.569+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.292__shadow_.gP7134SKMd5eEh6O6AoEfWuuTSqQDJ2_0 2024-09-14T12:44:04.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10045377109688905117', time=2024-09-14T13:54:53.223352+0000, chain.objs.size()=1 2024-09-14T12:44:04.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.nB-aHd6jVkhmokBwR8DAQdPtrNYoO95_0 2024-09-14T12:44:04.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16524201568775345633', time=2024-09-14T13:55:01.584632+0000, chain.objs.size()=1 2024-09-14T12:44:04.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.295__shadow_.m_TGG89M1KvUU2d-izlladmoFFJbZbU_0 2024-09-14T12:44:04.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17409221432458212575', time=2024-09-14T13:55:14.300404+0000, chain.objs.size()=1 2024-09-14T12:44:04.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.300__shadow_.OLCEfOGqHq6gsuSOmBPg-ZjVidSePQ4_0 2024-09-14T12:44:04.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.573+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4234436845078807544', time=2024-09-14T13:58:06.935457+0000, chain.objs.size()=1 2024-09-14T12:44:04.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.573+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Xmr_7BUpsGhmN7TFZM9xtq0zgiWPzVM_0 2024-09-14T12:44:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6686896551090512544', time=2024-09-14T13:58:08.388542+0000, chain.objs.size()=1 2024-09-14T12:44:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.bvTMuPmoxQu-rUBn7KNca5KzgtLS5Fb_0 2024-09-14T12:44:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16478753967293206418', time=2024-09-14T13:58:09.451117+0000, chain.objs.size()=1 2024-09-14T12:44:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fAGGnl2_NVKhaF_12SpqLOcwvTixeig_0 2024-09-14T12:44:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7913129534078275291', time=2024-09-14T13:58:10.534486+0000, chain.objs.size()=1 2024-09-14T12:44:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9LSrHynxZQURlkW1MeShNI_ZZZunv5r_0 2024-09-14T12:44:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10621030811189232443', time=2024-09-14T13:58:10.536699+0000, chain.objs.size()=1 2024-09-14T12:44:04.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.9bGyGe-I79UeMWLn7RkwACOwnEyOKh3_0 2024-09-14T12:44:04.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12567931350750857820', time=2024-09-14T13:58:10.888491+0000, chain.objs.size()=1 2024-09-14T12:44:04.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.q5IXSbKchPKO2UtTCfRPGjYw7SEiKBE_0 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15321854473112603646', time=2024-09-14T13:58:10.890746+0000, chain.objs.size()=1 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wRlpbhGeVHYyAxfCKHFfSFy3cCE99A-_0 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16049993417840456415', time=2024-09-14T13:58:11.379722+0000, chain.objs.size()=1 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.N7QhqIy_HFT6BYuGVF5tCU0SPtiquXu_0 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12408908774691425006', time=2024-09-14T13:58:11.623142+0000, chain.objs.size()=1 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YIux0fz2-5qeFmuxfoO24rJq97xsGFP_0 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4922724153595303237', time=2024-09-14T13:58:11.706068+0000, chain.objs.size()=1 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.spllDaOyQd8W9svxq5s4QyLYS_5Y2nL_0 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1826265066682032747', time=2024-09-14T13:58:11.990002+0000, chain.objs.size()=1 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DOkw0Mjf_m0f63NGgjSFvsk2bacq2r5_0 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10037730425367920688', time=2024-09-14T13:58:12.408708+0000, chain.objs.size()=1 2024-09-14T12:44:04.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.577+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.cMejelzwu6EzOmeb1iQ0zLWjwRzQfmI_0 2024-09-14T12:44:04.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17063411223358324364', time=2024-09-14T13:58:15.124966+0000, chain.objs.size()=1 2024-09-14T12:44:04.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gb4R-3-DbFp1GzyX3W2pltEihKWlGZV_0 2024-09-14T12:44:04.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18428940412330671938', time=2024-09-14T13:58:15.393970+0000, chain.objs.size()=1 2024-09-14T12:44:04.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.I4nPz3RUHIn1L662dwVG3ahZj_9BJQY_0 2024-09-14T12:44:04.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14124189282775262106', time=2024-09-14T13:58:16.306008+0000, chain.objs.size()=1 2024-09-14T12:44:04.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.f9NrjOSX6ryoKzrE98OAUqNjeCsTCMm_0 2024-09-14T12:44:04.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7624487217276044426', time=2024-09-14T13:58:17.819538+0000, chain.objs.size()=1 2024-09-14T12:44:04.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GVrjDcDZq8QkF9Q5ChxubZAWWNkEXad_0 2024-09-14T12:44:04.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2826180332103312069', time=2024-09-14T13:58:17.822741+0000, chain.objs.size()=1 2024-09-14T12:44:04.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.581+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FuZXJst-vKi3-A37qLhA9tI9xr8DNRR_0 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2336226881793605602', time=2024-09-14T13:58:19.168309+0000, chain.objs.size()=1 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.M7-b8iydelezL0eOQx8RETz1wQN6DVc_0 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11118131810879617555', time=2024-09-14T13:58:19.832472+0000, chain.objs.size()=1 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.5SdKQbbY9SyfvOSSnrw5FS0WLSWYVWq_0 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5167209450115217874', time=2024-09-14T13:58:19.924278+0000, chain.objs.size()=1 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pWOqZwgIk7__4OoAmZLAd1C-9XOyLsA_0 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3977732144278039910', time=2024-09-14T13:58:21.624824+0000, chain.objs.size()=1 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.uj5j8MFJb3i1JY5x9M6e1FBsEguoHN3_0 2024-09-14T12:44:04.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13747362993068335635', time=2024-09-14T13:58:22.567692+0000, chain.objs.size()=1 2024-09-14T12:44:04.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KCWOf4uvyBc3gxRNlw1wi6vIdtNQn9t_0 2024-09-14T12:44:04.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.843532102711296913', time=2024-09-14T13:58:23.103307+0000, chain.objs.size()=1 2024-09-14T12:44:04.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VzzEDmkYEBul2FYA3mTX0dh01TZ1K0M_0 2024-09-14T12:44:04.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16952050828558315121', time=2024-09-14T13:58:23.774407+0000, chain.objs.size()=1 2024-09-14T12:44:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IVJMtwhyQ94GjmJLq9ztSpD5EP1ayDf_0 2024-09-14T12:44:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9290007674530309596', time=2024-09-14T13:58:28.886684+0000, chain.objs.size()=1 2024-09-14T12:44:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.X6hyKzloXqHqNfvchAV5BlCCAx8uYEx_0 2024-09-14T12:44:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.716692516055103916', time=2024-09-14T13:58:29.628753+0000, chain.objs.size()=1 2024-09-14T12:44:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.P5gKR05f9Go_f52G18mh_T8y218S-GW_0 2024-09-14T12:44:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16191701172343874758', time=2024-09-14T13:58:29.949771+0000, chain.objs.size()=1 2024-09-14T12:44:04.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.585+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.H1zOHL8L-HTXA1cHdK5vj5uwjRhrFD__0 2024-09-14T12:44:04.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11706176886349573665', time=2024-09-14T13:58:30.848573+0000, chain.objs.size()=1 2024-09-14T12:44:04.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VJMJbgD10JNMoTVyvGgLQ0PmVPPtcbo_0 2024-09-14T12:44:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7719203905886673452', time=2024-09-14T13:58:30.972475+0000, chain.objs.size()=1 2024-09-14T12:44:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Iy7CLnTRNY15Yj0eC9CIW228QTeCYZW_0 2024-09-14T12:44:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4698441158348164512', time=2024-09-14T13:58:31.051386+0000, chain.objs.size()=1 2024-09-14T12:44:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.JqvJhZTH4pkE8Unp-sgKTVPfh2qWRwO_0 2024-09-14T12:44:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7781587595744885640', time=2024-09-14T13:58:31.331906+0000, chain.objs.size()=1 2024-09-14T12:44:04.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.4SmRVpoZomEHxVw1HiER8XQqawuL7YR_0 2024-09-14T12:44:04.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11655923518158406322', time=2024-09-14T13:58:31.338912+0000, chain.objs.size()=1 2024-09-14T12:44:04.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.UT0U5kJE8J6Qfy0Z-lDmr6LFVFlfU0G_0 2024-09-14T12:44:04.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17448529055264797074', time=2024-09-14T13:58:32.508016+0000, chain.objs.size()=1 2024-09-14T12:44:04.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.175lnlf4n6R_w-dVp5CQO7Hv7YWWPUi_0 2024-09-14T12:44:04.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3558162744292152342', time=2024-09-14T13:58:33.465480+0000, chain.objs.size()=1 2024-09-14T12:44:04.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.589+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.x0Kn34VPg2QJcEBg3XsevtS1yupCFla_0 2024-09-14T12:44:04.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10600751418945194737', time=2024-09-14T14:00:21.097547+0000, chain.objs.size()=1 2024-09-14T12:44:04.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.lilVMm93IKhYaJpmTTINctqTwYNDU4__0 2024-09-14T12:44:04.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.593+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10307867361395446635', time=2024-09-14T14:00:22.573155+0000, chain.objs.size()=1 2024-09-14T12:44:04.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.593+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.DvTaDu559tG8QkmOifDZFABL-HZNTMT_0 2024-09-14T12:44:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10512694971059916437', time=2024-09-14T14:00:24.947521+0000, chain.objs.size()=1 2024-09-14T12:44:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zde9wooIvKLL46GIRQqj-ifP1FOH-Cs_0 2024-09-14T12:44:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16447312531271442449', time=2024-09-14T14:00:27.626249+0000, chain.objs.size()=1 2024-09-14T12:44:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ieO_6jx0UQ8QGx0cJjrF3sAgr2GCApl_0 2024-09-14T12:44:04.586 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13684203402706402317', time=2024-09-14T14:00:27.965083+0000, chain.objs.size()=1 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.STNe0rALn_Ha8XbxcXw6nYa9Vzex8YT_0 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12224179108515200775', time=2024-09-14T14:00:29.333960+0000, chain.objs.size()=1 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ktgzR6HiJnOmXFsp8o2Kc_cEeedJfVG_0 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4649936188388410220', time=2024-09-14T14:00:29.549873+0000, chain.objs.size()=1 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.g_d55DeOPGIhotumHISPfwMDNCDSK5C_0 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8051874663529080817', time=2024-09-14T14:00:30.310597+0000, chain.objs.size()=1 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.d6wbKYWVy1OLWbHMLei35krAxvWgU6K_0 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3829459916831989182', time=2024-09-14T14:00:30.942188+0000, chain.objs.size()=1 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zYSRGiO1YdEu8ZS8lKWF_3mkSXcavfL_0 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14632235289110091036', time=2024-09-14T14:00:31.878510+0000, chain.objs.size()=1 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ZhXjIFCKYMKInesQBbDGj4xyYJjd5Qq_0 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7428379367843984035', time=2024-09-14T14:00:33.578850+0000, chain.objs.size()=1 2024-09-14T12:44:04.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.vj-J7T-ytn9o_GKyCNmX8udtmIThJ04_0 2024-09-14T12:44:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8639319918499975432', time=2024-09-14T14:00:33.939451+0000, chain.objs.size()=1 2024-09-14T12:44:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fAmKV1J3SuIjvugE958iVnRoNsG6_wn_0 2024-09-14T12:44:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10017981085628227413', time=2024-09-14T14:00:34.247455+0000, chain.objs.size()=1 2024-09-14T12:44:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.eYqzSPOGpC93ViBrMQ-FNgceCRS-gbb_0 2024-09-14T12:44:04.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1165116777962001531', time=2024-09-14T14:00:35.147138+0000, chain.objs.size()=1 2024-09-14T12:44:04.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.597+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ZYcG0-LfYETomlMiwepjGyqlLISX4KD_0 2024-09-14T12:44:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6196446940128610892', time=2024-09-14T14:00:35.373218+0000, chain.objs.size()=1 2024-09-14T12:44:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hMwcQ3XxIL37nE-rdBGdYQ5oxifIq-__0 2024-09-14T12:44:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12314032135952055634', time=2024-09-14T14:00:38.900358+0000, chain.objs.size()=1 2024-09-14T12:44:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WC1SLZBdR48IMvnrwfE_8Mu9nH0o9rv_0 2024-09-14T12:44:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7251861416980450322', time=2024-09-14T14:00:40.641299+0000, chain.objs.size()=1 2024-09-14T12:44:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BlqykA2NrKMnlJNvAIheYjoAnpxGv8f_0 2024-09-14T12:44:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7266613119435624925', time=2024-09-14T14:00:41.140831+0000, chain.objs.size()=1 2024-09-14T12:44:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jc10FrDkVjNe8i258NBANDU6C4SOaHj_0 2024-09-14T12:44:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17982367897114504805', time=2024-09-14T14:00:42.050572+0000, chain.objs.size()=1 2024-09-14T12:44:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.EAHePu8kPR_LPjRadYYh-fVI20WZUz1_0 2024-09-14T12:44:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15037304501893876167', time=2024-09-14T14:00:45.228820+0000, chain.objs.size()=1 2024-09-14T12:44:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iKvsvVI6YAtolhQLUl_RZ8-J00BHcN7_0 2024-09-14T12:44:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8287366810123899619', time=2024-09-14T14:00:46.492105+0000, chain.objs.size()=1 2024-09-14T12:44:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.601+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.tRe5tLK5qDrFhu-Ix5Ovp08A7pF5zHk_0 2024-09-14T12:44:04.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.605+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53870 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12130735372273176059', time=2024-09-14T14:00:46.641987+0000, chain.objs.size()=1 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IzcOQGcDmQMpWtLnfPnqWiViWddxoWa_0 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10156027609559133444', time=2024-09-14T14:00:48.876985+0000, chain.objs.size()=1 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9CiurdhQXsDs6xU83RMsDV3IAxo0rbn_0 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12522495120283617240', time=2024-09-14T14:00:48.878352+0000, chain.objs.size()=1 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.FCvic12e9UsgA17DRQeBiYacaNUikyC_0 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16874835733913115688', time=2024-09-14T14:00:49.188757+0000, chain.objs.size()=1 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jAv6q-Y3PIBHf4V1aadtCFw6FAvA0tC_0 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1511361271783532638', time=2024-09-14T14:00:49.672333+0000, chain.objs.size()=1 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.XtXzil54yVQqVXObujcawo8KU9PAkfJ_0 2024-09-14T12:44:04.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16222115254886375374', time=2024-09-14T14:01:16.774920+0000, chain.objs.size()=1 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.337__shadow_.5tyQsmiL8lGn-uwXmncCirI45Hu8KdK_0 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16835929317878696526', time=2024-09-14T14:04:48.645290+0000, chain.objs.size()=1 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.434__shadow_.mHjiJ7vqqPSR534HlS81CSO-TD1NIG7_0 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2258916126740710478', time=2024-09-14T14:06:02.386585+0000, chain.objs.size()=1 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.462__shadow_.SQ7LyJCDhr-nvtEKTS939C32VTj8ShM_0 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14580326429999608781', time=2024-09-14T14:07:20.657771+0000, chain.objs.size()=1 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.497__shadow_.xtHgjA3oW0ZY3YdAHlz5OldOR66Z0CW_0 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14965207330328568842', time=2024-09-14T14:07:29.331216+0000, chain.objs.size()=1 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.500__shadow_.oRN4K4q0_s58TAceyF7A89ddE_x3dKu_0 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10534819139208214187', time=2024-09-14T14:08:43.210711+0000, chain.objs.size()=1 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.517__multipart_mymultipartcopy.2~7t5l7Yx8_HwWU7RHcziwzX6jAr0zk1e.1 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12052984377479898676', time=2024-09-14T14:10:29.970050+0000, chain.objs.size()=4 2024-09-14T12:44:04.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.609+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.521__shadow:v0o6j.Vh9gwKIJXUcMVawUf2n.Ff07e_.ywGRlZ88ygWxE_35igbmq3HLyUJMRYR_0 2024-09-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.521__shadow:v0o6j.Vh9gwKIJXUcMVawUf2n.Ff07e_.ywGRlZ88ygWxE_35igbmq3HLyUJMRYR_1 2024-09-14T12:44:04.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.613+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.521__shadow:v0o6j.Vh9gwKIJXUcMVawUf2n.Ff07e_.ywGRlZ88ygWxE_35igbmq3HLyUJMRYR_2 2024-09-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.521__shadow:v0o6j.Vh9gwKIJXUcMVawUf2n.Ff07e_.ywGRlZ88ygWxE_35igbmq3HLyUJMRYR_3 2024-09-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf', time=2024-09-14T14:15:05.625583+0000, chain.objs.size()=10 2024-09-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.1 2024-09-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.2 2024-09-14T12:44:04.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.3 2024-09-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.4 2024-09-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.5 2024-09-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.6 2024-09-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.7 2024-09-14T12:44:04.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.8 2024-09-14T12:44:04.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.617+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.9 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.527__multipart_mymultipart.2~aj-nJuNRQ3gA9jW4IaCOCRT0gKVWkOf.10 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3250109089289044037', time=2024-09-14T14:19:26.990169+0000, chain.objs.size()=1 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:ACWYBywcUmf81K6l2B8vBmG3b6jVMYj_.yt93VSC7YcpAZaAg62e8Ab9YMD5EWfK_0 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16771885779822750289', time=2024-09-14T14:19:28.598378+0000, chain.objs.size()=1 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:CwIn52bON3y90XksDP4BcFjNtLiH1uy_.Bg_IIb4oiltFD21Kk4tnREjN74bsN0K_0 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6724951345755237796', time=2024-09-14T14:19:59.808450+0000, chain.objs.size()=1 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow_.eC769UspBpiPdjF8TmH9fpnY3o55sp1_0 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10457772378533523612', time=2024-09-14T14:20:04.669021+0000, chain.objs.size()=1 2024-09-14T12:44:04.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.621+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow:AeacsqnfEjMR72DmtcydklYfNGh-wDr_.kUltb1k-rTki7irAGm4UfUFio2-Whjk_0 2024-09-14T12:44:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.625+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5305341302829106601', time=2024-09-14T14:20:54.593572+0000, chain.objs.size()=1 2024-09-14T12:44:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.625+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:IKzH7rl8fuj8z9HiQjvD3K2Kqu8ZGEU_.nS6gMw9ceLsYCZKMo2zlSqPMs9E8DCe_0 2024-09-14T12:44:04.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.625+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16076727150613878048', time=2024-09-14T14:21:03.944676+0000, chain.objs.size()=1 2024-09-14T12:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.625+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:lmuR2lOZfgeFRqclAL7hSQk0oQ76pkB_.aW59Y5eHh0Wtv6xqaYaUKcXzeHv-SLj_0 2024-09-14T12:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.625+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2974368094061545401', time=2024-09-14T14:21:08.230285+0000, chain.objs.size()=1 2024-09-14T12:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.625+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:RPKJDmOYfyHIPseO284H4wOepQiLrno_.hxS3qFcHy3LoCn-zNQlqnK2O3Wrdu4j_0 2024-09-14T12:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.625+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7139529540220463427', time=2024-09-14T14:21:08.719245+0000, chain.objs.size()=1 2024-09-14T12:44:04.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.625+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:qTNpySWZZ.q36GrdQDmnu6.2IAFl7ET_.klB-siuw22TUTQNP8mjTXycpPjTk_9E_0 2024-09-14T12:44:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1613608557283124660', time=2024-09-14T14:31:21.090806+0000, chain.objs.size()=1 2024-09-14T12:44:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.653__shadow_.gryeNPWcjlT9UGdCyjPgRKl0Ly545Ck_0 2024-09-14T12:44:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5047763005286526314', time=2024-09-14T14:32:32.979315+0000, chain.objs.size()=6 2024-09-14T12:44:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.663__multipart_foo.2~sd7Gui6LAnfNB-Vl0SCxMBv-DKViX33.1 2024-09-14T12:44:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.663__multipart_foo.2~sd7Gui6LAnfNB-Vl0SCxMBv-DKViX33.2 2024-09-14T12:44:04.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.663__multipart_foo.2~sd7Gui6LAnfNB-Vl0SCxMBv-DKViX33.3 2024-09-14T12:44:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.663__multipart_foo.2~sd7Gui6LAnfNB-Vl0SCxMBv-DKViX33.4 2024-09-14T12:44:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.663__multipart_foo.2~sd7Gui6LAnfNB-Vl0SCxMBv-DKViX33.5 2024-09-14T12:44:04.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.629+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.663__multipart_foo.2~sd7Gui6LAnfNB-Vl0SCxMBv-DKViX33.6 2024-09-14T12:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1333041417714799379', time=2024-09-14T14:32:39.527997+0000, chain.objs.size()=1 2024-09-14T12:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.665__shadow_.7Crc36vsG6_T4Epfm8wqD-aKhTjhtfx_0 2024-09-14T12:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.633+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6580902955345427644', time=2024-09-14T14:38:45.794186+0000, chain.objs.size()=1 2024-09-14T12:44:04.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.633+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.760__shadow_.4liLTCfgErKxEYcwp8GYj_dcF23NUeh_0 2024-09-14T12:44:04.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.637+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.637+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T12:44:04.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43884' 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9621220837715163711', time=2024-09-14T13:49:53.848857+0000, chain.objs.size()=1 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.229__shadow_.iQM_0woZK12noqR8h4noNi4RZiL4zja_0 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3775810283116685220', time=2024-09-14T13:49:56.792827+0000, chain.objs.size()=1 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.231__shadow_.Qbc3swDWUrHbczzrHQ5bv-TdGlldjO7_0 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6280464416406644668', time=2024-09-14T13:50:38.435684+0000, chain.objs.size()=1 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.245__shadow_.UaaPQVLrO8VqBSWbPTkK2Zz71BAABkb_0 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14806280876389429114', time=2024-09-14T13:50:38.437602+0000, chain.objs.size()=1 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.245__shadow_.qqzb5t9DZl4Cj1Pk4ruIGlYW8LpZGrM_0 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15981718071226571260', time=2024-09-14T13:50:48.512316+0000, chain.objs.size()=1 2024-09-14T12:44:04.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.249__shadow_.WRKQ0TRV2Wpd4DEWis_fVK6LEFug5Gu_0 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6661076079392287280', time=2024-09-14T13:50:50.994827+0000, chain.objs.size()=1 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.250__shadow_.dEs4KL0MWdyV9Q0kzGJY2G8GdWkpf43_0 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17813154284639723267', time=2024-09-14T13:53:05.372765+0000, chain.objs.size()=1 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.98tjs_JLdx-biUJAbRADZLb4Fegh2CE_0 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5625797689931739607', time=2024-09-14T13:53:05.832082+0000, chain.objs.size()=1 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.MoSiWpokQfxiQs1LVYCzf0ePMmcpOl2_0 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1386937855067164819', time=2024-09-14T13:53:06.621780+0000, chain.objs.size()=1 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.q4pWgGiLDDX-jq1pfQnmf_YHn9OzqmI_0 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.791807110442100065', time=2024-09-14T13:53:07.381415+0000, chain.objs.size()=1 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.tWBeHVHzO-5lcr3tFypi-PGgSFNzf0O_0 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3250462640878656851', time=2024-09-14T13:53:07.486372+0000, chain.objs.size()=1 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8KY75hDISnKfhtbC_Ew9BlERZSZKm75_0 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6823757083536158047', time=2024-09-14T13:53:10.481871+0000, chain.objs.size()=1 2024-09-14T12:44:04.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.641+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fVWvVSUzEVKtiFSpZQ_LioX3TGYX5RK_0 2024-09-14T12:44:04.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4688119446530233932', time=2024-09-14T13:53:15.324202+0000, chain.objs.size()=1 2024-09-14T12:44:04.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.DI6rgWjuacmVIXFKGxjdPdhasr0bUS4_0 2024-09-14T12:44:04.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11484648852861242657', time=2024-09-14T13:53:15.851438+0000, chain.objs.size()=1 2024-09-14T12:44:04.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Y1dHjToM8bjYNCAjBuO61o0CK8j6tbj_0 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11599610288091084334', time=2024-09-14T13:53:15.893217+0000, chain.objs.size()=1 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hBphb-0lEhWFvznoxj6kdoZ0C39b76h_0 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17533621035542057077', time=2024-09-14T13:53:16.146536+0000, chain.objs.size()=1 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.JFUZAgaWRNhteYvd4iqe5p2mxVgzNdB_0 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13524218639068952435', time=2024-09-14T13:53:16.455632+0000, chain.objs.size()=1 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._ya0sVmhemhPQqaeWiTpwySNVComNBU_0 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14231444640264090733', time=2024-09-14T13:53:17.712521+0000, chain.objs.size()=1 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9VVU3AKIWcL_AcGGp7gCbaEroqCHTZs_0 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7641983820450404441', time=2024-09-14T13:53:18.399523+0000, chain.objs.size()=1 2024-09-14T12:44:04.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.645+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lZHGEnzrykQ4s9D8Tb4qrPPWotq1vuc_0 2024-09-14T12:44:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7247198201351492334', time=2024-09-14T13:53:22.552884+0000, chain.objs.size()=1 2024-09-14T12:44:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GX8H0IQxvNsOZ4PrvSCdwRNDWWZXcz-_0 2024-09-14T12:44:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2511919762983029491', time=2024-09-14T13:53:22.770151+0000, chain.objs.size()=1 2024-09-14T12:44:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Qul7NTX3UPkeiWRBvhL32yJ0gA5cEzZ_0 2024-09-14T12:44:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16578497698912057045', time=2024-09-14T13:53:23.498717+0000, chain.objs.size()=1 2024-09-14T12:44:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.N6Wva47MWYGP8OoIzveg15bIN-dJMGj_0 2024-09-14T12:44:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.649+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11222649979323387493', time=2024-09-14T13:53:23.737670+0000, chain.objs.size()=1 2024-09-14T12:44:04.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.649+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.h4N0fwI9cofyQRKu7910zZTn2g9X0lc_0 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16848503759819459007', time=2024-09-14T13:53:24.350426+0000, chain.objs.size()=1 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bgkvHHboAg8l31HacDBI3B-st7ozDdw_0 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8098232294098234636', time=2024-09-14T13:53:25.138027+0000, chain.objs.size()=1 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TPUowKPiMw7HI825I1VB79baS7K_UjP_0 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2696407188960638063', time=2024-09-14T13:53:27.044929+0000, chain.objs.size()=1 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.1SHR62zLq6lh4e8lx7S5V7yKKBmD1Ra_0 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18069067605753504547', time=2024-09-14T13:53:27.233542+0000, chain.objs.size()=1 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lgmZYlsoObUHEQsUy-23Bdigo4RbELL_0 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8824954833427205889', time=2024-09-14T13:53:28.967051+0000, chain.objs.size()=1 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FmeqocFYf67sE81Kj_bdpA6sKYinCXM_0 2024-09-14T12:44:04.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11538191641986491704', time=2024-09-14T13:53:28.980800+0000, chain.objs.size()=1 2024-09-14T12:44:04.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.653+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wttiOA9qNdM8o2NXCdKZRBieG-3CNR8_0 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1330355893235638964', time=2024-09-14T13:53:29.642080+0000, chain.objs.size()=1 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Cu_3msBMlzE8-D07wYF66_iAyyup5Tu_0 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12141283744173935783', time=2024-09-14T13:53:29.779493+0000, chain.objs.size()=1 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dhyBU4bnkvC2R-ET-uNWbSZZ63rUAuj_0 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7915841545828023008', time=2024-09-14T13:53:29.780934+0000, chain.objs.size()=1 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.o6SXo1JsnPr3u1oqLn7rpjR4DHjpFgO_0 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17718525778840229392', time=2024-09-14T13:53:30.568328+0000, chain.objs.size()=1 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.m5NzlHP1V66Z9L4wC0MNwR1vu1Ywb4V_0 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5759088387276635219', time=2024-09-14T13:53:30.811788+0000, chain.objs.size()=1 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GM_lLAq33LBHZiUIcCqN3CJ15EFkm2Q_0 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16064926607706414501', time=2024-09-14T13:53:31.332365+0000, chain.objs.size()=1 2024-09-14T12:44:04.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uQ-ZYy-H27liJ7UaydB_F3p9O3sHcC6_0 2024-09-14T12:44:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4754266512820038989', time=2024-09-14T13:53:32.803756+0000, chain.objs.size()=1 2024-09-14T12:44:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.0Wfg00bCKeKWWd0qMr-E8MBZpX4NbC-_0 2024-09-14T12:44:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14948788909821711043', time=2024-09-14T13:53:32.841760+0000, chain.objs.size()=1 2024-09-14T12:44:04.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.X0-XL49mT_wpcKrJ2QTKmujceI4usWk_0 2024-09-14T12:44:04.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17337580430791664669', time=2024-09-14T13:53:33.632155+0000, chain.objs.size()=1 2024-09-14T12:44:04.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lLwa3KAmnoEJIXRpIZpAMRqIQ6I0WY-_0 2024-09-14T12:44:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5302975736589972721', time=2024-09-14T13:53:34.870483+0000, chain.objs.size()=1 2024-09-14T12:44:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.PSQgNjpd3QRJHhC3OQhPPUMox7JoDX7_0 2024-09-14T12:44:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2241689539535825224', time=2024-09-14T13:53:56.720848+0000, chain.objs.size()=1 2024-09-14T12:44:04.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.657+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.272__shadow_.sJ12h4nO7cPQQnAlAlCfQIqxkl_Vgvw_0 2024-09-14T12:44:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10523731405388663083', time=2024-09-14T13:53:59.058383+0000, chain.objs.size()=1 2024-09-14T12:44:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.273__shadow_.RsleSv8QjFnrTcI1c-ZXdRi2RXII3Cr_0 2024-09-14T12:44:04.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7746688024710934122', time=2024-09-14T13:54:11.318405+0000, chain.objs.size()=1 2024-09-14T12:44:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.278__shadow_.5ng411qCpVtUwZR6uavk0Rqpd1KmY3P_0 2024-09-14T12:44:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2940209021986347308', time=2024-09-14T13:54:31.450667+0000, chain.objs.size()=1 2024-09-14T12:44:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.286__shadow_.Bano2ylhl_eoMdlZCQgw2XVyEl7pNAv_0 2024-09-14T12:44:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14233187547336845463', time=2024-09-14T13:54:52.841229+0000, chain.objs.size()=1 2024-09-14T12:44:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.Plr630E2FgLJa_xjaZ0zM0a3cGEqVCH_0 2024-09-14T12:44:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5176273151872696118', time=2024-09-14T13:54:58.995100+0000, chain.objs.size()=1 2024-09-14T12:44:04.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.661+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.LzvIRoR9L8n5pqnyvVC9gAXwKVGONZS_0 2024-09-14T12:44:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18192890643620676285', time=2024-09-14T13:55:19.356253+0000, chain.objs.size()=1 2024-09-14T12:44:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.302__shadow_.QJkhM5mZ8CinA6hKXCzgtLQVXCDJBb2_0 2024-09-14T12:44:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15515159789355838270', time=2024-09-14T13:55:19.382045+0000, chain.objs.size()=1 2024-09-14T12:44:04.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.302__shadow_.LDd5y6E3kCRwhAlZp-b93W7CNJIXdD9_0 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1081238799018393729', time=2024-09-14T13:55:29.466558+0000, chain.objs.size()=1 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.306__shadow_.tDGQzUQ8Q1fuPV26s_p-ORq-0yWP5g2_0 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7942170988018645602', time=2024-09-14T13:55:32.424451+0000, chain.objs.size()=1 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.307__shadow_.21lBSll9ihsYYdJ9SrtwEUkoN0044rY_0 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16451822711723101945', time=2024-09-14T13:58:05.477982+0000, chain.objs.size()=1 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.V0bxHsAUoxDwIAXDVafrX6WDu2U6pbh_0 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13408113380672762144', time=2024-09-14T13:58:06.442260+0000, chain.objs.size()=1 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.VBO15A-TBE_9BELCTs2dgRpJXQ9Gls5_0 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12005668680386080290', time=2024-09-14T13:58:08.107485+0000, chain.objs.size()=1 2024-09-14T12:44:04.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.31SUUJ3Wp_HJR5FjYn9IYj5XFEt-rtx_0 2024-09-14T12:44:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7354883473398542002', time=2024-09-14T13:58:09.501579+0000, chain.objs.size()=1 2024-09-14T12:44:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.665+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PK60DFO1ApyYV88s0ZGi47iT_hJ-b7f_0 2024-09-14T12:44:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15128932019692664833', time=2024-09-14T13:58:10.366478+0000, chain.objs.size()=1 2024-09-14T12:44:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ISSPZtAaRxHG6_psadPZNN61L5rR4Wq_0 2024-09-14T12:44:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15090096219915641670', time=2024-09-14T13:58:13.876666+0000, chain.objs.size()=1 2024-09-14T12:44:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nwTOymdT3In2Y27vCtIcxPL11RDl4VH_0 2024-09-14T12:44:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9314851851720042035', time=2024-09-14T13:58:14.221773+0000, chain.objs.size()=1 2024-09-14T12:44:04.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.iyewXE7AvVb0vg4f5AJVvAEDbCQC3_C_0 2024-09-14T12:44:04.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8853183346776041726', time=2024-09-14T13:58:17.455478+0000, chain.objs.size()=1 2024-09-14T12:44:04.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.UKMFGYcTBfbjh1Co5FACwJYEyvtjXWm_0 2024-09-14T12:44:04.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16467791918085167592', time=2024-09-14T13:58:18.344635+0000, chain.objs.size()=1 2024-09-14T12:44:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FrV_iZbsqjd0oj8L3f-Wvl7GrM2qq8a_0 2024-09-14T12:44:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4230290852786487765', time=2024-09-14T13:58:22.064554+0000, chain.objs.size()=1 2024-09-14T12:44:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.iARGu981W3YCI71u-mVnWS82eV4a_D3_0 2024-09-14T12:44:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17364049587214275796', time=2024-09-14T13:58:22.771306+0000, chain.objs.size()=1 2024-09-14T12:44:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.669+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.l91OlhhHMQOkCFU8qmQp6sf5YSzod6W_0 2024-09-14T12:44:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5078080991478739280', time=2024-09-14T13:58:28.545412+0000, chain.objs.size()=1 2024-09-14T12:44:04.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.EMK6iLnihAd3YOA2syC2xXJ54a4TRNR_0 2024-09-14T12:44:04.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4596663662195171222', time=2024-09-14T13:58:28.601748+0000, chain.objs.size()=1 2024-09-14T12:44:04.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7-6HClTr7IuYToKqJmyFy9Vu7YiX-of_0 2024-09-14T12:44:04.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16765213987692462876', time=2024-09-14T13:58:28.872728+0000, chain.objs.size()=1 2024-09-14T12:44:04.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HF7kO8YhnzUtAXQ-hmz6TmM8YqjIdmO_0 2024-09-14T12:44:04.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8281133402293636685', time=2024-09-14T13:58:29.233056+0000, chain.objs.size()=1 2024-09-14T12:44:04.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0biQqbAZQ5QloC_eued0DbEldnQTxYl_0 2024-09-14T12:44:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4831820727851807076', time=2024-09-14T13:58:32.034971+0000, chain.objs.size()=1 2024-09-14T12:44:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ahLm02DK9F3x8XCkQsHUo6gnwY3wcnS_0 2024-09-14T12:44:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14127766193890004632', time=2024-09-14T13:58:32.444998+0000, chain.objs.size()=1 2024-09-14T12:44:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.c7RANTciR6ZACS2g5tne39YLlngz5zK_0 2024-09-14T12:44:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13866076188899836711', time=2024-09-14T13:58:32.583939+0000, chain.objs.size()=1 2024-09-14T12:44:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ylr_Qb_AEEMF86FJbB0gbU3BJ3hBS-A_0 2024-09-14T12:44:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3412167739211599980', time=2024-09-14T14:00:21.526059+0000, chain.objs.size()=1 2024-09-14T12:44:04.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.673+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.3S3ABHGP5l3SHU1RQlwzgUwkNoGrzx1_0 2024-09-14T12:44:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7953867471644158581', time=2024-09-14T14:00:22.080413+0000, chain.objs.size()=1 2024-09-14T12:44:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5smb3UpDWbqL-jeM5zr3eY-8pg6kpDq_0 2024-09-14T12:44:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10689746620883563775', time=2024-09-14T14:00:23.044473+0000, chain.objs.size()=1 2024-09-14T12:44:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.K1Y0TA_Xu64Lu9qIpJ_F2wApTvUNx5U_0 2024-09-14T12:44:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14006215922324891285', time=2024-09-14T14:00:23.192273+0000, chain.objs.size()=1 2024-09-14T12:44:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Csqv6a_JUDciqohdnXOQqcn02F3N-P3_0 2024-09-14T12:44:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.677+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3100347924616328524', time=2024-09-14T14:00:25.155284+0000, chain.objs.size()=1 2024-09-14T12:44:04.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.677+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dy4JswMOuuk55hG9HgkWKYvkxcl6s7o_0 2024-09-14T12:44:04.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2190325917905390563', time=2024-09-14T14:00:25.517400+0000, chain.objs.size()=1 2024-09-14T12:44:04.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.M0FQDwc8RZMyYs-0Ygw59odqlRMqy07_0 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14232396328712409890', time=2024-09-14T14:00:25.950903+0000, chain.objs.size()=1 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.oYFOphDXUV6rcCyRCpDc20R52Oqf8xV_0 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1568492484773452744', time=2024-09-14T14:00:26.164721+0000, chain.objs.size()=1 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.GudQCBUQEod3UT8khYKfnUVVAQseY2M_0 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13446731217743774007', time=2024-09-14T14:00:30.503460+0000, chain.objs.size()=1 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9iCNMKbELgsLETyC6ehMCU2B7P6bdrW_0 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.822591946052825219', time=2024-09-14T14:00:30.511189+0000, chain.objs.size()=1 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IZb4vegbXmlMagvNemQQUyHMgDTa-hX_0 2024-09-14T12:44:04.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2995724964592936739', time=2024-09-14T14:00:31.497780+0000, chain.objs.size()=1 2024-09-14T12:44:04.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1Mh_I5McvBJTdZj1sL6hLrA0oCIKox2_0 2024-09-14T12:44:04.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2690671788632943088', time=2024-09-14T14:00:33.851461+0000, chain.objs.size()=1 2024-09-14T12:44:04.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.2nBhNJHWmZ9KDOpVR2va2g3zzu4VNmO_0 2024-09-14T12:44:04.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9083555214482971479', time=2024-09-14T14:00:35.316326+0000, chain.objs.size()=1 2024-09-14T12:44:04.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NH96wQUfL3fNnz2sCbWBaNgZmCGLkjQ_0 2024-09-14T12:44:04.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17589034858059604999', time=2024-09-14T14:00:35.623423+0000, chain.objs.size()=1 2024-09-14T12:44:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5fr_KzJVXHXAAxwur2UGK_FvWobS_uL_0 2024-09-14T12:44:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10013306088811784267', time=2024-09-14T14:00:37.442450+0000, chain.objs.size()=1 2024-09-14T12:44:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mcWNJWP3nSHPk-ivHHEsLssJuoVY2Z9_0 2024-09-14T12:44:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2722447584032771410', time=2024-09-14T14:00:37.445332+0000, chain.objs.size()=1 2024-09-14T12:44:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ELF8bYLLJjDPKAW5b6TwLSTJHReA1Kk_0 2024-09-14T12:44:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13165397970273793276', time=2024-09-14T14:00:38.835599+0000, chain.objs.size()=1 2024-09-14T12:44:04.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.681+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hhutDeXdd80dWvPpsQ6X4Nii3WjIiUz_0 2024-09-14T12:44:04.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4025710383916650562', time=2024-09-14T14:00:43.109255+0000, chain.objs.size()=1 2024-09-14T12:44:04.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.I4ibUYUViBjXmvLXvK9GIABtzO318J8_0 2024-09-14T12:44:04.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4353461486458489044', time=2024-09-14T14:00:44.400332+0000, chain.objs.size()=1 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.d7ITqdXqVP3j-ygM-veVX_k0UYsaMNa_0 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18180594038846055197', time=2024-09-14T14:00:45.890359+0000, chain.objs.size()=1 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.I-13rQaMW5Fh-byb_Jfw3z-svTIMB7A_0 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11562062917718430252', time=2024-09-14T14:00:46.109641+0000, chain.objs.size()=1 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SHXltWXTlb-v_AKdatM1RXSZo9Q1EAM_0 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2189816056200305238', time=2024-09-14T14:00:48.013034+0000, chain.objs.size()=1 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QXctpUW5p-x7xQFXQyzqaH952HvH5s9_0 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9567758068751811156', time=2024-09-14T14:02:19.888485+0000, chain.objs.size()=1 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.685+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.368__shadow_.aNE2nE37vjY1Kdvz9k0cxLS-TKgo5C2_0 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12083689626723835650', time=2024-09-14T14:02:26.091188+0000, chain.objs.size()=1 2024-09-14T12:44:04.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.371__shadow_.iW2vXXLUCUz-PJfYrvHDaYEbWNOOMDv_0 2024-09-14T12:44:04.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.689+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14951698721395700037', time=2024-09-14T14:03:54.173404+0000, chain.objs.size()=1 2024-09-14T12:44:04.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.689+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.410__shadow_.AJBaL0fDaxPOMIszmDg8kQFJm-KrokU_0 2024-09-14T12:44:04.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14744815732605028128', time=2024-09-14T14:07:29.944409+0000, chain.objs.size()=1 2024-09-14T12:44:04.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.501__shadow_.v_BEG5B-1rvvCYIoVgavvDjCH9XmXky_0 2024-09-14T12:44:04.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1839665271939534565', time=2024-09-14T14:07:39.387437+0000, chain.objs.size()=1 2024-09-14T12:44:04.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.504__shadow:CRVCgFwmMB1yqxO5U8RjttqtM84H.gl_.-dyH_j79k-7Z8XYotXT1e1-rBoXsavU_0 2024-09-14T12:44:04.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14157986964884210741', time=2024-09-14T14:14:41.801976+0000, chain.objs.size()=2 2024-09-14T12:44:04.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~f0hqMPe4y0YUGb2uWBrTMeO3Hmm429q.1 2024-09-14T12:44:04.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~f0hqMPe4y0YUGb2uWBrTMeO3Hmm429q.2 2024-09-14T12:44:04.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3374683958474859681', time=2024-09-14T14:19:29.436818+0000, chain.objs.size()=1 2024-09-14T12:44:04.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:vUM.jwVTi2MeTMUI8ojal-sIGjP35q6_.ZM8ePgFqw_e5-OtH62C1_j3Twu4RjqR_0 2024-09-14T12:44:04.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17365292307071485966', time=2024-09-14T14:20:36.772039+0000, chain.objs.size()=1 2024-09-14T12:44:04.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:Q.s0M6bZBz4uejqpTqdmTdFqv8u51Gp_.oCWGKfVqOiEWA72qj43HNJPTpb7Ga1d_0 2024-09-14T12:44:04.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1777811978185739288', time=2024-09-14T14:22:10.172354+0000, chain.objs.size()=1 2024-09-14T12:44:04.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.580__shadow:b93EYZB4RpYkK7UwSmwj-46yGJFYOps_.pTo7rhaoxrLb__mYojsV0oQd93NM0B4_0 2024-09-14T12:44:04.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14235746809526871743', time=2024-09-14T14:22:36.349687+0000, chain.objs.size()=1 2024-09-14T12:44:04.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:t7PEyh.9EIEoI2r5ujaRuLt.weGZ-aK_.8JI4J2yKJ8wGHvI7-5fx5kx0l0_F6n8_0 2024-09-14T12:44:04.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3670527832146661688', time=2024-09-14T14:32:42.763835+0000, chain.objs.size()=1 2024-09-14T12:44:04.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.693+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.666__shadow_.7zuYsXhsMPSWrY4BxY-OVozdkLzCShK_0 2024-09-14T12:44:04.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43884 2024-09-14T12:44:04.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T12:44:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12765991295274816477', time=2024-09-14T14:34:18.382460+0000, chain.objs.size()=1 2024-09-14T12:44:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.711__shadow:gdfjONK5c0wkd34WiMIkE0eNyXaTM5r_.y046km81iQn2T4WS38v6n12W8h_LCD0_0 2024-09-14T12:44:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15678828023080508538', time=2024-09-14T14:34:56.951967+0000, chain.objs.size()=1 2024-09-14T12:44:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.720__shadow_.5cxRcQxEggldg3AQuCaX0pqXt_h-xTM_0 2024-09-14T12:44:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~jIotgVhnrgjf9fkGw4C48bOATGJbhxz', time=2024-09-14T14:36:15.031149+0000, chain.objs.size()=1 2024-09-14T12:44:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.743__multipart_mymultipart2.2~jIotgVhnrgjf9fkGw4C48bOATGJbhxz.1 2024-09-14T12:44:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7837768179004226724', time=2024-09-14T14:39:44.178846+0000, chain.objs.size()=1 2024-09-14T12:44:04.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.701+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.767__shadow_.8Ne-3jOgs1u0JaOYvymSh-KcUSbrz_Z_0 2024-09-14T12:44:04.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.705+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.705+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T12:44:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53436' 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13469382670268332271', time=2024-09-14T13:46:01.468338+0000, chain.objs.size()=1 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.198__shadow_.vXSwbbxdtS38qV5XiP8U4yqzmqLmbSe_0 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~bfumc4Lq2Jqqk2GKccDdYFVK3T7jlRC', time=2024-09-14T13:46:18.328166+0000, chain.objs.size()=2 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.203__multipart_mymultipart.2~bfumc4Lq2Jqqk2GKccDdYFVK3T7jlRC.1 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.203__shadow_mymultipart.2~bfumc4Lq2Jqqk2GKccDdYFVK3T7jlRC.1_1 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13893018746764825323', time=2024-09-14T13:50:16.857862+0000, chain.objs.size()=1 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.238__shadow_.w-9_jomvQgNYzta8dftIqw1hhu_SPo3_0 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.842227670133552076', time=2024-09-14T13:50:25.346519+0000, chain.objs.size()=1 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.241__shadow_.GCxwZCoJFzELepT1H0jpmdVn9xCnAfu_0 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1821166368026195895', time=2024-09-14T13:50:56.128892+0000, chain.objs.size()=1 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.252__shadow_.cSQIeEQ83P8fWV50awsCvHdanbymvd5_0 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16742869309902650180', time=2024-09-14T13:51:18.366706+0000, chain.objs.size()=1 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.261__shadow_.BxNWsY7PqnbICqnWR4h5ce4kU59JyNX_0 2024-09-14T12:44:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1048633007578433207', time=2024-09-14T13:53:05.324194+0000, chain.objs.size()=1 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.QoNjfu6q5n8CrT-CfLeyVlY3VmoQxJC_0 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8922048646124406841', time=2024-09-14T13:53:05.534318+0000, chain.objs.size()=1 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.4ApEQyYqv_ok3OOHYO3EAYRZIiuATmT_0 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.940903050341974321', time=2024-09-14T13:53:05.912345+0000, chain.objs.size()=1 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.htprPfKkCkN_pR5zfx3o2P4EmqNlAzS_0 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12721293631015921622', time=2024-09-14T13:53:06.481156+0000, chain.objs.size()=1 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.K-8z4uVJWkiDHV4JI3o7jHGsqmPlgJV_0 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18017990482158521422', time=2024-09-14T13:53:06.656245+0000, chain.objs.size()=1 2024-09-14T12:44:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.709+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.40Eq8Eo1_O8lIv8pfpj1D-pDwewomoT_0 2024-09-14T12:44:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.756502658262724933', time=2024-09-14T13:53:06.771555+0000, chain.objs.size()=1 2024-09-14T12:44:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OFklfkEnMjDnm_2w0lIrnzJKtvBvDC9_0 2024-09-14T12:44:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.572680484975480313', time=2024-09-14T13:53:09.551237+0000, chain.objs.size()=1 2024-09-14T12:44:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.t0V5cKd8sCZz3mIAaq93vEzs7m994ug_0 2024-09-14T12:44:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12735995313890544949', time=2024-09-14T13:53:14.464415+0000, chain.objs.size()=1 2024-09-14T12:44:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ktbn01bt5Zqi1RE3LuWWSr8088h8bUX_0 2024-09-14T12:44:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14870704489813083168', time=2024-09-14T13:53:14.891998+0000, chain.objs.size()=1 2024-09-14T12:44:04.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AaXnuMkzX5Q4RsnEgqR7faHpFjQqmnn_0 2024-09-14T12:44:04.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5272590814956123392', time=2024-09-14T13:53:19.204046+0000, chain.objs.size()=1 2024-09-14T12:44:04.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HXBJFI99SmtXc9D50voNyx_kLIUwxvf_0 2024-09-14T12:44:04.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15100803932055013088', time=2024-09-14T13:53:19.303086+0000, chain.objs.size()=1 2024-09-14T12:44:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.oetnee3zYy3oDK5fpwkmLlqIv28-pRg_0 2024-09-14T12:44:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14813259533449447509', time=2024-09-14T13:53:22.749248+0000, chain.objs.size()=1 2024-09-14T12:44:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.EUMYjZxiUCwVe5nRKo2TGaAl6IsWLRB_0 2024-09-14T12:44:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4614908323529879223', time=2024-09-14T13:53:23.142988+0000, chain.objs.size()=1 2024-09-14T12:44:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fDrHQhGdkMeAdc3wQrgrmlwI858_I4D_0 2024-09-14T12:44:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16274891624722403286', time=2024-09-14T13:53:23.342472+0000, chain.objs.size()=1 2024-09-14T12:44:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.q204t9AzD3VIM6ZJUy709Y7d61vRRLd_0 2024-09-14T12:44:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11643007316553035256', time=2024-09-14T13:53:23.980198+0000, chain.objs.size()=1 2024-09-14T12:44:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8WXriBTABT8ulENCSYo7Aj6hS8uF0Hx_0 2024-09-14T12:44:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1500921393753175733', time=2024-09-14T13:53:25.195404+0000, chain.objs.size()=1 2024-09-14T12:44:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.713+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VxViB-J7iD2-8hQCp-a_SXY9mrEZYcg_0 2024-09-14T12:44:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5985567714989725965', time=2024-09-14T13:53:25.197330+0000, chain.objs.size()=1 2024-09-14T12:44:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.X2LIsg8-asP5Ogvjq8dNb-0yjbYd25y_0 2024-09-14T12:44:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3134170691678068652', time=2024-09-14T13:53:26.756052+0000, chain.objs.size()=1 2024-09-14T12:44:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hFtRZK1NnC82ZHr-r0-Vg3dbhsj7DQh_0 2024-09-14T12:44:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9831355148634380651', time=2024-09-14T13:53:26.758057+0000, chain.objs.size()=1 2024-09-14T12:44:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Qau49AqemGNpUAi2ZjOM4vWtW4IzJk0_0 2024-09-14T12:44:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14018988331594930377', time=2024-09-14T13:53:32.711452+0000, chain.objs.size()=1 2024-09-14T12:44:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gbOjp2THvGHjeyicBcv3FmGRNW4qexh_0 2024-09-14T12:44:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8348873121491984615', time=2024-09-14T13:53:33.261568+0000, chain.objs.size()=1 2024-09-14T12:44:04.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.717+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.96KlViQ7tdviHYXjuPkPAELjfWqDnVu_0 2024-09-14T12:44:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8901395479279007226', time=2024-09-14T13:53:33.493720+0000, chain.objs.size()=1 2024-09-14T12:44:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LhzhhZFpXYR6gcfX_XwdP6Mwy013oox_0 2024-09-14T12:44:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1056143042150592340', time=2024-09-14T13:53:34.563676+0000, chain.objs.size()=1 2024-09-14T12:44:04.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_._ZH_TLmyumNzKtdL-UEuKvINt4wxljC_0 2024-09-14T12:44:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17679134686986037689', time=2024-09-14T13:53:35.175736+0000, chain.objs.size()=1 2024-09-14T12:44:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.xAkOfcQu_ZQ-no_BMSIWzUj6EG3ss2a_0 2024-09-14T12:44:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13100131954699890041', time=2024-09-14T13:54:28.886161+0000, chain.objs.size()=1 2024-09-14T12:44:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.285__shadow_.XG8sv0CSwLnfRQLvuep4D1rT00OShQ9_0 2024-09-14T12:44:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5796814101119426398', time=2024-09-14T13:54:52.950854+0000, chain.objs.size()=1 2024-09-14T12:44:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.nkSzDjvA2FaG9McB3L3uxDAnMCzWQjA_0 2024-09-14T12:44:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6976617424225324447', time=2024-09-14T13:54:58.867135+0000, chain.objs.size()=1 2024-09-14T12:44:04.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.HYDijeV89v9p4aWCn5IlXObY8Q4iGGh_0 2024-09-14T12:44:04.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13710705873303524027', time=2024-09-14T13:54:59.056752+0000, chain.objs.size()=1 2024-09-14T12:44:04.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.721+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.3Bq25uyPjA3cajATBkwD_wJrBIPjAfP_0 2024-09-14T12:44:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16295167825780767834', time=2024-09-14T13:55:26.980292+0000, chain.objs.size()=1 2024-09-14T12:44:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.305__shadow_.0wUT_AkmYWG-GPzShaifbsKWTleTh9c_0 2024-09-14T12:44:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13235762448278483533', time=2024-09-14T13:58:05.498941+0000, chain.objs.size()=1 2024-09-14T12:44:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.T57TSLxwIefDVkmvFuvnZH2K8YOcEpG_0 2024-09-14T12:44:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3128492459959932990', time=2024-09-14T13:58:06.428397+0000, chain.objs.size()=1 2024-09-14T12:44:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CnaIFnXpUXgUjYj2UAG455KxFzZJzkq_0 2024-09-14T12:44:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5952040312992791004', time=2024-09-14T13:58:06.688260+0000, chain.objs.size()=1 2024-09-14T12:44:04.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gPvhynBlt29fUjxLIYc3_Hlw3ucuE7a_0 2024-09-14T12:44:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14278709933374759950', time=2024-09-14T13:58:08.408556+0000, chain.objs.size()=1 2024-09-14T12:44:04.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pAQzD5Y3qW2b6ijhOzwNYYwQLms1P8H_0 2024-09-14T12:44:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7831708566238124627', time=2024-09-14T13:58:10.020453+0000, chain.objs.size()=1 2024-09-14T12:44:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.s5gX6TBegl4n2o8byFPCq0QyI-5IrAQ_0 2024-09-14T12:44:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13558075441865372160', time=2024-09-14T13:58:10.363404+0000, chain.objs.size()=1 2024-09-14T12:44:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.CbWS2Xg7XV_xoEosDNq-skv8ibVgS05_0 2024-09-14T12:44:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5696927786207998836', time=2024-09-14T13:58:10.674662+0000, chain.objs.size()=1 2024-09-14T12:44:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.m7ee3Mz7oP0g8Hyy4igZaiWPM5blxzV_0 2024-09-14T12:44:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8479393745117384749', time=2024-09-14T13:58:11.883380+0000, chain.objs.size()=1 2024-09-14T12:44:04.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.725+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.F0-Bm-fKr32rhvYNdMT6yhpmj37cKPt_0 2024-09-14T12:44:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14514022269756649062', time=2024-09-14T13:58:12.031922+0000, chain.objs.size()=1 2024-09-14T12:44:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.mlPXpgw8kRcj1nBs49WtxTBq701fAIf_0 2024-09-14T12:44:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13350913155608267624', time=2024-09-14T13:58:12.363492+0000, chain.objs.size()=1 2024-09-14T12:44:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.gBxOBsxixjulo5Lig-Zn-uyxM4VNmid_0 2024-09-14T12:44:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11548285123898745191', time=2024-09-14T13:58:14.089727+0000, chain.objs.size()=1 2024-09-14T12:44:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0e1KT_sedMgfCN5FaFcB5YemX7oBo4v_0 2024-09-14T12:44:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7294474015066897604', time=2024-09-14T13:58:14.230397+0000, chain.objs.size()=1 2024-09-14T12:44:04.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Y36XvFDa-NBHp_WjD9FFLnjuHEEDl8N_0 2024-09-14T12:44:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18258934187503644024', time=2024-09-14T13:58:14.296238+0000, chain.objs.size()=1 2024-09-14T12:44:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.En17H791VCuYIRtv_HlLVs_WAtuJfd3_0 2024-09-14T12:44:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12472358677049614388', time=2024-09-14T13:58:15.734895+0000, chain.objs.size()=1 2024-09-14T12:44:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tUPJ2UgvBMRUp1KB887kGZxg_T4wLlz_0 2024-09-14T12:44:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15713856087656581664', time=2024-09-14T13:58:15.955841+0000, chain.objs.size()=1 2024-09-14T12:44:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.xnbcqD8Vk6sV8uY_2yme2sNkSzzbNMc_0 2024-09-14T12:44:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1706418628418931795', time=2024-09-14T13:58:17.307097+0000, chain.objs.size()=1 2024-09-14T12:44:04.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.729+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wpIuemN4uFvHvcGbNi05hCA25h5wYBF_0 2024-09-14T12:44:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8935837611241448408', time=2024-09-14T13:58:17.722062+0000, chain.objs.size()=1 2024-09-14T12:44:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2ovJCNuDolAJGWPng3MaC2ATZoVlZM8_0 2024-09-14T12:44:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8955389694474515015', time=2024-09-14T13:58:21.155711+0000, chain.objs.size()=1 2024-09-14T12:44:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YJ7THVpaxDSsVZYZnZaaPXBOG60gxGn_0 2024-09-14T12:44:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6064805639096744578', time=2024-09-14T13:58:22.058344+0000, chain.objs.size()=1 2024-09-14T12:44:04.722 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QeC0KI0noalKuOegD7_jv0iL4AFHaJf_0 2024-09-14T12:44:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11291750335481352982', time=2024-09-14T13:58:23.279194+0000, chain.objs.size()=1 2024-09-14T12:44:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nKjTpztZuVFPc3aBQX9Ggkw826ql0cB_0 2024-09-14T12:44:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16589610217034336222', time=2024-09-14T13:58:23.665905+0000, chain.objs.size()=1 2024-09-14T12:44:04.723 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.faO7DasDCQGL57LXNUH-vsK7ZB0goz4_0 2024-09-14T12:44:04.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8002720091862264037', time=2024-09-14T13:58:24.891773+0000, chain.objs.size()=1 2024-09-14T12:44:04.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0_j_7SZgZukICQvMsS1N7FzT-V5GnJ8_0 2024-09-14T12:44:04.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4333333596076426388', time=2024-09-14T13:58:25.997612+0000, chain.objs.size()=1 2024-09-14T12:44:04.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.733+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.uglHeGS_i2qIN_BEP3NFgCusNrOm1pa_0 2024-09-14T12:44:04.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14074853363285174482', time=2024-09-14T13:58:26.366935+0000, chain.objs.size()=1 2024-09-14T12:44:04.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Y9M3oAzE5TGl9QvuRYacZ5ZddA2KfCE_0 2024-09-14T12:44:04.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13399664521180014130', time=2024-09-14T13:58:26.751282+0000, chain.objs.size()=1 2024-09-14T12:44:04.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WkvyyeVavNll-D8M7Xr1vPSebXOed9f_0 2024-09-14T12:44:04.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.848552436928103342', time=2024-09-14T13:58:27.118554+0000, chain.objs.size()=1 2024-09-14T12:44:04.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7v5TyCCceJH6dIt1TVyJ_87f_92S1q4_0 2024-09-14T12:44:04.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2049876673830013299', time=2024-09-14T13:58:28.780469+0000, chain.objs.size()=1 2024-09-14T12:44:04.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eONgZQLcyRuRWea_y7C_kbs03BFDwO5_0 2024-09-14T12:44:04.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16824210916863560229', time=2024-09-14T13:58:30.206982+0000, chain.objs.size()=1 2024-09-14T12:44:04.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-eexrJn-enF0DzV_I1HXbwv-KvPbOkY_0 2024-09-14T12:44:04.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5033741966238030396', time=2024-09-14T13:58:30.793572+0000, chain.objs.size()=1 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HhF7zDDGkWnEEmPLfgcxlM_qhO9u-B2_0 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.783961135931576783', time=2024-09-14T13:58:30.941442+0000, chain.objs.size()=1 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rOAnP-WMhyw0dP_eT7fkSAR24T6DvFs_0 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17523409430367352713', time=2024-09-14T13:58:31.368731+0000, chain.objs.size()=1 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.0GKVAf-PLZxurWQatjN7QaVZd4P2tO3_0 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.78164090127950528', time=2024-09-14T13:58:32.103023+0000, chain.objs.size()=1 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.l-bjZOd4EgUn3kG6Bzuh6kj1qSN_YGn_0 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3858467760242752784', time=2024-09-14T13:58:32.969273+0000, chain.objs.size()=1 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ui-Ck4ePapCRIZGbhD_ZoyXSoNsvZwX_0 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1375907427297202020', time=2024-09-14T13:58:33.420799+0000, chain.objs.size()=1 2024-09-14T12:44:04.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.737+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Fp9i8ZoPChu32KhBiuM0gikIXoncryb_0 2024-09-14T12:44:04.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.741+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5998777110536961021', time=2024-09-14T13:58:34.082069+0000, chain.objs.size()=1 2024-09-14T12:44:04.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.741+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-u0O_xVQmsb7wQEYKkNRvHDqDJjU58D_0 2024-09-14T12:44:04.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.741+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8196572554713432166', time=2024-09-14T13:58:34.292602+0000, chain.objs.size()=1 2024-09-14T12:44:04.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.741+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.fIveeaIOEq65vMm3rTwveUELzkNEJoh_0 2024-09-14T12:44:04.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.741+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11101643186435450733', time=2024-09-14T14:00:21.054691+0000, chain.objs.size()=1 2024-09-14T12:44:04.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.741+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.WkoK8JbwzW-Kl_HitoWmEjiBjO1zEcY_0 2024-09-14T12:44:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.741+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12431323997871135558', time=2024-09-14T14:00:21.460987+0000, chain.objs.size()=1 2024-09-14T12:44:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.y0Gi7trnt7f1Sw3RQnbuFmOrYeBgAGz_0 2024-09-14T12:44:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11063140874151291199', time=2024-09-14T14:00:21.531509+0000, chain.objs.size()=1 2024-09-14T12:44:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ITH3jWrnCXL2MuSKGiOZ7wopwFT3opO_0 2024-09-14T12:44:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7098495421539602830', time=2024-09-14T14:00:22.179783+0000, chain.objs.size()=1 2024-09-14T12:44:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TvYVW5CULBpFc-Qai6omWRnX-8WAxM9_0 2024-09-14T12:44:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3422369953366806569', time=2024-09-14T14:00:22.352101+0000, chain.objs.size()=1 2024-09-14T12:44:04.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mE_Yxvps8v1WWHLpqoSLDzDKB6IXyuX_0 2024-09-14T12:44:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5845889481559521544', time=2024-09-14T14:00:23.516499+0000, chain.objs.size()=1 2024-09-14T12:44:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.iuJseq_o2gnFWpxY5g3Vlz_4UM2goFW_0 2024-09-14T12:44:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15472995527086497863', time=2024-09-14T14:00:23.858071+0000, chain.objs.size()=1 2024-09-14T12:44:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CSQPGQJRLefaZxjRvx0m2LLlytk6oXF_0 2024-09-14T12:44:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7911748652631904107', time=2024-09-14T14:00:25.052886+0000, chain.objs.size()=1 2024-09-14T12:44:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.z0MOolqpo8R8qAXamLRjjZ1aH3BkQgT_0 2024-09-14T12:44:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16698897771381976821', time=2024-09-14T14:00:25.346985+0000, chain.objs.size()=1 2024-09-14T12:44:04.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.m9onledfj-zKRyhQ_2BmKXaUutwwj_o_0 2024-09-14T12:44:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2534573889145651740', time=2024-09-14T14:00:25.527343+0000, chain.objs.size()=1 2024-09-14T12:44:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mpR24j8l6funZM-rhcJqyQ843YG2Bv4_0 2024-09-14T12:44:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2692911414708027589', time=2024-09-14T14:00:26.381073+0000, chain.objs.size()=1 2024-09-14T12:44:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-Is0o8vtV-qkj-_kex7GoBjvpp8N9_1_0 2024-09-14T12:44:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7932678348815669238', time=2024-09-14T14:00:26.588097+0000, chain.objs.size()=1 2024-09-14T12:44:04.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.745+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6wpwo_pWTgQEc9BYu8G8EM79ChfBJ6P_0 2024-09-14T12:44:04.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16340193971708970375', time=2024-09-14T14:00:27.193547+0000, chain.objs.size()=1 2024-09-14T12:44:04.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kbadkkI4mdZ1eVL6ujqBHFwwF0X0e-S_0 2024-09-14T12:44:04.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11214468243117004049', time=2024-09-14T14:00:27.899757+0000, chain.objs.size()=1 2024-09-14T12:44:04.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BWE9J_UtUDnZBGVNcqowWqpbnofRHrD_0 2024-09-14T12:44:04.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14947508170616480961', time=2024-09-14T14:00:27.940010+0000, chain.objs.size()=1 2024-09-14T12:44:04.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wsDmsUZ4njA54vIZd925FXlaGBqEBmE_0 2024-09-14T12:44:04.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15174474029589718834', time=2024-09-14T14:00:30.011272+0000, chain.objs.size()=1 2024-09-14T12:44:04.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KPsPGy_ENej13G7wjz5n-Ya3I1r_0Eu_0 2024-09-14T12:44:04.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1494216764193461497', time=2024-09-14T14:00:30.362568+0000, chain.objs.size()=1 2024-09-14T12:44:04.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.pEhPB1atxCU0uy2dl1j6wQeb4s19_wa_0 2024-09-14T12:44:04.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12024523212521969825', time=2024-09-14T14:00:30.791360+0000, chain.objs.size()=1 2024-09-14T12:44:04.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gW9X8kWj54CTWowZpqHbw3mTRVSdERP_0 2024-09-14T12:44:04.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2665975765351979472', time=2024-09-14T14:00:31.306211+0000, chain.objs.size()=1 2024-09-14T12:44:04.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KFMBHIZUnljU6-oKT5bdsgS0QYPAl0B_0 2024-09-14T12:44:04.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1454405747953172915', time=2024-09-14T14:00:31.581849+0000, chain.objs.size()=1 2024-09-14T12:44:04.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.749+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.xkkw0p5Rfy1mqXO8L1d0o-pxpdwwOlW_0 2024-09-14T12:44:04.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.599046363806288958', time=2024-09-14T14:00:31.881474+0000, chain.objs.size()=1 2024-09-14T12:44:04.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Ba2v1UxjB-QzBLDa54Mcm3sSqT0tBK4_0 2024-09-14T12:44:04.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14195711325801716530', time=2024-09-14T14:00:33.424651+0000, chain.objs.size()=1 2024-09-14T12:44:04.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dBnYoh7ibhHbF7kAbE47ZOzq6dyrpz-_0 2024-09-14T12:44:04.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9522035340249119040', time=2024-09-14T14:00:33.847538+0000, chain.objs.size()=1 2024-09-14T12:44:04.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KbY1QKp7XxUiyg_Fo64sC-gGYkCZz3v_0 2024-09-14T12:44:04.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6144101240770946671', time=2024-09-14T14:00:35.218571+0000, chain.objs.size()=1 2024-09-14T12:44:04.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.DMH9kTgU2foTtRI5Tfb02HTKZ2eGI33_0 2024-09-14T12:44:04.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2685765989205313767', time=2024-09-14T14:00:37.598069+0000, chain.objs.size()=1 2024-09-14T12:44:04.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Mfl6HItsg89WIUXHTnHb1l98H3VLnMt_0 2024-09-14T12:44:04.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1931733849823895342', time=2024-09-14T14:00:38.307107+0000, chain.objs.size()=1 2024-09-14T12:44:04.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4oTbmYAfu-n0DT1yR3-YKg0qsNlSPyn_0 2024-09-14T12:44:04.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13053275912898066293', time=2024-09-14T14:00:40.983164+0000, chain.objs.size()=1 2024-09-14T12:44:04.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.753+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uINq-AD9nqe2XPDn5sVK4RYt468eIQy_0 2024-09-14T12:44:04.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3001443079689485517', time=2024-09-14T14:00:41.758368+0000, chain.objs.size()=1 2024-09-14T12:44:04.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.9OEBfL6E5q7mHLDReFaYJjtuCOVl0c7_0 2024-09-14T12:44:04.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.757+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5723069004278900080', time=2024-09-14T14:00:42.902867+0000, chain.objs.size()=1 2024-09-14T12:44:04.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.757+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.bgWuQi8ibkPHBWttPSnnRP3rXGrCy8-_0 2024-09-14T12:44:04.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53436 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11939997957614290134', time=2024-09-14T14:00:43.239367+0000, chain.objs.size()=1 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SusqQgEySZFfXkn09Ff97S9hQRZZgCn_0 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3766651468564143606', time=2024-09-14T14:00:44.370286+0000, chain.objs.size()=1 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BLsyj-mztF8PnVbaskn35DIIVePZ9do_0 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2048205373012363401', time=2024-09-14T14:00:44.408484+0000, chain.objs.size()=1 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.C51X4Pk6WEepSW1Mxyth5zIPiZqJnoJ_0 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18237134534591334075', time=2024-09-14T14:00:44.632402+0000, chain.objs.size()=1 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IOQ4gZ_-I97kCXZdCyvLwJULS0_fyau_0 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1998736439491717410', time=2024-09-14T14:00:45.482649+0000, chain.objs.size()=1 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.dnahG0Y75H5lbGdo-pNivaYLBYA6YO9_0 2024-09-14T12:44:04.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10967007127301676557', time=2024-09-14T14:00:46.894931+0000, chain.objs.size()=1 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ubjnvJ2f1fX_07EhOO-ox_6dzaEGhG-_0 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9571546899506256628', time=2024-09-14T14:00:47.703213+0000, chain.objs.size()=1 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.XVQX2VqsXRIPlE2NDc_J93Q4Hr5UtZ0_0 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5603316708140657742', time=2024-09-14T14:00:47.746047+0000, chain.objs.size()=1 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._6js_wgOaWNODlToutQg1aUPx6kv1Oz_0 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12562501997155238040', time=2024-09-14T14:00:47.993702+0000, chain.objs.size()=1 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.miiegKYs3OL2AhCrxA9mpz7MwrHY74Y_0 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5820122323707559264', time=2024-09-14T14:00:48.508151+0000, chain.objs.size()=1 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.A8rCzXyYU7s3tGlIMz--OKGDPsE1kEU_0 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.801245209576088394', time=2024-09-14T14:00:48.651344+0000, chain.objs.size()=1 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.M4dA5A4w8aHWGHUmhgAFQ6jmja7hPpE_0 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17568543728713386046', time=2024-09-14T14:02:42.522847+0000, chain.objs.size()=1 2024-09-14T12:44:04.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.761+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.378__shadow_._4LVQrEJ3siHamk3SdmxLp5rvyyvXTo_0 2024-09-14T12:44:04.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16785268558114059206', time=2024-09-14T14:05:43.208578+0000, chain.objs.size()=1 2024-09-14T12:44:04.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.456__shadow_.68KJRACgBOIsYgN9-nLT3Hs05W_eWQD_0 2024-09-14T12:44:04.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8640124979912347849', time=2024-09-14T14:05:52.800583+0000, chain.objs.size()=1 2024-09-14T12:44:04.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.459__shadow_.Fv_I1KU8WW9G3wAeBcbEf1m4L07SsWn_0 2024-09-14T12:44:04.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4672635583860581709', time=2024-09-14T14:05:59.027231+0000, chain.objs.size()=1 2024-09-14T12:44:04.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.461__shadow_.lXREmU7e43YWrgGa8G9BY9QdCe-Xv1O_0 2024-09-14T12:44:04.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.765+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9141305161008442651', time=2024-09-14T14:06:05.576343+0000, chain.objs.size()=1 2024-09-14T12:44:04.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.765+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.463__shadow_.SOmW3qZ__fgypEdYXSuq93Sk7lC0753_0 2024-09-14T12:44:04.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16366911450051480057', time=2024-09-14T14:06:08.718022+0000, chain.objs.size()=1 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.464__shadow_.u0scDpRJk3OPQPpLJxMHEPAC7yVoJLu_0 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12453411725084229545', time=2024-09-14T14:06:46.796289+0000, chain.objs.size()=1 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.JbA24S5GAYZMtsZ9uLK9Cgg-cOqLcQr_0 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13934200527576851006', time=2024-09-14T14:07:25.806468+0000, chain.objs.size()=1 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.499__shadow_.xoczWkLJ-wiRfCrAhKBOxH1iutgZ9mx_0 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2411573812107111368', time=2024-09-14T14:07:29.343547+0000, chain.objs.size()=1 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.500__shadow_.oRN4K4q0_s58TAceyF7A89ddE_x3dKu_0 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Lkc6gPbD2t-sfUfRw2oqfHLAbFyCeH-', time=2024-09-14T14:10:50.957742+0000, chain.objs.size()=1 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~Lkc6gPbD2t-sfUfRw2oqfHLAbFyCeH-.1 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4452519768145198448', time=2024-09-14T14:18:14.674231+0000, chain.objs.size()=1 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.557__shadow_.cgCbDh-urTVgK4mEz5OyD5aWMAGnjUz_0 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8703070251876555414', time=2024-09-14T14:19:38.510597+0000, chain.objs.size()=1 2024-09-14T12:44:04.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.769+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:RAysTUKf5oMbUypOsKKytylTHxAMkZc_.pmAHXYN77LAG2X9lZ6EsB4YlW9E22Qk_0 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1466894575493375645', time=2024-09-14T14:19:40.115927+0000, chain.objs.size()=1 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:r.gdD3YJQVE6DPC4PRnjmLcwzWaR3cA_.Ko9cLI52unmXpj0m3Mp00u8KT12m5Zj_0 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16871846885732454482', time=2024-09-14T14:20:07.068347+0000, chain.objs.size()=1 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.575__shadow:pxDRpsUPyF-tmGM1JPIrykN-myrRiB7_._O82BbllimG7CPXMTIED8AgzhGdFWBs_0 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2726658877518882819', time=2024-09-14T14:20:10.952571+0000, chain.objs.size()=1 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.576__shadow_.3GdEWwc4TKu4KDRKhj3b-SDS9pvdhgA_0 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5914430431029450545', time=2024-09-14T14:20:31.297434+0000, chain.objs.size()=1 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:aJA22IfsDfQ0-EQ.X8f7c2ukz0WU7Re_.a6yLbk9ukPm7OdUprdvBh537V0UaP7f_0 2024-09-14T12:44:04.764 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9864674335429877285', time=2024-09-14T14:20:41.821698+0000, chain.objs.size()=1 2024-09-14T12:44:04.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.773+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:cSMy6tYN6bY63myUc0QTG-Ir9e57LTz_.c3l-S2v3-8lTyWKzqZjZ33eEtRW5pLO_0 2024-09-14T12:44:04.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5260741699883413891', time=2024-09-14T14:20:43.013581+0000, chain.objs.size()=1 2024-09-14T12:44:04.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:Zdf1mN72diiVOrKvFFp3ieNGDOxpj7Y_.WpKvYK_WcPqaKnWdrxwpFrLO0cCzGDg_0 2024-09-14T12:44:04.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14386727408709402353', time=2024-09-14T14:22:15.940655+0000, chain.objs.size()=1 2024-09-14T12:44:04.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:oyGf-ISpU1S27FbBH8c8mY5OhK2luOv_.8c2cs3P3W1-2iU8fGMX5glYz9K8CNBm_0 2024-09-14T12:44:04.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.777+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7930949157828291013', time=2024-09-14T14:22:37.211379+0000, chain.objs.size()=1 2024-09-14T12:44:04.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.777+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:FXW81R4sdt4hpLCTs.OrhkFc0yYJteN_.TpBMIkprVmTSLXlyrIbY0fLwIFKHGGk_0 2024-09-14T12:44:04.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.781+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.781+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T12:44:04.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47043' 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17162991259607627807', time=2024-09-14T13:42:45.554553+0000, chain.objs.size()=3 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.159__shadow_.6kmHLwLFE3EdQuuJyYbm5n_PtoLpLwy_0 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.159__shadow_.6kmHLwLFE3EdQuuJyYbm5n_PtoLpLwy_1 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.159__shadow_.6kmHLwLFE3EdQuuJyYbm5n_PtoLpLwy_2 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='_WUjlgp3vv0lU-WCtLyAqLjq9kBcDxjy', time=2024-09-14T13:44:04.854424+0000, chain.objs.size()=3 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.PhP8AT-SxVsjzacDhwC0QJO64wUJYy6_0 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.PhP8AT-SxVsjzacDhwC0QJO64wUJYy6_1 2024-09-14T12:44:04.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.162__shadow_.PhP8AT-SxVsjzacDhwC0QJO64wUJYy6_2 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7631168471293327757', time=2024-09-14T13:45:21.762805+0000, chain.objs.size()=1 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.190__shadow_.oRS_zyoEvUoJQUX5o84Jt1XtmraGnwF_0 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9285344907728946285', time=2024-09-14T13:50:16.835158+0000, chain.objs.size()=1 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.238__shadow_.UqlNk5uR7qMhBWH7ruOlhPHBymo93O6_0 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13748087072238625422', time=2024-09-14T13:50:27.847644+0000, chain.objs.size()=1 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.242__shadow_.gCv1jxY_-h9-ihlB4k8PkdOdJ3PT9Y7_0 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16566708819079553741', time=2024-09-14T13:53:05.844642+0000, chain.objs.size()=1 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.CdlBvQiVxhZdfwas5LovEtWew5x5z6v_0 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.85275310243448966', time=2024-09-14T13:53:06.672627+0000, chain.objs.size()=1 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.UzQpziSkougUW9zyLRfiukF6A8WKhTh_0 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18361580768499998213', time=2024-09-14T13:53:10.575523+0000, chain.objs.size()=1 2024-09-14T12:44:04.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.785+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.B5W74nXKMd6fliDJ1cxRTv-kmQ6UCC0_0 2024-09-14T12:44:04.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15609896316575635304', time=2024-09-14T13:53:13.959499+0000, chain.objs.size()=1 2024-09-14T12:44:04.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AXLkzb3avAKi_oWTmxEbmPqJQunq-vh_0 2024-09-14T12:44:04.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8710955832737950181', time=2024-09-14T13:53:13.980410+0000, chain.objs.size()=1 2024-09-14T12:44:04.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FWgvukxGzZsQylU6b8AtHsVGXvzXbj9_0 2024-09-14T12:44:04.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4236542918100686363', time=2024-09-14T13:53:14.222108+0000, chain.objs.size()=1 2024-09-14T12:44:04.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qL5UnTxOKlTHJqgR9a6sRczyz0wM68u_0 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13031199069217268110', time=2024-09-14T13:53:14.576270+0000, chain.objs.size()=1 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.64DYjJtdOR95Iumsu-_hTW0KfT_g3c3_0 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16605847732103016495', time=2024-09-14T13:53:14.578483+0000, chain.objs.size()=1 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.wNRK9bBfbiZIQUdisfmP6vUKtz55pfl_0 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10922569282680105619', time=2024-09-14T13:53:14.614731+0000, chain.objs.size()=1 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.YwlMYfQZiv6LDJsg86TBBhpR-8HJBAx_0 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5363600005096946609', time=2024-09-14T13:53:16.022582+0000, chain.objs.size()=1 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.LF4jbXMI8X-akpk4CZ9KlpELrkfo-Ct_0 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14194709276320274070', time=2024-09-14T13:53:17.698831+0000, chain.objs.size()=1 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rABFH9B7a5JlJsUIQLRFD8fcJfK2elT_0 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11691561618893195864', time=2024-09-14T13:53:18.398799+0000, chain.objs.size()=1 2024-09-14T12:44:04.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.WUwHwkIRCtX21RRHW9NnHaZt0WRV1hS_0 2024-09-14T12:44:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11608110681152202989', time=2024-09-14T13:53:19.276427+0000, chain.objs.size()=1 2024-09-14T12:44:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.uB8Pb5KQj-9nKvQTNP4_i5zgkjSQos1_0 2024-09-14T12:44:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17647203915068518169', time=2024-09-14T13:53:19.759621+0000, chain.objs.size()=1 2024-09-14T12:44:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.793+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.omUqbyVNyqT6Z33KRpac4s9jWJNlNY__0 2024-09-14T12:44:04.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10286611545792872118', time=2024-09-14T13:53:20.236877+0000, chain.objs.size()=1 2024-09-14T12:44:04.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KxGhst-Odh_bGuzDlqQ51nYSH2KtRTK_0 2024-09-14T12:44:04.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2779882567404303337', time=2024-09-14T13:53:21.545425+0000, chain.objs.size()=1 2024-09-14T12:44:04.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5_a7Cbq5doEIaIWzgkM_4D2jNocFhug_0 2024-09-14T12:44:04.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8995703721893443852', time=2024-09-14T13:53:22.925175+0000, chain.objs.size()=1 2024-09-14T12:44:04.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TOJTq16ZiGi3aP4nCUojkQyvJjpVIH5_0 2024-09-14T12:44:04.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15451660344162181372', time=2024-09-14T13:53:24.000886+0000, chain.objs.size()=1 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.l7qHoOHOur1_aMnI7wOdTg0CQeNjW1__0 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13357504727859116416', time=2024-09-14T13:53:27.340484+0000, chain.objs.size()=1 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FZuS62Nwxxyf5QTDDQTYycfqtajedZa_0 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2516283962796395406', time=2024-09-14T13:53:27.407283+0000, chain.objs.size()=1 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.nfe6sCvsxFRzTARN-U7nNLrERIkhAe6_0 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7349267317328500758', time=2024-09-14T13:53:28.001170+0000, chain.objs.size()=1 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.vZ76uAG5304F48EJZMlarM2mZUsu8Fj_0 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17384233830155725625', time=2024-09-14T13:53:28.854934+0000, chain.objs.size()=1 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HZuPGJhf3_o5s9vxO5AXmUuEtIMBYMD_0 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6028380795128463515', time=2024-09-14T13:53:28.960224+0000, chain.objs.size()=1 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.guL3tijoJ7WX0GTBK6EKQgFfYH7sWJY_0 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10076036329408132489', time=2024-09-14T13:53:29.888289+0000, chain.objs.size()=1 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dgrp-5U5nSduJ0z9QarP_Ku7TiBZzOO_0 2024-09-14T12:44:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7150331106719632757', time=2024-09-14T13:53:29.901732+0000, chain.objs.size()=1 2024-09-14T12:44:04.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.797+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8bSewYss7oO510ux-f00ZpuX0r5ozCQ_0 2024-09-14T12:44:04.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12195372911101972967', time=2024-09-14T13:53:30.549469+0000, chain.objs.size()=1 2024-09-14T12:44:04.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.L30gQzPG8-NJvqIvIGxMPf6cOefL9xL_0 2024-09-14T12:44:04.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17990814810971842401', time=2024-09-14T13:53:30.550841+0000, chain.objs.size()=1 2024-09-14T12:44:04.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.HXQ0gaIIMb-_hmlvF6xErqbo2xQkCJD_0 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11411772314726483060', time=2024-09-14T13:53:31.148018+0000, chain.objs.size()=1 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5FtFBwQguRltEplZoNILFm2FgLnyDaA_0 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4908782301478511241', time=2024-09-14T13:53:31.477052+0000, chain.objs.size()=1 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.51fcuKzSxKeW58NzeGzpEmD3gE0L5-1_0 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6835431636887044990', time=2024-09-14T13:53:31.625128+0000, chain.objs.size()=1 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.qYxpfDJicTVyixluEk762Vv5QGX3ihS_0 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6435933751101327922', time=2024-09-14T13:53:32.802033+0000, chain.objs.size()=1 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dxfkz51rsHEcl9E5JbTqd-Xd5TCzBY2_0 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15885887042483329663', time=2024-09-14T13:53:33.942540+0000, chain.objs.size()=1 2024-09-14T12:44:04.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.801+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ux7AFLXgiggJRxBFaU3XG8b2evh2XjI_0 2024-09-14T12:44:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2750350295792864905', time=2024-09-14T13:53:52.047964+0000, chain.objs.size()=1 2024-09-14T12:44:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.270__shadow_.hSIUsbGSpqmq0s3m3xgxCCF7dsKEems_0 2024-09-14T12:44:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3540470697101564797', time=2024-09-14T13:53:54.333364+0000, chain.objs.size()=1 2024-09-14T12:44:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.271__shadow_.CBHR_xGUdJyLdi-5Tnjv8h1W5PJNWU7_0 2024-09-14T12:44:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.869431548738681252', time=2024-09-14T13:53:56.717690+0000, chain.objs.size()=1 2024-09-14T12:44:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.272__shadow_.5lsp2iTps9aGWrbt7KWqsu5l8oQwbSi_0 2024-09-14T12:44:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13311482098770645591', time=2024-09-14T13:54:28.860411+0000, chain.objs.size()=1 2024-09-14T12:44:04.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.285__shadow_.4SGNj0hXTq_eI6YTasfW5N60pVW0fWJ_0 2024-09-14T12:44:04.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2237539451960141574', time=2024-09-14T13:54:31.454589+0000, chain.objs.size()=1 2024-09-14T12:44:04.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.805+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.286__shadow_.vrJPUQZ6S2mx-H4PmJ-iYwqBEuNiLKB_0 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9413543969546994962', time=2024-09-14T13:54:31.468380+0000, chain.objs.size()=1 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.286__shadow_.kEpJDgFvfLYYCWt_qIn91yfA5L2ovn1_0 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.82071712017487760', time=2024-09-14T13:54:34.073015+0000, chain.objs.size()=1 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.287__shadow_.2gbbWaSHQrkaX3eG8XOGx1onmEMVzdy_0 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.761037373907059954', time=2024-09-14T13:54:41.626379+0000, chain.objs.size()=1 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.290__shadow_.nkkPHp2iz8zMV-UkQdyAjSURdLyl-ea_0 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12926009787554397983', time=2024-09-14T13:54:59.066609+0000, chain.objs.size()=1 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.DM43_8pgqr9kWIKUqtofU_CRuQ5brDs_0 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15646882016794775436', time=2024-09-14T13:55:11.740230+0000, chain.objs.size()=1 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.299__shadow_.PAlAQn-TgNG3euPEp85ELO3Ak3BaeAu_0 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1813118176282982709', time=2024-09-14T13:56:18.948126+0000, chain.objs.size()=1 2024-09-14T12:44:04.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.323__shadow_.-ARk6RwlUk2iOw17zKQd5coWiWSxs4Q_0 2024-09-14T12:44:04.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16333429171334080338', time=2024-09-14T13:58:06.408974+0000, chain.objs.size()=1 2024-09-14T12:44:04.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.kJ0YpRbJX0sScMW1xav3drdv1-M6eh2_0 2024-09-14T12:44:04.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16064157757446680570', time=2024-09-14T13:58:06.411033+0000, chain.objs.size()=1 2024-09-14T12:44:04.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wmGNUgElDspHl-p2UjiI22GH3gMMnbD_0 2024-09-14T12:44:04.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12123294603180644794', time=2024-09-14T13:58:07.159488+0000, chain.objs.size()=1 2024-09-14T12:44:04.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ycMNgzcS6ip8lfYhfcQpMw2AvwvLfJJ_0 2024-09-14T12:44:04.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10583234987899152173', time=2024-09-14T13:58:07.322085+0000, chain.objs.size()=1 2024-09-14T12:44:04.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.809+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IODRdJvJyw8JSAHImtvRjvVvq2soJOb_0 2024-09-14T12:44:04.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15288223342548787879', time=2024-09-14T13:58:09.661469+0000, chain.objs.size()=1 2024-09-14T12:44:04.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.coE2o8rfg3YM_NLgWv77G2aysSgUM0O_0 2024-09-14T12:44:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5048970100258721667', time=2024-09-14T13:58:10.097851+0000, chain.objs.size()=1 2024-09-14T12:44:04.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YVjjuE9tJq4hH0cAoJXx59xg0wgcTnw_0 2024-09-14T12:44:04.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5215355922791832899', time=2024-09-14T13:58:11.600854+0000, chain.objs.size()=1 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Mf68S5BUPP2nGIi-3v1r2IZoUh-_OXb_0 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.901666252100346568', time=2024-09-14T13:58:11.644030+0000, chain.objs.size()=1 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Ld13Ot-k4FEhnXWkeLnotUXnBQKo8wf_0 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.813+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16970474473318278406', time=2024-09-14T13:58:11.936554+0000, chain.objs.size()=1 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2RJrhuGPehx_VLDsVePJfTQUCprYl0A_0 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7675747473267174838', time=2024-09-14T13:58:13.370476+0000, chain.objs.size()=1 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QNJR_9I0GGbSKRy_kC2RiMxRbzMVu1p_0 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12613046574997850801', time=2024-09-14T13:58:14.623186+0000, chain.objs.size()=1 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IM9HT-63uwZ4AeG5FdgydOwMVdd5a-V_0 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17437183569850841486', time=2024-09-14T13:58:14.992910+0000, chain.objs.size()=1 2024-09-14T12:44:04.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.efodS_8jFzEVcP-7kFw8bIrXe6xALhV_0 2024-09-14T12:44:04.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3791387761773601878', time=2024-09-14T13:58:18.321933+0000, chain.objs.size()=1 2024-09-14T12:44:04.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.lE-I-NaUISTFS-WOGMye0daKmDmZUSc_0 2024-09-14T12:44:04.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14248092134644286848', time=2024-09-14T13:58:18.619227+0000, chain.objs.size()=1 2024-09-14T12:44:04.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.nNTlbvHQ9sxPelan7K1C6TsbPFb2ZhK_0 2024-09-14T12:44:04.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16734380330806439220', time=2024-09-14T13:58:19.061212+0000, chain.objs.size()=1 2024-09-14T12:44:04.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.I2j5pL9nAhfjVaOmjKNUEGErNhupEx0_0 2024-09-14T12:44:04.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2051089283583388762', time=2024-09-14T13:58:19.063527+0000, chain.objs.size()=1 2024-09-14T12:44:04.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.817+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.aigqNd8EeKMvSk37NxrNjBT_wIUEBSy_0 2024-09-14T12:44:04.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.676821756352212874', time=2024-09-14T13:58:21.912939+0000, chain.objs.size()=1 2024-09-14T12:44:04.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.pLVH99cv06LEZCbeYPj_XOMM3h0fWQm_0 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1847835306415949612', time=2024-09-14T13:58:22.941772+0000, chain.objs.size()=1 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.PzHADadw7snngXtJuxSB1q-BNnAalDz_0 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8545794109085637962', time=2024-09-14T13:58:23.273100+0000, chain.objs.size()=1 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Vqi9jPeW_SgC7xMtkPWYf2EzR9Lk__w_0 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16088847765578875333', time=2024-09-14T13:58:25.213287+0000, chain.objs.size()=1 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YqaaGY9cvbdrtjEkZk_nXBinXiJfBCD_0 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5538773107424193219', time=2024-09-14T13:58:25.272725+0000, chain.objs.size()=1 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-QlGYGbSbdg_D-cIScuM1XaBzYLhyjm_0 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5455497652682734045', time=2024-09-14T13:58:26.079057+0000, chain.objs.size()=1 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ntfOPtER-SpzgrbBITVrDFAqodNIsU3_0 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8197437003103348651', time=2024-09-14T13:58:26.148388+0000, chain.objs.size()=1 2024-09-14T12:44:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6f3i6BJsWlAO8WK4hG7QRRbSaD5cODa_0 2024-09-14T12:44:04.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9370616859281686759', time=2024-09-14T13:58:26.577542+0000, chain.objs.size()=1 2024-09-14T12:44:04.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Jwp5WbjAHp6NkctgiuMx3XT6piVnCR8_0 2024-09-14T12:44:04.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9523694316561669171', time=2024-09-14T13:58:27.368798+0000, chain.objs.size()=1 2024-09-14T12:44:04.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.e69I9zJ1vaXwOwsgGNiHAxAvysFalpO_0 2024-09-14T12:44:04.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3566403811641051270', time=2024-09-14T13:58:28.881299+0000, chain.objs.size()=1 2024-09-14T12:44:04.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.821+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GBQLnC69OF3J-1b9H--sTnn0_7K5aNz_0 2024-09-14T12:44:04.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10357175528737180140', time=2024-09-14T13:58:29.239410+0000, chain.objs.size()=1 2024-09-14T12:44:04.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Uhm5uu5SfF2BUl9aKOsb0W9zOJsLV8m_0 2024-09-14T12:44:04.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10691911166047776878', time=2024-09-14T13:58:29.811068+0000, chain.objs.size()=1 2024-09-14T12:44:04.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.S3lUX_zYTFkQXyhWLFIKwjB6W3u63AJ_0 2024-09-14T12:44:04.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16768571074218334963', time=2024-09-14T13:58:31.153999+0000, chain.objs.size()=1 2024-09-14T12:44:04.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.jhvinhyj0rXawfIxDZff7q-wtngUYhs_0 2024-09-14T12:44:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.825+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8075271927928496422', time=2024-09-14T13:58:31.323205+0000, chain.objs.size()=1 2024-09-14T12:44:04.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.825+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.n44jz0f-1E_wiAaAspmAgYJAwbELfJs_0 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9453952280825812311', time=2024-09-14T13:58:32.106146+0000, chain.objs.size()=1 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.sT5xeMH7npUtWJ-T1KKcxMYuddyYKQF_0 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18278695271923314756', time=2024-09-14T13:58:32.580632+0000, chain.objs.size()=1 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.vAkdmzRbpyjFNoo3s-gO9rfNm8SiNum_0 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2191140516367274753', time=2024-09-14T13:58:33.217883+0000, chain.objs.size()=1 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Ebe5rE9CuUcGnZl-i1vhlSdUloHEm07_0 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6104975281470216413', time=2024-09-14T13:58:34.172657+0000, chain.objs.size()=1 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BrmGmoJKg_ixZSaVFjmeE4cgFsvSMXA_0 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5935872372643787025', time=2024-09-14T13:58:34.261537+0000, chain.objs.size()=1 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1Qk5DAvGv1uWl70xf56vbCiBS8ifgqs_0 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7731676498323434696', time=2024-09-14T13:58:34.314772+0000, chain.objs.size()=1 2024-09-14T12:44:04.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Te7Yc7OnhVNBJuu27iKKVmoVPxVBwjX_0 2024-09-14T12:44:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15922335861146668018', time=2024-09-14T14:00:21.048084+0000, chain.objs.size()=1 2024-09-14T12:44:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TCdhABUuCox9xEvfS0cMVaiz3-bTzDa_0 2024-09-14T12:44:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7221761202366691533', time=2024-09-14T14:00:25.058849+0000, chain.objs.size()=1 2024-09-14T12:44:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1yonuDsuc8X88PeKD_JQa5yXLMQ1_6d_0 2024-09-14T12:44:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12434703807099284032', time=2024-09-14T14:00:26.489059+0000, chain.objs.size()=1 2024-09-14T12:44:04.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.CIT6lpmB-hu_dyM2Ak58ZG0MDAlEXsY_0 2024-09-14T12:44:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5435084917840551857', time=2024-09-14T14:00:26.611511+0000, chain.objs.size()=1 2024-09-14T12:44:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.41M8b7orayfamWpC5kBqHC8WTxmsVBq_0 2024-09-14T12:44:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2107591444298064331', time=2024-09-14T14:00:30.868156+0000, chain.objs.size()=1 2024-09-14T12:44:04.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.BMElYnTB6UZhz-CRdCchpDc9Chc4ORh_0 2024-09-14T12:44:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11434524658969823717', time=2024-09-14T14:00:32.878171+0000, chain.objs.size()=1 2024-09-14T12:44:04.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.829+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-ViACRA_i-wxzzeQxANtmjPMQjD4IjY_0 2024-09-14T12:44:04.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2356301804076995013', time=2024-09-14T14:00:33.854306+0000, chain.objs.size()=1 2024-09-14T12:44:04.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.eJ3LXKqwaaQNAdcN3XYvWhzQOx9Qnqt_0 2024-09-14T12:44:04.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14545303826517187634', time=2024-09-14T14:00:34.799490+0000, chain.objs.size()=1 2024-09-14T12:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.MpNEqhgqu5MbhyOiAVYhla8TJ9x1yKQ_0 2024-09-14T12:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12235418960529356940', time=2024-09-14T14:00:35.356735+0000, chain.objs.size()=1 2024-09-14T12:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.I0mIX7YISQcsqQyy_s0zUABEyBDyyH0_0 2024-09-14T12:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7082175448896011910', time=2024-09-14T14:00:36.988204+0000, chain.objs.size()=1 2024-09-14T12:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.cvlGjugvlMuIPcK_VZGVkeVw4VpyMV7_0 2024-09-14T12:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2963540360269356266', time=2024-09-14T14:00:37.064728+0000, chain.objs.size()=1 2024-09-14T12:44:04.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.XtbFW-R9Mm9pZCpyaj1W-PKTzWDK-hh_0 2024-09-14T12:44:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16974571556287781110', time=2024-09-14T14:00:37.067199+0000, chain.objs.size()=1 2024-09-14T12:44:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.gN7YO6y0lXKHiovUIZU0NlzA-kUJLkd_0 2024-09-14T12:44:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12428315388391305846', time=2024-09-14T14:00:38.599087+0000, chain.objs.size()=1 2024-09-14T12:44:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.1IFMS9rfaDI-OE_Yk_AXrQ2Id0XQC2O_0 2024-09-14T12:44:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14674604989862767235', time=2024-09-14T14:00:38.645937+0000, chain.objs.size()=1 2024-09-14T12:44:04.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.o1wekvtd-992HYk_o6VAEw-fvSOKBvz_0 2024-09-14T12:44:04.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11829952174544172948', time=2024-09-14T14:00:39.186883+0000, chain.objs.size()=1 2024-09-14T12:44:04.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.833+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._QdjS2-N-FuFTNJEp_zwRHwFpxf1gY-_0 2024-09-14T12:44:04.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.837+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7477556217680500237', time=2024-09-14T14:00:39.539398+0000, chain.objs.size()=1 2024-09-14T12:44:04.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.837+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.MkwNF2NTzJD_HtERJj37MLc1k_AHbZi_0 2024-09-14T12:44:04.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47043 2024-09-14T12:44:04.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T12:44:04.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2572661362324753487', time=2024-09-14T14:00:40.330890+0000, chain.objs.size()=1 2024-09-14T12:44:04.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Gl-dXMKJ6UkwDpbDyNCmhgGkO4s-hOL_0 2024-09-14T12:44:04.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7645846581055461697', time=2024-09-14T14:00:42.862422+0000, chain.objs.size()=1 2024-09-14T12:44:04.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.6wA31Uw8QiQppSnetTaJEFyCggQJczo_0 2024-09-14T12:44:04.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7115476573065181555', time=2024-09-14T14:00:43.156883+0000, chain.objs.size()=1 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.o26tr3Vrvgk6-Nl8w50631apCaOEjJS_0 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14358145311558463713', time=2024-09-14T14:00:44.175588+0000, chain.objs.size()=1 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._paKrni2xrci0GO_HNTgkR_QPcJmtRH_0 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.551327997492513548', time=2024-09-14T14:00:46.891208+0000, chain.objs.size()=1 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Bt4iNZ4azAhWNMNAZyX_ySsCostXux3_0 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12634349953440458362', time=2024-09-14T14:00:47.691073+0000, chain.objs.size()=1 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Jbm139TnvPMczPut2P-vnXbWd7zJW3D_0 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13306260878771446924', time=2024-09-14T14:00:49.718442+0000, chain.objs.size()=1 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.c2fF_32zlSyYskjGDB_DhHq8z6tw_uz_0 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9301522112394904506', time=2024-09-14T14:00:49.818855+0000, chain.objs.size()=1 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uw1o9J6672c4ZLsT8lGyFCaaPQxJtuM_0 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3618968536717434220', time=2024-09-14T14:04:41.980267+0000, chain.objs.size()=1 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.431__shadow_.blWjDFXOMOkJ7kxlF9xuxLurCsqBpv1_0 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10896725233574406868', time=2024-09-14T14:06:18.210830+0000, chain.objs.size()=1 2024-09-14T12:44:04.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.467__shadow_.x9MdQdwlNcxSBLnaFIw8L-9mu6W11Zp_0 2024-09-14T12:44:04.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16517420157484434835', time=2024-09-14T14:07:02.902460+0000, chain.objs.size()=1 2024-09-14T12:44:04.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.488__shadow_.6f7Obv9nQFCxG7oVzG-aGf0nnZtIE1V_0 2024-09-14T12:44:04.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11618758626206450158', time=2024-09-14T14:14:05.478699+0000, chain.objs.size()=1 2024-09-14T12:44:04.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.841+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.524__multipart_mymultipart.2~eaZryEQ96YcL5fzVQcGnfYv1Y6CXXj1.1 2024-09-14T12:44:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.845+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6307639501325700020', time=2024-09-14T14:18:09.296584+0000, chain.objs.size()=1 2024-09-14T12:44:04.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.845+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.556__shadow_.R1BnYTVbBF--0AMTvjqVS5n2W9wgktJ_0 2024-09-14T12:44:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11550503609979370360', time=2024-09-14T14:18:36.860232+0000, chain.objs.size()=1 2024-09-14T12:44:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.559__shadow_.KDOsOgRMVwTMh4msRAs2sPtjsVTJ-HH_0 2024-09-14T12:44:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12221061363062332797', time=2024-09-14T14:19:21.043915+0000, chain.objs.size()=1 2024-09-14T12:44:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:c1OLWmIuoRSU3Oim1grWyr7Ph-Bv5m8_.8c1jc_veKVoF8BAgvjBGaIaa1AmnLuC_0 2024-09-14T12:44:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2572123155761189015', time=2024-09-14T14:20:45.056450+0000, chain.objs.size()=1 2024-09-14T12:44:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:xWxg69ZXfqMo0u5lpFHvsWIot86RcH9_._ksVvFF3esgb2_udk1yS5CUO62He9pl_0 2024-09-14T12:44:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7737687369271755052', time=2024-09-14T14:22:15.895725+0000, chain.objs.size()=1 2024-09-14T12:44:04.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:5i0pXNcrE9LLitUB5t.yPClN.qvtDqZ_.BZFJToQUEU6Ycfj5pGZYO6dUZW1vCf7_0 2024-09-14T12:44:04.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.651394957994547017', time=2024-09-14T14:25:46.355961+0000, chain.objs.size()=12 2024-09-14T12:44:04.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__multipart_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.1 2024-09-14T12:44:04.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__shadow_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.1_1 2024-09-14T12:44:04.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__multipart_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.2 2024-09-14T12:44:04.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__shadow_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.2_1 2024-09-14T12:44:04.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__multipart_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.3 2024-09-14T12:44:04.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.849+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__shadow_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.3_1 2024-09-14T12:44:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__multipart_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.4 2024-09-14T12:44:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__shadow_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.4_1 2024-09-14T12:44:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__multipart_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.5 2024-09-14T12:44:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__shadow_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.5_1 2024-09-14T12:44:04.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__multipart_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.6 2024-09-14T12:44:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.615__shadow_multipart_enc.2~LsssM8hJrZ3QEcQ2OxchbPVl4UQoJyF.6_1 2024-09-14T12:44:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15311750427645605046', time=2024-09-14T14:32:55.820180+0000, chain.objs.size()=1 2024-09-14T12:44:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.672__shadow_.hIESJdek25UpjCkxK_IDMl2ruFGXnIz_0 2024-09-14T12:44:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15248120523946928851', time=2024-09-14T14:33:57.014431+0000, chain.objs.size()=1 2024-09-14T12:44:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.702__shadow:mmC8ANVdA2G3j8Wj9Ou3sqm557ZxtAR_.rwn4dbVnUE9l1dUCBHVAc4HV6fIo2SN_0 2024-09-14T12:44:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1020378344116581189', time=2024-09-14T14:38:31.132464+0000, chain.objs.size()=1 2024-09-14T12:44:04.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.857+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.757__shadow_.SihMM5_uYlaGbdlFfK2N6rC9lP52T64_0 2024-09-14T12:44:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.865+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T12:44:04.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=98, truncated=0, next_marker='' 2024-09-14T12:44:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14723179757882244933', time=2024-09-14T13:42:45.633977+0000, chain.objs.size()=3 2024-09-14T12:44:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.159__shadow_.cSkLn2cZQFbY1YC3Urxo6_kfjXFcijZ_0 2024-09-14T12:44:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.159__shadow_.cSkLn2cZQFbY1YC3Urxo6_kfjXFcijZ_1 2024-09-14T12:44:04.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.159__shadow_.cSkLn2cZQFbY1YC3Urxo6_kfjXFcijZ_2 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9731050730417240354', time=2024-09-14T13:44:40.869794+0000, chain.objs.size()=1 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.171__shadow_.0_iyuymxMJHjD-SFdzWOrquscfCKjNN_0 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17953612279779446506', time=2024-09-14T13:50:34.370797+0000, chain.objs.size()=1 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.244__shadow_.DBV06IvTv-krzbN_gHhgWxxFQLY99SW_0 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17711165349887145310', time=2024-09-14T13:50:43.484074+0000, chain.objs.size()=1 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.247__shadow_.l2PToL0oWFovb6A8L_uRbncBh47E6yi_0 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2100635608725359967', time=2024-09-14T13:50:56.149685+0000, chain.objs.size()=1 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.252__shadow_.1G-eA3bO2vD2hCV9mJmCksr_4BxnZ0U_0 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16428571146639420578', time=2024-09-14T13:50:58.638832+0000, chain.objs.size()=1 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.253__shadow_.NQeBdRdXVqEw-yTblfjjv6ZL1ujgVKT_0 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.22712729302484166', time=2024-09-14T13:53:05.403876+0000, chain.objs.size()=1 2024-09-14T12:44:04.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bvOastjJuxfxZwfx72SRTka-NxrrPh3_0 2024-09-14T12:44:04.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3117005482183630591', time=2024-09-14T13:53:07.241744+0000, chain.objs.size()=1 2024-09-14T12:44:04.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.GagL0K68HmyNLnY3K-j2hjW1lPObwZB_0 2024-09-14T12:44:04.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4154237199401336552', time=2024-09-14T13:53:07.853762+0000, chain.objs.size()=1 2024-09-14T12:44:04.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Jxkoja8-xU7KOzw5pUW-G9NVsBiZWRu_0 2024-09-14T12:44:04.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11545632565699055585', time=2024-09-14T13:53:08.302308+0000, chain.objs.size()=1 2024-09-14T12:44:04.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.869+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.S2d1yvCXWJ6FX9rYBeq9ff0raxQZ31T_0 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11550245345132374415', time=2024-09-14T13:53:10.054026+0000, chain.objs.size()=1 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.TXxtq9xsiHc_YlHEafaWwrSwN8tZ-Wf_0 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10510119138756411615', time=2024-09-14T13:53:12.507651+0000, chain.objs.size()=1 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KiJ614etJkYd18vpNaW9jFLyrC9w5Zc_0 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17000813670372482459', time=2024-09-14T13:53:15.226189+0000, chain.objs.size()=1 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.eTTXJOpBmoJcVMQZtv4VVVN7eYNtnYz_0 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1492010224657873173', time=2024-09-14T13:53:15.308389+0000, chain.objs.size()=1 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Eq07FJpWGpUbqYbd7EfVim_WoSxRzb5_0 2024-09-14T12:44:04.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1263751222516771884', time=2024-09-14T13:53:17.727919+0000, chain.objs.size()=1 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.upocpF4xa0q5kHi2QKrd7iVcEALKY63_0 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4520744596958427231', time=2024-09-14T13:53:18.684980+0000, chain.objs.size()=1 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.gIcAbbQsfHksmT1LMManIUS1Xjrjr6D_0 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5516056675830928081', time=2024-09-14T13:53:19.597843+0000, chain.objs.size()=1 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fdv-n589n5a8z1jQd3OSH7BUEm-Q3lu_0 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6461382073856034198', time=2024-09-14T13:53:20.142853+0000, chain.objs.size()=1 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.lDwzwe1A5PrjWBqXSzQeV_Xw8_5qAz__0 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.442638665903614218', time=2024-09-14T13:53:20.619247+0000, chain.objs.size()=1 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.33_ZT7paR0Zq44vh3gd3EacnNuXzzCw_0 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1431026872600136349', time=2024-09-14T13:53:22.588521+0000, chain.objs.size()=1 2024-09-14T12:44:04.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.873+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.fxbNieOnSqmbsZNi9CzEfluqaUA1AT-_0 2024-09-14T12:44:04.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15026571625344196495', time=2024-09-14T13:53:25.338526+0000, chain.objs.size()=1 2024-09-14T12:44:04.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kqi0kJZEh9dbAEweB_0FAUm_xUgX9vL_0 2024-09-14T12:44:04.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.877+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7966170999960256947', time=2024-09-14T13:53:26.521074+0000, chain.objs.size()=1 2024-09-14T12:44:04.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.877+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.c_Rj0eUzmfXIP8ARbyFjyoTuKC2Ggt3_0 2024-09-14T12:44:04.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14126360695645940709', time=2024-09-14T13:53:30.466023+0000, chain.objs.size()=1 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cpx-C-wKEaoyp82rfjn2tMW6abUQSVH_0 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2260366183471673698', time=2024-09-14T13:53:31.705569+0000, chain.objs.size()=1 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.IKBdIiPhyjY3bmo1unkKrYD-wRZM5vD_0 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11845358682100007658', time=2024-09-14T13:53:32.705024+0000, chain.objs.size()=1 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.9wS4MKxId4-HQq4G-3M6YNIpEsK6Yxd_0 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12779547372557715200', time=2024-09-14T13:53:33.632930+0000, chain.objs.size()=1 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.b9GZRLetjUD7WNfKA1jKuBzI4ievIdp_0 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6476589892522440089', time=2024-09-14T13:53:34.871408+0000, chain.objs.size()=1 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FSAck3Q5I5qD4MIESNwgAOSHuoaWqqT_0 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16569981603327626054', time=2024-09-14T13:53:42.492197+0000, chain.objs.size()=1 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.266__shadow_.oT8NniJQUdzZL_0WStlPOLvwifPNiKE_0 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17901569732323263642', time=2024-09-14T13:53:44.866075+0000, chain.objs.size()=1 2024-09-14T12:44:04.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.267__shadow_.bChBzrq_JB8HM7IpcTXU5YDPuiHtfbd_0 2024-09-14T12:44:04.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.843056083465850415', time=2024-09-14T13:54:11.338657+0000, chain.objs.size()=1 2024-09-14T12:44:04.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.278__shadow_.hRhtfU20Xf6gV-ifg48kvgqjXKe7SKz_0 2024-09-14T12:44:04.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13451985425497431207', time=2024-09-14T13:54:44.157905+0000, chain.objs.size()=1 2024-09-14T12:44:04.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.291__shadow_.3WjUyLwJbTXLYCzL0vxQ8Rm_ba1_dHR_0 2024-09-14T12:44:04.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9955538071070001100', time=2024-09-14T13:54:53.223352+0000, chain.objs.size()=1 2024-09-14T12:44:04.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.881+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.AueyYgXQA_p-777d-bSftBSc2lDNA0o_0 2024-09-14T12:44:04.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17067194142044039533', time=2024-09-14T13:54:58.759568+0000, chain.objs.size()=1 2024-09-14T12:44:04.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.294__shadow_.PH4VIvAJXdvztF_FQzSRCQmROvYsCZi_0 2024-09-14T12:44:04.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15379775669914215656', time=2024-09-14T13:55:32.441814+0000, chain.objs.size()=1 2024-09-14T12:44:04.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.307__shadow_.DAHf9WOZyiwqJjUs1W5rJyRf8x_bCKd_0 2024-09-14T12:44:04.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.491177851988086159', time=2024-09-14T13:56:11.895594+0000, chain.objs.size()=1 2024-09-14T12:44:04.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.320__shadow:437dvs4kMHJuIptV7GHiboAkci2hUSL_.a10n8wUp_mT3Ey3pRnqQA84hORrw8FW_0 2024-09-14T12:44:04.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16989381518282745150', time=2024-09-14T13:58:06.441906+0000, chain.objs.size()=1 2024-09-14T12:44:04.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.vblX3cpnNj-UOZvcS_57NHNmsXhv2Pe_0 2024-09-14T12:44:04.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2914150437585377051', time=2024-09-14T13:58:10.534702+0000, chain.objs.size()=1 2024-09-14T12:44:04.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.FoXfwA52ANhfdorOd6ASZ0_Tzv7pSYu_0 2024-09-14T12:44:04.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14135403233786454638', time=2024-09-14T13:58:12.346584+0000, chain.objs.size()=1 2024-09-14T12:44:04.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.bJuEiKGS0pi_0tOBOIuYPtCxgZ_qbYF_0 2024-09-14T12:44:04.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2207599655630221885', time=2024-09-14T13:58:12.396622+0000, chain.objs.size()=1 2024-09-14T12:44:04.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.SDqQLNtB725rq6Y17d_gz-mHd62va4O_0 2024-09-14T12:44:04.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9990411947261032473', time=2024-09-14T13:58:13.871206+0000, chain.objs.size()=1 2024-09-14T12:44:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.S0hUme46xHm9-fvopcAU-nP5c7HDfxV_0 2024-09-14T12:44:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.885+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7861609314567307417', time=2024-09-14T13:58:16.108429+0000, chain.objs.size()=1 2024-09-14T12:44:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.C5Yn_HFO4N-bZwxIoeFarjquBtHO9iH_0 2024-09-14T12:44:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5940594792712750576', time=2024-09-14T13:58:16.164814+0000, chain.objs.size()=1 2024-09-14T12:44:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.-2OfstHuJARwU9Ar38YIWmyUazsNe7H_0 2024-09-14T12:44:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.889+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2956429881041514113', time=2024-09-14T13:58:16.306013+0000, chain.objs.size()=1 2024-09-14T12:44:04.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.889+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.h2ju56gKgwJGoJ2TFeZoCx2_iyuEQ9I_0 2024-09-14T12:44:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4614604527378278772', time=2024-09-14T13:58:17.279864+0000, chain.objs.size()=1 2024-09-14T12:44:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ze_y9ifew7PpKMNhOlD7Aj2Xp4Xox93_0 2024-09-14T12:44:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2286334740358653289', time=2024-09-14T13:58:21.864856+0000, chain.objs.size()=1 2024-09-14T12:44:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.6P_TRk2bPNIrM1x5Wlpj7x2jwG3jOka_0 2024-09-14T12:44:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12206045028421335910', time=2024-09-14T13:58:23.199762+0000, chain.objs.size()=1 2024-09-14T12:44:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2g2VdJ7OZRqJkSEq_vC4ycXIY8IgCZE_0 2024-09-14T12:44:04.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13890750951926298821', time=2024-09-14T13:58:24.934675+0000, chain.objs.size()=1 2024-09-14T12:44:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.Dj7b-RzjzMmwjqRJvKiX7bZoHr5o4O8_0 2024-09-14T12:44:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11239224422180657101', time=2024-09-14T13:58:26.899638+0000, chain.objs.size()=1 2024-09-14T12:44:04.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GG02Co-ZoYZgnPkwMOSNEy57bnFDlzM_0 2024-09-14T12:44:04.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11565697721150384752', time=2024-09-14T13:58:27.714732+0000, chain.objs.size()=1 2024-09-14T12:44:04.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.GNrcmIiAQCyGciIXUMhqZksVNcBm77A_0 2024-09-14T12:44:04.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9449912205403334945', time=2024-09-14T13:58:29.949218+0000, chain.objs.size()=1 2024-09-14T12:44:04.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.YGTiG1gqVfVXXhZjF3vx3cGEuvumKiH_0 2024-09-14T12:44:04.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5009435465179250538', time=2024-09-14T13:58:29.950940+0000, chain.objs.size()=1 2024-09-14T12:44:04.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.BkTbPjvfGsDkv3N-BKb9znO4mfP0Vb9_0 2024-09-14T12:44:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.651640986383961768', time=2024-09-14T13:58:31.051140+0000, chain.objs.size()=1 2024-09-14T12:44:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.SNP5rmNmSSy9amT7ZBLkadzqM_k0TX__0 2024-09-14T12:44:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6767102274194265526', time=2024-09-14T13:58:32.418710+0000, chain.objs.size()=1 2024-09-14T12:44:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.E89ihFo78KaL7mIbyFeiZJYrIas6Dsp_0 2024-09-14T12:44:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14140569385431537026', time=2024-09-14T13:58:32.427867+0000, chain.objs.size()=1 2024-09-14T12:44:04.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.893+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.DZEeOjzYAPYkT32et84405OJ8ODV85M_0 2024-09-14T12:44:04.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14278843364020423005', time=2024-09-14T13:58:33.666097+0000, chain.objs.size()=1 2024-09-14T12:44:04.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1e4Jp533pmugvIVkD7U5jRMNPGZH1Z7_0 2024-09-14T12:44:04.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.341115414489491', time=2024-09-14T14:00:21.899705+0000, chain.objs.size()=1 2024-09-14T12:44:04.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.4fYWDA6IPyKphqAQkF7ZtrJk6sD-eUH_0 2024-09-14T12:44:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12142044878464525279', time=2024-09-14T14:00:21.901339+0000, chain.objs.size()=1 2024-09-14T12:44:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.SGKWS-3XrBV9qpJhuk-FvuZheMRDAGZ_0 2024-09-14T12:44:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17438940693376611882', time=2024-09-14T14:00:22.900608+0000, chain.objs.size()=1 2024-09-14T12:44:04.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.PHR-gfVfe0rDWQSUCZc4LV2YfiWpstL_0 2024-09-14T12:44:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7085427793234772569', time=2024-09-14T14:00:23.051370+0000, chain.objs.size()=1 2024-09-14T12:44:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uRmy0fO_gsl1DIQP8oRHwSkpacEKaAl_0 2024-09-14T12:44:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.44568182866581673', time=2024-09-14T14:00:23.407174+0000, chain.objs.size()=1 2024-09-14T12:44:04.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.897+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.F6jCnM5HaAK6EWQIqHhMn3g67Imbf6S_0 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7597168651409222785', time=2024-09-14T14:00:23.408791+0000, chain.objs.size()=1 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QYLp79UbMydO_K61wYI0EnMwVYYB3DA_0 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13658458458599109063', time=2024-09-14T14:00:23.801285+0000, chain.objs.size()=1 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.KXfV_ue2BjawNIERiGiTj-4ruQ4kxLH_0 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8472093974462112911', time=2024-09-14T14:00:23.802900+0000, chain.objs.size()=1 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QcY_Aor0mBKyWWvKFHuC6mEB_azx_d3_0 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15936749293625470161', time=2024-09-14T14:00:23.947513+0000, chain.objs.size()=1 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.73D4Ji08Tz-Y7g9JOKGbFKtb_1nnPjv_0 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2592669615456579513', time=2024-09-14T14:00:27.965065+0000, chain.objs.size()=1 2024-09-14T12:44:04.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-ScLX8jMAkQb8DnWqBQDl4T4KvVtlCX_0 2024-09-14T12:44:04.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1247620783968178644', time=2024-09-14T14:00:30.310595+0000, chain.objs.size()=1 2024-09-14T12:44:04.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.w-in4aQDQIymo_L5nxxUzGaam-1Vida_0 2024-09-14T12:44:04.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10810859124481299460', time=2024-09-14T14:00:32.868947+0000, chain.objs.size()=1 2024-09-14T12:44:04.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.hCh517X1xLIjaB1gsc6TEO4oKDsGWwi_0 2024-09-14T12:44:04.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4898390654160828263', time=2024-09-14T14:00:33.115505+0000, chain.objs.size()=1 2024-09-14T12:44:04.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kplX7yrN2pfpLS89dp6cc_AnIhlq26b_0 2024-09-14T12:44:04.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16531037786425317444', time=2024-09-14T14:00:33.376354+0000, chain.objs.size()=1 2024-09-14T12:44:04.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.901+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.rZUgGBF0mSIIK9cc9ZUtY9kQURfwHo__0 2024-09-14T12:44:04.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11616937124912116534', time=2024-09-14T14:00:33.711709+0000, chain.objs.size()=1 2024-09-14T12:44:04.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.TWEB3WhR9dqf_3I8csohXXwfLPx30sl_0 2024-09-14T12:44:04.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1162887983879218768', time=2024-09-14T14:00:37.906036+0000, chain.objs.size()=1 2024-09-14T12:44:04.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.jvuql1y5DLYEL_fhD6X93bAiw3k7aRZ_0 2024-09-14T12:44:04.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.905+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5367606147864749316', time=2024-09-14T14:00:40.461222+0000, chain.objs.size()=1 2024-09-14T12:44:04.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.905+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.uDUSf7vlzTm39amQkiiCxaq7xYEcY0a_0 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7450236133530841519', time=2024-09-14T14:00:42.760086+0000, chain.objs.size()=1 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.buNw8tJaOH-ImOP5wOE2ZWXdUDRXIJe_0 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6115959696895473234', time=2024-09-14T14:00:42.762075+0000, chain.objs.size()=1 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wBE2vy1mMtjYZzRV9gCFSRGqSxOP-rg_0 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16262095762599933787', time=2024-09-14T14:00:44.381861+0000, chain.objs.size()=1 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.mwT7qeSe0rpp19mSTyiSCpWzfe25MMV_0 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7903748764616397056', time=2024-09-14T14:00:44.992331+0000, chain.objs.size()=1 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kec92mzOC3WxibOgF_QiMATB4N2oWNL_0 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9033490596549119665', time=2024-09-14T14:00:45.568711+0000, chain.objs.size()=1 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.QYxVhBbJdR7Uzs2o-r5XZQ4rszxX5oN_0 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2324923489536046073', time=2024-09-14T14:00:47.730862+0000, chain.objs.size()=1 2024-09-14T12:44:04.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UN2GpRPKSJ49BoA2qmsertacgY3rFr5_0 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2255896945116150647', time=2024-09-14T14:00:48.358132+0000, chain.objs.size()=1 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ypVgM8xTlQKECbGg9g27yjff8QfS9fp_0 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2460424866797386587', time=2024-09-14T14:00:48.359514+0000, chain.objs.size()=1 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.ROIgaa_o_ldci16jpgNM7U0gV3qROdJ_0 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2633063119719790233', time=2024-09-14T14:00:49.188527+0000, chain.objs.size()=1 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UnhtK_O7g11GT_3h7wPA75VTk6XbHXm_0 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12147650363604815566', time=2024-09-14T14:01:05.380069+0000, chain.objs.size()=1 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.332__shadow_.7rv2h4HkQ-TahecSkrWlbUN_JPPQCgP_0 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14251420865574160717', time=2024-09-14T14:01:10.020948+0000, chain.objs.size()=1 2024-09-14T12:44:04.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.909+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.334__shadow_.LvGguL-HWkoZoAJaQ6TQDwvjJm1p1R5_0 2024-09-14T12:44:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5820889093039337432', time=2024-09-14T14:02:46.710598+0000, chain.objs.size()=1 2024-09-14T12:44:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.380__shadow_.Doz68N8GHj5eGmO8lpf7R_NJ182zA1f_0 2024-09-14T12:44:04.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15781666075217269013', time=2024-09-14T14:06:11.161887+0000, chain.objs.size()=1 2024-09-14T12:44:04.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.465__shadow_.29SV6g0cU5z6LH0LmMqDzXV1K2mbU-w_0 2024-09-14T12:44:04.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4762482694933688553', time=2024-09-14T14:18:11.107756+0000, chain.objs.size()=1 2024-09-14T12:44:04.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.556__shadow_.nE4W8QqDfij9YneICka2mcV2u4XeaGE_0 2024-09-14T12:44:04.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6924013930323280294', time=2024-09-14T14:19:41.024316+0000, chain.objs.size()=1 2024-09-14T12:44:04.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:7uVMD-eZsLA.QxPs3SzstQcJLfCNOAw_.0tKiGLxYQlQmcN5w391XQ8k2lO9twP-_0 2024-09-14T12:44:04.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5829302108602024423', time=2024-09-14T14:19:49.280249+0000, chain.objs.size()=1 2024-09-14T12:44:04.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.572__shadow_.a6HgKIZ-dCPX9E_AYiTxENgNWwaQf7R_0 2024-09-14T12:44:04.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4150160792566212138', time=2024-09-14T14:20:17.846748+0000, chain.objs.size()=1 2024-09-14T12:44:04.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:irB1acwrbvMXMBMlvPL59qmXGKnX.La_.S-XXEwno-dSSbEl3o_IdDCexW0X7NWO_0 2024-09-14T12:44:04.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11191949716575502385', time=2024-09-14T14:20:23.382607+0000, chain.objs.size()=1 2024-09-14T12:44:04.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.577__shadow:TAP0QWqsoSQuX1L2O8ZP2ho4MuyPIjR_.nIuSF5CfhWho4-rvoTWnJbZpvH83Zn2_0 2024-09-14T12:44:04.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9655105147844902719', time=2024-09-14T14:20:47.299758+0000, chain.objs.size()=1 2024-09-14T12:44:04.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:ZaIRlVpVV0XRrCk4Dta3uY7fCtqXnJN_.YX7OeqWHZCR7O-TREKLzeS5Br6zMfSw_0 2024-09-14T12:44:04.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8169806620170717798', time=2024-09-14T14:20:58.281930+0000, chain.objs.size()=1 2024-09-14T12:44:04.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:.u-H261buCRkaT1ID3rontUrxvbPCEc_.sUIg8R6Ud-knalW6uUYAwAxeA0ZZI0c_0 2024-09-14T12:44:04.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.15034127324365971414', time=2024-09-14T14:22:28.944472+0000, chain.objs.size()=1 2024-09-14T12:44:04.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.586__shadow:kAfd193oxtwLv3c.rx-LdA5meObVw36_.aLadQ4H8JrQy9EXLZVJCLkgTM3RhJxq_0 2024-09-14T12:44:04.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2496090034627885741', time=2024-09-14T14:23:08.102717+0000, chain.objs.size()=1 2024-09-14T12:44:04.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.913+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.603__shadow_.mrriX_RmJkpmCYGgq593U6-1YKCOZS9_0 2024-09-14T12:44:04.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10454681292151295982', time=2024-09-14T14:32:42.759111+0000, chain.objs.size()=1 2024-09-14T12:44:04.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.666__shadow_.AHS2KpoxnlLCu3FXq83GCnrkLdnkQNT_0 2024-09-14T12:44:04.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16391858707262956496', time=2024-09-14T14:32:56.421827+0000, chain.objs.size()=1 2024-09-14T12:44:04.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.673__shadow_.ndzz9cI9L-LJVnFg2_czGjdWb9oTNB3_0 2024-09-14T12:44:04.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.917+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8962003995870158359', time=2024-09-14T14:33:38.585050+0000, chain.objs.size()=1 2024-09-14T12:44:04.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.917+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.694__shadow:8Vfd3iTNYhORZF9jP6kKxGERY58oaja_.j_RMNGY2yzK1pb4XhAplbJ4QR0T_RgK_0 2024-09-14T12:44:04.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.921+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5072733620860430034', time=2024-09-14T14:34:02.060019+0000, chain.objs.size()=1 2024-09-14T12:44:04.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.921+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.704__shadow:GyZwQS5aHWiLkU-tK1zv0DgO1ZKtV5v_.bCAYj1hbqxKbDUVXyWVeUT9u45YDUr4_0 2024-09-14T12:44:04.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.925+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.925+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T12:44:04.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:44:04.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46292' 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6103410140189960117', time=2024-09-14T13:53:05.711721+0000, chain.objs.size()=1 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.K7GC1zs4IuIFrZ1zy8zWqhYzqgwgLCp_0 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13991774503620202452', time=2024-09-14T13:53:06.219153+0000, chain.objs.size()=1 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.rJ3t3dIPHSPXNGDmD8n6_nTAL7onvgM_0 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11950690557792973791', time=2024-09-14T13:53:06.380345+0000, chain.objs.size()=1 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.hQv2tBw6KRO4SdkkJWG6g3ReKkpEkax_0 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3482293915533522186', time=2024-09-14T13:53:07.946743+0000, chain.objs.size()=1 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.3DDZqxLp--GOUMT_sMi07X89izZNOEO_0 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1582935935013570115', time=2024-09-14T13:53:08.148769+0000, chain.objs.size()=1 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.51yWTtGAv0YLxnuG-Z7N-abr6dbC6Lk_0 2024-09-14T12:44:04.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13206982617875834465', time=2024-09-14T13:53:10.349968+0000, chain.objs.size()=1 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8yeAdJJswiFnpoocsui_ifEbsQw4Uie_0 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16846512212996738678', time=2024-09-14T13:53:10.351851+0000, chain.objs.size()=1 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bVhKZG5-27eM7kWiHlnrMX7XwEUM4Lx_0 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4688138920064341736', time=2024-09-14T13:53:10.353738+0000, chain.objs.size()=1 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.AXaPG7dPIImLOxiWmjj5R_pDC625uEJ_0 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13310804938190269754', time=2024-09-14T13:53:10.660061+0000, chain.objs.size()=1 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.8Hw0sjt_aAFc6d5Yhirh76B91gjmd4W_0 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1077293984568527796', time=2024-09-14T13:53:11.118169+0000, chain.objs.size()=1 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.Hn9oNdGsiQ5FXwnx7BiLC9xJVM70Dfx_0 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6507995722986693318', time=2024-09-14T13:53:11.747348+0000, chain.objs.size()=1 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.n0URGP7covcCt7qOuvKu15Yz80QIpp__0 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.10953944779700460223', time=2024-09-14T13:53:12.402354+0000, chain.objs.size()=1 2024-09-14T12:44:04.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.929+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.kIsBOSjdCCuKTvHc9qFP65r9EnSTfag_0 2024-09-14T12:44:04.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3339073758065972321', time=2024-09-14T13:53:14.985462+0000, chain.objs.size()=1 2024-09-14T12:44:04.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.5A9UYFTmBqa1aLamdNuEKM33yx_P73W_0 2024-09-14T12:44:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12237453027861046669', time=2024-09-14T13:53:15.333158+0000, chain.objs.size()=1 2024-09-14T12:44:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.FcK9_kUc0kmzGXB1O0Oh1zaHmru90-J_0 2024-09-14T12:44:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16965337873426946557', time=2024-09-14T13:53:16.451962+0000, chain.objs.size()=1 2024-09-14T12:44:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.udDXkABFbweTFEkYpQGn8XLnsGhPo1C_0 2024-09-14T12:44:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1142625460251239377', time=2024-09-14T13:53:18.030256+0000, chain.objs.size()=1 2024-09-14T12:44:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.dX5BgWCR99HKkCP9j87o7mKN8pxtZep_0 2024-09-14T12:44:04.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.955492416795388489', time=2024-09-14T13:53:18.485823+0000, chain.objs.size()=1 2024-09-14T12:44:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.arTzkRTtxw3I9LJ3beD43hzW4PFS13C_0 2024-09-14T12:44:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18149742001503637508', time=2024-09-14T13:53:20.163755+0000, chain.objs.size()=1 2024-09-14T12:44:04.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.KCFQ3Arg1NMxKZhsgpmwQbZxAVNy-8U_0 2024-09-14T12:44:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8870326845040899957', time=2024-09-14T13:53:22.468844+0000, chain.objs.size()=1 2024-09-14T12:44:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.-MXRuHKnmaDTixEfgNNIdqL0hvHXTtz_0 2024-09-14T12:44:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17796776748246506488', time=2024-09-14T13:53:22.471176+0000, chain.objs.size()=1 2024-09-14T12:44:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.OzyOF5Ea8KHKOsv5x4oOAWuxPzRvmvF_0 2024-09-14T12:44:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6289031940331924103', time=2024-09-14T13:53:22.602888+0000, chain.objs.size()=1 2024-09-14T12:44:04.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.933+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.VDO2RAuQiyXjfZlvA5C9S86-vdT1nLX_0 2024-09-14T12:44:04.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9768613753920696353', time=2024-09-14T13:53:22.917199+0000, chain.objs.size()=1 2024-09-14T12:44:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.cFXQVgvfJU7dc6Wj3snKR9_eAR8nswM_0 2024-09-14T12:44:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.937+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17050208248837443778', time=2024-09-14T13:53:23.571684+0000, chain.objs.size()=1 2024-09-14T12:44:04.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.937+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ycsDR9MHrWqRxIBZhwghCVhaUUWR66O_0 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14785299955877375380', time=2024-09-14T13:53:26.091411+0000, chain.objs.size()=1 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.x6LrR8kCEwi60GfUKqJxo6BnHXwFhNi_0 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18051886313628173969', time=2024-09-14T13:53:26.314122+0000, chain.objs.size()=1 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.agmPu9G_nFKG8U7lGkWA7xJVYdXPrpO_0 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11938430509918547316', time=2024-09-14T13:53:26.542777+0000, chain.objs.size()=1 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.haUZClgxVK_u-ukB8GmhI0c_H8kYiSK_0 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5440544853990122810', time=2024-09-14T13:53:28.050116+0000, chain.objs.size()=1 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.j0P0e19XF-s_tOtRY0XeKJ6f0iKiOUQ_0 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8575269117597497149', time=2024-09-14T13:53:28.883709+0000, chain.objs.size()=1 2024-09-14T12:44:04.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.941+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.BGdZNmL06YQnu_wMc7FES2Fj0pW8E5q_0 2024-09-14T12:44:04.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5196255087386470629', time=2024-09-14T13:53:30.263022+0000, chain.objs.size()=1 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.grvw2ZUv5SD3gF0uh1BLOy_5DjuzufQ_0 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13437274016593273049', time=2024-09-14T13:53:31.056021+0000, chain.objs.size()=1 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.ce4JFcM59KBQwWnaKUn6bxZxhz5lpC1_0 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1724185359232790127', time=2024-09-14T13:53:31.854025+0000, chain.objs.size()=1 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.py8hB1HTsK670SqbehWgHQFCnfdqVjB_0 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18315785667084539544', time=2024-09-14T13:53:34.332902+0000, chain.objs.size()=1 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.263__shadow_.bOqyHCW2Zz-pSzHnBYEMjJr-n6s8smV_0 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.502014207994594089', time=2024-09-14T13:54:52.939241+0000, chain.objs.size()=1 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.293__shadow_.XPoTjVt3Isj2LY_ES0LMl8VAvaSy52E_0 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14454204003267246005', time=2024-09-14T13:55:36.134973+0000, chain.objs.size()=1 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.308__shadow:pXCdz.9L0HnUomelnCmIEY8mPztmWgc_.LpvkYDqns1WDcZAbs1BYU-JTImLe0oF_0 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14310638950784426175', time=2024-09-14T13:58:06.086484+0000, chain.objs.size()=1 2024-09-14T12:44:04.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.iK6o6SSW5pbkDyLB3UhliveQQThkRa3_0 2024-09-14T12:44:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11857576392003003238', time=2024-09-14T13:58:06.316467+0000, chain.objs.size()=1 2024-09-14T12:44:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.dczOiGxxMA5hLv2oaUv_JmbC9sUBrvI_0 2024-09-14T12:44:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3357250738776386767', time=2024-09-14T13:58:06.557113+0000, chain.objs.size()=1 2024-09-14T12:44:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.C-xD4N8dX8BobseH2m49XUhZr5_SQ8t_0 2024-09-14T12:44:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14836979367449440497', time=2024-09-14T13:58:07.705837+0000, chain.objs.size()=1 2024-09-14T12:44:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.QiCuSYtB_gNqsfXkUejlSxGrq4SiccR_0 2024-09-14T12:44:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12777029138363860291', time=2024-09-14T13:58:09.538406+0000, chain.objs.size()=1 2024-09-14T12:44:04.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.945+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.C3QUdduklmJnVYDvG6E3B06a6OKkzQC_0 2024-09-14T12:44:04.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1072029007100081995', time=2024-09-14T13:58:13.354262+0000, chain.objs.size()=1 2024-09-14T12:44:04.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.2FHn-w1YlGeZBVR-9zsjBjaS_oOrBBY_0 2024-09-14T12:44:04.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12129856746085285674', time=2024-09-14T13:58:16.195570+0000, chain.objs.size()=1 2024-09-14T12:44:04.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.1kuEUuCNbkY4sNMtyTpLetkdH1uIyO4_0 2024-09-14T12:44:04.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14084095303285267626', time=2024-09-14T13:58:17.810013+0000, chain.objs.size()=1 2024-09-14T12:44:04.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_._eOgqi9SFW1bcdJvSM77fjyYVpwfdcW_0 2024-09-14T12:44:04.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12870324858137145176', time=2024-09-14T13:58:18.246982+0000, chain.objs.size()=1 2024-09-14T12:44:04.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.wb897-hjIFIJgdsJueZPGeCoOhsZag-_0 2024-09-14T12:44:04.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.18152684875994600890', time=2024-09-14T13:58:18.750942+0000, chain.objs.size()=1 2024-09-14T12:44:04.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.rSPWMSG0s20x5DxL0i5H6rL5FCTliU__0 2024-09-14T12:44:04.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3935488881909534992', time=2024-09-14T13:58:21.401198+0000, chain.objs.size()=1 2024-09-14T12:44:04.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ya0MF4bQ717twGqhMIMp8uPmLcfffNn_0 2024-09-14T12:44:04.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.209815658359482635', time=2024-09-14T13:58:22.068375+0000, chain.objs.size()=1 2024-09-14T12:44:04.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.WKDDh7uZeczLAs33ZBeeWpsUM2H-KXS_0 2024-09-14T12:44:04.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6999652351610790821', time=2024-09-14T13:58:22.763563+0000, chain.objs.size()=1 2024-09-14T12:44:04.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.949+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.66cal1T_-zLE-E_ka5cz4dsnuZ6vElu_0 2024-09-14T12:44:04.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.16353907903160167316', time=2024-09-14T13:58:23.908813+0000, chain.objs.size()=1 2024-09-14T12:44:04.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.bIouN588d3HSi0YQhqEtizAX_i_2ka1_0 2024-09-14T12:44:04.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9993636749906483407', time=2024-09-14T13:58:24.879669+0000, chain.objs.size()=1 2024-09-14T12:44:04.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.tHCnUB0maubjrgjcVYOhQZIKhr1MPOR_0 2024-09-14T12:44:04.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9290181224779435597', time=2024-09-14T13:58:25.645654+0000, chain.objs.size()=1 2024-09-14T12:44:04.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.IdsGxFeGvBZuOrPS2Tppumr-etL3DTB_0 2024-09-14T12:44:04.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4634049982918853023', time=2024-09-14T13:58:26.130093+0000, chain.objs.size()=1 2024-09-14T12:44:04.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.ngzJ7ReK4UUnO61x8Dd3Xqnaqf8zGz5_0 2024-09-14T12:44:04.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1536892378533201611', time=2024-09-14T13:58:27.524874+0000, chain.objs.size()=1 2024-09-14T12:44:04.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.7BbjzkjdoDhzPXw1l6eQ7Fwy0PnQnRd_0 2024-09-14T12:44:04.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9581997055473781591', time=2024-09-14T13:58:29.828871+0000, chain.objs.size()=1 2024-09-14T12:44:04.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.953+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.oHGtOmcmkVBigX69QPzDQ0eCtmOj8Wj_0 2024-09-14T12:44:04.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7019885901162658336', time=2024-09-14T13:58:32.124848+0000, chain.objs.size()=1 2024-09-14T12:44:04.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.8WWFn-bt2zbSMkKa_ZIIVUBVISiHs_v_0 2024-09-14T12:44:04.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.918886151988804374', time=2024-09-14T13:58:32.838518+0000, chain.objs.size()=1 2024-09-14T12:44:04.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.KISnL6SEj0FxsAPdBldj-RyRzTeL_Ba_0 2024-09-14T12:44:04.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3890443337609740502', time=2024-09-14T13:58:33.551265+0000, chain.objs.size()=1 2024-09-14T12:44:04.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.eNnBVF_gDifTKMDRIREKHIx3gzNgIT8_0 2024-09-14T12:44:04.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.4496144347902666509', time=2024-09-14T13:58:34.155767+0000, chain.objs.size()=1 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.324__shadow_.HllNTJjL6ASfZdDhPWE5pFejw62nSME_0 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2496519362918483113', time=2024-09-14T14:00:23.020380+0000, chain.objs.size()=1 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.wFPhdxztJqTplRoT-UdTtPi-BC87Wkd_0 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13603851069746723025', time=2024-09-14T14:00:25.051595+0000, chain.objs.size()=1 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.j18I-L-2zADWb7oSazuoBo9_4zAIPMn_0 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9770080011395077005', time=2024-09-14T14:00:25.340182+0000, chain.objs.size()=1 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.NX1NjTwMNw-fwugv7HHmlLuzzWLTyOy_0 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9106689906149482421', time=2024-09-14T14:00:30.690848+0000, chain.objs.size()=1 2024-09-14T12:44:04.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.957+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.UwQNsZ97cPL--nbu2Nt0kQ4_1F9dzng_0 2024-09-14T12:44:04.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.961+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6109012915184661912', time=2024-09-14T14:00:30.881362+0000, chain.objs.size()=1 2024-09-14T12:44:04.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.961+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.MPZEFsSTZtb3WEaq4-uj2blHcVNyHOp_0 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8421488207889076015', time=2024-09-14T14:00:30.994023+0000, chain.objs.size()=1 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.Lu84_pEc-8XEY_EmfwPlV26QIHqwIpt_0 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11133985382932290964', time=2024-09-14T14:00:32.873769+0000, chain.objs.size()=1 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.kMiKu1if8QIXSHtYtjchj5KMXyt_K5M_0 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13242998539102839368', time=2024-09-14T14:00:33.303986+0000, chain.objs.size()=1 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.i3XMnQa9VAl1gRMfPyJPPqgM4tSItts_0 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6143097947886758730', time=2024-09-14T14:00:35.380539+0000, chain.objs.size()=1 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.N_LWZEk5ir7ByIi6ITP7U7RmEurtwFd_0 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11362338033273146677', time=2024-09-14T14:00:36.778428+0000, chain.objs.size()=1 2024-09-14T12:44:04.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.23Fq-35lyDuN7Sz4DZemrGRTFfDcTfM_0 2024-09-14T12:44:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17358881378263759434', time=2024-09-14T14:00:37.781869+0000, chain.objs.size()=1 2024-09-14T12:44:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.fKrfxpbFtfHbw-v2ukrg12qv-1OMgxn_0 2024-09-14T12:44:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12777722712290198407', time=2024-09-14T14:00:40.980182+0000, chain.objs.size()=1 2024-09-14T12:44:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.-X8MpEQ3Ebs2sxeX96yEXsuO6ZHAB1w_0 2024-09-14T12:44:04.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1818772963738672970', time=2024-09-14T14:00:41.488252+0000, chain.objs.size()=1 2024-09-14T12:44:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.zagEyvY2Wjz9CKdQfXHQtFvDO6syPRF_0 2024-09-14T12:44:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2572088621806404322', time=2024-09-14T14:00:42.065074+0000, chain.objs.size()=1 2024-09-14T12:44:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.LRgEYAfoYdqjWM41nRwStfelVCeIEEI_0 2024-09-14T12:44:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17972872994446050979', time=2024-09-14T14:00:44.817345+0000, chain.objs.size()=1 2024-09-14T12:44:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.5kXqp03jX8Aal1PL_5jG-fvW0um5j1G_0 2024-09-14T12:44:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7415788244119702650', time=2024-09-14T14:00:45.305803+0000, chain.objs.size()=1 2024-09-14T12:44:04.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.965+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.0_oovjo_PiE4a4Q1ZPhBDjRqao1lXtB_0 2024-09-14T12:44:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2148112183668114395', time=2024-09-14T14:00:46.296242+0000, chain.objs.size()=1 2024-09-14T12:44:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.IW6v-KnkIGuEMVPtVtEHAZX7sFaFWt4_0 2024-09-14T12:44:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3815732200575384434', time=2024-09-14T14:00:47.004534+0000, chain.objs.size()=1 2024-09-14T12:44:04.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_._Wc7Mk3Ytx-t2KIXE6m8a9QypxnPBTQ_0 2024-09-14T12:44:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.969+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.8116168239357787556', time=2024-09-14T14:00:47.926595+0000, chain.objs.size()=1 2024-09-14T12:44:04.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.969+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.V3wNwKhT1mMiV8xz5I1jfWdGn3ryRQd_0 2024-09-14T12:44:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1262541696574063735', time=2024-09-14T14:00:49.359070+0000, chain.objs.size()=1 2024-09-14T12:44:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.325__shadow_.yryn6wQiblyMWD-_ATNAJpbO6NkTGi__0 2024-09-14T12:44:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12640999237618481076', time=2024-09-14T14:01:07.818707+0000, chain.objs.size()=1 2024-09-14T12:44:04.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.333__shadow_.Fw0Iom7iJ9YvmMqNi7_UC2dne5E1ZOQ_0 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17219732858032844676', time=2024-09-14T14:01:09.517933+0000, chain.objs.size()=1 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.334__shadow_.-DKegSTY0Ugz_sfHFw2GP4bHREvGPna_0 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.6723745272993258071', time=2024-09-14T14:01:18.837418+0000, chain.objs.size()=1 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.338__shadow_.XDIlIpkkZFYHQ634Fnc3NtlY1ihMNvf_0 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3686633662487547195', time=2024-09-14T14:01:34.705228+0000, chain.objs.size()=1 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.345__shadow_.nCURm3dmEo7Z-Ilp2b-bwJFPVCDxwqZ_0 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1434354742382328565', time=2024-09-14T14:02:47.242572+0000, chain.objs.size()=1 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.380__shadow_.XPXDTeGxthzq4xBahto_-rIMbc_3XZ__0 2024-09-14T12:44:04.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.2933540283601720867', time=2024-09-14T14:04:39.820922+0000, chain.objs.size()=1 2024-09-14T12:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.430__shadow_.1MyqFHqU47wHa7n1eHF7PYayNCrMVH2_0 2024-09-14T12:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.1890470010872043270', time=2024-09-14T14:06:46.774003+0000, chain.objs.size()=1 2024-09-14T12:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.484__shadow_.9tERRRNYZl0WPlJUHY9DtEGhg4dNB9N_0 2024-09-14T12:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.12868778717940897024', time=2024-09-14T14:07:07.515230+0000, chain.objs.size()=1 2024-09-14T12:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.490__shadow_.cozKkgJiSK-2QQMb6_GNsuEmdCqZSYG_0 2024-09-14T12:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.5206182765083748892', time=2024-09-14T14:07:38.669458+0000, chain.objs.size()=1 2024-09-14T12:44:04.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.973+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.504__shadow:CRVCgFwmMB1yqxO5U8RjttqtM84H.gl_.-dyH_j79k-7Z8XYotXT1e1-rBoXsavU_0 2024-09-14T12:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.17727887386155565508', time=2024-09-14T14:10:17.502076+0000, chain.objs.size()=6 2024-09-14T12:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~XcX2pbErA4jUGtzr1hPfRYSKd8otE4N.1 2024-09-14T12:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__shadow_mymultipart.2~XcX2pbErA4jUGtzr1hPfRYSKd8otE4N.1_1 2024-09-14T12:44:04.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~XcX2pbErA4jUGtzr1hPfRYSKd8otE4N.2 2024-09-14T12:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__shadow_mymultipart.2~XcX2pbErA4jUGtzr1hPfRYSKd8otE4N.2_1 2024-09-14T12:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__multipart_mymultipart.2~XcX2pbErA4jUGtzr1hPfRYSKd8otE4N.3 2024-09-14T12:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.522__shadow_mymultipart.2~XcX2pbErA4jUGtzr1hPfRYSKd8otE4N.3_1 2024-09-14T12:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3036983024621069788', time=2024-09-14T14:12:03.839048+0000, chain.objs.size()=6 2024-09-14T12:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~aGAJA-12jScjxE_3Dq4IMiCunPKw4Nr.1 2024-09-14T12:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.0FVi_MocsDh4MtMBDD_o50GUc_U1KS7F.2 2024-09-14T12:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~aGAJA-12jScjxE_3Dq4IMiCunPKw4Nr.3 2024-09-14T12:44:04.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.977+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~aGAJA-12jScjxE_3Dq4IMiCunPKw4Nr.4 2024-09-14T12:44:04.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~aGAJA-12jScjxE_3Dq4IMiCunPKw4Nr.5 2024-09-14T12:44:04.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.523__multipart_mymultipart.2~aGAJA-12jScjxE_3Dq4IMiCunPKw4Nr.6 2024-09-14T12:44:04.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.981+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.406303845154306109', time=2024-09-14T14:14:57.416422+0000, chain.objs.size()=3 2024-09-14T12:44:04.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~l741QbN-gwlTP99UYX3GeWU48_2kjFa.1 2024-09-14T12:44:04.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.981+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~l741QbN-gwlTP99UYX3GeWU48_2kjFa.2 2024-09-14T12:44:04.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.526__multipart_mymultipart.2~l741QbN-gwlTP99UYX3GeWU48_2kjFa.3 2024-09-14T12:44:04.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.3484263334511574803', time=2024-09-14T14:17:19.411680+0000, chain.objs.size()=1 2024-09-14T12:44:04.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.551__shadow_.pooiNKx6Y-ue3uc8N-9IkOhkrdMVmW__0 2024-09-14T12:44:04.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='2~79kvjRFM6eQAS2CjXPsePX7h998NJ6J', time=2024-09-14T14:18:49.077084+0000, chain.objs.size()=1 2024-09-14T12:44:04.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.562__multipart_mymultipart.2~79kvjRFM6eQAS2CjXPsePX7h998NJ6J.1 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.297661378467792598', time=2024-09-14T14:19:27.489913+0000, chain.objs.size()=1 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:VN4PCG17.-vMV7dgmf-DhD2q0tH9kvx_.ULLrzYv6wDbYT9T8QL1IRz9kgrN7KsI_0 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14755091719843313432', time=2024-09-14T14:19:42.874160+0000, chain.objs.size()=1 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.570__shadow:pNuRXAjyu6UwlCzk32e3rl-OegQ4cxr_.PSO-Yspy9nKZiQA2MjGvAZefZlhW_aB_0 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.11836957683949872461', time=2024-09-14T14:20:53.526880+0000, chain.objs.size()=1 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.578__shadow:0Cbqx9RD-yhS6Ear7SanLS9dT5fz5WX_.apyXOV1P-XHKa60I9PPbs0UCR9NFyTu_0 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.7800035844417538946', time=2024-09-14T14:22:16.614150+0000, chain.objs.size()=1 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.581__shadow:oyGf-ISpU1S27FbBH8c8mY5OhK2luOv_.8c2cs3P3W1-2iU8fGMX5glYz9K8CNBm_0 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.9455491740148134374', time=2024-09-14T14:22:22.161990+0000, chain.objs.size()=1 2024-09-14T12:44:04.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.584__shadow:dSqZSktLZeKbKe-Z-sefMVJer-C9ych_.v8bd81DDe4tIXKzdUYIveh5iBrZcXcY_0 2024-09-14T12:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.935712425781729545', time=2024-09-14T14:22:37.103842+0000, chain.objs.size()=1 2024-09-14T12:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.588__shadow:KIABxBgBKmMG2ys.fPzI3xXeI-Q.ocL_.rU8G0UArW8e043fAGVJ4G2fHBlqF07B_0 2024-09-14T12:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13292516070558736749', time=2024-09-14T14:31:10.804445+0000, chain.objs.size()=1 2024-09-14T12:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.650__shadow_.NBZ687U2qFm7THxLJBhY3GdPsFDzvbT_0 2024-09-14T12:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.14847725734596965915', time=2024-09-14T14:31:28.906946+0000, chain.objs.size()=1 2024-09-14T12:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.985+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.655__shadow_.MKfDcEwROruxsAd1UfIqKbhXzBMYMpP_0 2024-09-14T12:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.989+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13890116148644857956', time=2024-09-14T14:32:46.836592+0000, chain.objs.size()=1 2024-09-14T12:44:04.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.989+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.667__shadow_.KOaBWzZ52lZd1viOt3XTbOBw27PKWoF_0 2024-09-14T12:44:04.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:04.997+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46292 2024-09-14T12:44:04.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T12:44:04.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.001+0000 7ff7f7f799c0 20 garbage collection: RGWGC::process iterating over entry tag='de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.13872995862712413008', time=2024-09-14T14:39:53.862160+0000, chain.objs.size()=1 2024-09-14T12:44:04.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:de8d1d51-bce5-4d5d-ab2e-644cf6365286.4680.769__shadow_.-9NqmVLCCEuIhp9bxWAJio7YuWhzAiV_0 2024-09-14T12:44:04.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.001+0000 7ff7f7f799c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:44:04.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.005+0000 7ff6a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:44:04.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.005+0000 7ff7f7f799c0 20 remove_watcher() i=0 2024-09-14T12:44:04.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.005+0000 7ff7f7f799c0 2 removed watcher, disabling cache 2024-09-14T12:44:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.005+0000 7ff7f7f799c0 20 remove_watcher() i=1 2024-09-14T12:44:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.009+0000 7ff7f7f799c0 20 remove_watcher() i=2 2024-09-14T12:44:04.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.009+0000 7ff7f7f799c0 20 remove_watcher() i=3 2024-09-14T12:44:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.009+0000 7ff7f7f799c0 20 remove_watcher() i=4 2024-09-14T12:44:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.009+0000 7ff7f7f799c0 20 remove_watcher() i=5 2024-09-14T12:44:05.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.013+0000 7ff7f7f799c0 20 remove_watcher() i=6 2024-09-14T12:44:05.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:05.013+0000 7ff7f7f799c0 20 remove_watcher() i=7 2024-09-14T12:44:05.015 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T12:44:05.026 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-14T12:44:05.062 DEBUG:teuthology.orchestra.run.smithi148:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T12:44:05.109 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-14T12:44:05.153 DEBUG:teuthology.orchestra.run.smithi148:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T12:44:05.202 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-14T12:44:05.257 DEBUG:teuthology.orchestra.run.smithi148:> sudo update-ca-certificates 2024-09-14T12:44:05.313 INFO:teuthology.orchestra.run.smithi148.stdout:Updating certificates in /etc/ssl/certs... 2024-09-14T12:44:05.633 INFO:teuthology.orchestra.run.smithi148.stdout:0 added, 0 removed; done. 2024-09-14T12:44:05.633 INFO:teuthology.orchestra.run.smithi148.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-14T12:44:05.635 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:44:05.819 INFO:teuthology.orchestra.run.smithi148.stdout:done. 2024-09-14T12:44:05.820 INFO:teuthology.orchestra.run.smithi148.stdout:done. 2024-09-14T12:44:05.823 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T12:44:05.833 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T12:44:05.833 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:44:06.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:44:06.224 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T12:44:06.229 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":3711,"stamp":"2024-09-14T12:44:05.142912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":722614847,"num_objects":4778,"num_object_clones":0,"num_object_copies":18082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4778,"num_whiteouts":0,"num_read":312008,"num_read_kb":2588423,"num_write":164013,"num_write_kb":2487467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12825,"ondisk_log_size":12825,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2734784,"kb_used_data":1074892,"kb_used_omap":12,"kb_used_meta":1659699,"kb_avail":752239936,"statfs":{"total":773094113280,"available":770293694464,"internally_reserved":0,"allocated":1100689408,"data_stored":1084273645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1699532336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53624186,"num_objects":-178,"num_object_clones":0,"num_object_copies":-694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-178,"num_whiteouts":0,"num_read":262,"num_read_kb":858,"num_write":215,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008309"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789873+0000","last_change":"2024-09-14T11:40:08.952510+0000","last_active":"2024-09-14T12:40:10.789873+0000","last_peered":"2024-09-14T12:40:10.789873+0000","last_clean":"2024-09-14T12:40:10.789873+0000","last_became_active":"2024-09-14T11:40:08.951795+0000","last_became_peered":"2024-09-14T11:40:08.951795+0000","last_unstale":"2024-09-14T12:40:10.789873+0000","last_undegraded":"2024-09-14T12:40:10.789873+0000","last_fullsized":"2024-09-14T12:40:10.789873+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:34.432945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538895+0000","last_change":"2024-09-14T11:12:26.252261+0000","last_active":"2024-09-14T12:39:55.538895+0000","last_peered":"2024-09-14T12:39:55.538895+0000","last_clean":"2024-09-14T12:39:55.538895+0000","last_became_active":"2024-09-14T11:12:26.251656+0000","last_became_peered":"2024-09-14T11:12:26.251656+0000","last_unstale":"2024-09-14T12:39:55.538895+0000","last_undegraded":"2024-09-14T12:39:55.538895+0000","last_fullsized":"2024-09-14T12:39:55.538895+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:01.924216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731815+0000","last_change":"2024-09-14T11:12:19.109493+0000","last_active":"2024-09-14T12:39:49.731815+0000","last_peered":"2024-09-14T12:39:49.731815+0000","last_clean":"2024-09-14T12:39:49.731815+0000","last_became_active":"2024-09-14T11:12:19.108050+0000","last_became_peered":"2024-09-14T11:12:19.108050+0000","last_unstale":"2024-09-14T12:39:49.731815+0000","last_undegraded":"2024-09-14T12:39:49.731815+0000","last_fullsized":"2024-09-14T12:39:49.731815+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:46.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'28","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.565399+0000","last_change":"2024-09-14T11:06:29.522001+0000","last_active":"2024-09-14T12:40:15.565399+0000","last_peered":"2024-09-14T12:40:15.565399+0000","last_clean":"2024-09-14T12:40:15.565399+0000","last_became_active":"2024-09-14T11:06:29.521269+0000","last_became_peered":"2024-09-14T11:06:29.521269+0000","last_unstale":"2024-09-14T12:40:15.565399+0000","last_undegraded":"2024-09-14T12:40:15.565399+0000","last_fullsized":"2024-09-14T12:40:15.565399+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:36.067094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":165,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537448+0000","last_change":"2024-09-14T11:40:08.947504+0000","last_active":"2024-09-14T12:40:11.537448+0000","last_peered":"2024-09-14T12:40:11.537448+0000","last_clean":"2024-09-14T12:40:11.537448+0000","last_became_active":"2024-09-14T11:40:08.946878+0000","last_became_peered":"2024-09-14T11:40:08.946878+0000","last_unstale":"2024-09-14T12:40:11.537448+0000","last_undegraded":"2024-09-14T12:40:11.537448+0000","last_fullsized":"2024-09-14T12:40:11.537448+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:13.424208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142354+0000","last_change":"2024-09-14T11:12:26.251932+0000","last_active":"2024-09-14T12:39:56.142354+0000","last_peered":"2024-09-14T12:39:56.142354+0000","last_clean":"2024-09-14T12:39:56.142354+0000","last_became_active":"2024-09-14T11:12:26.251518+0000","last_became_peered":"2024-09-14T11:12:26.251518+0000","last_unstale":"2024-09-14T12:39:56.142354+0000","last_undegraded":"2024-09-14T12:39:56.142354+0000","last_fullsized":"2024-09-14T12:39:56.142354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:18.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.549011+0000","last_change":"2024-09-14T11:12:19.078874+0000","last_active":"2024-09-14T12:39:50.549011+0000","last_peered":"2024-09-14T12:39:50.549011+0000","last_clean":"2024-09-14T12:39:50.549011+0000","last_became_active":"2024-09-14T11:12:19.078164+0000","last_became_peered":"2024-09-14T11:12:19.078164+0000","last_unstale":"2024-09-14T12:39:50.549011+0000","last_undegraded":"2024-09-14T12:39:50.549011+0000","last_fullsized":"2024-09-14T12:39:50.549011+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:07.851997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'14","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.573976+0000","last_change":"2024-09-14T11:06:29.539883+0000","last_active":"2024-09-14T12:40:55.573976+0000","last_peered":"2024-09-14T12:40:55.573976+0000","last_clean":"2024-09-14T12:40:55.573976+0000","last_became_active":"2024-09-14T11:06:29.538616+0000","last_became_peered":"2024-09-14T11:06:29.538616+0000","last_unstale":"2024-09-14T12:40:55.573976+0000","last_undegraded":"2024-09-14T12:40:55.573976+0000","last_fullsized":"2024-09-14T12:40:55.573976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:48.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":63,"num_write":44,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.548159+0000","last_change":"2024-09-14T11:40:08.943797+0000","last_active":"2024-09-14T12:40:35.548159+0000","last_peered":"2024-09-14T12:40:35.548159+0000","last_clean":"2024-09-14T12:40:35.548159+0000","last_became_active":"2024-09-14T11:40:08.942721+0000","last_became_peered":"2024-09-14T11:40:08.942721+0000","last_unstale":"2024-09-14T12:40:35.548159+0000","last_undegraded":"2024-09-14T12:40:35.548159+0000","last_fullsized":"2024-09-14T12:40:35.548159+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:17.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550343+0000","last_change":"2024-09-14T11:12:26.228979+0000","last_active":"2024-09-14T12:39:55.550343+0000","last_peered":"2024-09-14T12:39:55.550343+0000","last_clean":"2024-09-14T12:39:55.550343+0000","last_became_active":"2024-09-14T11:12:26.228172+0000","last_became_peered":"2024-09-14T11:12:26.228172+0000","last_unstale":"2024-09-14T12:39:55.550343+0000","last_undegraded":"2024-09-14T12:39:55.550343+0000","last_fullsized":"2024-09-14T12:39:55.550343+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:34.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:34.769431+0000","last_change":"2024-09-14T11:12:19.111973+0000","last_active":"2024-09-14T12:42:34.769431+0000","last_peered":"2024-09-14T12:42:34.769431+0000","last_clean":"2024-09-14T12:42:34.769431+0000","last_became_active":"2024-09-14T11:12:19.110542+0000","last_became_peered":"2024-09-14T11:12:19.110542+0000","last_unstale":"2024-09-14T12:42:34.769431+0000","last_undegraded":"2024-09-14T12:42:34.769431+0000","last_fullsized":"2024-09-14T12:42:34.769431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.885368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555139+0000","last_change":"2024-09-14T11:06:29.532390+0000","last_active":"2024-09-14T12:41:31.555139+0000","last_peered":"2024-09-14T12:41:31.555139+0000","last_clean":"2024-09-14T12:41:31.555139+0000","last_became_active":"2024-09-14T11:06:29.531655+0000","last_became_peered":"2024-09-14T11:06:29.531655+0000","last_unstale":"2024-09-14T12:41:31.555139+0000","last_undegraded":"2024-09-14T12:41:31.555139+0000","last_fullsized":"2024-09-14T12:41:31.555139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:15.026446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":194,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563239+0000","last_change":"2024-09-14T11:40:08.940194+0000","last_active":"2024-09-14T12:40:50.563239+0000","last_peered":"2024-09-14T12:40:50.563239+0000","last_clean":"2024-09-14T12:40:50.563239+0000","last_became_active":"2024-09-14T11:40:08.939509+0000","last_became_peered":"2024-09-14T11:40:08.939509+0000","last_unstale":"2024-09-14T12:40:50.563239+0000","last_undegraded":"2024-09-14T12:40:50.563239+0000","last_fullsized":"2024-09-14T12:40:50.563239+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:14.099727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.562210+0000","last_change":"2024-09-14T11:12:26.231260+0000","last_active":"2024-09-14T12:40:45.562210+0000","last_peered":"2024-09-14T12:40:45.562210+0000","last_clean":"2024-09-14T12:40:45.562210+0000","last_became_active":"2024-09-14T11:12:26.230403+0000","last_became_peered":"2024-09-14T11:12:26.230403+0000","last_unstale":"2024-09-14T12:40:45.562210+0000","last_undegraded":"2024-09-14T12:40:45.562210+0000","last_fullsized":"2024-09-14T12:40:45.562210+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:41.167301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5823147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":7282,"num_write":9,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"267'1","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568418+0000","last_change":"2024-09-14T11:12:19.105819+0000","last_active":"2024-09-14T12:41:55.568418+0000","last_peered":"2024-09-14T12:41:55.568418+0000","last_clean":"2024-09-14T12:41:55.568418+0000","last_became_active":"2024-09-14T11:12:19.105062+0000","last_became_peered":"2024-09-14T11:12:19.105062+0000","last_unstale":"2024-09-14T12:41:55.568418+0000","last_undegraded":"2024-09-14T12:41:55.568418+0000","last_fullsized":"2024-09-14T12:41:55.568418+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:15.694200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'12","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555085+0000","last_change":"2024-09-14T11:06:29.510354+0000","last_active":"2024-09-14T12:41:31.555085+0000","last_peered":"2024-09-14T12:41:31.555085+0000","last_clean":"2024-09-14T12:41:31.555085+0000","last_became_active":"2024-09-14T11:06:29.509556+0000","last_became_peered":"2024-09-14T11:06:29.509556+0000","last_unstale":"2024-09-14T12:41:31.555085+0000","last_undegraded":"2024-09-14T12:41:31.555085+0000","last_fullsized":"2024-09-14T12:41:31.555085+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:51.904786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:19.738657+0000","last_change":"2024-09-14T11:40:08.932176+0000","last_active":"2024-09-14T12:40:19.738657+0000","last_peered":"2024-09-14T12:40:19.738657+0000","last_clean":"2024-09-14T12:40:19.738657+0000","last_became_active":"2024-09-14T11:40:08.927702+0000","last_became_peered":"2024-09-14T11:40:08.927702+0000","last_unstale":"2024-09-14T12:40:19.738657+0000","last_undegraded":"2024-09-14T12:40:19.738657+0000","last_fullsized":"2024-09-14T12:40:19.738657+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:31.907550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782814+0000","last_change":"2024-09-14T11:12:26.219704+0000","last_active":"2024-09-14T12:39:40.782814+0000","last_peered":"2024-09-14T12:39:40.782814+0000","last_clean":"2024-09-14T12:39:40.782814+0000","last_became_active":"2024-09-14T11:12:26.218925+0000","last_became_peered":"2024-09-14T11:12:26.218925+0000","last_unstale":"2024-09-14T12:39:40.782814+0000","last_undegraded":"2024-09-14T12:39:40.782814+0000","last_fullsized":"2024-09-14T12:39:40.782814+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:12.358912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.541766+0000","last_change":"2024-09-14T11:12:19.111180+0000","last_active":"2024-09-14T12:39:20.541766+0000","last_peered":"2024-09-14T12:39:20.541766+0000","last_clean":"2024-09-14T12:39:20.541766+0000","last_became_active":"2024-09-14T11:12:19.110528+0000","last_became_peered":"2024-09-14T11:12:19.110528+0000","last_unstale":"2024-09-14T12:39:20.541766+0000","last_undegraded":"2024-09-14T12:39:20.541766+0000","last_fullsized":"2024-09-14T12:39:20.541766+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:53.395221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1028,"num_write":3,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'15","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555023+0000","last_change":"2024-09-14T11:06:29.539444+0000","last_active":"2024-09-14T12:41:31.555023+0000","last_peered":"2024-09-14T12:41:31.555023+0000","last_clean":"2024-09-14T12:41:31.555023+0000","last_became_active":"2024-09-14T11:06:29.538597+0000","last_became_peered":"2024-09-14T11:06:29.538597+0000","last_unstale":"2024-09-14T12:41:31.555023+0000","last_undegraded":"2024-09-14T12:41:31.555023+0000","last_fullsized":"2024-09-14T12:41:31.555023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:42.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569608+0000","last_change":"2024-09-14T11:40:08.925877+0000","last_active":"2024-09-14T12:40:35.569608+0000","last_peered":"2024-09-14T12:40:35.569608+0000","last_clean":"2024-09-14T12:40:35.569608+0000","last_became_active":"2024-09-14T11:40:08.924934+0000","last_became_peered":"2024-09-14T11:40:08.924934+0000","last_unstale":"2024-09-14T12:40:35.569608+0000","last_undegraded":"2024-09-14T12:40:35.569608+0000","last_fullsized":"2024-09-14T12:40:35.569608+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:38.137144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:26.465943+0000","last_change":"2024-09-14T11:12:26.246400+0000","last_active":"2024-09-14T12:39:26.465943+0000","last_peered":"2024-09-14T12:39:26.465943+0000","last_clean":"2024-09-14T12:39:26.465943+0000","last_became_active":"2024-09-14T11:12:26.245890+0000","last_became_peered":"2024-09-14T11:12:26.245890+0000","last_unstale":"2024-09-14T12:39:26.465943+0000","last_undegraded":"2024-09-14T12:39:26.465943+0000","last_fullsized":"2024-09-14T12:39:26.465943+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:48.151101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468681+0000","last_change":"2024-09-14T11:12:19.109400+0000","last_active":"2024-09-14T12:39:36.468681+0000","last_peered":"2024-09-14T12:39:36.468681+0000","last_clean":"2024-09-14T12:39:36.468681+0000","last_became_active":"2024-09-14T11:12:19.108158+0000","last_became_peered":"2024-09-14T11:12:19.108158+0000","last_unstale":"2024-09-14T12:39:36.468681+0000","last_undegraded":"2024-09-14T12:39:36.468681+0000","last_fullsized":"2024-09-14T12:39:36.468681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:12.518068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'13","reported_seq":104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164957+0000","last_change":"2024-09-14T11:06:29.529584+0000","last_active":"2024-09-14T12:41:31.164957+0000","last_peered":"2024-09-14T12:41:31.164957+0000","last_clean":"2024-09-14T12:41:31.164957+0000","last_became_active":"2024-09-14T11:06:29.525271+0000","last_became_peered":"2024-09-14T11:06:29.525271+0000","last_unstale":"2024-09-14T12:41:31.164957+0000","last_undegraded":"2024-09-14T12:41:31.164957+0000","last_fullsized":"2024-09-14T12:41:31.164957+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:48.747370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.145918+0000","last_change":"2024-09-14T11:40:08.929934+0000","last_active":"2024-09-14T12:40:11.145918+0000","last_peered":"2024-09-14T12:40:11.145918+0000","last_clean":"2024-09-14T12:40:11.145918+0000","last_became_active":"2024-09-14T11:40:08.928406+0000","last_became_peered":"2024-09-14T11:40:08.928406+0000","last_unstale":"2024-09-14T12:40:11.145918+0000","last_undegraded":"2024-09-14T12:40:11.145918+0000","last_fullsized":"2024-09-14T12:40:11.145918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:59.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142297+0000","last_change":"2024-09-14T11:12:26.241901+0000","last_active":"2024-09-14T12:39:56.142297+0000","last_peered":"2024-09-14T12:39:56.142297+0000","last_clean":"2024-09-14T12:39:56.142297+0000","last_became_active":"2024-09-14T11:12:26.241189+0000","last_became_peered":"2024-09-14T11:12:26.241189+0000","last_unstale":"2024-09-14T12:39:56.142297+0000","last_undegraded":"2024-09-14T12:39:56.142297+0000","last_fullsized":"2024-09-14T12:39:56.142297+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:26.882785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.785157+0000","last_change":"2024-09-14T11:12:19.090881+0000","last_active":"2024-09-14T12:39:50.785157+0000","last_peered":"2024-09-14T12:39:50.785157+0000","last_clean":"2024-09-14T12:39:50.785157+0000","last_became_active":"2024-09-14T11:12:19.090134+0000","last_became_peered":"2024-09-14T11:12:19.090134+0000","last_unstale":"2024-09-14T12:39:50.785157+0000","last_undegraded":"2024-09-14T12:39:50.785157+0000","last_fullsized":"2024-09-14T12:39:50.785157+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.751661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195178,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'175","reported_seq":578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:59.747524+0000","last_change":"2024-09-14T11:06:29.533832+0000","last_active":"2024-09-14T12:40:59.747524+0000","last_peered":"2024-09-14T12:40:59.747524+0000","last_clean":"2024-09-14T12:40:59.747524+0000","last_became_active":"2024-09-14T11:06:29.531149+0000","last_became_peered":"2024-09-14T11:06:29.531149+0000","last_unstale":"2024-09-14T12:40:59.747524+0000","last_undegraded":"2024-09-14T12:40:59.747524+0000","last_fullsized":"2024-09-14T12:40:59.747524+0000","mapping_epoch":256,"log_start":"264'100","ondisk_log_start":"264'100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:45.535262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1578,"num_read_kb":1327,"num_write":388,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789984+0000","last_change":"2024-09-14T11:40:08.942903+0000","last_active":"2024-09-14T12:40:10.789984+0000","last_peered":"2024-09-14T12:40:10.789984+0000","last_clean":"2024-09-14T12:40:10.789984+0000","last_became_active":"2024-09-14T11:40:08.942208+0000","last_became_peered":"2024-09-14T11:40:08.942208+0000","last_unstale":"2024-09-14T12:40:10.789984+0000","last_undegraded":"2024-09-14T12:40:10.789984+0000","last_fullsized":"2024-09-14T12:40:10.789984+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:07.315198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.768253+0000","last_change":"2024-09-14T11:12:26.236668+0000","last_active":"2024-09-14T12:42:29.768253+0000","last_peered":"2024-09-14T12:42:29.768253+0000","last_clean":"2024-09-14T12:42:29.768253+0000","last_became_active":"2024-09-14T11:12:26.236221+0000","last_became_peered":"2024-09-14T11:12:26.236221+0000","last_unstale":"2024-09-14T12:42:29.768253+0000","last_undegraded":"2024-09-14T12:42:29.768253+0000","last_fullsized":"2024-09-14T12:42:29.768253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.780862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532656+0000","last_change":"2024-09-14T11:12:19.087602+0000","last_active":"2024-09-14T12:39:51.532656+0000","last_peered":"2024-09-14T12:39:51.532656+0000","last_clean":"2024-09-14T12:39:51.532656+0000","last_became_active":"2024-09-14T11:12:19.086765+0000","last_became_peered":"2024-09-14T11:12:19.086765+0000","last_unstale":"2024-09-14T12:39:51.532656+0000","last_undegraded":"2024-09-14T12:39:51.532656+0000","last_fullsized":"2024-09-14T12:39:51.532656+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.252636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.545007+0000","last_change":"2024-09-14T11:06:29.518739+0000","last_active":"2024-09-14T12:40:46.545007+0000","last_peered":"2024-09-14T12:40:46.545007+0000","last_clean":"2024-09-14T12:40:46.545007+0000","last_became_active":"2024-09-14T11:06:29.518028+0000","last_became_peered":"2024-09-14T11:06:29.518028+0000","last_unstale":"2024-09-14T12:40:46.545007+0000","last_undegraded":"2024-09-14T12:40:46.545007+0000","last_fullsized":"2024-09-14T12:40:46.545007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:31.356112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":96,"num_write":55,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563311+0000","last_change":"2024-09-14T11:40:08.953653+0000","last_active":"2024-09-14T12:40:50.563311+0000","last_peered":"2024-09-14T12:40:50.563311+0000","last_clean":"2024-09-14T12:40:50.563311+0000","last_became_active":"2024-09-14T11:40:08.953030+0000","last_became_peered":"2024-09-14T11:40:08.953030+0000","last_unstale":"2024-09-14T12:40:50.563311+0000","last_undegraded":"2024-09-14T12:40:50.563311+0000","last_fullsized":"2024-09-14T12:40:50.563311+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:54.553294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:29.727366+0000","last_change":"2024-09-14T11:12:26.248644+0000","last_active":"2024-09-14T12:39:29.727366+0000","last_peered":"2024-09-14T12:39:29.727366+0000","last_clean":"2024-09-14T12:39:29.727366+0000","last_became_active":"2024-09-14T11:12:26.247784+0000","last_became_peered":"2024-09-14T11:12:26.247784+0000","last_unstale":"2024-09-14T12:39:29.727366+0000","last_undegraded":"2024-09-14T12:39:29.727366+0000","last_fullsized":"2024-09-14T12:39:29.727366+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:06.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494251+0000","last_change":"2024-09-14T11:12:19.114678+0000","last_active":"2024-09-14T12:41:16.494251+0000","last_peered":"2024-09-14T12:41:16.494251+0000","last_clean":"2024-09-14T12:41:16.494251+0000","last_became_active":"2024-09-14T11:12:19.113431+0000","last_became_peered":"2024-09-14T11:12:19.113431+0000","last_unstale":"2024-09-14T12:41:16.494251+0000","last_undegraded":"2024-09-14T12:41:16.494251+0000","last_fullsized":"2024-09-14T12:41:16.494251+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:46.474061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7166,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'46","reported_seq":197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571890+0000","last_change":"2024-09-14T11:06:29.532883+0000","last_active":"2024-09-14T12:40:45.571890+0000","last_peered":"2024-09-14T12:40:45.571890+0000","last_clean":"2024-09-14T12:40:45.571890+0000","last_became_active":"2024-09-14T11:06:29.532061+0000","last_became_peered":"2024-09-14T11:06:29.532061+0000","last_unstale":"2024-09-14T12:40:45.571890+0000","last_undegraded":"2024-09-14T12:40:45.571890+0000","last_fullsized":"2024-09-14T12:40:45.571890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:13.641002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":235,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.546149+0000","last_change":"2024-09-14T11:40:08.938546+0000","last_active":"2024-09-14T12:40:51.546149+0000","last_peered":"2024-09-14T12:40:51.546149+0000","last_clean":"2024-09-14T12:40:51.546149+0000","last_became_active":"2024-09-14T11:40:08.937813+0000","last_became_peered":"2024-09-14T11:40:08.937813+0000","last_unstale":"2024-09-14T12:40:51.546149+0000","last_undegraded":"2024-09-14T12:40:51.546149+0000","last_fullsized":"2024-09-14T12:40:51.546149+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:07.510647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.571681+0000","last_change":"2024-09-14T11:12:26.244350+0000","last_active":"2024-09-14T12:41:25.571681+0000","last_peered":"2024-09-14T12:41:25.571681+0000","last_clean":"2024-09-14T12:41:25.571681+0000","last_became_active":"2024-09-14T11:12:26.243612+0000","last_became_peered":"2024-09-14T11:12:26.243612+0000","last_unstale":"2024-09-14T12:41:25.571681+0000","last_undegraded":"2024-09-14T12:41:25.571681+0000","last_fullsized":"2024-09-14T12:41:25.571681+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.954445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14684160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":15364,"num_write":17,"num_write_kb":14340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.778500+0000","last_change":"2024-09-14T11:12:19.104603+0000","last_active":"2024-09-14T12:39:20.778500+0000","last_peered":"2024-09-14T12:39:20.778500+0000","last_clean":"2024-09-14T12:39:20.778500+0000","last_became_active":"2024-09-14T11:12:19.103871+0000","last_became_peered":"2024-09-14T11:12:19.103871+0000","last_unstale":"2024-09-14T12:39:20.778500+0000","last_undegraded":"2024-09-14T12:39:20.778500+0000","last_fullsized":"2024-09-14T12:39:20.778500+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:11.319272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'29","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571849+0000","last_change":"2024-09-14T11:06:29.530922+0000","last_active":"2024-09-14T12:40:45.571849+0000","last_peered":"2024-09-14T12:40:45.571849+0000","last_clean":"2024-09-14T12:40:45.571849+0000","last_became_active":"2024-09-14T11:06:29.529421+0000","last_became_peered":"2024-09-14T11:06:29.529421+0000","last_unstale":"2024-09-14T12:40:45.571849+0000","last_undegraded":"2024-09-14T12:40:45.571849+0000","last_fullsized":"2024-09-14T12:40:45.571849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:42.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":129,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.155363+0000","last_change":"2024-09-14T11:40:08.944753+0000","last_active":"2024-09-14T12:40:51.155363+0000","last_peered":"2024-09-14T12:40:51.155363+0000","last_clean":"2024-09-14T12:40:51.155363+0000","last_became_active":"2024-09-14T11:40:08.944066+0000","last_became_peered":"2024-09-14T11:40:08.944066+0000","last_unstale":"2024-09-14T12:40:51.155363+0000","last_undegraded":"2024-09-14T12:40:51.155363+0000","last_fullsized":"2024-09-14T12:40:51.155363+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:51.071467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:29.727468+0000","last_change":"2024-09-14T11:12:26.225753+0000","last_active":"2024-09-14T12:39:29.727468+0000","last_peered":"2024-09-14T12:39:29.727468+0000","last_clean":"2024-09-14T12:39:29.727468+0000","last_became_active":"2024-09-14T11:12:26.224877+0000","last_became_peered":"2024-09-14T11:12:26.224877+0000","last_unstale":"2024-09-14T12:39:29.727468+0000","last_undegraded":"2024-09-14T12:39:29.727468+0000","last_fullsized":"2024-09-14T12:39:29.727468+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:14.000285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'11","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.953503+0000","last_change":"2024-09-14T11:12:19.108246+0000","last_active":"2024-09-14T12:44:02.953503+0000","last_peered":"2024-09-14T12:44:02.953503+0000","last_clean":"2024-09-14T12:44:02.953503+0000","last_became_active":"2024-09-14T11:12:19.107563+0000","last_became_peered":"2024-09-14T11:12:19.107563+0000","last_unstale":"2024-09-14T12:44:02.953503+0000","last_undegraded":"2024-09-14T12:44:02.953503+0000","last_fullsized":"2024-09-14T12:44:02.953503+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9259,"num_write":16,"num_write_kb":6185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'15","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:44.744075+0000","last_change":"2024-09-14T11:06:29.535035+0000","last_active":"2024-09-14T12:40:44.744075+0000","last_peered":"2024-09-14T12:40:44.744075+0000","last_clean":"2024-09-14T12:40:44.744075+0000","last_became_active":"2024-09-14T11:06:29.534316+0000","last_became_peered":"2024-09-14T11:06:29.534316+0000","last_unstale":"2024-09-14T12:40:44.744075+0000","last_undegraded":"2024-09-14T12:40:44.744075+0000","last_fullsized":"2024-09-14T12:40:44.744075+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.975045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":71,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.798963+0000","last_change":"2024-09-14T11:40:08.945904+0000","last_active":"2024-09-14T12:40:50.798963+0000","last_peered":"2024-09-14T12:40:50.798963+0000","last_clean":"2024-09-14T12:40:50.798963+0000","last_became_active":"2024-09-14T11:40:08.945227+0000","last_became_peered":"2024-09-14T11:40:08.945227+0000","last_unstale":"2024-09-14T12:40:50.798963+0000","last_undegraded":"2024-09-14T12:40:50.798963+0000","last_fullsized":"2024-09-14T12:40:50.798963+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:52.335465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:25.779815+0000","last_change":"2024-09-14T11:12:26.239562+0000","last_active":"2024-09-14T12:39:25.779815+0000","last_peered":"2024-09-14T12:39:25.779815+0000","last_clean":"2024-09-14T12:39:25.779815+0000","last_became_active":"2024-09-14T11:12:26.238844+0000","last_became_peered":"2024-09-14T11:12:26.238844+0000","last_unstale":"2024-09-14T12:39:25.779815+0000","last_undegraded":"2024-09-14T12:39:25.779815+0000","last_fullsized":"2024-09-14T12:39:25.779815+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:15.939265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.541990+0000","last_change":"2024-09-14T11:12:19.074095+0000","last_active":"2024-09-14T12:39:20.541990+0000","last_peered":"2024-09-14T12:39:20.541990+0000","last_clean":"2024-09-14T12:39:20.541990+0000","last_became_active":"2024-09-14T11:12:19.072275+0000","last_became_peered":"2024-09-14T11:12:19.072275+0000","last_unstale":"2024-09-14T12:39:20.541990+0000","last_undegraded":"2024-09-14T12:39:20.541990+0000","last_fullsized":"2024-09-14T12:39:20.541990+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:16.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'30","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476064+0000","last_change":"2024-09-14T11:06:29.519394+0000","last_active":"2024-09-14T12:40:06.476064+0000","last_peered":"2024-09-14T12:40:06.476064+0000","last_clean":"2024-09-14T12:40:06.476064+0000","last_became_active":"2024-09-14T11:06:29.518650+0000","last_became_peered":"2024-09-14T11:06:29.518650+0000","last_unstale":"2024-09-14T12:40:06.476064+0000","last_undegraded":"2024-09-14T12:40:06.476064+0000","last_fullsized":"2024-09-14T12:40:06.476064+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.316442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":172,"num_write":81,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559828+0000","last_change":"2024-09-14T11:40:08.951327+0000","last_active":"2024-09-14T12:40:35.559828+0000","last_peered":"2024-09-14T12:40:35.559828+0000","last_clean":"2024-09-14T12:40:35.559828+0000","last_became_active":"2024-09-14T11:40:08.950670+0000","last_became_peered":"2024-09-14T11:40:08.950670+0000","last_unstale":"2024-09-14T12:40:35.559828+0000","last_undegraded":"2024-09-14T12:40:35.559828+0000","last_fullsized":"2024-09-14T12:40:35.559828+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:02.634753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'3","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566775+0000","last_change":"2024-09-14T11:12:26.228814+0000","last_active":"2024-09-14T12:41:05.566775+0000","last_peered":"2024-09-14T12:41:05.566775+0000","last_clean":"2024-09-14T12:41:05.566775+0000","last_became_active":"2024-09-14T11:12:26.227851+0000","last_became_peered":"2024-09-14T11:12:26.227851+0000","last_unstale":"2024-09-14T12:41:05.566775+0000","last_undegraded":"2024-09-14T12:41:05.566775+0000","last_fullsized":"2024-09-14T12:41:05.566775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:46.796979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.553829+0000","last_change":"2024-09-14T11:12:19.092586+0000","last_active":"2024-09-14T12:41:00.553829+0000","last_peered":"2024-09-14T12:41:00.553829+0000","last_clean":"2024-09-14T12:41:00.553829+0000","last_became_active":"2024-09-14T11:12:19.091893+0000","last_became_peered":"2024-09-14T11:12:19.091893+0000","last_unstale":"2024-09-14T12:41:00.553829+0000","last_undegraded":"2024-09-14T12:41:00.553829+0000","last_fullsized":"2024-09-14T12:41:00.553829+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:18.606010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'35","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.472861+0000","last_change":"2024-09-14T11:06:29.548605+0000","last_active":"2024-09-14T12:39:51.472861+0000","last_peered":"2024-09-14T12:39:51.472861+0000","last_clean":"2024-09-14T12:39:51.472861+0000","last_became_active":"2024-09-14T11:06:29.545575+0000","last_became_peered":"2024-09-14T11:06:29.545575+0000","last_unstale":"2024-09-14T12:39:51.472861+0000","last_undegraded":"2024-09-14T12:39:51.472861+0000","last_fullsized":"2024-09-14T12:39:51.472861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:04.244766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":183,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543115+0000","last_change":"2024-09-14T11:40:08.926123+0000","last_active":"2024-09-14T12:40:36.543115+0000","last_peered":"2024-09-14T12:40:36.543115+0000","last_clean":"2024-09-14T12:40:36.543115+0000","last_became_active":"2024-09-14T11:40:08.925358+0000","last_became_peered":"2024-09-14T11:40:08.925358+0000","last_unstale":"2024-09-14T12:40:36.543115+0000","last_undegraded":"2024-09-14T12:40:36.543115+0000","last_fullsized":"2024-09-14T12:40:36.543115+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:25.296629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566691+0000","last_change":"2024-09-14T11:12:26.247421+0000","last_active":"2024-09-14T12:41:05.566691+0000","last_peered":"2024-09-14T12:41:05.566691+0000","last_clean":"2024-09-14T12:41:05.566691+0000","last_became_active":"2024-09-14T11:12:26.246881+0000","last_became_peered":"2024-09-14T11:12:26.246881+0000","last_unstale":"2024-09-14T12:41:05.566691+0000","last_undegraded":"2024-09-14T12:41:05.566691+0000","last_fullsized":"2024-09-14T12:41:05.566691+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:19.198573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.565548+0000","last_change":"2024-09-14T11:12:19.096545+0000","last_active":"2024-09-14T12:41:00.565548+0000","last_peered":"2024-09-14T12:41:00.565548+0000","last_clean":"2024-09-14T12:41:00.565548+0000","last_became_active":"2024-09-14T11:12:19.095821+0000","last_became_peered":"2024-09-14T11:12:19.095821+0000","last_unstale":"2024-09-14T12:41:00.565548+0000","last_undegraded":"2024-09-14T12:41:00.565548+0000","last_fullsized":"2024-09-14T12:41:00.565548+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:19.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4663,"num_write":3,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'26","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731762+0000","last_change":"2024-09-14T11:06:29.533209+0000","last_active":"2024-09-14T12:39:49.731762+0000","last_peered":"2024-09-14T12:39:49.731762+0000","last_clean":"2024-09-14T12:39:49.731762+0000","last_became_active":"2024-09-14T11:06:29.529753+0000","last_became_peered":"2024-09-14T11:06:29.529753+0000","last_unstale":"2024-09-14T12:39:49.731762+0000","last_undegraded":"2024-09-14T12:39:49.731762+0000","last_fullsized":"2024-09-14T12:39:49.731762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:45.017988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.576092+0000","last_change":"2024-09-14T11:40:08.925501+0000","last_active":"2024-09-14T12:41:05.576092+0000","last_peered":"2024-09-14T12:41:05.576092+0000","last_clean":"2024-09-14T12:41:05.576092+0000","last_became_active":"2024-09-14T11:40:08.924726+0000","last_became_peered":"2024-09-14T11:40:08.924726+0000","last_unstale":"2024-09-14T12:41:05.576092+0000","last_undegraded":"2024-09-14T12:41:05.576092+0000","last_fullsized":"2024-09-14T12:41:05.576092+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:22.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:09.749817+0000","last_change":"2024-09-14T11:12:26.219990+0000","last_active":"2024-09-14T12:41:09.749817+0000","last_peered":"2024-09-14T12:41:09.749817+0000","last_clean":"2024-09-14T12:41:09.749817+0000","last_became_active":"2024-09-14T11:12:26.219169+0000","last_became_peered":"2024-09-14T11:12:26.219169+0000","last_unstale":"2024-09-14T12:41:09.749817+0000","last_undegraded":"2024-09-14T12:41:09.749817+0000","last_fullsized":"2024-09-14T12:41:09.749817+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:09.344730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"267'8","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.553945+0000","last_change":"2024-09-14T11:12:19.099929+0000","last_active":"2024-09-14T12:41:00.553945+0000","last_peered":"2024-09-14T12:41:00.553945+0000","last_clean":"2024-09-14T12:41:00.553945+0000","last_became_active":"2024-09-14T11:12:19.099233+0000","last_became_peered":"2024-09-14T11:12:19.099233+0000","last_unstale":"2024-09-14T12:41:00.553945+0000","last_undegraded":"2024-09-14T12:41:00.553945+0000","last_fullsized":"2024-09-14T12:41:00.553945+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:44.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2113536,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":8230,"num_write":8,"num_write_kb":6172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'35","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140567+0000","last_change":"2024-09-14T11:06:29.524243+0000","last_active":"2024-09-14T12:39:51.140567+0000","last_peered":"2024-09-14T12:39:51.140567+0000","last_clean":"2024-09-14T12:39:51.140567+0000","last_became_active":"2024-09-14T11:06:29.508842+0000","last_became_peered":"2024-09-14T11:06:29.508842+0000","last_unstale":"2024-09-14T12:39:51.140567+0000","last_undegraded":"2024-09-14T12:39:51.140567+0000","last_fullsized":"2024-09-14T12:39:51.140567+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:47.904384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":189,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543061+0000","last_change":"2024-09-14T11:40:08.945136+0000","last_active":"2024-09-14T12:40:36.543061+0000","last_peered":"2024-09-14T12:40:36.543061+0000","last_clean":"2024-09-14T12:40:36.543061+0000","last_became_active":"2024-09-14T11:40:08.944382+0000","last_became_peered":"2024-09-14T11:40:08.944382+0000","last_unstale":"2024-09-14T12:40:36.543061+0000","last_undegraded":"2024-09-14T12:40:36.543061+0000","last_fullsized":"2024-09-14T12:40:36.543061+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:00.265362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.491464+0000","last_change":"2024-09-14T11:12:26.238084+0000","last_active":"2024-09-14T12:41:06.491464+0000","last_peered":"2024-09-14T12:41:06.491464+0000","last_clean":"2024-09-14T12:41:06.491464+0000","last_became_active":"2024-09-14T11:12:26.232336+0000","last_became_peered":"2024-09-14T11:12:26.232336+0000","last_unstale":"2024-09-14T12:41:06.491464+0000","last_undegraded":"2024-09-14T12:41:06.491464+0000","last_fullsized":"2024-09-14T12:41:06.491464+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:24.342020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4970,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12288,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.554012+0000","last_change":"2024-09-14T11:12:19.093047+0000","last_active":"2024-09-14T12:41:00.554012+0000","last_peered":"2024-09-14T12:41:00.554012+0000","last_clean":"2024-09-14T12:41:00.554012+0000","last_became_active":"2024-09-14T11:12:19.092223+0000","last_became_peered":"2024-09-14T11:12:19.092223+0000","last_unstale":"2024-09-14T12:41:00.554012+0000","last_undegraded":"2024-09-14T12:41:00.554012+0000","last_fullsized":"2024-09-14T12:41:00.554012+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:48.559915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2056,"num_write":3,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'19","reported_seq":117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731645+0000","last_change":"2024-09-14T11:06:29.533456+0000","last_active":"2024-09-14T12:39:49.731645+0000","last_peered":"2024-09-14T12:39:49.731645+0000","last_clean":"2024-09-14T12:39:49.731645+0000","last_became_active":"2024-09-14T11:06:29.530722+0000","last_became_peered":"2024-09-14T11:06:29.530722+0000","last_unstale":"2024-09-14T12:39:49.731645+0000","last_undegraded":"2024-09-14T12:39:49.731645+0000","last_fullsized":"2024-09-14T12:39:49.731645+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:40.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":48,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566854+0000","last_change":"2024-09-14T11:40:08.948425+0000","last_active":"2024-09-14T12:41:05.566854+0000","last_peered":"2024-09-14T12:41:05.566854+0000","last_clean":"2024-09-14T12:41:05.566854+0000","last_became_active":"2024-09-14T11:40:08.947725+0000","last_became_peered":"2024-09-14T11:40:08.947725+0000","last_unstale":"2024-09-14T12:41:05.566854+0000","last_undegraded":"2024-09-14T12:41:05.566854+0000","last_fullsized":"2024-09-14T12:41:05.566854+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:01.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737522+0000","last_change":"2024-09-14T11:12:26.233658+0000","last_active":"2024-09-14T12:40:14.737522+0000","last_peered":"2024-09-14T12:40:14.737522+0000","last_clean":"2024-09-14T12:40:14.737522+0000","last_became_active":"2024-09-14T11:12:26.233006+0000","last_became_peered":"2024-09-14T11:12:26.233006+0000","last_unstale":"2024-09-14T12:40:14.737522+0000","last_undegraded":"2024-09-14T12:40:14.737522+0000","last_fullsized":"2024-09-14T12:40:14.737522+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:29.000670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"267'1","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.144797+0000","last_change":"2024-09-14T11:12:19.086179+0000","last_active":"2024-09-14T12:40:06.144797+0000","last_peered":"2024-09-14T12:40:06.144797+0000","last_clean":"2024-09-14T12:40:06.144797+0000","last_became_active":"2024-09-14T11:12:19.085380+0000","last_became_peered":"2024-09-14T11:12:19.085380+0000","last_unstale":"2024-09-14T12:40:06.144797+0000","last_undegraded":"2024-09-14T12:40:06.144797+0000","last_fullsized":"2024-09-14T12:40:06.144797+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:31.276536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'32","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:14.751168+0000","last_change":"2024-09-14T11:06:29.535049+0000","last_active":"2024-09-14T12:41:14.751168+0000","last_peered":"2024-09-14T12:41:14.751168+0000","last_clean":"2024-09-14T12:41:14.751168+0000","last_became_active":"2024-09-14T11:06:29.534458+0000","last_became_peered":"2024-09-14T11:06:29.534458+0000","last_unstale":"2024-09-14T12:41:14.751168+0000","last_undegraded":"2024-09-14T12:41:14.751168+0000","last_fullsized":"2024-09-14T12:41:14.751168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:56.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":170,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.552820+0000","last_change":"2024-09-14T11:40:08.950611+0000","last_active":"2024-09-14T12:40:55.552820+0000","last_peered":"2024-09-14T12:40:55.552820+0000","last_clean":"2024-09-14T12:40:55.552820+0000","last_became_active":"2024-09-14T11:40:08.949834+0000","last_became_peered":"2024-09-14T11:40:08.949834+0000","last_unstale":"2024-09-14T12:40:55.552820+0000","last_undegraded":"2024-09-14T12:40:55.552820+0000","last_fullsized":"2024-09-14T12:40:55.552820+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:57.861780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737457+0000","last_change":"2024-09-14T11:12:26.248461+0000","last_active":"2024-09-14T12:40:14.737457+0000","last_peered":"2024-09-14T12:40:14.737457+0000","last_clean":"2024-09-14T12:40:14.737457+0000","last_became_active":"2024-09-14T11:12:26.247614+0000","last_became_peered":"2024-09-14T11:12:26.247614+0000","last_unstale":"2024-09-14T12:40:14.737457+0000","last_undegraded":"2024-09-14T12:40:14.737457+0000","last_fullsized":"2024-09-14T12:40:14.737457+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:50.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'13","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.536466+0000","last_change":"2024-09-14T11:12:19.096853+0000","last_active":"2024-09-14T12:40:06.536466+0000","last_peered":"2024-09-14T12:40:06.536466+0000","last_clean":"2024-09-14T12:40:06.536466+0000","last_became_active":"2024-09-14T11:12:19.096087+0000","last_became_peered":"2024-09-14T11:12:19.096087+0000","last_unstale":"2024-09-14T12:40:06.536466+0000","last_undegraded":"2024-09-14T12:40:06.536466+0000","last_fullsized":"2024-09-14T12:40:06.536466+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:06.192659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":21525,"num_write":23,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'15","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490423+0000","last_change":"2024-09-14T11:06:29.545510+0000","last_active":"2024-09-14T12:41:01.490423+0000","last_peered":"2024-09-14T12:41:01.490423+0000","last_clean":"2024-09-14T12:41:01.490423+0000","last_became_active":"2024-09-14T11:06:29.544309+0000","last_became_peered":"2024-09-14T11:06:29.544309+0000","last_unstale":"2024-09-14T12:41:01.490423+0000","last_undegraded":"2024-09-14T12:41:01.490423+0000","last_fullsized":"2024-09-14T12:41:01.490423+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:06.467496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":80,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.487672+0000","last_change":"2024-09-14T11:40:08.941028+0000","last_active":"2024-09-14T12:40:51.487672+0000","last_peered":"2024-09-14T12:40:51.487672+0000","last_clean":"2024-09-14T12:40:51.487672+0000","last_became_active":"2024-09-14T11:40:08.934447+0000","last_became_peered":"2024-09-14T11:40:08.934447+0000","last_unstale":"2024-09-14T12:40:51.487672+0000","last_undegraded":"2024-09-14T12:40:51.487672+0000","last_fullsized":"2024-09-14T12:40:51.487672+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:15.709296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"267'11","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:44.771631+0000","last_change":"2024-09-14T11:12:26.254154+0000","last_active":"2024-09-14T12:42:44.771631+0000","last_peered":"2024-09-14T12:42:44.771631+0000","last_clean":"2024-09-14T12:42:44.771631+0000","last_became_active":"2024-09-14T11:12:26.253410+0000","last_became_peered":"2024-09-14T11:12:26.253410+0000","last_unstale":"2024-09-14T12:42:44.771631+0000","last_undegraded":"2024-09-14T12:42:44.771631+0000","last_fullsized":"2024-09-14T12:42:44.771631+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.081481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6160,"num_write":16,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:04.735243+0000","last_change":"2024-09-14T11:12:19.112482+0000","last_active":"2024-09-14T12:40:04.735243+0000","last_peered":"2024-09-14T12:40:04.735243+0000","last_clean":"2024-09-14T12:40:04.735243+0000","last_became_active":"2024-09-14T11:12:19.109807+0000","last_became_peered":"2024-09-14T11:12:19.109807+0000","last_unstale":"2024-09-14T12:40:04.735243+0000","last_undegraded":"2024-09-14T12:40:04.735243+0000","last_fullsized":"2024-09-14T12:40:04.735243+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:20.441664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'38","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.554078+0000","last_change":"2024-09-14T11:06:29.521507+0000","last_active":"2024-09-14T12:41:00.554078+0000","last_peered":"2024-09-14T12:41:00.554078+0000","last_clean":"2024-09-14T12:41:00.554078+0000","last_became_active":"2024-09-14T11:06:29.520734+0000","last_became_peered":"2024-09-14T11:06:29.520734+0000","last_unstale":"2024-09-14T12:41:00.554078+0000","last_undegraded":"2024-09-14T12:41:00.554078+0000","last_fullsized":"2024-09-14T12:41:00.554078+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:18.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":248,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.551623+0000","last_change":"2024-09-14T11:40:08.929963+0000","last_active":"2024-09-14T12:40:50.551623+0000","last_peered":"2024-09-14T12:40:50.551623+0000","last_clean":"2024-09-14T12:40:50.551623+0000","last_became_active":"2024-09-14T11:40:08.928855+0000","last_became_peered":"2024-09-14T11:40:08.928855+0000","last_unstale":"2024-09-14T12:40:50.551623+0000","last_undegraded":"2024-09-14T12:40:50.551623+0000","last_fullsized":"2024-09-14T12:40:50.551623+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:53.447923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.554007+0000","last_change":"2024-09-14T11:12:26.236373+0000","last_active":"2024-09-14T12:40:10.554007+0000","last_peered":"2024-09-14T12:40:10.554007+0000","last_clean":"2024-09-14T12:40:10.554007+0000","last_became_active":"2024-09-14T11:12:26.235707+0000","last_became_peered":"2024-09-14T11:12:26.235707+0000","last_unstale":"2024-09-14T12:40:10.554007+0000","last_undegraded":"2024-09-14T12:40:10.554007+0000","last_fullsized":"2024-09-14T12:40:10.554007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:08.153271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"267'5","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.951256+0000","last_change":"2024-09-14T11:12:19.112752+0000","last_active":"2024-09-14T12:44:02.951256+0000","last_peered":"2024-09-14T12:44:02.951256+0000","last_clean":"2024-09-14T12:44:02.951256+0000","last_became_active":"2024-09-14T11:12:19.112055+0000","last_became_peered":"2024-09-14T11:12:19.112055+0000","last_unstale":"2024-09-14T12:44:02.951256+0000","last_undegraded":"2024-09-14T12:44:02.951256+0000","last_fullsized":"2024-09-14T12:44:02.951256+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:44.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'65","reported_seq":253,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548334+0000","last_change":"2024-09-14T11:06:29.516817+0000","last_active":"2024-09-14T12:41:01.548334+0000","last_peered":"2024-09-14T12:41:01.548334+0000","last_clean":"2024-09-14T12:41:01.548334+0000","last_became_active":"2024-09-14T11:06:29.511360+0000","last_became_peered":"2024-09-14T11:06:29.511360+0000","last_unstale":"2024-09-14T12:41:01.548334+0000","last_undegraded":"2024-09-14T12:41:01.548334+0000","last_fullsized":"2024-09-14T12:41:01.548334+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:54.074956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":367,"num_write":155,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.564546+0000","last_change":"2024-09-14T11:40:08.949706+0000","last_active":"2024-09-14T12:40:55.564546+0000","last_peered":"2024-09-14T12:40:55.564546+0000","last_clean":"2024-09-14T12:40:55.564546+0000","last_became_active":"2024-09-14T11:40:08.949175+0000","last_became_peered":"2024-09-14T11:40:08.949175+0000","last_unstale":"2024-09-14T12:40:55.564546+0000","last_undegraded":"2024-09-14T12:40:55.564546+0000","last_fullsized":"2024-09-14T12:40:55.564546+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:24.365260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494106+0000","last_change":"2024-09-14T11:12:26.229833+0000","last_active":"2024-09-14T12:41:16.494106+0000","last_peered":"2024-09-14T12:41:16.494106+0000","last_clean":"2024-09-14T12:41:16.494106+0000","last_became_active":"2024-09-14T11:12:26.228889+0000","last_became_peered":"2024-09-14T11:12:26.228889+0000","last_unstale":"2024-09-14T12:41:16.494106+0000","last_undegraded":"2024-09-14T12:41:16.494106+0000","last_fullsized":"2024-09-14T12:41:16.494106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:37.357481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6156,"num_write":2,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:19.779183+0000","last_change":"2024-09-14T11:12:19.099716+0000","last_active":"2024-09-14T12:43:19.779183+0000","last_peered":"2024-09-14T12:43:19.779183+0000","last_clean":"2024-09-14T12:43:19.779183+0000","last_became_active":"2024-09-14T11:12:19.098699+0000","last_became_peered":"2024-09-14T11:12:19.098699+0000","last_unstale":"2024-09-14T12:43:19.779183+0000","last_undegraded":"2024-09-14T12:43:19.779183+0000","last_fullsized":"2024-09-14T12:43:19.779183+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:03.576522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'39","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548268+0000","last_change":"2024-09-14T11:06:29.539103+0000","last_active":"2024-09-14T12:41:01.548268+0000","last_peered":"2024-09-14T12:41:01.548268+0000","last_clean":"2024-09-14T12:41:01.548268+0000","last_became_active":"2024-09-14T11:06:29.538432+0000","last_became_peered":"2024-09-14T11:06:29.538432+0000","last_unstale":"2024-09-14T12:41:01.548268+0000","last_undegraded":"2024-09-14T12:41:01.548268+0000","last_fullsized":"2024-09-14T12:41:01.548268+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.474730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":213,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.159302+0000","last_change":"2024-09-14T11:40:08.942492+0000","last_active":"2024-09-14T12:41:06.159302+0000","last_peered":"2024-09-14T12:41:06.159302+0000","last_clean":"2024-09-14T12:41:06.159302+0000","last_became_active":"2024-09-14T11:40:08.941924+0000","last_became_peered":"2024-09-14T11:40:08.941924+0000","last_unstale":"2024-09-14T12:41:06.159302+0000","last_undegraded":"2024-09-14T12:41:06.159302+0000","last_fullsized":"2024-09-14T12:41:06.159302+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:27.899066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.161485+0000","last_change":"2024-09-14T11:12:26.248413+0000","last_active":"2024-09-14T12:41:16.161485+0000","last_peered":"2024-09-14T12:41:16.161485+0000","last_clean":"2024-09-14T12:41:16.161485+0000","last_became_active":"2024-09-14T11:12:26.247849+0000","last_became_peered":"2024-09-14T11:12:26.247849+0000","last_unstale":"2024-09-14T12:41:16.161485+0000","last_undegraded":"2024-09-14T12:41:16.161485+0000","last_fullsized":"2024-09-14T12:41:16.161485+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:10.903087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5155,"num_write":11,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:10.568076+0000","last_change":"2024-09-14T11:12:19.096332+0000","last_active":"2024-09-14T12:41:10.568076+0000","last_peered":"2024-09-14T12:41:10.568076+0000","last_clean":"2024-09-14T12:41:10.568076+0000","last_became_active":"2024-09-14T11:12:19.095636+0000","last_became_peered":"2024-09-14T11:12:19.095636+0000","last_unstale":"2024-09-14T12:41:10.568076+0000","last_undegraded":"2024-09-14T12:41:10.568076+0000","last_fullsized":"2024-09-14T12:41:10.568076+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:51.045024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'31","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142146+0000","last_change":"2024-09-14T11:06:29.508912+0000","last_active":"2024-09-14T12:39:56.142146+0000","last_peered":"2024-09-14T12:39:56.142146+0000","last_clean":"2024-09-14T12:39:56.142146+0000","last_became_active":"2024-09-14T11:06:29.508269+0000","last_became_peered":"2024-09-14T11:06:29.508269+0000","last_unstale":"2024-09-14T12:39:56.142146+0000","last_undegraded":"2024-09-14T12:39:56.142146+0000","last_fullsized":"2024-09-14T12:39:56.142146+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:53.190994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":149,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.800182+0000","last_change":"2024-09-14T11:40:08.945998+0000","last_active":"2024-09-14T12:40:55.800182+0000","last_peered":"2024-09-14T12:40:55.800182+0000","last_clean":"2024-09-14T12:40:55.800182+0000","last_became_active":"2024-09-14T11:40:08.945217+0000","last_became_peered":"2024-09-14T11:40:08.945217+0000","last_unstale":"2024-09-14T12:40:55.800182+0000","last_undegraded":"2024-09-14T12:40:55.800182+0000","last_fullsized":"2024-09-14T12:40:55.800182+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:49.290553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'4","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537498+0000","last_change":"2024-09-14T11:12:26.247976+0000","last_active":"2024-09-14T12:40:11.537498+0000","last_peered":"2024-09-14T12:40:11.537498+0000","last_clean":"2024-09-14T12:40:11.537498+0000","last_became_active":"2024-09-14T11:12:26.247272+0000","last_became_peered":"2024-09-14T11:12:26.247272+0000","last_unstale":"2024-09-14T12:40:11.537498+0000","last_undegraded":"2024-09-14T12:40:11.537498+0000","last_fullsized":"2024-09-14T12:40:11.537498+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:11.612706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:34.782674+0000","last_change":"2024-09-14T11:12:19.106061+0000","last_active":"2024-09-14T12:43:34.782674+0000","last_peered":"2024-09-14T12:43:34.782674+0000","last_clean":"2024-09-14T12:43:34.782674+0000","last_became_active":"2024-09-14T11:12:19.103535+0000","last_became_peered":"2024-09-14T11:12:19.103535+0000","last_unstale":"2024-09-14T12:43:34.782674+0000","last_undegraded":"2024-09-14T12:43:34.782674+0000","last_fullsized":"2024-09-14T12:43:34.782674+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.680229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'7","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.358674+0000","last_change":"2024-09-14T11:06:29.510769+0000","last_active":"2024-09-14T12:41:50.358674+0000","last_peered":"2024-09-14T12:41:50.358674+0000","last_clean":"2024-09-14T12:41:50.358674+0000","last_became_active":"2024-09-14T11:06:29.510044+0000","last_became_peered":"2024-09-14T11:06:29.510044+0000","last_unstale":"2024-09-14T12:41:50.358674+0000","last_undegraded":"2024-09-14T12:41:50.358674+0000","last_fullsized":"2024-09-14T12:41:50.358674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:30.328430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:54.746472+0000","last_change":"2024-09-14T11:40:08.930752+0000","last_active":"2024-09-14T12:40:54.746472+0000","last_peered":"2024-09-14T12:40:54.746472+0000","last_clean":"2024-09-14T12:40:54.746472+0000","last_became_active":"2024-09-14T11:40:08.930065+0000","last_became_peered":"2024-09-14T11:40:08.930065+0000","last_unstale":"2024-09-14T12:40:54.746472+0000","last_undegraded":"2024-09-14T12:40:54.746472+0000","last_fullsized":"2024-09-14T12:40:54.746472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.939757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.807272+0000","last_change":"2024-09-14T11:12:26.234589+0000","last_active":"2024-09-14T12:41:30.807272+0000","last_peered":"2024-09-14T12:41:30.807272+0000","last_clean":"2024-09-14T12:41:30.807272+0000","last_became_active":"2024-09-14T11:12:26.233812+0000","last_became_peered":"2024-09-14T11:12:26.233812+0000","last_unstale":"2024-09-14T12:41:30.807272+0000","last_undegraded":"2024-09-14T12:41:30.807272+0000","last_fullsized":"2024-09-14T12:41:30.807272+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:49.220830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'1","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476008+0000","last_change":"2024-09-14T11:12:19.108839+0000","last_active":"2024-09-14T12:40:06.476008+0000","last_peered":"2024-09-14T12:40:06.476008+0000","last_clean":"2024-09-14T12:40:06.476008+0000","last_became_active":"2024-09-14T11:12:19.107950+0000","last_became_peered":"2024-09-14T11:12:19.107950+0000","last_unstale":"2024-09-14T12:40:06.476008+0000","last_undegraded":"2024-09-14T12:40:06.476008+0000","last_fullsized":"2024-09-14T12:40:06.476008+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:06.871908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'21","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.810485+0000","last_change":"2024-09-14T11:06:29.528799+0000","last_active":"2024-09-14T12:41:50.810485+0000","last_peered":"2024-09-14T12:41:50.810485+0000","last_clean":"2024-09-14T12:41:50.810485+0000","last_became_active":"2024-09-14T11:06:29.528153+0000","last_became_peered":"2024-09-14T11:06:29.528153+0000","last_unstale":"2024-09-14T12:41:50.810485+0000","last_undegraded":"2024-09-14T12:41:50.810485+0000","last_fullsized":"2024-09-14T12:41:50.810485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:32.956165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":111,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795593+0000","last_change":"2024-09-14T11:40:08.937198+0000","last_active":"2024-09-14T12:40:35.795593+0000","last_peered":"2024-09-14T12:40:35.795593+0000","last_clean":"2024-09-14T12:40:35.795593+0000","last_became_active":"2024-09-14T11:40:08.936369+0000","last_became_peered":"2024-09-14T11:40:08.936369+0000","last_unstale":"2024-09-14T12:40:35.795593+0000","last_undegraded":"2024-09-14T12:40:35.795593+0000","last_fullsized":"2024-09-14T12:40:35.795593+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:41.385885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.555175+0000","last_change":"2024-09-14T11:12:26.246616+0000","last_active":"2024-09-14T12:40:15.555175+0000","last_peered":"2024-09-14T12:40:15.555175+0000","last_clean":"2024-09-14T12:40:15.555175+0000","last_became_active":"2024-09-14T11:12:26.245930+0000","last_became_peered":"2024-09-14T11:12:26.245930+0000","last_unstale":"2024-09-14T12:40:15.555175+0000","last_undegraded":"2024-09-14T12:40:15.555175+0000","last_fullsized":"2024-09-14T12:40:15.555175+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:04.624461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3080,"num_write":1,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'1","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504797+0000","last_change":"2024-09-14T11:12:19.109523+0000","last_active":"2024-09-14T12:41:56.504797+0000","last_peered":"2024-09-14T12:41:56.504797+0000","last_clean":"2024-09-14T12:41:56.504797+0000","last_became_active":"2024-09-14T11:12:19.108775+0000","last_became_peered":"2024-09-14T11:12:19.108775+0000","last_unstale":"2024-09-14T12:41:56.504797+0000","last_undegraded":"2024-09-14T12:41:56.504797+0000","last_fullsized":"2024-09-14T12:41:56.504797+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:14.420097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'26","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585974+0000","last_change":"2024-09-14T11:06:29.513212+0000","last_active":"2024-09-14T12:41:50.585974+0000","last_peered":"2024-09-14T12:41:50.585974+0000","last_clean":"2024-09-14T12:41:50.585974+0000","last_became_active":"2024-09-14T11:06:29.512500+0000","last_became_peered":"2024-09-14T11:06:29.512500+0000","last_unstale":"2024-09-14T12:41:50.585974+0000","last_undegraded":"2024-09-14T12:41:50.585974+0000","last_fullsized":"2024-09-14T12:41:50.585974+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:16.159078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":126,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795654+0000","last_change":"2024-09-14T11:40:08.942991+0000","last_active":"2024-09-14T12:40:35.795654+0000","last_peered":"2024-09-14T12:40:35.795654+0000","last_clean":"2024-09-14T12:40:35.795654+0000","last_became_active":"2024-09-14T11:40:08.941346+0000","last_became_peered":"2024-09-14T11:40:08.941346+0000","last_unstale":"2024-09-14T12:40:35.795654+0000","last_undegraded":"2024-09-14T12:40:35.795654+0000","last_fullsized":"2024-09-14T12:40:35.795654+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.150412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"267'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550224+0000","last_change":"2024-09-14T11:12:26.243752+0000","last_active":"2024-09-14T12:39:55.550224+0000","last_peered":"2024-09-14T12:39:55.550224+0000","last_clean":"2024-09-14T12:39:55.550224+0000","last_became_active":"2024-09-14T11:12:26.243209+0000","last_became_peered":"2024-09-14T11:12:26.243209+0000","last_unstale":"2024-09-14T12:39:55.550224+0000","last_undegraded":"2024-09-14T12:39:55.550224+0000","last_fullsized":"2024-09-14T12:39:55.550224+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:38.328679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":3,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'9","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.565326+0000","last_change":"2024-09-14T11:12:19.092074+0000","last_active":"2024-09-14T12:40:15.565326+0000","last_peered":"2024-09-14T12:40:15.565326+0000","last_clean":"2024-09-14T12:40:15.565326+0000","last_became_active":"2024-09-14T11:12:19.091327+0000","last_became_peered":"2024-09-14T11:12:19.091327+0000","last_unstale":"2024-09-14T12:40:15.565326+0000","last_undegraded":"2024-09-14T12:40:15.565326+0000","last_fullsized":"2024-09-14T12:40:15.565326+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:38.040984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":27638,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'29","reported_seq":155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503327+0000","last_change":"2024-09-14T11:06:29.545877+0000","last_active":"2024-09-14T12:41:51.503327+0000","last_peered":"2024-09-14T12:41:51.503327+0000","last_clean":"2024-09-14T12:41:51.503327+0000","last_became_active":"2024-09-14T11:06:29.539618+0000","last_became_peered":"2024-09-14T11:06:29.539618+0000","last_unstale":"2024-09-14T12:41:51.503327+0000","last_undegraded":"2024-09-14T12:41:51.503327+0000","last_fullsized":"2024-09-14T12:41:51.503327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:18.342360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":157,"num_write":71,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:25.557355+0000","last_change":"2024-09-14T11:40:08.946921+0000","last_active":"2024-09-14T12:40:25.557355+0000","last_peered":"2024-09-14T12:40:25.557355+0000","last_clean":"2024-09-14T12:40:25.557355+0000","last_became_active":"2024-09-14T11:40:08.946312+0000","last_became_peered":"2024-09-14T11:40:08.946312+0000","last_unstale":"2024-09-14T12:40:25.557355+0000","last_undegraded":"2024-09-14T12:40:25.557355+0000","last_fullsized":"2024-09-14T12:40:25.557355+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:31.836873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:15.804514+0000","last_change":"2024-09-14T11:12:26.229509+0000","last_active":"2024-09-14T12:41:15.804514+0000","last_peered":"2024-09-14T12:41:15.804514+0000","last_clean":"2024-09-14T12:41:15.804514+0000","last_became_active":"2024-09-14T11:12:26.228723+0000","last_became_peered":"2024-09-14T11:12:26.228723+0000","last_unstale":"2024-09-14T12:41:15.804514+0000","last_undegraded":"2024-09-14T12:41:15.804514+0000","last_fullsized":"2024-09-14T12:41:15.804514+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:02.621776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":11303,"num_write":13,"num_write_kb":5161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.160475+0000","last_change":"2024-09-14T11:12:19.085868+0000","last_active":"2024-09-14T12:41:11.160475+0000","last_peered":"2024-09-14T12:41:11.160475+0000","last_clean":"2024-09-14T12:41:11.160475+0000","last_became_active":"2024-09-14T11:12:19.085023+0000","last_became_peered":"2024-09-14T11:12:19.085023+0000","last_unstale":"2024-09-14T12:41:11.160475+0000","last_undegraded":"2024-09-14T12:41:11.160475+0000","last_fullsized":"2024-09-14T12:41:11.160475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:18.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:31.150526+0000","last_change":"2024-09-14T11:06:29.529450+0000","last_active":"2024-09-14T12:40:31.150526+0000","last_peered":"2024-09-14T12:40:31.150526+0000","last_clean":"2024-09-14T12:40:31.150526+0000","last_became_active":"2024-09-14T11:06:29.527422+0000","last_became_peered":"2024-09-14T11:06:29.527422+0000","last_unstale":"2024-09-14T12:40:31.150526+0000","last_undegraded":"2024-09-14T12:40:31.150526+0000","last_fullsized":"2024-09-14T12:40:31.150526+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.481655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":97,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.483898+0000","last_change":"2024-09-14T11:40:08.934634+0000","last_active":"2024-09-14T12:40:36.483898+0000","last_peered":"2024-09-14T12:40:36.483898+0000","last_clean":"2024-09-14T12:40:36.483898+0000","last_became_active":"2024-09-14T11:40:08.933897+0000","last_became_peered":"2024-09-14T11:40:08.933897+0000","last_unstale":"2024-09-14T12:40:36.483898+0000","last_undegraded":"2024-09-14T12:40:36.483898+0000","last_fullsized":"2024-09-14T12:40:36.483898+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:56.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'4","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494346+0000","last_change":"2024-09-14T11:12:26.238345+0000","last_active":"2024-09-14T12:41:16.494346+0000","last_peered":"2024-09-14T12:41:16.494346+0000","last_clean":"2024-09-14T12:41:16.494346+0000","last_became_active":"2024-09-14T11:12:26.232736+0000","last_became_peered":"2024-09-14T11:12:26.232736+0000","last_unstale":"2024-09-14T12:41:16.494346+0000","last_undegraded":"2024-09-14T12:41:16.494346+0000","last_fullsized":"2024-09-14T12:41:16.494346+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:45.595070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9441280,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":17408,"num_write":9,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.492937+0000","last_change":"2024-09-14T11:12:19.108780+0000","last_active":"2024-09-14T12:41:11.492937+0000","last_peered":"2024-09-14T12:41:11.492937+0000","last_clean":"2024-09-14T12:41:11.492937+0000","last_became_active":"2024-09-14T11:12:19.100258+0000","last_became_peered":"2024-09-14T11:12:19.100258+0000","last_unstale":"2024-09-14T12:41:11.492937+0000","last_undegraded":"2024-09-14T12:41:11.492937+0000","last_fullsized":"2024-09-14T12:41:11.492937+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.561655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":9,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737495+0000","last_change":"2024-09-14T11:06:29.533686+0000","last_active":"2024-09-14T12:40:14.737495+0000","last_peered":"2024-09-14T12:40:14.737495+0000","last_clean":"2024-09-14T12:40:14.737495+0000","last_became_active":"2024-09-14T11:06:29.532958+0000","last_became_peered":"2024-09-14T11:06:29.532958+0000","last_unstale":"2024-09-14T12:40:14.737495+0000","last_undegraded":"2024-09-14T12:40:14.737495+0000","last_fullsized":"2024-09-14T12:40:14.737495+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:35.814419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":199,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:49.745345+0000","last_change":"2024-09-14T11:40:08.934320+0000","last_active":"2024-09-14T12:40:49.745345+0000","last_peered":"2024-09-14T12:40:49.745345+0000","last_clean":"2024-09-14T12:40:49.745345+0000","last_became_active":"2024-09-14T11:40:08.932939+0000","last_became_peered":"2024-09-14T11:40:08.932939+0000","last_unstale":"2024-09-14T12:40:49.745345+0000","last_undegraded":"2024-09-14T12:40:49.745345+0000","last_fullsized":"2024-09-14T12:40:49.745345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:01.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.560888+0000","last_change":"2024-09-14T11:12:26.245494+0000","last_active":"2024-09-14T12:39:55.560888+0000","last_peered":"2024-09-14T12:39:55.560888+0000","last_clean":"2024-09-14T12:39:55.560888+0000","last_became_active":"2024-09-14T11:12:26.236892+0000","last_became_peered":"2024-09-14T11:12:26.236892+0000","last_unstale":"2024-09-14T12:39:55.560888+0000","last_undegraded":"2024-09-14T12:39:55.560888+0000","last_fullsized":"2024-09-14T12:39:55.560888+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.142203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.151616+0000","last_change":"2024-09-14T11:12:19.085476+0000","last_active":"2024-09-14T12:40:36.151616+0000","last_peered":"2024-09-14T12:40:36.151616+0000","last_clean":"2024-09-14T12:40:36.151616+0000","last_became_active":"2024-09-14T11:12:19.084630+0000","last_became_peered":"2024-09-14T11:12:19.084630+0000","last_unstale":"2024-09-14T12:40:36.151616+0000","last_undegraded":"2024-09-14T12:40:36.151616+0000","last_fullsized":"2024-09-14T12:40:36.151616+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:40.347823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'305","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.147026+0000","last_change":"2024-09-14T11:06:29.529539+0000","last_active":"2024-09-14T12:40:16.147026+0000","last_peered":"2024-09-14T12:40:16.147026+0000","last_clean":"2024-09-14T12:40:16.147026+0000","last_became_active":"2024-09-14T11:06:29.524051+0000","last_became_peered":"2024-09-14T11:06:29.524051+0000","last_unstale":"2024-09-14T12:40:16.147026+0000","last_undegraded":"2024-09-14T12:40:16.147026+0000","last_fullsized":"2024-09-14T12:40:16.147026+0000","mapping_epoch":256,"log_start":"264'200","ondisk_log_start":"264'200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:40.592968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2841,"num_read_kb":3371,"num_write":621,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.572999+0000","last_change":"2024-09-14T11:40:08.938945+0000","last_active":"2024-09-14T12:40:50.572999+0000","last_peered":"2024-09-14T12:40:50.572999+0000","last_clean":"2024-09-14T12:40:50.572999+0000","last_became_active":"2024-09-14T11:40:08.938357+0000","last_became_peered":"2024-09-14T11:40:08.938357+0000","last_unstale":"2024-09-14T12:40:50.572999+0000","last_undegraded":"2024-09-14T12:40:50.572999+0000","last_fullsized":"2024-09-14T12:40:50.572999+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:36.211620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485050+0000","last_change":"2024-09-14T11:12:26.252293+0000","last_active":"2024-09-14T12:40:41.485050+0000","last_peered":"2024-09-14T12:40:41.485050+0000","last_clean":"2024-09-14T12:40:41.485050+0000","last_became_active":"2024-09-14T11:12:26.251771+0000","last_became_peered":"2024-09-14T11:12:26.251771+0000","last_unstale":"2024-09-14T12:40:41.485050+0000","last_undegraded":"2024-09-14T12:40:41.485050+0000","last_fullsized":"2024-09-14T12:40:41.485050+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:13.079478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":9222,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'1","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504515+0000","last_change":"2024-09-14T11:12:19.109609+0000","last_active":"2024-09-14T12:41:56.504515+0000","last_peered":"2024-09-14T12:41:56.504515+0000","last_clean":"2024-09-14T12:41:56.504515+0000","last_became_active":"2024-09-14T11:12:19.100323+0000","last_became_peered":"2024-09-14T11:12:19.100323+0000","last_unstale":"2024-09-14T12:41:56.504515+0000","last_undegraded":"2024-09-14T12:41:56.504515+0000","last_fullsized":"2024-09-14T12:41:56.504515+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'31","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478473+0000","last_change":"2024-09-14T11:06:29.545567+0000","last_active":"2024-09-14T12:40:16.478473+0000","last_peered":"2024-09-14T12:40:16.478473+0000","last_clean":"2024-09-14T12:40:16.478473+0000","last_became_active":"2024-09-14T11:06:29.545010+0000","last_became_peered":"2024-09-14T11:06:29.545010+0000","last_unstale":"2024-09-14T12:40:16.478473+0000","last_undegraded":"2024-09-14T12:40:16.478473+0000","last_fullsized":"2024-09-14T12:40:16.478473+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:33.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":160,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559740+0000","last_change":"2024-09-14T11:40:08.946756+0000","last_active":"2024-09-14T12:40:35.559740+0000","last_peered":"2024-09-14T12:40:35.559740+0000","last_clean":"2024-09-14T12:40:35.559740+0000","last_became_active":"2024-09-14T11:40:08.946192+0000","last_became_peered":"2024-09-14T11:40:08.946192+0000","last_unstale":"2024-09-14T12:40:35.559740+0000","last_undegraded":"2024-09-14T12:40:35.559740+0000","last_fullsized":"2024-09-14T12:40:35.559740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:33.765939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"267'13","reported_seq":88,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142222+0000","last_change":"2024-09-14T11:12:26.252307+0000","last_active":"2024-09-14T12:39:56.142222+0000","last_peered":"2024-09-14T12:39:56.142222+0000","last_clean":"2024-09-14T12:39:56.142222+0000","last_became_active":"2024-09-14T11:12:26.251336+0000","last_became_peered":"2024-09-14T11:12:26.251336+0000","last_unstale":"2024-09-14T12:39:56.142222+0000","last_undegraded":"2024-09-14T12:39:56.142222+0000","last_fullsized":"2024-09-14T12:39:56.142222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:43.789676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":27664,"num_write":23,"num_write_kb":11276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560463+0000","last_change":"2024-09-14T11:12:19.090268+0000","last_active":"2024-09-14T12:41:56.560463+0000","last_peered":"2024-09-14T12:41:56.560463+0000","last_clean":"2024-09-14T12:41:56.560463+0000","last_became_active":"2024-09-14T11:12:19.089451+0000","last_became_peered":"2024-09-14T11:12:19.089451+0000","last_unstale":"2024-09-14T12:41:56.560463+0000","last_undegraded":"2024-09-14T12:41:56.560463+0000","last_fullsized":"2024-09-14T12:41:56.560463+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.308101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"267'36","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478384+0000","last_change":"2024-09-14T11:06:29.519496+0000","last_active":"2024-09-14T12:40:16.478384+0000","last_peered":"2024-09-14T12:40:16.478384+0000","last_clean":"2024-09-14T12:40:16.478384+0000","last_became_active":"2024-09-14T11:06:29.518775+0000","last_became_peered":"2024-09-14T11:06:29.518775+0000","last_unstale":"2024-09-14T12:40:16.478384+0000","last_undegraded":"2024-09-14T12:40:16.478384+0000","last_fullsized":"2024-09-14T12:40:16.478384+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:55.187103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":189,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485290+0000","last_change":"2024-09-14T11:40:08.934946+0000","last_active":"2024-09-14T12:40:41.485290+0000","last_peered":"2024-09-14T12:40:41.485290+0000","last_clean":"2024-09-14T12:40:41.485290+0000","last_became_active":"2024-09-14T11:40:08.934173+0000","last_became_peered":"2024-09-14T11:40:08.934173+0000","last_unstale":"2024-09-14T12:40:41.485290+0000","last_undegraded":"2024-09-14T12:40:41.485290+0000","last_fullsized":"2024-09-14T12:40:41.485290+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:19.698280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142074+0000","last_change":"2024-09-14T11:12:26.243412+0000","last_active":"2024-09-14T12:39:56.142074+0000","last_peered":"2024-09-14T12:39:56.142074+0000","last_clean":"2024-09-14T12:39:56.142074+0000","last_became_active":"2024-09-14T11:12:26.242532+0000","last_became_peered":"2024-09-14T11:12:26.242532+0000","last_unstale":"2024-09-14T12:39:56.142074+0000","last_undegraded":"2024-09-14T12:39:56.142074+0000","last_fullsized":"2024-09-14T12:39:56.142074+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:30.032531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9208,"num_write":5,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568347+0000","last_change":"2024-09-14T11:12:19.115989+0000","last_active":"2024-09-14T12:41:55.568347+0000","last_peered":"2024-09-14T12:41:55.568347+0000","last_clean":"2024-09-14T12:41:55.568347+0000","last_became_active":"2024-09-14T11:12:19.115236+0000","last_became_peered":"2024-09-14T11:12:19.115236+0000","last_unstale":"2024-09-14T12:41:55.568347+0000","last_undegraded":"2024-09-14T12:41:55.568347+0000","last_fullsized":"2024-09-14T12:41:55.568347+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:10.915539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'6","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.154160+0000","last_change":"2024-09-14T11:06:29.526320+0000","last_active":"2024-09-14T12:40:46.154160+0000","last_peered":"2024-09-14T12:40:46.154160+0000","last_clean":"2024-09-14T12:40:46.154160+0000","last_became_active":"2024-09-14T11:06:29.525548+0000","last_became_peered":"2024-09-14T11:06:29.525548+0000","last_unstale":"2024-09-14T12:40:46.154160+0000","last_undegraded":"2024-09-14T12:40:46.154160+0000","last_fullsized":"2024-09-14T12:40:46.154160+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:11.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'327","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.812029+0000","last_change":"2024-09-14T10:49:23.373774+0000","last_active":"2024-09-14T12:41:55.812029+0000","last_peered":"2024-09-14T12:41:55.812029+0000","last_clean":"2024-09-14T12:41:55.812029+0000","last_became_active":"2024-09-14T10:49:23.372514+0000","last_became_peered":"2024-09-14T10:49:23.372514+0000","last_unstale":"2024-09-14T12:41:55.812029+0000","last_undegraded":"2024-09-14T12:41:55.812029+0000","last_fullsized":"2024-09-14T12:41:55.812029+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15587743,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":630,"num_read_kb":89783,"num_write":1127,"num_write_kb":37856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'875","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.375040+0000","last_change":"2024-09-14T10:49:25.369326+0000","last_active":"2024-09-14T12:42:29.375040+0000","last_peered":"2024-09-14T12:42:29.375040+0000","last_clean":"2024-09-14T12:42:29.375040+0000","last_became_active":"2024-09-14T10:49:25.368861+0000","last_became_peered":"2024-09-14T10:49:25.368861+0000","last_unstale":"2024-09-14T12:42:29.375040+0000","last_undegraded":"2024-09-14T12:42:29.375040+0000","last_fullsized":"2024-09-14T12:42:29.375040+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:53.245258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4292,"num_read_kb":3786,"num_write":1290,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'327","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360075+0000","last_change":"2024-09-14T10:49:23.387406+0000","last_active":"2024-09-14T12:41:55.360075+0000","last_peered":"2024-09-14T12:41:55.360075+0000","last_clean":"2024-09-14T12:41:55.360075+0000","last_became_active":"2024-09-14T10:49:23.386742+0000","last_became_peered":"2024-09-14T10:49:23.386742+0000","last_unstale":"2024-09-14T12:41:55.360075+0000","last_undegraded":"2024-09-14T12:41:55.360075+0000","last_fullsized":"2024-09-14T12:41:55.360075+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.860422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5532289,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":905,"num_read_kb":14777,"num_write":1126,"num_write_kb":22069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'1157","reported_seq":2810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.680278+0000","last_change":"2024-09-14T10:49:25.371243+0000","last_active":"2024-09-14T12:42:31.680278+0000","last_peered":"2024-09-14T12:42:31.680278+0000","last_clean":"2024-09-14T12:42:31.680278+0000","last_became_active":"2024-09-14T10:49:25.370610+0000","last_became_peered":"2024-09-14T10:49:25.370610+0000","last_unstale":"2024-09-14T12:42:31.680278+0000","last_undegraded":"2024-09-14T12:42:31.680278+0000","last_fullsized":"2024-09-14T12:42:31.680278+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:18.603078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5343,"num_read_kb":4756,"num_write":1566,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'316","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360001+0000","last_change":"2024-09-14T10:49:23.368497+0000","last_active":"2024-09-14T12:41:55.360001+0000","last_peered":"2024-09-14T12:41:55.360001+0000","last_clean":"2024-09-14T12:41:55.360001+0000","last_became_active":"2024-09-14T10:49:23.367647+0000","last_became_peered":"2024-09-14T10:49:23.367647+0000","last_unstale":"2024-09-14T12:41:55.360001+0000","last_undegraded":"2024-09-14T12:41:55.360001+0000","last_fullsized":"2024-09-14T12:41:55.360001+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:08.432641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9463108,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":620,"num_read_kb":20302,"num_write":1165,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1240","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.728017+0000","last_change":"2024-09-14T10:49:25.380844+0000","last_active":"2024-09-14T12:41:23.728017+0000","last_peered":"2024-09-14T12:41:23.728017+0000","last_clean":"2024-09-14T12:41:23.728017+0000","last_became_active":"2024-09-14T10:49:25.380525+0000","last_became_peered":"2024-09-14T10:49:25.380525+0000","last_unstale":"2024-09-14T12:41:23.728017+0000","last_undegraded":"2024-09-14T12:41:23.728017+0000","last_fullsized":"2024-09-14T12:41:23.728017+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:39.949070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5594,"num_read_kb":4933,"num_write":1701,"num_write_kb":712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'311","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.167123+0000","last_change":"2024-09-14T10:49:23.395465+0000","last_active":"2024-09-14T12:41:41.167123+0000","last_peered":"2024-09-14T12:41:41.167123+0000","last_clean":"2024-09-14T12:41:41.167123+0000","last_became_active":"2024-09-14T10:49:23.395029+0000","last_became_peered":"2024-09-14T10:49:23.395029+0000","last_unstale":"2024-09-14T12:41:41.167123+0000","last_undegraded":"2024-09-14T12:41:41.167123+0000","last_fullsized":"2024-09-14T12:41:41.167123+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:51.643761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294264,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":508,"num_read_kb":13842,"num_write":1078,"num_write_kb":32575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'922","reported_seq":2538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:08.373535+0000","last_change":"2024-09-14T10:49:25.369478+0000","last_active":"2024-09-14T12:40:08.373535+0000","last_peered":"2024-09-14T12:40:08.373535+0000","last_clean":"2024-09-14T12:40:08.373535+0000","last_became_active":"2024-09-14T10:49:25.368723+0000","last_became_peered":"2024-09-14T10:49:25.368723+0000","last_unstale":"2024-09-14T12:40:08.373535+0000","last_undegraded":"2024-09-14T12:40:08.373535+0000","last_fullsized":"2024-09-14T12:40:08.373535+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:35.388355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6457,"num_read_kb":5960,"num_write":1431,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'303","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:25.779688+0000","last_change":"2024-09-14T10:49:23.397395+0000","last_active":"2024-09-14T12:39:25.779688+0000","last_peered":"2024-09-14T12:39:25.779688+0000","last_clean":"2024-09-14T12:39:25.779688+0000","last_became_active":"2024-09-14T10:49:23.396952+0000","last_became_peered":"2024-09-14T10:49:23.396952+0000","last_unstale":"2024-09-14T12:39:25.779688+0000","last_undegraded":"2024-09-14T12:39:25.779688+0000","last_fullsized":"2024-09-14T12:39:25.779688+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:46.006794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10144239,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":668,"num_read_kb":15587,"num_write":1187,"num_write_kb":19198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'487","reported_seq":2234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.631742+0000","last_change":"2024-09-14T10:49:25.369573+0000","last_active":"2024-09-14T12:43:47.631742+0000","last_peered":"2024-09-14T12:43:47.631742+0000","last_clean":"2024-09-14T12:43:47.631742+0000","last_became_active":"2024-09-14T10:49:25.369197+0000","last_became_peered":"2024-09-14T10:49:25.369197+0000","last_unstale":"2024-09-14T12:43:47.631742+0000","last_undegraded":"2024-09-14T12:43:47.631742+0000","last_fullsized":"2024-09-14T12:43:47.631742+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:39.097092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2591,"num_write":558,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'270","reported_seq":920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:26.135009+0000","last_change":"2024-09-14T10:49:23.387209+0000","last_active":"2024-09-14T12:39:26.135009+0000","last_peered":"2024-09-14T12:39:26.135009+0000","last_clean":"2024-09-14T12:39:26.135009+0000","last_became_active":"2024-09-14T10:49:23.386773+0000","last_became_peered":"2024-09-14T10:49:23.386773+0000","last_unstale":"2024-09-14T12:39:26.135009+0000","last_undegraded":"2024-09-14T12:39:26.135009+0000","last_fullsized":"2024-09-14T12:39:26.135009+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:38.080039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6302893,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":490,"num_read_kb":8718,"num_write":1001,"num_write_kb":39714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'428","reported_seq":2070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.811994+0000","last_change":"2024-09-14T10:49:25.404535+0000","last_active":"2024-09-14T12:41:55.811994+0000","last_peered":"2024-09-14T12:41:55.811994+0000","last_clean":"2024-09-14T12:41:55.811994+0000","last_became_active":"2024-09-14T10:49:25.404189+0000","last_became_peered":"2024-09-14T10:49:25.404189+0000","last_unstale":"2024-09-14T12:41:55.811994+0000","last_undegraded":"2024-09-14T12:41:55.811994+0000","last_fullsized":"2024-09-14T12:41:55.811994+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:54.606077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2519,"num_read_kb":2387,"num_write":515,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'337","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:27.635381+0000","last_change":"2024-09-14T10:49:23.354318+0000","last_active":"2024-09-14T12:39:27.635381+0000","last_peered":"2024-09-14T12:39:27.635381+0000","last_clean":"2024-09-14T12:39:27.635381+0000","last_became_active":"2024-09-14T10:49:23.353824+0000","last_became_peered":"2024-09-14T10:49:23.353824+0000","last_unstale":"2024-09-14T12:39:27.635381+0000","last_undegraded":"2024-09-14T12:39:27.635381+0000","last_fullsized":"2024-09-14T12:39:27.635381+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:21.688185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3446958,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":619,"num_read_kb":3209,"num_write":1233,"num_write_kb":30473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'1236","reported_seq":2941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.170607+0000","last_change":"2024-09-14T10:49:25.388326+0000","last_active":"2024-09-14T12:41:56.170607+0000","last_peered":"2024-09-14T12:41:56.170607+0000","last_clean":"2024-09-14T12:41:56.170607+0000","last_became_active":"2024-09-14T10:49:25.388008+0000","last_became_peered":"2024-09-14T10:49:25.388008+0000","last_unstale":"2024-09-14T12:41:56.170607+0000","last_undegraded":"2024-09-14T12:41:56.170607+0000","last_fullsized":"2024-09-14T12:41:56.170607+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":1200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:16.569310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5023,"num_write":1696,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'260","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:41.875394+0000","last_change":"2024-09-14T10:49:23.375365+0000","last_active":"2024-09-14T12:43:41.875394+0000","last_peered":"2024-09-14T12:43:41.875394+0000","last_clean":"2024-09-14T12:43:41.875394+0000","last_became_active":"2024-09-14T10:49:23.374194+0000","last_became_peered":"2024-09-14T10:49:23.374194+0000","last_unstale":"2024-09-14T12:43:41.875394+0000","last_undegraded":"2024-09-14T12:43:41.875394+0000","last_fullsized":"2024-09-14T12:43:41.875394+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:48.534483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10138434,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":420,"num_read_kb":30724,"num_write":905,"num_write_kb":46577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'763","reported_seq":2187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.688694+0000","last_change":"2024-09-14T10:49:25.396557+0000","last_active":"2024-09-14T12:43:47.688694+0000","last_peered":"2024-09-14T12:43:47.688694+0000","last_clean":"2024-09-14T12:43:47.688694+0000","last_became_active":"2024-09-14T10:49:25.395625+0000","last_became_peered":"2024-09-14T10:49:25.395625+0000","last_unstale":"2024-09-14T12:43:47.688694+0000","last_undegraded":"2024-09-14T12:43:47.688694+0000","last_fullsized":"2024-09-14T12:43:47.688694+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:55.126134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3607,"num_read_kb":3221,"num_write":1031,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'923","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496603+0000","last_change":"2024-09-14T10:49:25.378305+0000","last_active":"2024-09-14T12:41:26.496603+0000","last_peered":"2024-09-14T12:41:26.496603+0000","last_clean":"2024-09-14T12:41:26.496603+0000","last_became_active":"2024-09-14T10:49:25.377697+0000","last_became_peered":"2024-09-14T10:49:25.377697+0000","last_unstale":"2024-09-14T12:41:26.496603+0000","last_undegraded":"2024-09-14T12:41:26.496603+0000","last_fullsized":"2024-09-14T12:41:26.496603+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:55.143987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4426,"num_read_kb":3954,"num_write":1251,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'264","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.416054+0000","last_change":"2024-09-14T10:49:23.396284+0000","last_active":"2024-09-14T12:42:05.416054+0000","last_peered":"2024-09-14T12:42:05.416054+0000","last_clean":"2024-09-14T12:42:05.416054+0000","last_became_active":"2024-09-14T10:49:23.395881+0000","last_became_peered":"2024-09-14T10:49:23.395881+0000","last_unstale":"2024-09-14T12:42:05.416054+0000","last_undegraded":"2024-09-14T12:42:05.416054+0000","last_fullsized":"2024-09-14T12:42:05.416054+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:37.290462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10483156,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":532,"num_read_kb":45321,"num_write":882,"num_write_kb":34104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'503","reported_seq":2238,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.624807+0000","last_change":"2024-09-14T10:49:25.359959+0000","last_active":"2024-09-14T12:43:47.624807+0000","last_peered":"2024-09-14T12:43:47.624807+0000","last_clean":"2024-09-14T12:43:47.624807+0000","last_became_active":"2024-09-14T10:49:25.359419+0000","last_became_peered":"2024-09-14T10:49:25.359419+0000","last_unstale":"2024-09-14T12:43:47.624807+0000","last_undegraded":"2024-09-14T12:43:47.624807+0000","last_fullsized":"2024-09-14T12:43:47.624807+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:22.801370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2958,"num_read_kb":2787,"num_write":621,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'273","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:11.257777+0000","last_change":"2024-09-14T10:49:23.374078+0000","last_active":"2024-09-14T12:42:11.257777+0000","last_peered":"2024-09-14T12:42:11.257777+0000","last_clean":"2024-09-14T12:42:11.257777+0000","last_became_active":"2024-09-14T10:49:23.372672+0000","last_became_peered":"2024-09-14T10:49:23.372672+0000","last_unstale":"2024-09-14T12:42:11.257777+0000","last_undegraded":"2024-09-14T12:42:11.257777+0000","last_fullsized":"2024-09-14T12:42:11.257777+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.831678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8199771,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":527,"num_read_kb":8965,"num_write":975,"num_write_kb":20473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'401","reported_seq":1910,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.382357+0000","last_change":"2024-09-14T10:49:25.404208+0000","last_active":"2024-09-14T12:42:29.382357+0000","last_peered":"2024-09-14T12:42:29.382357+0000","last_clean":"2024-09-14T12:42:29.382357+0000","last_became_active":"2024-09-14T10:49:25.403885+0000","last_became_peered":"2024-09-14T10:49:25.403885+0000","last_unstale":"2024-09-14T12:42:29.382357+0000","last_undegraded":"2024-09-14T12:42:29.382357+0000","last_fullsized":"2024-09-14T12:42:29.382357+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:52.374511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2137,"num_read_kb":2023,"num_write":462,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'336","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:39.249338+0000","last_change":"2024-09-14T10:49:23.355237+0000","last_active":"2024-09-14T12:43:39.249338+0000","last_peered":"2024-09-14T12:43:39.249338+0000","last_clean":"2024-09-14T12:43:39.249338+0000","last_became_active":"2024-09-14T10:49:23.354127+0000","last_became_peered":"2024-09-14T10:49:23.354127+0000","last_unstale":"2024-09-14T12:43:39.249338+0000","last_undegraded":"2024-09-14T12:43:39.249338+0000","last_fullsized":"2024-09-14T12:43:39.249338+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:02.709768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2157026,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":723,"num_read_kb":56952,"num_write":1206,"num_write_kb":28690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"267'803","reported_seq":2347,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.456789+0000","last_change":"2024-09-14T10:49:25.396880+0000","last_active":"2024-09-14T12:42:29.456789+0000","last_peered":"2024-09-14T12:42:29.456789+0000","last_clean":"2024-09-14T12:42:29.456789+0000","last_became_active":"2024-09-14T10:49:25.396001+0000","last_became_peered":"2024-09-14T10:49:25.396001+0000","last_unstale":"2024-09-14T12:42:29.456789+0000","last_undegraded":"2024-09-14T12:42:29.456789+0000","last_fullsized":"2024-09-14T12:42:29.456789+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:58.603959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3888,"num_read_kb":3489,"num_write":1086,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'312","reported_seq":1101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795709+0000","last_change":"2024-09-14T10:49:23.387939+0000","last_active":"2024-09-14T12:40:35.795709+0000","last_peered":"2024-09-14T12:40:35.795709+0000","last_clean":"2024-09-14T12:40:35.795709+0000","last_became_active":"2024-09-14T10:49:23.387292+0000","last_became_peered":"2024-09-14T10:49:23.387292+0000","last_unstale":"2024-09-14T12:40:35.795709+0000","last_undegraded":"2024-09-14T12:40:35.795709+0000","last_fullsized":"2024-09-14T12:40:35.795709+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:32.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14639671,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":647,"num_read_kb":37760,"num_write":1121,"num_write_kb":55114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'373","reported_seq":1802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.628580+0000","last_change":"2024-09-14T10:49:25.394672+0000","last_active":"2024-09-14T12:43:47.628580+0000","last_peered":"2024-09-14T12:43:47.628580+0000","last_clean":"2024-09-14T12:43:47.628580+0000","last_became_active":"2024-09-14T10:49:25.394106+0000","last_became_peered":"2024-09-14T10:49:25.394106+0000","last_unstale":"2024-09-14T12:43:47.628580+0000","last_undegraded":"2024-09-14T12:43:47.628580+0000","last_fullsized":"2024-09-14T12:43:47.628580+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:13.420566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2013,"num_read_kb":1909,"num_write":433,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'373","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.412068+0000","last_change":"2024-09-14T10:49:23.364844+0000","last_active":"2024-09-14T12:42:05.412068+0000","last_peered":"2024-09-14T12:42:05.412068+0000","last_clean":"2024-09-14T12:42:05.412068+0000","last_became_active":"2024-09-14T10:49:23.364035+0000","last_became_peered":"2024-09-14T10:49:23.364035+0000","last_unstale":"2024-09-14T12:42:05.412068+0000","last_undegraded":"2024-09-14T12:42:05.412068+0000","last_fullsized":"2024-09-14T12:42:05.412068+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:50.556342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6985735,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":819,"num_read_kb":15225,"num_write":1177,"num_write_kb":26982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'779","reported_seq":2497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.206173+0000","last_change":"2024-09-14T10:49:25.372194+0000","last_active":"2024-09-14T12:42:22.206173+0000","last_peered":"2024-09-14T12:42:22.206173+0000","last_clean":"2024-09-14T12:42:22.206173+0000","last_became_active":"2024-09-14T10:49:25.371736+0000","last_became_peered":"2024-09-14T10:49:25.371736+0000","last_unstale":"2024-09-14T12:42:22.206173+0000","last_undegraded":"2024-09-14T12:42:22.206173+0000","last_fullsized":"2024-09-14T12:42:22.206173+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:00.150399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3876,"num_read_kb":3539,"num_write":1018,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'274","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.842429+0000","last_change":"2024-09-14T10:49:23.379017+0000","last_active":"2024-09-14T12:42:21.842429+0000","last_peered":"2024-09-14T12:42:21.842429+0000","last_clean":"2024-09-14T12:42:21.842429+0000","last_became_active":"2024-09-14T10:49:23.378269+0000","last_became_peered":"2024-09-14T10:49:23.378269+0000","last_unstale":"2024-09-14T12:42:21.842429+0000","last_undegraded":"2024-09-14T12:42:21.842429+0000","last_fullsized":"2024-09-14T12:42:21.842429+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:32.034490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6303647,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":481,"num_read_kb":35954,"num_write":1040,"num_write_kb":39786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'141","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.101213+0000","last_change":"2024-09-14T10:49:33.465171+0000","last_active":"2024-09-14T12:42:32.101213+0000","last_peered":"2024-09-14T12:42:32.101213+0000","last_clean":"2024-09-14T12:42:32.101213+0000","last_became_active":"2024-09-14T10:49:33.464427+0000","last_became_peered":"2024-09-14T10:49:33.464427+0000","last_unstale":"2024-09-14T12:42:32.101213+0000","last_undegraded":"2024-09-14T12:42:32.101213+0000","last_fullsized":"2024-09-14T12:42:32.101213+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.777578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":140,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'434","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.729509+0000","last_change":"2024-09-14T10:49:25.381601+0000","last_active":"2024-09-14T12:41:23.729509+0000","last_peered":"2024-09-14T12:41:23.729509+0000","last_clean":"2024-09-14T12:41:23.729509+0000","last_became_active":"2024-09-14T10:49:25.379409+0000","last_became_peered":"2024-09-14T10:49:25.379409+0000","last_unstale":"2024-09-14T12:41:23.729509+0000","last_undegraded":"2024-09-14T12:41:23.729509+0000","last_fullsized":"2024-09-14T12:41:23.729509+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:45.958192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2548,"num_read_kb":2434,"num_write":516,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'290","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496811+0000","last_change":"2024-09-14T10:49:23.366250+0000","last_active":"2024-09-14T12:41:26.496811+0000","last_peered":"2024-09-14T12:41:26.496811+0000","last_clean":"2024-09-14T12:41:26.496811+0000","last_became_active":"2024-09-14T10:49:23.365630+0000","last_became_peered":"2024-09-14T10:49:23.365630+0000","last_unstale":"2024-09-14T12:41:26.496811+0000","last_undegraded":"2024-09-14T12:41:26.496811+0000","last_fullsized":"2024-09-14T12:41:26.496811+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:00.413045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13969150,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":519,"num_read_kb":11787,"num_write":1121,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485373+0000","last_change":"2024-09-14T10:49:27.388283+0000","last_active":"2024-09-14T12:40:41.485373+0000","last_peered":"2024-09-14T12:40:41.485373+0000","last_clean":"2024-09-14T12:40:41.485373+0000","last_became_active":"2024-09-14T10:49:27.387803+0000","last_became_peered":"2024-09-14T10:49:27.387803+0000","last_unstale":"2024-09-14T12:40:41.485373+0000","last_undegraded":"2024-09-14T12:40:41.485373+0000","last_fullsized":"2024-09-14T12:40:41.485373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:58.901691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'383","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:05.603732+0000","last_change":"2024-09-14T10:49:29.387542+0000","last_active":"2024-09-14T12:43:05.603732+0000","last_peered":"2024-09-14T12:43:05.603732+0000","last_clean":"2024-09-14T12:43:05.603732+0000","last_became_active":"2024-09-14T10:49:29.386799+0000","last_became_peered":"2024-09-14T10:49:29.386799+0000","last_unstale":"2024-09-14T12:43:05.603732+0000","last_undegraded":"2024-09-14T12:43:05.603732+0000","last_fullsized":"2024-09-14T12:43:05.603732+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.432275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":1111,"num_write":482,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550661+0000","last_change":"2024-09-14T10:49:31.408598+0000","last_active":"2024-09-14T12:40:45.550661+0000","last_peered":"2024-09-14T12:40:45.550661+0000","last_clean":"2024-09-14T12:40:45.550661+0000","last_became_active":"2024-09-14T10:49:31.407831+0000","last_became_peered":"2024-09-14T10:49:31.407831+0000","last_unstale":"2024-09-14T12:40:45.550661+0000","last_undegraded":"2024-09-14T12:40:45.550661+0000","last_fullsized":"2024-09-14T12:40:45.550661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:34.507742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'138","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:25.404481+0000","last_change":"2024-09-14T10:49:33.475510+0000","last_active":"2024-09-14T12:42:25.404481+0000","last_peered":"2024-09-14T12:42:25.404481+0000","last_clean":"2024-09-14T12:42:25.404481+0000","last_became_active":"2024-09-14T10:49:33.474458+0000","last_became_peered":"2024-09-14T10:49:33.474458+0000","last_unstale":"2024-09-14T12:42:25.404481+0000","last_undegraded":"2024-09-14T12:42:25.404481+0000","last_fullsized":"2024-09-14T12:42:25.404481+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:19.578114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":162,"num_write":341,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'692","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.618190+0000","last_change":"2024-09-14T10:49:25.378257+0000","last_active":"2024-09-14T12:43:47.618190+0000","last_peered":"2024-09-14T12:43:47.618190+0000","last_clean":"2024-09-14T12:43:47.618190+0000","last_became_active":"2024-09-14T10:49:25.375112+0000","last_became_peered":"2024-09-14T10:49:25.375112+0000","last_unstale":"2024-09-14T12:43:47.618190+0000","last_undegraded":"2024-09-14T12:43:47.618190+0000","last_fullsized":"2024-09-14T12:43:47.618190+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:16.262424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3284,"num_write":889,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'369","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.553791+0000","last_change":"2024-09-14T10:49:23.385621+0000","last_active":"2024-09-14T12:41:26.553791+0000","last_peered":"2024-09-14T12:41:26.553791+0000","last_clean":"2024-09-14T12:41:26.553791+0000","last_became_active":"2024-09-14T10:49:23.384801+0000","last_became_peered":"2024-09-14T10:49:23.384801+0000","last_unstale":"2024-09-14T12:41:26.553791+0000","last_undegraded":"2024-09-14T12:41:26.553791+0000","last_fullsized":"2024-09-14T12:41:26.553791+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:37.649524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591992,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":673,"num_read_kb":6714,"num_write":1233,"num_write_kb":31721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.557476+0000","last_change":"2024-09-14T10:49:27.379539+0000","last_active":"2024-09-14T12:39:40.557476+0000","last_peered":"2024-09-14T12:39:40.557476+0000","last_clean":"2024-09-14T12:39:40.557476+0000","last_became_active":"2024-09-14T10:49:27.378702+0000","last_became_peered":"2024-09-14T10:49:27.378702+0000","last_unstale":"2024-09-14T12:39:40.557476+0000","last_undegraded":"2024-09-14T12:39:40.557476+0000","last_fullsized":"2024-09-14T12:39:40.557476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:50.849295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'127","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549519+0000","last_change":"2024-09-14T10:49:29.398866+0000","last_active":"2024-09-14T12:40:40.549519+0000","last_peered":"2024-09-14T12:40:40.549519+0000","last_clean":"2024-09-14T12:40:40.549519+0000","last_became_active":"2024-09-14T10:49:29.398354+0000","last_became_peered":"2024-09-14T10:49:29.398354+0000","last_unstale":"2024-09-14T12:40:40.549519+0000","last_undegraded":"2024-09-14T12:40:40.549519+0000","last_fullsized":"2024-09-14T12:40:40.549519+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:55.441392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550575+0000","last_change":"2024-09-14T10:49:31.434144+0000","last_active":"2024-09-14T12:40:45.550575+0000","last_peered":"2024-09-14T12:40:45.550575+0000","last_clean":"2024-09-14T12:40:45.550575+0000","last_became_active":"2024-09-14T10:49:31.433431+0000","last_became_peered":"2024-09-14T10:49:31.433431+0000","last_unstale":"2024-09-14T12:40:45.550575+0000","last_undegraded":"2024-09-14T12:40:45.550575+0000","last_fullsized":"2024-09-14T12:40:45.550575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:01.989175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'115","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.484054+0000","last_change":"2024-09-14T10:49:33.463822+0000","last_active":"2024-09-14T12:39:44.484054+0000","last_peered":"2024-09-14T12:39:44.484054+0000","last_clean":"2024-09-14T12:39:44.484054+0000","last_became_active":"2024-09-14T10:49:33.463124+0000","last_became_peered":"2024-09-14T10:49:33.463124+0000","last_unstale":"2024-09-14T12:39:44.484054+0000","last_undegraded":"2024-09-14T12:39:44.484054+0000","last_fullsized":"2024-09-14T12:39:44.484054+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:53.103119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'851","reported_seq":2501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.772346+0000","last_change":"2024-09-14T10:49:25.389867+0000","last_active":"2024-09-14T12:42:31.772346+0000","last_peered":"2024-09-14T12:42:31.772346+0000","last_clean":"2024-09-14T12:42:31.772346+0000","last_became_active":"2024-09-14T10:49:25.385678+0000","last_became_peered":"2024-09-14T10:49:25.385678+0000","last_unstale":"2024-09-14T12:42:31.772346+0000","last_undegraded":"2024-09-14T12:42:31.772346+0000","last_fullsized":"2024-09-14T12:42:31.772346+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:25.356791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4238,"num_read_kb":3841,"num_write":1159,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'314","reported_seq":1210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496668+0000","last_change":"2024-09-14T10:49:23.372266+0000","last_active":"2024-09-14T12:41:26.496668+0000","last_peered":"2024-09-14T12:41:26.496668+0000","last_clean":"2024-09-14T12:41:26.496668+0000","last_became_active":"2024-09-14T10:49:23.371893+0000","last_became_peered":"2024-09-14T10:49:23.371893+0000","last_unstale":"2024-09-14T12:41:26.496668+0000","last_undegraded":"2024-09-14T12:41:26.496668+0000","last_fullsized":"2024-09-14T12:41:26.496668+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:31.260794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9954594,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":1299,"num_read_kb":59405,"num_write":1078,"num_write_kb":37706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.570738+0000","last_change":"2024-09-14T10:49:27.380154+0000","last_active":"2024-09-14T12:40:40.570738+0000","last_peered":"2024-09-14T12:40:40.570738+0000","last_clean":"2024-09-14T12:40:40.570738+0000","last_became_active":"2024-09-14T10:49:27.379355+0000","last_became_peered":"2024-09-14T10:49:27.379355+0000","last_unstale":"2024-09-14T12:40:40.570738+0000","last_undegraded":"2024-09-14T12:40:40.570738+0000","last_fullsized":"2024-09-14T12:40:40.570738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:52.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.371862+0000","last_change":"2024-09-14T10:49:29.387051+0000","last_active":"2024-09-14T12:40:15.371862+0000","last_peered":"2024-09-14T12:40:15.371862+0000","last_clean":"2024-09-14T12:40:15.371862+0000","last_became_active":"2024-09-14T10:49:29.386264+0000","last_became_peered":"2024-09-14T10:49:29.386264+0000","last_unstale":"2024-09-14T12:40:15.371862+0000","last_undegraded":"2024-09-14T12:40:15.371862+0000","last_fullsized":"2024-09-14T12:40:15.371862+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:32.852231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'806","reported_seq":3017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.145566+0000","last_change":"2024-09-14T10:49:31.432319+0000","last_active":"2024-09-14T12:43:49.145566+0000","last_peered":"2024-09-14T12:43:49.145566+0000","last_clean":"2024-09-14T12:43:49.145566+0000","last_became_active":"2024-09-14T10:49:31.431702+0000","last_became_peered":"2024-09-14T10:49:31.431702+0000","last_unstale":"2024-09-14T12:43:49.145566+0000","last_undegraded":"2024-09-14T12:43:49.145566+0000","last_fullsized":"2024-09-14T12:43:49.145566+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:52.750405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'216","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.705477+0000","last_change":"2024-09-14T10:49:33.473107+0000","last_active":"2024-09-14T12:42:29.705477+0000","last_peered":"2024-09-14T12:42:29.705477+0000","last_clean":"2024-09-14T12:42:29.705477+0000","last_became_active":"2024-09-14T10:49:33.472433+0000","last_became_peered":"2024-09-14T10:49:33.472433+0000","last_unstale":"2024-09-14T12:42:29.705477+0000","last_undegraded":"2024-09-14T12:42:29.705477+0000","last_fullsized":"2024-09-14T12:42:29.705477+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":612,"num_write":471,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'451","reported_seq":2012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559941+0000","last_change":"2024-09-14T10:49:25.398553+0000","last_active":"2024-09-14T12:40:35.559941+0000","last_peered":"2024-09-14T12:40:35.559941+0000","last_clean":"2024-09-14T12:40:35.559941+0000","last_became_active":"2024-09-14T10:49:25.395255+0000","last_became_peered":"2024-09-14T10:49:25.395255+0000","last_unstale":"2024-09-14T12:40:35.559941+0000","last_undegraded":"2024-09-14T12:40:35.559941+0000","last_fullsized":"2024-09-14T12:40:35.559941+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:50.419167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2444,"num_read_kb":2309,"num_write":533,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'297","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.559409+0000","last_change":"2024-09-14T10:49:23.403490+0000","last_active":"2024-09-14T12:41:25.559409+0000","last_peered":"2024-09-14T12:41:25.559409+0000","last_clean":"2024-09-14T12:41:25.559409+0000","last_became_active":"2024-09-14T10:49:23.403079+0000","last_became_peered":"2024-09-14T10:49:23.403079+0000","last_unstale":"2024-09-14T12:41:25.559409+0000","last_undegraded":"2024-09-14T12:41:25.559409+0000","last_fullsized":"2024-09-14T12:41:25.559409+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:43.895377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15567719,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":495,"num_read_kb":46330,"num_write":1049,"num_write_kb":49327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485445+0000","last_change":"2024-09-14T10:49:27.392398+0000","last_active":"2024-09-14T12:40:41.485445+0000","last_peered":"2024-09-14T12:40:41.485445+0000","last_clean":"2024-09-14T12:40:41.485445+0000","last_became_active":"2024-09-14T10:49:27.391823+0000","last_became_peered":"2024-09-14T10:49:27.391823+0000","last_unstale":"2024-09-14T12:40:41.485445+0000","last_undegraded":"2024-09-14T12:40:41.485445+0000","last_fullsized":"2024-09-14T12:40:41.485445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:59.037074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'320","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:06.186645+0000","last_change":"2024-09-14T10:49:29.385602+0000","last_active":"2024-09-14T12:43:06.186645+0000","last_peered":"2024-09-14T12:43:06.186645+0000","last_clean":"2024-09-14T12:43:06.186645+0000","last_became_active":"2024-09-14T10:49:29.385023+0000","last_became_peered":"2024-09-14T10:49:29.385023+0000","last_unstale":"2024-09-14T12:43:06.186645+0000","last_undegraded":"2024-09-14T12:43:06.186645+0000","last_fullsized":"2024-09-14T12:43:06.186645+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:43.706717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":1019,"num_write":418,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'822","reported_seq":5655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105420+0000","last_change":"2024-09-14T10:49:31.425706+0000","last_active":"2024-09-14T12:43:49.105420+0000","last_peered":"2024-09-14T12:43:49.105420+0000","last_clean":"2024-09-14T12:43:49.105420+0000","last_became_active":"2024-09-14T10:49:31.424873+0000","last_became_peered":"2024-09-14T10:49:31.424873+0000","last_unstale":"2024-09-14T12:43:49.105420+0000","last_undegraded":"2024-09-14T12:43:49.105420+0000","last_fullsized":"2024-09-14T12:43:49.105420+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:39.590615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'493","reported_seq":2117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.788525+0000","last_change":"2024-09-14T10:49:25.373828+0000","last_active":"2024-09-14T12:41:16.788525+0000","last_peered":"2024-09-14T12:41:16.788525+0000","last_clean":"2024-09-14T12:41:16.788525+0000","last_became_active":"2024-09-14T10:49:25.372711+0000","last_became_peered":"2024-09-14T10:49:25.372711+0000","last_unstale":"2024-09-14T12:41:16.788525+0000","last_undegraded":"2024-09-14T12:41:16.788525+0000","last_fullsized":"2024-09-14T12:41:16.788525+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:46.395982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2694,"num_read_kb":2523,"num_write":626,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'317","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.998103+0000","last_change":"2024-09-14T10:49:23.363597+0000","last_active":"2024-09-14T12:40:14.998103+0000","last_peered":"2024-09-14T12:40:14.998103+0000","last_clean":"2024-09-14T12:40:14.998103+0000","last_became_active":"2024-09-14T10:49:23.363126+0000","last_became_peered":"2024-09-14T10:49:23.363126+0000","last_unstale":"2024-09-14T12:40:14.998103+0000","last_undegraded":"2024-09-14T12:40:14.998103+0000","last_fullsized":"2024-09-14T12:40:14.998103+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:44.328445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2353159,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":645,"num_read_kb":10241,"num_write":1136,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.540062+0000","last_change":"2024-09-14T10:49:27.382040+0000","last_active":"2024-09-14T12:40:00.540062+0000","last_peered":"2024-09-14T12:40:00.540062+0000","last_clean":"2024-09-14T12:40:00.540062+0000","last_became_active":"2024-09-14T10:49:27.380063+0000","last_became_peered":"2024-09-14T10:49:27.380063+0000","last_unstale":"2024-09-14T12:40:00.540062+0000","last_undegraded":"2024-09-14T12:40:00.540062+0000","last_fullsized":"2024-09-14T12:40:00.540062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:23.504934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'437","reported_seq":1137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.819664+0000","last_change":"2024-09-14T10:49:29.383878+0000","last_active":"2024-09-14T12:42:30.819664+0000","last_peered":"2024-09-14T12:42:30.819664+0000","last_clean":"2024-09-14T12:42:30.819664+0000","last_became_active":"2024-09-14T10:49:29.383306+0000","last_became_peered":"2024-09-14T10:49:29.383306+0000","last_unstale":"2024-09-14T12:42:30.819664+0000","last_undegraded":"2024-09-14T12:42:30.819664+0000","last_fullsized":"2024-09-14T12:42:30.819664+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:17.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59853,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":1152,"num_write":526,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532617+0000","last_change":"2024-09-14T10:49:31.407042+0000","last_active":"2024-09-14T12:39:51.532617+0000","last_peered":"2024-09-14T12:39:51.532617+0000","last_clean":"2024-09-14T12:39:51.532617+0000","last_became_active":"2024-09-14T10:49:31.406293+0000","last_became_peered":"2024-09-14T10:49:31.406293+0000","last_unstale":"2024-09-14T12:39:51.532617+0000","last_undegraded":"2024-09-14T12:39:51.532617+0000","last_fullsized":"2024-09-14T12:39:51.532617+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:15.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'561","reported_seq":1444,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.641698+0000","last_change":"2024-09-14T10:49:33.475077+0000","last_active":"2024-09-14T12:43:48.641698+0000","last_peered":"2024-09-14T12:43:48.641698+0000","last_clean":"2024-09-14T12:43:48.641698+0000","last_became_active":"2024-09-14T10:49:33.474412+0000","last_became_peered":"2024-09-14T10:49:33.474412+0000","last_unstale":"2024-09-14T12:43:48.641698+0000","last_undegraded":"2024-09-14T12:43:48.641698+0000","last_fullsized":"2024-09-14T12:43:48.641698+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:52.098600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1493,"num_read_kb":1442,"num_write":1188,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'446","reported_seq":2088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538801+0000","last_change":"2024-09-14T10:49:25.405914+0000","last_active":"2024-09-14T12:39:55.538801+0000","last_peered":"2024-09-14T12:39:55.538801+0000","last_clean":"2024-09-14T12:39:55.538801+0000","last_became_active":"2024-09-14T10:49:25.405499+0000","last_became_peered":"2024-09-14T10:49:25.405499+0000","last_unstale":"2024-09-14T12:39:55.538801+0000","last_undegraded":"2024-09-14T12:39:55.538801+0000","last_fullsized":"2024-09-14T12:39:55.538801+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:54.507625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2382,"num_write":513,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'316","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.415753+0000","last_change":"2024-09-14T10:49:23.403913+0000","last_active":"2024-09-14T12:41:23.415753+0000","last_peered":"2024-09-14T12:41:23.415753+0000","last_clean":"2024-09-14T12:41:23.415753+0000","last_became_active":"2024-09-14T10:49:23.403551+0000","last_became_peered":"2024-09-14T10:49:23.403551+0000","last_unstale":"2024-09-14T12:41:23.415753+0000","last_undegraded":"2024-09-14T12:41:23.415753+0000","last_fullsized":"2024-09-14T12:41:23.415753+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:47.233133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224360,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":621,"num_read_kb":10639,"num_write":1173,"num_write_kb":29906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.535230+0000","last_change":"2024-09-14T10:49:27.373230+0000","last_active":"2024-09-14T12:40:01.535230+0000","last_peered":"2024-09-14T12:40:01.535230+0000","last_clean":"2024-09-14T12:40:01.535230+0000","last_became_active":"2024-09-14T10:49:27.372510+0000","last_became_peered":"2024-09-14T10:49:27.372510+0000","last_unstale":"2024-09-14T12:40:01.535230+0000","last_undegraded":"2024-09-14T12:40:01.535230+0000","last_fullsized":"2024-09-14T12:40:01.535230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:58.625869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'299","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.708769+0000","last_change":"2024-09-14T10:49:29.378472+0000","last_active":"2024-09-14T12:43:47.708769+0000","last_peered":"2024-09-14T12:43:47.708769+0000","last_clean":"2024-09-14T12:43:47.708769+0000","last_became_active":"2024-09-14T10:49:29.377710+0000","last_became_peered":"2024-09-14T10:49:29.377710+0000","last_unstale":"2024-09-14T12:43:47.708769+0000","last_undegraded":"2024-09-14T12:43:47.708769+0000","last_fullsized":"2024-09-14T12:43:47.708769+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:54.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":938,"num_write":382,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569489+0000","last_change":"2024-09-14T10:49:31.413000+0000","last_active":"2024-09-14T12:40:35.569489+0000","last_peered":"2024-09-14T12:40:35.569489+0000","last_clean":"2024-09-14T12:40:35.569489+0000","last_became_active":"2024-09-14T10:49:31.412080+0000","last_became_peered":"2024-09-14T10:49:31.412080+0000","last_unstale":"2024-09-14T12:40:35.569489+0000","last_undegraded":"2024-09-14T12:40:35.569489+0000","last_fullsized":"2024-09-14T12:40:35.569489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.692991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2528","reported_seq":4388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.576044+0000","last_change":"2024-09-14T10:49:33.479265+0000","last_active":"2024-09-14T12:42:30.576044+0000","last_peered":"2024-09-14T12:42:30.576044+0000","last_clean":"2024-09-14T12:42:30.576044+0000","last_became_active":"2024-09-14T10:49:33.478542+0000","last_became_peered":"2024-09-14T10:49:33.478542+0000","last_unstale":"2024-09-14T12:42:30.576044+0000","last_undegraded":"2024-09-14T12:42:30.576044+0000","last_fullsized":"2024-09-14T12:42:30.576044+0000","mapping_epoch":36,"log_start":"267'2500","ondisk_log_start":"267'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:52.785039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6246,"num_read_kb":6243,"num_write":5128,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'497","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.824180+0000","last_change":"2024-09-14T10:49:25.381367+0000","last_active":"2024-09-14T12:41:11.824180+0000","last_peered":"2024-09-14T12:41:11.824180+0000","last_clean":"2024-09-14T12:41:11.824180+0000","last_became_active":"2024-09-14T10:49:25.380967+0000","last_became_peered":"2024-09-14T10:49:25.380967+0000","last_unstale":"2024-09-14T12:41:11.824180+0000","last_undegraded":"2024-09-14T12:41:11.824180+0000","last_fullsized":"2024-09-14T12:41:11.824180+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:55.558427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2697,"num_read_kb":2531,"num_write":585,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'303","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:41.470216+0000","last_change":"2024-09-14T10:49:23.356775+0000","last_active":"2024-09-14T12:39:41.470216+0000","last_peered":"2024-09-14T12:39:41.470216+0000","last_clean":"2024-09-14T12:39:41.470216+0000","last_became_active":"2024-09-14T10:49:23.355809+0000","last_became_peered":"2024-09-14T10:49:23.355809+0000","last_unstale":"2024-09-14T12:39:41.470216+0000","last_undegraded":"2024-09-14T12:39:41.470216+0000","last_fullsized":"2024-09-14T12:39:41.470216+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:13.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11164066,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":501,"num_read_kb":12441,"num_write":1125,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:45.547722+0000","last_change":"2024-09-14T10:49:27.379127+0000","last_active":"2024-09-14T12:39:45.547722+0000","last_peered":"2024-09-14T12:39:45.547722+0000","last_clean":"2024-09-14T12:39:45.547722+0000","last_became_active":"2024-09-14T10:49:27.378028+0000","last_became_peered":"2024-09-14T10:49:27.378028+0000","last_unstale":"2024-09-14T12:39:45.547722+0000","last_undegraded":"2024-09-14T12:39:45.547722+0000","last_fullsized":"2024-09-14T12:39:45.547722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:49.172785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'394","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:42.933132+0000","last_change":"2024-09-14T10:49:29.389462+0000","last_active":"2024-09-14T12:43:42.933132+0000","last_peered":"2024-09-14T12:43:42.933132+0000","last_clean":"2024-09-14T12:43:42.933132+0000","last_became_active":"2024-09-14T10:49:29.388786+0000","last_became_peered":"2024-09-14T10:49:29.388786+0000","last_unstale":"2024-09-14T12:43:42.933132+0000","last_undegraded":"2024-09-14T12:43:42.933132+0000","last_fullsized":"2024-09-14T12:43:42.933132+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:53.840769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63295,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1173,"num_write":498,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'821","reported_seq":3416,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105522+0000","last_change":"2024-09-14T10:49:31.420988+0000","last_active":"2024-09-14T12:43:49.105522+0000","last_peered":"2024-09-14T12:43:49.105522+0000","last_clean":"2024-09-14T12:43:49.105522+0000","last_became_active":"2024-09-14T10:49:31.420178+0000","last_became_peered":"2024-09-14T10:49:31.420178+0000","last_unstale":"2024-09-14T12:43:49.105522+0000","last_undegraded":"2024-09-14T12:43:49.105522+0000","last_fullsized":"2024-09-14T12:43:49.105522+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:41.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'144","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.388041+0000","last_change":"2024-09-14T10:49:33.463351+0000","last_active":"2024-09-14T12:43:47.388041+0000","last_peered":"2024-09-14T12:43:47.388041+0000","last_clean":"2024-09-14T12:43:47.388041+0000","last_became_active":"2024-09-14T10:49:33.462780+0000","last_became_peered":"2024-09-14T10:49:33.462780+0000","last_unstale":"2024-09-14T12:43:47.388041+0000","last_undegraded":"2024-09-14T12:43:47.388041+0000","last_fullsized":"2024-09-14T12:43:47.388041+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:58.346452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'836","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.604978+0000","last_change":"2024-09-14T10:49:25.391283+0000","last_active":"2024-09-14T12:43:47.604978+0000","last_peered":"2024-09-14T12:43:47.604978+0000","last_clean":"2024-09-14T12:43:47.604978+0000","last_became_active":"2024-09-14T10:49:25.389567+0000","last_became_peered":"2024-09-14T10:49:25.389567+0000","last_unstale":"2024-09-14T12:43:47.604978+0000","last_undegraded":"2024-09-14T12:43:47.604978+0000","last_fullsized":"2024-09-14T12:43:47.604978+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:34.685545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4051,"num_read_kb":3641,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'305","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782903+0000","last_change":"2024-09-14T10:49:23.355908+0000","last_active":"2024-09-14T12:39:40.782903+0000","last_peered":"2024-09-14T12:39:40.782903+0000","last_clean":"2024-09-14T12:39:40.782903+0000","last_became_active":"2024-09-14T10:49:23.354452+0000","last_became_peered":"2024-09-14T10:49:23.354452+0000","last_unstale":"2024-09-14T12:39:40.782903+0000","last_undegraded":"2024-09-14T12:39:40.782903+0000","last_fullsized":"2024-09-14T12:39:40.782903+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:06:03.903748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16810810,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":531,"num_read_kb":20988,"num_write":1070,"num_write_kb":31512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:21.539587+0000","last_change":"2024-09-14T10:49:27.354654+0000","last_active":"2024-09-14T12:40:21.539587+0000","last_peered":"2024-09-14T12:40:21.539587+0000","last_clean":"2024-09-14T12:40:21.539587+0000","last_became_active":"2024-09-14T10:49:27.353932+0000","last_became_peered":"2024-09-14T10:49:27.353932+0000","last_unstale":"2024-09-14T12:40:21.539587+0000","last_undegraded":"2024-09-14T12:40:21.539587+0000","last_fullsized":"2024-09-14T12:40:21.539587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:21.532896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'488","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.578615+0000","last_change":"2024-09-14T10:49:29.379743+0000","last_active":"2024-09-14T12:43:48.578615+0000","last_peered":"2024-09-14T12:43:48.578615+0000","last_clean":"2024-09-14T12:43:48.578615+0000","last_became_active":"2024-09-14T10:49:29.378107+0000","last_became_peered":"2024-09-14T10:49:29.378107+0000","last_unstale":"2024-09-14T12:43:48.578615+0000","last_undegraded":"2024-09-14T12:43:48.578615+0000","last_fullsized":"2024-09-14T12:43:48.578615+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:49.708518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":820,"num_read_kb":1683,"num_write":664,"num_write_kb":517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:05.552752+0000","last_change":"2024-09-14T10:49:31.410161+0000","last_active":"2024-09-14T12:40:05.552752+0000","last_peered":"2024-09-14T12:40:05.552752+0000","last_clean":"2024-09-14T12:40:05.552752+0000","last_became_active":"2024-09-14T10:49:31.409247+0000","last_became_peered":"2024-09-14T10:49:31.409247+0000","last_unstale":"2024-09-14T12:40:05.552752+0000","last_undegraded":"2024-09-14T12:40:05.552752+0000","last_fullsized":"2024-09-14T12:40:05.552752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:49.593404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'132","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:14.764993+0000","last_change":"2024-09-14T10:49:33.462318+0000","last_active":"2024-09-14T12:42:14.764993+0000","last_peered":"2024-09-14T12:42:14.764993+0000","last_clean":"2024-09-14T12:42:14.764993+0000","last_became_active":"2024-09-14T10:49:33.461635+0000","last_became_peered":"2024-09-14T10:49:33.461635+0000","last_unstale":"2024-09-14T12:42:14.764993+0000","last_undegraded":"2024-09-14T12:42:14.764993+0000","last_fullsized":"2024-09-14T12:42:14.764993+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:57.796265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":314,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'839","reported_seq":2531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.621508+0000","last_change":"2024-09-14T10:49:25.361656+0000","last_active":"2024-09-14T12:43:47.621508+0000","last_peered":"2024-09-14T12:43:47.621508+0000","last_clean":"2024-09-14T12:43:47.621508+0000","last_became_active":"2024-09-14T10:49:25.361148+0000","last_became_peered":"2024-09-14T10:49:25.361148+0000","last_unstale":"2024-09-14T12:43:47.621508+0000","last_undegraded":"2024-09-14T12:43:47.621508+0000","last_fullsized":"2024-09-14T12:43:47.621508+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:41.324755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4070,"num_read_kb":3684,"num_write":1107,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'344","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.638949+0000","last_change":"2024-09-14T10:49:23.375908+0000","last_active":"2024-09-14T12:44:04.638949+0000","last_peered":"2024-09-14T12:44:04.638949+0000","last_clean":"2024-09-14T12:44:04.638949+0000","last_became_active":"2024-09-14T10:49:23.375005+0000","last_became_peered":"2024-09-14T10:49:23.375005+0000","last_unstale":"2024-09-14T12:44:04.638949+0000","last_undegraded":"2024-09-14T12:44:04.638949+0000","last_fullsized":"2024-09-14T12:44:04.638949+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:45.791369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":714,"num_read_kb":12064,"num_write":1097,"num_write_kb":35066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.730652+0000","last_change":"2024-09-14T10:49:27.386488+0000","last_active":"2024-09-14T12:39:44.730652+0000","last_peered":"2024-09-14T12:39:44.730652+0000","last_clean":"2024-09-14T12:39:44.730652+0000","last_became_active":"2024-09-14T10:49:27.385658+0000","last_became_peered":"2024-09-14T10:49:27.385658+0000","last_unstale":"2024-09-14T12:39:44.730652+0000","last_undegraded":"2024-09-14T12:39:44.730652+0000","last_fullsized":"2024-09-14T12:39:44.730652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:00.744114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'362","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.569445+0000","last_change":"2024-09-14T10:49:29.391486+0000","last_active":"2024-09-14T12:42:00.569445+0000","last_peered":"2024-09-14T12:42:00.569445+0000","last_clean":"2024-09-14T12:42:00.569445+0000","last_became_active":"2024-09-14T10:49:29.388618+0000","last_became_peered":"2024-09-14T10:49:29.388618+0000","last_unstale":"2024-09-14T12:42:00.569445+0000","last_undegraded":"2024-09-14T12:42:00.569445+0000","last_fullsized":"2024-09-14T12:42:00.569445+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:27.307665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":601,"num_read_kb":1144,"num_write":528,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:09.736444+0000","last_change":"2024-09-14T10:49:31.418529+0000","last_active":"2024-09-14T12:40:09.736444+0000","last_peered":"2024-09-14T12:40:09.736444+0000","last_clean":"2024-09-14T12:40:09.736444+0000","last_became_active":"2024-09-14T10:49:31.417797+0000","last_became_peered":"2024-09-14T10:49:31.417797+0000","last_unstale":"2024-09-14T12:40:09.736444+0000","last_undegraded":"2024-09-14T12:40:09.736444+0000","last_fullsized":"2024-09-14T12:40:09.736444+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:56.573341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'113","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.362386+0000","last_change":"2024-09-14T10:49:33.455868+0000","last_active":"2024-09-14T12:42:05.362386+0000","last_peered":"2024-09-14T12:42:05.362386+0000","last_clean":"2024-09-14T12:42:05.362386+0000","last_became_active":"2024-09-14T10:49:33.455162+0000","last_became_peered":"2024-09-14T10:49:33.455162+0000","last_unstale":"2024-09-14T12:42:05.362386+0000","last_undegraded":"2024-09-14T12:42:05.362386+0000","last_fullsized":"2024-09-14T12:42:05.362386+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:42.886276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'587","reported_seq":2424,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:57.861667+0000","last_change":"2024-09-14T10:49:25.378821+0000","last_active":"2024-09-14T12:39:57.861667+0000","last_peered":"2024-09-14T12:39:57.861667+0000","last_clean":"2024-09-14T12:39:57.861667+0000","last_became_active":"2024-09-14T10:49:25.377866+0000","last_became_peered":"2024-09-14T10:49:25.377866+0000","last_unstale":"2024-09-14T12:39:57.861667+0000","last_undegraded":"2024-09-14T12:39:57.861667+0000","last_fullsized":"2024-09-14T12:39:57.861667+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:16.585676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3293,"num_read_kb":3082,"num_write":722,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'257","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.477225+0000","last_change":"2024-09-14T10:49:23.362931+0000","last_active":"2024-09-14T12:40:11.477225+0000","last_peered":"2024-09-14T12:40:11.477225+0000","last_clean":"2024-09-14T12:40:11.477225+0000","last_became_active":"2024-09-14T10:49:23.362203+0000","last_became_peered":"2024-09-14T10:49:23.362203+0000","last_unstale":"2024-09-14T12:40:11.477225+0000","last_undegraded":"2024-09-14T12:40:11.477225+0000","last_fullsized":"2024-09-14T12:40:11.477225+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:22.083961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5248060,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":443,"num_read_kb":29276,"num_write":938,"num_write_kb":13260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:45.547789+0000","last_change":"2024-09-14T10:49:27.378611+0000","last_active":"2024-09-14T12:39:45.547789+0000","last_peered":"2024-09-14T12:39:45.547789+0000","last_clean":"2024-09-14T12:39:45.547789+0000","last_became_active":"2024-09-14T10:49:27.377674+0000","last_became_peered":"2024-09-14T10:49:27.377674+0000","last_unstale":"2024-09-14T12:39:45.547789+0000","last_undegraded":"2024-09-14T12:39:45.547789+0000","last_fullsized":"2024-09-14T12:39:45.547789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:20.096097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'391","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.369060+0000","last_change":"2024-09-14T10:49:29.394103+0000","last_active":"2024-09-14T12:42:30.369060+0000","last_peered":"2024-09-14T12:42:30.369060+0000","last_clean":"2024-09-14T12:42:30.369060+0000","last_became_active":"2024-09-14T10:49:29.393350+0000","last_became_peered":"2024-09-14T10:49:29.393350+0000","last_unstale":"2024-09-14T12:42:30.369060+0000","last_undegraded":"2024-09-14T12:42:30.369060+0000","last_fullsized":"2024-09-14T12:42:30.369060+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.411758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64930,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":1187,"num_write":506,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'793","reported_seq":5225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.691608+0000","last_change":"2024-09-14T10:49:31.423468+0000","last_active":"2024-09-14T12:44:01.691608+0000","last_peered":"2024-09-14T12:44:01.691608+0000","last_clean":"2024-09-14T12:44:01.691608+0000","last_became_active":"2024-09-14T10:49:31.422534+0000","last_became_peered":"2024-09-14T10:49:31.422534+0000","last_unstale":"2024-09-14T12:44:01.691608+0000","last_undegraded":"2024-09-14T12:44:01.691608+0000","last_fullsized":"2024-09-14T12:44:01.691608+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:58.304373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'158","reported_seq":729,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.415473+0000","last_change":"2024-09-14T10:49:33.466535+0000","last_active":"2024-09-14T12:42:29.415473+0000","last_peered":"2024-09-14T12:42:29.415473+0000","last_clean":"2024-09-14T12:42:29.415473+0000","last_became_active":"2024-09-14T10:49:33.466024+0000","last_became_peered":"2024-09-14T10:49:33.466024+0000","last_unstale":"2024-09-14T12:42:29.415473+0000","last_undegraded":"2024-09-14T12:42:29.415473+0000","last_fullsized":"2024-09-14T12:42:29.415473+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:24.127809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":335,"num_read_kb":285,"num_write":383,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'671","reported_seq":2389,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.135328+0000","last_change":"2024-09-14T10:49:25.381139+0000","last_active":"2024-09-14T12:42:22.135328+0000","last_peered":"2024-09-14T12:42:22.135328+0000","last_clean":"2024-09-14T12:42:22.135328+0000","last_became_active":"2024-09-14T10:49:25.380712+0000","last_became_peered":"2024-09-14T10:49:25.380712+0000","last_unstale":"2024-09-14T12:42:22.135328+0000","last_undegraded":"2024-09-14T12:42:22.135328+0000","last_fullsized":"2024-09-14T12:42:22.135328+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:50.719358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3719,"num_read_kb":3469,"num_write":935,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'293","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.507425+0000","last_change":"2024-09-14T10:49:23.367590+0000","last_active":"2024-09-14T12:42:06.507425+0000","last_peered":"2024-09-14T12:42:06.507425+0000","last_clean":"2024-09-14T12:42:06.507425+0000","last_became_active":"2024-09-14T10:49:23.367200+0000","last_became_peered":"2024-09-14T10:49:23.367200+0000","last_unstale":"2024-09-14T12:42:06.507425+0000","last_undegraded":"2024-09-14T12:42:06.507425+0000","last_fullsized":"2024-09-14T12:42:06.507425+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:06.469171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14338667,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":622,"num_read_kb":77246,"num_write":1091,"num_write_kb":38780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.516242+0000","last_change":"2024-09-14T10:49:27.380444+0000","last_active":"2024-09-14T12:43:48.516242+0000","last_peered":"2024-09-14T12:43:48.516242+0000","last_clean":"2024-09-14T12:43:48.516242+0000","last_became_active":"2024-09-14T10:49:27.379952+0000","last_became_peered":"2024-09-14T10:49:27.379952+0000","last_unstale":"2024-09-14T12:43:48.516242+0000","last_undegraded":"2024-09-14T12:43:48.516242+0000","last_fullsized":"2024-09-14T12:43:48.516242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:22.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'141","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561715+0000","last_change":"2024-09-14T10:49:29.373528+0000","last_active":"2024-09-14T12:42:01.561715+0000","last_peered":"2024-09-14T12:42:01.561715+0000","last_clean":"2024-09-14T12:42:01.561715+0000","last_became_active":"2024-09-14T10:49:29.371803+0000","last_became_peered":"2024-09-14T10:49:29.371803+0000","last_unstale":"2024-09-14T12:42:01.561715+0000","last_undegraded":"2024-09-14T12:42:01.561715+0000","last_fullsized":"2024-09-14T12:42:01.561715+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:44.432155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'793","reported_seq":3142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.104720+0000","last_change":"2024-09-14T10:49:31.427780+0000","last_active":"2024-09-14T12:43:49.104720+0000","last_peered":"2024-09-14T12:43:49.104720+0000","last_clean":"2024-09-14T12:43:49.104720+0000","last_became_active":"2024-09-14T10:49:31.427179+0000","last_became_peered":"2024-09-14T10:49:31.427179+0000","last_unstale":"2024-09-14T12:43:49.104720+0000","last_undegraded":"2024-09-14T12:43:49.104720+0000","last_fullsized":"2024-09-14T12:43:49.104720+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:38.189084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'134","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:28.826359+0000","last_change":"2024-09-14T10:49:33.471795+0000","last_active":"2024-09-14T12:42:28.826359+0000","last_peered":"2024-09-14T12:42:28.826359+0000","last_clean":"2024-09-14T12:42:28.826359+0000","last_became_active":"2024-09-14T10:49:33.468831+0000","last_became_peered":"2024-09-14T10:49:33.468831+0000","last_unstale":"2024-09-14T12:42:28.826359+0000","last_undegraded":"2024-09-14T12:42:28.826359+0000","last_fullsized":"2024-09-14T12:42:28.826359+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:46.840813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":148,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'487","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.736832+0000","last_change":"2024-09-14T10:49:25.371388+0000","last_active":"2024-09-14T12:41:23.736832+0000","last_peered":"2024-09-14T12:41:23.736832+0000","last_clean":"2024-09-14T12:41:23.736832+0000","last_became_active":"2024-09-14T10:49:25.370649+0000","last_became_peered":"2024-09-14T10:49:25.370649+0000","last_unstale":"2024-09-14T12:41:23.736832+0000","last_undegraded":"2024-09-14T12:41:23.736832+0000","last_fullsized":"2024-09-14T12:41:23.736832+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:54.984697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2839,"num_read_kb":2682,"num_write":610,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'310","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:21.114878+0000","last_change":"2024-09-14T10:49:23.359479+0000","last_active":"2024-09-14T12:41:21.114878+0000","last_peered":"2024-09-14T12:41:21.114878+0000","last_clean":"2024-09-14T12:41:21.114878+0000","last_became_active":"2024-09-14T10:49:23.355864+0000","last_became_peered":"2024-09-14T10:49:23.355864+0000","last_unstale":"2024-09-14T12:41:21.114878+0000","last_undegraded":"2024-09-14T12:41:21.114878+0000","last_fullsized":"2024-09-14T12:41:21.114878+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:44.897414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12833623,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":642,"num_read_kb":100725,"num_write":1023,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:46.471497+0000","last_change":"2024-09-14T10:49:27.391003+0000","last_active":"2024-09-14T12:39:46.471497+0000","last_peered":"2024-09-14T12:39:46.471497+0000","last_clean":"2024-09-14T12:39:46.471497+0000","last_became_active":"2024-09-14T10:49:27.390169+0000","last_became_peered":"2024-09-14T10:49:27.390169+0000","last_unstale":"2024-09-14T12:39:46.471497+0000","last_undegraded":"2024-09-14T12:39:46.471497+0000","last_fullsized":"2024-09-14T12:39:46.471497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:41.899346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'414","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.569385+0000","last_change":"2024-09-14T10:49:29.401131+0000","last_active":"2024-09-14T12:42:00.569385+0000","last_peered":"2024-09-14T12:42:00.569385+0000","last_clean":"2024-09-14T12:42:00.569385+0000","last_became_active":"2024-09-14T10:49:29.400776+0000","last_became_peered":"2024-09-14T10:49:29.400776+0000","last_unstale":"2024-09-14T12:42:00.569385+0000","last_undegraded":"2024-09-14T12:42:00.569385+0000","last_fullsized":"2024-09-14T12:42:00.569385+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:04.011436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54314,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":1124,"num_write":508,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140700+0000","last_change":"2024-09-14T10:49:31.421446+0000","last_active":"2024-09-14T12:39:51.140700+0000","last_peered":"2024-09-14T12:39:51.140700+0000","last_clean":"2024-09-14T12:39:51.140700+0000","last_became_active":"2024-09-14T10:49:31.418131+0000","last_became_peered":"2024-09-14T10:49:31.418131+0000","last_unstale":"2024-09-14T12:39:51.140700+0000","last_undegraded":"2024-09-14T12:39:51.140700+0000","last_fullsized":"2024-09-14T12:39:51.140700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:15.418822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'138","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.192828+0000","last_change":"2024-09-14T10:49:33.457926+0000","last_active":"2024-09-14T12:42:31.192828+0000","last_peered":"2024-09-14T12:42:31.192828+0000","last_clean":"2024-09-14T12:42:31.192828+0000","last_became_active":"2024-09-14T10:49:33.455953+0000","last_became_peered":"2024-09-14T10:49:33.455953+0000","last_unstale":"2024-09-14T12:42:31.192828+0000","last_undegraded":"2024-09-14T12:42:31.192828+0000","last_fullsized":"2024-09-14T12:42:31.192828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:50.433913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":155,"num_write":340,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'412","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.340214+0000","last_change":"2024-09-14T10:49:25.378560+0000","last_active":"2024-09-14T12:40:40.340214+0000","last_peered":"2024-09-14T12:40:40.340214+0000","last_clean":"2024-09-14T12:40:40.340214+0000","last_became_active":"2024-09-14T10:49:25.377841+0000","last_became_peered":"2024-09-14T10:49:25.377841+0000","last_unstale":"2024-09-14T12:40:40.340214+0000","last_undegraded":"2024-09-14T12:40:40.340214+0000","last_fullsized":"2024-09-14T12:40:40.340214+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:34.685545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2397,"num_read_kb":2304,"num_write":471,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.560546+0000","last_change":"2024-09-14T10:49:02.305650+0000","last_active":"2024-09-14T12:41:30.560546+0000","last_peered":"2024-09-14T12:41:30.560546+0000","last_clean":"2024-09-14T12:41:30.560546+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T12:41:30.560546+0000","last_undegraded":"2024-09-14T12:41:30.560546+0000","last_fullsized":"2024-09-14T12:41:30.560546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_clean_scrub_stamp":"2024-09-14T10:49:00.978700+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:28.964363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500441+0000","last_change":"2024-09-14T10:49:09.053703+0000","last_active":"2024-09-14T12:41:41.500441+0000","last_peered":"2024-09-14T12:41:41.500441+0000","last_clean":"2024-09-14T12:41:41.500441+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T12:41:41.500441+0000","last_undegraded":"2024-09-14T12:41:41.500441+0000","last_fullsized":"2024-09-14T12:41:41.500441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:01.458375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'272","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.587004+0000","last_change":"2024-09-14T10:49:23.371837+0000","last_active":"2024-09-14T12:41:55.587004+0000","last_peered":"2024-09-14T12:41:55.587004+0000","last_clean":"2024-09-14T12:41:55.587004+0000","last_became_active":"2024-09-14T10:49:23.371077+0000","last_became_peered":"2024-09-14T10:49:23.371077+0000","last_unstale":"2024-09-14T12:41:55.587004+0000","last_undegraded":"2024-09-14T12:41:55.587004+0000","last_fullsized":"2024-09-14T12:41:55.587004+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:28.149667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16978352,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":526,"num_read_kb":16360,"num_write":1056,"num_write_kb":33420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.786507+0000","last_change":"2024-09-14T10:49:27.375599+0000","last_active":"2024-09-14T12:39:55.786507+0000","last_peered":"2024-09-14T12:39:55.786507+0000","last_clean":"2024-09-14T12:39:55.786507+0000","last_became_active":"2024-09-14T10:49:27.372388+0000","last_became_peered":"2024-09-14T10:49:27.372388+0000","last_unstale":"2024-09-14T12:39:55.786507+0000","last_undegraded":"2024-09-14T12:39:55.786507+0000","last_fullsized":"2024-09-14T12:39:55.786507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:22.751936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'814","reported_seq":1545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.613172+0000","last_change":"2024-09-14T10:49:29.390925+0000","last_active":"2024-09-14T12:43:48.613172+0000","last_peered":"2024-09-14T12:43:48.613172+0000","last_clean":"2024-09-14T12:43:48.613172+0000","last_became_active":"2024-09-14T10:49:29.390014+0000","last_became_peered":"2024-09-14T10:49:29.390014+0000","last_unstale":"2024-09-14T12:43:48.613172+0000","last_undegraded":"2024-09-14T12:43:48.613172+0000","last_fullsized":"2024-09-14T12:43:48.613172+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.279366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209443,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1584,"num_read_kb":3253,"num_write":1568,"num_write_kb":1419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:05.552990+0000","last_change":"2024-09-14T10:49:31.411996+0000","last_active":"2024-09-14T12:40:05.552990+0000","last_peered":"2024-09-14T12:40:05.552990+0000","last_clean":"2024-09-14T12:40:05.552990+0000","last_became_active":"2024-09-14T10:49:31.411212+0000","last_became_peered":"2024-09-14T10:49:31.411212+0000","last_unstale":"2024-09-14T12:40:05.552990+0000","last_undegraded":"2024-09-14T12:40:05.552990+0000","last_fullsized":"2024-09-14T12:40:05.552990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:47.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'196","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.596985+0000","last_change":"2024-09-14T10:49:33.470365+0000","last_active":"2024-09-14T12:42:29.596985+0000","last_peered":"2024-09-14T12:42:29.596985+0000","last_clean":"2024-09-14T12:42:29.596985+0000","last_became_active":"2024-09-14T10:49:33.469611+0000","last_became_peered":"2024-09-14T10:49:33.469611+0000","last_unstale":"2024-09-14T12:42:29.596985+0000","last_undegraded":"2024-09-14T12:42:29.596985+0000","last_fullsized":"2024-09-14T12:42:29.596985+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:02.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":425,"num_write":402,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'780","reported_seq":2292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.583324+0000","last_change":"2024-09-14T10:49:25.391340+0000","last_active":"2024-09-14T12:41:29.583324+0000","last_peered":"2024-09-14T12:41:29.583324+0000","last_clean":"2024-09-14T12:41:29.583324+0000","last_became_active":"2024-09-14T10:49:25.390586+0000","last_became_peered":"2024-09-14T10:49:25.390586+0000","last_unstale":"2024-09-14T12:41:29.583324+0000","last_undegraded":"2024-09-14T12:41:29.583324+0000","last_fullsized":"2024-09-14T12:41:29.583324+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:28.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3382,"num_write":1057,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496631+0000","last_change":"2024-09-14T10:49:09.052857+0000","last_active":"2024-09-14T12:41:26.496631+0000","last_peered":"2024-09-14T12:41:26.496631+0000","last_clean":"2024-09-14T12:41:26.496631+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T12:41:26.496631+0000","last_undegraded":"2024-09-14T12:41:26.496631+0000","last_fullsized":"2024-09-14T12:41:26.496631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.713061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'289","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560334+0000","last_change":"2024-09-14T10:49:53.509685+0000","last_active":"2024-09-14T12:41:56.560334+0000","last_peered":"2024-09-14T12:41:56.560334+0000","last_clean":"2024-09-14T12:41:56.560334+0000","last_became_active":"2024-09-14T10:49:53.507913+0000","last_became_peered":"2024-09-14T10:49:53.507913+0000","last_unstale":"2024-09-14T12:41:56.560334+0000","last_undegraded":"2024-09-14T12:41:56.560334+0000","last_fullsized":"2024-09-14T12:41:56.560334+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.727574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11873036,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":518,"num_read_kb":56481,"num_write":1073,"num_write_kb":45113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,3],"acting":[6,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.474795+0000","last_change":"2024-09-14T10:49:27.389322+0000","last_active":"2024-09-14T12:40:01.474795+0000","last_peered":"2024-09-14T12:40:01.474795+0000","last_clean":"2024-09-14T12:40:01.474795+0000","last_became_active":"2024-09-14T10:49:27.388875+0000","last_became_peered":"2024-09-14T10:49:27.388875+0000","last_unstale":"2024-09-14T12:40:01.474795+0000","last_undegraded":"2024-09-14T12:40:01.474795+0000","last_fullsized":"2024-09-14T12:40:01.474795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:39.859202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1470","reported_seq":3843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.556102+0000","last_change":"2024-09-14T10:49:29.394197+0000","last_active":"2024-09-14T12:44:04.556102+0000","last_peered":"2024-09-14T12:44:04.556102+0000","last_clean":"2024-09-14T12:44:04.556102+0000","last_became_active":"2024-09-14T10:49:29.393295+0000","last_became_peered":"2024-09-14T10:49:29.393295+0000","last_unstale":"2024-09-14T12:44:04.556102+0000","last_undegraded":"2024-09-14T12:44:04.556102+0000","last_fullsized":"2024-09-14T12:44:04.556102+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:36.360396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2284,"num_read_kb":4194,"num_write":1394,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478561+0000","last_change":"2024-09-14T10:49:31.432764+0000","last_active":"2024-09-14T12:40:16.478561+0000","last_peered":"2024-09-14T12:40:16.478561+0000","last_clean":"2024-09-14T12:40:16.478561+0000","last_became_active":"2024-09-14T10:49:31.432054+0000","last_became_peered":"2024-09-14T10:49:31.432054+0000","last_unstale":"2024-09-14T12:40:16.478561+0000","last_undegraded":"2024-09-14T12:40:16.478561+0000","last_fullsized":"2024-09-14T12:40:16.478561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:16.891140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'83","reported_seq":607,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:30.558557+0000","last_change":"2024-09-14T10:49:33.466954+0000","last_active":"2024-09-14T12:40:30.558557+0000","last_peered":"2024-09-14T12:40:30.558557+0000","last_clean":"2024-09-14T12:40:30.558557+0000","last_became_active":"2024-09-14T10:49:33.466307+0000","last_became_peered":"2024-09-14T10:49:33.466307+0000","last_unstale":"2024-09-14T12:40:30.558557+0000","last_undegraded":"2024-09-14T12:40:30.558557+0000","last_fullsized":"2024-09-14T12:40:30.558557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:18.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":197,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'927","reported_seq":2492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.371619+0000","last_change":"2024-09-14T10:49:25.384251+0000","last_active":"2024-09-14T12:42:29.371619+0000","last_peered":"2024-09-14T12:42:29.371619+0000","last_clean":"2024-09-14T12:42:29.371619+0000","last_became_active":"2024-09-14T10:49:25.382937+0000","last_became_peered":"2024-09-14T10:49:25.382937+0000","last_unstale":"2024-09-14T12:42:29.371619+0000","last_undegraded":"2024-09-14T12:42:29.371619+0000","last_fullsized":"2024-09-14T12:42:29.371619+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:13.849834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":3892,"num_write":1285,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:39.756813+0000","last_change":"2024-09-14T10:49:09.482540+0000","last_active":"2024-09-14T12:41:39.756813+0000","last_peered":"2024-09-14T12:41:39.756813+0000","last_clean":"2024-09-14T12:41:39.756813+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T12:41:39.756813+0000","last_undegraded":"2024-09-14T12:41:39.756813+0000","last_fullsized":"2024-09-14T12:41:39.756813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:28.426232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'274","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.359813+0000","last_change":"2024-09-14T10:49:23.388674+0000","last_active":"2024-09-14T12:41:55.359813+0000","last_peered":"2024-09-14T12:41:55.359813+0000","last_clean":"2024-09-14T12:41:55.359813+0000","last_became_active":"2024-09-14T10:49:23.387885+0000","last_became_peered":"2024-09-14T10:49:23.387885+0000","last_unstale":"2024-09-14T12:41:55.359813+0000","last_undegraded":"2024-09-14T12:41:55.359813+0000","last_fullsized":"2024-09-14T12:41:55.359813+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:35.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9753178,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":500,"num_read_kb":25294,"num_write":1005,"num_write_kb":31965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:59.734121+0000","last_change":"2024-09-14T10:49:27.385977+0000","last_active":"2024-09-14T12:39:59.734121+0000","last_peered":"2024-09-14T12:39:59.734121+0000","last_clean":"2024-09-14T12:39:59.734121+0000","last_became_active":"2024-09-14T10:49:27.384973+0000","last_became_peered":"2024-09-14T10:49:27.384973+0000","last_unstale":"2024-09-14T12:39:59.734121+0000","last_undegraded":"2024-09-14T12:39:59.734121+0000","last_fullsized":"2024-09-14T12:39:59.734121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:44.532319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'415","reported_seq":2396,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:44.016898+0000","last_change":"2024-09-14T10:49:29.382733+0000","last_active":"2024-09-14T12:43:44.016898+0000","last_peered":"2024-09-14T12:43:44.016898+0000","last_clean":"2024-09-14T12:43:44.016898+0000","last_became_active":"2024-09-14T10:49:29.382485+0000","last_became_peered":"2024-09-14T10:49:29.382485+0000","last_unstale":"2024-09-14T12:43:44.016898+0000","last_undegraded":"2024-09-14T12:43:44.016898+0000","last_fullsized":"2024-09-14T12:43:44.016898+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:09.682817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":384,"num_read_kb":370,"num_write":379,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.562226+0000","last_change":"2024-09-14T10:49:31.421762+0000","last_active":"2024-09-14T12:40:00.562226+0000","last_peered":"2024-09-14T12:40:00.562226+0000","last_clean":"2024-09-14T12:40:00.562226+0000","last_became_active":"2024-09-14T10:49:31.420121+0000","last_became_peered":"2024-09-14T10:49:31.420121+0000","last_unstale":"2024-09-14T12:40:00.562226+0000","last_undegraded":"2024-09-14T12:40:00.562226+0000","last_fullsized":"2024-09-14T12:40:00.562226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:24.154484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'274","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.858379+0000","last_change":"2024-09-14T10:49:33.438284+0000","last_active":"2024-09-14T12:42:29.858379+0000","last_peered":"2024-09-14T12:42:29.858379+0000","last_clean":"2024-09-14T12:42:29.858379+0000","last_became_active":"2024-09-14T10:49:33.437564+0000","last_became_peered":"2024-09-14T10:49:33.437564+0000","last_unstale":"2024-09-14T12:42:29.858379+0000","last_undegraded":"2024-09-14T12:42:29.858379+0000","last_fullsized":"2024-09-14T12:42:29.858379+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:21.636592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":600,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'363","reported_seq":1770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.457004+0000","last_change":"2024-09-14T10:49:25.378315+0000","last_active":"2024-09-14T12:42:29.457004+0000","last_peered":"2024-09-14T12:42:29.457004+0000","last_clean":"2024-09-14T12:42:29.457004+0000","last_became_active":"2024-09-14T10:49:25.377606+0000","last_became_peered":"2024-09-14T10:49:25.377606+0000","last_unstale":"2024-09-14T12:42:29.457004+0000","last_undegraded":"2024-09-14T12:42:29.457004+0000","last_fullsized":"2024-09-14T12:42:29.457004+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:08.626742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2088,"num_read_kb":1981,"num_write":424,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500386+0000","last_change":"2024-09-14T10:49:09.053071+0000","last_active":"2024-09-14T12:41:41.500386+0000","last_peered":"2024-09-14T12:41:41.500386+0000","last_clean":"2024-09-14T12:41:41.500386+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T12:41:41.500386+0000","last_undegraded":"2024-09-14T12:41:41.500386+0000","last_fullsized":"2024-09-14T12:41:41.500386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:51.730662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'296","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:07.758881+0000","last_change":"2024-09-14T10:49:23.365487+0000","last_active":"2024-09-14T12:42:07.758881+0000","last_peered":"2024-09-14T12:42:07.758881+0000","last_clean":"2024-09-14T12:42:07.758881+0000","last_became_active":"2024-09-14T10:49:23.365016+0000","last_became_peered":"2024-09-14T10:49:23.365016+0000","last_unstale":"2024-09-14T12:42:07.758881+0000","last_undegraded":"2024-09-14T12:42:07.758881+0000","last_fullsized":"2024-09-14T12:42:07.758881+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.567826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28316518,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":588,"num_read_kb":160042,"num_write":1061,"num_write_kb":62525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737546+0000","last_change":"2024-09-14T10:49:27.374724+0000","last_active":"2024-09-14T12:40:14.737546+0000","last_peered":"2024-09-14T12:40:14.737546+0000","last_clean":"2024-09-14T12:40:14.737546+0000","last_became_active":"2024-09-14T10:49:27.373998+0000","last_became_peered":"2024-09-14T10:49:27.373998+0000","last_unstale":"2024-09-14T12:40:14.737546+0000","last_undegraded":"2024-09-14T12:40:14.737546+0000","last_fullsized":"2024-09-14T12:40:14.737546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:19.157690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'229","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:10.363823+0000","last_change":"2024-09-14T10:49:29.391820+0000","last_active":"2024-09-14T12:42:10.363823+0000","last_peered":"2024-09-14T12:42:10.363823+0000","last_clean":"2024-09-14T12:42:10.363823+0000","last_became_active":"2024-09-14T10:49:29.391056+0000","last_became_peered":"2024-09-14T10:49:29.391056+0000","last_unstale":"2024-09-14T12:42:10.363823+0000","last_undegraded":"2024-09-14T12:42:10.363823+0000","last_fullsized":"2024-09-14T12:42:10.363823+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:10.544422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":287,"num_read_kb":274,"num_write":212,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476208+0000","last_change":"2024-09-14T10:49:31.430127+0000","last_active":"2024-09-14T12:40:06.476208+0000","last_peered":"2024-09-14T12:40:06.476208+0000","last_clean":"2024-09-14T12:40:06.476208+0000","last_became_active":"2024-09-14T10:49:31.424769+0000","last_became_peered":"2024-09-14T10:49:31.424769+0000","last_unstale":"2024-09-14T12:40:06.476208+0000","last_undegraded":"2024-09-14T12:40:06.476208+0000","last_fullsized":"2024-09-14T12:40:06.476208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:42.138808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'129","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.097115+0000","last_change":"2024-09-14T10:49:33.469301+0000","last_active":"2024-09-14T12:42:31.097115+0000","last_peered":"2024-09-14T12:42:31.097115+0000","last_clean":"2024-09-14T12:42:31.097115+0000","last_became_active":"2024-09-14T10:49:33.468553+0000","last_became_peered":"2024-09-14T10:49:33.468553+0000","last_unstale":"2024-09-14T12:42:31.097115+0000","last_undegraded":"2024-09-14T12:42:31.097115+0000","last_fullsized":"2024-09-14T12:42:31.097115+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:38.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":228,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'553","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.456842+0000","last_change":"2024-09-14T10:49:25.381598+0000","last_active":"2024-09-14T12:42:29.456842+0000","last_peered":"2024-09-14T12:42:29.456842+0000","last_clean":"2024-09-14T12:42:29.456842+0000","last_became_active":"2024-09-14T10:49:25.379137+0000","last_became_peered":"2024-09-14T10:49:25.379137+0000","last_unstale":"2024-09-14T12:42:29.456842+0000","last_undegraded":"2024-09-14T12:42:29.456842+0000","last_fullsized":"2024-09-14T12:42:29.456842+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:41.217351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2924,"num_read_kb":2647,"num_write":735,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'302","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.144857+0000","last_change":"2024-09-14T10:49:23.389597+0000","last_active":"2024-09-14T12:40:06.144857+0000","last_peered":"2024-09-14T12:40:06.144857+0000","last_clean":"2024-09-14T12:40:06.144857+0000","last_became_active":"2024-09-14T10:49:23.389195+0000","last_became_peered":"2024-09-14T10:49:23.389195+0000","last_unstale":"2024-09-14T12:40:06.144857+0000","last_undegraded":"2024-09-14T12:40:06.144857+0000","last_fullsized":"2024-09-14T12:40:06.144857+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.064159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10717874,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":585,"num_read_kb":23841,"num_write":1092,"num_write_kb":31374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:40.575257+0000","last_change":"2024-09-14T10:49:09.318418+0000","last_active":"2024-09-14T12:41:40.575257+0000","last_peered":"2024-09-14T12:41:40.575257+0000","last_clean":"2024-09-14T12:41:40.575257+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T12:41:40.575257+0000","last_undegraded":"2024-09-14T12:41:40.575257+0000","last_fullsized":"2024-09-14T12:41:40.575257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:16.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.560955+0000","last_change":"2024-09-14T10:49:27.369178+0000","last_active":"2024-09-14T12:39:55.560955+0000","last_peered":"2024-09-14T12:39:55.560955+0000","last_clean":"2024-09-14T12:39:55.560955+0000","last_became_active":"2024-09-14T10:49:27.368412+0000","last_became_peered":"2024-09-14T10:49:27.368412+0000","last_unstale":"2024-09-14T12:39:55.560955+0000","last_undegraded":"2024-09-14T12:39:55.560955+0000","last_fullsized":"2024-09-14T12:39:55.560955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:12.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'755","reported_seq":1493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.153074+0000","last_change":"2024-09-14T10:49:29.389811+0000","last_active":"2024-09-14T12:44:04.153074+0000","last_peered":"2024-09-14T12:44:04.153074+0000","last_clean":"2024-09-14T12:44:04.153074+0000","last_became_active":"2024-09-14T10:49:29.383270+0000","last_became_peered":"2024-09-14T10:49:29.383270+0000","last_unstale":"2024-09-14T12:44:04.153074+0000","last_undegraded":"2024-09-14T12:44:04.153074+0000","last_fullsized":"2024-09-14T12:44:04.153074+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:51.681617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99398,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2001,"num_read_kb":3265,"num_write":2692,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.143642+0000","last_change":"2024-09-14T10:49:31.419150+0000","last_active":"2024-09-14T12:40:01.143642+0000","last_peered":"2024-09-14T12:40:01.143642+0000","last_clean":"2024-09-14T12:40:01.143642+0000","last_became_active":"2024-09-14T10:49:31.418385+0000","last_became_peered":"2024-09-14T10:49:31.418385+0000","last_unstale":"2024-09-14T12:40:01.143642+0000","last_undegraded":"2024-09-14T12:40:01.143642+0000","last_fullsized":"2024-09-14T12:40:01.143642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:53.967427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'130","reported_seq":662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.863696+0000","last_change":"2024-09-14T10:49:33.468510+0000","last_active":"2024-09-14T12:42:30.863696+0000","last_peered":"2024-09-14T12:42:30.863696+0000","last_clean":"2024-09-14T12:42:30.863696+0000","last_became_active":"2024-09-14T10:49:33.467268+0000","last_became_peered":"2024-09-14T10:49:33.467268+0000","last_unstale":"2024-09-14T12:42:30.863696+0000","last_undegraded":"2024-09-14T12:42:30.863696+0000","last_fullsized":"2024-09-14T12:42:30.863696+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:48.075987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":137,"num_write":301,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'744","reported_seq":2288,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560542+0000","last_change":"2024-09-14T10:49:25.378254+0000","last_active":"2024-09-14T12:41:56.560542+0000","last_peered":"2024-09-14T12:41:56.560542+0000","last_clean":"2024-09-14T12:41:56.560542+0000","last_became_active":"2024-09-14T10:49:25.377460+0000","last_became_peered":"2024-09-14T10:49:25.377460+0000","last_unstale":"2024-09-14T12:41:56.560542+0000","last_undegraded":"2024-09-14T12:41:56.560542+0000","last_fullsized":"2024-09-14T12:41:56.560542+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:40.959297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3587,"num_read_kb":3249,"num_write":953,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'288","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560585+0000","last_change":"2024-09-14T10:49:23.386787+0000","last_active":"2024-09-14T12:41:56.560585+0000","last_peered":"2024-09-14T12:41:56.560585+0000","last_clean":"2024-09-14T12:41:56.560585+0000","last_became_active":"2024-09-14T10:49:23.383686+0000","last_became_peered":"2024-09-14T10:49:23.383686+0000","last_unstale":"2024-09-14T12:41:56.560585+0000","last_undegraded":"2024-09-14T12:41:56.560585+0000","last_fullsized":"2024-09-14T12:41:56.560585+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:13.515080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8730875,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":470,"num_read_kb":8941,"num_write":1021,"num_write_kb":53511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504873+0000","last_change":"2024-09-14T10:49:09.053478+0000","last_active":"2024-09-14T12:41:56.504873+0000","last_peered":"2024-09-14T12:41:56.504873+0000","last_clean":"2024-09-14T12:41:56.504873+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T12:41:56.504873+0000","last_undegraded":"2024-09-14T12:41:56.504873+0000","last_fullsized":"2024-09-14T12:41:56.504873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.160900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.786411+0000","last_change":"2024-09-14T10:49:27.374268+0000","last_active":"2024-09-14T12:39:55.786411+0000","last_peered":"2024-09-14T12:39:55.786411+0000","last_clean":"2024-09-14T12:39:55.786411+0000","last_became_active":"2024-09-14T10:49:27.373801+0000","last_became_peered":"2024-09-14T10:49:27.373801+0000","last_unstale":"2024-09-14T12:39:55.786411+0000","last_undegraded":"2024-09-14T12:39:55.786411+0000","last_fullsized":"2024-09-14T12:39:55.786411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:26.573366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'247","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.851447+0000","last_change":"2024-09-14T10:49:29.387943+0000","last_active":"2024-09-14T12:40:15.851447+0000","last_peered":"2024-09-14T12:40:15.851447+0000","last_clean":"2024-09-14T12:40:15.851447+0000","last_became_active":"2024-09-14T10:49:29.387176+0000","last_became_peered":"2024-09-14T10:49:29.387176+0000","last_unstale":"2024-09-14T12:40:15.851447+0000","last_undegraded":"2024-09-14T12:40:15.851447+0000","last_fullsized":"2024-09-14T12:40:15.851447+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:04.926878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'792","reported_seq":3332,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:52.730993+0000","last_change":"2024-09-14T10:49:31.418103+0000","last_active":"2024-09-14T12:43:52.730993+0000","last_peered":"2024-09-14T12:43:52.730993+0000","last_clean":"2024-09-14T12:43:52.730993+0000","last_became_active":"2024-09-14T10:49:31.417376+0000","last_became_peered":"2024-09-14T10:49:31.417376+0000","last_unstale":"2024-09-14T12:43:52.730993+0000","last_undegraded":"2024-09-14T12:43:52.730993+0000","last_fullsized":"2024-09-14T12:43:52.730993+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:56.482438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'146","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.767330+0000","last_change":"2024-09-14T10:49:33.459885+0000","last_active":"2024-09-14T12:42:24.767330+0000","last_peered":"2024-09-14T12:42:24.767330+0000","last_clean":"2024-09-14T12:42:24.767330+0000","last_became_active":"2024-09-14T10:49:33.459122+0000","last_became_peered":"2024-09-14T10:49:33.459122+0000","last_unstale":"2024-09-14T12:42:24.767330+0000","last_undegraded":"2024-09-14T12:42:24.767330+0000","last_fullsized":"2024-09-14T12:42:24.767330+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:50.717373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":355,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'838","reported_seq":2546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.586893+0000","last_change":"2024-09-14T10:49:25.361390+0000","last_active":"2024-09-14T12:41:55.586893+0000","last_peered":"2024-09-14T12:41:55.586893+0000","last_clean":"2024-09-14T12:41:55.586893+0000","last_became_active":"2024-09-14T10:49:25.360655+0000","last_became_peered":"2024-09-14T10:49:25.360655+0000","last_unstale":"2024-09-14T12:41:55.586893+0000","last_undegraded":"2024-09-14T12:41:55.586893+0000","last_fullsized":"2024-09-14T12:41:55.586893+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:50.719358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4101,"num_read_kb":3716,"num_write":1090,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'379","reported_seq":1086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.561098+0000","last_change":"2024-09-14T10:49:23.361586+0000","last_active":"2024-09-14T12:39:55.561098+0000","last_peered":"2024-09-14T12:39:55.561098+0000","last_clean":"2024-09-14T12:39:55.561098+0000","last_became_active":"2024-09-14T10:49:23.359442+0000","last_became_peered":"2024-09-14T10:49:23.359442+0000","last_unstale":"2024-09-14T12:39:55.561098+0000","last_undegraded":"2024-09-14T12:39:55.561098+0000","last_fullsized":"2024-09-14T12:39:55.561098+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.017232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15319025,"num_objects":91,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":745,"num_read_kb":31084,"num_write":1277,"num_write_kb":31792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585909+0000","last_change":"2024-09-14T10:49:09.044027+0000","last_active":"2024-09-14T12:41:50.585909+0000","last_peered":"2024-09-14T12:41:50.585909+0000","last_clean":"2024-09-14T12:41:50.585909+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T12:41:50.585909+0000","last_undegraded":"2024-09-14T12:41:50.585909+0000","last_fullsized":"2024-09-14T12:41:50.585909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:42.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.473776+0000","last_change":"2024-09-14T10:49:27.385279+0000","last_active":"2024-09-14T12:39:56.473776+0000","last_peered":"2024-09-14T12:39:56.473776+0000","last_clean":"2024-09-14T12:39:56.473776+0000","last_became_active":"2024-09-14T10:49:27.384635+0000","last_became_peered":"2024-09-14T10:49:27.384635+0000","last_unstale":"2024-09-14T12:39:56.473776+0000","last_undegraded":"2024-09-14T12:39:56.473776+0000","last_fullsized":"2024-09-14T12:39:56.473776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.745658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'179","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.412351+0000","last_change":"2024-09-14T10:49:29.397010+0000","last_active":"2024-09-14T12:40:15.412351+0000","last_peered":"2024-09-14T12:40:15.412351+0000","last_clean":"2024-09-14T12:40:15.412351+0000","last_became_active":"2024-09-14T10:49:29.394105+0000","last_became_peered":"2024-09-14T10:49:29.394105+0000","last_unstale":"2024-09-14T12:40:15.412351+0000","last_undegraded":"2024-09-14T12:40:15.412351+0000","last_fullsized":"2024-09-14T12:40:15.412351+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:23.758962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'824","reported_seq":3139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105369+0000","last_change":"2024-09-14T10:49:31.411841+0000","last_active":"2024-09-14T12:43:49.105369+0000","last_peered":"2024-09-14T12:43:49.105369+0000","last_clean":"2024-09-14T12:43:49.105369+0000","last_became_active":"2024-09-14T10:49:31.411055+0000","last_became_peered":"2024-09-14T10:49:31.411055+0000","last_unstale":"2024-09-14T12:43:49.105369+0000","last_undegraded":"2024-09-14T12:43:49.105369+0000","last_fullsized":"2024-09-14T12:43:49.105369+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:46.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'269","reported_seq":814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.548982+0000","last_change":"2024-09-14T10:49:33.457595+0000","last_active":"2024-09-14T12:39:50.548982+0000","last_peered":"2024-09-14T12:39:50.548982+0000","last_clean":"2024-09-14T12:39:50.548982+0000","last_became_active":"2024-09-14T10:49:33.456806+0000","last_became_peered":"2024-09-14T10:49:33.456806+0000","last_unstale":"2024-09-14T12:39:50.548982+0000","last_undegraded":"2024-09-14T12:39:50.548982+0000","last_fullsized":"2024-09-14T12:39:50.548982+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:15.247749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":331,"num_read_kb":330,"num_write":580,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'499","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.457164+0000","last_change":"2024-09-14T10:49:25.373350+0000","last_active":"2024-09-14T12:42:29.457164+0000","last_peered":"2024-09-14T12:42:29.457164+0000","last_clean":"2024-09-14T12:42:29.457164+0000","last_became_active":"2024-09-14T10:49:25.372923+0000","last_became_peered":"2024-09-14T10:49:25.372923+0000","last_unstale":"2024-09-14T12:42:29.457164+0000","last_undegraded":"2024-09-14T12:42:29.457164+0000","last_fullsized":"2024-09-14T12:42:29.457164+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:38.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2643,"num_read_kb":2487,"num_write":591,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'293","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.561028+0000","last_change":"2024-09-14T10:49:23.346381+0000","last_active":"2024-09-14T12:39:55.561028+0000","last_peered":"2024-09-14T12:39:55.561028+0000","last_clean":"2024-09-14T12:39:55.561028+0000","last_became_active":"2024-09-14T10:49:23.344863+0000","last_became_peered":"2024-09-14T10:49:23.344863+0000","last_unstale":"2024-09-14T12:39:55.561028+0000","last_undegraded":"2024-09-14T12:39:55.561028+0000","last_fullsized":"2024-09-14T12:39:55.561028+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:12.876419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6333334,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":497,"num_read_kb":37228,"num_write":1020,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503382+0000","last_change":"2024-09-14T10:49:09.054207+0000","last_active":"2024-09-14T12:41:51.503382+0000","last_peered":"2024-09-14T12:41:51.503382+0000","last_clean":"2024-09-14T12:41:51.503382+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T12:41:51.503382+0000","last_undegraded":"2024-09-14T12:41:51.503382+0000","last_fullsized":"2024-09-14T12:41:51.503382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.696418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.588173+0000","last_change":"2024-09-14T10:49:27.380671+0000","last_active":"2024-09-14T12:42:00.588173+0000","last_peered":"2024-09-14T12:42:00.588173+0000","last_clean":"2024-09-14T12:42:00.588173+0000","last_became_active":"2024-09-14T10:49:27.379820+0000","last_became_peered":"2024-09-14T10:49:27.379820+0000","last_unstale":"2024-09-14T12:42:00.588173+0000","last_undegraded":"2024-09-14T12:42:00.588173+0000","last_fullsized":"2024-09-14T12:42:00.588173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:08.601000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'834","reported_seq":1614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.589148+0000","last_change":"2024-09-14T10:49:29.390161+0000","last_active":"2024-09-14T12:43:48.589148+0000","last_peered":"2024-09-14T12:43:48.589148+0000","last_clean":"2024-09-14T12:43:48.589148+0000","last_became_active":"2024-09-14T10:49:29.389500+0000","last_became_peered":"2024-09-14T10:49:29.389500+0000","last_unstale":"2024-09-14T12:43:48.589148+0000","last_undegraded":"2024-09-14T12:43:48.589148+0000","last_fullsized":"2024-09-14T12:43:48.589148+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:43.125499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196422,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1468,"num_read_kb":3084,"num_write":1208,"num_write_kb":978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.562166+0000","last_change":"2024-09-14T10:49:31.413780+0000","last_active":"2024-09-14T12:40:00.562166+0000","last_peered":"2024-09-14T12:40:00.562166+0000","last_clean":"2024-09-14T12:40:00.562166+0000","last_became_active":"2024-09-14T10:49:31.413008+0000","last_became_peered":"2024-09-14T10:49:31.413008+0000","last_unstale":"2024-09-14T12:40:00.562166+0000","last_undegraded":"2024-09-14T12:40:00.562166+0000","last_fullsized":"2024-09-14T12:40:00.562166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:58.384037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.643169+0000","last_change":"2024-09-14T10:49:33.471643+0000","last_active":"2024-09-14T12:42:31.643169+0000","last_peered":"2024-09-14T12:42:31.643169+0000","last_clean":"2024-09-14T12:42:31.643169+0000","last_became_active":"2024-09-14T10:49:33.468546+0000","last_became_peered":"2024-09-14T10:49:33.468546+0000","last_unstale":"2024-09-14T12:42:31.643169+0000","last_undegraded":"2024-09-14T12:42:31.643169+0000","last_fullsized":"2024-09-14T12:42:31.643169+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.990777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'160","reported_seq":765,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.764101+0000","last_change":"2024-09-14T10:49:33.462576+0000","last_active":"2024-09-14T12:42:29.764101+0000","last_peered":"2024-09-14T12:42:29.764101+0000","last_clean":"2024-09-14T12:42:29.764101+0000","last_became_active":"2024-09-14T10:49:33.461782+0000","last_became_peered":"2024-09-14T10:49:33.461782+0000","last_unstale":"2024-09-14T12:42:29.764101+0000","last_undegraded":"2024-09-14T12:42:29.764101+0000","last_fullsized":"2024-09-14T12:42:29.764101+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:38.902854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":264,"num_write":397,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'521","reported_seq":2247,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.163802+0000","last_change":"2024-09-14T10:49:25.381899+0000","last_active":"2024-09-14T12:41:26.163802+0000","last_peered":"2024-09-14T12:41:26.163802+0000","last_clean":"2024-09-14T12:41:26.163802+0000","last_became_active":"2024-09-14T10:49:25.381653+0000","last_became_peered":"2024-09-14T10:49:25.381653+0000","last_unstale":"2024-09-14T12:41:26.163802+0000","last_undegraded":"2024-09-14T12:41:26.163802+0000","last_fullsized":"2024-09-14T12:41:26.163802+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:01.827788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2737,"num_read_kb":2577,"num_write":621,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'301","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500472+0000","last_change":"2024-09-14T10:49:23.365867+0000","last_active":"2024-09-14T12:41:41.500472+0000","last_peered":"2024-09-14T12:41:41.500472+0000","last_clean":"2024-09-14T12:41:41.500472+0000","last_became_active":"2024-09-14T10:49:23.365341+0000","last_became_peered":"2024-09-14T10:49:23.365341+0000","last_unstale":"2024-09-14T12:41:41.500472+0000","last_undegraded":"2024-09-14T12:41:41.500472+0000","last_fullsized":"2024-09-14T12:41:41.500472+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:00.255631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10074569,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":607,"num_read_kb":37656,"num_write":1053,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.554957+0000","last_change":"2024-09-14T10:49:27.368112+0000","last_active":"2024-09-14T12:41:31.554957+0000","last_peered":"2024-09-14T12:41:31.554957+0000","last_clean":"2024-09-14T12:41:31.554957+0000","last_became_active":"2024-09-14T10:49:27.366990+0000","last_became_peered":"2024-09-14T10:49:27.366990+0000","last_unstale":"2024-09-14T12:41:31.554957+0000","last_undegraded":"2024-09-14T12:41:31.554957+0000","last_fullsized":"2024-09-14T12:41:31.554957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.945759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'330","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.617729+0000","last_change":"2024-09-14T10:49:29.372907+0000","last_active":"2024-09-14T12:43:48.617729+0000","last_peered":"2024-09-14T12:43:48.617729+0000","last_clean":"2024-09-14T12:43:48.617729+0000","last_became_active":"2024-09-14T10:49:29.371655+0000","last_became_peered":"2024-09-14T10:49:29.371655+0000","last_unstale":"2024-09-14T12:43:48.617729+0000","last_undegraded":"2024-09-14T12:43:48.617729+0000","last_fullsized":"2024-09-14T12:43:48.617729+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:51.332753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61251,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1050,"num_write":434,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755605+0000","last_change":"2024-09-14T10:49:31.418572+0000","last_active":"2024-09-14T12:41:34.755605+0000","last_peered":"2024-09-14T12:41:34.755605+0000","last_clean":"2024-09-14T12:41:34.755605+0000","last_became_active":"2024-09-14T10:49:31.417675+0000","last_became_peered":"2024-09-14T10:49:31.417675+0000","last_unstale":"2024-09-14T12:41:34.755605+0000","last_undegraded":"2024-09-14T12:41:34.755605+0000","last_fullsized":"2024-09-14T12:41:34.755605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:42.817490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'145","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.663503+0000","last_change":"2024-09-14T10:49:33.454370+0000","last_active":"2024-09-14T12:43:47.663503+0000","last_peered":"2024-09-14T12:43:47.663503+0000","last_clean":"2024-09-14T12:43:47.663503+0000","last_became_active":"2024-09-14T10:49:33.453630+0000","last_became_peered":"2024-09-14T10:49:33.453630+0000","last_unstale":"2024-09-14T12:43:47.663503+0000","last_undegraded":"2024-09-14T12:43:47.663503+0000","last_fullsized":"2024-09-14T12:43:47.663503+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:55.786343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":363,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'722","reported_seq":2161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.580335+0000","last_change":"2024-09-14T10:49:25.374565+0000","last_active":"2024-09-14T12:41:25.580335+0000","last_peered":"2024-09-14T12:41:25.580335+0000","last_clean":"2024-09-14T12:41:25.580335+0000","last_became_active":"2024-09-14T10:49:25.373876+0000","last_became_peered":"2024-09-14T10:49:25.373876+0000","last_unstale":"2024-09-14T12:41:25.580335+0000","last_undegraded":"2024-09-14T12:41:25.580335+0000","last_fullsized":"2024-09-14T12:41:25.580335+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:31.592836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3124,"num_write":967,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'273","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795748+0000","last_change":"2024-09-14T10:49:23.373710+0000","last_active":"2024-09-14T12:40:35.795748+0000","last_peered":"2024-09-14T12:40:35.795748+0000","last_clean":"2024-09-14T12:40:35.795748+0000","last_became_active":"2024-09-14T10:49:23.373206+0000","last_became_peered":"2024-09-14T10:49:23.373206+0000","last_unstale":"2024-09-14T12:40:35.795748+0000","last_undegraded":"2024-09-14T12:40:35.795748+0000","last_fullsized":"2024-09-14T12:40:35.795748+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:03.253858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489973,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":579,"num_read_kb":34264,"num_write":987,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581474+0000","last_change":"2024-09-14T10:49:27.371401+0000","last_active":"2024-09-14T12:41:30.581474+0000","last_peered":"2024-09-14T12:41:30.581474+0000","last_clean":"2024-09-14T12:41:30.581474+0000","last_became_active":"2024-09-14T10:49:27.370174+0000","last_became_peered":"2024-09-14T10:49:27.370174+0000","last_unstale":"2024-09-14T12:41:30.581474+0000","last_undegraded":"2024-09-14T12:41:30.581474+0000","last_fullsized":"2024-09-14T12:41:30.581474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.300623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581354+0000","last_change":"2024-09-14T10:49:29.376404+0000","last_active":"2024-09-14T12:41:30.581354+0000","last_peered":"2024-09-14T12:41:30.581354+0000","last_clean":"2024-09-14T12:41:30.581354+0000","last_became_active":"2024-09-14T10:49:29.375761+0000","last_became_peered":"2024-09-14T10:49:29.375761+0000","last_unstale":"2024-09-14T12:41:30.581354+0000","last_undegraded":"2024-09-14T12:41:30.581354+0000","last_fullsized":"2024-09-14T12:41:30.581354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:47.597945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:36.165985+0000","last_change":"2024-09-14T10:49:31.411967+0000","last_active":"2024-09-14T12:41:36.165985+0000","last_peered":"2024-09-14T12:41:36.165985+0000","last_clean":"2024-09-14T12:41:36.165985+0000","last_became_active":"2024-09-14T10:49:31.410915+0000","last_became_peered":"2024-09-14T10:49:31.410915+0000","last_unstale":"2024-09-14T12:41:36.165985+0000","last_undegraded":"2024-09-14T12:41:36.165985+0000","last_fullsized":"2024-09-14T12:41:36.165985+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:52.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'179","reported_seq":721,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.366754+0000","last_change":"2024-09-14T10:49:33.454043+0000","last_active":"2024-09-14T12:42:29.366754+0000","last_peered":"2024-09-14T12:42:29.366754+0000","last_clean":"2024-09-14T12:42:29.366754+0000","last_became_active":"2024-09-14T10:49:33.453278+0000","last_became_peered":"2024-09-14T10:49:33.453278+0000","last_unstale":"2024-09-14T12:42:29.366754+0000","last_undegraded":"2024-09-14T12:42:29.366754+0000","last_fullsized":"2024-09-14T12:42:29.366754+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:00.597295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":265,"num_write":381,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'431","reported_seq":2071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.579695+0000","last_change":"2024-09-14T10:49:25.353852+0000","last_active":"2024-09-14T12:41:29.579695+0000","last_peered":"2024-09-14T12:41:29.579695+0000","last_clean":"2024-09-14T12:41:29.579695+0000","last_became_active":"2024-09-14T10:49:25.353010+0000","last_became_peered":"2024-09-14T10:49:25.353010+0000","last_unstale":"2024-09-14T12:41:29.579695+0000","last_undegraded":"2024-09-14T12:41:29.579695+0000","last_fullsized":"2024-09-14T12:41:29.579695+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:33.291317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2606,"num_read_kb":2470,"num_write":495,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'293","reported_seq":1012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:15.686441+0000","last_change":"2024-09-14T10:49:23.404260+0000","last_active":"2024-09-14T12:41:15.686441+0000","last_peered":"2024-09-14T12:41:15.686441+0000","last_clean":"2024-09-14T12:41:15.686441+0000","last_became_active":"2024-09-14T10:49:23.403718+0000","last_became_peered":"2024-09-14T10:49:23.403718+0000","last_unstale":"2024-09-14T12:41:15.686441+0000","last_undegraded":"2024-09-14T12:41:15.686441+0000","last_fullsized":"2024-09-14T12:41:15.686441+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:18.065436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6885332,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":662,"num_read_kb":4161,"num_write":997,"num_write_kb":34340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164879+0000","last_change":"2024-09-14T10:49:27.378466+0000","last_active":"2024-09-14T12:41:31.164879+0000","last_peered":"2024-09-14T12:41:31.164879+0000","last_clean":"2024-09-14T12:41:31.164879+0000","last_became_active":"2024-09-14T10:49:27.377584+0000","last_became_peered":"2024-09-14T10:49:27.377584+0000","last_unstale":"2024-09-14T12:41:31.164879+0000","last_undegraded":"2024-09-14T12:41:31.164879+0000","last_fullsized":"2024-09-14T12:41:31.164879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:00.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'387","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.040268+0000","last_change":"2024-09-14T10:49:29.390323+0000","last_active":"2024-09-14T12:44:02.040268+0000","last_peered":"2024-09-14T12:44:02.040268+0000","last_clean":"2024-09-14T12:44:02.040268+0000","last_became_active":"2024-09-14T10:49:29.389523+0000","last_became_peered":"2024-09-14T10:49:29.389523+0000","last_unstale":"2024-09-14T12:44:02.040268+0000","last_undegraded":"2024-09-14T12:44:02.040268+0000","last_fullsized":"2024-09-14T12:44:02.040268+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:19.414203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":1411,"num_write":516,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.561781+0000","last_change":"2024-09-14T10:49:31.422662+0000","last_active":"2024-09-14T12:41:35.561781+0000","last_peered":"2024-09-14T12:41:35.561781+0000","last_clean":"2024-09-14T12:41:35.561781+0000","last_became_active":"2024-09-14T10:49:31.422113+0000","last_became_peered":"2024-09-14T10:49:31.422113+0000","last_unstale":"2024-09-14T12:41:35.561781+0000","last_undegraded":"2024-09-14T12:41:35.561781+0000","last_fullsized":"2024-09-14T12:41:35.561781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:51.224760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'154","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468918+0000","last_change":"2024-09-14T10:49:33.476247+0000","last_active":"2024-09-14T12:39:36.468918+0000","last_peered":"2024-09-14T12:39:36.468918+0000","last_clean":"2024-09-14T12:39:36.468918+0000","last_became_active":"2024-09-14T10:49:33.475156+0000","last_became_peered":"2024-09-14T10:49:33.475156+0000","last_unstale":"2024-09-14T12:39:36.468918+0000","last_undegraded":"2024-09-14T12:39:36.468918+0000","last_fullsized":"2024-09-14T12:39:36.468918+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:09.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'411","reported_seq":2093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.754459+0000","last_change":"2024-09-14T10:49:25.371715+0000","last_active":"2024-09-14T12:41:29.754459+0000","last_peered":"2024-09-14T12:41:29.754459+0000","last_clean":"2024-09-14T12:41:29.754459+0000","last_became_active":"2024-09-14T10:49:25.370901+0000","last_became_peered":"2024-09-14T10:49:25.370901+0000","last_unstale":"2024-09-14T12:41:29.754459+0000","last_undegraded":"2024-09-14T12:41:29.754459+0000","last_fullsized":"2024-09-14T12:41:29.754459+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:49.373960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2274,"num_write":465,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'321","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559911+0000","last_change":"2024-09-14T10:49:23.370421+0000","last_active":"2024-09-14T12:40:35.559911+0000","last_peered":"2024-09-14T12:40:35.559911+0000","last_clean":"2024-09-14T12:40:35.559911+0000","last_became_active":"2024-09-14T10:49:23.369669+0000","last_became_peered":"2024-09-14T10:49:23.369669+0000","last_unstale":"2024-09-14T12:40:35.559911+0000","last_undegraded":"2024-09-14T12:40:35.559911+0000","last_fullsized":"2024-09-14T12:40:35.559911+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:37.860070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14752595,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":717,"num_read_kb":9967,"num_write":1297,"num_write_kb":36861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.498091+0000","last_change":"2024-09-14T10:49:27.388330+0000","last_active":"2024-09-14T12:41:31.498091+0000","last_peered":"2024-09-14T12:41:31.498091+0000","last_clean":"2024-09-14T12:41:31.498091+0000","last_became_active":"2024-09-14T10:49:27.387840+0000","last_became_peered":"2024-09-14T10:49:27.387840+0000","last_unstale":"2024-09-14T12:41:31.498091+0000","last_undegraded":"2024-09-14T12:41:31.498091+0000","last_fullsized":"2024-09-14T12:41:31.498091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:31.040634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'319","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.585470+0000","last_change":"2024-09-14T10:49:29.392053+0000","last_active":"2024-09-14T12:43:48.585470+0000","last_peered":"2024-09-14T12:43:48.585470+0000","last_clean":"2024-09-14T12:43:48.585470+0000","last_became_active":"2024-09-14T10:49:29.391517+0000","last_became_peered":"2024-09-14T10:49:29.391517+0000","last_unstale":"2024-09-14T12:43:48.585470+0000","last_undegraded":"2024-09-14T12:43:48.585470+0000","last_fullsized":"2024-09-14T12:43:48.585470+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:03.721336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":1268,"num_write":432,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755694+0000","last_change":"2024-09-14T10:49:31.411523+0000","last_active":"2024-09-14T12:41:34.755694+0000","last_peered":"2024-09-14T12:41:34.755694+0000","last_clean":"2024-09-14T12:41:34.755694+0000","last_became_active":"2024-09-14T10:49:31.410633+0000","last_became_peered":"2024-09-14T10:49:31.410633+0000","last_unstale":"2024-09-14T12:41:34.755694+0000","last_undegraded":"2024-09-14T12:41:34.755694+0000","last_fullsized":"2024-09-14T12:41:34.755694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:56.976562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'747","reported_seq":2283,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.505119+0000","last_change":"2024-09-14T10:49:25.408540+0000","last_active":"2024-09-14T12:41:56.505119+0000","last_peered":"2024-09-14T12:41:56.505119+0000","last_clean":"2024-09-14T12:41:56.505119+0000","last_became_active":"2024-09-14T10:49:25.408028+0000","last_became_peered":"2024-09-14T10:49:25.408028+0000","last_unstale":"2024-09-14T12:41:56.505119+0000","last_undegraded":"2024-09-14T12:41:56.505119+0000","last_fullsized":"2024-09-14T12:41:56.505119+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:24.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3658,"num_read_kb":3304,"num_write":985,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'312","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:27.422883+0000","last_change":"2024-09-14T10:49:23.387201+0000","last_active":"2024-09-14T12:41:27.422883+0000","last_peered":"2024-09-14T12:41:27.422883+0000","last_clean":"2024-09-14T12:41:27.422883+0000","last_became_active":"2024-09-14T10:49:23.386404+0000","last_became_peered":"2024-09-14T10:49:23.386404+0000","last_unstale":"2024-09-14T12:41:27.422883+0000","last_undegraded":"2024-09-14T12:41:27.422883+0000","last_fullsized":"2024-09-14T12:41:27.422883+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:38.147399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9214153,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":614,"num_read_kb":6911,"num_write":1144,"num_write_kb":32272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:51.586033+0000","last_change":"2024-09-14T10:49:27.382769+0000","last_active":"2024-09-14T12:43:51.586033+0000","last_peered":"2024-09-14T12:43:51.586033+0000","last_clean":"2024-09-14T12:43:51.586033+0000","last_became_active":"2024-09-14T10:49:27.381931+0000","last_became_peered":"2024-09-14T10:49:27.381931+0000","last_unstale":"2024-09-14T12:43:51.586033+0000","last_undegraded":"2024-09-14T12:43:51.586033+0000","last_fullsized":"2024-09-14T12:43:51.586033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:55.209752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":730,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'546","reported_seq":1208,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.583410+0000","last_change":"2024-09-14T10:49:29.364784+0000","last_active":"2024-09-14T12:43:48.583410+0000","last_peered":"2024-09-14T12:43:48.583410+0000","last_clean":"2024-09-14T12:43:48.583410+0000","last_became_active":"2024-09-14T10:49:29.364013+0000","last_became_peered":"2024-09-14T10:49:29.364013+0000","last_unstale":"2024-09-14T12:43:48.583410+0000","last_undegraded":"2024-09-14T12:43:48.583410+0000","last_fullsized":"2024-09-14T12:43:48.583410+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:14.626395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":938,"num_read_kb":1929,"num_write":824,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.137434+0000","last_change":"2024-09-14T10:49:31.432562+0000","last_active":"2024-09-14T12:39:36.137434+0000","last_peered":"2024-09-14T12:39:36.137434+0000","last_clean":"2024-09-14T12:39:36.137434+0000","last_became_active":"2024-09-14T10:49:31.431550+0000","last_became_peered":"2024-09-14T10:49:31.431550+0000","last_unstale":"2024-09-14T12:39:36.137434+0000","last_undegraded":"2024-09-14T12:39:36.137434+0000","last_fullsized":"2024-09-14T12:39:36.137434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:21.094996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'162","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.573998+0000","last_change":"2024-09-14T10:49:33.467050+0000","last_active":"2024-09-14T12:41:35.573998+0000","last_peered":"2024-09-14T12:41:35.573998+0000","last_clean":"2024-09-14T12:41:35.573998+0000","last_became_active":"2024-09-14T10:49:33.466424+0000","last_became_peered":"2024-09-14T10:49:33.466424+0000","last_unstale":"2024-09-14T12:41:35.573998+0000","last_undegraded":"2024-09-14T12:41:35.573998+0000","last_fullsized":"2024-09-14T12:41:35.573998+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:16.563193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":247,"num_write":384,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'832","reported_seq":2406,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.767765+0000","last_change":"2024-09-14T10:49:25.367610+0000","last_active":"2024-09-14T12:42:31.767765+0000","last_peered":"2024-09-14T12:42:31.767765+0000","last_clean":"2024-09-14T12:42:31.767765+0000","last_became_active":"2024-09-14T10:49:25.364958+0000","last_became_peered":"2024-09-14T10:49:25.364958+0000","last_unstale":"2024-09-14T12:42:31.767765+0000","last_undegraded":"2024-09-14T12:42:31.767765+0000","last_fullsized":"2024-09-14T12:42:31.767765+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:15.525950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3911,"num_read_kb":3508,"num_write":1119,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'341","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:37.080833+0000","last_change":"2024-09-14T10:49:23.378450+0000","last_active":"2024-09-14T12:43:37.080833+0000","last_peered":"2024-09-14T12:43:37.080833+0000","last_clean":"2024-09-14T12:43:37.080833+0000","last_became_active":"2024-09-14T10:49:23.375310+0000","last_became_peered":"2024-09-14T10:49:23.375310+0000","last_unstale":"2024-09-14T12:43:37.080833+0000","last_undegraded":"2024-09-14T12:43:37.080833+0000","last_fullsized":"2024-09-14T12:43:37.080833+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:47.638057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22018826,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":753,"num_read_kb":30362,"num_write":1144,"num_write_kb":52321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'5","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.501490+0000","last_change":"2024-09-14T10:49:27.386902+0000","last_active":"2024-09-14T12:43:48.501490+0000","last_peered":"2024-09-14T12:43:48.501490+0000","last_clean":"2024-09-14T12:43:48.501490+0000","last_became_active":"2024-09-14T10:49:27.386412+0000","last_became_peered":"2024-09-14T10:49:27.386412+0000","last_unstale":"2024-09-14T12:43:48.501490+0000","last_undegraded":"2024-09-14T12:43:48.501490+0000","last_fullsized":"2024-09-14T12:43:48.501490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:24.661084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'353","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506319+0000","last_change":"2024-09-14T10:49:29.388733+0000","last_active":"2024-09-14T12:42:01.506319+0000","last_peered":"2024-09-14T12:42:01.506319+0000","last_clean":"2024-09-14T12:42:01.506319+0000","last_became_active":"2024-09-14T10:49:29.388370+0000","last_became_peered":"2024-09-14T10:49:29.388370+0000","last_unstale":"2024-09-14T12:42:01.506319+0000","last_undegraded":"2024-09-14T12:42:01.506319+0000","last_fullsized":"2024-09-14T12:42:01.506319+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.037315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46625,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":564,"num_read_kb":950,"num_write":456,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.545289+0000","last_change":"2024-09-14T10:49:31.430532+0000","last_active":"2024-09-14T12:39:35.545289+0000","last_peered":"2024-09-14T12:39:35.545289+0000","last_clean":"2024-09-14T12:39:35.545289+0000","last_became_active":"2024-09-14T10:49:31.429861+0000","last_became_peered":"2024-09-14T10:49:31.429861+0000","last_unstale":"2024-09-14T12:39:35.545289+0000","last_undegraded":"2024-09-14T12:39:35.545289+0000","last_fullsized":"2024-09-14T12:39:35.545289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:13.932023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'278","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.559029+0000","last_change":"2024-09-14T10:49:33.451361+0000","last_active":"2024-09-14T12:42:24.559029+0000","last_peered":"2024-09-14T12:42:24.559029+0000","last_clean":"2024-09-14T12:42:24.559029+0000","last_became_active":"2024-09-14T10:49:33.446698+0000","last_became_peered":"2024-09-14T10:49:33.446698+0000","last_unstale":"2024-09-14T12:42:24.559029+0000","last_undegraded":"2024-09-14T12:42:24.559029+0000","last_fullsized":"2024-09-14T12:42:24.559029+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:44.754797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":288,"num_write":643,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'442","reported_seq":2142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.508259+0000","last_change":"2024-09-14T10:49:25.396269+0000","last_active":"2024-09-14T12:39:44.508259+0000","last_peered":"2024-09-14T12:39:44.508259+0000","last_clean":"2024-09-14T12:39:44.508259+0000","last_became_active":"2024-09-14T10:49:25.395644+0000","last_became_peered":"2024-09-14T10:49:25.395644+0000","last_unstale":"2024-09-14T12:39:44.508259+0000","last_undegraded":"2024-09-14T12:39:44.508259+0000","last_fullsized":"2024-09-14T12:39:44.508259+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:11.713387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2723,"num_read_kb":2577,"num_write":520,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'282","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:07.338108+0000","last_change":"2024-09-14T10:49:23.395500+0000","last_active":"2024-09-14T12:40:07.338108+0000","last_peered":"2024-09-14T12:40:07.338108+0000","last_clean":"2024-09-14T12:40:07.338108+0000","last_became_active":"2024-09-14T10:49:23.394870+0000","last_became_peered":"2024-09-14T10:49:23.394870+0000","last_unstale":"2024-09-14T12:40:07.338108+0000","last_undegraded":"2024-09-14T12:40:07.338108+0000","last_fullsized":"2024-09-14T12:40:07.338108+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:09.297899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4540402,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":553,"num_read_kb":18368,"num_write":1036,"num_write_kb":30203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136301+0000","last_change":"2024-09-14T10:49:27.387706+0000","last_active":"2024-09-14T12:39:31.136301+0000","last_peered":"2024-09-14T12:39:31.136301+0000","last_clean":"2024-09-14T12:39:31.136301+0000","last_became_active":"2024-09-14T10:49:27.385720+0000","last_became_peered":"2024-09-14T10:49:27.385720+0000","last_unstale":"2024-09-14T12:39:31.136301+0000","last_undegraded":"2024-09-14T12:39:31.136301+0000","last_fullsized":"2024-09-14T12:39:31.136301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:41.338079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'333","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561794+0000","last_change":"2024-09-14T10:49:29.364739+0000","last_active":"2024-09-14T12:42:01.561794+0000","last_peered":"2024-09-14T12:42:01.561794+0000","last_clean":"2024-09-14T12:42:01.561794+0000","last_became_active":"2024-09-14T10:49:29.363989+0000","last_became_peered":"2024-09-14T10:49:29.363989+0000","last_unstale":"2024-09-14T12:42:01.561794+0000","last_undegraded":"2024-09-14T12:42:01.561794+0000","last_fullsized":"2024-09-14T12:42:01.561794+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:11.406587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56407,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":525,"num_read_kb":1007,"num_write":416,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760421+0000","last_change":"2024-09-14T10:49:31.423380+0000","last_active":"2024-09-14T12:41:54.760421+0000","last_peered":"2024-09-14T12:41:54.760421+0000","last_clean":"2024-09-14T12:41:54.760421+0000","last_became_active":"2024-09-14T10:49:31.421636+0000","last_became_peered":"2024-09-14T10:49:31.421636+0000","last_unstale":"2024-09-14T12:41:54.760421+0000","last_undegraded":"2024-09-14T12:41:54.760421+0000","last_fullsized":"2024-09-14T12:41:54.760421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:30.278841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.656575+0000","last_change":"2024-09-14T10:49:33.466507+0000","last_active":"2024-09-14T12:43:48.656575+0000","last_peered":"2024-09-14T12:43:48.656575+0000","last_clean":"2024-09-14T12:43:48.656575+0000","last_became_active":"2024-09-14T10:49:33.465638+0000","last_became_peered":"2024-09-14T10:49:33.465638+0000","last_unstale":"2024-09-14T12:43:48.656575+0000","last_undegraded":"2024-09-14T12:43:48.656575+0000","last_fullsized":"2024-09-14T12:43:48.656575+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:13.972982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'566","reported_seq":2222,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.703947+0000","last_change":"2024-09-14T10:49:25.384614+0000","last_active":"2024-09-14T12:42:31.703947+0000","last_peered":"2024-09-14T12:42:31.703947+0000","last_clean":"2024-09-14T12:42:31.703947+0000","last_became_active":"2024-09-14T10:49:25.383840+0000","last_became_peered":"2024-09-14T10:49:25.383840+0000","last_unstale":"2024-09-14T12:42:31.703947+0000","last_undegraded":"2024-09-14T12:42:31.703947+0000","last_fullsized":"2024-09-14T12:42:31.703947+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:21.627271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2923,"num_read_kb":2712,"num_write":720,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'399","reported_seq":1100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:34.760157+0000","last_change":"2024-09-14T10:49:23.340003+0000","last_active":"2024-09-14T12:39:34.760157+0000","last_peered":"2024-09-14T12:39:34.760157+0000","last_clean":"2024-09-14T12:39:34.760157+0000","last_became_active":"2024-09-14T10:49:23.338934+0000","last_became_peered":"2024-09-14T10:49:23.338934+0000","last_unstale":"2024-09-14T12:39:34.760157+0000","last_undegraded":"2024-09-14T12:39:34.760157+0000","last_fullsized":"2024-09-14T12:39:34.760157+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:53.526708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14158597,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":771,"num_read_kb":33265,"num_write":1244,"num_write_kb":49842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:30.555291+0000","last_change":"2024-09-14T10:49:27.369319+0000","last_active":"2024-09-14T12:39:30.555291+0000","last_peered":"2024-09-14T12:39:30.555291+0000","last_clean":"2024-09-14T12:39:30.555291+0000","last_became_active":"2024-09-14T10:49:27.368567+0000","last_became_peered":"2024-09-14T10:49:27.368567+0000","last_unstale":"2024-09-14T12:39:30.555291+0000","last_undegraded":"2024-09-14T12:39:30.555291+0000","last_fullsized":"2024-09-14T12:39:30.555291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:50.967591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'149","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:46.501799+0000","last_change":"2024-09-14T10:49:29.393578+0000","last_active":"2024-09-14T12:41:46.501799+0000","last_peered":"2024-09-14T12:41:46.501799+0000","last_clean":"2024-09-14T12:41:46.501799+0000","last_became_active":"2024-09-14T10:49:29.392965+0000","last_became_peered":"2024-09-14T10:49:29.392965+0000","last_unstale":"2024-09-14T12:41:46.501799+0000","last_undegraded":"2024-09-14T12:41:46.501799+0000","last_fullsized":"2024-09-14T12:41:46.501799+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.416866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":187,"num_read_kb":181,"num_write":132,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'788","reported_seq":3261,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.100675+0000","last_change":"2024-09-14T10:49:31.423609+0000","last_active":"2024-09-14T12:43:49.100675+0000","last_peered":"2024-09-14T12:43:49.100675+0000","last_clean":"2024-09-14T12:43:49.100675+0000","last_became_active":"2024-09-14T10:49:31.422765+0000","last_became_peered":"2024-09-14T10:49:31.422765+0000","last_unstale":"2024-09-14T12:43:49.100675+0000","last_undegraded":"2024-09-14T12:43:49.100675+0000","last_fullsized":"2024-09-14T12:43:49.100675+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:06.381324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'100","reported_seq":619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:27.666413+0000","last_change":"2024-09-14T10:49:33.443828+0000","last_active":"2024-09-14T12:42:27.666413+0000","last_peered":"2024-09-14T12:42:27.666413+0000","last_clean":"2024-09-14T12:42:27.666413+0000","last_became_active":"2024-09-14T10:49:33.443020+0000","last_became_peered":"2024-09-14T10:49:33.443020+0000","last_unstale":"2024-09-14T12:42:27.666413+0000","last_undegraded":"2024-09-14T12:42:27.666413+0000","last_fullsized":"2024-09-14T12:42:27.666413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.241734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":233,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'968","reported_seq":2582,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.506058+0000","last_change":"2024-09-14T10:49:25.401196+0000","last_active":"2024-09-14T12:39:44.506058+0000","last_peered":"2024-09-14T12:39:44.506058+0000","last_clean":"2024-09-14T12:39:44.506058+0000","last_became_active":"2024-09-14T10:49:25.400786+0000","last_became_peered":"2024-09-14T10:49:25.400786+0000","last_unstale":"2024-09-14T12:39:44.506058+0000","last_undegraded":"2024-09-14T12:39:44.506058+0000","last_fullsized":"2024-09-14T12:39:44.506058+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":900,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:26.988291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4481,"num_read_kb":3955,"num_write":1321,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'267","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.608528+0000","last_change":"2024-09-14T10:49:23.395425+0000","last_active":"2024-09-14T12:39:49.608528+0000","last_peered":"2024-09-14T12:39:49.608528+0000","last_clean":"2024-09-14T12:39:49.608528+0000","last_became_active":"2024-09-14T10:49:23.394973+0000","last_became_peered":"2024-09-14T10:49:23.394973+0000","last_unstale":"2024-09-14T12:39:49.608528+0000","last_undegraded":"2024-09-14T12:39:49.608528+0000","last_fullsized":"2024-09-14T12:39:49.608528+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.054954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8188169,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":541,"num_read_kb":75759,"num_write":965,"num_write_kb":39860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:30.533301+0000","last_change":"2024-09-14T10:49:27.378358+0000","last_active":"2024-09-14T12:39:30.533301+0000","last_peered":"2024-09-14T12:39:30.533301+0000","last_clean":"2024-09-14T12:39:30.533301+0000","last_became_active":"2024-09-14T10:49:27.377395+0000","last_became_peered":"2024-09-14T10:49:27.377395+0000","last_unstale":"2024-09-14T12:39:30.533301+0000","last_undegraded":"2024-09-14T12:39:30.533301+0000","last_fullsized":"2024-09-14T12:39:30.533301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:07.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'389","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:25.830017+0000","last_change":"2024-09-14T10:49:29.377185+0000","last_active":"2024-09-14T12:43:25.830017+0000","last_peered":"2024-09-14T12:43:25.830017+0000","last_clean":"2024-09-14T12:43:25.830017+0000","last_became_active":"2024-09-14T10:49:29.376813+0000","last_became_peered":"2024-09-14T10:49:29.376813+0000","last_unstale":"2024-09-14T12:43:25.830017+0000","last_undegraded":"2024-09-14T12:43:25.830017+0000","last_fullsized":"2024-09-14T12:43:25.830017+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.599152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53512,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":615,"num_read_kb":1099,"num_write":486,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571666+0000","last_change":"2024-09-14T10:49:31.425171+0000","last_active":"2024-09-14T12:40:45.571666+0000","last_peered":"2024-09-14T12:40:45.571666+0000","last_clean":"2024-09-14T12:40:45.571666+0000","last_became_active":"2024-09-14T10:49:31.424394+0000","last_became_peered":"2024-09-14T10:49:31.424394+0000","last_unstale":"2024-09-14T12:40:45.571666+0000","last_undegraded":"2024-09-14T12:40:45.571666+0000","last_fullsized":"2024-09-14T12:40:45.571666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:07.004493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'151","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.578263+0000","last_change":"2024-09-14T10:49:33.463294+0000","last_active":"2024-09-14T12:42:24.578263+0000","last_peered":"2024-09-14T12:42:24.578263+0000","last_clean":"2024-09-14T12:42:24.578263+0000","last_became_active":"2024-09-14T10:49:33.462582+0000","last_became_peered":"2024-09-14T10:49:33.462582+0000","last_unstale":"2024-09-14T12:42:24.578263+0000","last_undegraded":"2024-09-14T12:42:24.578263+0000","last_fullsized":"2024-09-14T12:42:24.578263+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:51.070074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":151,"num_write":347,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'487","reported_seq":2225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.769121+0000","last_change":"2024-09-14T10:49:25.387231+0000","last_active":"2024-09-14T12:42:31.769121+0000","last_peered":"2024-09-14T12:42:31.769121+0000","last_clean":"2024-09-14T12:42:31.769121+0000","last_became_active":"2024-09-14T10:49:25.386937+0000","last_became_peered":"2024-09-14T10:49:25.386937+0000","last_unstale":"2024-09-14T12:42:31.769121+0000","last_undegraded":"2024-09-14T12:42:31.769121+0000","last_fullsized":"2024-09-14T12:42:31.769121+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:41.631753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2676,"num_write":566,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'305","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:42.941916+0000","last_change":"2024-09-14T10:49:53.506313+0000","last_active":"2024-09-14T12:43:42.941916+0000","last_peered":"2024-09-14T12:43:42.941916+0000","last_clean":"2024-09-14T12:43:42.941916+0000","last_became_active":"2024-09-14T10:49:53.505479+0000","last_became_peered":"2024-09-14T10:49:53.505479+0000","last_unstale":"2024-09-14T12:43:42.941916+0000","last_undegraded":"2024-09-14T12:43:42.941916+0000","last_fullsized":"2024-09-14T12:43:42.941916+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:20.359828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7666583,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":607,"num_read_kb":68230,"num_write":1102,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1,6],"acting":[3,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136252+0000","last_change":"2024-09-14T10:49:27.371936+0000","last_active":"2024-09-14T12:39:31.136252+0000","last_peered":"2024-09-14T12:39:31.136252+0000","last_clean":"2024-09-14T12:39:31.136252+0000","last_became_active":"2024-09-14T10:49:27.371450+0000","last_became_peered":"2024-09-14T10:49:27.371450+0000","last_unstale":"2024-09-14T12:39:31.136252+0000","last_undegraded":"2024-09-14T12:39:31.136252+0000","last_fullsized":"2024-09-14T12:39:31.136252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:11.677326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'295","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:05.603542+0000","last_change":"2024-09-14T10:49:29.380669+0000","last_active":"2024-09-14T12:43:05.603542+0000","last_peered":"2024-09-14T12:43:05.603542+0000","last_clean":"2024-09-14T12:43:05.603542+0000","last_became_active":"2024-09-14T10:49:29.379942+0000","last_became_peered":"2024-09-14T10:49:29.379942+0000","last_unstale":"2024-09-14T12:43:05.603542+0000","last_undegraded":"2024-09-14T12:43:05.603542+0000","last_fullsized":"2024-09-14T12:43:05.603542+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:50.784831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55454,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":936,"num_write":380,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490245+0000","last_change":"2024-09-14T10:49:31.430688+0000","last_active":"2024-09-14T12:41:01.490245+0000","last_peered":"2024-09-14T12:41:01.490245+0000","last_clean":"2024-09-14T12:41:01.490245+0000","last_became_active":"2024-09-14T10:49:31.424882+0000","last_became_peered":"2024-09-14T10:49:31.424882+0000","last_unstale":"2024-09-14T12:41:01.490245+0000","last_undegraded":"2024-09-14T12:41:01.490245+0000","last_fullsized":"2024-09-14T12:41:01.490245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:10.035901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'115","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.540999+0000","last_change":"2024-09-14T10:49:33.469121+0000","last_active":"2024-09-14T12:41:29.540999+0000","last_peered":"2024-09-14T12:41:29.540999+0000","last_clean":"2024-09-14T12:41:29.540999+0000","last_became_active":"2024-09-14T10:49:33.468026+0000","last_became_peered":"2024-09-14T10:49:33.468026+0000","last_unstale":"2024-09-14T12:41:29.540999+0000","last_undegraded":"2024-09-14T12:41:29.540999+0000","last_fullsized":"2024-09-14T12:41:29.540999+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:54.591274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":167,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'978","reported_seq":2671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.736717+0000","last_change":"2024-09-14T10:49:25.386916+0000","last_active":"2024-09-14T12:41:23.736717+0000","last_peered":"2024-09-14T12:41:23.736717+0000","last_clean":"2024-09-14T12:41:23.736717+0000","last_became_active":"2024-09-14T10:49:25.386168+0000","last_became_peered":"2024-09-14T10:49:25.386168+0000","last_unstale":"2024-09-14T12:41:23.736717+0000","last_undegraded":"2024-09-14T12:41:23.736717+0000","last_fullsized":"2024-09-14T12:41:23.736717+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":900,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.415912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4881,"num_read_kb":4356,"num_write":1346,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'270","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360047+0000","last_change":"2024-09-14T10:49:23.368770+0000","last_active":"2024-09-14T12:41:55.360047+0000","last_peered":"2024-09-14T12:41:55.360047+0000","last_clean":"2024-09-14T12:41:55.360047+0000","last_became_active":"2024-09-14T10:49:23.367940+0000","last_became_peered":"2024-09-14T10:49:23.367940+0000","last_unstale":"2024-09-14T12:41:55.360047+0000","last_undegraded":"2024-09-14T12:41:55.360047+0000","last_fullsized":"2024-09-14T12:41:55.360047+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:45.609107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4273589,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":524,"num_read_kb":29389,"num_write":999,"num_write_kb":29053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549364+0000","last_change":"2024-09-14T10:49:27.381081+0000","last_active":"2024-09-14T12:40:40.549364+0000","last_peered":"2024-09-14T12:40:40.549364+0000","last_clean":"2024-09-14T12:40:40.549364+0000","last_became_active":"2024-09-14T10:49:27.380333+0000","last_became_peered":"2024-09-14T10:49:27.380333+0000","last_unstale":"2024-09-14T12:40:40.549364+0000","last_undegraded":"2024-09-14T12:40:40.549364+0000","last_fullsized":"2024-09-14T12:40:40.549364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:32.329024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'239","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561664+0000","last_change":"2024-09-14T10:49:29.378365+0000","last_active":"2024-09-14T12:42:01.561664+0000","last_peered":"2024-09-14T12:42:01.561664+0000","last_clean":"2024-09-14T12:42:01.561664+0000","last_became_active":"2024-09-14T10:49:29.377643+0000","last_became_peered":"2024-09-14T10:49:29.377643+0000","last_unstale":"2024-09-14T12:42:01.561664+0000","last_undegraded":"2024-09-14T12:42:01.561664+0000","last_fullsized":"2024-09-14T12:42:01.561664+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:11.214340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51632,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":376,"num_read_kb":788,"num_write":302,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468822+0000","last_change":"2024-09-14T10:49:31.431402+0000","last_active":"2024-09-14T12:39:36.468822+0000","last_peered":"2024-09-14T12:39:36.468822+0000","last_clean":"2024-09-14T12:39:36.468822+0000","last_became_active":"2024-09-14T10:49:31.430693+0000","last_became_peered":"2024-09-14T10:49:31.430693+0000","last_unstale":"2024-09-14T12:39:36.468822+0000","last_undegraded":"2024-09-14T12:39:36.468822+0000","last_fullsized":"2024-09-14T12:39:36.468822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:32.715814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'154","reported_seq":1639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.449796+0000","last_change":"2024-09-14T10:49:33.476298+0000","last_active":"2024-09-14T12:42:24.449796+0000","last_peered":"2024-09-14T12:42:24.449796+0000","last_clean":"2024-09-14T12:42:24.449796+0000","last_became_active":"2024-09-14T10:49:33.475592+0000","last_became_peered":"2024-09-14T10:49:33.475592+0000","last_unstale":"2024-09-14T12:42:24.449796+0000","last_undegraded":"2024-09-14T12:42:24.449796+0000","last_fullsized":"2024-09-14T12:42:24.449796+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:10.319176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1153,"num_read_kb":1151,"num_write":333,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'1200","reported_seq":2911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.582879+0000","last_change":"2024-09-14T10:49:25.362578+0000","last_active":"2024-09-14T12:41:29.582879+0000","last_peered":"2024-09-14T12:41:29.582879+0000","last_clean":"2024-09-14T12:41:29.582879+0000","last_became_active":"2024-09-14T10:49:25.362059+0000","last_became_peered":"2024-09-14T10:49:25.362059+0000","last_unstale":"2024-09-14T12:41:29.582879+0000","last_undegraded":"2024-09-14T12:41:29.582879+0000","last_fullsized":"2024-09-14T12:41:29.582879+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:36.132405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5522,"num_read_kb":4921,"num_write":1640,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'338","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360131+0000","last_change":"2024-09-14T10:49:23.382568+0000","last_active":"2024-09-14T12:41:55.360131+0000","last_peered":"2024-09-14T12:41:55.360131+0000","last_clean":"2024-09-14T12:41:55.360131+0000","last_became_active":"2024-09-14T10:49:23.381620+0000","last_became_peered":"2024-09-14T10:49:23.381620+0000","last_unstale":"2024-09-14T12:41:55.360131+0000","last_undegraded":"2024-09-14T12:41:55.360131+0000","last_fullsized":"2024-09-14T12:41:55.360131+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:07.597062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381662,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":674,"num_read_kb":34199,"num_write":1177,"num_write_kb":46564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:10.577149+0000","last_change":"2024-09-14T10:49:27.373477+0000","last_active":"2024-09-14T12:41:10.577149+0000","last_peered":"2024-09-14T12:41:10.577149+0000","last_clean":"2024-09-14T12:41:10.577149+0000","last_became_active":"2024-09-14T10:49:27.372685+0000","last_became_peered":"2024-09-14T10:49:27.372685+0000","last_unstale":"2024-09-14T12:41:10.577149+0000","last_undegraded":"2024-09-14T12:41:10.577149+0000","last_fullsized":"2024-09-14T12:41:10.577149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:18.351337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'326","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506246+0000","last_change":"2024-09-14T10:49:29.397492+0000","last_active":"2024-09-14T12:42:01.506246+0000","last_peered":"2024-09-14T12:42:01.506246+0000","last_clean":"2024-09-14T12:42:01.506246+0000","last_became_active":"2024-09-14T10:49:29.396379+0000","last_became_peered":"2024-09-14T10:49:29.396379+0000","last_unstale":"2024-09-14T12:42:01.506246+0000","last_undegraded":"2024-09-14T12:42:01.506246+0000","last_fullsized":"2024-09-14T12:42:01.506246+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:50.814297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59903,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":539,"num_read_kb":1024,"num_write":426,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.556297+0000","last_change":"2024-09-14T10:49:31.420969+0000","last_active":"2024-09-14T12:39:35.556297+0000","last_peered":"2024-09-14T12:39:35.556297+0000","last_clean":"2024-09-14T12:39:35.556297+0000","last_became_active":"2024-09-14T10:49:31.418819+0000","last_became_peered":"2024-09-14T10:49:31.418819+0000","last_unstale":"2024-09-14T12:39:35.556297+0000","last_undegraded":"2024-09-14T12:39:35.556297+0000","last_fullsized":"2024-09-14T12:39:35.556297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:53.067509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'132","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.601534+0000","last_change":"2024-09-14T10:49:33.477067+0000","last_active":"2024-09-14T12:43:47.601534+0000","last_peered":"2024-09-14T12:43:47.601534+0000","last_clean":"2024-09-14T12:43:47.601534+0000","last_became_active":"2024-09-14T10:49:33.476455+0000","last_became_peered":"2024-09-14T10:49:33.476455+0000","last_unstale":"2024-09-14T12:43:47.601534+0000","last_undegraded":"2024-09-14T12:43:47.601534+0000","last_fullsized":"2024-09-14T12:43:47.601534+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:57.442153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":173,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'504","reported_seq":2191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.582161+0000","last_change":"2024-09-14T10:49:25.374531+0000","last_active":"2024-09-14T12:41:29.582161+0000","last_peered":"2024-09-14T12:41:29.582161+0000","last_clean":"2024-09-14T12:41:29.582161+0000","last_became_active":"2024-09-14T10:49:25.373337+0000","last_became_peered":"2024-09-14T10:49:25.373337+0000","last_unstale":"2024-09-14T12:41:29.582161+0000","last_undegraded":"2024-09-14T12:41:29.582161+0000","last_fullsized":"2024-09-14T12:41:29.582161+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:13.554009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2857,"num_read_kb":2693,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'281","reported_seq":954,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:46.809140+0000","last_change":"2024-09-14T10:49:23.378184+0000","last_active":"2024-09-14T12:43:46.809140+0000","last_peered":"2024-09-14T12:43:46.809140+0000","last_clean":"2024-09-14T12:43:46.809140+0000","last_became_active":"2024-09-14T10:49:23.377766+0000","last_became_peered":"2024-09-14T10:49:23.377766+0000","last_unstale":"2024-09-14T12:43:46.809140+0000","last_undegraded":"2024-09-14T12:43:46.809140+0000","last_fullsized":"2024-09-14T12:43:46.809140+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:23.916084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11876760,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":548,"num_read_kb":20990,"num_write":989,"num_write_kb":39444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'622","reported_seq":2307,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.828646+0000","last_change":"2024-09-14T10:49:25.376291+0000","last_active":"2024-09-14T12:41:11.828646+0000","last_peered":"2024-09-14T12:41:11.828646+0000","last_clean":"2024-09-14T12:41:11.828646+0000","last_became_active":"2024-09-14T10:49:25.375595+0000","last_became_peered":"2024-09-14T10:49:25.375595+0000","last_unstale":"2024-09-14T12:41:11.828646+0000","last_undegraded":"2024-09-14T12:41:11.828646+0000","last_fullsized":"2024-09-14T12:41:11.828646+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:54.871887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3344,"num_read_kb":3023,"num_write":799,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'292","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.677452+0000","last_change":"2024-09-14T10:49:23.392114+0000","last_active":"2024-09-14T12:44:04.677452+0000","last_peered":"2024-09-14T12:44:04.677452+0000","last_clean":"2024-09-14T12:44:04.677452+0000","last_became_active":"2024-09-14T10:49:23.390456+0000","last_became_peered":"2024-09-14T10:49:23.390456+0000","last_unstale":"2024-09-14T12:44:04.677452+0000","last_undegraded":"2024-09-14T12:44:04.677452+0000","last_fullsized":"2024-09-14T12:44:04.677452+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:19.921702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190342,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":449,"num_read_kb":9557,"num_write":874,"num_write_kb":19994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'455","reported_seq":2085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.608380+0000","last_change":"2024-09-14T10:49:25.377312+0000","last_active":"2024-09-14T12:43:47.608380+0000","last_peered":"2024-09-14T12:43:47.608380+0000","last_clean":"2024-09-14T12:43:47.608380+0000","last_became_active":"2024-09-14T10:49:25.372436+0000","last_became_peered":"2024-09-14T10:49:25.372436+0000","last_unstale":"2024-09-14T12:43:47.608380+0000","last_undegraded":"2024-09-14T12:43:47.608380+0000","last_fullsized":"2024-09-14T12:43:47.608380+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:05.450288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2453,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'274","reported_seq":970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504696+0000","last_change":"2024-09-14T10:49:23.395538+0000","last_active":"2024-09-14T12:41:56.504696+0000","last_peered":"2024-09-14T12:41:56.504696+0000","last_clean":"2024-09-14T12:41:56.504696+0000","last_became_active":"2024-09-14T10:49:23.395161+0000","last_became_peered":"2024-09-14T10:49:23.395161+0000","last_unstale":"2024-09-14T12:41:56.504696+0000","last_undegraded":"2024-09-14T12:41:56.504696+0000","last_fullsized":"2024-09-14T12:41:56.504696+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:29.846931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2318602,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":620,"num_read_kb":8858,"num_write":968,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'753","reported_seq":2450,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.132003+0000","last_change":"2024-09-14T10:49:25.391763+0000","last_active":"2024-09-14T12:42:22.132003+0000","last_peered":"2024-09-14T12:42:22.132003+0000","last_clean":"2024-09-14T12:42:22.132003+0000","last_became_active":"2024-09-14T10:49:25.390167+0000","last_became_peered":"2024-09-14T10:49:25.390167+0000","last_unstale":"2024-09-14T12:42:22.132003+0000","last_undegraded":"2024-09-14T12:42:22.132003+0000","last_fullsized":"2024-09-14T12:42:22.132003+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.035163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3780,"num_read_kb":3460,"num_write":968,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'297","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.046545+0000","last_change":"2024-09-14T10:49:23.375090+0000","last_active":"2024-09-14T12:41:06.046545+0000","last_peered":"2024-09-14T12:41:06.046545+0000","last_clean":"2024-09-14T12:41:06.046545+0000","last_became_active":"2024-09-14T10:49:23.374332+0000","last_became_peered":"2024-09-14T10:49:23.374332+0000","last_unstale":"2024-09-14T12:41:06.046545+0000","last_undegraded":"2024-09-14T12:41:06.046545+0000","last_fullsized":"2024-09-14T12:41:06.046545+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:00.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779726,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":610,"num_read_kb":1430,"num_write":1197,"num_write_kb":16611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'435","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.715675+0000","last_change":"2024-09-14T10:49:25.391424+0000","last_active":"2024-09-14T12:42:31.715675+0000","last_peered":"2024-09-14T12:42:31.715675+0000","last_clean":"2024-09-14T12:42:31.715675+0000","last_became_active":"2024-09-14T10:49:25.390444+0000","last_became_peered":"2024-09-14T10:49:25.390444+0000","last_unstale":"2024-09-14T12:42:31.715675+0000","last_undegraded":"2024-09-14T12:42:31.715675+0000","last_fullsized":"2024-09-14T12:42:31.715675+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:26.275135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2280,"num_write":506,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'263","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.534070+0000","last_change":"2024-09-14T10:49:23.365856+0000","last_active":"2024-09-14T12:39:56.534070+0000","last_peered":"2024-09-14T12:39:56.534070+0000","last_clean":"2024-09-14T12:39:56.534070+0000","last_became_active":"2024-09-14T10:49:23.365007+0000","last_became_peered":"2024-09-14T10:49:23.365007+0000","last_unstale":"2024-09-14T12:39:56.534070+0000","last_undegraded":"2024-09-14T12:39:56.534070+0000","last_fullsized":"2024-09-14T12:39:56.534070+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:22.123987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28000,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":465,"num_read_kb":40509,"num_write":970,"num_write_kb":34103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'617","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.811795+0000","last_change":"2024-09-14T10:49:25.381143+0000","last_active":"2024-09-14T12:41:55.811795+0000","last_peered":"2024-09-14T12:41:55.811795+0000","last_clean":"2024-09-14T12:41:55.811795+0000","last_became_active":"2024-09-14T10:49:25.380751+0000","last_became_peered":"2024-09-14T10:49:25.380751+0000","last_unstale":"2024-09-14T12:41:55.811795+0000","last_undegraded":"2024-09-14T12:41:55.811795+0000","last_fullsized":"2024-09-14T12:41:55.811795+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:26.129271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3385,"num_read_kb":3142,"num_write":784,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'303","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.663098+0000","last_change":"2024-09-14T10:49:23.367673+0000","last_active":"2024-09-14T12:39:56.663098+0000","last_peered":"2024-09-14T12:39:56.663098+0000","last_clean":"2024-09-14T12:39:56.663098+0000","last_became_active":"2024-09-14T10:49:23.366946+0000","last_became_peered":"2024-09-14T10:49:23.366946+0000","last_unstale":"2024-09-14T12:39:56.663098+0000","last_undegraded":"2024-09-14T12:39:56.663098+0000","last_fullsized":"2024-09-14T12:39:56.663098+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:45.550841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10887879,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":574,"num_read_kb":15337,"num_write":1132,"num_write_kb":33762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'817","reported_seq":2544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.209601+0000","last_change":"2024-09-14T10:49:25.395514+0000","last_active":"2024-09-14T12:42:22.209601+0000","last_peered":"2024-09-14T12:42:22.209601+0000","last_clean":"2024-09-14T12:42:22.209601+0000","last_became_active":"2024-09-14T10:49:25.394994+0000","last_became_peered":"2024-09-14T10:49:25.394994+0000","last_unstale":"2024-09-14T12:42:22.209601+0000","last_undegraded":"2024-09-14T12:42:22.209601+0000","last_fullsized":"2024-09-14T12:42:22.209601+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:10.461194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4031,"num_read_kb":3664,"num_write":1069,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'333","reported_seq":1182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142473+0000","last_change":"2024-09-14T10:49:23.373580+0000","last_active":"2024-09-14T12:39:56.142473+0000","last_peered":"2024-09-14T12:39:56.142473+0000","last_clean":"2024-09-14T12:39:56.142473+0000","last_became_active":"2024-09-14T10:49:23.373080+0000","last_became_peered":"2024-09-14T10:49:23.373080+0000","last_unstale":"2024-09-14T12:39:56.142473+0000","last_undegraded":"2024-09-14T12:39:56.142473+0000","last_fullsized":"2024-09-14T12:39:56.142473+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:31.818739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8600715,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1360,"num_read_kb":12734,"num_write":1166,"num_write_kb":19451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'534","reported_seq":2270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568255+0000","last_change":"2024-09-14T10:49:25.376719+0000","last_active":"2024-09-14T12:41:55.568255+0000","last_peered":"2024-09-14T12:41:55.568255+0000","last_clean":"2024-09-14T12:41:55.568255+0000","last_became_active":"2024-09-14T10:49:25.375465+0000","last_became_peered":"2024-09-14T10:49:25.375465+0000","last_unstale":"2024-09-14T12:41:55.568255+0000","last_undegraded":"2024-09-14T12:41:55.568255+0000","last_fullsized":"2024-09-14T12:41:55.568255+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.679259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2646,"num_write":644,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'278","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550380+0000","last_change":"2024-09-14T10:49:23.378694+0000","last_active":"2024-09-14T12:39:55.550380+0000","last_peered":"2024-09-14T12:39:55.550380+0000","last_clean":"2024-09-14T12:39:55.550380+0000","last_became_active":"2024-09-14T10:49:23.377964+0000","last_became_peered":"2024-09-14T10:49:23.377964+0000","last_unstale":"2024-09-14T12:39:55.550380+0000","last_undegraded":"2024-09-14T12:39:55.550380+0000","last_fullsized":"2024-09-14T12:39:55.550380+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:24.829760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4248428,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":523,"num_read_kb":6819,"num_write":1034,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'851","reported_seq":2405,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.209489+0000","last_change":"2024-09-14T10:49:25.387331+0000","last_active":"2024-09-14T12:42:22.209489+0000","last_peered":"2024-09-14T12:42:22.209489+0000","last_clean":"2024-09-14T12:42:22.209489+0000","last_became_active":"2024-09-14T10:49:25.386541+0000","last_became_peered":"2024-09-14T10:49:25.386541+0000","last_unstale":"2024-09-14T12:42:22.209489+0000","last_undegraded":"2024-09-14T12:42:22.209489+0000","last_fullsized":"2024-09-14T12:42:22.209489+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:37.887330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3987,"num_read_kb":3560,"num_write":1145,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'327","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:39.983841+0000","last_change":"2024-09-14T10:49:23.387632+0000","last_active":"2024-09-14T12:40:39.983841+0000","last_peered":"2024-09-14T12:40:39.983841+0000","last_clean":"2024-09-14T12:40:39.983841+0000","last_became_active":"2024-09-14T10:49:23.387245+0000","last_became_peered":"2024-09-14T10:49:23.387245+0000","last_unstale":"2024-09-14T12:40:39.983841+0000","last_undegraded":"2024-09-14T12:40:39.983841+0000","last_fullsized":"2024-09-14T12:40:39.983841+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:39.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8100655,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":574,"num_read_kb":46177,"num_write":1211,"num_write_kb":35513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'848","reported_seq":2611,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.452842+0000","last_change":"2024-09-14T10:49:25.374040+0000","last_active":"2024-09-14T12:42:29.452842+0000","last_peered":"2024-09-14T12:42:29.452842+0000","last_clean":"2024-09-14T12:42:29.452842+0000","last_became_active":"2024-09-14T10:49:25.373511+0000","last_became_peered":"2024-09-14T10:49:25.373511+0000","last_unstale":"2024-09-14T12:42:29.452842+0000","last_undegraded":"2024-09-14T12:42:29.452842+0000","last_fullsized":"2024-09-14T12:42:29.452842+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:06.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4179,"num_read_kb":3797,"num_write":1119,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'304","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.546496+0000","last_change":"2024-09-14T10:49:23.378107+0000","last_active":"2024-09-14T12:39:40.546496+0000","last_peered":"2024-09-14T12:39:40.546496+0000","last_clean":"2024-09-14T12:39:40.546496+0000","last_became_active":"2024-09-14T10:49:23.377218+0000","last_became_peered":"2024-09-14T10:49:23.377218+0000","last_unstale":"2024-09-14T12:39:40.546496+0000","last_undegraded":"2024-09-14T12:39:40.546496+0000","last_fullsized":"2024-09-14T12:39:40.546496+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:31.856619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9551716,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":579,"num_read_kb":6958,"num_write":1125,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'524","reported_seq":2129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.731901+0000","last_change":"2024-09-14T10:49:25.395953+0000","last_active":"2024-09-14T12:41:23.731901+0000","last_peered":"2024-09-14T12:41:23.731901+0000","last_clean":"2024-09-14T12:41:23.731901+0000","last_became_active":"2024-09-14T10:49:25.394237+0000","last_became_peered":"2024-09-14T10:49:25.394237+0000","last_unstale":"2024-09-14T12:41:23.731901+0000","last_undegraded":"2024-09-14T12:41:23.731901+0000","last_fullsized":"2024-09-14T12:41:23.731901+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:13.449753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2610,"num_write":682,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'307","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.535444+0000","last_change":"2024-09-14T10:49:23.372390+0000","last_active":"2024-09-14T12:39:40.535444+0000","last_peered":"2024-09-14T12:39:40.535444+0000","last_clean":"2024-09-14T12:39:40.535444+0000","last_became_active":"2024-09-14T10:49:23.371845+0000","last_became_peered":"2024-09-14T10:49:23.371845+0000","last_unstale":"2024-09-14T12:39:40.535444+0000","last_undegraded":"2024-09-14T12:39:40.535444+0000","last_fullsized":"2024-09-14T12:39:40.535444+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:14.322795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7346908,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":665,"num_read_kb":30321,"num_write":1104,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'407","reported_seq":1828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.684104+0000","last_change":"2024-09-14T10:49:25.375748+0000","last_active":"2024-09-14T12:42:31.684104+0000","last_peered":"2024-09-14T12:42:31.684104+0000","last_clean":"2024-09-14T12:42:31.684104+0000","last_became_active":"2024-09-14T10:49:25.375374+0000","last_became_peered":"2024-09-14T10:49:25.375374+0000","last_unstale":"2024-09-14T12:42:31.684104+0000","last_undegraded":"2024-09-14T12:42:31.684104+0000","last_fullsized":"2024-09-14T12:42:31.684104+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:51.858708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2030,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'313","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.449533+0000","last_change":"2024-09-14T10:49:23.373160+0000","last_active":"2024-09-14T12:41:16.449533+0000","last_peered":"2024-09-14T12:41:16.449533+0000","last_clean":"2024-09-14T12:41:16.449533+0000","last_became_active":"2024-09-14T10:49:23.371987+0000","last_became_peered":"2024-09-14T10:49:23.371987+0000","last_unstale":"2024-09-14T12:41:16.449533+0000","last_undegraded":"2024-09-14T12:41:16.449533+0000","last_fullsized":"2024-09-14T12:41:16.449533+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:57.645505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18831056,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":645,"num_read_kb":54430,"num_write":1094,"num_write_kb":38478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'764","reported_seq":2315,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.401581+0000","last_change":"2024-09-14T10:49:25.404779+0000","last_active":"2024-09-14T12:42:29.401581+0000","last_peered":"2024-09-14T12:42:29.401581+0000","last_clean":"2024-09-14T12:42:29.401581+0000","last_became_active":"2024-09-14T10:49:25.404302+0000","last_became_peered":"2024-09-14T10:49:25.404302+0000","last_unstale":"2024-09-14T12:42:29.401581+0000","last_undegraded":"2024-09-14T12:42:29.401581+0000","last_fullsized":"2024-09-14T12:42:29.401581+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.123156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3673,"num_read_kb":3318,"num_write":995,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'315","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782950+0000","last_change":"2024-09-14T10:49:23.373328+0000","last_active":"2024-09-14T12:39:40.782950+0000","last_peered":"2024-09-14T12:39:40.782950+0000","last_clean":"2024-09-14T12:39:40.782950+0000","last_became_active":"2024-09-14T10:49:23.372362+0000","last_became_peered":"2024-09-14T10:49:23.372362+0000","last_unstale":"2024-09-14T12:39:40.782950+0000","last_undegraded":"2024-09-14T12:39:40.782950+0000","last_fullsized":"2024-09-14T12:39:40.782950+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:33.274164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5596178,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":526,"num_read_kb":10747,"num_write":1122,"num_write_kb":31883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"267'887","reported_seq":2536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.611847+0000","last_change":"2024-09-14T10:49:25.379008+0000","last_active":"2024-09-14T12:43:47.611847+0000","last_peered":"2024-09-14T12:43:47.611847+0000","last_clean":"2024-09-14T12:43:47.611847+0000","last_became_active":"2024-09-14T10:49:25.378231+0000","last_became_peered":"2024-09-14T10:49:25.378231+0000","last_unstale":"2024-09-14T12:43:47.611847+0000","last_undegraded":"2024-09-14T12:43:47.611847+0000","last_fullsized":"2024-09-14T12:43:47.611847+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:27.346745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4260,"num_read_kb":3817,"num_write":1188,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'318","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.415409+0000","last_change":"2024-09-14T10:49:23.396632+0000","last_active":"2024-09-14T12:42:05.415409+0000","last_peered":"2024-09-14T12:42:05.415409+0000","last_clean":"2024-09-14T12:42:05.415409+0000","last_became_active":"2024-09-14T10:49:23.396179+0000","last_became_peered":"2024-09-14T10:49:23.396179+0000","last_unstale":"2024-09-14T12:42:05.415409+0000","last_undegraded":"2024-09-14T12:42:05.415409+0000","last_fullsized":"2024-09-14T12:42:05.415409+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:19.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12572263,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":970,"num_read_kb":35151,"num_write":1188,"num_write_kb":27361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'452","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.639145+0000","last_change":"2024-09-14T10:49:25.387446+0000","last_active":"2024-09-14T12:43:47.639145+0000","last_peered":"2024-09-14T12:43:47.639145+0000","last_clean":"2024-09-14T12:43:47.639145+0000","last_became_active":"2024-09-14T10:49:25.386602+0000","last_became_peered":"2024-09-14T10:49:25.386602+0000","last_unstale":"2024-09-14T12:43:47.639145+0000","last_undegraded":"2024-09-14T12:43:47.639145+0000","last_fullsized":"2024-09-14T12:43:47.639145+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:41.415729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2532,"num_read_kb":2369,"num_write":580,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'359","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.738301+0000","last_change":"2024-09-14T10:49:23.370968+0000","last_active":"2024-09-14T12:44:04.738301+0000","last_peered":"2024-09-14T12:44:04.738301+0000","last_clean":"2024-09-14T12:44:04.738301+0000","last_became_active":"2024-09-14T10:49:23.369989+0000","last_became_peered":"2024-09-14T10:49:23.369989+0000","last_unstale":"2024-09-14T12:44:04.738301+0000","last_undegraded":"2024-09-14T12:44:04.738301+0000","last_fullsized":"2024-09-14T12:44:04.738301+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:46.807806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190304,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":690,"num_read_kb":14222,"num_write":1153,"num_write_kb":28974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'1263","reported_seq":2959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:20.544825+0000","last_change":"2024-09-14T10:49:25.408105+0000","last_active":"2024-09-14T12:40:20.544825+0000","last_peered":"2024-09-14T12:40:20.544825+0000","last_clean":"2024-09-14T12:40:20.544825+0000","last_became_active":"2024-09-14T10:49:25.407817+0000","last_became_peered":"2024-09-14T10:49:25.407817+0000","last_unstale":"2024-09-14T12:40:20.544825+0000","last_undegraded":"2024-09-14T12:40:20.544825+0000","last_fullsized":"2024-09-14T12:40:20.544825+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":1200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:28.857748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5850,"num_read_kb":5153,"num_write":1753,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'311","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.497020+0000","last_change":"2024-09-14T10:49:23.366572+0000","last_active":"2024-09-14T12:41:26.497020+0000","last_peered":"2024-09-14T12:41:26.497020+0000","last_clean":"2024-09-14T12:41:26.497020+0000","last_became_active":"2024-09-14T10:49:23.365975+0000","last_became_peered":"2024-09-14T10:49:23.365975+0000","last_unstale":"2024-09-14T12:41:26.497020+0000","last_undegraded":"2024-09-14T12:41:26.497020+0000","last_fullsized":"2024-09-14T12:41:26.497020+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:46.697172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21473224,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":895,"num_read_kb":99658,"num_write":1100,"num_write_kb":35935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'292","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496522+0000","last_change":"2024-09-14T10:49:23.374017+0000","last_active":"2024-09-14T12:41:26.496522+0000","last_peered":"2024-09-14T12:41:26.496522+0000","last_clean":"2024-09-14T12:41:26.496522+0000","last_became_active":"2024-09-14T10:49:23.373652+0000","last_became_peered":"2024-09-14T10:49:23.373652+0000","last_unstale":"2024-09-14T12:41:26.496522+0000","last_undegraded":"2024-09-14T12:41:26.496522+0000","last_fullsized":"2024-09-14T12:41:26.496522+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:34.956815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272146,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":806,"num_read_kb":808,"num_write":1029,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'429","reported_seq":2023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.767109+0000","last_change":"2024-09-14T10:49:25.400404+0000","last_active":"2024-09-14T12:42:31.767109+0000","last_peered":"2024-09-14T12:42:31.767109+0000","last_clean":"2024-09-14T12:42:31.767109+0000","last_became_active":"2024-09-14T10:49:25.399830+0000","last_became_peered":"2024-09-14T10:49:25.399830+0000","last_unstale":"2024-09-14T12:42:31.767109+0000","last_undegraded":"2024-09-14T12:42:31.767109+0000","last_fullsized":"2024-09-14T12:42:31.767109+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:56.425228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2288,"num_read_kb":2174,"num_write":485,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'285","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.571597+0000","last_change":"2024-09-14T10:49:23.384640+0000","last_active":"2024-09-14T12:41:25.571597+0000","last_peered":"2024-09-14T12:41:25.571597+0000","last_clean":"2024-09-14T12:41:25.571597+0000","last_became_active":"2024-09-14T10:49:23.382302+0000","last_became_peered":"2024-09-14T10:49:23.382302+0000","last_unstale":"2024-09-14T12:41:25.571597+0000","last_undegraded":"2024-09-14T12:41:25.571597+0000","last_fullsized":"2024-09-14T12:41:25.571597+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:19.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14347518,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":781,"num_read_kb":33665,"num_write":989,"num_write_kb":42742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'432","reported_seq":2105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.791117+0000","last_change":"2024-09-14T10:49:25.392230+0000","last_active":"2024-09-14T12:41:16.791117+0000","last_peered":"2024-09-14T12:41:16.791117+0000","last_clean":"2024-09-14T12:41:16.791117+0000","last_became_active":"2024-09-14T10:49:25.391680+0000","last_became_peered":"2024-09-14T10:49:25.391680+0000","last_unstale":"2024-09-14T12:41:16.791117+0000","last_undegraded":"2024-09-14T12:41:16.791117+0000","last_fullsized":"2024-09-14T12:41:16.791117+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:29.701571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2427,"num_read_kb":2321,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10880,"num_read_kb":8996,"num_write":3119,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15325,"num_read_kb":14960,"num_write":17100,"num_write_kb":5007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":539,"ondisk_log_size":539,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1949033,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":20817,"num_read_kb":37788,"num_write":17575,"num_write_kb":12732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3039232,"data_stored":2541282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1723,"ondisk_log_size":1723,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221603,"num_read_kb":202842,"num_write":56199,"num_write_kb":19273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3589,"ondisk_log_size":3589,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":605614295,"num_objects":4263,"num_object_clones":0,"num_object_copies":17052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4263,"num_whiteouts":0,"num_read":40605,"num_read_kb":1985148,"num_write":69552,"num_write_kb":2196624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":822476800,"data_stored":822476800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4145,"ondisk_log_size":4145,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":64559776,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":168154,"num_write":160,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122826752,"data_stored":122815808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":49883808,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":139,"num_read_kb":167578,"num_write":165,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114917376,"data_stored":114907797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510827,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238896,"kb_used_data":139680,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94132944,"statfs":{"total":96636764160,"available":96392134656,"internally_reserved":0,"allocated":143032320,"data_stored":140972101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510825,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":403036,"kb_used_data":128908,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93968804,"statfs":{"total":96636764160,"available":96224055296,"internally_reserved":0,"allocated":132001792,"data_stored":129955770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510828,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":382744,"kb_used_data":162824,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":93989096,"statfs":{"total":96636764160,"available":96244834304,"internally_reserved":0,"allocated":166731776,"data_stored":164671390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225180101},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510829,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413496,"kb_used_data":161576,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93958344,"statfs":{"total":96636764160,"available":96213344256,"internally_reserved":0,"allocated":165453824,"data_stored":163399235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510828,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308284,"kb_used_data":168812,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94063556,"statfs":{"total":96636764160,"available":96321081344,"internally_reserved":0,"allocated":172863488,"data_stored":170844255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510825,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451388,"kb_used_data":131436,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":93920452,"statfs":{"total":96636764160,"available":96174542848,"internally_reserved":0,"allocated":134590464,"data_stored":132523079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":327612869},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510826,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286608,"kb_used_data":156864,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94085232,"statfs":{"total":96636764160,"available":96343277568,"internally_reserved":0,"allocated":160628736,"data_stored":158530254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543533,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250332,"kb_used_data":24792,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94121508,"statfs":{"total":96636764160,"available":96380424192,"internally_reserved":0,"allocated":25387008,"data_stored":23377561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230881738},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":134848512,"data_stored":134848512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":104042496,"data_stored":104042496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":140152832,"data_stored":140152832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":129421312,"data_stored":129421312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":123695104,"data_stored":123695104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":84639744,"data_stored":84639744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86999040,"data_stored":86999040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18677760,"data_stored":18677760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":478941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":478031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":118964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":267778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":389581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":414006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":359552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":34429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12579690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19935232,"data_stored":19935232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18878464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11538432,"data_stored":11537547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18898944,"data_stored":18895722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7929856,"data_stored":7927606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25153536,"data_stored":25153536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5238784,"data_stored":5238784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9453568,"data_stored":9452683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19935232,"data_stored":19932010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19451904,"data_stored":19449654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34148352,"data_stored":34143765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26218496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:44:06.245 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:44:06.597 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:44:06.610 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T12:44:06.614 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":3711,"stamp":"2024-09-14T12:44:05.142912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":722614847,"num_objects":4778,"num_object_clones":0,"num_object_copies":18082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4778,"num_whiteouts":0,"num_read":312008,"num_read_kb":2588423,"num_write":164013,"num_write_kb":2487467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12825,"ondisk_log_size":12825,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2734784,"kb_used_data":1074892,"kb_used_omap":12,"kb_used_meta":1659699,"kb_avail":752239936,"statfs":{"total":773094113280,"available":770293694464,"internally_reserved":0,"allocated":1100689408,"data_stored":1084273645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1699532336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53624186,"num_objects":-178,"num_object_clones":0,"num_object_copies":-694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-178,"num_whiteouts":0,"num_read":262,"num_read_kb":858,"num_write":215,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008309"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789873+0000","last_change":"2024-09-14T11:40:08.952510+0000","last_active":"2024-09-14T12:40:10.789873+0000","last_peered":"2024-09-14T12:40:10.789873+0000","last_clean":"2024-09-14T12:40:10.789873+0000","last_became_active":"2024-09-14T11:40:08.951795+0000","last_became_peered":"2024-09-14T11:40:08.951795+0000","last_unstale":"2024-09-14T12:40:10.789873+0000","last_undegraded":"2024-09-14T12:40:10.789873+0000","last_fullsized":"2024-09-14T12:40:10.789873+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:34.432945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538895+0000","last_change":"2024-09-14T11:12:26.252261+0000","last_active":"2024-09-14T12:39:55.538895+0000","last_peered":"2024-09-14T12:39:55.538895+0000","last_clean":"2024-09-14T12:39:55.538895+0000","last_became_active":"2024-09-14T11:12:26.251656+0000","last_became_peered":"2024-09-14T11:12:26.251656+0000","last_unstale":"2024-09-14T12:39:55.538895+0000","last_undegraded":"2024-09-14T12:39:55.538895+0000","last_fullsized":"2024-09-14T12:39:55.538895+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:01.924216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731815+0000","last_change":"2024-09-14T11:12:19.109493+0000","last_active":"2024-09-14T12:39:49.731815+0000","last_peered":"2024-09-14T12:39:49.731815+0000","last_clean":"2024-09-14T12:39:49.731815+0000","last_became_active":"2024-09-14T11:12:19.108050+0000","last_became_peered":"2024-09-14T11:12:19.108050+0000","last_unstale":"2024-09-14T12:39:49.731815+0000","last_undegraded":"2024-09-14T12:39:49.731815+0000","last_fullsized":"2024-09-14T12:39:49.731815+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:46.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'28","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.565399+0000","last_change":"2024-09-14T11:06:29.522001+0000","last_active":"2024-09-14T12:40:15.565399+0000","last_peered":"2024-09-14T12:40:15.565399+0000","last_clean":"2024-09-14T12:40:15.565399+0000","last_became_active":"2024-09-14T11:06:29.521269+0000","last_became_peered":"2024-09-14T11:06:29.521269+0000","last_unstale":"2024-09-14T12:40:15.565399+0000","last_undegraded":"2024-09-14T12:40:15.565399+0000","last_fullsized":"2024-09-14T12:40:15.565399+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:36.067094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":165,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537448+0000","last_change":"2024-09-14T11:40:08.947504+0000","last_active":"2024-09-14T12:40:11.537448+0000","last_peered":"2024-09-14T12:40:11.537448+0000","last_clean":"2024-09-14T12:40:11.537448+0000","last_became_active":"2024-09-14T11:40:08.946878+0000","last_became_peered":"2024-09-14T11:40:08.946878+0000","last_unstale":"2024-09-14T12:40:11.537448+0000","last_undegraded":"2024-09-14T12:40:11.537448+0000","last_fullsized":"2024-09-14T12:40:11.537448+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:13.424208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142354+0000","last_change":"2024-09-14T11:12:26.251932+0000","last_active":"2024-09-14T12:39:56.142354+0000","last_peered":"2024-09-14T12:39:56.142354+0000","last_clean":"2024-09-14T12:39:56.142354+0000","last_became_active":"2024-09-14T11:12:26.251518+0000","last_became_peered":"2024-09-14T11:12:26.251518+0000","last_unstale":"2024-09-14T12:39:56.142354+0000","last_undegraded":"2024-09-14T12:39:56.142354+0000","last_fullsized":"2024-09-14T12:39:56.142354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:18.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.549011+0000","last_change":"2024-09-14T11:12:19.078874+0000","last_active":"2024-09-14T12:39:50.549011+0000","last_peered":"2024-09-14T12:39:50.549011+0000","last_clean":"2024-09-14T12:39:50.549011+0000","last_became_active":"2024-09-14T11:12:19.078164+0000","last_became_peered":"2024-09-14T11:12:19.078164+0000","last_unstale":"2024-09-14T12:39:50.549011+0000","last_undegraded":"2024-09-14T12:39:50.549011+0000","last_fullsized":"2024-09-14T12:39:50.549011+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:07.851997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'14","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.573976+0000","last_change":"2024-09-14T11:06:29.539883+0000","last_active":"2024-09-14T12:40:55.573976+0000","last_peered":"2024-09-14T12:40:55.573976+0000","last_clean":"2024-09-14T12:40:55.573976+0000","last_became_active":"2024-09-14T11:06:29.538616+0000","last_became_peered":"2024-09-14T11:06:29.538616+0000","last_unstale":"2024-09-14T12:40:55.573976+0000","last_undegraded":"2024-09-14T12:40:55.573976+0000","last_fullsized":"2024-09-14T12:40:55.573976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:48.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":63,"num_write":44,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.548159+0000","last_change":"2024-09-14T11:40:08.943797+0000","last_active":"2024-09-14T12:40:35.548159+0000","last_peered":"2024-09-14T12:40:35.548159+0000","last_clean":"2024-09-14T12:40:35.548159+0000","last_became_active":"2024-09-14T11:40:08.942721+0000","last_became_peered":"2024-09-14T11:40:08.942721+0000","last_unstale":"2024-09-14T12:40:35.548159+0000","last_undegraded":"2024-09-14T12:40:35.548159+0000","last_fullsized":"2024-09-14T12:40:35.548159+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:17.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550343+0000","last_change":"2024-09-14T11:12:26.228979+0000","last_active":"2024-09-14T12:39:55.550343+0000","last_peered":"2024-09-14T12:39:55.550343+0000","last_clean":"2024-09-14T12:39:55.550343+0000","last_became_active":"2024-09-14T11:12:26.228172+0000","last_became_peered":"2024-09-14T11:12:26.228172+0000","last_unstale":"2024-09-14T12:39:55.550343+0000","last_undegraded":"2024-09-14T12:39:55.550343+0000","last_fullsized":"2024-09-14T12:39:55.550343+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:34.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:34.769431+0000","last_change":"2024-09-14T11:12:19.111973+0000","last_active":"2024-09-14T12:42:34.769431+0000","last_peered":"2024-09-14T12:42:34.769431+0000","last_clean":"2024-09-14T12:42:34.769431+0000","last_became_active":"2024-09-14T11:12:19.110542+0000","last_became_peered":"2024-09-14T11:12:19.110542+0000","last_unstale":"2024-09-14T12:42:34.769431+0000","last_undegraded":"2024-09-14T12:42:34.769431+0000","last_fullsized":"2024-09-14T12:42:34.769431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.885368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555139+0000","last_change":"2024-09-14T11:06:29.532390+0000","last_active":"2024-09-14T12:41:31.555139+0000","last_peered":"2024-09-14T12:41:31.555139+0000","last_clean":"2024-09-14T12:41:31.555139+0000","last_became_active":"2024-09-14T11:06:29.531655+0000","last_became_peered":"2024-09-14T11:06:29.531655+0000","last_unstale":"2024-09-14T12:41:31.555139+0000","last_undegraded":"2024-09-14T12:41:31.555139+0000","last_fullsized":"2024-09-14T12:41:31.555139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:15.026446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":194,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563239+0000","last_change":"2024-09-14T11:40:08.940194+0000","last_active":"2024-09-14T12:40:50.563239+0000","last_peered":"2024-09-14T12:40:50.563239+0000","last_clean":"2024-09-14T12:40:50.563239+0000","last_became_active":"2024-09-14T11:40:08.939509+0000","last_became_peered":"2024-09-14T11:40:08.939509+0000","last_unstale":"2024-09-14T12:40:50.563239+0000","last_undegraded":"2024-09-14T12:40:50.563239+0000","last_fullsized":"2024-09-14T12:40:50.563239+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:14.099727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.562210+0000","last_change":"2024-09-14T11:12:26.231260+0000","last_active":"2024-09-14T12:40:45.562210+0000","last_peered":"2024-09-14T12:40:45.562210+0000","last_clean":"2024-09-14T12:40:45.562210+0000","last_became_active":"2024-09-14T11:12:26.230403+0000","last_became_peered":"2024-09-14T11:12:26.230403+0000","last_unstale":"2024-09-14T12:40:45.562210+0000","last_undegraded":"2024-09-14T12:40:45.562210+0000","last_fullsized":"2024-09-14T12:40:45.562210+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:41.167301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5823147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":7282,"num_write":9,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"267'1","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568418+0000","last_change":"2024-09-14T11:12:19.105819+0000","last_active":"2024-09-14T12:41:55.568418+0000","last_peered":"2024-09-14T12:41:55.568418+0000","last_clean":"2024-09-14T12:41:55.568418+0000","last_became_active":"2024-09-14T11:12:19.105062+0000","last_became_peered":"2024-09-14T11:12:19.105062+0000","last_unstale":"2024-09-14T12:41:55.568418+0000","last_undegraded":"2024-09-14T12:41:55.568418+0000","last_fullsized":"2024-09-14T12:41:55.568418+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:15.694200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'12","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555085+0000","last_change":"2024-09-14T11:06:29.510354+0000","last_active":"2024-09-14T12:41:31.555085+0000","last_peered":"2024-09-14T12:41:31.555085+0000","last_clean":"2024-09-14T12:41:31.555085+0000","last_became_active":"2024-09-14T11:06:29.509556+0000","last_became_peered":"2024-09-14T11:06:29.509556+0000","last_unstale":"2024-09-14T12:41:31.555085+0000","last_undegraded":"2024-09-14T12:41:31.555085+0000","last_fullsized":"2024-09-14T12:41:31.555085+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:51.904786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:19.738657+0000","last_change":"2024-09-14T11:40:08.932176+0000","last_active":"2024-09-14T12:40:19.738657+0000","last_peered":"2024-09-14T12:40:19.738657+0000","last_clean":"2024-09-14T12:40:19.738657+0000","last_became_active":"2024-09-14T11:40:08.927702+0000","last_became_peered":"2024-09-14T11:40:08.927702+0000","last_unstale":"2024-09-14T12:40:19.738657+0000","last_undegraded":"2024-09-14T12:40:19.738657+0000","last_fullsized":"2024-09-14T12:40:19.738657+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:31.907550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782814+0000","last_change":"2024-09-14T11:12:26.219704+0000","last_active":"2024-09-14T12:39:40.782814+0000","last_peered":"2024-09-14T12:39:40.782814+0000","last_clean":"2024-09-14T12:39:40.782814+0000","last_became_active":"2024-09-14T11:12:26.218925+0000","last_became_peered":"2024-09-14T11:12:26.218925+0000","last_unstale":"2024-09-14T12:39:40.782814+0000","last_undegraded":"2024-09-14T12:39:40.782814+0000","last_fullsized":"2024-09-14T12:39:40.782814+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:12.358912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.541766+0000","last_change":"2024-09-14T11:12:19.111180+0000","last_active":"2024-09-14T12:39:20.541766+0000","last_peered":"2024-09-14T12:39:20.541766+0000","last_clean":"2024-09-14T12:39:20.541766+0000","last_became_active":"2024-09-14T11:12:19.110528+0000","last_became_peered":"2024-09-14T11:12:19.110528+0000","last_unstale":"2024-09-14T12:39:20.541766+0000","last_undegraded":"2024-09-14T12:39:20.541766+0000","last_fullsized":"2024-09-14T12:39:20.541766+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:53.395221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1028,"num_write":3,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'15","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555023+0000","last_change":"2024-09-14T11:06:29.539444+0000","last_active":"2024-09-14T12:41:31.555023+0000","last_peered":"2024-09-14T12:41:31.555023+0000","last_clean":"2024-09-14T12:41:31.555023+0000","last_became_active":"2024-09-14T11:06:29.538597+0000","last_became_peered":"2024-09-14T11:06:29.538597+0000","last_unstale":"2024-09-14T12:41:31.555023+0000","last_undegraded":"2024-09-14T12:41:31.555023+0000","last_fullsized":"2024-09-14T12:41:31.555023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:42.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569608+0000","last_change":"2024-09-14T11:40:08.925877+0000","last_active":"2024-09-14T12:40:35.569608+0000","last_peered":"2024-09-14T12:40:35.569608+0000","last_clean":"2024-09-14T12:40:35.569608+0000","last_became_active":"2024-09-14T11:40:08.924934+0000","last_became_peered":"2024-09-14T11:40:08.924934+0000","last_unstale":"2024-09-14T12:40:35.569608+0000","last_undegraded":"2024-09-14T12:40:35.569608+0000","last_fullsized":"2024-09-14T12:40:35.569608+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:38.137144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:26.465943+0000","last_change":"2024-09-14T11:12:26.246400+0000","last_active":"2024-09-14T12:39:26.465943+0000","last_peered":"2024-09-14T12:39:26.465943+0000","last_clean":"2024-09-14T12:39:26.465943+0000","last_became_active":"2024-09-14T11:12:26.245890+0000","last_became_peered":"2024-09-14T11:12:26.245890+0000","last_unstale":"2024-09-14T12:39:26.465943+0000","last_undegraded":"2024-09-14T12:39:26.465943+0000","last_fullsized":"2024-09-14T12:39:26.465943+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:48.151101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468681+0000","last_change":"2024-09-14T11:12:19.109400+0000","last_active":"2024-09-14T12:39:36.468681+0000","last_peered":"2024-09-14T12:39:36.468681+0000","last_clean":"2024-09-14T12:39:36.468681+0000","last_became_active":"2024-09-14T11:12:19.108158+0000","last_became_peered":"2024-09-14T11:12:19.108158+0000","last_unstale":"2024-09-14T12:39:36.468681+0000","last_undegraded":"2024-09-14T12:39:36.468681+0000","last_fullsized":"2024-09-14T12:39:36.468681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:12.518068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'13","reported_seq":104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164957+0000","last_change":"2024-09-14T11:06:29.529584+0000","last_active":"2024-09-14T12:41:31.164957+0000","last_peered":"2024-09-14T12:41:31.164957+0000","last_clean":"2024-09-14T12:41:31.164957+0000","last_became_active":"2024-09-14T11:06:29.525271+0000","last_became_peered":"2024-09-14T11:06:29.525271+0000","last_unstale":"2024-09-14T12:41:31.164957+0000","last_undegraded":"2024-09-14T12:41:31.164957+0000","last_fullsized":"2024-09-14T12:41:31.164957+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:48.747370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.145918+0000","last_change":"2024-09-14T11:40:08.929934+0000","last_active":"2024-09-14T12:40:11.145918+0000","last_peered":"2024-09-14T12:40:11.145918+0000","last_clean":"2024-09-14T12:40:11.145918+0000","last_became_active":"2024-09-14T11:40:08.928406+0000","last_became_peered":"2024-09-14T11:40:08.928406+0000","last_unstale":"2024-09-14T12:40:11.145918+0000","last_undegraded":"2024-09-14T12:40:11.145918+0000","last_fullsized":"2024-09-14T12:40:11.145918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:59.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142297+0000","last_change":"2024-09-14T11:12:26.241901+0000","last_active":"2024-09-14T12:39:56.142297+0000","last_peered":"2024-09-14T12:39:56.142297+0000","last_clean":"2024-09-14T12:39:56.142297+0000","last_became_active":"2024-09-14T11:12:26.241189+0000","last_became_peered":"2024-09-14T11:12:26.241189+0000","last_unstale":"2024-09-14T12:39:56.142297+0000","last_undegraded":"2024-09-14T12:39:56.142297+0000","last_fullsized":"2024-09-14T12:39:56.142297+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:26.882785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.785157+0000","last_change":"2024-09-14T11:12:19.090881+0000","last_active":"2024-09-14T12:39:50.785157+0000","last_peered":"2024-09-14T12:39:50.785157+0000","last_clean":"2024-09-14T12:39:50.785157+0000","last_became_active":"2024-09-14T11:12:19.090134+0000","last_became_peered":"2024-09-14T11:12:19.090134+0000","last_unstale":"2024-09-14T12:39:50.785157+0000","last_undegraded":"2024-09-14T12:39:50.785157+0000","last_fullsized":"2024-09-14T12:39:50.785157+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.751661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195178,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'175","reported_seq":578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:59.747524+0000","last_change":"2024-09-14T11:06:29.533832+0000","last_active":"2024-09-14T12:40:59.747524+0000","last_peered":"2024-09-14T12:40:59.747524+0000","last_clean":"2024-09-14T12:40:59.747524+0000","last_became_active":"2024-09-14T11:06:29.531149+0000","last_became_peered":"2024-09-14T11:06:29.531149+0000","last_unstale":"2024-09-14T12:40:59.747524+0000","last_undegraded":"2024-09-14T12:40:59.747524+0000","last_fullsized":"2024-09-14T12:40:59.747524+0000","mapping_epoch":256,"log_start":"264'100","ondisk_log_start":"264'100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:45.535262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1578,"num_read_kb":1327,"num_write":388,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789984+0000","last_change":"2024-09-14T11:40:08.942903+0000","last_active":"2024-09-14T12:40:10.789984+0000","last_peered":"2024-09-14T12:40:10.789984+0000","last_clean":"2024-09-14T12:40:10.789984+0000","last_became_active":"2024-09-14T11:40:08.942208+0000","last_became_peered":"2024-09-14T11:40:08.942208+0000","last_unstale":"2024-09-14T12:40:10.789984+0000","last_undegraded":"2024-09-14T12:40:10.789984+0000","last_fullsized":"2024-09-14T12:40:10.789984+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:07.315198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.768253+0000","last_change":"2024-09-14T11:12:26.236668+0000","last_active":"2024-09-14T12:42:29.768253+0000","last_peered":"2024-09-14T12:42:29.768253+0000","last_clean":"2024-09-14T12:42:29.768253+0000","last_became_active":"2024-09-14T11:12:26.236221+0000","last_became_peered":"2024-09-14T11:12:26.236221+0000","last_unstale":"2024-09-14T12:42:29.768253+0000","last_undegraded":"2024-09-14T12:42:29.768253+0000","last_fullsized":"2024-09-14T12:42:29.768253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.780862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532656+0000","last_change":"2024-09-14T11:12:19.087602+0000","last_active":"2024-09-14T12:39:51.532656+0000","last_peered":"2024-09-14T12:39:51.532656+0000","last_clean":"2024-09-14T12:39:51.532656+0000","last_became_active":"2024-09-14T11:12:19.086765+0000","last_became_peered":"2024-09-14T11:12:19.086765+0000","last_unstale":"2024-09-14T12:39:51.532656+0000","last_undegraded":"2024-09-14T12:39:51.532656+0000","last_fullsized":"2024-09-14T12:39:51.532656+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.252636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.545007+0000","last_change":"2024-09-14T11:06:29.518739+0000","last_active":"2024-09-14T12:40:46.545007+0000","last_peered":"2024-09-14T12:40:46.545007+0000","last_clean":"2024-09-14T12:40:46.545007+0000","last_became_active":"2024-09-14T11:06:29.518028+0000","last_became_peered":"2024-09-14T11:06:29.518028+0000","last_unstale":"2024-09-14T12:40:46.545007+0000","last_undegraded":"2024-09-14T12:40:46.545007+0000","last_fullsized":"2024-09-14T12:40:46.545007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:31.356112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":96,"num_write":55,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563311+0000","last_change":"2024-09-14T11:40:08.953653+0000","last_active":"2024-09-14T12:40:50.563311+0000","last_peered":"2024-09-14T12:40:50.563311+0000","last_clean":"2024-09-14T12:40:50.563311+0000","last_became_active":"2024-09-14T11:40:08.953030+0000","last_became_peered":"2024-09-14T11:40:08.953030+0000","last_unstale":"2024-09-14T12:40:50.563311+0000","last_undegraded":"2024-09-14T12:40:50.563311+0000","last_fullsized":"2024-09-14T12:40:50.563311+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:54.553294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:29.727366+0000","last_change":"2024-09-14T11:12:26.248644+0000","last_active":"2024-09-14T12:39:29.727366+0000","last_peered":"2024-09-14T12:39:29.727366+0000","last_clean":"2024-09-14T12:39:29.727366+0000","last_became_active":"2024-09-14T11:12:26.247784+0000","last_became_peered":"2024-09-14T11:12:26.247784+0000","last_unstale":"2024-09-14T12:39:29.727366+0000","last_undegraded":"2024-09-14T12:39:29.727366+0000","last_fullsized":"2024-09-14T12:39:29.727366+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:06.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494251+0000","last_change":"2024-09-14T11:12:19.114678+0000","last_active":"2024-09-14T12:41:16.494251+0000","last_peered":"2024-09-14T12:41:16.494251+0000","last_clean":"2024-09-14T12:41:16.494251+0000","last_became_active":"2024-09-14T11:12:19.113431+0000","last_became_peered":"2024-09-14T11:12:19.113431+0000","last_unstale":"2024-09-14T12:41:16.494251+0000","last_undegraded":"2024-09-14T12:41:16.494251+0000","last_fullsized":"2024-09-14T12:41:16.494251+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:46.474061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7166,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'46","reported_seq":197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571890+0000","last_change":"2024-09-14T11:06:29.532883+0000","last_active":"2024-09-14T12:40:45.571890+0000","last_peered":"2024-09-14T12:40:45.571890+0000","last_clean":"2024-09-14T12:40:45.571890+0000","last_became_active":"2024-09-14T11:06:29.532061+0000","last_became_peered":"2024-09-14T11:06:29.532061+0000","last_unstale":"2024-09-14T12:40:45.571890+0000","last_undegraded":"2024-09-14T12:40:45.571890+0000","last_fullsized":"2024-09-14T12:40:45.571890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:13.641002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":235,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.546149+0000","last_change":"2024-09-14T11:40:08.938546+0000","last_active":"2024-09-14T12:40:51.546149+0000","last_peered":"2024-09-14T12:40:51.546149+0000","last_clean":"2024-09-14T12:40:51.546149+0000","last_became_active":"2024-09-14T11:40:08.937813+0000","last_became_peered":"2024-09-14T11:40:08.937813+0000","last_unstale":"2024-09-14T12:40:51.546149+0000","last_undegraded":"2024-09-14T12:40:51.546149+0000","last_fullsized":"2024-09-14T12:40:51.546149+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:07.510647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.571681+0000","last_change":"2024-09-14T11:12:26.244350+0000","last_active":"2024-09-14T12:41:25.571681+0000","last_peered":"2024-09-14T12:41:25.571681+0000","last_clean":"2024-09-14T12:41:25.571681+0000","last_became_active":"2024-09-14T11:12:26.243612+0000","last_became_peered":"2024-09-14T11:12:26.243612+0000","last_unstale":"2024-09-14T12:41:25.571681+0000","last_undegraded":"2024-09-14T12:41:25.571681+0000","last_fullsized":"2024-09-14T12:41:25.571681+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.954445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14684160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":15364,"num_write":17,"num_write_kb":14340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.778500+0000","last_change":"2024-09-14T11:12:19.104603+0000","last_active":"2024-09-14T12:39:20.778500+0000","last_peered":"2024-09-14T12:39:20.778500+0000","last_clean":"2024-09-14T12:39:20.778500+0000","last_became_active":"2024-09-14T11:12:19.103871+0000","last_became_peered":"2024-09-14T11:12:19.103871+0000","last_unstale":"2024-09-14T12:39:20.778500+0000","last_undegraded":"2024-09-14T12:39:20.778500+0000","last_fullsized":"2024-09-14T12:39:20.778500+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:11.319272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'29","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571849+0000","last_change":"2024-09-14T11:06:29.530922+0000","last_active":"2024-09-14T12:40:45.571849+0000","last_peered":"2024-09-14T12:40:45.571849+0000","last_clean":"2024-09-14T12:40:45.571849+0000","last_became_active":"2024-09-14T11:06:29.529421+0000","last_became_peered":"2024-09-14T11:06:29.529421+0000","last_unstale":"2024-09-14T12:40:45.571849+0000","last_undegraded":"2024-09-14T12:40:45.571849+0000","last_fullsized":"2024-09-14T12:40:45.571849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:42.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":129,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.155363+0000","last_change":"2024-09-14T11:40:08.944753+0000","last_active":"2024-09-14T12:40:51.155363+0000","last_peered":"2024-09-14T12:40:51.155363+0000","last_clean":"2024-09-14T12:40:51.155363+0000","last_became_active":"2024-09-14T11:40:08.944066+0000","last_became_peered":"2024-09-14T11:40:08.944066+0000","last_unstale":"2024-09-14T12:40:51.155363+0000","last_undegraded":"2024-09-14T12:40:51.155363+0000","last_fullsized":"2024-09-14T12:40:51.155363+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:51.071467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:29.727468+0000","last_change":"2024-09-14T11:12:26.225753+0000","last_active":"2024-09-14T12:39:29.727468+0000","last_peered":"2024-09-14T12:39:29.727468+0000","last_clean":"2024-09-14T12:39:29.727468+0000","last_became_active":"2024-09-14T11:12:26.224877+0000","last_became_peered":"2024-09-14T11:12:26.224877+0000","last_unstale":"2024-09-14T12:39:29.727468+0000","last_undegraded":"2024-09-14T12:39:29.727468+0000","last_fullsized":"2024-09-14T12:39:29.727468+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:14.000285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'11","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.953503+0000","last_change":"2024-09-14T11:12:19.108246+0000","last_active":"2024-09-14T12:44:02.953503+0000","last_peered":"2024-09-14T12:44:02.953503+0000","last_clean":"2024-09-14T12:44:02.953503+0000","last_became_active":"2024-09-14T11:12:19.107563+0000","last_became_peered":"2024-09-14T11:12:19.107563+0000","last_unstale":"2024-09-14T12:44:02.953503+0000","last_undegraded":"2024-09-14T12:44:02.953503+0000","last_fullsized":"2024-09-14T12:44:02.953503+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9259,"num_write":16,"num_write_kb":6185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'15","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:44.744075+0000","last_change":"2024-09-14T11:06:29.535035+0000","last_active":"2024-09-14T12:40:44.744075+0000","last_peered":"2024-09-14T12:40:44.744075+0000","last_clean":"2024-09-14T12:40:44.744075+0000","last_became_active":"2024-09-14T11:06:29.534316+0000","last_became_peered":"2024-09-14T11:06:29.534316+0000","last_unstale":"2024-09-14T12:40:44.744075+0000","last_undegraded":"2024-09-14T12:40:44.744075+0000","last_fullsized":"2024-09-14T12:40:44.744075+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.975045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":71,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.798963+0000","last_change":"2024-09-14T11:40:08.945904+0000","last_active":"2024-09-14T12:40:50.798963+0000","last_peered":"2024-09-14T12:40:50.798963+0000","last_clean":"2024-09-14T12:40:50.798963+0000","last_became_active":"2024-09-14T11:40:08.945227+0000","last_became_peered":"2024-09-14T11:40:08.945227+0000","last_unstale":"2024-09-14T12:40:50.798963+0000","last_undegraded":"2024-09-14T12:40:50.798963+0000","last_fullsized":"2024-09-14T12:40:50.798963+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:52.335465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:25.779815+0000","last_change":"2024-09-14T11:12:26.239562+0000","last_active":"2024-09-14T12:39:25.779815+0000","last_peered":"2024-09-14T12:39:25.779815+0000","last_clean":"2024-09-14T12:39:25.779815+0000","last_became_active":"2024-09-14T11:12:26.238844+0000","last_became_peered":"2024-09-14T11:12:26.238844+0000","last_unstale":"2024-09-14T12:39:25.779815+0000","last_undegraded":"2024-09-14T12:39:25.779815+0000","last_fullsized":"2024-09-14T12:39:25.779815+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:15.939265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.541990+0000","last_change":"2024-09-14T11:12:19.074095+0000","last_active":"2024-09-14T12:39:20.541990+0000","last_peered":"2024-09-14T12:39:20.541990+0000","last_clean":"2024-09-14T12:39:20.541990+0000","last_became_active":"2024-09-14T11:12:19.072275+0000","last_became_peered":"2024-09-14T11:12:19.072275+0000","last_unstale":"2024-09-14T12:39:20.541990+0000","last_undegraded":"2024-09-14T12:39:20.541990+0000","last_fullsized":"2024-09-14T12:39:20.541990+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:16.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'30","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476064+0000","last_change":"2024-09-14T11:06:29.519394+0000","last_active":"2024-09-14T12:40:06.476064+0000","last_peered":"2024-09-14T12:40:06.476064+0000","last_clean":"2024-09-14T12:40:06.476064+0000","last_became_active":"2024-09-14T11:06:29.518650+0000","last_became_peered":"2024-09-14T11:06:29.518650+0000","last_unstale":"2024-09-14T12:40:06.476064+0000","last_undegraded":"2024-09-14T12:40:06.476064+0000","last_fullsized":"2024-09-14T12:40:06.476064+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.316442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":172,"num_write":81,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559828+0000","last_change":"2024-09-14T11:40:08.951327+0000","last_active":"2024-09-14T12:40:35.559828+0000","last_peered":"2024-09-14T12:40:35.559828+0000","last_clean":"2024-09-14T12:40:35.559828+0000","last_became_active":"2024-09-14T11:40:08.950670+0000","last_became_peered":"2024-09-14T11:40:08.950670+0000","last_unstale":"2024-09-14T12:40:35.559828+0000","last_undegraded":"2024-09-14T12:40:35.559828+0000","last_fullsized":"2024-09-14T12:40:35.559828+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:02.634753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'3","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566775+0000","last_change":"2024-09-14T11:12:26.228814+0000","last_active":"2024-09-14T12:41:05.566775+0000","last_peered":"2024-09-14T12:41:05.566775+0000","last_clean":"2024-09-14T12:41:05.566775+0000","last_became_active":"2024-09-14T11:12:26.227851+0000","last_became_peered":"2024-09-14T11:12:26.227851+0000","last_unstale":"2024-09-14T12:41:05.566775+0000","last_undegraded":"2024-09-14T12:41:05.566775+0000","last_fullsized":"2024-09-14T12:41:05.566775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:46.796979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.553829+0000","last_change":"2024-09-14T11:12:19.092586+0000","last_active":"2024-09-14T12:41:00.553829+0000","last_peered":"2024-09-14T12:41:00.553829+0000","last_clean":"2024-09-14T12:41:00.553829+0000","last_became_active":"2024-09-14T11:12:19.091893+0000","last_became_peered":"2024-09-14T11:12:19.091893+0000","last_unstale":"2024-09-14T12:41:00.553829+0000","last_undegraded":"2024-09-14T12:41:00.553829+0000","last_fullsized":"2024-09-14T12:41:00.553829+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:18.606010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'35","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.472861+0000","last_change":"2024-09-14T11:06:29.548605+0000","last_active":"2024-09-14T12:39:51.472861+0000","last_peered":"2024-09-14T12:39:51.472861+0000","last_clean":"2024-09-14T12:39:51.472861+0000","last_became_active":"2024-09-14T11:06:29.545575+0000","last_became_peered":"2024-09-14T11:06:29.545575+0000","last_unstale":"2024-09-14T12:39:51.472861+0000","last_undegraded":"2024-09-14T12:39:51.472861+0000","last_fullsized":"2024-09-14T12:39:51.472861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:04.244766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":183,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543115+0000","last_change":"2024-09-14T11:40:08.926123+0000","last_active":"2024-09-14T12:40:36.543115+0000","last_peered":"2024-09-14T12:40:36.543115+0000","last_clean":"2024-09-14T12:40:36.543115+0000","last_became_active":"2024-09-14T11:40:08.925358+0000","last_became_peered":"2024-09-14T11:40:08.925358+0000","last_unstale":"2024-09-14T12:40:36.543115+0000","last_undegraded":"2024-09-14T12:40:36.543115+0000","last_fullsized":"2024-09-14T12:40:36.543115+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:25.296629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566691+0000","last_change":"2024-09-14T11:12:26.247421+0000","last_active":"2024-09-14T12:41:05.566691+0000","last_peered":"2024-09-14T12:41:05.566691+0000","last_clean":"2024-09-14T12:41:05.566691+0000","last_became_active":"2024-09-14T11:12:26.246881+0000","last_became_peered":"2024-09-14T11:12:26.246881+0000","last_unstale":"2024-09-14T12:41:05.566691+0000","last_undegraded":"2024-09-14T12:41:05.566691+0000","last_fullsized":"2024-09-14T12:41:05.566691+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:19.198573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.565548+0000","last_change":"2024-09-14T11:12:19.096545+0000","last_active":"2024-09-14T12:41:00.565548+0000","last_peered":"2024-09-14T12:41:00.565548+0000","last_clean":"2024-09-14T12:41:00.565548+0000","last_became_active":"2024-09-14T11:12:19.095821+0000","last_became_peered":"2024-09-14T11:12:19.095821+0000","last_unstale":"2024-09-14T12:41:00.565548+0000","last_undegraded":"2024-09-14T12:41:00.565548+0000","last_fullsized":"2024-09-14T12:41:00.565548+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:19.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4663,"num_write":3,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'26","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731762+0000","last_change":"2024-09-14T11:06:29.533209+0000","last_active":"2024-09-14T12:39:49.731762+0000","last_peered":"2024-09-14T12:39:49.731762+0000","last_clean":"2024-09-14T12:39:49.731762+0000","last_became_active":"2024-09-14T11:06:29.529753+0000","last_became_peered":"2024-09-14T11:06:29.529753+0000","last_unstale":"2024-09-14T12:39:49.731762+0000","last_undegraded":"2024-09-14T12:39:49.731762+0000","last_fullsized":"2024-09-14T12:39:49.731762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:45.017988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.576092+0000","last_change":"2024-09-14T11:40:08.925501+0000","last_active":"2024-09-14T12:41:05.576092+0000","last_peered":"2024-09-14T12:41:05.576092+0000","last_clean":"2024-09-14T12:41:05.576092+0000","last_became_active":"2024-09-14T11:40:08.924726+0000","last_became_peered":"2024-09-14T11:40:08.924726+0000","last_unstale":"2024-09-14T12:41:05.576092+0000","last_undegraded":"2024-09-14T12:41:05.576092+0000","last_fullsized":"2024-09-14T12:41:05.576092+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:22.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:09.749817+0000","last_change":"2024-09-14T11:12:26.219990+0000","last_active":"2024-09-14T12:41:09.749817+0000","last_peered":"2024-09-14T12:41:09.749817+0000","last_clean":"2024-09-14T12:41:09.749817+0000","last_became_active":"2024-09-14T11:12:26.219169+0000","last_became_peered":"2024-09-14T11:12:26.219169+0000","last_unstale":"2024-09-14T12:41:09.749817+0000","last_undegraded":"2024-09-14T12:41:09.749817+0000","last_fullsized":"2024-09-14T12:41:09.749817+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:09.344730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"267'8","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.553945+0000","last_change":"2024-09-14T11:12:19.099929+0000","last_active":"2024-09-14T12:41:00.553945+0000","last_peered":"2024-09-14T12:41:00.553945+0000","last_clean":"2024-09-14T12:41:00.553945+0000","last_became_active":"2024-09-14T11:12:19.099233+0000","last_became_peered":"2024-09-14T11:12:19.099233+0000","last_unstale":"2024-09-14T12:41:00.553945+0000","last_undegraded":"2024-09-14T12:41:00.553945+0000","last_fullsized":"2024-09-14T12:41:00.553945+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:44.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2113536,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":8230,"num_write":8,"num_write_kb":6172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'35","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140567+0000","last_change":"2024-09-14T11:06:29.524243+0000","last_active":"2024-09-14T12:39:51.140567+0000","last_peered":"2024-09-14T12:39:51.140567+0000","last_clean":"2024-09-14T12:39:51.140567+0000","last_became_active":"2024-09-14T11:06:29.508842+0000","last_became_peered":"2024-09-14T11:06:29.508842+0000","last_unstale":"2024-09-14T12:39:51.140567+0000","last_undegraded":"2024-09-14T12:39:51.140567+0000","last_fullsized":"2024-09-14T12:39:51.140567+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:47.904384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":189,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543061+0000","last_change":"2024-09-14T11:40:08.945136+0000","last_active":"2024-09-14T12:40:36.543061+0000","last_peered":"2024-09-14T12:40:36.543061+0000","last_clean":"2024-09-14T12:40:36.543061+0000","last_became_active":"2024-09-14T11:40:08.944382+0000","last_became_peered":"2024-09-14T11:40:08.944382+0000","last_unstale":"2024-09-14T12:40:36.543061+0000","last_undegraded":"2024-09-14T12:40:36.543061+0000","last_fullsized":"2024-09-14T12:40:36.543061+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:00.265362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.491464+0000","last_change":"2024-09-14T11:12:26.238084+0000","last_active":"2024-09-14T12:41:06.491464+0000","last_peered":"2024-09-14T12:41:06.491464+0000","last_clean":"2024-09-14T12:41:06.491464+0000","last_became_active":"2024-09-14T11:12:26.232336+0000","last_became_peered":"2024-09-14T11:12:26.232336+0000","last_unstale":"2024-09-14T12:41:06.491464+0000","last_undegraded":"2024-09-14T12:41:06.491464+0000","last_fullsized":"2024-09-14T12:41:06.491464+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:24.342020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4970,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12288,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.554012+0000","last_change":"2024-09-14T11:12:19.093047+0000","last_active":"2024-09-14T12:41:00.554012+0000","last_peered":"2024-09-14T12:41:00.554012+0000","last_clean":"2024-09-14T12:41:00.554012+0000","last_became_active":"2024-09-14T11:12:19.092223+0000","last_became_peered":"2024-09-14T11:12:19.092223+0000","last_unstale":"2024-09-14T12:41:00.554012+0000","last_undegraded":"2024-09-14T12:41:00.554012+0000","last_fullsized":"2024-09-14T12:41:00.554012+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:48.559915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2056,"num_write":3,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'19","reported_seq":117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731645+0000","last_change":"2024-09-14T11:06:29.533456+0000","last_active":"2024-09-14T12:39:49.731645+0000","last_peered":"2024-09-14T12:39:49.731645+0000","last_clean":"2024-09-14T12:39:49.731645+0000","last_became_active":"2024-09-14T11:06:29.530722+0000","last_became_peered":"2024-09-14T11:06:29.530722+0000","last_unstale":"2024-09-14T12:39:49.731645+0000","last_undegraded":"2024-09-14T12:39:49.731645+0000","last_fullsized":"2024-09-14T12:39:49.731645+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:40.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":48,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566854+0000","last_change":"2024-09-14T11:40:08.948425+0000","last_active":"2024-09-14T12:41:05.566854+0000","last_peered":"2024-09-14T12:41:05.566854+0000","last_clean":"2024-09-14T12:41:05.566854+0000","last_became_active":"2024-09-14T11:40:08.947725+0000","last_became_peered":"2024-09-14T11:40:08.947725+0000","last_unstale":"2024-09-14T12:41:05.566854+0000","last_undegraded":"2024-09-14T12:41:05.566854+0000","last_fullsized":"2024-09-14T12:41:05.566854+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:01.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737522+0000","last_change":"2024-09-14T11:12:26.233658+0000","last_active":"2024-09-14T12:40:14.737522+0000","last_peered":"2024-09-14T12:40:14.737522+0000","last_clean":"2024-09-14T12:40:14.737522+0000","last_became_active":"2024-09-14T11:12:26.233006+0000","last_became_peered":"2024-09-14T11:12:26.233006+0000","last_unstale":"2024-09-14T12:40:14.737522+0000","last_undegraded":"2024-09-14T12:40:14.737522+0000","last_fullsized":"2024-09-14T12:40:14.737522+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:29.000670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"267'1","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.144797+0000","last_change":"2024-09-14T11:12:19.086179+0000","last_active":"2024-09-14T12:40:06.144797+0000","last_peered":"2024-09-14T12:40:06.144797+0000","last_clean":"2024-09-14T12:40:06.144797+0000","last_became_active":"2024-09-14T11:12:19.085380+0000","last_became_peered":"2024-09-14T11:12:19.085380+0000","last_unstale":"2024-09-14T12:40:06.144797+0000","last_undegraded":"2024-09-14T12:40:06.144797+0000","last_fullsized":"2024-09-14T12:40:06.144797+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:31.276536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'32","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:14.751168+0000","last_change":"2024-09-14T11:06:29.535049+0000","last_active":"2024-09-14T12:41:14.751168+0000","last_peered":"2024-09-14T12:41:14.751168+0000","last_clean":"2024-09-14T12:41:14.751168+0000","last_became_active":"2024-09-14T11:06:29.534458+0000","last_became_peered":"2024-09-14T11:06:29.534458+0000","last_unstale":"2024-09-14T12:41:14.751168+0000","last_undegraded":"2024-09-14T12:41:14.751168+0000","last_fullsized":"2024-09-14T12:41:14.751168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:56.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":170,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.552820+0000","last_change":"2024-09-14T11:40:08.950611+0000","last_active":"2024-09-14T12:40:55.552820+0000","last_peered":"2024-09-14T12:40:55.552820+0000","last_clean":"2024-09-14T12:40:55.552820+0000","last_became_active":"2024-09-14T11:40:08.949834+0000","last_became_peered":"2024-09-14T11:40:08.949834+0000","last_unstale":"2024-09-14T12:40:55.552820+0000","last_undegraded":"2024-09-14T12:40:55.552820+0000","last_fullsized":"2024-09-14T12:40:55.552820+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:57.861780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737457+0000","last_change":"2024-09-14T11:12:26.248461+0000","last_active":"2024-09-14T12:40:14.737457+0000","last_peered":"2024-09-14T12:40:14.737457+0000","last_clean":"2024-09-14T12:40:14.737457+0000","last_became_active":"2024-09-14T11:12:26.247614+0000","last_became_peered":"2024-09-14T11:12:26.247614+0000","last_unstale":"2024-09-14T12:40:14.737457+0000","last_undegraded":"2024-09-14T12:40:14.737457+0000","last_fullsized":"2024-09-14T12:40:14.737457+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:50.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'13","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.536466+0000","last_change":"2024-09-14T11:12:19.096853+0000","last_active":"2024-09-14T12:40:06.536466+0000","last_peered":"2024-09-14T12:40:06.536466+0000","last_clean":"2024-09-14T12:40:06.536466+0000","last_became_active":"2024-09-14T11:12:19.096087+0000","last_became_peered":"2024-09-14T11:12:19.096087+0000","last_unstale":"2024-09-14T12:40:06.536466+0000","last_undegraded":"2024-09-14T12:40:06.536466+0000","last_fullsized":"2024-09-14T12:40:06.536466+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:06.192659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":21525,"num_write":23,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'15","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490423+0000","last_change":"2024-09-14T11:06:29.545510+0000","last_active":"2024-09-14T12:41:01.490423+0000","last_peered":"2024-09-14T12:41:01.490423+0000","last_clean":"2024-09-14T12:41:01.490423+0000","last_became_active":"2024-09-14T11:06:29.544309+0000","last_became_peered":"2024-09-14T11:06:29.544309+0000","last_unstale":"2024-09-14T12:41:01.490423+0000","last_undegraded":"2024-09-14T12:41:01.490423+0000","last_fullsized":"2024-09-14T12:41:01.490423+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:06.467496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":80,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.487672+0000","last_change":"2024-09-14T11:40:08.941028+0000","last_active":"2024-09-14T12:40:51.487672+0000","last_peered":"2024-09-14T12:40:51.487672+0000","last_clean":"2024-09-14T12:40:51.487672+0000","last_became_active":"2024-09-14T11:40:08.934447+0000","last_became_peered":"2024-09-14T11:40:08.934447+0000","last_unstale":"2024-09-14T12:40:51.487672+0000","last_undegraded":"2024-09-14T12:40:51.487672+0000","last_fullsized":"2024-09-14T12:40:51.487672+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:15.709296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"267'11","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:44.771631+0000","last_change":"2024-09-14T11:12:26.254154+0000","last_active":"2024-09-14T12:42:44.771631+0000","last_peered":"2024-09-14T12:42:44.771631+0000","last_clean":"2024-09-14T12:42:44.771631+0000","last_became_active":"2024-09-14T11:12:26.253410+0000","last_became_peered":"2024-09-14T11:12:26.253410+0000","last_unstale":"2024-09-14T12:42:44.771631+0000","last_undegraded":"2024-09-14T12:42:44.771631+0000","last_fullsized":"2024-09-14T12:42:44.771631+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.081481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6160,"num_write":16,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:04.735243+0000","last_change":"2024-09-14T11:12:19.112482+0000","last_active":"2024-09-14T12:40:04.735243+0000","last_peered":"2024-09-14T12:40:04.735243+0000","last_clean":"2024-09-14T12:40:04.735243+0000","last_became_active":"2024-09-14T11:12:19.109807+0000","last_became_peered":"2024-09-14T11:12:19.109807+0000","last_unstale":"2024-09-14T12:40:04.735243+0000","last_undegraded":"2024-09-14T12:40:04.735243+0000","last_fullsized":"2024-09-14T12:40:04.735243+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:20.441664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'38","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.554078+0000","last_change":"2024-09-14T11:06:29.521507+0000","last_active":"2024-09-14T12:41:00.554078+0000","last_peered":"2024-09-14T12:41:00.554078+0000","last_clean":"2024-09-14T12:41:00.554078+0000","last_became_active":"2024-09-14T11:06:29.520734+0000","last_became_peered":"2024-09-14T11:06:29.520734+0000","last_unstale":"2024-09-14T12:41:00.554078+0000","last_undegraded":"2024-09-14T12:41:00.554078+0000","last_fullsized":"2024-09-14T12:41:00.554078+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:18.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":248,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.551623+0000","last_change":"2024-09-14T11:40:08.929963+0000","last_active":"2024-09-14T12:40:50.551623+0000","last_peered":"2024-09-14T12:40:50.551623+0000","last_clean":"2024-09-14T12:40:50.551623+0000","last_became_active":"2024-09-14T11:40:08.928855+0000","last_became_peered":"2024-09-14T11:40:08.928855+0000","last_unstale":"2024-09-14T12:40:50.551623+0000","last_undegraded":"2024-09-14T12:40:50.551623+0000","last_fullsized":"2024-09-14T12:40:50.551623+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:53.447923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.554007+0000","last_change":"2024-09-14T11:12:26.236373+0000","last_active":"2024-09-14T12:40:10.554007+0000","last_peered":"2024-09-14T12:40:10.554007+0000","last_clean":"2024-09-14T12:40:10.554007+0000","last_became_active":"2024-09-14T11:12:26.235707+0000","last_became_peered":"2024-09-14T11:12:26.235707+0000","last_unstale":"2024-09-14T12:40:10.554007+0000","last_undegraded":"2024-09-14T12:40:10.554007+0000","last_fullsized":"2024-09-14T12:40:10.554007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:08.153271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"267'5","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.951256+0000","last_change":"2024-09-14T11:12:19.112752+0000","last_active":"2024-09-14T12:44:02.951256+0000","last_peered":"2024-09-14T12:44:02.951256+0000","last_clean":"2024-09-14T12:44:02.951256+0000","last_became_active":"2024-09-14T11:12:19.112055+0000","last_became_peered":"2024-09-14T11:12:19.112055+0000","last_unstale":"2024-09-14T12:44:02.951256+0000","last_undegraded":"2024-09-14T12:44:02.951256+0000","last_fullsized":"2024-09-14T12:44:02.951256+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:44.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'65","reported_seq":253,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548334+0000","last_change":"2024-09-14T11:06:29.516817+0000","last_active":"2024-09-14T12:41:01.548334+0000","last_peered":"2024-09-14T12:41:01.548334+0000","last_clean":"2024-09-14T12:41:01.548334+0000","last_became_active":"2024-09-14T11:06:29.511360+0000","last_became_peered":"2024-09-14T11:06:29.511360+0000","last_unstale":"2024-09-14T12:41:01.548334+0000","last_undegraded":"2024-09-14T12:41:01.548334+0000","last_fullsized":"2024-09-14T12:41:01.548334+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:54.074956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":367,"num_write":155,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.564546+0000","last_change":"2024-09-14T11:40:08.949706+0000","last_active":"2024-09-14T12:40:55.564546+0000","last_peered":"2024-09-14T12:40:55.564546+0000","last_clean":"2024-09-14T12:40:55.564546+0000","last_became_active":"2024-09-14T11:40:08.949175+0000","last_became_peered":"2024-09-14T11:40:08.949175+0000","last_unstale":"2024-09-14T12:40:55.564546+0000","last_undegraded":"2024-09-14T12:40:55.564546+0000","last_fullsized":"2024-09-14T12:40:55.564546+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:24.365260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494106+0000","last_change":"2024-09-14T11:12:26.229833+0000","last_active":"2024-09-14T12:41:16.494106+0000","last_peered":"2024-09-14T12:41:16.494106+0000","last_clean":"2024-09-14T12:41:16.494106+0000","last_became_active":"2024-09-14T11:12:26.228889+0000","last_became_peered":"2024-09-14T11:12:26.228889+0000","last_unstale":"2024-09-14T12:41:16.494106+0000","last_undegraded":"2024-09-14T12:41:16.494106+0000","last_fullsized":"2024-09-14T12:41:16.494106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:37.357481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6156,"num_write":2,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:19.779183+0000","last_change":"2024-09-14T11:12:19.099716+0000","last_active":"2024-09-14T12:43:19.779183+0000","last_peered":"2024-09-14T12:43:19.779183+0000","last_clean":"2024-09-14T12:43:19.779183+0000","last_became_active":"2024-09-14T11:12:19.098699+0000","last_became_peered":"2024-09-14T11:12:19.098699+0000","last_unstale":"2024-09-14T12:43:19.779183+0000","last_undegraded":"2024-09-14T12:43:19.779183+0000","last_fullsized":"2024-09-14T12:43:19.779183+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:03.576522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'39","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548268+0000","last_change":"2024-09-14T11:06:29.539103+0000","last_active":"2024-09-14T12:41:01.548268+0000","last_peered":"2024-09-14T12:41:01.548268+0000","last_clean":"2024-09-14T12:41:01.548268+0000","last_became_active":"2024-09-14T11:06:29.538432+0000","last_became_peered":"2024-09-14T11:06:29.538432+0000","last_unstale":"2024-09-14T12:41:01.548268+0000","last_undegraded":"2024-09-14T12:41:01.548268+0000","last_fullsized":"2024-09-14T12:41:01.548268+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.474730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":213,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.159302+0000","last_change":"2024-09-14T11:40:08.942492+0000","last_active":"2024-09-14T12:41:06.159302+0000","last_peered":"2024-09-14T12:41:06.159302+0000","last_clean":"2024-09-14T12:41:06.159302+0000","last_became_active":"2024-09-14T11:40:08.941924+0000","last_became_peered":"2024-09-14T11:40:08.941924+0000","last_unstale":"2024-09-14T12:41:06.159302+0000","last_undegraded":"2024-09-14T12:41:06.159302+0000","last_fullsized":"2024-09-14T12:41:06.159302+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:27.899066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.161485+0000","last_change":"2024-09-14T11:12:26.248413+0000","last_active":"2024-09-14T12:41:16.161485+0000","last_peered":"2024-09-14T12:41:16.161485+0000","last_clean":"2024-09-14T12:41:16.161485+0000","last_became_active":"2024-09-14T11:12:26.247849+0000","last_became_peered":"2024-09-14T11:12:26.247849+0000","last_unstale":"2024-09-14T12:41:16.161485+0000","last_undegraded":"2024-09-14T12:41:16.161485+0000","last_fullsized":"2024-09-14T12:41:16.161485+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:10.903087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5155,"num_write":11,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:10.568076+0000","last_change":"2024-09-14T11:12:19.096332+0000","last_active":"2024-09-14T12:41:10.568076+0000","last_peered":"2024-09-14T12:41:10.568076+0000","last_clean":"2024-09-14T12:41:10.568076+0000","last_became_active":"2024-09-14T11:12:19.095636+0000","last_became_peered":"2024-09-14T11:12:19.095636+0000","last_unstale":"2024-09-14T12:41:10.568076+0000","last_undegraded":"2024-09-14T12:41:10.568076+0000","last_fullsized":"2024-09-14T12:41:10.568076+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:51.045024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'31","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142146+0000","last_change":"2024-09-14T11:06:29.508912+0000","last_active":"2024-09-14T12:39:56.142146+0000","last_peered":"2024-09-14T12:39:56.142146+0000","last_clean":"2024-09-14T12:39:56.142146+0000","last_became_active":"2024-09-14T11:06:29.508269+0000","last_became_peered":"2024-09-14T11:06:29.508269+0000","last_unstale":"2024-09-14T12:39:56.142146+0000","last_undegraded":"2024-09-14T12:39:56.142146+0000","last_fullsized":"2024-09-14T12:39:56.142146+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:53.190994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":149,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.800182+0000","last_change":"2024-09-14T11:40:08.945998+0000","last_active":"2024-09-14T12:40:55.800182+0000","last_peered":"2024-09-14T12:40:55.800182+0000","last_clean":"2024-09-14T12:40:55.800182+0000","last_became_active":"2024-09-14T11:40:08.945217+0000","last_became_peered":"2024-09-14T11:40:08.945217+0000","last_unstale":"2024-09-14T12:40:55.800182+0000","last_undegraded":"2024-09-14T12:40:55.800182+0000","last_fullsized":"2024-09-14T12:40:55.800182+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:49.290553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'4","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537498+0000","last_change":"2024-09-14T11:12:26.247976+0000","last_active":"2024-09-14T12:40:11.537498+0000","last_peered":"2024-09-14T12:40:11.537498+0000","last_clean":"2024-09-14T12:40:11.537498+0000","last_became_active":"2024-09-14T11:12:26.247272+0000","last_became_peered":"2024-09-14T11:12:26.247272+0000","last_unstale":"2024-09-14T12:40:11.537498+0000","last_undegraded":"2024-09-14T12:40:11.537498+0000","last_fullsized":"2024-09-14T12:40:11.537498+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:11.612706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:34.782674+0000","last_change":"2024-09-14T11:12:19.106061+0000","last_active":"2024-09-14T12:43:34.782674+0000","last_peered":"2024-09-14T12:43:34.782674+0000","last_clean":"2024-09-14T12:43:34.782674+0000","last_became_active":"2024-09-14T11:12:19.103535+0000","last_became_peered":"2024-09-14T11:12:19.103535+0000","last_unstale":"2024-09-14T12:43:34.782674+0000","last_undegraded":"2024-09-14T12:43:34.782674+0000","last_fullsized":"2024-09-14T12:43:34.782674+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.680229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'7","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.358674+0000","last_change":"2024-09-14T11:06:29.510769+0000","last_active":"2024-09-14T12:41:50.358674+0000","last_peered":"2024-09-14T12:41:50.358674+0000","last_clean":"2024-09-14T12:41:50.358674+0000","last_became_active":"2024-09-14T11:06:29.510044+0000","last_became_peered":"2024-09-14T11:06:29.510044+0000","last_unstale":"2024-09-14T12:41:50.358674+0000","last_undegraded":"2024-09-14T12:41:50.358674+0000","last_fullsized":"2024-09-14T12:41:50.358674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:30.328430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:54.746472+0000","last_change":"2024-09-14T11:40:08.930752+0000","last_active":"2024-09-14T12:40:54.746472+0000","last_peered":"2024-09-14T12:40:54.746472+0000","last_clean":"2024-09-14T12:40:54.746472+0000","last_became_active":"2024-09-14T11:40:08.930065+0000","last_became_peered":"2024-09-14T11:40:08.930065+0000","last_unstale":"2024-09-14T12:40:54.746472+0000","last_undegraded":"2024-09-14T12:40:54.746472+0000","last_fullsized":"2024-09-14T12:40:54.746472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.939757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.807272+0000","last_change":"2024-09-14T11:12:26.234589+0000","last_active":"2024-09-14T12:41:30.807272+0000","last_peered":"2024-09-14T12:41:30.807272+0000","last_clean":"2024-09-14T12:41:30.807272+0000","last_became_active":"2024-09-14T11:12:26.233812+0000","last_became_peered":"2024-09-14T11:12:26.233812+0000","last_unstale":"2024-09-14T12:41:30.807272+0000","last_undegraded":"2024-09-14T12:41:30.807272+0000","last_fullsized":"2024-09-14T12:41:30.807272+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:49.220830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'1","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476008+0000","last_change":"2024-09-14T11:12:19.108839+0000","last_active":"2024-09-14T12:40:06.476008+0000","last_peered":"2024-09-14T12:40:06.476008+0000","last_clean":"2024-09-14T12:40:06.476008+0000","last_became_active":"2024-09-14T11:12:19.107950+0000","last_became_peered":"2024-09-14T11:12:19.107950+0000","last_unstale":"2024-09-14T12:40:06.476008+0000","last_undegraded":"2024-09-14T12:40:06.476008+0000","last_fullsized":"2024-09-14T12:40:06.476008+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:06.871908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'21","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.810485+0000","last_change":"2024-09-14T11:06:29.528799+0000","last_active":"2024-09-14T12:41:50.810485+0000","last_peered":"2024-09-14T12:41:50.810485+0000","last_clean":"2024-09-14T12:41:50.810485+0000","last_became_active":"2024-09-14T11:06:29.528153+0000","last_became_peered":"2024-09-14T11:06:29.528153+0000","last_unstale":"2024-09-14T12:41:50.810485+0000","last_undegraded":"2024-09-14T12:41:50.810485+0000","last_fullsized":"2024-09-14T12:41:50.810485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:32.956165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":111,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795593+0000","last_change":"2024-09-14T11:40:08.937198+0000","last_active":"2024-09-14T12:40:35.795593+0000","last_peered":"2024-09-14T12:40:35.795593+0000","last_clean":"2024-09-14T12:40:35.795593+0000","last_became_active":"2024-09-14T11:40:08.936369+0000","last_became_peered":"2024-09-14T11:40:08.936369+0000","last_unstale":"2024-09-14T12:40:35.795593+0000","last_undegraded":"2024-09-14T12:40:35.795593+0000","last_fullsized":"2024-09-14T12:40:35.795593+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:41.385885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.555175+0000","last_change":"2024-09-14T11:12:26.246616+0000","last_active":"2024-09-14T12:40:15.555175+0000","last_peered":"2024-09-14T12:40:15.555175+0000","last_clean":"2024-09-14T12:40:15.555175+0000","last_became_active":"2024-09-14T11:12:26.245930+0000","last_became_peered":"2024-09-14T11:12:26.245930+0000","last_unstale":"2024-09-14T12:40:15.555175+0000","last_undegraded":"2024-09-14T12:40:15.555175+0000","last_fullsized":"2024-09-14T12:40:15.555175+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:04.624461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3080,"num_write":1,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'1","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504797+0000","last_change":"2024-09-14T11:12:19.109523+0000","last_active":"2024-09-14T12:41:56.504797+0000","last_peered":"2024-09-14T12:41:56.504797+0000","last_clean":"2024-09-14T12:41:56.504797+0000","last_became_active":"2024-09-14T11:12:19.108775+0000","last_became_peered":"2024-09-14T11:12:19.108775+0000","last_unstale":"2024-09-14T12:41:56.504797+0000","last_undegraded":"2024-09-14T12:41:56.504797+0000","last_fullsized":"2024-09-14T12:41:56.504797+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:14.420097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'26","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585974+0000","last_change":"2024-09-14T11:06:29.513212+0000","last_active":"2024-09-14T12:41:50.585974+0000","last_peered":"2024-09-14T12:41:50.585974+0000","last_clean":"2024-09-14T12:41:50.585974+0000","last_became_active":"2024-09-14T11:06:29.512500+0000","last_became_peered":"2024-09-14T11:06:29.512500+0000","last_unstale":"2024-09-14T12:41:50.585974+0000","last_undegraded":"2024-09-14T12:41:50.585974+0000","last_fullsized":"2024-09-14T12:41:50.585974+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:16.159078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":126,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795654+0000","last_change":"2024-09-14T11:40:08.942991+0000","last_active":"2024-09-14T12:40:35.795654+0000","last_peered":"2024-09-14T12:40:35.795654+0000","last_clean":"2024-09-14T12:40:35.795654+0000","last_became_active":"2024-09-14T11:40:08.941346+0000","last_became_peered":"2024-09-14T11:40:08.941346+0000","last_unstale":"2024-09-14T12:40:35.795654+0000","last_undegraded":"2024-09-14T12:40:35.795654+0000","last_fullsized":"2024-09-14T12:40:35.795654+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.150412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"267'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550224+0000","last_change":"2024-09-14T11:12:26.243752+0000","last_active":"2024-09-14T12:39:55.550224+0000","last_peered":"2024-09-14T12:39:55.550224+0000","last_clean":"2024-09-14T12:39:55.550224+0000","last_became_active":"2024-09-14T11:12:26.243209+0000","last_became_peered":"2024-09-14T11:12:26.243209+0000","last_unstale":"2024-09-14T12:39:55.550224+0000","last_undegraded":"2024-09-14T12:39:55.550224+0000","last_fullsized":"2024-09-14T12:39:55.550224+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:38.328679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":3,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'9","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.565326+0000","last_change":"2024-09-14T11:12:19.092074+0000","last_active":"2024-09-14T12:40:15.565326+0000","last_peered":"2024-09-14T12:40:15.565326+0000","last_clean":"2024-09-14T12:40:15.565326+0000","last_became_active":"2024-09-14T11:12:19.091327+0000","last_became_peered":"2024-09-14T11:12:19.091327+0000","last_unstale":"2024-09-14T12:40:15.565326+0000","last_undegraded":"2024-09-14T12:40:15.565326+0000","last_fullsized":"2024-09-14T12:40:15.565326+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:38.040984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":27638,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'29","reported_seq":155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503327+0000","last_change":"2024-09-14T11:06:29.545877+0000","last_active":"2024-09-14T12:41:51.503327+0000","last_peered":"2024-09-14T12:41:51.503327+0000","last_clean":"2024-09-14T12:41:51.503327+0000","last_became_active":"2024-09-14T11:06:29.539618+0000","last_became_peered":"2024-09-14T11:06:29.539618+0000","last_unstale":"2024-09-14T12:41:51.503327+0000","last_undegraded":"2024-09-14T12:41:51.503327+0000","last_fullsized":"2024-09-14T12:41:51.503327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:18.342360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":157,"num_write":71,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:25.557355+0000","last_change":"2024-09-14T11:40:08.946921+0000","last_active":"2024-09-14T12:40:25.557355+0000","last_peered":"2024-09-14T12:40:25.557355+0000","last_clean":"2024-09-14T12:40:25.557355+0000","last_became_active":"2024-09-14T11:40:08.946312+0000","last_became_peered":"2024-09-14T11:40:08.946312+0000","last_unstale":"2024-09-14T12:40:25.557355+0000","last_undegraded":"2024-09-14T12:40:25.557355+0000","last_fullsized":"2024-09-14T12:40:25.557355+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:31.836873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:15.804514+0000","last_change":"2024-09-14T11:12:26.229509+0000","last_active":"2024-09-14T12:41:15.804514+0000","last_peered":"2024-09-14T12:41:15.804514+0000","last_clean":"2024-09-14T12:41:15.804514+0000","last_became_active":"2024-09-14T11:12:26.228723+0000","last_became_peered":"2024-09-14T11:12:26.228723+0000","last_unstale":"2024-09-14T12:41:15.804514+0000","last_undegraded":"2024-09-14T12:41:15.804514+0000","last_fullsized":"2024-09-14T12:41:15.804514+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:02.621776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":11303,"num_write":13,"num_write_kb":5161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.160475+0000","last_change":"2024-09-14T11:12:19.085868+0000","last_active":"2024-09-14T12:41:11.160475+0000","last_peered":"2024-09-14T12:41:11.160475+0000","last_clean":"2024-09-14T12:41:11.160475+0000","last_became_active":"2024-09-14T11:12:19.085023+0000","last_became_peered":"2024-09-14T11:12:19.085023+0000","last_unstale":"2024-09-14T12:41:11.160475+0000","last_undegraded":"2024-09-14T12:41:11.160475+0000","last_fullsized":"2024-09-14T12:41:11.160475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:18.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:31.150526+0000","last_change":"2024-09-14T11:06:29.529450+0000","last_active":"2024-09-14T12:40:31.150526+0000","last_peered":"2024-09-14T12:40:31.150526+0000","last_clean":"2024-09-14T12:40:31.150526+0000","last_became_active":"2024-09-14T11:06:29.527422+0000","last_became_peered":"2024-09-14T11:06:29.527422+0000","last_unstale":"2024-09-14T12:40:31.150526+0000","last_undegraded":"2024-09-14T12:40:31.150526+0000","last_fullsized":"2024-09-14T12:40:31.150526+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.481655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":97,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.483898+0000","last_change":"2024-09-14T11:40:08.934634+0000","last_active":"2024-09-14T12:40:36.483898+0000","last_peered":"2024-09-14T12:40:36.483898+0000","last_clean":"2024-09-14T12:40:36.483898+0000","last_became_active":"2024-09-14T11:40:08.933897+0000","last_became_peered":"2024-09-14T11:40:08.933897+0000","last_unstale":"2024-09-14T12:40:36.483898+0000","last_undegraded":"2024-09-14T12:40:36.483898+0000","last_fullsized":"2024-09-14T12:40:36.483898+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:56.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'4","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494346+0000","last_change":"2024-09-14T11:12:26.238345+0000","last_active":"2024-09-14T12:41:16.494346+0000","last_peered":"2024-09-14T12:41:16.494346+0000","last_clean":"2024-09-14T12:41:16.494346+0000","last_became_active":"2024-09-14T11:12:26.232736+0000","last_became_peered":"2024-09-14T11:12:26.232736+0000","last_unstale":"2024-09-14T12:41:16.494346+0000","last_undegraded":"2024-09-14T12:41:16.494346+0000","last_fullsized":"2024-09-14T12:41:16.494346+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:45.595070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9441280,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":17408,"num_write":9,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.492937+0000","last_change":"2024-09-14T11:12:19.108780+0000","last_active":"2024-09-14T12:41:11.492937+0000","last_peered":"2024-09-14T12:41:11.492937+0000","last_clean":"2024-09-14T12:41:11.492937+0000","last_became_active":"2024-09-14T11:12:19.100258+0000","last_became_peered":"2024-09-14T11:12:19.100258+0000","last_unstale":"2024-09-14T12:41:11.492937+0000","last_undegraded":"2024-09-14T12:41:11.492937+0000","last_fullsized":"2024-09-14T12:41:11.492937+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.561655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":9,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737495+0000","last_change":"2024-09-14T11:06:29.533686+0000","last_active":"2024-09-14T12:40:14.737495+0000","last_peered":"2024-09-14T12:40:14.737495+0000","last_clean":"2024-09-14T12:40:14.737495+0000","last_became_active":"2024-09-14T11:06:29.532958+0000","last_became_peered":"2024-09-14T11:06:29.532958+0000","last_unstale":"2024-09-14T12:40:14.737495+0000","last_undegraded":"2024-09-14T12:40:14.737495+0000","last_fullsized":"2024-09-14T12:40:14.737495+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:35.814419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":199,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:49.745345+0000","last_change":"2024-09-14T11:40:08.934320+0000","last_active":"2024-09-14T12:40:49.745345+0000","last_peered":"2024-09-14T12:40:49.745345+0000","last_clean":"2024-09-14T12:40:49.745345+0000","last_became_active":"2024-09-14T11:40:08.932939+0000","last_became_peered":"2024-09-14T11:40:08.932939+0000","last_unstale":"2024-09-14T12:40:49.745345+0000","last_undegraded":"2024-09-14T12:40:49.745345+0000","last_fullsized":"2024-09-14T12:40:49.745345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:01.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.560888+0000","last_change":"2024-09-14T11:12:26.245494+0000","last_active":"2024-09-14T12:39:55.560888+0000","last_peered":"2024-09-14T12:39:55.560888+0000","last_clean":"2024-09-14T12:39:55.560888+0000","last_became_active":"2024-09-14T11:12:26.236892+0000","last_became_peered":"2024-09-14T11:12:26.236892+0000","last_unstale":"2024-09-14T12:39:55.560888+0000","last_undegraded":"2024-09-14T12:39:55.560888+0000","last_fullsized":"2024-09-14T12:39:55.560888+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.142203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.151616+0000","last_change":"2024-09-14T11:12:19.085476+0000","last_active":"2024-09-14T12:40:36.151616+0000","last_peered":"2024-09-14T12:40:36.151616+0000","last_clean":"2024-09-14T12:40:36.151616+0000","last_became_active":"2024-09-14T11:12:19.084630+0000","last_became_peered":"2024-09-14T11:12:19.084630+0000","last_unstale":"2024-09-14T12:40:36.151616+0000","last_undegraded":"2024-09-14T12:40:36.151616+0000","last_fullsized":"2024-09-14T12:40:36.151616+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:40.347823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'305","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.147026+0000","last_change":"2024-09-14T11:06:29.529539+0000","last_active":"2024-09-14T12:40:16.147026+0000","last_peered":"2024-09-14T12:40:16.147026+0000","last_clean":"2024-09-14T12:40:16.147026+0000","last_became_active":"2024-09-14T11:06:29.524051+0000","last_became_peered":"2024-09-14T11:06:29.524051+0000","last_unstale":"2024-09-14T12:40:16.147026+0000","last_undegraded":"2024-09-14T12:40:16.147026+0000","last_fullsized":"2024-09-14T12:40:16.147026+0000","mapping_epoch":256,"log_start":"264'200","ondisk_log_start":"264'200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:40.592968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2841,"num_read_kb":3371,"num_write":621,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.572999+0000","last_change":"2024-09-14T11:40:08.938945+0000","last_active":"2024-09-14T12:40:50.572999+0000","last_peered":"2024-09-14T12:40:50.572999+0000","last_clean":"2024-09-14T12:40:50.572999+0000","last_became_active":"2024-09-14T11:40:08.938357+0000","last_became_peered":"2024-09-14T11:40:08.938357+0000","last_unstale":"2024-09-14T12:40:50.572999+0000","last_undegraded":"2024-09-14T12:40:50.572999+0000","last_fullsized":"2024-09-14T12:40:50.572999+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:36.211620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485050+0000","last_change":"2024-09-14T11:12:26.252293+0000","last_active":"2024-09-14T12:40:41.485050+0000","last_peered":"2024-09-14T12:40:41.485050+0000","last_clean":"2024-09-14T12:40:41.485050+0000","last_became_active":"2024-09-14T11:12:26.251771+0000","last_became_peered":"2024-09-14T11:12:26.251771+0000","last_unstale":"2024-09-14T12:40:41.485050+0000","last_undegraded":"2024-09-14T12:40:41.485050+0000","last_fullsized":"2024-09-14T12:40:41.485050+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:13.079478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":9222,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'1","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504515+0000","last_change":"2024-09-14T11:12:19.109609+0000","last_active":"2024-09-14T12:41:56.504515+0000","last_peered":"2024-09-14T12:41:56.504515+0000","last_clean":"2024-09-14T12:41:56.504515+0000","last_became_active":"2024-09-14T11:12:19.100323+0000","last_became_peered":"2024-09-14T11:12:19.100323+0000","last_unstale":"2024-09-14T12:41:56.504515+0000","last_undegraded":"2024-09-14T12:41:56.504515+0000","last_fullsized":"2024-09-14T12:41:56.504515+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'31","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478473+0000","last_change":"2024-09-14T11:06:29.545567+0000","last_active":"2024-09-14T12:40:16.478473+0000","last_peered":"2024-09-14T12:40:16.478473+0000","last_clean":"2024-09-14T12:40:16.478473+0000","last_became_active":"2024-09-14T11:06:29.545010+0000","last_became_peered":"2024-09-14T11:06:29.545010+0000","last_unstale":"2024-09-14T12:40:16.478473+0000","last_undegraded":"2024-09-14T12:40:16.478473+0000","last_fullsized":"2024-09-14T12:40:16.478473+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:33.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":160,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559740+0000","last_change":"2024-09-14T11:40:08.946756+0000","last_active":"2024-09-14T12:40:35.559740+0000","last_peered":"2024-09-14T12:40:35.559740+0000","last_clean":"2024-09-14T12:40:35.559740+0000","last_became_active":"2024-09-14T11:40:08.946192+0000","last_became_peered":"2024-09-14T11:40:08.946192+0000","last_unstale":"2024-09-14T12:40:35.559740+0000","last_undegraded":"2024-09-14T12:40:35.559740+0000","last_fullsized":"2024-09-14T12:40:35.559740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:33.765939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"267'13","reported_seq":88,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142222+0000","last_change":"2024-09-14T11:12:26.252307+0000","last_active":"2024-09-14T12:39:56.142222+0000","last_peered":"2024-09-14T12:39:56.142222+0000","last_clean":"2024-09-14T12:39:56.142222+0000","last_became_active":"2024-09-14T11:12:26.251336+0000","last_became_peered":"2024-09-14T11:12:26.251336+0000","last_unstale":"2024-09-14T12:39:56.142222+0000","last_undegraded":"2024-09-14T12:39:56.142222+0000","last_fullsized":"2024-09-14T12:39:56.142222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:43.789676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":27664,"num_write":23,"num_write_kb":11276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560463+0000","last_change":"2024-09-14T11:12:19.090268+0000","last_active":"2024-09-14T12:41:56.560463+0000","last_peered":"2024-09-14T12:41:56.560463+0000","last_clean":"2024-09-14T12:41:56.560463+0000","last_became_active":"2024-09-14T11:12:19.089451+0000","last_became_peered":"2024-09-14T11:12:19.089451+0000","last_unstale":"2024-09-14T12:41:56.560463+0000","last_undegraded":"2024-09-14T12:41:56.560463+0000","last_fullsized":"2024-09-14T12:41:56.560463+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.308101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"267'36","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478384+0000","last_change":"2024-09-14T11:06:29.519496+0000","last_active":"2024-09-14T12:40:16.478384+0000","last_peered":"2024-09-14T12:40:16.478384+0000","last_clean":"2024-09-14T12:40:16.478384+0000","last_became_active":"2024-09-14T11:06:29.518775+0000","last_became_peered":"2024-09-14T11:06:29.518775+0000","last_unstale":"2024-09-14T12:40:16.478384+0000","last_undegraded":"2024-09-14T12:40:16.478384+0000","last_fullsized":"2024-09-14T12:40:16.478384+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:55.187103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":189,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485290+0000","last_change":"2024-09-14T11:40:08.934946+0000","last_active":"2024-09-14T12:40:41.485290+0000","last_peered":"2024-09-14T12:40:41.485290+0000","last_clean":"2024-09-14T12:40:41.485290+0000","last_became_active":"2024-09-14T11:40:08.934173+0000","last_became_peered":"2024-09-14T11:40:08.934173+0000","last_unstale":"2024-09-14T12:40:41.485290+0000","last_undegraded":"2024-09-14T12:40:41.485290+0000","last_fullsized":"2024-09-14T12:40:41.485290+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:19.698280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142074+0000","last_change":"2024-09-14T11:12:26.243412+0000","last_active":"2024-09-14T12:39:56.142074+0000","last_peered":"2024-09-14T12:39:56.142074+0000","last_clean":"2024-09-14T12:39:56.142074+0000","last_became_active":"2024-09-14T11:12:26.242532+0000","last_became_peered":"2024-09-14T11:12:26.242532+0000","last_unstale":"2024-09-14T12:39:56.142074+0000","last_undegraded":"2024-09-14T12:39:56.142074+0000","last_fullsized":"2024-09-14T12:39:56.142074+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:30.032531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9208,"num_write":5,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568347+0000","last_change":"2024-09-14T11:12:19.115989+0000","last_active":"2024-09-14T12:41:55.568347+0000","last_peered":"2024-09-14T12:41:55.568347+0000","last_clean":"2024-09-14T12:41:55.568347+0000","last_became_active":"2024-09-14T11:12:19.115236+0000","last_became_peered":"2024-09-14T11:12:19.115236+0000","last_unstale":"2024-09-14T12:41:55.568347+0000","last_undegraded":"2024-09-14T12:41:55.568347+0000","last_fullsized":"2024-09-14T12:41:55.568347+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:10.915539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'6","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.154160+0000","last_change":"2024-09-14T11:06:29.526320+0000","last_active":"2024-09-14T12:40:46.154160+0000","last_peered":"2024-09-14T12:40:46.154160+0000","last_clean":"2024-09-14T12:40:46.154160+0000","last_became_active":"2024-09-14T11:06:29.525548+0000","last_became_peered":"2024-09-14T11:06:29.525548+0000","last_unstale":"2024-09-14T12:40:46.154160+0000","last_undegraded":"2024-09-14T12:40:46.154160+0000","last_fullsized":"2024-09-14T12:40:46.154160+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:11.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'327","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.812029+0000","last_change":"2024-09-14T10:49:23.373774+0000","last_active":"2024-09-14T12:41:55.812029+0000","last_peered":"2024-09-14T12:41:55.812029+0000","last_clean":"2024-09-14T12:41:55.812029+0000","last_became_active":"2024-09-14T10:49:23.372514+0000","last_became_peered":"2024-09-14T10:49:23.372514+0000","last_unstale":"2024-09-14T12:41:55.812029+0000","last_undegraded":"2024-09-14T12:41:55.812029+0000","last_fullsized":"2024-09-14T12:41:55.812029+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15587743,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":630,"num_read_kb":89783,"num_write":1127,"num_write_kb":37856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'875","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.375040+0000","last_change":"2024-09-14T10:49:25.369326+0000","last_active":"2024-09-14T12:42:29.375040+0000","last_peered":"2024-09-14T12:42:29.375040+0000","last_clean":"2024-09-14T12:42:29.375040+0000","last_became_active":"2024-09-14T10:49:25.368861+0000","last_became_peered":"2024-09-14T10:49:25.368861+0000","last_unstale":"2024-09-14T12:42:29.375040+0000","last_undegraded":"2024-09-14T12:42:29.375040+0000","last_fullsized":"2024-09-14T12:42:29.375040+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:53.245258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4292,"num_read_kb":3786,"num_write":1290,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'327","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360075+0000","last_change":"2024-09-14T10:49:23.387406+0000","last_active":"2024-09-14T12:41:55.360075+0000","last_peered":"2024-09-14T12:41:55.360075+0000","last_clean":"2024-09-14T12:41:55.360075+0000","last_became_active":"2024-09-14T10:49:23.386742+0000","last_became_peered":"2024-09-14T10:49:23.386742+0000","last_unstale":"2024-09-14T12:41:55.360075+0000","last_undegraded":"2024-09-14T12:41:55.360075+0000","last_fullsized":"2024-09-14T12:41:55.360075+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.860422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5532289,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":905,"num_read_kb":14777,"num_write":1126,"num_write_kb":22069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'1157","reported_seq":2810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.680278+0000","last_change":"2024-09-14T10:49:25.371243+0000","last_active":"2024-09-14T12:42:31.680278+0000","last_peered":"2024-09-14T12:42:31.680278+0000","last_clean":"2024-09-14T12:42:31.680278+0000","last_became_active":"2024-09-14T10:49:25.370610+0000","last_became_peered":"2024-09-14T10:49:25.370610+0000","last_unstale":"2024-09-14T12:42:31.680278+0000","last_undegraded":"2024-09-14T12:42:31.680278+0000","last_fullsized":"2024-09-14T12:42:31.680278+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:18.603078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5343,"num_read_kb":4756,"num_write":1566,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'316","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360001+0000","last_change":"2024-09-14T10:49:23.368497+0000","last_active":"2024-09-14T12:41:55.360001+0000","last_peered":"2024-09-14T12:41:55.360001+0000","last_clean":"2024-09-14T12:41:55.360001+0000","last_became_active":"2024-09-14T10:49:23.367647+0000","last_became_peered":"2024-09-14T10:49:23.367647+0000","last_unstale":"2024-09-14T12:41:55.360001+0000","last_undegraded":"2024-09-14T12:41:55.360001+0000","last_fullsized":"2024-09-14T12:41:55.360001+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:08.432641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9463108,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":620,"num_read_kb":20302,"num_write":1165,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1240","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.728017+0000","last_change":"2024-09-14T10:49:25.380844+0000","last_active":"2024-09-14T12:41:23.728017+0000","last_peered":"2024-09-14T12:41:23.728017+0000","last_clean":"2024-09-14T12:41:23.728017+0000","last_became_active":"2024-09-14T10:49:25.380525+0000","last_became_peered":"2024-09-14T10:49:25.380525+0000","last_unstale":"2024-09-14T12:41:23.728017+0000","last_undegraded":"2024-09-14T12:41:23.728017+0000","last_fullsized":"2024-09-14T12:41:23.728017+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:39.949070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5594,"num_read_kb":4933,"num_write":1701,"num_write_kb":712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'311","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.167123+0000","last_change":"2024-09-14T10:49:23.395465+0000","last_active":"2024-09-14T12:41:41.167123+0000","last_peered":"2024-09-14T12:41:41.167123+0000","last_clean":"2024-09-14T12:41:41.167123+0000","last_became_active":"2024-09-14T10:49:23.395029+0000","last_became_peered":"2024-09-14T10:49:23.395029+0000","last_unstale":"2024-09-14T12:41:41.167123+0000","last_undegraded":"2024-09-14T12:41:41.167123+0000","last_fullsized":"2024-09-14T12:41:41.167123+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:51.643761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294264,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":508,"num_read_kb":13842,"num_write":1078,"num_write_kb":32575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'922","reported_seq":2538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:08.373535+0000","last_change":"2024-09-14T10:49:25.369478+0000","last_active":"2024-09-14T12:40:08.373535+0000","last_peered":"2024-09-14T12:40:08.373535+0000","last_clean":"2024-09-14T12:40:08.373535+0000","last_became_active":"2024-09-14T10:49:25.368723+0000","last_became_peered":"2024-09-14T10:49:25.368723+0000","last_unstale":"2024-09-14T12:40:08.373535+0000","last_undegraded":"2024-09-14T12:40:08.373535+0000","last_fullsized":"2024-09-14T12:40:08.373535+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:35.388355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6457,"num_read_kb":5960,"num_write":1431,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'303","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:25.779688+0000","last_change":"2024-09-14T10:49:23.397395+0000","last_active":"2024-09-14T12:39:25.779688+0000","last_peered":"2024-09-14T12:39:25.779688+0000","last_clean":"2024-09-14T12:39:25.779688+0000","last_became_active":"2024-09-14T10:49:23.396952+0000","last_became_peered":"2024-09-14T10:49:23.396952+0000","last_unstale":"2024-09-14T12:39:25.779688+0000","last_undegraded":"2024-09-14T12:39:25.779688+0000","last_fullsized":"2024-09-14T12:39:25.779688+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:46.006794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10144239,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":668,"num_read_kb":15587,"num_write":1187,"num_write_kb":19198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'487","reported_seq":2234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.631742+0000","last_change":"2024-09-14T10:49:25.369573+0000","last_active":"2024-09-14T12:43:47.631742+0000","last_peered":"2024-09-14T12:43:47.631742+0000","last_clean":"2024-09-14T12:43:47.631742+0000","last_became_active":"2024-09-14T10:49:25.369197+0000","last_became_peered":"2024-09-14T10:49:25.369197+0000","last_unstale":"2024-09-14T12:43:47.631742+0000","last_undegraded":"2024-09-14T12:43:47.631742+0000","last_fullsized":"2024-09-14T12:43:47.631742+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:39.097092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2591,"num_write":558,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'270","reported_seq":920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:26.135009+0000","last_change":"2024-09-14T10:49:23.387209+0000","last_active":"2024-09-14T12:39:26.135009+0000","last_peered":"2024-09-14T12:39:26.135009+0000","last_clean":"2024-09-14T12:39:26.135009+0000","last_became_active":"2024-09-14T10:49:23.386773+0000","last_became_peered":"2024-09-14T10:49:23.386773+0000","last_unstale":"2024-09-14T12:39:26.135009+0000","last_undegraded":"2024-09-14T12:39:26.135009+0000","last_fullsized":"2024-09-14T12:39:26.135009+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:38.080039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6302893,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":490,"num_read_kb":8718,"num_write":1001,"num_write_kb":39714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'428","reported_seq":2070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.811994+0000","last_change":"2024-09-14T10:49:25.404535+0000","last_active":"2024-09-14T12:41:55.811994+0000","last_peered":"2024-09-14T12:41:55.811994+0000","last_clean":"2024-09-14T12:41:55.811994+0000","last_became_active":"2024-09-14T10:49:25.404189+0000","last_became_peered":"2024-09-14T10:49:25.404189+0000","last_unstale":"2024-09-14T12:41:55.811994+0000","last_undegraded":"2024-09-14T12:41:55.811994+0000","last_fullsized":"2024-09-14T12:41:55.811994+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:54.606077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2519,"num_read_kb":2387,"num_write":515,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'337","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:27.635381+0000","last_change":"2024-09-14T10:49:23.354318+0000","last_active":"2024-09-14T12:39:27.635381+0000","last_peered":"2024-09-14T12:39:27.635381+0000","last_clean":"2024-09-14T12:39:27.635381+0000","last_became_active":"2024-09-14T10:49:23.353824+0000","last_became_peered":"2024-09-14T10:49:23.353824+0000","last_unstale":"2024-09-14T12:39:27.635381+0000","last_undegraded":"2024-09-14T12:39:27.635381+0000","last_fullsized":"2024-09-14T12:39:27.635381+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:21.688185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3446958,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":619,"num_read_kb":3209,"num_write":1233,"num_write_kb":30473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'1236","reported_seq":2941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.170607+0000","last_change":"2024-09-14T10:49:25.388326+0000","last_active":"2024-09-14T12:41:56.170607+0000","last_peered":"2024-09-14T12:41:56.170607+0000","last_clean":"2024-09-14T12:41:56.170607+0000","last_became_active":"2024-09-14T10:49:25.388008+0000","last_became_peered":"2024-09-14T10:49:25.388008+0000","last_unstale":"2024-09-14T12:41:56.170607+0000","last_undegraded":"2024-09-14T12:41:56.170607+0000","last_fullsized":"2024-09-14T12:41:56.170607+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":1200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:16.569310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5023,"num_write":1696,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'260","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:41.875394+0000","last_change":"2024-09-14T10:49:23.375365+0000","last_active":"2024-09-14T12:43:41.875394+0000","last_peered":"2024-09-14T12:43:41.875394+0000","last_clean":"2024-09-14T12:43:41.875394+0000","last_became_active":"2024-09-14T10:49:23.374194+0000","last_became_peered":"2024-09-14T10:49:23.374194+0000","last_unstale":"2024-09-14T12:43:41.875394+0000","last_undegraded":"2024-09-14T12:43:41.875394+0000","last_fullsized":"2024-09-14T12:43:41.875394+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:48.534483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10138434,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":420,"num_read_kb":30724,"num_write":905,"num_write_kb":46577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'763","reported_seq":2187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.688694+0000","last_change":"2024-09-14T10:49:25.396557+0000","last_active":"2024-09-14T12:43:47.688694+0000","last_peered":"2024-09-14T12:43:47.688694+0000","last_clean":"2024-09-14T12:43:47.688694+0000","last_became_active":"2024-09-14T10:49:25.395625+0000","last_became_peered":"2024-09-14T10:49:25.395625+0000","last_unstale":"2024-09-14T12:43:47.688694+0000","last_undegraded":"2024-09-14T12:43:47.688694+0000","last_fullsized":"2024-09-14T12:43:47.688694+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:55.126134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3607,"num_read_kb":3221,"num_write":1031,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'923","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496603+0000","last_change":"2024-09-14T10:49:25.378305+0000","last_active":"2024-09-14T12:41:26.496603+0000","last_peered":"2024-09-14T12:41:26.496603+0000","last_clean":"2024-09-14T12:41:26.496603+0000","last_became_active":"2024-09-14T10:49:25.377697+0000","last_became_peered":"2024-09-14T10:49:25.377697+0000","last_unstale":"2024-09-14T12:41:26.496603+0000","last_undegraded":"2024-09-14T12:41:26.496603+0000","last_fullsized":"2024-09-14T12:41:26.496603+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:55.143987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4426,"num_read_kb":3954,"num_write":1251,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'264","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.416054+0000","last_change":"2024-09-14T10:49:23.396284+0000","last_active":"2024-09-14T12:42:05.416054+0000","last_peered":"2024-09-14T12:42:05.416054+0000","last_clean":"2024-09-14T12:42:05.416054+0000","last_became_active":"2024-09-14T10:49:23.395881+0000","last_became_peered":"2024-09-14T10:49:23.395881+0000","last_unstale":"2024-09-14T12:42:05.416054+0000","last_undegraded":"2024-09-14T12:42:05.416054+0000","last_fullsized":"2024-09-14T12:42:05.416054+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:37.290462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10483156,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":532,"num_read_kb":45321,"num_write":882,"num_write_kb":34104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'503","reported_seq":2238,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.624807+0000","last_change":"2024-09-14T10:49:25.359959+0000","last_active":"2024-09-14T12:43:47.624807+0000","last_peered":"2024-09-14T12:43:47.624807+0000","last_clean":"2024-09-14T12:43:47.624807+0000","last_became_active":"2024-09-14T10:49:25.359419+0000","last_became_peered":"2024-09-14T10:49:25.359419+0000","last_unstale":"2024-09-14T12:43:47.624807+0000","last_undegraded":"2024-09-14T12:43:47.624807+0000","last_fullsized":"2024-09-14T12:43:47.624807+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:22.801370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2958,"num_read_kb":2787,"num_write":621,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'273","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:11.257777+0000","last_change":"2024-09-14T10:49:23.374078+0000","last_active":"2024-09-14T12:42:11.257777+0000","last_peered":"2024-09-14T12:42:11.257777+0000","last_clean":"2024-09-14T12:42:11.257777+0000","last_became_active":"2024-09-14T10:49:23.372672+0000","last_became_peered":"2024-09-14T10:49:23.372672+0000","last_unstale":"2024-09-14T12:42:11.257777+0000","last_undegraded":"2024-09-14T12:42:11.257777+0000","last_fullsized":"2024-09-14T12:42:11.257777+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.831678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8199771,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":527,"num_read_kb":8965,"num_write":975,"num_write_kb":20473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'401","reported_seq":1910,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.382357+0000","last_change":"2024-09-14T10:49:25.404208+0000","last_active":"2024-09-14T12:42:29.382357+0000","last_peered":"2024-09-14T12:42:29.382357+0000","last_clean":"2024-09-14T12:42:29.382357+0000","last_became_active":"2024-09-14T10:49:25.403885+0000","last_became_peered":"2024-09-14T10:49:25.403885+0000","last_unstale":"2024-09-14T12:42:29.382357+0000","last_undegraded":"2024-09-14T12:42:29.382357+0000","last_fullsized":"2024-09-14T12:42:29.382357+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:52.374511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2137,"num_read_kb":2023,"num_write":462,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'336","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:39.249338+0000","last_change":"2024-09-14T10:49:23.355237+0000","last_active":"2024-09-14T12:43:39.249338+0000","last_peered":"2024-09-14T12:43:39.249338+0000","last_clean":"2024-09-14T12:43:39.249338+0000","last_became_active":"2024-09-14T10:49:23.354127+0000","last_became_peered":"2024-09-14T10:49:23.354127+0000","last_unstale":"2024-09-14T12:43:39.249338+0000","last_undegraded":"2024-09-14T12:43:39.249338+0000","last_fullsized":"2024-09-14T12:43:39.249338+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:02.709768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2157026,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":723,"num_read_kb":56952,"num_write":1206,"num_write_kb":28690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"267'803","reported_seq":2347,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.456789+0000","last_change":"2024-09-14T10:49:25.396880+0000","last_active":"2024-09-14T12:42:29.456789+0000","last_peered":"2024-09-14T12:42:29.456789+0000","last_clean":"2024-09-14T12:42:29.456789+0000","last_became_active":"2024-09-14T10:49:25.396001+0000","last_became_peered":"2024-09-14T10:49:25.396001+0000","last_unstale":"2024-09-14T12:42:29.456789+0000","last_undegraded":"2024-09-14T12:42:29.456789+0000","last_fullsized":"2024-09-14T12:42:29.456789+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:58.603959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3888,"num_read_kb":3489,"num_write":1086,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'312","reported_seq":1101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795709+0000","last_change":"2024-09-14T10:49:23.387939+0000","last_active":"2024-09-14T12:40:35.795709+0000","last_peered":"2024-09-14T12:40:35.795709+0000","last_clean":"2024-09-14T12:40:35.795709+0000","last_became_active":"2024-09-14T10:49:23.387292+0000","last_became_peered":"2024-09-14T10:49:23.387292+0000","last_unstale":"2024-09-14T12:40:35.795709+0000","last_undegraded":"2024-09-14T12:40:35.795709+0000","last_fullsized":"2024-09-14T12:40:35.795709+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:32.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14639671,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":647,"num_read_kb":37760,"num_write":1121,"num_write_kb":55114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'373","reported_seq":1802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.628580+0000","last_change":"2024-09-14T10:49:25.394672+0000","last_active":"2024-09-14T12:43:47.628580+0000","last_peered":"2024-09-14T12:43:47.628580+0000","last_clean":"2024-09-14T12:43:47.628580+0000","last_became_active":"2024-09-14T10:49:25.394106+0000","last_became_peered":"2024-09-14T10:49:25.394106+0000","last_unstale":"2024-09-14T12:43:47.628580+0000","last_undegraded":"2024-09-14T12:43:47.628580+0000","last_fullsized":"2024-09-14T12:43:47.628580+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:13.420566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2013,"num_read_kb":1909,"num_write":433,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'373","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.412068+0000","last_change":"2024-09-14T10:49:23.364844+0000","last_active":"2024-09-14T12:42:05.412068+0000","last_peered":"2024-09-14T12:42:05.412068+0000","last_clean":"2024-09-14T12:42:05.412068+0000","last_became_active":"2024-09-14T10:49:23.364035+0000","last_became_peered":"2024-09-14T10:49:23.364035+0000","last_unstale":"2024-09-14T12:42:05.412068+0000","last_undegraded":"2024-09-14T12:42:05.412068+0000","last_fullsized":"2024-09-14T12:42:05.412068+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:50.556342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6985735,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":819,"num_read_kb":15225,"num_write":1177,"num_write_kb":26982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'779","reported_seq":2497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.206173+0000","last_change":"2024-09-14T10:49:25.372194+0000","last_active":"2024-09-14T12:42:22.206173+0000","last_peered":"2024-09-14T12:42:22.206173+0000","last_clean":"2024-09-14T12:42:22.206173+0000","last_became_active":"2024-09-14T10:49:25.371736+0000","last_became_peered":"2024-09-14T10:49:25.371736+0000","last_unstale":"2024-09-14T12:42:22.206173+0000","last_undegraded":"2024-09-14T12:42:22.206173+0000","last_fullsized":"2024-09-14T12:42:22.206173+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:00.150399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3876,"num_read_kb":3539,"num_write":1018,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'274","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.842429+0000","last_change":"2024-09-14T10:49:23.379017+0000","last_active":"2024-09-14T12:42:21.842429+0000","last_peered":"2024-09-14T12:42:21.842429+0000","last_clean":"2024-09-14T12:42:21.842429+0000","last_became_active":"2024-09-14T10:49:23.378269+0000","last_became_peered":"2024-09-14T10:49:23.378269+0000","last_unstale":"2024-09-14T12:42:21.842429+0000","last_undegraded":"2024-09-14T12:42:21.842429+0000","last_fullsized":"2024-09-14T12:42:21.842429+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:32.034490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6303647,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":481,"num_read_kb":35954,"num_write":1040,"num_write_kb":39786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'141","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.101213+0000","last_change":"2024-09-14T10:49:33.465171+0000","last_active":"2024-09-14T12:42:32.101213+0000","last_peered":"2024-09-14T12:42:32.101213+0000","last_clean":"2024-09-14T12:42:32.101213+0000","last_became_active":"2024-09-14T10:49:33.464427+0000","last_became_peered":"2024-09-14T10:49:33.464427+0000","last_unstale":"2024-09-14T12:42:32.101213+0000","last_undegraded":"2024-09-14T12:42:32.101213+0000","last_fullsized":"2024-09-14T12:42:32.101213+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.777578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":140,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'434","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.729509+0000","last_change":"2024-09-14T10:49:25.381601+0000","last_active":"2024-09-14T12:41:23.729509+0000","last_peered":"2024-09-14T12:41:23.729509+0000","last_clean":"2024-09-14T12:41:23.729509+0000","last_became_active":"2024-09-14T10:49:25.379409+0000","last_became_peered":"2024-09-14T10:49:25.379409+0000","last_unstale":"2024-09-14T12:41:23.729509+0000","last_undegraded":"2024-09-14T12:41:23.729509+0000","last_fullsized":"2024-09-14T12:41:23.729509+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:45.958192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2548,"num_read_kb":2434,"num_write":516,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'290","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496811+0000","last_change":"2024-09-14T10:49:23.366250+0000","last_active":"2024-09-14T12:41:26.496811+0000","last_peered":"2024-09-14T12:41:26.496811+0000","last_clean":"2024-09-14T12:41:26.496811+0000","last_became_active":"2024-09-14T10:49:23.365630+0000","last_became_peered":"2024-09-14T10:49:23.365630+0000","last_unstale":"2024-09-14T12:41:26.496811+0000","last_undegraded":"2024-09-14T12:41:26.496811+0000","last_fullsized":"2024-09-14T12:41:26.496811+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:00.413045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13969150,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":519,"num_read_kb":11787,"num_write":1121,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485373+0000","last_change":"2024-09-14T10:49:27.388283+0000","last_active":"2024-09-14T12:40:41.485373+0000","last_peered":"2024-09-14T12:40:41.485373+0000","last_clean":"2024-09-14T12:40:41.485373+0000","last_became_active":"2024-09-14T10:49:27.387803+0000","last_became_peered":"2024-09-14T10:49:27.387803+0000","last_unstale":"2024-09-14T12:40:41.485373+0000","last_undegraded":"2024-09-14T12:40:41.485373+0000","last_fullsized":"2024-09-14T12:40:41.485373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:58.901691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'383","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:05.603732+0000","last_change":"2024-09-14T10:49:29.387542+0000","last_active":"2024-09-14T12:43:05.603732+0000","last_peered":"2024-09-14T12:43:05.603732+0000","last_clean":"2024-09-14T12:43:05.603732+0000","last_became_active":"2024-09-14T10:49:29.386799+0000","last_became_peered":"2024-09-14T10:49:29.386799+0000","last_unstale":"2024-09-14T12:43:05.603732+0000","last_undegraded":"2024-09-14T12:43:05.603732+0000","last_fullsized":"2024-09-14T12:43:05.603732+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.432275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":1111,"num_write":482,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550661+0000","last_change":"2024-09-14T10:49:31.408598+0000","last_active":"2024-09-14T12:40:45.550661+0000","last_peered":"2024-09-14T12:40:45.550661+0000","last_clean":"2024-09-14T12:40:45.550661+0000","last_became_active":"2024-09-14T10:49:31.407831+0000","last_became_peered":"2024-09-14T10:49:31.407831+0000","last_unstale":"2024-09-14T12:40:45.550661+0000","last_undegraded":"2024-09-14T12:40:45.550661+0000","last_fullsized":"2024-09-14T12:40:45.550661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:34.507742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'138","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:25.404481+0000","last_change":"2024-09-14T10:49:33.475510+0000","last_active":"2024-09-14T12:42:25.404481+0000","last_peered":"2024-09-14T12:42:25.404481+0000","last_clean":"2024-09-14T12:42:25.404481+0000","last_became_active":"2024-09-14T10:49:33.474458+0000","last_became_peered":"2024-09-14T10:49:33.474458+0000","last_unstale":"2024-09-14T12:42:25.404481+0000","last_undegraded":"2024-09-14T12:42:25.404481+0000","last_fullsized":"2024-09-14T12:42:25.404481+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:19.578114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":162,"num_write":341,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'692","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.618190+0000","last_change":"2024-09-14T10:49:25.378257+0000","last_active":"2024-09-14T12:43:47.618190+0000","last_peered":"2024-09-14T12:43:47.618190+0000","last_clean":"2024-09-14T12:43:47.618190+0000","last_became_active":"2024-09-14T10:49:25.375112+0000","last_became_peered":"2024-09-14T10:49:25.375112+0000","last_unstale":"2024-09-14T12:43:47.618190+0000","last_undegraded":"2024-09-14T12:43:47.618190+0000","last_fullsized":"2024-09-14T12:43:47.618190+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:16.262424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3284,"num_write":889,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'369","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.553791+0000","last_change":"2024-09-14T10:49:23.385621+0000","last_active":"2024-09-14T12:41:26.553791+0000","last_peered":"2024-09-14T12:41:26.553791+0000","last_clean":"2024-09-14T12:41:26.553791+0000","last_became_active":"2024-09-14T10:49:23.384801+0000","last_became_peered":"2024-09-14T10:49:23.384801+0000","last_unstale":"2024-09-14T12:41:26.553791+0000","last_undegraded":"2024-09-14T12:41:26.553791+0000","last_fullsized":"2024-09-14T12:41:26.553791+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:37.649524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591992,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":673,"num_read_kb":6714,"num_write":1233,"num_write_kb":31721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.557476+0000","last_change":"2024-09-14T10:49:27.379539+0000","last_active":"2024-09-14T12:39:40.557476+0000","last_peered":"2024-09-14T12:39:40.557476+0000","last_clean":"2024-09-14T12:39:40.557476+0000","last_became_active":"2024-09-14T10:49:27.378702+0000","last_became_peered":"2024-09-14T10:49:27.378702+0000","last_unstale":"2024-09-14T12:39:40.557476+0000","last_undegraded":"2024-09-14T12:39:40.557476+0000","last_fullsized":"2024-09-14T12:39:40.557476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:50.849295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'127","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549519+0000","last_change":"2024-09-14T10:49:29.398866+0000","last_active":"2024-09-14T12:40:40.549519+0000","last_peered":"2024-09-14T12:40:40.549519+0000","last_clean":"2024-09-14T12:40:40.549519+0000","last_became_active":"2024-09-14T10:49:29.398354+0000","last_became_peered":"2024-09-14T10:49:29.398354+0000","last_unstale":"2024-09-14T12:40:40.549519+0000","last_undegraded":"2024-09-14T12:40:40.549519+0000","last_fullsized":"2024-09-14T12:40:40.549519+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:55.441392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550575+0000","last_change":"2024-09-14T10:49:31.434144+0000","last_active":"2024-09-14T12:40:45.550575+0000","last_peered":"2024-09-14T12:40:45.550575+0000","last_clean":"2024-09-14T12:40:45.550575+0000","last_became_active":"2024-09-14T10:49:31.433431+0000","last_became_peered":"2024-09-14T10:49:31.433431+0000","last_unstale":"2024-09-14T12:40:45.550575+0000","last_undegraded":"2024-09-14T12:40:45.550575+0000","last_fullsized":"2024-09-14T12:40:45.550575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:01.989175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'115","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.484054+0000","last_change":"2024-09-14T10:49:33.463822+0000","last_active":"2024-09-14T12:39:44.484054+0000","last_peered":"2024-09-14T12:39:44.484054+0000","last_clean":"2024-09-14T12:39:44.484054+0000","last_became_active":"2024-09-14T10:49:33.463124+0000","last_became_peered":"2024-09-14T10:49:33.463124+0000","last_unstale":"2024-09-14T12:39:44.484054+0000","last_undegraded":"2024-09-14T12:39:44.484054+0000","last_fullsized":"2024-09-14T12:39:44.484054+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:53.103119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'851","reported_seq":2501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.772346+0000","last_change":"2024-09-14T10:49:25.389867+0000","last_active":"2024-09-14T12:42:31.772346+0000","last_peered":"2024-09-14T12:42:31.772346+0000","last_clean":"2024-09-14T12:42:31.772346+0000","last_became_active":"2024-09-14T10:49:25.385678+0000","last_became_peered":"2024-09-14T10:49:25.385678+0000","last_unstale":"2024-09-14T12:42:31.772346+0000","last_undegraded":"2024-09-14T12:42:31.772346+0000","last_fullsized":"2024-09-14T12:42:31.772346+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:25.356791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4238,"num_read_kb":3841,"num_write":1159,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'314","reported_seq":1210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496668+0000","last_change":"2024-09-14T10:49:23.372266+0000","last_active":"2024-09-14T12:41:26.496668+0000","last_peered":"2024-09-14T12:41:26.496668+0000","last_clean":"2024-09-14T12:41:26.496668+0000","last_became_active":"2024-09-14T10:49:23.371893+0000","last_became_peered":"2024-09-14T10:49:23.371893+0000","last_unstale":"2024-09-14T12:41:26.496668+0000","last_undegraded":"2024-09-14T12:41:26.496668+0000","last_fullsized":"2024-09-14T12:41:26.496668+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:31.260794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9954594,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":1299,"num_read_kb":59405,"num_write":1078,"num_write_kb":37706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.570738+0000","last_change":"2024-09-14T10:49:27.380154+0000","last_active":"2024-09-14T12:40:40.570738+0000","last_peered":"2024-09-14T12:40:40.570738+0000","last_clean":"2024-09-14T12:40:40.570738+0000","last_became_active":"2024-09-14T10:49:27.379355+0000","last_became_peered":"2024-09-14T10:49:27.379355+0000","last_unstale":"2024-09-14T12:40:40.570738+0000","last_undegraded":"2024-09-14T12:40:40.570738+0000","last_fullsized":"2024-09-14T12:40:40.570738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:52.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.371862+0000","last_change":"2024-09-14T10:49:29.387051+0000","last_active":"2024-09-14T12:40:15.371862+0000","last_peered":"2024-09-14T12:40:15.371862+0000","last_clean":"2024-09-14T12:40:15.371862+0000","last_became_active":"2024-09-14T10:49:29.386264+0000","last_became_peered":"2024-09-14T10:49:29.386264+0000","last_unstale":"2024-09-14T12:40:15.371862+0000","last_undegraded":"2024-09-14T12:40:15.371862+0000","last_fullsized":"2024-09-14T12:40:15.371862+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:32.852231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'806","reported_seq":3017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.145566+0000","last_change":"2024-09-14T10:49:31.432319+0000","last_active":"2024-09-14T12:43:49.145566+0000","last_peered":"2024-09-14T12:43:49.145566+0000","last_clean":"2024-09-14T12:43:49.145566+0000","last_became_active":"2024-09-14T10:49:31.431702+0000","last_became_peered":"2024-09-14T10:49:31.431702+0000","last_unstale":"2024-09-14T12:43:49.145566+0000","last_undegraded":"2024-09-14T12:43:49.145566+0000","last_fullsized":"2024-09-14T12:43:49.145566+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:52.750405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'216","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.705477+0000","last_change":"2024-09-14T10:49:33.473107+0000","last_active":"2024-09-14T12:42:29.705477+0000","last_peered":"2024-09-14T12:42:29.705477+0000","last_clean":"2024-09-14T12:42:29.705477+0000","last_became_active":"2024-09-14T10:49:33.472433+0000","last_became_peered":"2024-09-14T10:49:33.472433+0000","last_unstale":"2024-09-14T12:42:29.705477+0000","last_undegraded":"2024-09-14T12:42:29.705477+0000","last_fullsized":"2024-09-14T12:42:29.705477+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":612,"num_write":471,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'451","reported_seq":2012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559941+0000","last_change":"2024-09-14T10:49:25.398553+0000","last_active":"2024-09-14T12:40:35.559941+0000","last_peered":"2024-09-14T12:40:35.559941+0000","last_clean":"2024-09-14T12:40:35.559941+0000","last_became_active":"2024-09-14T10:49:25.395255+0000","last_became_peered":"2024-09-14T10:49:25.395255+0000","last_unstale":"2024-09-14T12:40:35.559941+0000","last_undegraded":"2024-09-14T12:40:35.559941+0000","last_fullsized":"2024-09-14T12:40:35.559941+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:50.419167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2444,"num_read_kb":2309,"num_write":533,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'297","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.559409+0000","last_change":"2024-09-14T10:49:23.403490+0000","last_active":"2024-09-14T12:41:25.559409+0000","last_peered":"2024-09-14T12:41:25.559409+0000","last_clean":"2024-09-14T12:41:25.559409+0000","last_became_active":"2024-09-14T10:49:23.403079+0000","last_became_peered":"2024-09-14T10:49:23.403079+0000","last_unstale":"2024-09-14T12:41:25.559409+0000","last_undegraded":"2024-09-14T12:41:25.559409+0000","last_fullsized":"2024-09-14T12:41:25.559409+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:43.895377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15567719,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":495,"num_read_kb":46330,"num_write":1049,"num_write_kb":49327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485445+0000","last_change":"2024-09-14T10:49:27.392398+0000","last_active":"2024-09-14T12:40:41.485445+0000","last_peered":"2024-09-14T12:40:41.485445+0000","last_clean":"2024-09-14T12:40:41.485445+0000","last_became_active":"2024-09-14T10:49:27.391823+0000","last_became_peered":"2024-09-14T10:49:27.391823+0000","last_unstale":"2024-09-14T12:40:41.485445+0000","last_undegraded":"2024-09-14T12:40:41.485445+0000","last_fullsized":"2024-09-14T12:40:41.485445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:59.037074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'320","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:06.186645+0000","last_change":"2024-09-14T10:49:29.385602+0000","last_active":"2024-09-14T12:43:06.186645+0000","last_peered":"2024-09-14T12:43:06.186645+0000","last_clean":"2024-09-14T12:43:06.186645+0000","last_became_active":"2024-09-14T10:49:29.385023+0000","last_became_peered":"2024-09-14T10:49:29.385023+0000","last_unstale":"2024-09-14T12:43:06.186645+0000","last_undegraded":"2024-09-14T12:43:06.186645+0000","last_fullsized":"2024-09-14T12:43:06.186645+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:43.706717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":1019,"num_write":418,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'822","reported_seq":5655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105420+0000","last_change":"2024-09-14T10:49:31.425706+0000","last_active":"2024-09-14T12:43:49.105420+0000","last_peered":"2024-09-14T12:43:49.105420+0000","last_clean":"2024-09-14T12:43:49.105420+0000","last_became_active":"2024-09-14T10:49:31.424873+0000","last_became_peered":"2024-09-14T10:49:31.424873+0000","last_unstale":"2024-09-14T12:43:49.105420+0000","last_undegraded":"2024-09-14T12:43:49.105420+0000","last_fullsized":"2024-09-14T12:43:49.105420+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:39.590615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'493","reported_seq":2117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.788525+0000","last_change":"2024-09-14T10:49:25.373828+0000","last_active":"2024-09-14T12:41:16.788525+0000","last_peered":"2024-09-14T12:41:16.788525+0000","last_clean":"2024-09-14T12:41:16.788525+0000","last_became_active":"2024-09-14T10:49:25.372711+0000","last_became_peered":"2024-09-14T10:49:25.372711+0000","last_unstale":"2024-09-14T12:41:16.788525+0000","last_undegraded":"2024-09-14T12:41:16.788525+0000","last_fullsized":"2024-09-14T12:41:16.788525+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:46.395982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2694,"num_read_kb":2523,"num_write":626,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'317","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.998103+0000","last_change":"2024-09-14T10:49:23.363597+0000","last_active":"2024-09-14T12:40:14.998103+0000","last_peered":"2024-09-14T12:40:14.998103+0000","last_clean":"2024-09-14T12:40:14.998103+0000","last_became_active":"2024-09-14T10:49:23.363126+0000","last_became_peered":"2024-09-14T10:49:23.363126+0000","last_unstale":"2024-09-14T12:40:14.998103+0000","last_undegraded":"2024-09-14T12:40:14.998103+0000","last_fullsized":"2024-09-14T12:40:14.998103+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:44.328445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2353159,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":645,"num_read_kb":10241,"num_write":1136,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.540062+0000","last_change":"2024-09-14T10:49:27.382040+0000","last_active":"2024-09-14T12:40:00.540062+0000","last_peered":"2024-09-14T12:40:00.540062+0000","last_clean":"2024-09-14T12:40:00.540062+0000","last_became_active":"2024-09-14T10:49:27.380063+0000","last_became_peered":"2024-09-14T10:49:27.380063+0000","last_unstale":"2024-09-14T12:40:00.540062+0000","last_undegraded":"2024-09-14T12:40:00.540062+0000","last_fullsized":"2024-09-14T12:40:00.540062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:23.504934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'437","reported_seq":1137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.819664+0000","last_change":"2024-09-14T10:49:29.383878+0000","last_active":"2024-09-14T12:42:30.819664+0000","last_peered":"2024-09-14T12:42:30.819664+0000","last_clean":"2024-09-14T12:42:30.819664+0000","last_became_active":"2024-09-14T10:49:29.383306+0000","last_became_peered":"2024-09-14T10:49:29.383306+0000","last_unstale":"2024-09-14T12:42:30.819664+0000","last_undegraded":"2024-09-14T12:42:30.819664+0000","last_fullsized":"2024-09-14T12:42:30.819664+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:17.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59853,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":1152,"num_write":526,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532617+0000","last_change":"2024-09-14T10:49:31.407042+0000","last_active":"2024-09-14T12:39:51.532617+0000","last_peered":"2024-09-14T12:39:51.532617+0000","last_clean":"2024-09-14T12:39:51.532617+0000","last_became_active":"2024-09-14T10:49:31.406293+0000","last_became_peered":"2024-09-14T10:49:31.406293+0000","last_unstale":"2024-09-14T12:39:51.532617+0000","last_undegraded":"2024-09-14T12:39:51.532617+0000","last_fullsized":"2024-09-14T12:39:51.532617+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:15.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'561","reported_seq":1444,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.641698+0000","last_change":"2024-09-14T10:49:33.475077+0000","last_active":"2024-09-14T12:43:48.641698+0000","last_peered":"2024-09-14T12:43:48.641698+0000","last_clean":"2024-09-14T12:43:48.641698+0000","last_became_active":"2024-09-14T10:49:33.474412+0000","last_became_peered":"2024-09-14T10:49:33.474412+0000","last_unstale":"2024-09-14T12:43:48.641698+0000","last_undegraded":"2024-09-14T12:43:48.641698+0000","last_fullsized":"2024-09-14T12:43:48.641698+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:52.098600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1493,"num_read_kb":1442,"num_write":1188,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'446","reported_seq":2088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538801+0000","last_change":"2024-09-14T10:49:25.405914+0000","last_active":"2024-09-14T12:39:55.538801+0000","last_peered":"2024-09-14T12:39:55.538801+0000","last_clean":"2024-09-14T12:39:55.538801+0000","last_became_active":"2024-09-14T10:49:25.405499+0000","last_became_peered":"2024-09-14T10:49:25.405499+0000","last_unstale":"2024-09-14T12:39:55.538801+0000","last_undegraded":"2024-09-14T12:39:55.538801+0000","last_fullsized":"2024-09-14T12:39:55.538801+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:54.507625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2382,"num_write":513,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'316","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.415753+0000","last_change":"2024-09-14T10:49:23.403913+0000","last_active":"2024-09-14T12:41:23.415753+0000","last_peered":"2024-09-14T12:41:23.415753+0000","last_clean":"2024-09-14T12:41:23.415753+0000","last_became_active":"2024-09-14T10:49:23.403551+0000","last_became_peered":"2024-09-14T10:49:23.403551+0000","last_unstale":"2024-09-14T12:41:23.415753+0000","last_undegraded":"2024-09-14T12:41:23.415753+0000","last_fullsized":"2024-09-14T12:41:23.415753+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:47.233133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224360,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":621,"num_read_kb":10639,"num_write":1173,"num_write_kb":29906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.535230+0000","last_change":"2024-09-14T10:49:27.373230+0000","last_active":"2024-09-14T12:40:01.535230+0000","last_peered":"2024-09-14T12:40:01.535230+0000","last_clean":"2024-09-14T12:40:01.535230+0000","last_became_active":"2024-09-14T10:49:27.372510+0000","last_became_peered":"2024-09-14T10:49:27.372510+0000","last_unstale":"2024-09-14T12:40:01.535230+0000","last_undegraded":"2024-09-14T12:40:01.535230+0000","last_fullsized":"2024-09-14T12:40:01.535230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:58.625869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'299","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.708769+0000","last_change":"2024-09-14T10:49:29.378472+0000","last_active":"2024-09-14T12:43:47.708769+0000","last_peered":"2024-09-14T12:43:47.708769+0000","last_clean":"2024-09-14T12:43:47.708769+0000","last_became_active":"2024-09-14T10:49:29.377710+0000","last_became_peered":"2024-09-14T10:49:29.377710+0000","last_unstale":"2024-09-14T12:43:47.708769+0000","last_undegraded":"2024-09-14T12:43:47.708769+0000","last_fullsized":"2024-09-14T12:43:47.708769+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:54.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":938,"num_write":382,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569489+0000","last_change":"2024-09-14T10:49:31.413000+0000","last_active":"2024-09-14T12:40:35.569489+0000","last_peered":"2024-09-14T12:40:35.569489+0000","last_clean":"2024-09-14T12:40:35.569489+0000","last_became_active":"2024-09-14T10:49:31.412080+0000","last_became_peered":"2024-09-14T10:49:31.412080+0000","last_unstale":"2024-09-14T12:40:35.569489+0000","last_undegraded":"2024-09-14T12:40:35.569489+0000","last_fullsized":"2024-09-14T12:40:35.569489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.692991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2528","reported_seq":4388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.576044+0000","last_change":"2024-09-14T10:49:33.479265+0000","last_active":"2024-09-14T12:42:30.576044+0000","last_peered":"2024-09-14T12:42:30.576044+0000","last_clean":"2024-09-14T12:42:30.576044+0000","last_became_active":"2024-09-14T10:49:33.478542+0000","last_became_peered":"2024-09-14T10:49:33.478542+0000","last_unstale":"2024-09-14T12:42:30.576044+0000","last_undegraded":"2024-09-14T12:42:30.576044+0000","last_fullsized":"2024-09-14T12:42:30.576044+0000","mapping_epoch":36,"log_start":"267'2500","ondisk_log_start":"267'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:52.785039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6246,"num_read_kb":6243,"num_write":5128,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'497","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.824180+0000","last_change":"2024-09-14T10:49:25.381367+0000","last_active":"2024-09-14T12:41:11.824180+0000","last_peered":"2024-09-14T12:41:11.824180+0000","last_clean":"2024-09-14T12:41:11.824180+0000","last_became_active":"2024-09-14T10:49:25.380967+0000","last_became_peered":"2024-09-14T10:49:25.380967+0000","last_unstale":"2024-09-14T12:41:11.824180+0000","last_undegraded":"2024-09-14T12:41:11.824180+0000","last_fullsized":"2024-09-14T12:41:11.824180+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:55.558427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2697,"num_read_kb":2531,"num_write":585,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'303","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:41.470216+0000","last_change":"2024-09-14T10:49:23.356775+0000","last_active":"2024-09-14T12:39:41.470216+0000","last_peered":"2024-09-14T12:39:41.470216+0000","last_clean":"2024-09-14T12:39:41.470216+0000","last_became_active":"2024-09-14T10:49:23.355809+0000","last_became_peered":"2024-09-14T10:49:23.355809+0000","last_unstale":"2024-09-14T12:39:41.470216+0000","last_undegraded":"2024-09-14T12:39:41.470216+0000","last_fullsized":"2024-09-14T12:39:41.470216+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:13.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11164066,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":501,"num_read_kb":12441,"num_write":1125,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:45.547722+0000","last_change":"2024-09-14T10:49:27.379127+0000","last_active":"2024-09-14T12:39:45.547722+0000","last_peered":"2024-09-14T12:39:45.547722+0000","last_clean":"2024-09-14T12:39:45.547722+0000","last_became_active":"2024-09-14T10:49:27.378028+0000","last_became_peered":"2024-09-14T10:49:27.378028+0000","last_unstale":"2024-09-14T12:39:45.547722+0000","last_undegraded":"2024-09-14T12:39:45.547722+0000","last_fullsized":"2024-09-14T12:39:45.547722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:49.172785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'394","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:42.933132+0000","last_change":"2024-09-14T10:49:29.389462+0000","last_active":"2024-09-14T12:43:42.933132+0000","last_peered":"2024-09-14T12:43:42.933132+0000","last_clean":"2024-09-14T12:43:42.933132+0000","last_became_active":"2024-09-14T10:49:29.388786+0000","last_became_peered":"2024-09-14T10:49:29.388786+0000","last_unstale":"2024-09-14T12:43:42.933132+0000","last_undegraded":"2024-09-14T12:43:42.933132+0000","last_fullsized":"2024-09-14T12:43:42.933132+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:53.840769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63295,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1173,"num_write":498,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'821","reported_seq":3416,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105522+0000","last_change":"2024-09-14T10:49:31.420988+0000","last_active":"2024-09-14T12:43:49.105522+0000","last_peered":"2024-09-14T12:43:49.105522+0000","last_clean":"2024-09-14T12:43:49.105522+0000","last_became_active":"2024-09-14T10:49:31.420178+0000","last_became_peered":"2024-09-14T10:49:31.420178+0000","last_unstale":"2024-09-14T12:43:49.105522+0000","last_undegraded":"2024-09-14T12:43:49.105522+0000","last_fullsized":"2024-09-14T12:43:49.105522+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:41.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'144","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.388041+0000","last_change":"2024-09-14T10:49:33.463351+0000","last_active":"2024-09-14T12:43:47.388041+0000","last_peered":"2024-09-14T12:43:47.388041+0000","last_clean":"2024-09-14T12:43:47.388041+0000","last_became_active":"2024-09-14T10:49:33.462780+0000","last_became_peered":"2024-09-14T10:49:33.462780+0000","last_unstale":"2024-09-14T12:43:47.388041+0000","last_undegraded":"2024-09-14T12:43:47.388041+0000","last_fullsized":"2024-09-14T12:43:47.388041+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:58.346452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'836","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.604978+0000","last_change":"2024-09-14T10:49:25.391283+0000","last_active":"2024-09-14T12:43:47.604978+0000","last_peered":"2024-09-14T12:43:47.604978+0000","last_clean":"2024-09-14T12:43:47.604978+0000","last_became_active":"2024-09-14T10:49:25.389567+0000","last_became_peered":"2024-09-14T10:49:25.389567+0000","last_unstale":"2024-09-14T12:43:47.604978+0000","last_undegraded":"2024-09-14T12:43:47.604978+0000","last_fullsized":"2024-09-14T12:43:47.604978+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:34.685545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4051,"num_read_kb":3641,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'305","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782903+0000","last_change":"2024-09-14T10:49:23.355908+0000","last_active":"2024-09-14T12:39:40.782903+0000","last_peered":"2024-09-14T12:39:40.782903+0000","last_clean":"2024-09-14T12:39:40.782903+0000","last_became_active":"2024-09-14T10:49:23.354452+0000","last_became_peered":"2024-09-14T10:49:23.354452+0000","last_unstale":"2024-09-14T12:39:40.782903+0000","last_undegraded":"2024-09-14T12:39:40.782903+0000","last_fullsized":"2024-09-14T12:39:40.782903+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:06:03.903748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16810810,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":531,"num_read_kb":20988,"num_write":1070,"num_write_kb":31512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:21.539587+0000","last_change":"2024-09-14T10:49:27.354654+0000","last_active":"2024-09-14T12:40:21.539587+0000","last_peered":"2024-09-14T12:40:21.539587+0000","last_clean":"2024-09-14T12:40:21.539587+0000","last_became_active":"2024-09-14T10:49:27.353932+0000","last_became_peered":"2024-09-14T10:49:27.353932+0000","last_unstale":"2024-09-14T12:40:21.539587+0000","last_undegraded":"2024-09-14T12:40:21.539587+0000","last_fullsized":"2024-09-14T12:40:21.539587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:21.532896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'488","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.578615+0000","last_change":"2024-09-14T10:49:29.379743+0000","last_active":"2024-09-14T12:43:48.578615+0000","last_peered":"2024-09-14T12:43:48.578615+0000","last_clean":"2024-09-14T12:43:48.578615+0000","last_became_active":"2024-09-14T10:49:29.378107+0000","last_became_peered":"2024-09-14T10:49:29.378107+0000","last_unstale":"2024-09-14T12:43:48.578615+0000","last_undegraded":"2024-09-14T12:43:48.578615+0000","last_fullsized":"2024-09-14T12:43:48.578615+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:49.708518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":820,"num_read_kb":1683,"num_write":664,"num_write_kb":517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:05.552752+0000","last_change":"2024-09-14T10:49:31.410161+0000","last_active":"2024-09-14T12:40:05.552752+0000","last_peered":"2024-09-14T12:40:05.552752+0000","last_clean":"2024-09-14T12:40:05.552752+0000","last_became_active":"2024-09-14T10:49:31.409247+0000","last_became_peered":"2024-09-14T10:49:31.409247+0000","last_unstale":"2024-09-14T12:40:05.552752+0000","last_undegraded":"2024-09-14T12:40:05.552752+0000","last_fullsized":"2024-09-14T12:40:05.552752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:49.593404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'132","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:14.764993+0000","last_change":"2024-09-14T10:49:33.462318+0000","last_active":"2024-09-14T12:42:14.764993+0000","last_peered":"2024-09-14T12:42:14.764993+0000","last_clean":"2024-09-14T12:42:14.764993+0000","last_became_active":"2024-09-14T10:49:33.461635+0000","last_became_peered":"2024-09-14T10:49:33.461635+0000","last_unstale":"2024-09-14T12:42:14.764993+0000","last_undegraded":"2024-09-14T12:42:14.764993+0000","last_fullsized":"2024-09-14T12:42:14.764993+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:57.796265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":314,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'839","reported_seq":2531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.621508+0000","last_change":"2024-09-14T10:49:25.361656+0000","last_active":"2024-09-14T12:43:47.621508+0000","last_peered":"2024-09-14T12:43:47.621508+0000","last_clean":"2024-09-14T12:43:47.621508+0000","last_became_active":"2024-09-14T10:49:25.361148+0000","last_became_peered":"2024-09-14T10:49:25.361148+0000","last_unstale":"2024-09-14T12:43:47.621508+0000","last_undegraded":"2024-09-14T12:43:47.621508+0000","last_fullsized":"2024-09-14T12:43:47.621508+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:41.324755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4070,"num_read_kb":3684,"num_write":1107,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'344","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.638949+0000","last_change":"2024-09-14T10:49:23.375908+0000","last_active":"2024-09-14T12:44:04.638949+0000","last_peered":"2024-09-14T12:44:04.638949+0000","last_clean":"2024-09-14T12:44:04.638949+0000","last_became_active":"2024-09-14T10:49:23.375005+0000","last_became_peered":"2024-09-14T10:49:23.375005+0000","last_unstale":"2024-09-14T12:44:04.638949+0000","last_undegraded":"2024-09-14T12:44:04.638949+0000","last_fullsized":"2024-09-14T12:44:04.638949+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:45.791369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":714,"num_read_kb":12064,"num_write":1097,"num_write_kb":35066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.730652+0000","last_change":"2024-09-14T10:49:27.386488+0000","last_active":"2024-09-14T12:39:44.730652+0000","last_peered":"2024-09-14T12:39:44.730652+0000","last_clean":"2024-09-14T12:39:44.730652+0000","last_became_active":"2024-09-14T10:49:27.385658+0000","last_became_peered":"2024-09-14T10:49:27.385658+0000","last_unstale":"2024-09-14T12:39:44.730652+0000","last_undegraded":"2024-09-14T12:39:44.730652+0000","last_fullsized":"2024-09-14T12:39:44.730652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:00.744114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'362","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.569445+0000","last_change":"2024-09-14T10:49:29.391486+0000","last_active":"2024-09-14T12:42:00.569445+0000","last_peered":"2024-09-14T12:42:00.569445+0000","last_clean":"2024-09-14T12:42:00.569445+0000","last_became_active":"2024-09-14T10:49:29.388618+0000","last_became_peered":"2024-09-14T10:49:29.388618+0000","last_unstale":"2024-09-14T12:42:00.569445+0000","last_undegraded":"2024-09-14T12:42:00.569445+0000","last_fullsized":"2024-09-14T12:42:00.569445+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:27.307665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":601,"num_read_kb":1144,"num_write":528,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:09.736444+0000","last_change":"2024-09-14T10:49:31.418529+0000","last_active":"2024-09-14T12:40:09.736444+0000","last_peered":"2024-09-14T12:40:09.736444+0000","last_clean":"2024-09-14T12:40:09.736444+0000","last_became_active":"2024-09-14T10:49:31.417797+0000","last_became_peered":"2024-09-14T10:49:31.417797+0000","last_unstale":"2024-09-14T12:40:09.736444+0000","last_undegraded":"2024-09-14T12:40:09.736444+0000","last_fullsized":"2024-09-14T12:40:09.736444+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:56.573341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'113","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.362386+0000","last_change":"2024-09-14T10:49:33.455868+0000","last_active":"2024-09-14T12:42:05.362386+0000","last_peered":"2024-09-14T12:42:05.362386+0000","last_clean":"2024-09-14T12:42:05.362386+0000","last_became_active":"2024-09-14T10:49:33.455162+0000","last_became_peered":"2024-09-14T10:49:33.455162+0000","last_unstale":"2024-09-14T12:42:05.362386+0000","last_undegraded":"2024-09-14T12:42:05.362386+0000","last_fullsized":"2024-09-14T12:42:05.362386+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:42.886276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'587","reported_seq":2424,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:57.861667+0000","last_change":"2024-09-14T10:49:25.378821+0000","last_active":"2024-09-14T12:39:57.861667+0000","last_peered":"2024-09-14T12:39:57.861667+0000","last_clean":"2024-09-14T12:39:57.861667+0000","last_became_active":"2024-09-14T10:49:25.377866+0000","last_became_peered":"2024-09-14T10:49:25.377866+0000","last_unstale":"2024-09-14T12:39:57.861667+0000","last_undegraded":"2024-09-14T12:39:57.861667+0000","last_fullsized":"2024-09-14T12:39:57.861667+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:16.585676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3293,"num_read_kb":3082,"num_write":722,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'257","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.477225+0000","last_change":"2024-09-14T10:49:23.362931+0000","last_active":"2024-09-14T12:40:11.477225+0000","last_peered":"2024-09-14T12:40:11.477225+0000","last_clean":"2024-09-14T12:40:11.477225+0000","last_became_active":"2024-09-14T10:49:23.362203+0000","last_became_peered":"2024-09-14T10:49:23.362203+0000","last_unstale":"2024-09-14T12:40:11.477225+0000","last_undegraded":"2024-09-14T12:40:11.477225+0000","last_fullsized":"2024-09-14T12:40:11.477225+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:22.083961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5248060,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":443,"num_read_kb":29276,"num_write":938,"num_write_kb":13260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:45.547789+0000","last_change":"2024-09-14T10:49:27.378611+0000","last_active":"2024-09-14T12:39:45.547789+0000","last_peered":"2024-09-14T12:39:45.547789+0000","last_clean":"2024-09-14T12:39:45.547789+0000","last_became_active":"2024-09-14T10:49:27.377674+0000","last_became_peered":"2024-09-14T10:49:27.377674+0000","last_unstale":"2024-09-14T12:39:45.547789+0000","last_undegraded":"2024-09-14T12:39:45.547789+0000","last_fullsized":"2024-09-14T12:39:45.547789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:20.096097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'391","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.369060+0000","last_change":"2024-09-14T10:49:29.394103+0000","last_active":"2024-09-14T12:42:30.369060+0000","last_peered":"2024-09-14T12:42:30.369060+0000","last_clean":"2024-09-14T12:42:30.369060+0000","last_became_active":"2024-09-14T10:49:29.393350+0000","last_became_peered":"2024-09-14T10:49:29.393350+0000","last_unstale":"2024-09-14T12:42:30.369060+0000","last_undegraded":"2024-09-14T12:42:30.369060+0000","last_fullsized":"2024-09-14T12:42:30.369060+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.411758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64930,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":1187,"num_write":506,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'793","reported_seq":5225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.691608+0000","last_change":"2024-09-14T10:49:31.423468+0000","last_active":"2024-09-14T12:44:01.691608+0000","last_peered":"2024-09-14T12:44:01.691608+0000","last_clean":"2024-09-14T12:44:01.691608+0000","last_became_active":"2024-09-14T10:49:31.422534+0000","last_became_peered":"2024-09-14T10:49:31.422534+0000","last_unstale":"2024-09-14T12:44:01.691608+0000","last_undegraded":"2024-09-14T12:44:01.691608+0000","last_fullsized":"2024-09-14T12:44:01.691608+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:58.304373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'158","reported_seq":729,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.415473+0000","last_change":"2024-09-14T10:49:33.466535+0000","last_active":"2024-09-14T12:42:29.415473+0000","last_peered":"2024-09-14T12:42:29.415473+0000","last_clean":"2024-09-14T12:42:29.415473+0000","last_became_active":"2024-09-14T10:49:33.466024+0000","last_became_peered":"2024-09-14T10:49:33.466024+0000","last_unstale":"2024-09-14T12:42:29.415473+0000","last_undegraded":"2024-09-14T12:42:29.415473+0000","last_fullsized":"2024-09-14T12:42:29.415473+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:24.127809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":335,"num_read_kb":285,"num_write":383,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'671","reported_seq":2389,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.135328+0000","last_change":"2024-09-14T10:49:25.381139+0000","last_active":"2024-09-14T12:42:22.135328+0000","last_peered":"2024-09-14T12:42:22.135328+0000","last_clean":"2024-09-14T12:42:22.135328+0000","last_became_active":"2024-09-14T10:49:25.380712+0000","last_became_peered":"2024-09-14T10:49:25.380712+0000","last_unstale":"2024-09-14T12:42:22.135328+0000","last_undegraded":"2024-09-14T12:42:22.135328+0000","last_fullsized":"2024-09-14T12:42:22.135328+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:50.719358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3719,"num_read_kb":3469,"num_write":935,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'293","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.507425+0000","last_change":"2024-09-14T10:49:23.367590+0000","last_active":"2024-09-14T12:42:06.507425+0000","last_peered":"2024-09-14T12:42:06.507425+0000","last_clean":"2024-09-14T12:42:06.507425+0000","last_became_active":"2024-09-14T10:49:23.367200+0000","last_became_peered":"2024-09-14T10:49:23.367200+0000","last_unstale":"2024-09-14T12:42:06.507425+0000","last_undegraded":"2024-09-14T12:42:06.507425+0000","last_fullsized":"2024-09-14T12:42:06.507425+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:06.469171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14338667,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":622,"num_read_kb":77246,"num_write":1091,"num_write_kb":38780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.516242+0000","last_change":"2024-09-14T10:49:27.380444+0000","last_active":"2024-09-14T12:43:48.516242+0000","last_peered":"2024-09-14T12:43:48.516242+0000","last_clean":"2024-09-14T12:43:48.516242+0000","last_became_active":"2024-09-14T10:49:27.379952+0000","last_became_peered":"2024-09-14T10:49:27.379952+0000","last_unstale":"2024-09-14T12:43:48.516242+0000","last_undegraded":"2024-09-14T12:43:48.516242+0000","last_fullsized":"2024-09-14T12:43:48.516242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:22.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'141","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561715+0000","last_change":"2024-09-14T10:49:29.373528+0000","last_active":"2024-09-14T12:42:01.561715+0000","last_peered":"2024-09-14T12:42:01.561715+0000","last_clean":"2024-09-14T12:42:01.561715+0000","last_became_active":"2024-09-14T10:49:29.371803+0000","last_became_peered":"2024-09-14T10:49:29.371803+0000","last_unstale":"2024-09-14T12:42:01.561715+0000","last_undegraded":"2024-09-14T12:42:01.561715+0000","last_fullsized":"2024-09-14T12:42:01.561715+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:44.432155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'793","reported_seq":3142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.104720+0000","last_change":"2024-09-14T10:49:31.427780+0000","last_active":"2024-09-14T12:43:49.104720+0000","last_peered":"2024-09-14T12:43:49.104720+0000","last_clean":"2024-09-14T12:43:49.104720+0000","last_became_active":"2024-09-14T10:49:31.427179+0000","last_became_peered":"2024-09-14T10:49:31.427179+0000","last_unstale":"2024-09-14T12:43:49.104720+0000","last_undegraded":"2024-09-14T12:43:49.104720+0000","last_fullsized":"2024-09-14T12:43:49.104720+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:38.189084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'134","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:28.826359+0000","last_change":"2024-09-14T10:49:33.471795+0000","last_active":"2024-09-14T12:42:28.826359+0000","last_peered":"2024-09-14T12:42:28.826359+0000","last_clean":"2024-09-14T12:42:28.826359+0000","last_became_active":"2024-09-14T10:49:33.468831+0000","last_became_peered":"2024-09-14T10:49:33.468831+0000","last_unstale":"2024-09-14T12:42:28.826359+0000","last_undegraded":"2024-09-14T12:42:28.826359+0000","last_fullsized":"2024-09-14T12:42:28.826359+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:46.840813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":148,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'487","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.736832+0000","last_change":"2024-09-14T10:49:25.371388+0000","last_active":"2024-09-14T12:41:23.736832+0000","last_peered":"2024-09-14T12:41:23.736832+0000","last_clean":"2024-09-14T12:41:23.736832+0000","last_became_active":"2024-09-14T10:49:25.370649+0000","last_became_peered":"2024-09-14T10:49:25.370649+0000","last_unstale":"2024-09-14T12:41:23.736832+0000","last_undegraded":"2024-09-14T12:41:23.736832+0000","last_fullsized":"2024-09-14T12:41:23.736832+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:54.984697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2839,"num_read_kb":2682,"num_write":610,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'310","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:21.114878+0000","last_change":"2024-09-14T10:49:23.359479+0000","last_active":"2024-09-14T12:41:21.114878+0000","last_peered":"2024-09-14T12:41:21.114878+0000","last_clean":"2024-09-14T12:41:21.114878+0000","last_became_active":"2024-09-14T10:49:23.355864+0000","last_became_peered":"2024-09-14T10:49:23.355864+0000","last_unstale":"2024-09-14T12:41:21.114878+0000","last_undegraded":"2024-09-14T12:41:21.114878+0000","last_fullsized":"2024-09-14T12:41:21.114878+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:44.897414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12833623,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":642,"num_read_kb":100725,"num_write":1023,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:46.471497+0000","last_change":"2024-09-14T10:49:27.391003+0000","last_active":"2024-09-14T12:39:46.471497+0000","last_peered":"2024-09-14T12:39:46.471497+0000","last_clean":"2024-09-14T12:39:46.471497+0000","last_became_active":"2024-09-14T10:49:27.390169+0000","last_became_peered":"2024-09-14T10:49:27.390169+0000","last_unstale":"2024-09-14T12:39:46.471497+0000","last_undegraded":"2024-09-14T12:39:46.471497+0000","last_fullsized":"2024-09-14T12:39:46.471497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:41.899346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'414","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.569385+0000","last_change":"2024-09-14T10:49:29.401131+0000","last_active":"2024-09-14T12:42:00.569385+0000","last_peered":"2024-09-14T12:42:00.569385+0000","last_clean":"2024-09-14T12:42:00.569385+0000","last_became_active":"2024-09-14T10:49:29.400776+0000","last_became_peered":"2024-09-14T10:49:29.400776+0000","last_unstale":"2024-09-14T12:42:00.569385+0000","last_undegraded":"2024-09-14T12:42:00.569385+0000","last_fullsized":"2024-09-14T12:42:00.569385+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:04.011436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54314,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":1124,"num_write":508,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140700+0000","last_change":"2024-09-14T10:49:31.421446+0000","last_active":"2024-09-14T12:39:51.140700+0000","last_peered":"2024-09-14T12:39:51.140700+0000","last_clean":"2024-09-14T12:39:51.140700+0000","last_became_active":"2024-09-14T10:49:31.418131+0000","last_became_peered":"2024-09-14T10:49:31.418131+0000","last_unstale":"2024-09-14T12:39:51.140700+0000","last_undegraded":"2024-09-14T12:39:51.140700+0000","last_fullsized":"2024-09-14T12:39:51.140700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:15.418822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'138","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.192828+0000","last_change":"2024-09-14T10:49:33.457926+0000","last_active":"2024-09-14T12:42:31.192828+0000","last_peered":"2024-09-14T12:42:31.192828+0000","last_clean":"2024-09-14T12:42:31.192828+0000","last_became_active":"2024-09-14T10:49:33.455953+0000","last_became_peered":"2024-09-14T10:49:33.455953+0000","last_unstale":"2024-09-14T12:42:31.192828+0000","last_undegraded":"2024-09-14T12:42:31.192828+0000","last_fullsized":"2024-09-14T12:42:31.192828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:50.433913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":155,"num_write":340,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'412","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.340214+0000","last_change":"2024-09-14T10:49:25.378560+0000","last_active":"2024-09-14T12:40:40.340214+0000","last_peered":"2024-09-14T12:40:40.340214+0000","last_clean":"2024-09-14T12:40:40.340214+0000","last_became_active":"2024-09-14T10:49:25.377841+0000","last_became_peered":"2024-09-14T10:49:25.377841+0000","last_unstale":"2024-09-14T12:40:40.340214+0000","last_undegraded":"2024-09-14T12:40:40.340214+0000","last_fullsized":"2024-09-14T12:40:40.340214+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:34.685545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2397,"num_read_kb":2304,"num_write":471,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.560546+0000","last_change":"2024-09-14T10:49:02.305650+0000","last_active":"2024-09-14T12:41:30.560546+0000","last_peered":"2024-09-14T12:41:30.560546+0000","last_clean":"2024-09-14T12:41:30.560546+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T12:41:30.560546+0000","last_undegraded":"2024-09-14T12:41:30.560546+0000","last_fullsized":"2024-09-14T12:41:30.560546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_clean_scrub_stamp":"2024-09-14T10:49:00.978700+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:28.964363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500441+0000","last_change":"2024-09-14T10:49:09.053703+0000","last_active":"2024-09-14T12:41:41.500441+0000","last_peered":"2024-09-14T12:41:41.500441+0000","last_clean":"2024-09-14T12:41:41.500441+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T12:41:41.500441+0000","last_undegraded":"2024-09-14T12:41:41.500441+0000","last_fullsized":"2024-09-14T12:41:41.500441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:01.458375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'272","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.587004+0000","last_change":"2024-09-14T10:49:23.371837+0000","last_active":"2024-09-14T12:41:55.587004+0000","last_peered":"2024-09-14T12:41:55.587004+0000","last_clean":"2024-09-14T12:41:55.587004+0000","last_became_active":"2024-09-14T10:49:23.371077+0000","last_became_peered":"2024-09-14T10:49:23.371077+0000","last_unstale":"2024-09-14T12:41:55.587004+0000","last_undegraded":"2024-09-14T12:41:55.587004+0000","last_fullsized":"2024-09-14T12:41:55.587004+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:28.149667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16978352,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":526,"num_read_kb":16360,"num_write":1056,"num_write_kb":33420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.786507+0000","last_change":"2024-09-14T10:49:27.375599+0000","last_active":"2024-09-14T12:39:55.786507+0000","last_peered":"2024-09-14T12:39:55.786507+0000","last_clean":"2024-09-14T12:39:55.786507+0000","last_became_active":"2024-09-14T10:49:27.372388+0000","last_became_peered":"2024-09-14T10:49:27.372388+0000","last_unstale":"2024-09-14T12:39:55.786507+0000","last_undegraded":"2024-09-14T12:39:55.786507+0000","last_fullsized":"2024-09-14T12:39:55.786507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:22.751936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'814","reported_seq":1545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.613172+0000","last_change":"2024-09-14T10:49:29.390925+0000","last_active":"2024-09-14T12:43:48.613172+0000","last_peered":"2024-09-14T12:43:48.613172+0000","last_clean":"2024-09-14T12:43:48.613172+0000","last_became_active":"2024-09-14T10:49:29.390014+0000","last_became_peered":"2024-09-14T10:49:29.390014+0000","last_unstale":"2024-09-14T12:43:48.613172+0000","last_undegraded":"2024-09-14T12:43:48.613172+0000","last_fullsized":"2024-09-14T12:43:48.613172+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.279366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209443,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1584,"num_read_kb":3253,"num_write":1568,"num_write_kb":1419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:05.552990+0000","last_change":"2024-09-14T10:49:31.411996+0000","last_active":"2024-09-14T12:40:05.552990+0000","last_peered":"2024-09-14T12:40:05.552990+0000","last_clean":"2024-09-14T12:40:05.552990+0000","last_became_active":"2024-09-14T10:49:31.411212+0000","last_became_peered":"2024-09-14T10:49:31.411212+0000","last_unstale":"2024-09-14T12:40:05.552990+0000","last_undegraded":"2024-09-14T12:40:05.552990+0000","last_fullsized":"2024-09-14T12:40:05.552990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:47.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'196","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.596985+0000","last_change":"2024-09-14T10:49:33.470365+0000","last_active":"2024-09-14T12:42:29.596985+0000","last_peered":"2024-09-14T12:42:29.596985+0000","last_clean":"2024-09-14T12:42:29.596985+0000","last_became_active":"2024-09-14T10:49:33.469611+0000","last_became_peered":"2024-09-14T10:49:33.469611+0000","last_unstale":"2024-09-14T12:42:29.596985+0000","last_undegraded":"2024-09-14T12:42:29.596985+0000","last_fullsized":"2024-09-14T12:42:29.596985+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:02.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":425,"num_write":402,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'780","reported_seq":2292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.583324+0000","last_change":"2024-09-14T10:49:25.391340+0000","last_active":"2024-09-14T12:41:29.583324+0000","last_peered":"2024-09-14T12:41:29.583324+0000","last_clean":"2024-09-14T12:41:29.583324+0000","last_became_active":"2024-09-14T10:49:25.390586+0000","last_became_peered":"2024-09-14T10:49:25.390586+0000","last_unstale":"2024-09-14T12:41:29.583324+0000","last_undegraded":"2024-09-14T12:41:29.583324+0000","last_fullsized":"2024-09-14T12:41:29.583324+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:28.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3382,"num_write":1057,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496631+0000","last_change":"2024-09-14T10:49:09.052857+0000","last_active":"2024-09-14T12:41:26.496631+0000","last_peered":"2024-09-14T12:41:26.496631+0000","last_clean":"2024-09-14T12:41:26.496631+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T12:41:26.496631+0000","last_undegraded":"2024-09-14T12:41:26.496631+0000","last_fullsized":"2024-09-14T12:41:26.496631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.713061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'289","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560334+0000","last_change":"2024-09-14T10:49:53.509685+0000","last_active":"2024-09-14T12:41:56.560334+0000","last_peered":"2024-09-14T12:41:56.560334+0000","last_clean":"2024-09-14T12:41:56.560334+0000","last_became_active":"2024-09-14T10:49:53.507913+0000","last_became_peered":"2024-09-14T10:49:53.507913+0000","last_unstale":"2024-09-14T12:41:56.560334+0000","last_undegraded":"2024-09-14T12:41:56.560334+0000","last_fullsized":"2024-09-14T12:41:56.560334+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.727574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11873036,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":518,"num_read_kb":56481,"num_write":1073,"num_write_kb":45113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,3],"acting":[6,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.474795+0000","last_change":"2024-09-14T10:49:27.389322+0000","last_active":"2024-09-14T12:40:01.474795+0000","last_peered":"2024-09-14T12:40:01.474795+0000","last_clean":"2024-09-14T12:40:01.474795+0000","last_became_active":"2024-09-14T10:49:27.388875+0000","last_became_peered":"2024-09-14T10:49:27.388875+0000","last_unstale":"2024-09-14T12:40:01.474795+0000","last_undegraded":"2024-09-14T12:40:01.474795+0000","last_fullsized":"2024-09-14T12:40:01.474795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:39.859202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1470","reported_seq":3843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.556102+0000","last_change":"2024-09-14T10:49:29.394197+0000","last_active":"2024-09-14T12:44:04.556102+0000","last_peered":"2024-09-14T12:44:04.556102+0000","last_clean":"2024-09-14T12:44:04.556102+0000","last_became_active":"2024-09-14T10:49:29.393295+0000","last_became_peered":"2024-09-14T10:49:29.393295+0000","last_unstale":"2024-09-14T12:44:04.556102+0000","last_undegraded":"2024-09-14T12:44:04.556102+0000","last_fullsized":"2024-09-14T12:44:04.556102+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:36.360396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2284,"num_read_kb":4194,"num_write":1394,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478561+0000","last_change":"2024-09-14T10:49:31.432764+0000","last_active":"2024-09-14T12:40:16.478561+0000","last_peered":"2024-09-14T12:40:16.478561+0000","last_clean":"2024-09-14T12:40:16.478561+0000","last_became_active":"2024-09-14T10:49:31.432054+0000","last_became_peered":"2024-09-14T10:49:31.432054+0000","last_unstale":"2024-09-14T12:40:16.478561+0000","last_undegraded":"2024-09-14T12:40:16.478561+0000","last_fullsized":"2024-09-14T12:40:16.478561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:16.891140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'83","reported_seq":607,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:30.558557+0000","last_change":"2024-09-14T10:49:33.466954+0000","last_active":"2024-09-14T12:40:30.558557+0000","last_peered":"2024-09-14T12:40:30.558557+0000","last_clean":"2024-09-14T12:40:30.558557+0000","last_became_active":"2024-09-14T10:49:33.466307+0000","last_became_peered":"2024-09-14T10:49:33.466307+0000","last_unstale":"2024-09-14T12:40:30.558557+0000","last_undegraded":"2024-09-14T12:40:30.558557+0000","last_fullsized":"2024-09-14T12:40:30.558557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:18.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":197,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'927","reported_seq":2492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.371619+0000","last_change":"2024-09-14T10:49:25.384251+0000","last_active":"2024-09-14T12:42:29.371619+0000","last_peered":"2024-09-14T12:42:29.371619+0000","last_clean":"2024-09-14T12:42:29.371619+0000","last_became_active":"2024-09-14T10:49:25.382937+0000","last_became_peered":"2024-09-14T10:49:25.382937+0000","last_unstale":"2024-09-14T12:42:29.371619+0000","last_undegraded":"2024-09-14T12:42:29.371619+0000","last_fullsized":"2024-09-14T12:42:29.371619+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:13.849834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":3892,"num_write":1285,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:39.756813+0000","last_change":"2024-09-14T10:49:09.482540+0000","last_active":"2024-09-14T12:41:39.756813+0000","last_peered":"2024-09-14T12:41:39.756813+0000","last_clean":"2024-09-14T12:41:39.756813+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T12:41:39.756813+0000","last_undegraded":"2024-09-14T12:41:39.756813+0000","last_fullsized":"2024-09-14T12:41:39.756813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:28.426232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'274","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.359813+0000","last_change":"2024-09-14T10:49:23.388674+0000","last_active":"2024-09-14T12:41:55.359813+0000","last_peered":"2024-09-14T12:41:55.359813+0000","last_clean":"2024-09-14T12:41:55.359813+0000","last_became_active":"2024-09-14T10:49:23.387885+0000","last_became_peered":"2024-09-14T10:49:23.387885+0000","last_unstale":"2024-09-14T12:41:55.359813+0000","last_undegraded":"2024-09-14T12:41:55.359813+0000","last_fullsized":"2024-09-14T12:41:55.359813+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:35.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9753178,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":500,"num_read_kb":25294,"num_write":1005,"num_write_kb":31965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:59.734121+0000","last_change":"2024-09-14T10:49:27.385977+0000","last_active":"2024-09-14T12:39:59.734121+0000","last_peered":"2024-09-14T12:39:59.734121+0000","last_clean":"2024-09-14T12:39:59.734121+0000","last_became_active":"2024-09-14T10:49:27.384973+0000","last_became_peered":"2024-09-14T10:49:27.384973+0000","last_unstale":"2024-09-14T12:39:59.734121+0000","last_undegraded":"2024-09-14T12:39:59.734121+0000","last_fullsized":"2024-09-14T12:39:59.734121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:44.532319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'415","reported_seq":2396,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:44.016898+0000","last_change":"2024-09-14T10:49:29.382733+0000","last_active":"2024-09-14T12:43:44.016898+0000","last_peered":"2024-09-14T12:43:44.016898+0000","last_clean":"2024-09-14T12:43:44.016898+0000","last_became_active":"2024-09-14T10:49:29.382485+0000","last_became_peered":"2024-09-14T10:49:29.382485+0000","last_unstale":"2024-09-14T12:43:44.016898+0000","last_undegraded":"2024-09-14T12:43:44.016898+0000","last_fullsized":"2024-09-14T12:43:44.016898+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:09.682817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":384,"num_read_kb":370,"num_write":379,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.562226+0000","last_change":"2024-09-14T10:49:31.421762+0000","last_active":"2024-09-14T12:40:00.562226+0000","last_peered":"2024-09-14T12:40:00.562226+0000","last_clean":"2024-09-14T12:40:00.562226+0000","last_became_active":"2024-09-14T10:49:31.420121+0000","last_became_peered":"2024-09-14T10:49:31.420121+0000","last_unstale":"2024-09-14T12:40:00.562226+0000","last_undegraded":"2024-09-14T12:40:00.562226+0000","last_fullsized":"2024-09-14T12:40:00.562226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:24.154484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'274","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.858379+0000","last_change":"2024-09-14T10:49:33.438284+0000","last_active":"2024-09-14T12:42:29.858379+0000","last_peered":"2024-09-14T12:42:29.858379+0000","last_clean":"2024-09-14T12:42:29.858379+0000","last_became_active":"2024-09-14T10:49:33.437564+0000","last_became_peered":"2024-09-14T10:49:33.437564+0000","last_unstale":"2024-09-14T12:42:29.858379+0000","last_undegraded":"2024-09-14T12:42:29.858379+0000","last_fullsized":"2024-09-14T12:42:29.858379+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:21.636592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":600,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'363","reported_seq":1770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.457004+0000","last_change":"2024-09-14T10:49:25.378315+0000","last_active":"2024-09-14T12:42:29.457004+0000","last_peered":"2024-09-14T12:42:29.457004+0000","last_clean":"2024-09-14T12:42:29.457004+0000","last_became_active":"2024-09-14T10:49:25.377606+0000","last_became_peered":"2024-09-14T10:49:25.377606+0000","last_unstale":"2024-09-14T12:42:29.457004+0000","last_undegraded":"2024-09-14T12:42:29.457004+0000","last_fullsized":"2024-09-14T12:42:29.457004+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:08.626742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2088,"num_read_kb":1981,"num_write":424,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500386+0000","last_change":"2024-09-14T10:49:09.053071+0000","last_active":"2024-09-14T12:41:41.500386+0000","last_peered":"2024-09-14T12:41:41.500386+0000","last_clean":"2024-09-14T12:41:41.500386+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T12:41:41.500386+0000","last_undegraded":"2024-09-14T12:41:41.500386+0000","last_fullsized":"2024-09-14T12:41:41.500386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:51.730662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'296","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:07.758881+0000","last_change":"2024-09-14T10:49:23.365487+0000","last_active":"2024-09-14T12:42:07.758881+0000","last_peered":"2024-09-14T12:42:07.758881+0000","last_clean":"2024-09-14T12:42:07.758881+0000","last_became_active":"2024-09-14T10:49:23.365016+0000","last_became_peered":"2024-09-14T10:49:23.365016+0000","last_unstale":"2024-09-14T12:42:07.758881+0000","last_undegraded":"2024-09-14T12:42:07.758881+0000","last_fullsized":"2024-09-14T12:42:07.758881+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.567826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28316518,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":588,"num_read_kb":160042,"num_write":1061,"num_write_kb":62525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737546+0000","last_change":"2024-09-14T10:49:27.374724+0000","last_active":"2024-09-14T12:40:14.737546+0000","last_peered":"2024-09-14T12:40:14.737546+0000","last_clean":"2024-09-14T12:40:14.737546+0000","last_became_active":"2024-09-14T10:49:27.373998+0000","last_became_peered":"2024-09-14T10:49:27.373998+0000","last_unstale":"2024-09-14T12:40:14.737546+0000","last_undegraded":"2024-09-14T12:40:14.737546+0000","last_fullsized":"2024-09-14T12:40:14.737546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:19.157690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'229","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:10.363823+0000","last_change":"2024-09-14T10:49:29.391820+0000","last_active":"2024-09-14T12:42:10.363823+0000","last_peered":"2024-09-14T12:42:10.363823+0000","last_clean":"2024-09-14T12:42:10.363823+0000","last_became_active":"2024-09-14T10:49:29.391056+0000","last_became_peered":"2024-09-14T10:49:29.391056+0000","last_unstale":"2024-09-14T12:42:10.363823+0000","last_undegraded":"2024-09-14T12:42:10.363823+0000","last_fullsized":"2024-09-14T12:42:10.363823+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:10.544422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":287,"num_read_kb":274,"num_write":212,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476208+0000","last_change":"2024-09-14T10:49:31.430127+0000","last_active":"2024-09-14T12:40:06.476208+0000","last_peered":"2024-09-14T12:40:06.476208+0000","last_clean":"2024-09-14T12:40:06.476208+0000","last_became_active":"2024-09-14T10:49:31.424769+0000","last_became_peered":"2024-09-14T10:49:31.424769+0000","last_unstale":"2024-09-14T12:40:06.476208+0000","last_undegraded":"2024-09-14T12:40:06.476208+0000","last_fullsized":"2024-09-14T12:40:06.476208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:42.138808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'129","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.097115+0000","last_change":"2024-09-14T10:49:33.469301+0000","last_active":"2024-09-14T12:42:31.097115+0000","last_peered":"2024-09-14T12:42:31.097115+0000","last_clean":"2024-09-14T12:42:31.097115+0000","last_became_active":"2024-09-14T10:49:33.468553+0000","last_became_peered":"2024-09-14T10:49:33.468553+0000","last_unstale":"2024-09-14T12:42:31.097115+0000","last_undegraded":"2024-09-14T12:42:31.097115+0000","last_fullsized":"2024-09-14T12:42:31.097115+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:38.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":228,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'553","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.456842+0000","last_change":"2024-09-14T10:49:25.381598+0000","last_active":"2024-09-14T12:42:29.456842+0000","last_peered":"2024-09-14T12:42:29.456842+0000","last_clean":"2024-09-14T12:42:29.456842+0000","last_became_active":"2024-09-14T10:49:25.379137+0000","last_became_peered":"2024-09-14T10:49:25.379137+0000","last_unstale":"2024-09-14T12:42:29.456842+0000","last_undegraded":"2024-09-14T12:42:29.456842+0000","last_fullsized":"2024-09-14T12:42:29.456842+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:41.217351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2924,"num_read_kb":2647,"num_write":735,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'302","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.144857+0000","last_change":"2024-09-14T10:49:23.389597+0000","last_active":"2024-09-14T12:40:06.144857+0000","last_peered":"2024-09-14T12:40:06.144857+0000","last_clean":"2024-09-14T12:40:06.144857+0000","last_became_active":"2024-09-14T10:49:23.389195+0000","last_became_peered":"2024-09-14T10:49:23.389195+0000","last_unstale":"2024-09-14T12:40:06.144857+0000","last_undegraded":"2024-09-14T12:40:06.144857+0000","last_fullsized":"2024-09-14T12:40:06.144857+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.064159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10717874,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":585,"num_read_kb":23841,"num_write":1092,"num_write_kb":31374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:40.575257+0000","last_change":"2024-09-14T10:49:09.318418+0000","last_active":"2024-09-14T12:41:40.575257+0000","last_peered":"2024-09-14T12:41:40.575257+0000","last_clean":"2024-09-14T12:41:40.575257+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T12:41:40.575257+0000","last_undegraded":"2024-09-14T12:41:40.575257+0000","last_fullsized":"2024-09-14T12:41:40.575257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:16.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.560955+0000","last_change":"2024-09-14T10:49:27.369178+0000","last_active":"2024-09-14T12:39:55.560955+0000","last_peered":"2024-09-14T12:39:55.560955+0000","last_clean":"2024-09-14T12:39:55.560955+0000","last_became_active":"2024-09-14T10:49:27.368412+0000","last_became_peered":"2024-09-14T10:49:27.368412+0000","last_unstale":"2024-09-14T12:39:55.560955+0000","last_undegraded":"2024-09-14T12:39:55.560955+0000","last_fullsized":"2024-09-14T12:39:55.560955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:12.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'755","reported_seq":1493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.153074+0000","last_change":"2024-09-14T10:49:29.389811+0000","last_active":"2024-09-14T12:44:04.153074+0000","last_peered":"2024-09-14T12:44:04.153074+0000","last_clean":"2024-09-14T12:44:04.153074+0000","last_became_active":"2024-09-14T10:49:29.383270+0000","last_became_peered":"2024-09-14T10:49:29.383270+0000","last_unstale":"2024-09-14T12:44:04.153074+0000","last_undegraded":"2024-09-14T12:44:04.153074+0000","last_fullsized":"2024-09-14T12:44:04.153074+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:51.681617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99398,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2001,"num_read_kb":3265,"num_write":2692,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.143642+0000","last_change":"2024-09-14T10:49:31.419150+0000","last_active":"2024-09-14T12:40:01.143642+0000","last_peered":"2024-09-14T12:40:01.143642+0000","last_clean":"2024-09-14T12:40:01.143642+0000","last_became_active":"2024-09-14T10:49:31.418385+0000","last_became_peered":"2024-09-14T10:49:31.418385+0000","last_unstale":"2024-09-14T12:40:01.143642+0000","last_undegraded":"2024-09-14T12:40:01.143642+0000","last_fullsized":"2024-09-14T12:40:01.143642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:53.967427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'130","reported_seq":662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.863696+0000","last_change":"2024-09-14T10:49:33.468510+0000","last_active":"2024-09-14T12:42:30.863696+0000","last_peered":"2024-09-14T12:42:30.863696+0000","last_clean":"2024-09-14T12:42:30.863696+0000","last_became_active":"2024-09-14T10:49:33.467268+0000","last_became_peered":"2024-09-14T10:49:33.467268+0000","last_unstale":"2024-09-14T12:42:30.863696+0000","last_undegraded":"2024-09-14T12:42:30.863696+0000","last_fullsized":"2024-09-14T12:42:30.863696+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:48.075987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":137,"num_write":301,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'744","reported_seq":2288,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560542+0000","last_change":"2024-09-14T10:49:25.378254+0000","last_active":"2024-09-14T12:41:56.560542+0000","last_peered":"2024-09-14T12:41:56.560542+0000","last_clean":"2024-09-14T12:41:56.560542+0000","last_became_active":"2024-09-14T10:49:25.377460+0000","last_became_peered":"2024-09-14T10:49:25.377460+0000","last_unstale":"2024-09-14T12:41:56.560542+0000","last_undegraded":"2024-09-14T12:41:56.560542+0000","last_fullsized":"2024-09-14T12:41:56.560542+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:40.959297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3587,"num_read_kb":3249,"num_write":953,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'288","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560585+0000","last_change":"2024-09-14T10:49:23.386787+0000","last_active":"2024-09-14T12:41:56.560585+0000","last_peered":"2024-09-14T12:41:56.560585+0000","last_clean":"2024-09-14T12:41:56.560585+0000","last_became_active":"2024-09-14T10:49:23.383686+0000","last_became_peered":"2024-09-14T10:49:23.383686+0000","last_unstale":"2024-09-14T12:41:56.560585+0000","last_undegraded":"2024-09-14T12:41:56.560585+0000","last_fullsized":"2024-09-14T12:41:56.560585+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:13.515080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8730875,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":470,"num_read_kb":8941,"num_write":1021,"num_write_kb":53511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504873+0000","last_change":"2024-09-14T10:49:09.053478+0000","last_active":"2024-09-14T12:41:56.504873+0000","last_peered":"2024-09-14T12:41:56.504873+0000","last_clean":"2024-09-14T12:41:56.504873+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T12:41:56.504873+0000","last_undegraded":"2024-09-14T12:41:56.504873+0000","last_fullsized":"2024-09-14T12:41:56.504873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.160900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.786411+0000","last_change":"2024-09-14T10:49:27.374268+0000","last_active":"2024-09-14T12:39:55.786411+0000","last_peered":"2024-09-14T12:39:55.786411+0000","last_clean":"2024-09-14T12:39:55.786411+0000","last_became_active":"2024-09-14T10:49:27.373801+0000","last_became_peered":"2024-09-14T10:49:27.373801+0000","last_unstale":"2024-09-14T12:39:55.786411+0000","last_undegraded":"2024-09-14T12:39:55.786411+0000","last_fullsized":"2024-09-14T12:39:55.786411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:26.573366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'247","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.851447+0000","last_change":"2024-09-14T10:49:29.387943+0000","last_active":"2024-09-14T12:40:15.851447+0000","last_peered":"2024-09-14T12:40:15.851447+0000","last_clean":"2024-09-14T12:40:15.851447+0000","last_became_active":"2024-09-14T10:49:29.387176+0000","last_became_peered":"2024-09-14T10:49:29.387176+0000","last_unstale":"2024-09-14T12:40:15.851447+0000","last_undegraded":"2024-09-14T12:40:15.851447+0000","last_fullsized":"2024-09-14T12:40:15.851447+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:04.926878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'792","reported_seq":3332,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:52.730993+0000","last_change":"2024-09-14T10:49:31.418103+0000","last_active":"2024-09-14T12:43:52.730993+0000","last_peered":"2024-09-14T12:43:52.730993+0000","last_clean":"2024-09-14T12:43:52.730993+0000","last_became_active":"2024-09-14T10:49:31.417376+0000","last_became_peered":"2024-09-14T10:49:31.417376+0000","last_unstale":"2024-09-14T12:43:52.730993+0000","last_undegraded":"2024-09-14T12:43:52.730993+0000","last_fullsized":"2024-09-14T12:43:52.730993+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:56.482438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'146","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.767330+0000","last_change":"2024-09-14T10:49:33.459885+0000","last_active":"2024-09-14T12:42:24.767330+0000","last_peered":"2024-09-14T12:42:24.767330+0000","last_clean":"2024-09-14T12:42:24.767330+0000","last_became_active":"2024-09-14T10:49:33.459122+0000","last_became_peered":"2024-09-14T10:49:33.459122+0000","last_unstale":"2024-09-14T12:42:24.767330+0000","last_undegraded":"2024-09-14T12:42:24.767330+0000","last_fullsized":"2024-09-14T12:42:24.767330+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:50.717373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":355,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'838","reported_seq":2546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.586893+0000","last_change":"2024-09-14T10:49:25.361390+0000","last_active":"2024-09-14T12:41:55.586893+0000","last_peered":"2024-09-14T12:41:55.586893+0000","last_clean":"2024-09-14T12:41:55.586893+0000","last_became_active":"2024-09-14T10:49:25.360655+0000","last_became_peered":"2024-09-14T10:49:25.360655+0000","last_unstale":"2024-09-14T12:41:55.586893+0000","last_undegraded":"2024-09-14T12:41:55.586893+0000","last_fullsized":"2024-09-14T12:41:55.586893+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:50.719358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4101,"num_read_kb":3716,"num_write":1090,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'379","reported_seq":1086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.561098+0000","last_change":"2024-09-14T10:49:23.361586+0000","last_active":"2024-09-14T12:39:55.561098+0000","last_peered":"2024-09-14T12:39:55.561098+0000","last_clean":"2024-09-14T12:39:55.561098+0000","last_became_active":"2024-09-14T10:49:23.359442+0000","last_became_peered":"2024-09-14T10:49:23.359442+0000","last_unstale":"2024-09-14T12:39:55.561098+0000","last_undegraded":"2024-09-14T12:39:55.561098+0000","last_fullsized":"2024-09-14T12:39:55.561098+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.017232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15319025,"num_objects":91,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":745,"num_read_kb":31084,"num_write":1277,"num_write_kb":31792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585909+0000","last_change":"2024-09-14T10:49:09.044027+0000","last_active":"2024-09-14T12:41:50.585909+0000","last_peered":"2024-09-14T12:41:50.585909+0000","last_clean":"2024-09-14T12:41:50.585909+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T12:41:50.585909+0000","last_undegraded":"2024-09-14T12:41:50.585909+0000","last_fullsized":"2024-09-14T12:41:50.585909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:42.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.473776+0000","last_change":"2024-09-14T10:49:27.385279+0000","last_active":"2024-09-14T12:39:56.473776+0000","last_peered":"2024-09-14T12:39:56.473776+0000","last_clean":"2024-09-14T12:39:56.473776+0000","last_became_active":"2024-09-14T10:49:27.384635+0000","last_became_peered":"2024-09-14T10:49:27.384635+0000","last_unstale":"2024-09-14T12:39:56.473776+0000","last_undegraded":"2024-09-14T12:39:56.473776+0000","last_fullsized":"2024-09-14T12:39:56.473776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.745658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'179","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.412351+0000","last_change":"2024-09-14T10:49:29.397010+0000","last_active":"2024-09-14T12:40:15.412351+0000","last_peered":"2024-09-14T12:40:15.412351+0000","last_clean":"2024-09-14T12:40:15.412351+0000","last_became_active":"2024-09-14T10:49:29.394105+0000","last_became_peered":"2024-09-14T10:49:29.394105+0000","last_unstale":"2024-09-14T12:40:15.412351+0000","last_undegraded":"2024-09-14T12:40:15.412351+0000","last_fullsized":"2024-09-14T12:40:15.412351+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:23.758962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'824","reported_seq":3139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105369+0000","last_change":"2024-09-14T10:49:31.411841+0000","last_active":"2024-09-14T12:43:49.105369+0000","last_peered":"2024-09-14T12:43:49.105369+0000","last_clean":"2024-09-14T12:43:49.105369+0000","last_became_active":"2024-09-14T10:49:31.411055+0000","last_became_peered":"2024-09-14T10:49:31.411055+0000","last_unstale":"2024-09-14T12:43:49.105369+0000","last_undegraded":"2024-09-14T12:43:49.105369+0000","last_fullsized":"2024-09-14T12:43:49.105369+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:46.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'269","reported_seq":814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.548982+0000","last_change":"2024-09-14T10:49:33.457595+0000","last_active":"2024-09-14T12:39:50.548982+0000","last_peered":"2024-09-14T12:39:50.548982+0000","last_clean":"2024-09-14T12:39:50.548982+0000","last_became_active":"2024-09-14T10:49:33.456806+0000","last_became_peered":"2024-09-14T10:49:33.456806+0000","last_unstale":"2024-09-14T12:39:50.548982+0000","last_undegraded":"2024-09-14T12:39:50.548982+0000","last_fullsized":"2024-09-14T12:39:50.548982+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:15.247749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":331,"num_read_kb":330,"num_write":580,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'499","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.457164+0000","last_change":"2024-09-14T10:49:25.373350+0000","last_active":"2024-09-14T12:42:29.457164+0000","last_peered":"2024-09-14T12:42:29.457164+0000","last_clean":"2024-09-14T12:42:29.457164+0000","last_became_active":"2024-09-14T10:49:25.372923+0000","last_became_peered":"2024-09-14T10:49:25.372923+0000","last_unstale":"2024-09-14T12:42:29.457164+0000","last_undegraded":"2024-09-14T12:42:29.457164+0000","last_fullsized":"2024-09-14T12:42:29.457164+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:38.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2643,"num_read_kb":2487,"num_write":591,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'293","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.561028+0000","last_change":"2024-09-14T10:49:23.346381+0000","last_active":"2024-09-14T12:39:55.561028+0000","last_peered":"2024-09-14T12:39:55.561028+0000","last_clean":"2024-09-14T12:39:55.561028+0000","last_became_active":"2024-09-14T10:49:23.344863+0000","last_became_peered":"2024-09-14T10:49:23.344863+0000","last_unstale":"2024-09-14T12:39:55.561028+0000","last_undegraded":"2024-09-14T12:39:55.561028+0000","last_fullsized":"2024-09-14T12:39:55.561028+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:12.876419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6333334,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":497,"num_read_kb":37228,"num_write":1020,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503382+0000","last_change":"2024-09-14T10:49:09.054207+0000","last_active":"2024-09-14T12:41:51.503382+0000","last_peered":"2024-09-14T12:41:51.503382+0000","last_clean":"2024-09-14T12:41:51.503382+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T12:41:51.503382+0000","last_undegraded":"2024-09-14T12:41:51.503382+0000","last_fullsized":"2024-09-14T12:41:51.503382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.696418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.588173+0000","last_change":"2024-09-14T10:49:27.380671+0000","last_active":"2024-09-14T12:42:00.588173+0000","last_peered":"2024-09-14T12:42:00.588173+0000","last_clean":"2024-09-14T12:42:00.588173+0000","last_became_active":"2024-09-14T10:49:27.379820+0000","last_became_peered":"2024-09-14T10:49:27.379820+0000","last_unstale":"2024-09-14T12:42:00.588173+0000","last_undegraded":"2024-09-14T12:42:00.588173+0000","last_fullsized":"2024-09-14T12:42:00.588173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:08.601000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'834","reported_seq":1614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.589148+0000","last_change":"2024-09-14T10:49:29.390161+0000","last_active":"2024-09-14T12:43:48.589148+0000","last_peered":"2024-09-14T12:43:48.589148+0000","last_clean":"2024-09-14T12:43:48.589148+0000","last_became_active":"2024-09-14T10:49:29.389500+0000","last_became_peered":"2024-09-14T10:49:29.389500+0000","last_unstale":"2024-09-14T12:43:48.589148+0000","last_undegraded":"2024-09-14T12:43:48.589148+0000","last_fullsized":"2024-09-14T12:43:48.589148+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:43.125499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196422,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1468,"num_read_kb":3084,"num_write":1208,"num_write_kb":978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.562166+0000","last_change":"2024-09-14T10:49:31.413780+0000","last_active":"2024-09-14T12:40:00.562166+0000","last_peered":"2024-09-14T12:40:00.562166+0000","last_clean":"2024-09-14T12:40:00.562166+0000","last_became_active":"2024-09-14T10:49:31.413008+0000","last_became_peered":"2024-09-14T10:49:31.413008+0000","last_unstale":"2024-09-14T12:40:00.562166+0000","last_undegraded":"2024-09-14T12:40:00.562166+0000","last_fullsized":"2024-09-14T12:40:00.562166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:58.384037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.643169+0000","last_change":"2024-09-14T10:49:33.471643+0000","last_active":"2024-09-14T12:42:31.643169+0000","last_peered":"2024-09-14T12:42:31.643169+0000","last_clean":"2024-09-14T12:42:31.643169+0000","last_became_active":"2024-09-14T10:49:33.468546+0000","last_became_peered":"2024-09-14T10:49:33.468546+0000","last_unstale":"2024-09-14T12:42:31.643169+0000","last_undegraded":"2024-09-14T12:42:31.643169+0000","last_fullsized":"2024-09-14T12:42:31.643169+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.990777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'160","reported_seq":765,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.764101+0000","last_change":"2024-09-14T10:49:33.462576+0000","last_active":"2024-09-14T12:42:29.764101+0000","last_peered":"2024-09-14T12:42:29.764101+0000","last_clean":"2024-09-14T12:42:29.764101+0000","last_became_active":"2024-09-14T10:49:33.461782+0000","last_became_peered":"2024-09-14T10:49:33.461782+0000","last_unstale":"2024-09-14T12:42:29.764101+0000","last_undegraded":"2024-09-14T12:42:29.764101+0000","last_fullsized":"2024-09-14T12:42:29.764101+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:38.902854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":264,"num_write":397,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'521","reported_seq":2247,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.163802+0000","last_change":"2024-09-14T10:49:25.381899+0000","last_active":"2024-09-14T12:41:26.163802+0000","last_peered":"2024-09-14T12:41:26.163802+0000","last_clean":"2024-09-14T12:41:26.163802+0000","last_became_active":"2024-09-14T10:49:25.381653+0000","last_became_peered":"2024-09-14T10:49:25.381653+0000","last_unstale":"2024-09-14T12:41:26.163802+0000","last_undegraded":"2024-09-14T12:41:26.163802+0000","last_fullsized":"2024-09-14T12:41:26.163802+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:01.827788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2737,"num_read_kb":2577,"num_write":621,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'301","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500472+0000","last_change":"2024-09-14T10:49:23.365867+0000","last_active":"2024-09-14T12:41:41.500472+0000","last_peered":"2024-09-14T12:41:41.500472+0000","last_clean":"2024-09-14T12:41:41.500472+0000","last_became_active":"2024-09-14T10:49:23.365341+0000","last_became_peered":"2024-09-14T10:49:23.365341+0000","last_unstale":"2024-09-14T12:41:41.500472+0000","last_undegraded":"2024-09-14T12:41:41.500472+0000","last_fullsized":"2024-09-14T12:41:41.500472+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:00.255631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10074569,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":607,"num_read_kb":37656,"num_write":1053,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.554957+0000","last_change":"2024-09-14T10:49:27.368112+0000","last_active":"2024-09-14T12:41:31.554957+0000","last_peered":"2024-09-14T12:41:31.554957+0000","last_clean":"2024-09-14T12:41:31.554957+0000","last_became_active":"2024-09-14T10:49:27.366990+0000","last_became_peered":"2024-09-14T10:49:27.366990+0000","last_unstale":"2024-09-14T12:41:31.554957+0000","last_undegraded":"2024-09-14T12:41:31.554957+0000","last_fullsized":"2024-09-14T12:41:31.554957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.945759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'330","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.617729+0000","last_change":"2024-09-14T10:49:29.372907+0000","last_active":"2024-09-14T12:43:48.617729+0000","last_peered":"2024-09-14T12:43:48.617729+0000","last_clean":"2024-09-14T12:43:48.617729+0000","last_became_active":"2024-09-14T10:49:29.371655+0000","last_became_peered":"2024-09-14T10:49:29.371655+0000","last_unstale":"2024-09-14T12:43:48.617729+0000","last_undegraded":"2024-09-14T12:43:48.617729+0000","last_fullsized":"2024-09-14T12:43:48.617729+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:51.332753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61251,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1050,"num_write":434,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755605+0000","last_change":"2024-09-14T10:49:31.418572+0000","last_active":"2024-09-14T12:41:34.755605+0000","last_peered":"2024-09-14T12:41:34.755605+0000","last_clean":"2024-09-14T12:41:34.755605+0000","last_became_active":"2024-09-14T10:49:31.417675+0000","last_became_peered":"2024-09-14T10:49:31.417675+0000","last_unstale":"2024-09-14T12:41:34.755605+0000","last_undegraded":"2024-09-14T12:41:34.755605+0000","last_fullsized":"2024-09-14T12:41:34.755605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:42.817490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'145","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.663503+0000","last_change":"2024-09-14T10:49:33.454370+0000","last_active":"2024-09-14T12:43:47.663503+0000","last_peered":"2024-09-14T12:43:47.663503+0000","last_clean":"2024-09-14T12:43:47.663503+0000","last_became_active":"2024-09-14T10:49:33.453630+0000","last_became_peered":"2024-09-14T10:49:33.453630+0000","last_unstale":"2024-09-14T12:43:47.663503+0000","last_undegraded":"2024-09-14T12:43:47.663503+0000","last_fullsized":"2024-09-14T12:43:47.663503+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:55.786343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":363,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'722","reported_seq":2161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.580335+0000","last_change":"2024-09-14T10:49:25.374565+0000","last_active":"2024-09-14T12:41:25.580335+0000","last_peered":"2024-09-14T12:41:25.580335+0000","last_clean":"2024-09-14T12:41:25.580335+0000","last_became_active":"2024-09-14T10:49:25.373876+0000","last_became_peered":"2024-09-14T10:49:25.373876+0000","last_unstale":"2024-09-14T12:41:25.580335+0000","last_undegraded":"2024-09-14T12:41:25.580335+0000","last_fullsized":"2024-09-14T12:41:25.580335+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:31.592836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3124,"num_write":967,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'273","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795748+0000","last_change":"2024-09-14T10:49:23.373710+0000","last_active":"2024-09-14T12:40:35.795748+0000","last_peered":"2024-09-14T12:40:35.795748+0000","last_clean":"2024-09-14T12:40:35.795748+0000","last_became_active":"2024-09-14T10:49:23.373206+0000","last_became_peered":"2024-09-14T10:49:23.373206+0000","last_unstale":"2024-09-14T12:40:35.795748+0000","last_undegraded":"2024-09-14T12:40:35.795748+0000","last_fullsized":"2024-09-14T12:40:35.795748+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:03.253858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489973,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":579,"num_read_kb":34264,"num_write":987,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581474+0000","last_change":"2024-09-14T10:49:27.371401+0000","last_active":"2024-09-14T12:41:30.581474+0000","last_peered":"2024-09-14T12:41:30.581474+0000","last_clean":"2024-09-14T12:41:30.581474+0000","last_became_active":"2024-09-14T10:49:27.370174+0000","last_became_peered":"2024-09-14T10:49:27.370174+0000","last_unstale":"2024-09-14T12:41:30.581474+0000","last_undegraded":"2024-09-14T12:41:30.581474+0000","last_fullsized":"2024-09-14T12:41:30.581474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.300623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581354+0000","last_change":"2024-09-14T10:49:29.376404+0000","last_active":"2024-09-14T12:41:30.581354+0000","last_peered":"2024-09-14T12:41:30.581354+0000","last_clean":"2024-09-14T12:41:30.581354+0000","last_became_active":"2024-09-14T10:49:29.375761+0000","last_became_peered":"2024-09-14T10:49:29.375761+0000","last_unstale":"2024-09-14T12:41:30.581354+0000","last_undegraded":"2024-09-14T12:41:30.581354+0000","last_fullsized":"2024-09-14T12:41:30.581354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:47.597945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:36.165985+0000","last_change":"2024-09-14T10:49:31.411967+0000","last_active":"2024-09-14T12:41:36.165985+0000","last_peered":"2024-09-14T12:41:36.165985+0000","last_clean":"2024-09-14T12:41:36.165985+0000","last_became_active":"2024-09-14T10:49:31.410915+0000","last_became_peered":"2024-09-14T10:49:31.410915+0000","last_unstale":"2024-09-14T12:41:36.165985+0000","last_undegraded":"2024-09-14T12:41:36.165985+0000","last_fullsized":"2024-09-14T12:41:36.165985+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:52.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'179","reported_seq":721,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.366754+0000","last_change":"2024-09-14T10:49:33.454043+0000","last_active":"2024-09-14T12:42:29.366754+0000","last_peered":"2024-09-14T12:42:29.366754+0000","last_clean":"2024-09-14T12:42:29.366754+0000","last_became_active":"2024-09-14T10:49:33.453278+0000","last_became_peered":"2024-09-14T10:49:33.453278+0000","last_unstale":"2024-09-14T12:42:29.366754+0000","last_undegraded":"2024-09-14T12:42:29.366754+0000","last_fullsized":"2024-09-14T12:42:29.366754+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:00.597295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":265,"num_write":381,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'431","reported_seq":2071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.579695+0000","last_change":"2024-09-14T10:49:25.353852+0000","last_active":"2024-09-14T12:41:29.579695+0000","last_peered":"2024-09-14T12:41:29.579695+0000","last_clean":"2024-09-14T12:41:29.579695+0000","last_became_active":"2024-09-14T10:49:25.353010+0000","last_became_peered":"2024-09-14T10:49:25.353010+0000","last_unstale":"2024-09-14T12:41:29.579695+0000","last_undegraded":"2024-09-14T12:41:29.579695+0000","last_fullsized":"2024-09-14T12:41:29.579695+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:33.291317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2606,"num_read_kb":2470,"num_write":495,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'293","reported_seq":1012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:15.686441+0000","last_change":"2024-09-14T10:49:23.404260+0000","last_active":"2024-09-14T12:41:15.686441+0000","last_peered":"2024-09-14T12:41:15.686441+0000","last_clean":"2024-09-14T12:41:15.686441+0000","last_became_active":"2024-09-14T10:49:23.403718+0000","last_became_peered":"2024-09-14T10:49:23.403718+0000","last_unstale":"2024-09-14T12:41:15.686441+0000","last_undegraded":"2024-09-14T12:41:15.686441+0000","last_fullsized":"2024-09-14T12:41:15.686441+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:18.065436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6885332,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":662,"num_read_kb":4161,"num_write":997,"num_write_kb":34340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164879+0000","last_change":"2024-09-14T10:49:27.378466+0000","last_active":"2024-09-14T12:41:31.164879+0000","last_peered":"2024-09-14T12:41:31.164879+0000","last_clean":"2024-09-14T12:41:31.164879+0000","last_became_active":"2024-09-14T10:49:27.377584+0000","last_became_peered":"2024-09-14T10:49:27.377584+0000","last_unstale":"2024-09-14T12:41:31.164879+0000","last_undegraded":"2024-09-14T12:41:31.164879+0000","last_fullsized":"2024-09-14T12:41:31.164879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:00.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'387","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.040268+0000","last_change":"2024-09-14T10:49:29.390323+0000","last_active":"2024-09-14T12:44:02.040268+0000","last_peered":"2024-09-14T12:44:02.040268+0000","last_clean":"2024-09-14T12:44:02.040268+0000","last_became_active":"2024-09-14T10:49:29.389523+0000","last_became_peered":"2024-09-14T10:49:29.389523+0000","last_unstale":"2024-09-14T12:44:02.040268+0000","last_undegraded":"2024-09-14T12:44:02.040268+0000","last_fullsized":"2024-09-14T12:44:02.040268+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:19.414203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":1411,"num_write":516,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.561781+0000","last_change":"2024-09-14T10:49:31.422662+0000","last_active":"2024-09-14T12:41:35.561781+0000","last_peered":"2024-09-14T12:41:35.561781+0000","last_clean":"2024-09-14T12:41:35.561781+0000","last_became_active":"2024-09-14T10:49:31.422113+0000","last_became_peered":"2024-09-14T10:49:31.422113+0000","last_unstale":"2024-09-14T12:41:35.561781+0000","last_undegraded":"2024-09-14T12:41:35.561781+0000","last_fullsized":"2024-09-14T12:41:35.561781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:51.224760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'154","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468918+0000","last_change":"2024-09-14T10:49:33.476247+0000","last_active":"2024-09-14T12:39:36.468918+0000","last_peered":"2024-09-14T12:39:36.468918+0000","last_clean":"2024-09-14T12:39:36.468918+0000","last_became_active":"2024-09-14T10:49:33.475156+0000","last_became_peered":"2024-09-14T10:49:33.475156+0000","last_unstale":"2024-09-14T12:39:36.468918+0000","last_undegraded":"2024-09-14T12:39:36.468918+0000","last_fullsized":"2024-09-14T12:39:36.468918+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:09.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'411","reported_seq":2093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.754459+0000","last_change":"2024-09-14T10:49:25.371715+0000","last_active":"2024-09-14T12:41:29.754459+0000","last_peered":"2024-09-14T12:41:29.754459+0000","last_clean":"2024-09-14T12:41:29.754459+0000","last_became_active":"2024-09-14T10:49:25.370901+0000","last_became_peered":"2024-09-14T10:49:25.370901+0000","last_unstale":"2024-09-14T12:41:29.754459+0000","last_undegraded":"2024-09-14T12:41:29.754459+0000","last_fullsized":"2024-09-14T12:41:29.754459+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:49.373960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2274,"num_write":465,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'321","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559911+0000","last_change":"2024-09-14T10:49:23.370421+0000","last_active":"2024-09-14T12:40:35.559911+0000","last_peered":"2024-09-14T12:40:35.559911+0000","last_clean":"2024-09-14T12:40:35.559911+0000","last_became_active":"2024-09-14T10:49:23.369669+0000","last_became_peered":"2024-09-14T10:49:23.369669+0000","last_unstale":"2024-09-14T12:40:35.559911+0000","last_undegraded":"2024-09-14T12:40:35.559911+0000","last_fullsized":"2024-09-14T12:40:35.559911+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:37.860070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14752595,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":717,"num_read_kb":9967,"num_write":1297,"num_write_kb":36861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.498091+0000","last_change":"2024-09-14T10:49:27.388330+0000","last_active":"2024-09-14T12:41:31.498091+0000","last_peered":"2024-09-14T12:41:31.498091+0000","last_clean":"2024-09-14T12:41:31.498091+0000","last_became_active":"2024-09-14T10:49:27.387840+0000","last_became_peered":"2024-09-14T10:49:27.387840+0000","last_unstale":"2024-09-14T12:41:31.498091+0000","last_undegraded":"2024-09-14T12:41:31.498091+0000","last_fullsized":"2024-09-14T12:41:31.498091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:31.040634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'319","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.585470+0000","last_change":"2024-09-14T10:49:29.392053+0000","last_active":"2024-09-14T12:43:48.585470+0000","last_peered":"2024-09-14T12:43:48.585470+0000","last_clean":"2024-09-14T12:43:48.585470+0000","last_became_active":"2024-09-14T10:49:29.391517+0000","last_became_peered":"2024-09-14T10:49:29.391517+0000","last_unstale":"2024-09-14T12:43:48.585470+0000","last_undegraded":"2024-09-14T12:43:48.585470+0000","last_fullsized":"2024-09-14T12:43:48.585470+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:03.721336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":1268,"num_write":432,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755694+0000","last_change":"2024-09-14T10:49:31.411523+0000","last_active":"2024-09-14T12:41:34.755694+0000","last_peered":"2024-09-14T12:41:34.755694+0000","last_clean":"2024-09-14T12:41:34.755694+0000","last_became_active":"2024-09-14T10:49:31.410633+0000","last_became_peered":"2024-09-14T10:49:31.410633+0000","last_unstale":"2024-09-14T12:41:34.755694+0000","last_undegraded":"2024-09-14T12:41:34.755694+0000","last_fullsized":"2024-09-14T12:41:34.755694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:56.976562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'747","reported_seq":2283,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.505119+0000","last_change":"2024-09-14T10:49:25.408540+0000","last_active":"2024-09-14T12:41:56.505119+0000","last_peered":"2024-09-14T12:41:56.505119+0000","last_clean":"2024-09-14T12:41:56.505119+0000","last_became_active":"2024-09-14T10:49:25.408028+0000","last_became_peered":"2024-09-14T10:49:25.408028+0000","last_unstale":"2024-09-14T12:41:56.505119+0000","last_undegraded":"2024-09-14T12:41:56.505119+0000","last_fullsized":"2024-09-14T12:41:56.505119+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:24.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3658,"num_read_kb":3304,"num_write":985,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'312","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:27.422883+0000","last_change":"2024-09-14T10:49:23.387201+0000","last_active":"2024-09-14T12:41:27.422883+0000","last_peered":"2024-09-14T12:41:27.422883+0000","last_clean":"2024-09-14T12:41:27.422883+0000","last_became_active":"2024-09-14T10:49:23.386404+0000","last_became_peered":"2024-09-14T10:49:23.386404+0000","last_unstale":"2024-09-14T12:41:27.422883+0000","last_undegraded":"2024-09-14T12:41:27.422883+0000","last_fullsized":"2024-09-14T12:41:27.422883+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:38.147399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9214153,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":614,"num_read_kb":6911,"num_write":1144,"num_write_kb":32272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:51.586033+0000","last_change":"2024-09-14T10:49:27.382769+0000","last_active":"2024-09-14T12:43:51.586033+0000","last_peered":"2024-09-14T12:43:51.586033+0000","last_clean":"2024-09-14T12:43:51.586033+0000","last_became_active":"2024-09-14T10:49:27.381931+0000","last_became_peered":"2024-09-14T10:49:27.381931+0000","last_unstale":"2024-09-14T12:43:51.586033+0000","last_undegraded":"2024-09-14T12:43:51.586033+0000","last_fullsized":"2024-09-14T12:43:51.586033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:55.209752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":730,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'546","reported_seq":1208,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.583410+0000","last_change":"2024-09-14T10:49:29.364784+0000","last_active":"2024-09-14T12:43:48.583410+0000","last_peered":"2024-09-14T12:43:48.583410+0000","last_clean":"2024-09-14T12:43:48.583410+0000","last_became_active":"2024-09-14T10:49:29.364013+0000","last_became_peered":"2024-09-14T10:49:29.364013+0000","last_unstale":"2024-09-14T12:43:48.583410+0000","last_undegraded":"2024-09-14T12:43:48.583410+0000","last_fullsized":"2024-09-14T12:43:48.583410+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:14.626395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":938,"num_read_kb":1929,"num_write":824,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.137434+0000","last_change":"2024-09-14T10:49:31.432562+0000","last_active":"2024-09-14T12:39:36.137434+0000","last_peered":"2024-09-14T12:39:36.137434+0000","last_clean":"2024-09-14T12:39:36.137434+0000","last_became_active":"2024-09-14T10:49:31.431550+0000","last_became_peered":"2024-09-14T10:49:31.431550+0000","last_unstale":"2024-09-14T12:39:36.137434+0000","last_undegraded":"2024-09-14T12:39:36.137434+0000","last_fullsized":"2024-09-14T12:39:36.137434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:21.094996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'162","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.573998+0000","last_change":"2024-09-14T10:49:33.467050+0000","last_active":"2024-09-14T12:41:35.573998+0000","last_peered":"2024-09-14T12:41:35.573998+0000","last_clean":"2024-09-14T12:41:35.573998+0000","last_became_active":"2024-09-14T10:49:33.466424+0000","last_became_peered":"2024-09-14T10:49:33.466424+0000","last_unstale":"2024-09-14T12:41:35.573998+0000","last_undegraded":"2024-09-14T12:41:35.573998+0000","last_fullsized":"2024-09-14T12:41:35.573998+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:16.563193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":247,"num_write":384,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'832","reported_seq":2406,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.767765+0000","last_change":"2024-09-14T10:49:25.367610+0000","last_active":"2024-09-14T12:42:31.767765+0000","last_peered":"2024-09-14T12:42:31.767765+0000","last_clean":"2024-09-14T12:42:31.767765+0000","last_became_active":"2024-09-14T10:49:25.364958+0000","last_became_peered":"2024-09-14T10:49:25.364958+0000","last_unstale":"2024-09-14T12:42:31.767765+0000","last_undegraded":"2024-09-14T12:42:31.767765+0000","last_fullsized":"2024-09-14T12:42:31.767765+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:15.525950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3911,"num_read_kb":3508,"num_write":1119,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'341","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:37.080833+0000","last_change":"2024-09-14T10:49:23.378450+0000","last_active":"2024-09-14T12:43:37.080833+0000","last_peered":"2024-09-14T12:43:37.080833+0000","last_clean":"2024-09-14T12:43:37.080833+0000","last_became_active":"2024-09-14T10:49:23.375310+0000","last_became_peered":"2024-09-14T10:49:23.375310+0000","last_unstale":"2024-09-14T12:43:37.080833+0000","last_undegraded":"2024-09-14T12:43:37.080833+0000","last_fullsized":"2024-09-14T12:43:37.080833+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:47.638057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22018826,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":753,"num_read_kb":30362,"num_write":1144,"num_write_kb":52321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'5","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.501490+0000","last_change":"2024-09-14T10:49:27.386902+0000","last_active":"2024-09-14T12:43:48.501490+0000","last_peered":"2024-09-14T12:43:48.501490+0000","last_clean":"2024-09-14T12:43:48.501490+0000","last_became_active":"2024-09-14T10:49:27.386412+0000","last_became_peered":"2024-09-14T10:49:27.386412+0000","last_unstale":"2024-09-14T12:43:48.501490+0000","last_undegraded":"2024-09-14T12:43:48.501490+0000","last_fullsized":"2024-09-14T12:43:48.501490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:24.661084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'353","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506319+0000","last_change":"2024-09-14T10:49:29.388733+0000","last_active":"2024-09-14T12:42:01.506319+0000","last_peered":"2024-09-14T12:42:01.506319+0000","last_clean":"2024-09-14T12:42:01.506319+0000","last_became_active":"2024-09-14T10:49:29.388370+0000","last_became_peered":"2024-09-14T10:49:29.388370+0000","last_unstale":"2024-09-14T12:42:01.506319+0000","last_undegraded":"2024-09-14T12:42:01.506319+0000","last_fullsized":"2024-09-14T12:42:01.506319+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.037315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46625,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":564,"num_read_kb":950,"num_write":456,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.545289+0000","last_change":"2024-09-14T10:49:31.430532+0000","last_active":"2024-09-14T12:39:35.545289+0000","last_peered":"2024-09-14T12:39:35.545289+0000","last_clean":"2024-09-14T12:39:35.545289+0000","last_became_active":"2024-09-14T10:49:31.429861+0000","last_became_peered":"2024-09-14T10:49:31.429861+0000","last_unstale":"2024-09-14T12:39:35.545289+0000","last_undegraded":"2024-09-14T12:39:35.545289+0000","last_fullsized":"2024-09-14T12:39:35.545289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:13.932023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'278","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.559029+0000","last_change":"2024-09-14T10:49:33.451361+0000","last_active":"2024-09-14T12:42:24.559029+0000","last_peered":"2024-09-14T12:42:24.559029+0000","last_clean":"2024-09-14T12:42:24.559029+0000","last_became_active":"2024-09-14T10:49:33.446698+0000","last_became_peered":"2024-09-14T10:49:33.446698+0000","last_unstale":"2024-09-14T12:42:24.559029+0000","last_undegraded":"2024-09-14T12:42:24.559029+0000","last_fullsized":"2024-09-14T12:42:24.559029+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:44.754797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":288,"num_write":643,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'442","reported_seq":2142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.508259+0000","last_change":"2024-09-14T10:49:25.396269+0000","last_active":"2024-09-14T12:39:44.508259+0000","last_peered":"2024-09-14T12:39:44.508259+0000","last_clean":"2024-09-14T12:39:44.508259+0000","last_became_active":"2024-09-14T10:49:25.395644+0000","last_became_peered":"2024-09-14T10:49:25.395644+0000","last_unstale":"2024-09-14T12:39:44.508259+0000","last_undegraded":"2024-09-14T12:39:44.508259+0000","last_fullsized":"2024-09-14T12:39:44.508259+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:11.713387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2723,"num_read_kb":2577,"num_write":520,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'282","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:07.338108+0000","last_change":"2024-09-14T10:49:23.395500+0000","last_active":"2024-09-14T12:40:07.338108+0000","last_peered":"2024-09-14T12:40:07.338108+0000","last_clean":"2024-09-14T12:40:07.338108+0000","last_became_active":"2024-09-14T10:49:23.394870+0000","last_became_peered":"2024-09-14T10:49:23.394870+0000","last_unstale":"2024-09-14T12:40:07.338108+0000","last_undegraded":"2024-09-14T12:40:07.338108+0000","last_fullsized":"2024-09-14T12:40:07.338108+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:09.297899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4540402,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":553,"num_read_kb":18368,"num_write":1036,"num_write_kb":30203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136301+0000","last_change":"2024-09-14T10:49:27.387706+0000","last_active":"2024-09-14T12:39:31.136301+0000","last_peered":"2024-09-14T12:39:31.136301+0000","last_clean":"2024-09-14T12:39:31.136301+0000","last_became_active":"2024-09-14T10:49:27.385720+0000","last_became_peered":"2024-09-14T10:49:27.385720+0000","last_unstale":"2024-09-14T12:39:31.136301+0000","last_undegraded":"2024-09-14T12:39:31.136301+0000","last_fullsized":"2024-09-14T12:39:31.136301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:41.338079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'333","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561794+0000","last_change":"2024-09-14T10:49:29.364739+0000","last_active":"2024-09-14T12:42:01.561794+0000","last_peered":"2024-09-14T12:42:01.561794+0000","last_clean":"2024-09-14T12:42:01.561794+0000","last_became_active":"2024-09-14T10:49:29.363989+0000","last_became_peered":"2024-09-14T10:49:29.363989+0000","last_unstale":"2024-09-14T12:42:01.561794+0000","last_undegraded":"2024-09-14T12:42:01.561794+0000","last_fullsized":"2024-09-14T12:42:01.561794+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:11.406587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56407,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":525,"num_read_kb":1007,"num_write":416,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760421+0000","last_change":"2024-09-14T10:49:31.423380+0000","last_active":"2024-09-14T12:41:54.760421+0000","last_peered":"2024-09-14T12:41:54.760421+0000","last_clean":"2024-09-14T12:41:54.760421+0000","last_became_active":"2024-09-14T10:49:31.421636+0000","last_became_peered":"2024-09-14T10:49:31.421636+0000","last_unstale":"2024-09-14T12:41:54.760421+0000","last_undegraded":"2024-09-14T12:41:54.760421+0000","last_fullsized":"2024-09-14T12:41:54.760421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:30.278841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.656575+0000","last_change":"2024-09-14T10:49:33.466507+0000","last_active":"2024-09-14T12:43:48.656575+0000","last_peered":"2024-09-14T12:43:48.656575+0000","last_clean":"2024-09-14T12:43:48.656575+0000","last_became_active":"2024-09-14T10:49:33.465638+0000","last_became_peered":"2024-09-14T10:49:33.465638+0000","last_unstale":"2024-09-14T12:43:48.656575+0000","last_undegraded":"2024-09-14T12:43:48.656575+0000","last_fullsized":"2024-09-14T12:43:48.656575+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:13.972982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'566","reported_seq":2222,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.703947+0000","last_change":"2024-09-14T10:49:25.384614+0000","last_active":"2024-09-14T12:42:31.703947+0000","last_peered":"2024-09-14T12:42:31.703947+0000","last_clean":"2024-09-14T12:42:31.703947+0000","last_became_active":"2024-09-14T10:49:25.383840+0000","last_became_peered":"2024-09-14T10:49:25.383840+0000","last_unstale":"2024-09-14T12:42:31.703947+0000","last_undegraded":"2024-09-14T12:42:31.703947+0000","last_fullsized":"2024-09-14T12:42:31.703947+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:21.627271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2923,"num_read_kb":2712,"num_write":720,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'399","reported_seq":1100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:34.760157+0000","last_change":"2024-09-14T10:49:23.340003+0000","last_active":"2024-09-14T12:39:34.760157+0000","last_peered":"2024-09-14T12:39:34.760157+0000","last_clean":"2024-09-14T12:39:34.760157+0000","last_became_active":"2024-09-14T10:49:23.338934+0000","last_became_peered":"2024-09-14T10:49:23.338934+0000","last_unstale":"2024-09-14T12:39:34.760157+0000","last_undegraded":"2024-09-14T12:39:34.760157+0000","last_fullsized":"2024-09-14T12:39:34.760157+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:53.526708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14158597,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":771,"num_read_kb":33265,"num_write":1244,"num_write_kb":49842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:30.555291+0000","last_change":"2024-09-14T10:49:27.369319+0000","last_active":"2024-09-14T12:39:30.555291+0000","last_peered":"2024-09-14T12:39:30.555291+0000","last_clean":"2024-09-14T12:39:30.555291+0000","last_became_active":"2024-09-14T10:49:27.368567+0000","last_became_peered":"2024-09-14T10:49:27.368567+0000","last_unstale":"2024-09-14T12:39:30.555291+0000","last_undegraded":"2024-09-14T12:39:30.555291+0000","last_fullsized":"2024-09-14T12:39:30.555291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:50.967591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'149","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:46.501799+0000","last_change":"2024-09-14T10:49:29.393578+0000","last_active":"2024-09-14T12:41:46.501799+0000","last_peered":"2024-09-14T12:41:46.501799+0000","last_clean":"2024-09-14T12:41:46.501799+0000","last_became_active":"2024-09-14T10:49:29.392965+0000","last_became_peered":"2024-09-14T10:49:29.392965+0000","last_unstale":"2024-09-14T12:41:46.501799+0000","last_undegraded":"2024-09-14T12:41:46.501799+0000","last_fullsized":"2024-09-14T12:41:46.501799+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.416866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":187,"num_read_kb":181,"num_write":132,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'788","reported_seq":3261,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.100675+0000","last_change":"2024-09-14T10:49:31.423609+0000","last_active":"2024-09-14T12:43:49.100675+0000","last_peered":"2024-09-14T12:43:49.100675+0000","last_clean":"2024-09-14T12:43:49.100675+0000","last_became_active":"2024-09-14T10:49:31.422765+0000","last_became_peered":"2024-09-14T10:49:31.422765+0000","last_unstale":"2024-09-14T12:43:49.100675+0000","last_undegraded":"2024-09-14T12:43:49.100675+0000","last_fullsized":"2024-09-14T12:43:49.100675+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:06.381324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'100","reported_seq":619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:27.666413+0000","last_change":"2024-09-14T10:49:33.443828+0000","last_active":"2024-09-14T12:42:27.666413+0000","last_peered":"2024-09-14T12:42:27.666413+0000","last_clean":"2024-09-14T12:42:27.666413+0000","last_became_active":"2024-09-14T10:49:33.443020+0000","last_became_peered":"2024-09-14T10:49:33.443020+0000","last_unstale":"2024-09-14T12:42:27.666413+0000","last_undegraded":"2024-09-14T12:42:27.666413+0000","last_fullsized":"2024-09-14T12:42:27.666413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.241734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":233,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'968","reported_seq":2582,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.506058+0000","last_change":"2024-09-14T10:49:25.401196+0000","last_active":"2024-09-14T12:39:44.506058+0000","last_peered":"2024-09-14T12:39:44.506058+0000","last_clean":"2024-09-14T12:39:44.506058+0000","last_became_active":"2024-09-14T10:49:25.400786+0000","last_became_peered":"2024-09-14T10:49:25.400786+0000","last_unstale":"2024-09-14T12:39:44.506058+0000","last_undegraded":"2024-09-14T12:39:44.506058+0000","last_fullsized":"2024-09-14T12:39:44.506058+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":900,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:26.988291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4481,"num_read_kb":3955,"num_write":1321,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'267","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.608528+0000","last_change":"2024-09-14T10:49:23.395425+0000","last_active":"2024-09-14T12:39:49.608528+0000","last_peered":"2024-09-14T12:39:49.608528+0000","last_clean":"2024-09-14T12:39:49.608528+0000","last_became_active":"2024-09-14T10:49:23.394973+0000","last_became_peered":"2024-09-14T10:49:23.394973+0000","last_unstale":"2024-09-14T12:39:49.608528+0000","last_undegraded":"2024-09-14T12:39:49.608528+0000","last_fullsized":"2024-09-14T12:39:49.608528+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.054954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8188169,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":541,"num_read_kb":75759,"num_write":965,"num_write_kb":39860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:30.533301+0000","last_change":"2024-09-14T10:49:27.378358+0000","last_active":"2024-09-14T12:39:30.533301+0000","last_peered":"2024-09-14T12:39:30.533301+0000","last_clean":"2024-09-14T12:39:30.533301+0000","last_became_active":"2024-09-14T10:49:27.377395+0000","last_became_peered":"2024-09-14T10:49:27.377395+0000","last_unstale":"2024-09-14T12:39:30.533301+0000","last_undegraded":"2024-09-14T12:39:30.533301+0000","last_fullsized":"2024-09-14T12:39:30.533301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:07.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'389","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:25.830017+0000","last_change":"2024-09-14T10:49:29.377185+0000","last_active":"2024-09-14T12:43:25.830017+0000","last_peered":"2024-09-14T12:43:25.830017+0000","last_clean":"2024-09-14T12:43:25.830017+0000","last_became_active":"2024-09-14T10:49:29.376813+0000","last_became_peered":"2024-09-14T10:49:29.376813+0000","last_unstale":"2024-09-14T12:43:25.830017+0000","last_undegraded":"2024-09-14T12:43:25.830017+0000","last_fullsized":"2024-09-14T12:43:25.830017+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.599152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53512,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":615,"num_read_kb":1099,"num_write":486,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571666+0000","last_change":"2024-09-14T10:49:31.425171+0000","last_active":"2024-09-14T12:40:45.571666+0000","last_peered":"2024-09-14T12:40:45.571666+0000","last_clean":"2024-09-14T12:40:45.571666+0000","last_became_active":"2024-09-14T10:49:31.424394+0000","last_became_peered":"2024-09-14T10:49:31.424394+0000","last_unstale":"2024-09-14T12:40:45.571666+0000","last_undegraded":"2024-09-14T12:40:45.571666+0000","last_fullsized":"2024-09-14T12:40:45.571666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:07.004493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'151","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.578263+0000","last_change":"2024-09-14T10:49:33.463294+0000","last_active":"2024-09-14T12:42:24.578263+0000","last_peered":"2024-09-14T12:42:24.578263+0000","last_clean":"2024-09-14T12:42:24.578263+0000","last_became_active":"2024-09-14T10:49:33.462582+0000","last_became_peered":"2024-09-14T10:49:33.462582+0000","last_unstale":"2024-09-14T12:42:24.578263+0000","last_undegraded":"2024-09-14T12:42:24.578263+0000","last_fullsized":"2024-09-14T12:42:24.578263+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:51.070074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":151,"num_write":347,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'487","reported_seq":2225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.769121+0000","last_change":"2024-09-14T10:49:25.387231+0000","last_active":"2024-09-14T12:42:31.769121+0000","last_peered":"2024-09-14T12:42:31.769121+0000","last_clean":"2024-09-14T12:42:31.769121+0000","last_became_active":"2024-09-14T10:49:25.386937+0000","last_became_peered":"2024-09-14T10:49:25.386937+0000","last_unstale":"2024-09-14T12:42:31.769121+0000","last_undegraded":"2024-09-14T12:42:31.769121+0000","last_fullsized":"2024-09-14T12:42:31.769121+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:41.631753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2676,"num_write":566,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'305","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:42.941916+0000","last_change":"2024-09-14T10:49:53.506313+0000","last_active":"2024-09-14T12:43:42.941916+0000","last_peered":"2024-09-14T12:43:42.941916+0000","last_clean":"2024-09-14T12:43:42.941916+0000","last_became_active":"2024-09-14T10:49:53.505479+0000","last_became_peered":"2024-09-14T10:49:53.505479+0000","last_unstale":"2024-09-14T12:43:42.941916+0000","last_undegraded":"2024-09-14T12:43:42.941916+0000","last_fullsized":"2024-09-14T12:43:42.941916+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:20.359828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7666583,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":607,"num_read_kb":68230,"num_write":1102,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1,6],"acting":[3,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136252+0000","last_change":"2024-09-14T10:49:27.371936+0000","last_active":"2024-09-14T12:39:31.136252+0000","last_peered":"2024-09-14T12:39:31.136252+0000","last_clean":"2024-09-14T12:39:31.136252+0000","last_became_active":"2024-09-14T10:49:27.371450+0000","last_became_peered":"2024-09-14T10:49:27.371450+0000","last_unstale":"2024-09-14T12:39:31.136252+0000","last_undegraded":"2024-09-14T12:39:31.136252+0000","last_fullsized":"2024-09-14T12:39:31.136252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:11.677326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'295","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:05.603542+0000","last_change":"2024-09-14T10:49:29.380669+0000","last_active":"2024-09-14T12:43:05.603542+0000","last_peered":"2024-09-14T12:43:05.603542+0000","last_clean":"2024-09-14T12:43:05.603542+0000","last_became_active":"2024-09-14T10:49:29.379942+0000","last_became_peered":"2024-09-14T10:49:29.379942+0000","last_unstale":"2024-09-14T12:43:05.603542+0000","last_undegraded":"2024-09-14T12:43:05.603542+0000","last_fullsized":"2024-09-14T12:43:05.603542+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:50.784831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55454,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":936,"num_write":380,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490245+0000","last_change":"2024-09-14T10:49:31.430688+0000","last_active":"2024-09-14T12:41:01.490245+0000","last_peered":"2024-09-14T12:41:01.490245+0000","last_clean":"2024-09-14T12:41:01.490245+0000","last_became_active":"2024-09-14T10:49:31.424882+0000","last_became_peered":"2024-09-14T10:49:31.424882+0000","last_unstale":"2024-09-14T12:41:01.490245+0000","last_undegraded":"2024-09-14T12:41:01.490245+0000","last_fullsized":"2024-09-14T12:41:01.490245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:10.035901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'115","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.540999+0000","last_change":"2024-09-14T10:49:33.469121+0000","last_active":"2024-09-14T12:41:29.540999+0000","last_peered":"2024-09-14T12:41:29.540999+0000","last_clean":"2024-09-14T12:41:29.540999+0000","last_became_active":"2024-09-14T10:49:33.468026+0000","last_became_peered":"2024-09-14T10:49:33.468026+0000","last_unstale":"2024-09-14T12:41:29.540999+0000","last_undegraded":"2024-09-14T12:41:29.540999+0000","last_fullsized":"2024-09-14T12:41:29.540999+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:54.591274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":167,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'978","reported_seq":2671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.736717+0000","last_change":"2024-09-14T10:49:25.386916+0000","last_active":"2024-09-14T12:41:23.736717+0000","last_peered":"2024-09-14T12:41:23.736717+0000","last_clean":"2024-09-14T12:41:23.736717+0000","last_became_active":"2024-09-14T10:49:25.386168+0000","last_became_peered":"2024-09-14T10:49:25.386168+0000","last_unstale":"2024-09-14T12:41:23.736717+0000","last_undegraded":"2024-09-14T12:41:23.736717+0000","last_fullsized":"2024-09-14T12:41:23.736717+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":900,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.415912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4881,"num_read_kb":4356,"num_write":1346,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'270","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360047+0000","last_change":"2024-09-14T10:49:23.368770+0000","last_active":"2024-09-14T12:41:55.360047+0000","last_peered":"2024-09-14T12:41:55.360047+0000","last_clean":"2024-09-14T12:41:55.360047+0000","last_became_active":"2024-09-14T10:49:23.367940+0000","last_became_peered":"2024-09-14T10:49:23.367940+0000","last_unstale":"2024-09-14T12:41:55.360047+0000","last_undegraded":"2024-09-14T12:41:55.360047+0000","last_fullsized":"2024-09-14T12:41:55.360047+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:45.609107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4273589,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":524,"num_read_kb":29389,"num_write":999,"num_write_kb":29053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549364+0000","last_change":"2024-09-14T10:49:27.381081+0000","last_active":"2024-09-14T12:40:40.549364+0000","last_peered":"2024-09-14T12:40:40.549364+0000","last_clean":"2024-09-14T12:40:40.549364+0000","last_became_active":"2024-09-14T10:49:27.380333+0000","last_became_peered":"2024-09-14T10:49:27.380333+0000","last_unstale":"2024-09-14T12:40:40.549364+0000","last_undegraded":"2024-09-14T12:40:40.549364+0000","last_fullsized":"2024-09-14T12:40:40.549364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:32.329024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'239","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561664+0000","last_change":"2024-09-14T10:49:29.378365+0000","last_active":"2024-09-14T12:42:01.561664+0000","last_peered":"2024-09-14T12:42:01.561664+0000","last_clean":"2024-09-14T12:42:01.561664+0000","last_became_active":"2024-09-14T10:49:29.377643+0000","last_became_peered":"2024-09-14T10:49:29.377643+0000","last_unstale":"2024-09-14T12:42:01.561664+0000","last_undegraded":"2024-09-14T12:42:01.561664+0000","last_fullsized":"2024-09-14T12:42:01.561664+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:11.214340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51632,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":376,"num_read_kb":788,"num_write":302,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468822+0000","last_change":"2024-09-14T10:49:31.431402+0000","last_active":"2024-09-14T12:39:36.468822+0000","last_peered":"2024-09-14T12:39:36.468822+0000","last_clean":"2024-09-14T12:39:36.468822+0000","last_became_active":"2024-09-14T10:49:31.430693+0000","last_became_peered":"2024-09-14T10:49:31.430693+0000","last_unstale":"2024-09-14T12:39:36.468822+0000","last_undegraded":"2024-09-14T12:39:36.468822+0000","last_fullsized":"2024-09-14T12:39:36.468822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:32.715814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'154","reported_seq":1639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.449796+0000","last_change":"2024-09-14T10:49:33.476298+0000","last_active":"2024-09-14T12:42:24.449796+0000","last_peered":"2024-09-14T12:42:24.449796+0000","last_clean":"2024-09-14T12:42:24.449796+0000","last_became_active":"2024-09-14T10:49:33.475592+0000","last_became_peered":"2024-09-14T10:49:33.475592+0000","last_unstale":"2024-09-14T12:42:24.449796+0000","last_undegraded":"2024-09-14T12:42:24.449796+0000","last_fullsized":"2024-09-14T12:42:24.449796+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:10.319176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1153,"num_read_kb":1151,"num_write":333,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'1200","reported_seq":2911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.582879+0000","last_change":"2024-09-14T10:49:25.362578+0000","last_active":"2024-09-14T12:41:29.582879+0000","last_peered":"2024-09-14T12:41:29.582879+0000","last_clean":"2024-09-14T12:41:29.582879+0000","last_became_active":"2024-09-14T10:49:25.362059+0000","last_became_peered":"2024-09-14T10:49:25.362059+0000","last_unstale":"2024-09-14T12:41:29.582879+0000","last_undegraded":"2024-09-14T12:41:29.582879+0000","last_fullsized":"2024-09-14T12:41:29.582879+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:36.132405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5522,"num_read_kb":4921,"num_write":1640,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'338","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360131+0000","last_change":"2024-09-14T10:49:23.382568+0000","last_active":"2024-09-14T12:41:55.360131+0000","last_peered":"2024-09-14T12:41:55.360131+0000","last_clean":"2024-09-14T12:41:55.360131+0000","last_became_active":"2024-09-14T10:49:23.381620+0000","last_became_peered":"2024-09-14T10:49:23.381620+0000","last_unstale":"2024-09-14T12:41:55.360131+0000","last_undegraded":"2024-09-14T12:41:55.360131+0000","last_fullsized":"2024-09-14T12:41:55.360131+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:07.597062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381662,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":674,"num_read_kb":34199,"num_write":1177,"num_write_kb":46564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:10.577149+0000","last_change":"2024-09-14T10:49:27.373477+0000","last_active":"2024-09-14T12:41:10.577149+0000","last_peered":"2024-09-14T12:41:10.577149+0000","last_clean":"2024-09-14T12:41:10.577149+0000","last_became_active":"2024-09-14T10:49:27.372685+0000","last_became_peered":"2024-09-14T10:49:27.372685+0000","last_unstale":"2024-09-14T12:41:10.577149+0000","last_undegraded":"2024-09-14T12:41:10.577149+0000","last_fullsized":"2024-09-14T12:41:10.577149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:18.351337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'326","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506246+0000","last_change":"2024-09-14T10:49:29.397492+0000","last_active":"2024-09-14T12:42:01.506246+0000","last_peered":"2024-09-14T12:42:01.506246+0000","last_clean":"2024-09-14T12:42:01.506246+0000","last_became_active":"2024-09-14T10:49:29.396379+0000","last_became_peered":"2024-09-14T10:49:29.396379+0000","last_unstale":"2024-09-14T12:42:01.506246+0000","last_undegraded":"2024-09-14T12:42:01.506246+0000","last_fullsized":"2024-09-14T12:42:01.506246+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:50.814297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59903,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":539,"num_read_kb":1024,"num_write":426,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.556297+0000","last_change":"2024-09-14T10:49:31.420969+0000","last_active":"2024-09-14T12:39:35.556297+0000","last_peered":"2024-09-14T12:39:35.556297+0000","last_clean":"2024-09-14T12:39:35.556297+0000","last_became_active":"2024-09-14T10:49:31.418819+0000","last_became_peered":"2024-09-14T10:49:31.418819+0000","last_unstale":"2024-09-14T12:39:35.556297+0000","last_undegraded":"2024-09-14T12:39:35.556297+0000","last_fullsized":"2024-09-14T12:39:35.556297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:53.067509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'132","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.601534+0000","last_change":"2024-09-14T10:49:33.477067+0000","last_active":"2024-09-14T12:43:47.601534+0000","last_peered":"2024-09-14T12:43:47.601534+0000","last_clean":"2024-09-14T12:43:47.601534+0000","last_became_active":"2024-09-14T10:49:33.476455+0000","last_became_peered":"2024-09-14T10:49:33.476455+0000","last_unstale":"2024-09-14T12:43:47.601534+0000","last_undegraded":"2024-09-14T12:43:47.601534+0000","last_fullsized":"2024-09-14T12:43:47.601534+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:57.442153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":173,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'504","reported_seq":2191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.582161+0000","last_change":"2024-09-14T10:49:25.374531+0000","last_active":"2024-09-14T12:41:29.582161+0000","last_peered":"2024-09-14T12:41:29.582161+0000","last_clean":"2024-09-14T12:41:29.582161+0000","last_became_active":"2024-09-14T10:49:25.373337+0000","last_became_peered":"2024-09-14T10:49:25.373337+0000","last_unstale":"2024-09-14T12:41:29.582161+0000","last_undegraded":"2024-09-14T12:41:29.582161+0000","last_fullsized":"2024-09-14T12:41:29.582161+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:13.554009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2857,"num_read_kb":2693,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'281","reported_seq":954,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:46.809140+0000","last_change":"2024-09-14T10:49:23.378184+0000","last_active":"2024-09-14T12:43:46.809140+0000","last_peered":"2024-09-14T12:43:46.809140+0000","last_clean":"2024-09-14T12:43:46.809140+0000","last_became_active":"2024-09-14T10:49:23.377766+0000","last_became_peered":"2024-09-14T10:49:23.377766+0000","last_unstale":"2024-09-14T12:43:46.809140+0000","last_undegraded":"2024-09-14T12:43:46.809140+0000","last_fullsized":"2024-09-14T12:43:46.809140+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:23.916084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11876760,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":548,"num_read_kb":20990,"num_write":989,"num_write_kb":39444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'622","reported_seq":2307,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.828646+0000","last_change":"2024-09-14T10:49:25.376291+0000","last_active":"2024-09-14T12:41:11.828646+0000","last_peered":"2024-09-14T12:41:11.828646+0000","last_clean":"2024-09-14T12:41:11.828646+0000","last_became_active":"2024-09-14T10:49:25.375595+0000","last_became_peered":"2024-09-14T10:49:25.375595+0000","last_unstale":"2024-09-14T12:41:11.828646+0000","last_undegraded":"2024-09-14T12:41:11.828646+0000","last_fullsized":"2024-09-14T12:41:11.828646+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:54.871887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3344,"num_read_kb":3023,"num_write":799,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'292","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.677452+0000","last_change":"2024-09-14T10:49:23.392114+0000","last_active":"2024-09-14T12:44:04.677452+0000","last_peered":"2024-09-14T12:44:04.677452+0000","last_clean":"2024-09-14T12:44:04.677452+0000","last_became_active":"2024-09-14T10:49:23.390456+0000","last_became_peered":"2024-09-14T10:49:23.390456+0000","last_unstale":"2024-09-14T12:44:04.677452+0000","last_undegraded":"2024-09-14T12:44:04.677452+0000","last_fullsized":"2024-09-14T12:44:04.677452+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:19.921702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190342,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":449,"num_read_kb":9557,"num_write":874,"num_write_kb":19994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'455","reported_seq":2085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.608380+0000","last_change":"2024-09-14T10:49:25.377312+0000","last_active":"2024-09-14T12:43:47.608380+0000","last_peered":"2024-09-14T12:43:47.608380+0000","last_clean":"2024-09-14T12:43:47.608380+0000","last_became_active":"2024-09-14T10:49:25.372436+0000","last_became_peered":"2024-09-14T10:49:25.372436+0000","last_unstale":"2024-09-14T12:43:47.608380+0000","last_undegraded":"2024-09-14T12:43:47.608380+0000","last_fullsized":"2024-09-14T12:43:47.608380+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:05.450288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2453,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'274","reported_seq":970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504696+0000","last_change":"2024-09-14T10:49:23.395538+0000","last_active":"2024-09-14T12:41:56.504696+0000","last_peered":"2024-09-14T12:41:56.504696+0000","last_clean":"2024-09-14T12:41:56.504696+0000","last_became_active":"2024-09-14T10:49:23.395161+0000","last_became_peered":"2024-09-14T10:49:23.395161+0000","last_unstale":"2024-09-14T12:41:56.504696+0000","last_undegraded":"2024-09-14T12:41:56.504696+0000","last_fullsized":"2024-09-14T12:41:56.504696+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:29.846931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2318602,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":620,"num_read_kb":8858,"num_write":968,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'753","reported_seq":2450,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.132003+0000","last_change":"2024-09-14T10:49:25.391763+0000","last_active":"2024-09-14T12:42:22.132003+0000","last_peered":"2024-09-14T12:42:22.132003+0000","last_clean":"2024-09-14T12:42:22.132003+0000","last_became_active":"2024-09-14T10:49:25.390167+0000","last_became_peered":"2024-09-14T10:49:25.390167+0000","last_unstale":"2024-09-14T12:42:22.132003+0000","last_undegraded":"2024-09-14T12:42:22.132003+0000","last_fullsized":"2024-09-14T12:42:22.132003+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.035163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3780,"num_read_kb":3460,"num_write":968,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'297","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.046545+0000","last_change":"2024-09-14T10:49:23.375090+0000","last_active":"2024-09-14T12:41:06.046545+0000","last_peered":"2024-09-14T12:41:06.046545+0000","last_clean":"2024-09-14T12:41:06.046545+0000","last_became_active":"2024-09-14T10:49:23.374332+0000","last_became_peered":"2024-09-14T10:49:23.374332+0000","last_unstale":"2024-09-14T12:41:06.046545+0000","last_undegraded":"2024-09-14T12:41:06.046545+0000","last_fullsized":"2024-09-14T12:41:06.046545+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:00.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779726,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":610,"num_read_kb":1430,"num_write":1197,"num_write_kb":16611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'435","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.715675+0000","last_change":"2024-09-14T10:49:25.391424+0000","last_active":"2024-09-14T12:42:31.715675+0000","last_peered":"2024-09-14T12:42:31.715675+0000","last_clean":"2024-09-14T12:42:31.715675+0000","last_became_active":"2024-09-14T10:49:25.390444+0000","last_became_peered":"2024-09-14T10:49:25.390444+0000","last_unstale":"2024-09-14T12:42:31.715675+0000","last_undegraded":"2024-09-14T12:42:31.715675+0000","last_fullsized":"2024-09-14T12:42:31.715675+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:26.275135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2280,"num_write":506,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'263","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.534070+0000","last_change":"2024-09-14T10:49:23.365856+0000","last_active":"2024-09-14T12:39:56.534070+0000","last_peered":"2024-09-14T12:39:56.534070+0000","last_clean":"2024-09-14T12:39:56.534070+0000","last_became_active":"2024-09-14T10:49:23.365007+0000","last_became_peered":"2024-09-14T10:49:23.365007+0000","last_unstale":"2024-09-14T12:39:56.534070+0000","last_undegraded":"2024-09-14T12:39:56.534070+0000","last_fullsized":"2024-09-14T12:39:56.534070+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:22.123987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28000,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":465,"num_read_kb":40509,"num_write":970,"num_write_kb":34103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'617","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.811795+0000","last_change":"2024-09-14T10:49:25.381143+0000","last_active":"2024-09-14T12:41:55.811795+0000","last_peered":"2024-09-14T12:41:55.811795+0000","last_clean":"2024-09-14T12:41:55.811795+0000","last_became_active":"2024-09-14T10:49:25.380751+0000","last_became_peered":"2024-09-14T10:49:25.380751+0000","last_unstale":"2024-09-14T12:41:55.811795+0000","last_undegraded":"2024-09-14T12:41:55.811795+0000","last_fullsized":"2024-09-14T12:41:55.811795+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:26.129271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3385,"num_read_kb":3142,"num_write":784,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'303","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.663098+0000","last_change":"2024-09-14T10:49:23.367673+0000","last_active":"2024-09-14T12:39:56.663098+0000","last_peered":"2024-09-14T12:39:56.663098+0000","last_clean":"2024-09-14T12:39:56.663098+0000","last_became_active":"2024-09-14T10:49:23.366946+0000","last_became_peered":"2024-09-14T10:49:23.366946+0000","last_unstale":"2024-09-14T12:39:56.663098+0000","last_undegraded":"2024-09-14T12:39:56.663098+0000","last_fullsized":"2024-09-14T12:39:56.663098+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:45.550841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10887879,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":574,"num_read_kb":15337,"num_write":1132,"num_write_kb":33762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'817","reported_seq":2544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.209601+0000","last_change":"2024-09-14T10:49:25.395514+0000","last_active":"2024-09-14T12:42:22.209601+0000","last_peered":"2024-09-14T12:42:22.209601+0000","last_clean":"2024-09-14T12:42:22.209601+0000","last_became_active":"2024-09-14T10:49:25.394994+0000","last_became_peered":"2024-09-14T10:49:25.394994+0000","last_unstale":"2024-09-14T12:42:22.209601+0000","last_undegraded":"2024-09-14T12:42:22.209601+0000","last_fullsized":"2024-09-14T12:42:22.209601+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:10.461194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4031,"num_read_kb":3664,"num_write":1069,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'333","reported_seq":1182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142473+0000","last_change":"2024-09-14T10:49:23.373580+0000","last_active":"2024-09-14T12:39:56.142473+0000","last_peered":"2024-09-14T12:39:56.142473+0000","last_clean":"2024-09-14T12:39:56.142473+0000","last_became_active":"2024-09-14T10:49:23.373080+0000","last_became_peered":"2024-09-14T10:49:23.373080+0000","last_unstale":"2024-09-14T12:39:56.142473+0000","last_undegraded":"2024-09-14T12:39:56.142473+0000","last_fullsized":"2024-09-14T12:39:56.142473+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:31.818739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8600715,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1360,"num_read_kb":12734,"num_write":1166,"num_write_kb":19451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'534","reported_seq":2270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568255+0000","last_change":"2024-09-14T10:49:25.376719+0000","last_active":"2024-09-14T12:41:55.568255+0000","last_peered":"2024-09-14T12:41:55.568255+0000","last_clean":"2024-09-14T12:41:55.568255+0000","last_became_active":"2024-09-14T10:49:25.375465+0000","last_became_peered":"2024-09-14T10:49:25.375465+0000","last_unstale":"2024-09-14T12:41:55.568255+0000","last_undegraded":"2024-09-14T12:41:55.568255+0000","last_fullsized":"2024-09-14T12:41:55.568255+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.679259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2646,"num_write":644,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'278","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550380+0000","last_change":"2024-09-14T10:49:23.378694+0000","last_active":"2024-09-14T12:39:55.550380+0000","last_peered":"2024-09-14T12:39:55.550380+0000","last_clean":"2024-09-14T12:39:55.550380+0000","last_became_active":"2024-09-14T10:49:23.377964+0000","last_became_peered":"2024-09-14T10:49:23.377964+0000","last_unstale":"2024-09-14T12:39:55.550380+0000","last_undegraded":"2024-09-14T12:39:55.550380+0000","last_fullsized":"2024-09-14T12:39:55.550380+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:24.829760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4248428,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":523,"num_read_kb":6819,"num_write":1034,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'851","reported_seq":2405,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.209489+0000","last_change":"2024-09-14T10:49:25.387331+0000","last_active":"2024-09-14T12:42:22.209489+0000","last_peered":"2024-09-14T12:42:22.209489+0000","last_clean":"2024-09-14T12:42:22.209489+0000","last_became_active":"2024-09-14T10:49:25.386541+0000","last_became_peered":"2024-09-14T10:49:25.386541+0000","last_unstale":"2024-09-14T12:42:22.209489+0000","last_undegraded":"2024-09-14T12:42:22.209489+0000","last_fullsized":"2024-09-14T12:42:22.209489+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:37.887330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3987,"num_read_kb":3560,"num_write":1145,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'327","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:39.983841+0000","last_change":"2024-09-14T10:49:23.387632+0000","last_active":"2024-09-14T12:40:39.983841+0000","last_peered":"2024-09-14T12:40:39.983841+0000","last_clean":"2024-09-14T12:40:39.983841+0000","last_became_active":"2024-09-14T10:49:23.387245+0000","last_became_peered":"2024-09-14T10:49:23.387245+0000","last_unstale":"2024-09-14T12:40:39.983841+0000","last_undegraded":"2024-09-14T12:40:39.983841+0000","last_fullsized":"2024-09-14T12:40:39.983841+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:39.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8100655,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":574,"num_read_kb":46177,"num_write":1211,"num_write_kb":35513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'848","reported_seq":2611,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.452842+0000","last_change":"2024-09-14T10:49:25.374040+0000","last_active":"2024-09-14T12:42:29.452842+0000","last_peered":"2024-09-14T12:42:29.452842+0000","last_clean":"2024-09-14T12:42:29.452842+0000","last_became_active":"2024-09-14T10:49:25.373511+0000","last_became_peered":"2024-09-14T10:49:25.373511+0000","last_unstale":"2024-09-14T12:42:29.452842+0000","last_undegraded":"2024-09-14T12:42:29.452842+0000","last_fullsized":"2024-09-14T12:42:29.452842+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:06.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4179,"num_read_kb":3797,"num_write":1119,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'304","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.546496+0000","last_change":"2024-09-14T10:49:23.378107+0000","last_active":"2024-09-14T12:39:40.546496+0000","last_peered":"2024-09-14T12:39:40.546496+0000","last_clean":"2024-09-14T12:39:40.546496+0000","last_became_active":"2024-09-14T10:49:23.377218+0000","last_became_peered":"2024-09-14T10:49:23.377218+0000","last_unstale":"2024-09-14T12:39:40.546496+0000","last_undegraded":"2024-09-14T12:39:40.546496+0000","last_fullsized":"2024-09-14T12:39:40.546496+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:31.856619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9551716,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":579,"num_read_kb":6958,"num_write":1125,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'524","reported_seq":2129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.731901+0000","last_change":"2024-09-14T10:49:25.395953+0000","last_active":"2024-09-14T12:41:23.731901+0000","last_peered":"2024-09-14T12:41:23.731901+0000","last_clean":"2024-09-14T12:41:23.731901+0000","last_became_active":"2024-09-14T10:49:25.394237+0000","last_became_peered":"2024-09-14T10:49:25.394237+0000","last_unstale":"2024-09-14T12:41:23.731901+0000","last_undegraded":"2024-09-14T12:41:23.731901+0000","last_fullsized":"2024-09-14T12:41:23.731901+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:13.449753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2610,"num_write":682,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'307","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.535444+0000","last_change":"2024-09-14T10:49:23.372390+0000","last_active":"2024-09-14T12:39:40.535444+0000","last_peered":"2024-09-14T12:39:40.535444+0000","last_clean":"2024-09-14T12:39:40.535444+0000","last_became_active":"2024-09-14T10:49:23.371845+0000","last_became_peered":"2024-09-14T10:49:23.371845+0000","last_unstale":"2024-09-14T12:39:40.535444+0000","last_undegraded":"2024-09-14T12:39:40.535444+0000","last_fullsized":"2024-09-14T12:39:40.535444+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:14.322795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7346908,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":665,"num_read_kb":30321,"num_write":1104,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'407","reported_seq":1828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.684104+0000","last_change":"2024-09-14T10:49:25.375748+0000","last_active":"2024-09-14T12:42:31.684104+0000","last_peered":"2024-09-14T12:42:31.684104+0000","last_clean":"2024-09-14T12:42:31.684104+0000","last_became_active":"2024-09-14T10:49:25.375374+0000","last_became_peered":"2024-09-14T10:49:25.375374+0000","last_unstale":"2024-09-14T12:42:31.684104+0000","last_undegraded":"2024-09-14T12:42:31.684104+0000","last_fullsized":"2024-09-14T12:42:31.684104+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:51.858708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2030,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'313","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.449533+0000","last_change":"2024-09-14T10:49:23.373160+0000","last_active":"2024-09-14T12:41:16.449533+0000","last_peered":"2024-09-14T12:41:16.449533+0000","last_clean":"2024-09-14T12:41:16.449533+0000","last_became_active":"2024-09-14T10:49:23.371987+0000","last_became_peered":"2024-09-14T10:49:23.371987+0000","last_unstale":"2024-09-14T12:41:16.449533+0000","last_undegraded":"2024-09-14T12:41:16.449533+0000","last_fullsized":"2024-09-14T12:41:16.449533+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:57.645505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18831056,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":645,"num_read_kb":54430,"num_write":1094,"num_write_kb":38478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'764","reported_seq":2315,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.401581+0000","last_change":"2024-09-14T10:49:25.404779+0000","last_active":"2024-09-14T12:42:29.401581+0000","last_peered":"2024-09-14T12:42:29.401581+0000","last_clean":"2024-09-14T12:42:29.401581+0000","last_became_active":"2024-09-14T10:49:25.404302+0000","last_became_peered":"2024-09-14T10:49:25.404302+0000","last_unstale":"2024-09-14T12:42:29.401581+0000","last_undegraded":"2024-09-14T12:42:29.401581+0000","last_fullsized":"2024-09-14T12:42:29.401581+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.123156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3673,"num_read_kb":3318,"num_write":995,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'315","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782950+0000","last_change":"2024-09-14T10:49:23.373328+0000","last_active":"2024-09-14T12:39:40.782950+0000","last_peered":"2024-09-14T12:39:40.782950+0000","last_clean":"2024-09-14T12:39:40.782950+0000","last_became_active":"2024-09-14T10:49:23.372362+0000","last_became_peered":"2024-09-14T10:49:23.372362+0000","last_unstale":"2024-09-14T12:39:40.782950+0000","last_undegraded":"2024-09-14T12:39:40.782950+0000","last_fullsized":"2024-09-14T12:39:40.782950+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:33.274164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5596178,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":526,"num_read_kb":10747,"num_write":1122,"num_write_kb":31883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"267'887","reported_seq":2536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.611847+0000","last_change":"2024-09-14T10:49:25.379008+0000","last_active":"2024-09-14T12:43:47.611847+0000","last_peered":"2024-09-14T12:43:47.611847+0000","last_clean":"2024-09-14T12:43:47.611847+0000","last_became_active":"2024-09-14T10:49:25.378231+0000","last_became_peered":"2024-09-14T10:49:25.378231+0000","last_unstale":"2024-09-14T12:43:47.611847+0000","last_undegraded":"2024-09-14T12:43:47.611847+0000","last_fullsized":"2024-09-14T12:43:47.611847+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:27.346745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4260,"num_read_kb":3817,"num_write":1188,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'318","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.415409+0000","last_change":"2024-09-14T10:49:23.396632+0000","last_active":"2024-09-14T12:42:05.415409+0000","last_peered":"2024-09-14T12:42:05.415409+0000","last_clean":"2024-09-14T12:42:05.415409+0000","last_became_active":"2024-09-14T10:49:23.396179+0000","last_became_peered":"2024-09-14T10:49:23.396179+0000","last_unstale":"2024-09-14T12:42:05.415409+0000","last_undegraded":"2024-09-14T12:42:05.415409+0000","last_fullsized":"2024-09-14T12:42:05.415409+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:19.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12572263,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":970,"num_read_kb":35151,"num_write":1188,"num_write_kb":27361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'452","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.639145+0000","last_change":"2024-09-14T10:49:25.387446+0000","last_active":"2024-09-14T12:43:47.639145+0000","last_peered":"2024-09-14T12:43:47.639145+0000","last_clean":"2024-09-14T12:43:47.639145+0000","last_became_active":"2024-09-14T10:49:25.386602+0000","last_became_peered":"2024-09-14T10:49:25.386602+0000","last_unstale":"2024-09-14T12:43:47.639145+0000","last_undegraded":"2024-09-14T12:43:47.639145+0000","last_fullsized":"2024-09-14T12:43:47.639145+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:41.415729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2532,"num_read_kb":2369,"num_write":580,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'359","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.738301+0000","last_change":"2024-09-14T10:49:23.370968+0000","last_active":"2024-09-14T12:44:04.738301+0000","last_peered":"2024-09-14T12:44:04.738301+0000","last_clean":"2024-09-14T12:44:04.738301+0000","last_became_active":"2024-09-14T10:49:23.369989+0000","last_became_peered":"2024-09-14T10:49:23.369989+0000","last_unstale":"2024-09-14T12:44:04.738301+0000","last_undegraded":"2024-09-14T12:44:04.738301+0000","last_fullsized":"2024-09-14T12:44:04.738301+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:46.807806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190304,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":690,"num_read_kb":14222,"num_write":1153,"num_write_kb":28974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'1263","reported_seq":2959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:20.544825+0000","last_change":"2024-09-14T10:49:25.408105+0000","last_active":"2024-09-14T12:40:20.544825+0000","last_peered":"2024-09-14T12:40:20.544825+0000","last_clean":"2024-09-14T12:40:20.544825+0000","last_became_active":"2024-09-14T10:49:25.407817+0000","last_became_peered":"2024-09-14T10:49:25.407817+0000","last_unstale":"2024-09-14T12:40:20.544825+0000","last_undegraded":"2024-09-14T12:40:20.544825+0000","last_fullsized":"2024-09-14T12:40:20.544825+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":1200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:28.857748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5850,"num_read_kb":5153,"num_write":1753,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'311","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.497020+0000","last_change":"2024-09-14T10:49:23.366572+0000","last_active":"2024-09-14T12:41:26.497020+0000","last_peered":"2024-09-14T12:41:26.497020+0000","last_clean":"2024-09-14T12:41:26.497020+0000","last_became_active":"2024-09-14T10:49:23.365975+0000","last_became_peered":"2024-09-14T10:49:23.365975+0000","last_unstale":"2024-09-14T12:41:26.497020+0000","last_undegraded":"2024-09-14T12:41:26.497020+0000","last_fullsized":"2024-09-14T12:41:26.497020+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:46.697172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21473224,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":895,"num_read_kb":99658,"num_write":1100,"num_write_kb":35935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'292","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496522+0000","last_change":"2024-09-14T10:49:23.374017+0000","last_active":"2024-09-14T12:41:26.496522+0000","last_peered":"2024-09-14T12:41:26.496522+0000","last_clean":"2024-09-14T12:41:26.496522+0000","last_became_active":"2024-09-14T10:49:23.373652+0000","last_became_peered":"2024-09-14T10:49:23.373652+0000","last_unstale":"2024-09-14T12:41:26.496522+0000","last_undegraded":"2024-09-14T12:41:26.496522+0000","last_fullsized":"2024-09-14T12:41:26.496522+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:34.956815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272146,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":806,"num_read_kb":808,"num_write":1029,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'429","reported_seq":2023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.767109+0000","last_change":"2024-09-14T10:49:25.400404+0000","last_active":"2024-09-14T12:42:31.767109+0000","last_peered":"2024-09-14T12:42:31.767109+0000","last_clean":"2024-09-14T12:42:31.767109+0000","last_became_active":"2024-09-14T10:49:25.399830+0000","last_became_peered":"2024-09-14T10:49:25.399830+0000","last_unstale":"2024-09-14T12:42:31.767109+0000","last_undegraded":"2024-09-14T12:42:31.767109+0000","last_fullsized":"2024-09-14T12:42:31.767109+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:56.425228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2288,"num_read_kb":2174,"num_write":485,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'285","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.571597+0000","last_change":"2024-09-14T10:49:23.384640+0000","last_active":"2024-09-14T12:41:25.571597+0000","last_peered":"2024-09-14T12:41:25.571597+0000","last_clean":"2024-09-14T12:41:25.571597+0000","last_became_active":"2024-09-14T10:49:23.382302+0000","last_became_peered":"2024-09-14T10:49:23.382302+0000","last_unstale":"2024-09-14T12:41:25.571597+0000","last_undegraded":"2024-09-14T12:41:25.571597+0000","last_fullsized":"2024-09-14T12:41:25.571597+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:19.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14347518,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":781,"num_read_kb":33665,"num_write":989,"num_write_kb":42742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'432","reported_seq":2105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.791117+0000","last_change":"2024-09-14T10:49:25.392230+0000","last_active":"2024-09-14T12:41:16.791117+0000","last_peered":"2024-09-14T12:41:16.791117+0000","last_clean":"2024-09-14T12:41:16.791117+0000","last_became_active":"2024-09-14T10:49:25.391680+0000","last_became_peered":"2024-09-14T10:49:25.391680+0000","last_unstale":"2024-09-14T12:41:16.791117+0000","last_undegraded":"2024-09-14T12:41:16.791117+0000","last_fullsized":"2024-09-14T12:41:16.791117+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:29.701571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2427,"num_read_kb":2321,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10880,"num_read_kb":8996,"num_write":3119,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15325,"num_read_kb":14960,"num_write":17100,"num_write_kb":5007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":539,"ondisk_log_size":539,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1949033,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":20817,"num_read_kb":37788,"num_write":17575,"num_write_kb":12732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3039232,"data_stored":2541282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1723,"ondisk_log_size":1723,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221603,"num_read_kb":202842,"num_write":56199,"num_write_kb":19273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3589,"ondisk_log_size":3589,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":605614295,"num_objects":4263,"num_object_clones":0,"num_object_copies":17052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4263,"num_whiteouts":0,"num_read":40605,"num_read_kb":1985148,"num_write":69552,"num_write_kb":2196624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":822476800,"data_stored":822476800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4145,"ondisk_log_size":4145,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":64559776,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":168154,"num_write":160,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122826752,"data_stored":122815808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":49883808,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":139,"num_read_kb":167578,"num_write":165,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114917376,"data_stored":114907797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510827,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238896,"kb_used_data":139680,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94132944,"statfs":{"total":96636764160,"available":96392134656,"internally_reserved":0,"allocated":143032320,"data_stored":140972101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510825,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":403036,"kb_used_data":128908,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93968804,"statfs":{"total":96636764160,"available":96224055296,"internally_reserved":0,"allocated":132001792,"data_stored":129955770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510828,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":382744,"kb_used_data":162824,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":93989096,"statfs":{"total":96636764160,"available":96244834304,"internally_reserved":0,"allocated":166731776,"data_stored":164671390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225180101},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510829,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413496,"kb_used_data":161576,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93958344,"statfs":{"total":96636764160,"available":96213344256,"internally_reserved":0,"allocated":165453824,"data_stored":163399235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510828,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308284,"kb_used_data":168812,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94063556,"statfs":{"total":96636764160,"available":96321081344,"internally_reserved":0,"allocated":172863488,"data_stored":170844255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510825,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451388,"kb_used_data":131436,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":93920452,"statfs":{"total":96636764160,"available":96174542848,"internally_reserved":0,"allocated":134590464,"data_stored":132523079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":327612869},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510826,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286608,"kb_used_data":156864,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94085232,"statfs":{"total":96636764160,"available":96343277568,"internally_reserved":0,"allocated":160628736,"data_stored":158530254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543533,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250332,"kb_used_data":24792,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94121508,"statfs":{"total":96636764160,"available":96380424192,"internally_reserved":0,"allocated":25387008,"data_stored":23377561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230881738},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":134848512,"data_stored":134848512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":104042496,"data_stored":104042496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":140152832,"data_stored":140152832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":129421312,"data_stored":129421312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":123695104,"data_stored":123695104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":84639744,"data_stored":84639744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86999040,"data_stored":86999040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18677760,"data_stored":18677760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":478941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":478031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":118964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":267778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":389581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":414006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":359552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":34429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12579690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19935232,"data_stored":19935232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18878464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11538432,"data_stored":11537547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18898944,"data_stored":18895722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7929856,"data_stored":7927606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25153536,"data_stored":25153536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5238784,"data_stored":5238784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9453568,"data_stored":9452683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19935232,"data_stored":19932010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19451904,"data_stored":19449654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34148352,"data_stored":34143765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26218496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:44:06.627 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T12:44:06.628 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:44:06.973 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:44:06.984 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T12:44:06.989 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":3711,"stamp":"2024-09-14T12:44:05.142912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":722614847,"num_objects":4778,"num_object_clones":0,"num_object_copies":18082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4778,"num_whiteouts":0,"num_read":312008,"num_read_kb":2588423,"num_write":164013,"num_write_kb":2487467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12825,"ondisk_log_size":12825,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2734784,"kb_used_data":1074892,"kb_used_omap":12,"kb_used_meta":1659699,"kb_avail":752239936,"statfs":{"total":773094113280,"available":770293694464,"internally_reserved":0,"allocated":1100689408,"data_stored":1084273645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1699532336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53624186,"num_objects":-178,"num_object_clones":0,"num_object_copies":-694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-178,"num_whiteouts":0,"num_read":262,"num_read_kb":858,"num_write":215,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008309"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789873+0000","last_change":"2024-09-14T11:40:08.952510+0000","last_active":"2024-09-14T12:40:10.789873+0000","last_peered":"2024-09-14T12:40:10.789873+0000","last_clean":"2024-09-14T12:40:10.789873+0000","last_became_active":"2024-09-14T11:40:08.951795+0000","last_became_peered":"2024-09-14T11:40:08.951795+0000","last_unstale":"2024-09-14T12:40:10.789873+0000","last_undegraded":"2024-09-14T12:40:10.789873+0000","last_fullsized":"2024-09-14T12:40:10.789873+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:34.432945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538895+0000","last_change":"2024-09-14T11:12:26.252261+0000","last_active":"2024-09-14T12:39:55.538895+0000","last_peered":"2024-09-14T12:39:55.538895+0000","last_clean":"2024-09-14T12:39:55.538895+0000","last_became_active":"2024-09-14T11:12:26.251656+0000","last_became_peered":"2024-09-14T11:12:26.251656+0000","last_unstale":"2024-09-14T12:39:55.538895+0000","last_undegraded":"2024-09-14T12:39:55.538895+0000","last_fullsized":"2024-09-14T12:39:55.538895+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:01.924216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731815+0000","last_change":"2024-09-14T11:12:19.109493+0000","last_active":"2024-09-14T12:39:49.731815+0000","last_peered":"2024-09-14T12:39:49.731815+0000","last_clean":"2024-09-14T12:39:49.731815+0000","last_became_active":"2024-09-14T11:12:19.108050+0000","last_became_peered":"2024-09-14T11:12:19.108050+0000","last_unstale":"2024-09-14T12:39:49.731815+0000","last_undegraded":"2024-09-14T12:39:49.731815+0000","last_fullsized":"2024-09-14T12:39:49.731815+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:46.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'28","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.565399+0000","last_change":"2024-09-14T11:06:29.522001+0000","last_active":"2024-09-14T12:40:15.565399+0000","last_peered":"2024-09-14T12:40:15.565399+0000","last_clean":"2024-09-14T12:40:15.565399+0000","last_became_active":"2024-09-14T11:06:29.521269+0000","last_became_peered":"2024-09-14T11:06:29.521269+0000","last_unstale":"2024-09-14T12:40:15.565399+0000","last_undegraded":"2024-09-14T12:40:15.565399+0000","last_fullsized":"2024-09-14T12:40:15.565399+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:36.067094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":165,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537448+0000","last_change":"2024-09-14T11:40:08.947504+0000","last_active":"2024-09-14T12:40:11.537448+0000","last_peered":"2024-09-14T12:40:11.537448+0000","last_clean":"2024-09-14T12:40:11.537448+0000","last_became_active":"2024-09-14T11:40:08.946878+0000","last_became_peered":"2024-09-14T11:40:08.946878+0000","last_unstale":"2024-09-14T12:40:11.537448+0000","last_undegraded":"2024-09-14T12:40:11.537448+0000","last_fullsized":"2024-09-14T12:40:11.537448+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:13.424208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142354+0000","last_change":"2024-09-14T11:12:26.251932+0000","last_active":"2024-09-14T12:39:56.142354+0000","last_peered":"2024-09-14T12:39:56.142354+0000","last_clean":"2024-09-14T12:39:56.142354+0000","last_became_active":"2024-09-14T11:12:26.251518+0000","last_became_peered":"2024-09-14T11:12:26.251518+0000","last_unstale":"2024-09-14T12:39:56.142354+0000","last_undegraded":"2024-09-14T12:39:56.142354+0000","last_fullsized":"2024-09-14T12:39:56.142354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:18.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.549011+0000","last_change":"2024-09-14T11:12:19.078874+0000","last_active":"2024-09-14T12:39:50.549011+0000","last_peered":"2024-09-14T12:39:50.549011+0000","last_clean":"2024-09-14T12:39:50.549011+0000","last_became_active":"2024-09-14T11:12:19.078164+0000","last_became_peered":"2024-09-14T11:12:19.078164+0000","last_unstale":"2024-09-14T12:39:50.549011+0000","last_undegraded":"2024-09-14T12:39:50.549011+0000","last_fullsized":"2024-09-14T12:39:50.549011+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:07.851997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'14","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.573976+0000","last_change":"2024-09-14T11:06:29.539883+0000","last_active":"2024-09-14T12:40:55.573976+0000","last_peered":"2024-09-14T12:40:55.573976+0000","last_clean":"2024-09-14T12:40:55.573976+0000","last_became_active":"2024-09-14T11:06:29.538616+0000","last_became_peered":"2024-09-14T11:06:29.538616+0000","last_unstale":"2024-09-14T12:40:55.573976+0000","last_undegraded":"2024-09-14T12:40:55.573976+0000","last_fullsized":"2024-09-14T12:40:55.573976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:48.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":63,"num_write":44,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.548159+0000","last_change":"2024-09-14T11:40:08.943797+0000","last_active":"2024-09-14T12:40:35.548159+0000","last_peered":"2024-09-14T12:40:35.548159+0000","last_clean":"2024-09-14T12:40:35.548159+0000","last_became_active":"2024-09-14T11:40:08.942721+0000","last_became_peered":"2024-09-14T11:40:08.942721+0000","last_unstale":"2024-09-14T12:40:35.548159+0000","last_undegraded":"2024-09-14T12:40:35.548159+0000","last_fullsized":"2024-09-14T12:40:35.548159+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:17.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550343+0000","last_change":"2024-09-14T11:12:26.228979+0000","last_active":"2024-09-14T12:39:55.550343+0000","last_peered":"2024-09-14T12:39:55.550343+0000","last_clean":"2024-09-14T12:39:55.550343+0000","last_became_active":"2024-09-14T11:12:26.228172+0000","last_became_peered":"2024-09-14T11:12:26.228172+0000","last_unstale":"2024-09-14T12:39:55.550343+0000","last_undegraded":"2024-09-14T12:39:55.550343+0000","last_fullsized":"2024-09-14T12:39:55.550343+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:34.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:34.769431+0000","last_change":"2024-09-14T11:12:19.111973+0000","last_active":"2024-09-14T12:42:34.769431+0000","last_peered":"2024-09-14T12:42:34.769431+0000","last_clean":"2024-09-14T12:42:34.769431+0000","last_became_active":"2024-09-14T11:12:19.110542+0000","last_became_peered":"2024-09-14T11:12:19.110542+0000","last_unstale":"2024-09-14T12:42:34.769431+0000","last_undegraded":"2024-09-14T12:42:34.769431+0000","last_fullsized":"2024-09-14T12:42:34.769431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.885368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555139+0000","last_change":"2024-09-14T11:06:29.532390+0000","last_active":"2024-09-14T12:41:31.555139+0000","last_peered":"2024-09-14T12:41:31.555139+0000","last_clean":"2024-09-14T12:41:31.555139+0000","last_became_active":"2024-09-14T11:06:29.531655+0000","last_became_peered":"2024-09-14T11:06:29.531655+0000","last_unstale":"2024-09-14T12:41:31.555139+0000","last_undegraded":"2024-09-14T12:41:31.555139+0000","last_fullsized":"2024-09-14T12:41:31.555139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:15.026446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":194,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563239+0000","last_change":"2024-09-14T11:40:08.940194+0000","last_active":"2024-09-14T12:40:50.563239+0000","last_peered":"2024-09-14T12:40:50.563239+0000","last_clean":"2024-09-14T12:40:50.563239+0000","last_became_active":"2024-09-14T11:40:08.939509+0000","last_became_peered":"2024-09-14T11:40:08.939509+0000","last_unstale":"2024-09-14T12:40:50.563239+0000","last_undegraded":"2024-09-14T12:40:50.563239+0000","last_fullsized":"2024-09-14T12:40:50.563239+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:14.099727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.562210+0000","last_change":"2024-09-14T11:12:26.231260+0000","last_active":"2024-09-14T12:40:45.562210+0000","last_peered":"2024-09-14T12:40:45.562210+0000","last_clean":"2024-09-14T12:40:45.562210+0000","last_became_active":"2024-09-14T11:12:26.230403+0000","last_became_peered":"2024-09-14T11:12:26.230403+0000","last_unstale":"2024-09-14T12:40:45.562210+0000","last_undegraded":"2024-09-14T12:40:45.562210+0000","last_fullsized":"2024-09-14T12:40:45.562210+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:41.167301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5823147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":7282,"num_write":9,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"267'1","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568418+0000","last_change":"2024-09-14T11:12:19.105819+0000","last_active":"2024-09-14T12:41:55.568418+0000","last_peered":"2024-09-14T12:41:55.568418+0000","last_clean":"2024-09-14T12:41:55.568418+0000","last_became_active":"2024-09-14T11:12:19.105062+0000","last_became_peered":"2024-09-14T11:12:19.105062+0000","last_unstale":"2024-09-14T12:41:55.568418+0000","last_undegraded":"2024-09-14T12:41:55.568418+0000","last_fullsized":"2024-09-14T12:41:55.568418+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:15.694200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'12","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555085+0000","last_change":"2024-09-14T11:06:29.510354+0000","last_active":"2024-09-14T12:41:31.555085+0000","last_peered":"2024-09-14T12:41:31.555085+0000","last_clean":"2024-09-14T12:41:31.555085+0000","last_became_active":"2024-09-14T11:06:29.509556+0000","last_became_peered":"2024-09-14T11:06:29.509556+0000","last_unstale":"2024-09-14T12:41:31.555085+0000","last_undegraded":"2024-09-14T12:41:31.555085+0000","last_fullsized":"2024-09-14T12:41:31.555085+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:51.904786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:19.738657+0000","last_change":"2024-09-14T11:40:08.932176+0000","last_active":"2024-09-14T12:40:19.738657+0000","last_peered":"2024-09-14T12:40:19.738657+0000","last_clean":"2024-09-14T12:40:19.738657+0000","last_became_active":"2024-09-14T11:40:08.927702+0000","last_became_peered":"2024-09-14T11:40:08.927702+0000","last_unstale":"2024-09-14T12:40:19.738657+0000","last_undegraded":"2024-09-14T12:40:19.738657+0000","last_fullsized":"2024-09-14T12:40:19.738657+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:31.907550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782814+0000","last_change":"2024-09-14T11:12:26.219704+0000","last_active":"2024-09-14T12:39:40.782814+0000","last_peered":"2024-09-14T12:39:40.782814+0000","last_clean":"2024-09-14T12:39:40.782814+0000","last_became_active":"2024-09-14T11:12:26.218925+0000","last_became_peered":"2024-09-14T11:12:26.218925+0000","last_unstale":"2024-09-14T12:39:40.782814+0000","last_undegraded":"2024-09-14T12:39:40.782814+0000","last_fullsized":"2024-09-14T12:39:40.782814+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:12.358912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.541766+0000","last_change":"2024-09-14T11:12:19.111180+0000","last_active":"2024-09-14T12:39:20.541766+0000","last_peered":"2024-09-14T12:39:20.541766+0000","last_clean":"2024-09-14T12:39:20.541766+0000","last_became_active":"2024-09-14T11:12:19.110528+0000","last_became_peered":"2024-09-14T11:12:19.110528+0000","last_unstale":"2024-09-14T12:39:20.541766+0000","last_undegraded":"2024-09-14T12:39:20.541766+0000","last_fullsized":"2024-09-14T12:39:20.541766+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:53.395221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1028,"num_write":3,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'15","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555023+0000","last_change":"2024-09-14T11:06:29.539444+0000","last_active":"2024-09-14T12:41:31.555023+0000","last_peered":"2024-09-14T12:41:31.555023+0000","last_clean":"2024-09-14T12:41:31.555023+0000","last_became_active":"2024-09-14T11:06:29.538597+0000","last_became_peered":"2024-09-14T11:06:29.538597+0000","last_unstale":"2024-09-14T12:41:31.555023+0000","last_undegraded":"2024-09-14T12:41:31.555023+0000","last_fullsized":"2024-09-14T12:41:31.555023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:42.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569608+0000","last_change":"2024-09-14T11:40:08.925877+0000","last_active":"2024-09-14T12:40:35.569608+0000","last_peered":"2024-09-14T12:40:35.569608+0000","last_clean":"2024-09-14T12:40:35.569608+0000","last_became_active":"2024-09-14T11:40:08.924934+0000","last_became_peered":"2024-09-14T11:40:08.924934+0000","last_unstale":"2024-09-14T12:40:35.569608+0000","last_undegraded":"2024-09-14T12:40:35.569608+0000","last_fullsized":"2024-09-14T12:40:35.569608+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:38.137144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:26.465943+0000","last_change":"2024-09-14T11:12:26.246400+0000","last_active":"2024-09-14T12:39:26.465943+0000","last_peered":"2024-09-14T12:39:26.465943+0000","last_clean":"2024-09-14T12:39:26.465943+0000","last_became_active":"2024-09-14T11:12:26.245890+0000","last_became_peered":"2024-09-14T11:12:26.245890+0000","last_unstale":"2024-09-14T12:39:26.465943+0000","last_undegraded":"2024-09-14T12:39:26.465943+0000","last_fullsized":"2024-09-14T12:39:26.465943+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:48.151101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468681+0000","last_change":"2024-09-14T11:12:19.109400+0000","last_active":"2024-09-14T12:39:36.468681+0000","last_peered":"2024-09-14T12:39:36.468681+0000","last_clean":"2024-09-14T12:39:36.468681+0000","last_became_active":"2024-09-14T11:12:19.108158+0000","last_became_peered":"2024-09-14T11:12:19.108158+0000","last_unstale":"2024-09-14T12:39:36.468681+0000","last_undegraded":"2024-09-14T12:39:36.468681+0000","last_fullsized":"2024-09-14T12:39:36.468681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:12.518068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'13","reported_seq":104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164957+0000","last_change":"2024-09-14T11:06:29.529584+0000","last_active":"2024-09-14T12:41:31.164957+0000","last_peered":"2024-09-14T12:41:31.164957+0000","last_clean":"2024-09-14T12:41:31.164957+0000","last_became_active":"2024-09-14T11:06:29.525271+0000","last_became_peered":"2024-09-14T11:06:29.525271+0000","last_unstale":"2024-09-14T12:41:31.164957+0000","last_undegraded":"2024-09-14T12:41:31.164957+0000","last_fullsized":"2024-09-14T12:41:31.164957+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:48.747370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.145918+0000","last_change":"2024-09-14T11:40:08.929934+0000","last_active":"2024-09-14T12:40:11.145918+0000","last_peered":"2024-09-14T12:40:11.145918+0000","last_clean":"2024-09-14T12:40:11.145918+0000","last_became_active":"2024-09-14T11:40:08.928406+0000","last_became_peered":"2024-09-14T11:40:08.928406+0000","last_unstale":"2024-09-14T12:40:11.145918+0000","last_undegraded":"2024-09-14T12:40:11.145918+0000","last_fullsized":"2024-09-14T12:40:11.145918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:59.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142297+0000","last_change":"2024-09-14T11:12:26.241901+0000","last_active":"2024-09-14T12:39:56.142297+0000","last_peered":"2024-09-14T12:39:56.142297+0000","last_clean":"2024-09-14T12:39:56.142297+0000","last_became_active":"2024-09-14T11:12:26.241189+0000","last_became_peered":"2024-09-14T11:12:26.241189+0000","last_unstale":"2024-09-14T12:39:56.142297+0000","last_undegraded":"2024-09-14T12:39:56.142297+0000","last_fullsized":"2024-09-14T12:39:56.142297+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:26.882785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.785157+0000","last_change":"2024-09-14T11:12:19.090881+0000","last_active":"2024-09-14T12:39:50.785157+0000","last_peered":"2024-09-14T12:39:50.785157+0000","last_clean":"2024-09-14T12:39:50.785157+0000","last_became_active":"2024-09-14T11:12:19.090134+0000","last_became_peered":"2024-09-14T11:12:19.090134+0000","last_unstale":"2024-09-14T12:39:50.785157+0000","last_undegraded":"2024-09-14T12:39:50.785157+0000","last_fullsized":"2024-09-14T12:39:50.785157+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.751661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195178,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'175","reported_seq":578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:59.747524+0000","last_change":"2024-09-14T11:06:29.533832+0000","last_active":"2024-09-14T12:40:59.747524+0000","last_peered":"2024-09-14T12:40:59.747524+0000","last_clean":"2024-09-14T12:40:59.747524+0000","last_became_active":"2024-09-14T11:06:29.531149+0000","last_became_peered":"2024-09-14T11:06:29.531149+0000","last_unstale":"2024-09-14T12:40:59.747524+0000","last_undegraded":"2024-09-14T12:40:59.747524+0000","last_fullsized":"2024-09-14T12:40:59.747524+0000","mapping_epoch":256,"log_start":"264'100","ondisk_log_start":"264'100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:45.535262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1578,"num_read_kb":1327,"num_write":388,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789984+0000","last_change":"2024-09-14T11:40:08.942903+0000","last_active":"2024-09-14T12:40:10.789984+0000","last_peered":"2024-09-14T12:40:10.789984+0000","last_clean":"2024-09-14T12:40:10.789984+0000","last_became_active":"2024-09-14T11:40:08.942208+0000","last_became_peered":"2024-09-14T11:40:08.942208+0000","last_unstale":"2024-09-14T12:40:10.789984+0000","last_undegraded":"2024-09-14T12:40:10.789984+0000","last_fullsized":"2024-09-14T12:40:10.789984+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:07.315198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.768253+0000","last_change":"2024-09-14T11:12:26.236668+0000","last_active":"2024-09-14T12:42:29.768253+0000","last_peered":"2024-09-14T12:42:29.768253+0000","last_clean":"2024-09-14T12:42:29.768253+0000","last_became_active":"2024-09-14T11:12:26.236221+0000","last_became_peered":"2024-09-14T11:12:26.236221+0000","last_unstale":"2024-09-14T12:42:29.768253+0000","last_undegraded":"2024-09-14T12:42:29.768253+0000","last_fullsized":"2024-09-14T12:42:29.768253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.780862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532656+0000","last_change":"2024-09-14T11:12:19.087602+0000","last_active":"2024-09-14T12:39:51.532656+0000","last_peered":"2024-09-14T12:39:51.532656+0000","last_clean":"2024-09-14T12:39:51.532656+0000","last_became_active":"2024-09-14T11:12:19.086765+0000","last_became_peered":"2024-09-14T11:12:19.086765+0000","last_unstale":"2024-09-14T12:39:51.532656+0000","last_undegraded":"2024-09-14T12:39:51.532656+0000","last_fullsized":"2024-09-14T12:39:51.532656+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.252636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.545007+0000","last_change":"2024-09-14T11:06:29.518739+0000","last_active":"2024-09-14T12:40:46.545007+0000","last_peered":"2024-09-14T12:40:46.545007+0000","last_clean":"2024-09-14T12:40:46.545007+0000","last_became_active":"2024-09-14T11:06:29.518028+0000","last_became_peered":"2024-09-14T11:06:29.518028+0000","last_unstale":"2024-09-14T12:40:46.545007+0000","last_undegraded":"2024-09-14T12:40:46.545007+0000","last_fullsized":"2024-09-14T12:40:46.545007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:31.356112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":96,"num_write":55,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563311+0000","last_change":"2024-09-14T11:40:08.953653+0000","last_active":"2024-09-14T12:40:50.563311+0000","last_peered":"2024-09-14T12:40:50.563311+0000","last_clean":"2024-09-14T12:40:50.563311+0000","last_became_active":"2024-09-14T11:40:08.953030+0000","last_became_peered":"2024-09-14T11:40:08.953030+0000","last_unstale":"2024-09-14T12:40:50.563311+0000","last_undegraded":"2024-09-14T12:40:50.563311+0000","last_fullsized":"2024-09-14T12:40:50.563311+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:54.553294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:29.727366+0000","last_change":"2024-09-14T11:12:26.248644+0000","last_active":"2024-09-14T12:39:29.727366+0000","last_peered":"2024-09-14T12:39:29.727366+0000","last_clean":"2024-09-14T12:39:29.727366+0000","last_became_active":"2024-09-14T11:12:26.247784+0000","last_became_peered":"2024-09-14T11:12:26.247784+0000","last_unstale":"2024-09-14T12:39:29.727366+0000","last_undegraded":"2024-09-14T12:39:29.727366+0000","last_fullsized":"2024-09-14T12:39:29.727366+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:06.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494251+0000","last_change":"2024-09-14T11:12:19.114678+0000","last_active":"2024-09-14T12:41:16.494251+0000","last_peered":"2024-09-14T12:41:16.494251+0000","last_clean":"2024-09-14T12:41:16.494251+0000","last_became_active":"2024-09-14T11:12:19.113431+0000","last_became_peered":"2024-09-14T11:12:19.113431+0000","last_unstale":"2024-09-14T12:41:16.494251+0000","last_undegraded":"2024-09-14T12:41:16.494251+0000","last_fullsized":"2024-09-14T12:41:16.494251+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:46.474061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7166,"num_write":5,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'46","reported_seq":197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571890+0000","last_change":"2024-09-14T11:06:29.532883+0000","last_active":"2024-09-14T12:40:45.571890+0000","last_peered":"2024-09-14T12:40:45.571890+0000","last_clean":"2024-09-14T12:40:45.571890+0000","last_became_active":"2024-09-14T11:06:29.532061+0000","last_became_peered":"2024-09-14T11:06:29.532061+0000","last_unstale":"2024-09-14T12:40:45.571890+0000","last_undegraded":"2024-09-14T12:40:45.571890+0000","last_fullsized":"2024-09-14T12:40:45.571890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:13.641002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":235,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.546149+0000","last_change":"2024-09-14T11:40:08.938546+0000","last_active":"2024-09-14T12:40:51.546149+0000","last_peered":"2024-09-14T12:40:51.546149+0000","last_clean":"2024-09-14T12:40:51.546149+0000","last_became_active":"2024-09-14T11:40:08.937813+0000","last_became_peered":"2024-09-14T11:40:08.937813+0000","last_unstale":"2024-09-14T12:40:51.546149+0000","last_undegraded":"2024-09-14T12:40:51.546149+0000","last_fullsized":"2024-09-14T12:40:51.546149+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:07.510647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.571681+0000","last_change":"2024-09-14T11:12:26.244350+0000","last_active":"2024-09-14T12:41:25.571681+0000","last_peered":"2024-09-14T12:41:25.571681+0000","last_clean":"2024-09-14T12:41:25.571681+0000","last_became_active":"2024-09-14T11:12:26.243612+0000","last_became_peered":"2024-09-14T11:12:26.243612+0000","last_unstale":"2024-09-14T12:41:25.571681+0000","last_undegraded":"2024-09-14T12:41:25.571681+0000","last_fullsized":"2024-09-14T12:41:25.571681+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.954445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14684160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6,"num_read_kb":15364,"num_write":17,"num_write_kb":14340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.778500+0000","last_change":"2024-09-14T11:12:19.104603+0000","last_active":"2024-09-14T12:39:20.778500+0000","last_peered":"2024-09-14T12:39:20.778500+0000","last_clean":"2024-09-14T12:39:20.778500+0000","last_became_active":"2024-09-14T11:12:19.103871+0000","last_became_peered":"2024-09-14T11:12:19.103871+0000","last_unstale":"2024-09-14T12:39:20.778500+0000","last_undegraded":"2024-09-14T12:39:20.778500+0000","last_fullsized":"2024-09-14T12:39:20.778500+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:11.319272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'29","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571849+0000","last_change":"2024-09-14T11:06:29.530922+0000","last_active":"2024-09-14T12:40:45.571849+0000","last_peered":"2024-09-14T12:40:45.571849+0000","last_clean":"2024-09-14T12:40:45.571849+0000","last_became_active":"2024-09-14T11:06:29.529421+0000","last_became_peered":"2024-09-14T11:06:29.529421+0000","last_unstale":"2024-09-14T12:40:45.571849+0000","last_undegraded":"2024-09-14T12:40:45.571849+0000","last_fullsized":"2024-09-14T12:40:45.571849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:42.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":129,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.155363+0000","last_change":"2024-09-14T11:40:08.944753+0000","last_active":"2024-09-14T12:40:51.155363+0000","last_peered":"2024-09-14T12:40:51.155363+0000","last_clean":"2024-09-14T12:40:51.155363+0000","last_became_active":"2024-09-14T11:40:08.944066+0000","last_became_peered":"2024-09-14T11:40:08.944066+0000","last_unstale":"2024-09-14T12:40:51.155363+0000","last_undegraded":"2024-09-14T12:40:51.155363+0000","last_fullsized":"2024-09-14T12:40:51.155363+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:51.071467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:29.727468+0000","last_change":"2024-09-14T11:12:26.225753+0000","last_active":"2024-09-14T12:39:29.727468+0000","last_peered":"2024-09-14T12:39:29.727468+0000","last_clean":"2024-09-14T12:39:29.727468+0000","last_became_active":"2024-09-14T11:12:26.224877+0000","last_became_peered":"2024-09-14T11:12:26.224877+0000","last_unstale":"2024-09-14T12:39:29.727468+0000","last_undegraded":"2024-09-14T12:39:29.727468+0000","last_fullsized":"2024-09-14T12:39:29.727468+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:14.000285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'11","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.953503+0000","last_change":"2024-09-14T11:12:19.108246+0000","last_active":"2024-09-14T12:44:02.953503+0000","last_peered":"2024-09-14T12:44:02.953503+0000","last_clean":"2024-09-14T12:44:02.953503+0000","last_became_active":"2024-09-14T11:12:19.107563+0000","last_became_peered":"2024-09-14T11:12:19.107563+0000","last_unstale":"2024-09-14T12:44:02.953503+0000","last_undegraded":"2024-09-14T12:44:02.953503+0000","last_fullsized":"2024-09-14T12:44:02.953503+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9259,"num_write":16,"num_write_kb":6185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'15","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:44.744075+0000","last_change":"2024-09-14T11:06:29.535035+0000","last_active":"2024-09-14T12:40:44.744075+0000","last_peered":"2024-09-14T12:40:44.744075+0000","last_clean":"2024-09-14T12:40:44.744075+0000","last_became_active":"2024-09-14T11:06:29.534316+0000","last_became_peered":"2024-09-14T11:06:29.534316+0000","last_unstale":"2024-09-14T12:40:44.744075+0000","last_undegraded":"2024-09-14T12:40:44.744075+0000","last_fullsized":"2024-09-14T12:40:44.744075+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.975045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":71,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.798963+0000","last_change":"2024-09-14T11:40:08.945904+0000","last_active":"2024-09-14T12:40:50.798963+0000","last_peered":"2024-09-14T12:40:50.798963+0000","last_clean":"2024-09-14T12:40:50.798963+0000","last_became_active":"2024-09-14T11:40:08.945227+0000","last_became_peered":"2024-09-14T11:40:08.945227+0000","last_unstale":"2024-09-14T12:40:50.798963+0000","last_undegraded":"2024-09-14T12:40:50.798963+0000","last_fullsized":"2024-09-14T12:40:50.798963+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:52.335465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:25.779815+0000","last_change":"2024-09-14T11:12:26.239562+0000","last_active":"2024-09-14T12:39:25.779815+0000","last_peered":"2024-09-14T12:39:25.779815+0000","last_clean":"2024-09-14T12:39:25.779815+0000","last_became_active":"2024-09-14T11:12:26.238844+0000","last_became_peered":"2024-09-14T11:12:26.238844+0000","last_unstale":"2024-09-14T12:39:25.779815+0000","last_undegraded":"2024-09-14T12:39:25.779815+0000","last_fullsized":"2024-09-14T12:39:25.779815+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:15.939265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:20.541990+0000","last_change":"2024-09-14T11:12:19.074095+0000","last_active":"2024-09-14T12:39:20.541990+0000","last_peered":"2024-09-14T12:39:20.541990+0000","last_clean":"2024-09-14T12:39:20.541990+0000","last_became_active":"2024-09-14T11:12:19.072275+0000","last_became_peered":"2024-09-14T11:12:19.072275+0000","last_unstale":"2024-09-14T12:39:20.541990+0000","last_undegraded":"2024-09-14T12:39:20.541990+0000","last_fullsized":"2024-09-14T12:39:20.541990+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:16.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'30","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476064+0000","last_change":"2024-09-14T11:06:29.519394+0000","last_active":"2024-09-14T12:40:06.476064+0000","last_peered":"2024-09-14T12:40:06.476064+0000","last_clean":"2024-09-14T12:40:06.476064+0000","last_became_active":"2024-09-14T11:06:29.518650+0000","last_became_peered":"2024-09-14T11:06:29.518650+0000","last_unstale":"2024-09-14T12:40:06.476064+0000","last_undegraded":"2024-09-14T12:40:06.476064+0000","last_fullsized":"2024-09-14T12:40:06.476064+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.316442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":172,"num_write":81,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559828+0000","last_change":"2024-09-14T11:40:08.951327+0000","last_active":"2024-09-14T12:40:35.559828+0000","last_peered":"2024-09-14T12:40:35.559828+0000","last_clean":"2024-09-14T12:40:35.559828+0000","last_became_active":"2024-09-14T11:40:08.950670+0000","last_became_peered":"2024-09-14T11:40:08.950670+0000","last_unstale":"2024-09-14T12:40:35.559828+0000","last_undegraded":"2024-09-14T12:40:35.559828+0000","last_fullsized":"2024-09-14T12:40:35.559828+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:02.634753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'3","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566775+0000","last_change":"2024-09-14T11:12:26.228814+0000","last_active":"2024-09-14T12:41:05.566775+0000","last_peered":"2024-09-14T12:41:05.566775+0000","last_clean":"2024-09-14T12:41:05.566775+0000","last_became_active":"2024-09-14T11:12:26.227851+0000","last_became_peered":"2024-09-14T11:12:26.227851+0000","last_unstale":"2024-09-14T12:41:05.566775+0000","last_undegraded":"2024-09-14T12:41:05.566775+0000","last_fullsized":"2024-09-14T12:41:05.566775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:46.796979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":8,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.553829+0000","last_change":"2024-09-14T11:12:19.092586+0000","last_active":"2024-09-14T12:41:00.553829+0000","last_peered":"2024-09-14T12:41:00.553829+0000","last_clean":"2024-09-14T12:41:00.553829+0000","last_became_active":"2024-09-14T11:12:19.091893+0000","last_became_peered":"2024-09-14T11:12:19.091893+0000","last_unstale":"2024-09-14T12:41:00.553829+0000","last_undegraded":"2024-09-14T12:41:00.553829+0000","last_fullsized":"2024-09-14T12:41:00.553829+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:18.606010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'35","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.472861+0000","last_change":"2024-09-14T11:06:29.548605+0000","last_active":"2024-09-14T12:39:51.472861+0000","last_peered":"2024-09-14T12:39:51.472861+0000","last_clean":"2024-09-14T12:39:51.472861+0000","last_became_active":"2024-09-14T11:06:29.545575+0000","last_became_peered":"2024-09-14T11:06:29.545575+0000","last_unstale":"2024-09-14T12:39:51.472861+0000","last_undegraded":"2024-09-14T12:39:51.472861+0000","last_fullsized":"2024-09-14T12:39:51.472861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:04.244766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":183,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543115+0000","last_change":"2024-09-14T11:40:08.926123+0000","last_active":"2024-09-14T12:40:36.543115+0000","last_peered":"2024-09-14T12:40:36.543115+0000","last_clean":"2024-09-14T12:40:36.543115+0000","last_became_active":"2024-09-14T11:40:08.925358+0000","last_became_peered":"2024-09-14T11:40:08.925358+0000","last_unstale":"2024-09-14T12:40:36.543115+0000","last_undegraded":"2024-09-14T12:40:36.543115+0000","last_fullsized":"2024-09-14T12:40:36.543115+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:25.296629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566691+0000","last_change":"2024-09-14T11:12:26.247421+0000","last_active":"2024-09-14T12:41:05.566691+0000","last_peered":"2024-09-14T12:41:05.566691+0000","last_clean":"2024-09-14T12:41:05.566691+0000","last_became_active":"2024-09-14T11:12:26.246881+0000","last_became_peered":"2024-09-14T11:12:26.246881+0000","last_unstale":"2024-09-14T12:41:05.566691+0000","last_undegraded":"2024-09-14T12:41:05.566691+0000","last_fullsized":"2024-09-14T12:41:05.566691+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:19.198573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.565548+0000","last_change":"2024-09-14T11:12:19.096545+0000","last_active":"2024-09-14T12:41:00.565548+0000","last_peered":"2024-09-14T12:41:00.565548+0000","last_clean":"2024-09-14T12:41:00.565548+0000","last_became_active":"2024-09-14T11:12:19.095821+0000","last_became_peered":"2024-09-14T11:12:19.095821+0000","last_unstale":"2024-09-14T12:41:00.565548+0000","last_undegraded":"2024-09-14T12:41:00.565548+0000","last_fullsized":"2024-09-14T12:41:00.565548+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:19.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4663,"num_write":3,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'26","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731762+0000","last_change":"2024-09-14T11:06:29.533209+0000","last_active":"2024-09-14T12:39:49.731762+0000","last_peered":"2024-09-14T12:39:49.731762+0000","last_clean":"2024-09-14T12:39:49.731762+0000","last_became_active":"2024-09-14T11:06:29.529753+0000","last_became_peered":"2024-09-14T11:06:29.529753+0000","last_unstale":"2024-09-14T12:39:49.731762+0000","last_undegraded":"2024-09-14T12:39:49.731762+0000","last_fullsized":"2024-09-14T12:39:49.731762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:45.017988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.576092+0000","last_change":"2024-09-14T11:40:08.925501+0000","last_active":"2024-09-14T12:41:05.576092+0000","last_peered":"2024-09-14T12:41:05.576092+0000","last_clean":"2024-09-14T12:41:05.576092+0000","last_became_active":"2024-09-14T11:40:08.924726+0000","last_became_peered":"2024-09-14T11:40:08.924726+0000","last_unstale":"2024-09-14T12:41:05.576092+0000","last_undegraded":"2024-09-14T12:41:05.576092+0000","last_fullsized":"2024-09-14T12:41:05.576092+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:22.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:09.749817+0000","last_change":"2024-09-14T11:12:26.219990+0000","last_active":"2024-09-14T12:41:09.749817+0000","last_peered":"2024-09-14T12:41:09.749817+0000","last_clean":"2024-09-14T12:41:09.749817+0000","last_became_active":"2024-09-14T11:12:26.219169+0000","last_became_peered":"2024-09-14T11:12:26.219169+0000","last_unstale":"2024-09-14T12:41:09.749817+0000","last_undegraded":"2024-09-14T12:41:09.749817+0000","last_fullsized":"2024-09-14T12:41:09.749817+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:09.344730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"267'8","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.553945+0000","last_change":"2024-09-14T11:12:19.099929+0000","last_active":"2024-09-14T12:41:00.553945+0000","last_peered":"2024-09-14T12:41:00.553945+0000","last_clean":"2024-09-14T12:41:00.553945+0000","last_became_active":"2024-09-14T11:12:19.099233+0000","last_became_peered":"2024-09-14T11:12:19.099233+0000","last_unstale":"2024-09-14T12:41:00.553945+0000","last_undegraded":"2024-09-14T12:41:00.553945+0000","last_fullsized":"2024-09-14T12:41:00.553945+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:44.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2113536,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":8230,"num_write":8,"num_write_kb":6172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'35","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140567+0000","last_change":"2024-09-14T11:06:29.524243+0000","last_active":"2024-09-14T12:39:51.140567+0000","last_peered":"2024-09-14T12:39:51.140567+0000","last_clean":"2024-09-14T12:39:51.140567+0000","last_became_active":"2024-09-14T11:06:29.508842+0000","last_became_peered":"2024-09-14T11:06:29.508842+0000","last_unstale":"2024-09-14T12:39:51.140567+0000","last_undegraded":"2024-09-14T12:39:51.140567+0000","last_fullsized":"2024-09-14T12:39:51.140567+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:47.904384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":189,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543061+0000","last_change":"2024-09-14T11:40:08.945136+0000","last_active":"2024-09-14T12:40:36.543061+0000","last_peered":"2024-09-14T12:40:36.543061+0000","last_clean":"2024-09-14T12:40:36.543061+0000","last_became_active":"2024-09-14T11:40:08.944382+0000","last_became_peered":"2024-09-14T11:40:08.944382+0000","last_unstale":"2024-09-14T12:40:36.543061+0000","last_undegraded":"2024-09-14T12:40:36.543061+0000","last_fullsized":"2024-09-14T12:40:36.543061+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:00.265362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"267'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.491464+0000","last_change":"2024-09-14T11:12:26.238084+0000","last_active":"2024-09-14T12:41:06.491464+0000","last_peered":"2024-09-14T12:41:06.491464+0000","last_clean":"2024-09-14T12:41:06.491464+0000","last_became_active":"2024-09-14T11:12:26.232336+0000","last_became_peered":"2024-09-14T11:12:26.232336+0000","last_unstale":"2024-09-14T12:41:06.491464+0000","last_undegraded":"2024-09-14T12:41:06.491464+0000","last_fullsized":"2024-09-14T12:41:06.491464+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:24.342020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4970,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12288,"num_write":5,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.554012+0000","last_change":"2024-09-14T11:12:19.093047+0000","last_active":"2024-09-14T12:41:00.554012+0000","last_peered":"2024-09-14T12:41:00.554012+0000","last_clean":"2024-09-14T12:41:00.554012+0000","last_became_active":"2024-09-14T11:12:19.092223+0000","last_became_peered":"2024-09-14T11:12:19.092223+0000","last_unstale":"2024-09-14T12:41:00.554012+0000","last_undegraded":"2024-09-14T12:41:00.554012+0000","last_fullsized":"2024-09-14T12:41:00.554012+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:48.559915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2056,"num_write":3,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'19","reported_seq":117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731645+0000","last_change":"2024-09-14T11:06:29.533456+0000","last_active":"2024-09-14T12:39:49.731645+0000","last_peered":"2024-09-14T12:39:49.731645+0000","last_clean":"2024-09-14T12:39:49.731645+0000","last_became_active":"2024-09-14T11:06:29.530722+0000","last_became_peered":"2024-09-14T11:06:29.530722+0000","last_unstale":"2024-09-14T12:39:49.731645+0000","last_undegraded":"2024-09-14T12:39:49.731645+0000","last_fullsized":"2024-09-14T12:39:49.731645+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:40.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":48,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566854+0000","last_change":"2024-09-14T11:40:08.948425+0000","last_active":"2024-09-14T12:41:05.566854+0000","last_peered":"2024-09-14T12:41:05.566854+0000","last_clean":"2024-09-14T12:41:05.566854+0000","last_became_active":"2024-09-14T11:40:08.947725+0000","last_became_peered":"2024-09-14T11:40:08.947725+0000","last_unstale":"2024-09-14T12:41:05.566854+0000","last_undegraded":"2024-09-14T12:41:05.566854+0000","last_fullsized":"2024-09-14T12:41:05.566854+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:01.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737522+0000","last_change":"2024-09-14T11:12:26.233658+0000","last_active":"2024-09-14T12:40:14.737522+0000","last_peered":"2024-09-14T12:40:14.737522+0000","last_clean":"2024-09-14T12:40:14.737522+0000","last_became_active":"2024-09-14T11:12:26.233006+0000","last_became_peered":"2024-09-14T11:12:26.233006+0000","last_unstale":"2024-09-14T12:40:14.737522+0000","last_undegraded":"2024-09-14T12:40:14.737522+0000","last_fullsized":"2024-09-14T12:40:14.737522+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:29.000670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"267'1","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.144797+0000","last_change":"2024-09-14T11:12:19.086179+0000","last_active":"2024-09-14T12:40:06.144797+0000","last_peered":"2024-09-14T12:40:06.144797+0000","last_clean":"2024-09-14T12:40:06.144797+0000","last_became_active":"2024-09-14T11:12:19.085380+0000","last_became_peered":"2024-09-14T11:12:19.085380+0000","last_unstale":"2024-09-14T12:40:06.144797+0000","last_undegraded":"2024-09-14T12:40:06.144797+0000","last_fullsized":"2024-09-14T12:40:06.144797+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:31.276536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'32","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:14.751168+0000","last_change":"2024-09-14T11:06:29.535049+0000","last_active":"2024-09-14T12:41:14.751168+0000","last_peered":"2024-09-14T12:41:14.751168+0000","last_clean":"2024-09-14T12:41:14.751168+0000","last_became_active":"2024-09-14T11:06:29.534458+0000","last_became_peered":"2024-09-14T11:06:29.534458+0000","last_unstale":"2024-09-14T12:41:14.751168+0000","last_undegraded":"2024-09-14T12:41:14.751168+0000","last_fullsized":"2024-09-14T12:41:14.751168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:56.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":170,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.552820+0000","last_change":"2024-09-14T11:40:08.950611+0000","last_active":"2024-09-14T12:40:55.552820+0000","last_peered":"2024-09-14T12:40:55.552820+0000","last_clean":"2024-09-14T12:40:55.552820+0000","last_became_active":"2024-09-14T11:40:08.949834+0000","last_became_peered":"2024-09-14T11:40:08.949834+0000","last_unstale":"2024-09-14T12:40:55.552820+0000","last_undegraded":"2024-09-14T12:40:55.552820+0000","last_fullsized":"2024-09-14T12:40:55.552820+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:57.861780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737457+0000","last_change":"2024-09-14T11:12:26.248461+0000","last_active":"2024-09-14T12:40:14.737457+0000","last_peered":"2024-09-14T12:40:14.737457+0000","last_clean":"2024-09-14T12:40:14.737457+0000","last_became_active":"2024-09-14T11:12:26.247614+0000","last_became_peered":"2024-09-14T11:12:26.247614+0000","last_unstale":"2024-09-14T12:40:14.737457+0000","last_undegraded":"2024-09-14T12:40:14.737457+0000","last_fullsized":"2024-09-14T12:40:14.737457+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:50.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'13","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.536466+0000","last_change":"2024-09-14T11:12:19.096853+0000","last_active":"2024-09-14T12:40:06.536466+0000","last_peered":"2024-09-14T12:40:06.536466+0000","last_clean":"2024-09-14T12:40:06.536466+0000","last_became_active":"2024-09-14T11:12:19.096087+0000","last_became_peered":"2024-09-14T11:12:19.096087+0000","last_unstale":"2024-09-14T12:40:06.536466+0000","last_undegraded":"2024-09-14T12:40:06.536466+0000","last_fullsized":"2024-09-14T12:40:06.536466+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:06.192659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":21525,"num_write":23,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'15","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490423+0000","last_change":"2024-09-14T11:06:29.545510+0000","last_active":"2024-09-14T12:41:01.490423+0000","last_peered":"2024-09-14T12:41:01.490423+0000","last_clean":"2024-09-14T12:41:01.490423+0000","last_became_active":"2024-09-14T11:06:29.544309+0000","last_became_peered":"2024-09-14T11:06:29.544309+0000","last_unstale":"2024-09-14T12:41:01.490423+0000","last_undegraded":"2024-09-14T12:41:01.490423+0000","last_fullsized":"2024-09-14T12:41:01.490423+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:06.467496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":80,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.487672+0000","last_change":"2024-09-14T11:40:08.941028+0000","last_active":"2024-09-14T12:40:51.487672+0000","last_peered":"2024-09-14T12:40:51.487672+0000","last_clean":"2024-09-14T12:40:51.487672+0000","last_became_active":"2024-09-14T11:40:08.934447+0000","last_became_peered":"2024-09-14T11:40:08.934447+0000","last_unstale":"2024-09-14T12:40:51.487672+0000","last_undegraded":"2024-09-14T12:40:51.487672+0000","last_fullsized":"2024-09-14T12:40:51.487672+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:15.709296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"267'11","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:44.771631+0000","last_change":"2024-09-14T11:12:26.254154+0000","last_active":"2024-09-14T12:42:44.771631+0000","last_peered":"2024-09-14T12:42:44.771631+0000","last_clean":"2024-09-14T12:42:44.771631+0000","last_became_active":"2024-09-14T11:12:26.253410+0000","last_became_peered":"2024-09-14T11:12:26.253410+0000","last_unstale":"2024-09-14T12:42:44.771631+0000","last_undegraded":"2024-09-14T12:42:44.771631+0000","last_fullsized":"2024-09-14T12:42:44.771631+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.081481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6160,"num_write":16,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:04.735243+0000","last_change":"2024-09-14T11:12:19.112482+0000","last_active":"2024-09-14T12:40:04.735243+0000","last_peered":"2024-09-14T12:40:04.735243+0000","last_clean":"2024-09-14T12:40:04.735243+0000","last_became_active":"2024-09-14T11:12:19.109807+0000","last_became_peered":"2024-09-14T11:12:19.109807+0000","last_unstale":"2024-09-14T12:40:04.735243+0000","last_undegraded":"2024-09-14T12:40:04.735243+0000","last_fullsized":"2024-09-14T12:40:04.735243+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:20.441664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'38","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.554078+0000","last_change":"2024-09-14T11:06:29.521507+0000","last_active":"2024-09-14T12:41:00.554078+0000","last_peered":"2024-09-14T12:41:00.554078+0000","last_clean":"2024-09-14T12:41:00.554078+0000","last_became_active":"2024-09-14T11:06:29.520734+0000","last_became_peered":"2024-09-14T11:06:29.520734+0000","last_unstale":"2024-09-14T12:41:00.554078+0000","last_undegraded":"2024-09-14T12:41:00.554078+0000","last_fullsized":"2024-09-14T12:41:00.554078+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:18.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":248,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.551623+0000","last_change":"2024-09-14T11:40:08.929963+0000","last_active":"2024-09-14T12:40:50.551623+0000","last_peered":"2024-09-14T12:40:50.551623+0000","last_clean":"2024-09-14T12:40:50.551623+0000","last_became_active":"2024-09-14T11:40:08.928855+0000","last_became_peered":"2024-09-14T11:40:08.928855+0000","last_unstale":"2024-09-14T12:40:50.551623+0000","last_undegraded":"2024-09-14T12:40:50.551623+0000","last_fullsized":"2024-09-14T12:40:50.551623+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:53.447923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.554007+0000","last_change":"2024-09-14T11:12:26.236373+0000","last_active":"2024-09-14T12:40:10.554007+0000","last_peered":"2024-09-14T12:40:10.554007+0000","last_clean":"2024-09-14T12:40:10.554007+0000","last_became_active":"2024-09-14T11:12:26.235707+0000","last_became_peered":"2024-09-14T11:12:26.235707+0000","last_unstale":"2024-09-14T12:40:10.554007+0000","last_undegraded":"2024-09-14T12:40:10.554007+0000","last_fullsized":"2024-09-14T12:40:10.554007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:08.153271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"267'5","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.951256+0000","last_change":"2024-09-14T11:12:19.112752+0000","last_active":"2024-09-14T12:44:02.951256+0000","last_peered":"2024-09-14T12:44:02.951256+0000","last_clean":"2024-09-14T12:44:02.951256+0000","last_became_active":"2024-09-14T11:12:19.112055+0000","last_became_peered":"2024-09-14T11:12:19.112055+0000","last_unstale":"2024-09-14T12:44:02.951256+0000","last_undegraded":"2024-09-14T12:44:02.951256+0000","last_fullsized":"2024-09-14T12:44:02.951256+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:44.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'65","reported_seq":253,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548334+0000","last_change":"2024-09-14T11:06:29.516817+0000","last_active":"2024-09-14T12:41:01.548334+0000","last_peered":"2024-09-14T12:41:01.548334+0000","last_clean":"2024-09-14T12:41:01.548334+0000","last_became_active":"2024-09-14T11:06:29.511360+0000","last_became_peered":"2024-09-14T11:06:29.511360+0000","last_unstale":"2024-09-14T12:41:01.548334+0000","last_undegraded":"2024-09-14T12:41:01.548334+0000","last_fullsized":"2024-09-14T12:41:01.548334+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:54.074956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":367,"num_write":155,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.564546+0000","last_change":"2024-09-14T11:40:08.949706+0000","last_active":"2024-09-14T12:40:55.564546+0000","last_peered":"2024-09-14T12:40:55.564546+0000","last_clean":"2024-09-14T12:40:55.564546+0000","last_became_active":"2024-09-14T11:40:08.949175+0000","last_became_peered":"2024-09-14T11:40:08.949175+0000","last_unstale":"2024-09-14T12:40:55.564546+0000","last_undegraded":"2024-09-14T12:40:55.564546+0000","last_fullsized":"2024-09-14T12:40:55.564546+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:24.365260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494106+0000","last_change":"2024-09-14T11:12:26.229833+0000","last_active":"2024-09-14T12:41:16.494106+0000","last_peered":"2024-09-14T12:41:16.494106+0000","last_clean":"2024-09-14T12:41:16.494106+0000","last_became_active":"2024-09-14T11:12:26.228889+0000","last_became_peered":"2024-09-14T11:12:26.228889+0000","last_unstale":"2024-09-14T12:41:16.494106+0000","last_undegraded":"2024-09-14T12:41:16.494106+0000","last_fullsized":"2024-09-14T12:41:16.494106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:37.357481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6156,"num_write":2,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:19.779183+0000","last_change":"2024-09-14T11:12:19.099716+0000","last_active":"2024-09-14T12:43:19.779183+0000","last_peered":"2024-09-14T12:43:19.779183+0000","last_clean":"2024-09-14T12:43:19.779183+0000","last_became_active":"2024-09-14T11:12:19.098699+0000","last_became_peered":"2024-09-14T11:12:19.098699+0000","last_unstale":"2024-09-14T12:43:19.779183+0000","last_undegraded":"2024-09-14T12:43:19.779183+0000","last_fullsized":"2024-09-14T12:43:19.779183+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:03.576522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'39","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548268+0000","last_change":"2024-09-14T11:06:29.539103+0000","last_active":"2024-09-14T12:41:01.548268+0000","last_peered":"2024-09-14T12:41:01.548268+0000","last_clean":"2024-09-14T12:41:01.548268+0000","last_became_active":"2024-09-14T11:06:29.538432+0000","last_became_peered":"2024-09-14T11:06:29.538432+0000","last_unstale":"2024-09-14T12:41:01.548268+0000","last_undegraded":"2024-09-14T12:41:01.548268+0000","last_fullsized":"2024-09-14T12:41:01.548268+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.474730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":213,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.159302+0000","last_change":"2024-09-14T11:40:08.942492+0000","last_active":"2024-09-14T12:41:06.159302+0000","last_peered":"2024-09-14T12:41:06.159302+0000","last_clean":"2024-09-14T12:41:06.159302+0000","last_became_active":"2024-09-14T11:40:08.941924+0000","last_became_peered":"2024-09-14T11:40:08.941924+0000","last_unstale":"2024-09-14T12:41:06.159302+0000","last_undegraded":"2024-09-14T12:41:06.159302+0000","last_fullsized":"2024-09-14T12:41:06.159302+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:27.899066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.161485+0000","last_change":"2024-09-14T11:12:26.248413+0000","last_active":"2024-09-14T12:41:16.161485+0000","last_peered":"2024-09-14T12:41:16.161485+0000","last_clean":"2024-09-14T12:41:16.161485+0000","last_became_active":"2024-09-14T11:12:26.247849+0000","last_became_peered":"2024-09-14T11:12:26.247849+0000","last_unstale":"2024-09-14T12:41:16.161485+0000","last_undegraded":"2024-09-14T12:41:16.161485+0000","last_fullsized":"2024-09-14T12:41:16.161485+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:10.903087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5155,"num_write":11,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:10.568076+0000","last_change":"2024-09-14T11:12:19.096332+0000","last_active":"2024-09-14T12:41:10.568076+0000","last_peered":"2024-09-14T12:41:10.568076+0000","last_clean":"2024-09-14T12:41:10.568076+0000","last_became_active":"2024-09-14T11:12:19.095636+0000","last_became_peered":"2024-09-14T11:12:19.095636+0000","last_unstale":"2024-09-14T12:41:10.568076+0000","last_undegraded":"2024-09-14T12:41:10.568076+0000","last_fullsized":"2024-09-14T12:41:10.568076+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:51.045024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'31","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142146+0000","last_change":"2024-09-14T11:06:29.508912+0000","last_active":"2024-09-14T12:39:56.142146+0000","last_peered":"2024-09-14T12:39:56.142146+0000","last_clean":"2024-09-14T12:39:56.142146+0000","last_became_active":"2024-09-14T11:06:29.508269+0000","last_became_peered":"2024-09-14T11:06:29.508269+0000","last_unstale":"2024-09-14T12:39:56.142146+0000","last_undegraded":"2024-09-14T12:39:56.142146+0000","last_fullsized":"2024-09-14T12:39:56.142146+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:53.190994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":149,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.800182+0000","last_change":"2024-09-14T11:40:08.945998+0000","last_active":"2024-09-14T12:40:55.800182+0000","last_peered":"2024-09-14T12:40:55.800182+0000","last_clean":"2024-09-14T12:40:55.800182+0000","last_became_active":"2024-09-14T11:40:08.945217+0000","last_became_peered":"2024-09-14T11:40:08.945217+0000","last_unstale":"2024-09-14T12:40:55.800182+0000","last_undegraded":"2024-09-14T12:40:55.800182+0000","last_fullsized":"2024-09-14T12:40:55.800182+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:49.290553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'4","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537498+0000","last_change":"2024-09-14T11:12:26.247976+0000","last_active":"2024-09-14T12:40:11.537498+0000","last_peered":"2024-09-14T12:40:11.537498+0000","last_clean":"2024-09-14T12:40:11.537498+0000","last_became_active":"2024-09-14T11:12:26.247272+0000","last_became_peered":"2024-09-14T11:12:26.247272+0000","last_unstale":"2024-09-14T12:40:11.537498+0000","last_undegraded":"2024-09-14T12:40:11.537498+0000","last_fullsized":"2024-09-14T12:40:11.537498+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:11.612706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:34.782674+0000","last_change":"2024-09-14T11:12:19.106061+0000","last_active":"2024-09-14T12:43:34.782674+0000","last_peered":"2024-09-14T12:43:34.782674+0000","last_clean":"2024-09-14T12:43:34.782674+0000","last_became_active":"2024-09-14T11:12:19.103535+0000","last_became_peered":"2024-09-14T11:12:19.103535+0000","last_unstale":"2024-09-14T12:43:34.782674+0000","last_undegraded":"2024-09-14T12:43:34.782674+0000","last_fullsized":"2024-09-14T12:43:34.782674+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.680229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'7","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.358674+0000","last_change":"2024-09-14T11:06:29.510769+0000","last_active":"2024-09-14T12:41:50.358674+0000","last_peered":"2024-09-14T12:41:50.358674+0000","last_clean":"2024-09-14T12:41:50.358674+0000","last_became_active":"2024-09-14T11:06:29.510044+0000","last_became_peered":"2024-09-14T11:06:29.510044+0000","last_unstale":"2024-09-14T12:41:50.358674+0000","last_undegraded":"2024-09-14T12:41:50.358674+0000","last_fullsized":"2024-09-14T12:41:50.358674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:30.328430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:54.746472+0000","last_change":"2024-09-14T11:40:08.930752+0000","last_active":"2024-09-14T12:40:54.746472+0000","last_peered":"2024-09-14T12:40:54.746472+0000","last_clean":"2024-09-14T12:40:54.746472+0000","last_became_active":"2024-09-14T11:40:08.930065+0000","last_became_peered":"2024-09-14T11:40:08.930065+0000","last_unstale":"2024-09-14T12:40:54.746472+0000","last_undegraded":"2024-09-14T12:40:54.746472+0000","last_fullsized":"2024-09-14T12:40:54.746472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.939757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.807272+0000","last_change":"2024-09-14T11:12:26.234589+0000","last_active":"2024-09-14T12:41:30.807272+0000","last_peered":"2024-09-14T12:41:30.807272+0000","last_clean":"2024-09-14T12:41:30.807272+0000","last_became_active":"2024-09-14T11:12:26.233812+0000","last_became_peered":"2024-09-14T11:12:26.233812+0000","last_unstale":"2024-09-14T12:41:30.807272+0000","last_undegraded":"2024-09-14T12:41:30.807272+0000","last_fullsized":"2024-09-14T12:41:30.807272+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:49.220830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'1","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476008+0000","last_change":"2024-09-14T11:12:19.108839+0000","last_active":"2024-09-14T12:40:06.476008+0000","last_peered":"2024-09-14T12:40:06.476008+0000","last_clean":"2024-09-14T12:40:06.476008+0000","last_became_active":"2024-09-14T11:12:19.107950+0000","last_became_peered":"2024-09-14T11:12:19.107950+0000","last_unstale":"2024-09-14T12:40:06.476008+0000","last_undegraded":"2024-09-14T12:40:06.476008+0000","last_fullsized":"2024-09-14T12:40:06.476008+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:06.871908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'21","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.810485+0000","last_change":"2024-09-14T11:06:29.528799+0000","last_active":"2024-09-14T12:41:50.810485+0000","last_peered":"2024-09-14T12:41:50.810485+0000","last_clean":"2024-09-14T12:41:50.810485+0000","last_became_active":"2024-09-14T11:06:29.528153+0000","last_became_peered":"2024-09-14T11:06:29.528153+0000","last_unstale":"2024-09-14T12:41:50.810485+0000","last_undegraded":"2024-09-14T12:41:50.810485+0000","last_fullsized":"2024-09-14T12:41:50.810485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:32.956165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":111,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795593+0000","last_change":"2024-09-14T11:40:08.937198+0000","last_active":"2024-09-14T12:40:35.795593+0000","last_peered":"2024-09-14T12:40:35.795593+0000","last_clean":"2024-09-14T12:40:35.795593+0000","last_became_active":"2024-09-14T11:40:08.936369+0000","last_became_peered":"2024-09-14T11:40:08.936369+0000","last_unstale":"2024-09-14T12:40:35.795593+0000","last_undegraded":"2024-09-14T12:40:35.795593+0000","last_fullsized":"2024-09-14T12:40:35.795593+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:41.385885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.555175+0000","last_change":"2024-09-14T11:12:26.246616+0000","last_active":"2024-09-14T12:40:15.555175+0000","last_peered":"2024-09-14T12:40:15.555175+0000","last_clean":"2024-09-14T12:40:15.555175+0000","last_became_active":"2024-09-14T11:12:26.245930+0000","last_became_peered":"2024-09-14T11:12:26.245930+0000","last_unstale":"2024-09-14T12:40:15.555175+0000","last_undegraded":"2024-09-14T12:40:15.555175+0000","last_fullsized":"2024-09-14T12:40:15.555175+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:04.624461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3080,"num_write":1,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'1","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504797+0000","last_change":"2024-09-14T11:12:19.109523+0000","last_active":"2024-09-14T12:41:56.504797+0000","last_peered":"2024-09-14T12:41:56.504797+0000","last_clean":"2024-09-14T12:41:56.504797+0000","last_became_active":"2024-09-14T11:12:19.108775+0000","last_became_peered":"2024-09-14T11:12:19.108775+0000","last_unstale":"2024-09-14T12:41:56.504797+0000","last_undegraded":"2024-09-14T12:41:56.504797+0000","last_fullsized":"2024-09-14T12:41:56.504797+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:14.420097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'26","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585974+0000","last_change":"2024-09-14T11:06:29.513212+0000","last_active":"2024-09-14T12:41:50.585974+0000","last_peered":"2024-09-14T12:41:50.585974+0000","last_clean":"2024-09-14T12:41:50.585974+0000","last_became_active":"2024-09-14T11:06:29.512500+0000","last_became_peered":"2024-09-14T11:06:29.512500+0000","last_unstale":"2024-09-14T12:41:50.585974+0000","last_undegraded":"2024-09-14T12:41:50.585974+0000","last_fullsized":"2024-09-14T12:41:50.585974+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:16.159078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":126,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795654+0000","last_change":"2024-09-14T11:40:08.942991+0000","last_active":"2024-09-14T12:40:35.795654+0000","last_peered":"2024-09-14T12:40:35.795654+0000","last_clean":"2024-09-14T12:40:35.795654+0000","last_became_active":"2024-09-14T11:40:08.941346+0000","last_became_peered":"2024-09-14T11:40:08.941346+0000","last_unstale":"2024-09-14T12:40:35.795654+0000","last_undegraded":"2024-09-14T12:40:35.795654+0000","last_fullsized":"2024-09-14T12:40:35.795654+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.150412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"267'3","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550224+0000","last_change":"2024-09-14T11:12:26.243752+0000","last_active":"2024-09-14T12:39:55.550224+0000","last_peered":"2024-09-14T12:39:55.550224+0000","last_clean":"2024-09-14T12:39:55.550224+0000","last_became_active":"2024-09-14T11:12:26.243209+0000","last_became_peered":"2024-09-14T11:12:26.243209+0000","last_unstale":"2024-09-14T12:39:55.550224+0000","last_undegraded":"2024-09-14T12:39:55.550224+0000","last_fullsized":"2024-09-14T12:39:55.550224+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:38.328679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":3,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'9","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.565326+0000","last_change":"2024-09-14T11:12:19.092074+0000","last_active":"2024-09-14T12:40:15.565326+0000","last_peered":"2024-09-14T12:40:15.565326+0000","last_clean":"2024-09-14T12:40:15.565326+0000","last_became_active":"2024-09-14T11:12:19.091327+0000","last_became_peered":"2024-09-14T11:12:19.091327+0000","last_unstale":"2024-09-14T12:40:15.565326+0000","last_undegraded":"2024-09-14T12:40:15.565326+0000","last_fullsized":"2024-09-14T12:40:15.565326+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:38.040984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":27638,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'29","reported_seq":155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503327+0000","last_change":"2024-09-14T11:06:29.545877+0000","last_active":"2024-09-14T12:41:51.503327+0000","last_peered":"2024-09-14T12:41:51.503327+0000","last_clean":"2024-09-14T12:41:51.503327+0000","last_became_active":"2024-09-14T11:06:29.539618+0000","last_became_peered":"2024-09-14T11:06:29.539618+0000","last_unstale":"2024-09-14T12:41:51.503327+0000","last_undegraded":"2024-09-14T12:41:51.503327+0000","last_fullsized":"2024-09-14T12:41:51.503327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:18.342360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":157,"num_write":71,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:25.557355+0000","last_change":"2024-09-14T11:40:08.946921+0000","last_active":"2024-09-14T12:40:25.557355+0000","last_peered":"2024-09-14T12:40:25.557355+0000","last_clean":"2024-09-14T12:40:25.557355+0000","last_became_active":"2024-09-14T11:40:08.946312+0000","last_became_peered":"2024-09-14T11:40:08.946312+0000","last_unstale":"2024-09-14T12:40:25.557355+0000","last_undegraded":"2024-09-14T12:40:25.557355+0000","last_fullsized":"2024-09-14T12:40:25.557355+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:31.836873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:15.804514+0000","last_change":"2024-09-14T11:12:26.229509+0000","last_active":"2024-09-14T12:41:15.804514+0000","last_peered":"2024-09-14T12:41:15.804514+0000","last_clean":"2024-09-14T12:41:15.804514+0000","last_became_active":"2024-09-14T11:12:26.228723+0000","last_became_peered":"2024-09-14T11:12:26.228723+0000","last_unstale":"2024-09-14T12:41:15.804514+0000","last_undegraded":"2024-09-14T12:41:15.804514+0000","last_fullsized":"2024-09-14T12:41:15.804514+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:02.621776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":11303,"num_write":13,"num_write_kb":5161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.160475+0000","last_change":"2024-09-14T11:12:19.085868+0000","last_active":"2024-09-14T12:41:11.160475+0000","last_peered":"2024-09-14T12:41:11.160475+0000","last_clean":"2024-09-14T12:41:11.160475+0000","last_became_active":"2024-09-14T11:12:19.085023+0000","last_became_peered":"2024-09-14T11:12:19.085023+0000","last_unstale":"2024-09-14T12:41:11.160475+0000","last_undegraded":"2024-09-14T12:41:11.160475+0000","last_fullsized":"2024-09-14T12:41:11.160475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:18.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:31.150526+0000","last_change":"2024-09-14T11:06:29.529450+0000","last_active":"2024-09-14T12:40:31.150526+0000","last_peered":"2024-09-14T12:40:31.150526+0000","last_clean":"2024-09-14T12:40:31.150526+0000","last_became_active":"2024-09-14T11:06:29.527422+0000","last_became_peered":"2024-09-14T11:06:29.527422+0000","last_unstale":"2024-09-14T12:40:31.150526+0000","last_undegraded":"2024-09-14T12:40:31.150526+0000","last_fullsized":"2024-09-14T12:40:31.150526+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.481655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":97,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.483898+0000","last_change":"2024-09-14T11:40:08.934634+0000","last_active":"2024-09-14T12:40:36.483898+0000","last_peered":"2024-09-14T12:40:36.483898+0000","last_clean":"2024-09-14T12:40:36.483898+0000","last_became_active":"2024-09-14T11:40:08.933897+0000","last_became_peered":"2024-09-14T11:40:08.933897+0000","last_unstale":"2024-09-14T12:40:36.483898+0000","last_undegraded":"2024-09-14T12:40:36.483898+0000","last_fullsized":"2024-09-14T12:40:36.483898+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:56.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'4","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.494346+0000","last_change":"2024-09-14T11:12:26.238345+0000","last_active":"2024-09-14T12:41:16.494346+0000","last_peered":"2024-09-14T12:41:16.494346+0000","last_clean":"2024-09-14T12:41:16.494346+0000","last_became_active":"2024-09-14T11:12:26.232736+0000","last_became_peered":"2024-09-14T11:12:26.232736+0000","last_unstale":"2024-09-14T12:41:16.494346+0000","last_undegraded":"2024-09-14T12:41:16.494346+0000","last_fullsized":"2024-09-14T12:41:16.494346+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:45.595070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9441280,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":17408,"num_write":9,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.492937+0000","last_change":"2024-09-14T11:12:19.108780+0000","last_active":"2024-09-14T12:41:11.492937+0000","last_peered":"2024-09-14T12:41:11.492937+0000","last_clean":"2024-09-14T12:41:11.492937+0000","last_became_active":"2024-09-14T11:12:19.100258+0000","last_became_peered":"2024-09-14T11:12:19.100258+0000","last_unstale":"2024-09-14T12:41:11.492937+0000","last_undegraded":"2024-09-14T12:41:11.492937+0000","last_fullsized":"2024-09-14T12:41:11.492937+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.561655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":9,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737495+0000","last_change":"2024-09-14T11:06:29.533686+0000","last_active":"2024-09-14T12:40:14.737495+0000","last_peered":"2024-09-14T12:40:14.737495+0000","last_clean":"2024-09-14T12:40:14.737495+0000","last_became_active":"2024-09-14T11:06:29.532958+0000","last_became_peered":"2024-09-14T11:06:29.532958+0000","last_unstale":"2024-09-14T12:40:14.737495+0000","last_undegraded":"2024-09-14T12:40:14.737495+0000","last_fullsized":"2024-09-14T12:40:14.737495+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:35.814419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":199,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:49.745345+0000","last_change":"2024-09-14T11:40:08.934320+0000","last_active":"2024-09-14T12:40:49.745345+0000","last_peered":"2024-09-14T12:40:49.745345+0000","last_clean":"2024-09-14T12:40:49.745345+0000","last_became_active":"2024-09-14T11:40:08.932939+0000","last_became_peered":"2024-09-14T11:40:08.932939+0000","last_unstale":"2024-09-14T12:40:49.745345+0000","last_undegraded":"2024-09-14T12:40:49.745345+0000","last_fullsized":"2024-09-14T12:40:49.745345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:01.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"267'1","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.560888+0000","last_change":"2024-09-14T11:12:26.245494+0000","last_active":"2024-09-14T12:39:55.560888+0000","last_peered":"2024-09-14T12:39:55.560888+0000","last_clean":"2024-09-14T12:39:55.560888+0000","last_became_active":"2024-09-14T11:12:26.236892+0000","last_became_peered":"2024-09-14T11:12:26.236892+0000","last_unstale":"2024-09-14T12:39:55.560888+0000","last_undegraded":"2024-09-14T12:39:55.560888+0000","last_fullsized":"2024-09-14T12:39:55.560888+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.142203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.151616+0000","last_change":"2024-09-14T11:12:19.085476+0000","last_active":"2024-09-14T12:40:36.151616+0000","last_peered":"2024-09-14T12:40:36.151616+0000","last_clean":"2024-09-14T12:40:36.151616+0000","last_became_active":"2024-09-14T11:12:19.084630+0000","last_became_peered":"2024-09-14T11:12:19.084630+0000","last_unstale":"2024-09-14T12:40:36.151616+0000","last_undegraded":"2024-09-14T12:40:36.151616+0000","last_fullsized":"2024-09-14T12:40:36.151616+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:40.347823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'305","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.147026+0000","last_change":"2024-09-14T11:06:29.529539+0000","last_active":"2024-09-14T12:40:16.147026+0000","last_peered":"2024-09-14T12:40:16.147026+0000","last_clean":"2024-09-14T12:40:16.147026+0000","last_became_active":"2024-09-14T11:06:29.524051+0000","last_became_peered":"2024-09-14T11:06:29.524051+0000","last_unstale":"2024-09-14T12:40:16.147026+0000","last_undegraded":"2024-09-14T12:40:16.147026+0000","last_fullsized":"2024-09-14T12:40:16.147026+0000","mapping_epoch":256,"log_start":"264'200","ondisk_log_start":"264'200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:40.592968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2841,"num_read_kb":3371,"num_write":621,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.572999+0000","last_change":"2024-09-14T11:40:08.938945+0000","last_active":"2024-09-14T12:40:50.572999+0000","last_peered":"2024-09-14T12:40:50.572999+0000","last_clean":"2024-09-14T12:40:50.572999+0000","last_became_active":"2024-09-14T11:40:08.938357+0000","last_became_peered":"2024-09-14T11:40:08.938357+0000","last_unstale":"2024-09-14T12:40:50.572999+0000","last_undegraded":"2024-09-14T12:40:50.572999+0000","last_fullsized":"2024-09-14T12:40:50.572999+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:36.211620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'8","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485050+0000","last_change":"2024-09-14T11:12:26.252293+0000","last_active":"2024-09-14T12:40:41.485050+0000","last_peered":"2024-09-14T12:40:41.485050+0000","last_clean":"2024-09-14T12:40:41.485050+0000","last_became_active":"2024-09-14T11:12:26.251771+0000","last_became_peered":"2024-09-14T11:12:26.251771+0000","last_unstale":"2024-09-14T12:40:41.485050+0000","last_undegraded":"2024-09-14T12:40:41.485050+0000","last_fullsized":"2024-09-14T12:40:41.485050+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:13.079478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":9222,"num_write":8,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'1","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504515+0000","last_change":"2024-09-14T11:12:19.109609+0000","last_active":"2024-09-14T12:41:56.504515+0000","last_peered":"2024-09-14T12:41:56.504515+0000","last_clean":"2024-09-14T12:41:56.504515+0000","last_became_active":"2024-09-14T11:12:19.100323+0000","last_became_peered":"2024-09-14T11:12:19.100323+0000","last_unstale":"2024-09-14T12:41:56.504515+0000","last_undegraded":"2024-09-14T12:41:56.504515+0000","last_fullsized":"2024-09-14T12:41:56.504515+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'31","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478473+0000","last_change":"2024-09-14T11:06:29.545567+0000","last_active":"2024-09-14T12:40:16.478473+0000","last_peered":"2024-09-14T12:40:16.478473+0000","last_clean":"2024-09-14T12:40:16.478473+0000","last_became_active":"2024-09-14T11:06:29.545010+0000","last_became_peered":"2024-09-14T11:06:29.545010+0000","last_unstale":"2024-09-14T12:40:16.478473+0000","last_undegraded":"2024-09-14T12:40:16.478473+0000","last_fullsized":"2024-09-14T12:40:16.478473+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:33.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":160,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559740+0000","last_change":"2024-09-14T11:40:08.946756+0000","last_active":"2024-09-14T12:40:35.559740+0000","last_peered":"2024-09-14T12:40:35.559740+0000","last_clean":"2024-09-14T12:40:35.559740+0000","last_became_active":"2024-09-14T11:40:08.946192+0000","last_became_peered":"2024-09-14T11:40:08.946192+0000","last_unstale":"2024-09-14T12:40:35.559740+0000","last_undegraded":"2024-09-14T12:40:35.559740+0000","last_fullsized":"2024-09-14T12:40:35.559740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:33.765939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"267'13","reported_seq":88,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142222+0000","last_change":"2024-09-14T11:12:26.252307+0000","last_active":"2024-09-14T12:39:56.142222+0000","last_peered":"2024-09-14T12:39:56.142222+0000","last_clean":"2024-09-14T12:39:56.142222+0000","last_became_active":"2024-09-14T11:12:26.251336+0000","last_became_peered":"2024-09-14T11:12:26.251336+0000","last_unstale":"2024-09-14T12:39:56.142222+0000","last_undegraded":"2024-09-14T12:39:56.142222+0000","last_fullsized":"2024-09-14T12:39:56.142222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:43.789676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":27664,"num_write":23,"num_write_kb":11276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560463+0000","last_change":"2024-09-14T11:12:19.090268+0000","last_active":"2024-09-14T12:41:56.560463+0000","last_peered":"2024-09-14T12:41:56.560463+0000","last_clean":"2024-09-14T12:41:56.560463+0000","last_became_active":"2024-09-14T11:12:19.089451+0000","last_became_peered":"2024-09-14T11:12:19.089451+0000","last_unstale":"2024-09-14T12:41:56.560463+0000","last_undegraded":"2024-09-14T12:41:56.560463+0000","last_fullsized":"2024-09-14T12:41:56.560463+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.308101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"267'36","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478384+0000","last_change":"2024-09-14T11:06:29.519496+0000","last_active":"2024-09-14T12:40:16.478384+0000","last_peered":"2024-09-14T12:40:16.478384+0000","last_clean":"2024-09-14T12:40:16.478384+0000","last_became_active":"2024-09-14T11:06:29.518775+0000","last_became_peered":"2024-09-14T11:06:29.518775+0000","last_unstale":"2024-09-14T12:40:16.478384+0000","last_undegraded":"2024-09-14T12:40:16.478384+0000","last_fullsized":"2024-09-14T12:40:16.478384+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:55.187103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":189,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485290+0000","last_change":"2024-09-14T11:40:08.934946+0000","last_active":"2024-09-14T12:40:41.485290+0000","last_peered":"2024-09-14T12:40:41.485290+0000","last_clean":"2024-09-14T12:40:41.485290+0000","last_became_active":"2024-09-14T11:40:08.934173+0000","last_became_peered":"2024-09-14T11:40:08.934173+0000","last_unstale":"2024-09-14T12:40:41.485290+0000","last_undegraded":"2024-09-14T12:40:41.485290+0000","last_fullsized":"2024-09-14T12:40:41.485290+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:19.698280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"267'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142074+0000","last_change":"2024-09-14T11:12:26.243412+0000","last_active":"2024-09-14T12:39:56.142074+0000","last_peered":"2024-09-14T12:39:56.142074+0000","last_clean":"2024-09-14T12:39:56.142074+0000","last_became_active":"2024-09-14T11:12:26.242532+0000","last_became_peered":"2024-09-14T11:12:26.242532+0000","last_unstale":"2024-09-14T12:39:56.142074+0000","last_undegraded":"2024-09-14T12:39:56.142074+0000","last_fullsized":"2024-09-14T12:39:56.142074+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:30.032531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9208,"num_write":5,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568347+0000","last_change":"2024-09-14T11:12:19.115989+0000","last_active":"2024-09-14T12:41:55.568347+0000","last_peered":"2024-09-14T12:41:55.568347+0000","last_clean":"2024-09-14T12:41:55.568347+0000","last_became_active":"2024-09-14T11:12:19.115236+0000","last_became_peered":"2024-09-14T11:12:19.115236+0000","last_unstale":"2024-09-14T12:41:55.568347+0000","last_undegraded":"2024-09-14T12:41:55.568347+0000","last_fullsized":"2024-09-14T12:41:55.568347+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:10.915539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'6","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.154160+0000","last_change":"2024-09-14T11:06:29.526320+0000","last_active":"2024-09-14T12:40:46.154160+0000","last_peered":"2024-09-14T12:40:46.154160+0000","last_clean":"2024-09-14T12:40:46.154160+0000","last_became_active":"2024-09-14T11:06:29.525548+0000","last_became_peered":"2024-09-14T11:06:29.525548+0000","last_unstale":"2024-09-14T12:40:46.154160+0000","last_undegraded":"2024-09-14T12:40:46.154160+0000","last_fullsized":"2024-09-14T12:40:46.154160+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:11.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'327","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.812029+0000","last_change":"2024-09-14T10:49:23.373774+0000","last_active":"2024-09-14T12:41:55.812029+0000","last_peered":"2024-09-14T12:41:55.812029+0000","last_clean":"2024-09-14T12:41:55.812029+0000","last_became_active":"2024-09-14T10:49:23.372514+0000","last_became_peered":"2024-09-14T10:49:23.372514+0000","last_unstale":"2024-09-14T12:41:55.812029+0000","last_undegraded":"2024-09-14T12:41:55.812029+0000","last_fullsized":"2024-09-14T12:41:55.812029+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15587743,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":630,"num_read_kb":89783,"num_write":1127,"num_write_kb":37856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'875","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.375040+0000","last_change":"2024-09-14T10:49:25.369326+0000","last_active":"2024-09-14T12:42:29.375040+0000","last_peered":"2024-09-14T12:42:29.375040+0000","last_clean":"2024-09-14T12:42:29.375040+0000","last_became_active":"2024-09-14T10:49:25.368861+0000","last_became_peered":"2024-09-14T10:49:25.368861+0000","last_unstale":"2024-09-14T12:42:29.375040+0000","last_undegraded":"2024-09-14T12:42:29.375040+0000","last_fullsized":"2024-09-14T12:42:29.375040+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:53.245258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4292,"num_read_kb":3786,"num_write":1290,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'327","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360075+0000","last_change":"2024-09-14T10:49:23.387406+0000","last_active":"2024-09-14T12:41:55.360075+0000","last_peered":"2024-09-14T12:41:55.360075+0000","last_clean":"2024-09-14T12:41:55.360075+0000","last_became_active":"2024-09-14T10:49:23.386742+0000","last_became_peered":"2024-09-14T10:49:23.386742+0000","last_unstale":"2024-09-14T12:41:55.360075+0000","last_undegraded":"2024-09-14T12:41:55.360075+0000","last_fullsized":"2024-09-14T12:41:55.360075+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.860422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5532289,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":905,"num_read_kb":14777,"num_write":1126,"num_write_kb":22069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'1157","reported_seq":2810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.680278+0000","last_change":"2024-09-14T10:49:25.371243+0000","last_active":"2024-09-14T12:42:31.680278+0000","last_peered":"2024-09-14T12:42:31.680278+0000","last_clean":"2024-09-14T12:42:31.680278+0000","last_became_active":"2024-09-14T10:49:25.370610+0000","last_became_peered":"2024-09-14T10:49:25.370610+0000","last_unstale":"2024-09-14T12:42:31.680278+0000","last_undegraded":"2024-09-14T12:42:31.680278+0000","last_fullsized":"2024-09-14T12:42:31.680278+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:18.603078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5343,"num_read_kb":4756,"num_write":1566,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'316","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360001+0000","last_change":"2024-09-14T10:49:23.368497+0000","last_active":"2024-09-14T12:41:55.360001+0000","last_peered":"2024-09-14T12:41:55.360001+0000","last_clean":"2024-09-14T12:41:55.360001+0000","last_became_active":"2024-09-14T10:49:23.367647+0000","last_became_peered":"2024-09-14T10:49:23.367647+0000","last_unstale":"2024-09-14T12:41:55.360001+0000","last_undegraded":"2024-09-14T12:41:55.360001+0000","last_fullsized":"2024-09-14T12:41:55.360001+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:08.432641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9463108,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":620,"num_read_kb":20302,"num_write":1165,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1240","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.728017+0000","last_change":"2024-09-14T10:49:25.380844+0000","last_active":"2024-09-14T12:41:23.728017+0000","last_peered":"2024-09-14T12:41:23.728017+0000","last_clean":"2024-09-14T12:41:23.728017+0000","last_became_active":"2024-09-14T10:49:25.380525+0000","last_became_peered":"2024-09-14T10:49:25.380525+0000","last_unstale":"2024-09-14T12:41:23.728017+0000","last_undegraded":"2024-09-14T12:41:23.728017+0000","last_fullsized":"2024-09-14T12:41:23.728017+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:39.949070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5594,"num_read_kb":4933,"num_write":1701,"num_write_kb":712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'311","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.167123+0000","last_change":"2024-09-14T10:49:23.395465+0000","last_active":"2024-09-14T12:41:41.167123+0000","last_peered":"2024-09-14T12:41:41.167123+0000","last_clean":"2024-09-14T12:41:41.167123+0000","last_became_active":"2024-09-14T10:49:23.395029+0000","last_became_peered":"2024-09-14T10:49:23.395029+0000","last_unstale":"2024-09-14T12:41:41.167123+0000","last_undegraded":"2024-09-14T12:41:41.167123+0000","last_fullsized":"2024-09-14T12:41:41.167123+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:51.643761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294264,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":508,"num_read_kb":13842,"num_write":1078,"num_write_kb":32575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'922","reported_seq":2538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:08.373535+0000","last_change":"2024-09-14T10:49:25.369478+0000","last_active":"2024-09-14T12:40:08.373535+0000","last_peered":"2024-09-14T12:40:08.373535+0000","last_clean":"2024-09-14T12:40:08.373535+0000","last_became_active":"2024-09-14T10:49:25.368723+0000","last_became_peered":"2024-09-14T10:49:25.368723+0000","last_unstale":"2024-09-14T12:40:08.373535+0000","last_undegraded":"2024-09-14T12:40:08.373535+0000","last_fullsized":"2024-09-14T12:40:08.373535+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:35.388355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6457,"num_read_kb":5960,"num_write":1431,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'303","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:25.779688+0000","last_change":"2024-09-14T10:49:23.397395+0000","last_active":"2024-09-14T12:39:25.779688+0000","last_peered":"2024-09-14T12:39:25.779688+0000","last_clean":"2024-09-14T12:39:25.779688+0000","last_became_active":"2024-09-14T10:49:23.396952+0000","last_became_peered":"2024-09-14T10:49:23.396952+0000","last_unstale":"2024-09-14T12:39:25.779688+0000","last_undegraded":"2024-09-14T12:39:25.779688+0000","last_fullsized":"2024-09-14T12:39:25.779688+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:46.006794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10144239,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":668,"num_read_kb":15587,"num_write":1187,"num_write_kb":19198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'487","reported_seq":2234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.631742+0000","last_change":"2024-09-14T10:49:25.369573+0000","last_active":"2024-09-14T12:43:47.631742+0000","last_peered":"2024-09-14T12:43:47.631742+0000","last_clean":"2024-09-14T12:43:47.631742+0000","last_became_active":"2024-09-14T10:49:25.369197+0000","last_became_peered":"2024-09-14T10:49:25.369197+0000","last_unstale":"2024-09-14T12:43:47.631742+0000","last_undegraded":"2024-09-14T12:43:47.631742+0000","last_fullsized":"2024-09-14T12:43:47.631742+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:39.097092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2591,"num_write":558,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'270","reported_seq":920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:26.135009+0000","last_change":"2024-09-14T10:49:23.387209+0000","last_active":"2024-09-14T12:39:26.135009+0000","last_peered":"2024-09-14T12:39:26.135009+0000","last_clean":"2024-09-14T12:39:26.135009+0000","last_became_active":"2024-09-14T10:49:23.386773+0000","last_became_peered":"2024-09-14T10:49:23.386773+0000","last_unstale":"2024-09-14T12:39:26.135009+0000","last_undegraded":"2024-09-14T12:39:26.135009+0000","last_fullsized":"2024-09-14T12:39:26.135009+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:38.080039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6302893,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":490,"num_read_kb":8718,"num_write":1001,"num_write_kb":39714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'428","reported_seq":2070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.811994+0000","last_change":"2024-09-14T10:49:25.404535+0000","last_active":"2024-09-14T12:41:55.811994+0000","last_peered":"2024-09-14T12:41:55.811994+0000","last_clean":"2024-09-14T12:41:55.811994+0000","last_became_active":"2024-09-14T10:49:25.404189+0000","last_became_peered":"2024-09-14T10:49:25.404189+0000","last_unstale":"2024-09-14T12:41:55.811994+0000","last_undegraded":"2024-09-14T12:41:55.811994+0000","last_fullsized":"2024-09-14T12:41:55.811994+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:54.606077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2519,"num_read_kb":2387,"num_write":515,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'337","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:27.635381+0000","last_change":"2024-09-14T10:49:23.354318+0000","last_active":"2024-09-14T12:39:27.635381+0000","last_peered":"2024-09-14T12:39:27.635381+0000","last_clean":"2024-09-14T12:39:27.635381+0000","last_became_active":"2024-09-14T10:49:23.353824+0000","last_became_peered":"2024-09-14T10:49:23.353824+0000","last_unstale":"2024-09-14T12:39:27.635381+0000","last_undegraded":"2024-09-14T12:39:27.635381+0000","last_fullsized":"2024-09-14T12:39:27.635381+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:21.688185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3446958,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":619,"num_read_kb":3209,"num_write":1233,"num_write_kb":30473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'1236","reported_seq":2941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.170607+0000","last_change":"2024-09-14T10:49:25.388326+0000","last_active":"2024-09-14T12:41:56.170607+0000","last_peered":"2024-09-14T12:41:56.170607+0000","last_clean":"2024-09-14T12:41:56.170607+0000","last_became_active":"2024-09-14T10:49:25.388008+0000","last_became_peered":"2024-09-14T10:49:25.388008+0000","last_unstale":"2024-09-14T12:41:56.170607+0000","last_undegraded":"2024-09-14T12:41:56.170607+0000","last_fullsized":"2024-09-14T12:41:56.170607+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":1200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:16.569310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5023,"num_write":1696,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'260","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:41.875394+0000","last_change":"2024-09-14T10:49:23.375365+0000","last_active":"2024-09-14T12:43:41.875394+0000","last_peered":"2024-09-14T12:43:41.875394+0000","last_clean":"2024-09-14T12:43:41.875394+0000","last_became_active":"2024-09-14T10:49:23.374194+0000","last_became_peered":"2024-09-14T10:49:23.374194+0000","last_unstale":"2024-09-14T12:43:41.875394+0000","last_undegraded":"2024-09-14T12:43:41.875394+0000","last_fullsized":"2024-09-14T12:43:41.875394+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:48.534483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10138434,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":420,"num_read_kb":30724,"num_write":905,"num_write_kb":46577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'763","reported_seq":2187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.688694+0000","last_change":"2024-09-14T10:49:25.396557+0000","last_active":"2024-09-14T12:43:47.688694+0000","last_peered":"2024-09-14T12:43:47.688694+0000","last_clean":"2024-09-14T12:43:47.688694+0000","last_became_active":"2024-09-14T10:49:25.395625+0000","last_became_peered":"2024-09-14T10:49:25.395625+0000","last_unstale":"2024-09-14T12:43:47.688694+0000","last_undegraded":"2024-09-14T12:43:47.688694+0000","last_fullsized":"2024-09-14T12:43:47.688694+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:55.126134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3607,"num_read_kb":3221,"num_write":1031,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'923","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496603+0000","last_change":"2024-09-14T10:49:25.378305+0000","last_active":"2024-09-14T12:41:26.496603+0000","last_peered":"2024-09-14T12:41:26.496603+0000","last_clean":"2024-09-14T12:41:26.496603+0000","last_became_active":"2024-09-14T10:49:25.377697+0000","last_became_peered":"2024-09-14T10:49:25.377697+0000","last_unstale":"2024-09-14T12:41:26.496603+0000","last_undegraded":"2024-09-14T12:41:26.496603+0000","last_fullsized":"2024-09-14T12:41:26.496603+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:55.143987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4426,"num_read_kb":3954,"num_write":1251,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'264","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.416054+0000","last_change":"2024-09-14T10:49:23.396284+0000","last_active":"2024-09-14T12:42:05.416054+0000","last_peered":"2024-09-14T12:42:05.416054+0000","last_clean":"2024-09-14T12:42:05.416054+0000","last_became_active":"2024-09-14T10:49:23.395881+0000","last_became_peered":"2024-09-14T10:49:23.395881+0000","last_unstale":"2024-09-14T12:42:05.416054+0000","last_undegraded":"2024-09-14T12:42:05.416054+0000","last_fullsized":"2024-09-14T12:42:05.416054+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:37.290462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10483156,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":532,"num_read_kb":45321,"num_write":882,"num_write_kb":34104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'503","reported_seq":2238,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.624807+0000","last_change":"2024-09-14T10:49:25.359959+0000","last_active":"2024-09-14T12:43:47.624807+0000","last_peered":"2024-09-14T12:43:47.624807+0000","last_clean":"2024-09-14T12:43:47.624807+0000","last_became_active":"2024-09-14T10:49:25.359419+0000","last_became_peered":"2024-09-14T10:49:25.359419+0000","last_unstale":"2024-09-14T12:43:47.624807+0000","last_undegraded":"2024-09-14T12:43:47.624807+0000","last_fullsized":"2024-09-14T12:43:47.624807+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:22.801370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2958,"num_read_kb":2787,"num_write":621,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'273","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:11.257777+0000","last_change":"2024-09-14T10:49:23.374078+0000","last_active":"2024-09-14T12:42:11.257777+0000","last_peered":"2024-09-14T12:42:11.257777+0000","last_clean":"2024-09-14T12:42:11.257777+0000","last_became_active":"2024-09-14T10:49:23.372672+0000","last_became_peered":"2024-09-14T10:49:23.372672+0000","last_unstale":"2024-09-14T12:42:11.257777+0000","last_undegraded":"2024-09-14T12:42:11.257777+0000","last_fullsized":"2024-09-14T12:42:11.257777+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.831678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8199771,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":527,"num_read_kb":8965,"num_write":975,"num_write_kb":20473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'401","reported_seq":1910,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.382357+0000","last_change":"2024-09-14T10:49:25.404208+0000","last_active":"2024-09-14T12:42:29.382357+0000","last_peered":"2024-09-14T12:42:29.382357+0000","last_clean":"2024-09-14T12:42:29.382357+0000","last_became_active":"2024-09-14T10:49:25.403885+0000","last_became_peered":"2024-09-14T10:49:25.403885+0000","last_unstale":"2024-09-14T12:42:29.382357+0000","last_undegraded":"2024-09-14T12:42:29.382357+0000","last_fullsized":"2024-09-14T12:42:29.382357+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:52.374511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2137,"num_read_kb":2023,"num_write":462,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'336","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:39.249338+0000","last_change":"2024-09-14T10:49:23.355237+0000","last_active":"2024-09-14T12:43:39.249338+0000","last_peered":"2024-09-14T12:43:39.249338+0000","last_clean":"2024-09-14T12:43:39.249338+0000","last_became_active":"2024-09-14T10:49:23.354127+0000","last_became_peered":"2024-09-14T10:49:23.354127+0000","last_unstale":"2024-09-14T12:43:39.249338+0000","last_undegraded":"2024-09-14T12:43:39.249338+0000","last_fullsized":"2024-09-14T12:43:39.249338+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:02.709768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2157026,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":723,"num_read_kb":56952,"num_write":1206,"num_write_kb":28690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"267'803","reported_seq":2347,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.456789+0000","last_change":"2024-09-14T10:49:25.396880+0000","last_active":"2024-09-14T12:42:29.456789+0000","last_peered":"2024-09-14T12:42:29.456789+0000","last_clean":"2024-09-14T12:42:29.456789+0000","last_became_active":"2024-09-14T10:49:25.396001+0000","last_became_peered":"2024-09-14T10:49:25.396001+0000","last_unstale":"2024-09-14T12:42:29.456789+0000","last_undegraded":"2024-09-14T12:42:29.456789+0000","last_fullsized":"2024-09-14T12:42:29.456789+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:58.603959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3888,"num_read_kb":3489,"num_write":1086,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'312","reported_seq":1101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795709+0000","last_change":"2024-09-14T10:49:23.387939+0000","last_active":"2024-09-14T12:40:35.795709+0000","last_peered":"2024-09-14T12:40:35.795709+0000","last_clean":"2024-09-14T12:40:35.795709+0000","last_became_active":"2024-09-14T10:49:23.387292+0000","last_became_peered":"2024-09-14T10:49:23.387292+0000","last_unstale":"2024-09-14T12:40:35.795709+0000","last_undegraded":"2024-09-14T12:40:35.795709+0000","last_fullsized":"2024-09-14T12:40:35.795709+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:32.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14639671,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":647,"num_read_kb":37760,"num_write":1121,"num_write_kb":55114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'373","reported_seq":1802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.628580+0000","last_change":"2024-09-14T10:49:25.394672+0000","last_active":"2024-09-14T12:43:47.628580+0000","last_peered":"2024-09-14T12:43:47.628580+0000","last_clean":"2024-09-14T12:43:47.628580+0000","last_became_active":"2024-09-14T10:49:25.394106+0000","last_became_peered":"2024-09-14T10:49:25.394106+0000","last_unstale":"2024-09-14T12:43:47.628580+0000","last_undegraded":"2024-09-14T12:43:47.628580+0000","last_fullsized":"2024-09-14T12:43:47.628580+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:13.420566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2013,"num_read_kb":1909,"num_write":433,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'373","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.412068+0000","last_change":"2024-09-14T10:49:23.364844+0000","last_active":"2024-09-14T12:42:05.412068+0000","last_peered":"2024-09-14T12:42:05.412068+0000","last_clean":"2024-09-14T12:42:05.412068+0000","last_became_active":"2024-09-14T10:49:23.364035+0000","last_became_peered":"2024-09-14T10:49:23.364035+0000","last_unstale":"2024-09-14T12:42:05.412068+0000","last_undegraded":"2024-09-14T12:42:05.412068+0000","last_fullsized":"2024-09-14T12:42:05.412068+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:50.556342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6985735,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":819,"num_read_kb":15225,"num_write":1177,"num_write_kb":26982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'779","reported_seq":2497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.206173+0000","last_change":"2024-09-14T10:49:25.372194+0000","last_active":"2024-09-14T12:42:22.206173+0000","last_peered":"2024-09-14T12:42:22.206173+0000","last_clean":"2024-09-14T12:42:22.206173+0000","last_became_active":"2024-09-14T10:49:25.371736+0000","last_became_peered":"2024-09-14T10:49:25.371736+0000","last_unstale":"2024-09-14T12:42:22.206173+0000","last_undegraded":"2024-09-14T12:42:22.206173+0000","last_fullsized":"2024-09-14T12:42:22.206173+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:00.150399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3876,"num_read_kb":3539,"num_write":1018,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'274","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.842429+0000","last_change":"2024-09-14T10:49:23.379017+0000","last_active":"2024-09-14T12:42:21.842429+0000","last_peered":"2024-09-14T12:42:21.842429+0000","last_clean":"2024-09-14T12:42:21.842429+0000","last_became_active":"2024-09-14T10:49:23.378269+0000","last_became_peered":"2024-09-14T10:49:23.378269+0000","last_unstale":"2024-09-14T12:42:21.842429+0000","last_undegraded":"2024-09-14T12:42:21.842429+0000","last_fullsized":"2024-09-14T12:42:21.842429+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:32.034490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6303647,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":481,"num_read_kb":35954,"num_write":1040,"num_write_kb":39786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'141","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.101213+0000","last_change":"2024-09-14T10:49:33.465171+0000","last_active":"2024-09-14T12:42:32.101213+0000","last_peered":"2024-09-14T12:42:32.101213+0000","last_clean":"2024-09-14T12:42:32.101213+0000","last_became_active":"2024-09-14T10:49:33.464427+0000","last_became_peered":"2024-09-14T10:49:33.464427+0000","last_unstale":"2024-09-14T12:42:32.101213+0000","last_undegraded":"2024-09-14T12:42:32.101213+0000","last_fullsized":"2024-09-14T12:42:32.101213+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.777578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":140,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'434","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.729509+0000","last_change":"2024-09-14T10:49:25.381601+0000","last_active":"2024-09-14T12:41:23.729509+0000","last_peered":"2024-09-14T12:41:23.729509+0000","last_clean":"2024-09-14T12:41:23.729509+0000","last_became_active":"2024-09-14T10:49:25.379409+0000","last_became_peered":"2024-09-14T10:49:25.379409+0000","last_unstale":"2024-09-14T12:41:23.729509+0000","last_undegraded":"2024-09-14T12:41:23.729509+0000","last_fullsized":"2024-09-14T12:41:23.729509+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:45.958192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2548,"num_read_kb":2434,"num_write":516,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'290","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496811+0000","last_change":"2024-09-14T10:49:23.366250+0000","last_active":"2024-09-14T12:41:26.496811+0000","last_peered":"2024-09-14T12:41:26.496811+0000","last_clean":"2024-09-14T12:41:26.496811+0000","last_became_active":"2024-09-14T10:49:23.365630+0000","last_became_peered":"2024-09-14T10:49:23.365630+0000","last_unstale":"2024-09-14T12:41:26.496811+0000","last_undegraded":"2024-09-14T12:41:26.496811+0000","last_fullsized":"2024-09-14T12:41:26.496811+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:00.413045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13969150,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":519,"num_read_kb":11787,"num_write":1121,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485373+0000","last_change":"2024-09-14T10:49:27.388283+0000","last_active":"2024-09-14T12:40:41.485373+0000","last_peered":"2024-09-14T12:40:41.485373+0000","last_clean":"2024-09-14T12:40:41.485373+0000","last_became_active":"2024-09-14T10:49:27.387803+0000","last_became_peered":"2024-09-14T10:49:27.387803+0000","last_unstale":"2024-09-14T12:40:41.485373+0000","last_undegraded":"2024-09-14T12:40:41.485373+0000","last_fullsized":"2024-09-14T12:40:41.485373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:58.901691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'383","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:05.603732+0000","last_change":"2024-09-14T10:49:29.387542+0000","last_active":"2024-09-14T12:43:05.603732+0000","last_peered":"2024-09-14T12:43:05.603732+0000","last_clean":"2024-09-14T12:43:05.603732+0000","last_became_active":"2024-09-14T10:49:29.386799+0000","last_became_peered":"2024-09-14T10:49:29.386799+0000","last_unstale":"2024-09-14T12:43:05.603732+0000","last_undegraded":"2024-09-14T12:43:05.603732+0000","last_fullsized":"2024-09-14T12:43:05.603732+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.432275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":1111,"num_write":482,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550661+0000","last_change":"2024-09-14T10:49:31.408598+0000","last_active":"2024-09-14T12:40:45.550661+0000","last_peered":"2024-09-14T12:40:45.550661+0000","last_clean":"2024-09-14T12:40:45.550661+0000","last_became_active":"2024-09-14T10:49:31.407831+0000","last_became_peered":"2024-09-14T10:49:31.407831+0000","last_unstale":"2024-09-14T12:40:45.550661+0000","last_undegraded":"2024-09-14T12:40:45.550661+0000","last_fullsized":"2024-09-14T12:40:45.550661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:34.507742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'138","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:25.404481+0000","last_change":"2024-09-14T10:49:33.475510+0000","last_active":"2024-09-14T12:42:25.404481+0000","last_peered":"2024-09-14T12:42:25.404481+0000","last_clean":"2024-09-14T12:42:25.404481+0000","last_became_active":"2024-09-14T10:49:33.474458+0000","last_became_peered":"2024-09-14T10:49:33.474458+0000","last_unstale":"2024-09-14T12:42:25.404481+0000","last_undegraded":"2024-09-14T12:42:25.404481+0000","last_fullsized":"2024-09-14T12:42:25.404481+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:19.578114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":162,"num_write":341,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'692","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.618190+0000","last_change":"2024-09-14T10:49:25.378257+0000","last_active":"2024-09-14T12:43:47.618190+0000","last_peered":"2024-09-14T12:43:47.618190+0000","last_clean":"2024-09-14T12:43:47.618190+0000","last_became_active":"2024-09-14T10:49:25.375112+0000","last_became_peered":"2024-09-14T10:49:25.375112+0000","last_unstale":"2024-09-14T12:43:47.618190+0000","last_undegraded":"2024-09-14T12:43:47.618190+0000","last_fullsized":"2024-09-14T12:43:47.618190+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:16.262424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3284,"num_write":889,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'369","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.553791+0000","last_change":"2024-09-14T10:49:23.385621+0000","last_active":"2024-09-14T12:41:26.553791+0000","last_peered":"2024-09-14T12:41:26.553791+0000","last_clean":"2024-09-14T12:41:26.553791+0000","last_became_active":"2024-09-14T10:49:23.384801+0000","last_became_peered":"2024-09-14T10:49:23.384801+0000","last_unstale":"2024-09-14T12:41:26.553791+0000","last_undegraded":"2024-09-14T12:41:26.553791+0000","last_fullsized":"2024-09-14T12:41:26.553791+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:37.649524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591992,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":673,"num_read_kb":6714,"num_write":1233,"num_write_kb":31721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.557476+0000","last_change":"2024-09-14T10:49:27.379539+0000","last_active":"2024-09-14T12:39:40.557476+0000","last_peered":"2024-09-14T12:39:40.557476+0000","last_clean":"2024-09-14T12:39:40.557476+0000","last_became_active":"2024-09-14T10:49:27.378702+0000","last_became_peered":"2024-09-14T10:49:27.378702+0000","last_unstale":"2024-09-14T12:39:40.557476+0000","last_undegraded":"2024-09-14T12:39:40.557476+0000","last_fullsized":"2024-09-14T12:39:40.557476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:50.849295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'127","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549519+0000","last_change":"2024-09-14T10:49:29.398866+0000","last_active":"2024-09-14T12:40:40.549519+0000","last_peered":"2024-09-14T12:40:40.549519+0000","last_clean":"2024-09-14T12:40:40.549519+0000","last_became_active":"2024-09-14T10:49:29.398354+0000","last_became_peered":"2024-09-14T10:49:29.398354+0000","last_unstale":"2024-09-14T12:40:40.549519+0000","last_undegraded":"2024-09-14T12:40:40.549519+0000","last_fullsized":"2024-09-14T12:40:40.549519+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:55.441392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550575+0000","last_change":"2024-09-14T10:49:31.434144+0000","last_active":"2024-09-14T12:40:45.550575+0000","last_peered":"2024-09-14T12:40:45.550575+0000","last_clean":"2024-09-14T12:40:45.550575+0000","last_became_active":"2024-09-14T10:49:31.433431+0000","last_became_peered":"2024-09-14T10:49:31.433431+0000","last_unstale":"2024-09-14T12:40:45.550575+0000","last_undegraded":"2024-09-14T12:40:45.550575+0000","last_fullsized":"2024-09-14T12:40:45.550575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:01.989175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'115","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.484054+0000","last_change":"2024-09-14T10:49:33.463822+0000","last_active":"2024-09-14T12:39:44.484054+0000","last_peered":"2024-09-14T12:39:44.484054+0000","last_clean":"2024-09-14T12:39:44.484054+0000","last_became_active":"2024-09-14T10:49:33.463124+0000","last_became_peered":"2024-09-14T10:49:33.463124+0000","last_unstale":"2024-09-14T12:39:44.484054+0000","last_undegraded":"2024-09-14T12:39:44.484054+0000","last_fullsized":"2024-09-14T12:39:44.484054+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:53.103119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'851","reported_seq":2501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.772346+0000","last_change":"2024-09-14T10:49:25.389867+0000","last_active":"2024-09-14T12:42:31.772346+0000","last_peered":"2024-09-14T12:42:31.772346+0000","last_clean":"2024-09-14T12:42:31.772346+0000","last_became_active":"2024-09-14T10:49:25.385678+0000","last_became_peered":"2024-09-14T10:49:25.385678+0000","last_unstale":"2024-09-14T12:42:31.772346+0000","last_undegraded":"2024-09-14T12:42:31.772346+0000","last_fullsized":"2024-09-14T12:42:31.772346+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:25.356791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4238,"num_read_kb":3841,"num_write":1159,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'314","reported_seq":1210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496668+0000","last_change":"2024-09-14T10:49:23.372266+0000","last_active":"2024-09-14T12:41:26.496668+0000","last_peered":"2024-09-14T12:41:26.496668+0000","last_clean":"2024-09-14T12:41:26.496668+0000","last_became_active":"2024-09-14T10:49:23.371893+0000","last_became_peered":"2024-09-14T10:49:23.371893+0000","last_unstale":"2024-09-14T12:41:26.496668+0000","last_undegraded":"2024-09-14T12:41:26.496668+0000","last_fullsized":"2024-09-14T12:41:26.496668+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:31.260794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9954594,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":1299,"num_read_kb":59405,"num_write":1078,"num_write_kb":37706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.570738+0000","last_change":"2024-09-14T10:49:27.380154+0000","last_active":"2024-09-14T12:40:40.570738+0000","last_peered":"2024-09-14T12:40:40.570738+0000","last_clean":"2024-09-14T12:40:40.570738+0000","last_became_active":"2024-09-14T10:49:27.379355+0000","last_became_peered":"2024-09-14T10:49:27.379355+0000","last_unstale":"2024-09-14T12:40:40.570738+0000","last_undegraded":"2024-09-14T12:40:40.570738+0000","last_fullsized":"2024-09-14T12:40:40.570738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:52.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.371862+0000","last_change":"2024-09-14T10:49:29.387051+0000","last_active":"2024-09-14T12:40:15.371862+0000","last_peered":"2024-09-14T12:40:15.371862+0000","last_clean":"2024-09-14T12:40:15.371862+0000","last_became_active":"2024-09-14T10:49:29.386264+0000","last_became_peered":"2024-09-14T10:49:29.386264+0000","last_unstale":"2024-09-14T12:40:15.371862+0000","last_undegraded":"2024-09-14T12:40:15.371862+0000","last_fullsized":"2024-09-14T12:40:15.371862+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:32.852231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'806","reported_seq":3017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.145566+0000","last_change":"2024-09-14T10:49:31.432319+0000","last_active":"2024-09-14T12:43:49.145566+0000","last_peered":"2024-09-14T12:43:49.145566+0000","last_clean":"2024-09-14T12:43:49.145566+0000","last_became_active":"2024-09-14T10:49:31.431702+0000","last_became_peered":"2024-09-14T10:49:31.431702+0000","last_unstale":"2024-09-14T12:43:49.145566+0000","last_undegraded":"2024-09-14T12:43:49.145566+0000","last_fullsized":"2024-09-14T12:43:49.145566+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:52.750405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'216","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.705477+0000","last_change":"2024-09-14T10:49:33.473107+0000","last_active":"2024-09-14T12:42:29.705477+0000","last_peered":"2024-09-14T12:42:29.705477+0000","last_clean":"2024-09-14T12:42:29.705477+0000","last_became_active":"2024-09-14T10:49:33.472433+0000","last_became_peered":"2024-09-14T10:49:33.472433+0000","last_unstale":"2024-09-14T12:42:29.705477+0000","last_undegraded":"2024-09-14T12:42:29.705477+0000","last_fullsized":"2024-09-14T12:42:29.705477+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":612,"num_write":471,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'451","reported_seq":2012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559941+0000","last_change":"2024-09-14T10:49:25.398553+0000","last_active":"2024-09-14T12:40:35.559941+0000","last_peered":"2024-09-14T12:40:35.559941+0000","last_clean":"2024-09-14T12:40:35.559941+0000","last_became_active":"2024-09-14T10:49:25.395255+0000","last_became_peered":"2024-09-14T10:49:25.395255+0000","last_unstale":"2024-09-14T12:40:35.559941+0000","last_undegraded":"2024-09-14T12:40:35.559941+0000","last_fullsized":"2024-09-14T12:40:35.559941+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:50.419167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2444,"num_read_kb":2309,"num_write":533,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'297","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.559409+0000","last_change":"2024-09-14T10:49:23.403490+0000","last_active":"2024-09-14T12:41:25.559409+0000","last_peered":"2024-09-14T12:41:25.559409+0000","last_clean":"2024-09-14T12:41:25.559409+0000","last_became_active":"2024-09-14T10:49:23.403079+0000","last_became_peered":"2024-09-14T10:49:23.403079+0000","last_unstale":"2024-09-14T12:41:25.559409+0000","last_undegraded":"2024-09-14T12:41:25.559409+0000","last_fullsized":"2024-09-14T12:41:25.559409+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:43.895377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15567719,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":495,"num_read_kb":46330,"num_write":1049,"num_write_kb":49327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485445+0000","last_change":"2024-09-14T10:49:27.392398+0000","last_active":"2024-09-14T12:40:41.485445+0000","last_peered":"2024-09-14T12:40:41.485445+0000","last_clean":"2024-09-14T12:40:41.485445+0000","last_became_active":"2024-09-14T10:49:27.391823+0000","last_became_peered":"2024-09-14T10:49:27.391823+0000","last_unstale":"2024-09-14T12:40:41.485445+0000","last_undegraded":"2024-09-14T12:40:41.485445+0000","last_fullsized":"2024-09-14T12:40:41.485445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:59.037074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'320","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:06.186645+0000","last_change":"2024-09-14T10:49:29.385602+0000","last_active":"2024-09-14T12:43:06.186645+0000","last_peered":"2024-09-14T12:43:06.186645+0000","last_clean":"2024-09-14T12:43:06.186645+0000","last_became_active":"2024-09-14T10:49:29.385023+0000","last_became_peered":"2024-09-14T10:49:29.385023+0000","last_unstale":"2024-09-14T12:43:06.186645+0000","last_undegraded":"2024-09-14T12:43:06.186645+0000","last_fullsized":"2024-09-14T12:43:06.186645+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:43.706717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":1019,"num_write":418,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'822","reported_seq":5655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105420+0000","last_change":"2024-09-14T10:49:31.425706+0000","last_active":"2024-09-14T12:43:49.105420+0000","last_peered":"2024-09-14T12:43:49.105420+0000","last_clean":"2024-09-14T12:43:49.105420+0000","last_became_active":"2024-09-14T10:49:31.424873+0000","last_became_peered":"2024-09-14T10:49:31.424873+0000","last_unstale":"2024-09-14T12:43:49.105420+0000","last_undegraded":"2024-09-14T12:43:49.105420+0000","last_fullsized":"2024-09-14T12:43:49.105420+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:39.590615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'493","reported_seq":2117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.788525+0000","last_change":"2024-09-14T10:49:25.373828+0000","last_active":"2024-09-14T12:41:16.788525+0000","last_peered":"2024-09-14T12:41:16.788525+0000","last_clean":"2024-09-14T12:41:16.788525+0000","last_became_active":"2024-09-14T10:49:25.372711+0000","last_became_peered":"2024-09-14T10:49:25.372711+0000","last_unstale":"2024-09-14T12:41:16.788525+0000","last_undegraded":"2024-09-14T12:41:16.788525+0000","last_fullsized":"2024-09-14T12:41:16.788525+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:46.395982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2694,"num_read_kb":2523,"num_write":626,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'317","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.998103+0000","last_change":"2024-09-14T10:49:23.363597+0000","last_active":"2024-09-14T12:40:14.998103+0000","last_peered":"2024-09-14T12:40:14.998103+0000","last_clean":"2024-09-14T12:40:14.998103+0000","last_became_active":"2024-09-14T10:49:23.363126+0000","last_became_peered":"2024-09-14T10:49:23.363126+0000","last_unstale":"2024-09-14T12:40:14.998103+0000","last_undegraded":"2024-09-14T12:40:14.998103+0000","last_fullsized":"2024-09-14T12:40:14.998103+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:44.328445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2353159,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":645,"num_read_kb":10241,"num_write":1136,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.540062+0000","last_change":"2024-09-14T10:49:27.382040+0000","last_active":"2024-09-14T12:40:00.540062+0000","last_peered":"2024-09-14T12:40:00.540062+0000","last_clean":"2024-09-14T12:40:00.540062+0000","last_became_active":"2024-09-14T10:49:27.380063+0000","last_became_peered":"2024-09-14T10:49:27.380063+0000","last_unstale":"2024-09-14T12:40:00.540062+0000","last_undegraded":"2024-09-14T12:40:00.540062+0000","last_fullsized":"2024-09-14T12:40:00.540062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:23.504934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'437","reported_seq":1137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.819664+0000","last_change":"2024-09-14T10:49:29.383878+0000","last_active":"2024-09-14T12:42:30.819664+0000","last_peered":"2024-09-14T12:42:30.819664+0000","last_clean":"2024-09-14T12:42:30.819664+0000","last_became_active":"2024-09-14T10:49:29.383306+0000","last_became_peered":"2024-09-14T10:49:29.383306+0000","last_unstale":"2024-09-14T12:42:30.819664+0000","last_undegraded":"2024-09-14T12:42:30.819664+0000","last_fullsized":"2024-09-14T12:42:30.819664+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:17.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59853,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":699,"num_read_kb":1152,"num_write":526,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532617+0000","last_change":"2024-09-14T10:49:31.407042+0000","last_active":"2024-09-14T12:39:51.532617+0000","last_peered":"2024-09-14T12:39:51.532617+0000","last_clean":"2024-09-14T12:39:51.532617+0000","last_became_active":"2024-09-14T10:49:31.406293+0000","last_became_peered":"2024-09-14T10:49:31.406293+0000","last_unstale":"2024-09-14T12:39:51.532617+0000","last_undegraded":"2024-09-14T12:39:51.532617+0000","last_fullsized":"2024-09-14T12:39:51.532617+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:15.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'561","reported_seq":1444,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.641698+0000","last_change":"2024-09-14T10:49:33.475077+0000","last_active":"2024-09-14T12:43:48.641698+0000","last_peered":"2024-09-14T12:43:48.641698+0000","last_clean":"2024-09-14T12:43:48.641698+0000","last_became_active":"2024-09-14T10:49:33.474412+0000","last_became_peered":"2024-09-14T10:49:33.474412+0000","last_unstale":"2024-09-14T12:43:48.641698+0000","last_undegraded":"2024-09-14T12:43:48.641698+0000","last_fullsized":"2024-09-14T12:43:48.641698+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:52.098600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1493,"num_read_kb":1442,"num_write":1188,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'446","reported_seq":2088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538801+0000","last_change":"2024-09-14T10:49:25.405914+0000","last_active":"2024-09-14T12:39:55.538801+0000","last_peered":"2024-09-14T12:39:55.538801+0000","last_clean":"2024-09-14T12:39:55.538801+0000","last_became_active":"2024-09-14T10:49:25.405499+0000","last_became_peered":"2024-09-14T10:49:25.405499+0000","last_unstale":"2024-09-14T12:39:55.538801+0000","last_undegraded":"2024-09-14T12:39:55.538801+0000","last_fullsized":"2024-09-14T12:39:55.538801+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:54.507625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2382,"num_write":513,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'316","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.415753+0000","last_change":"2024-09-14T10:49:23.403913+0000","last_active":"2024-09-14T12:41:23.415753+0000","last_peered":"2024-09-14T12:41:23.415753+0000","last_clean":"2024-09-14T12:41:23.415753+0000","last_became_active":"2024-09-14T10:49:23.403551+0000","last_became_peered":"2024-09-14T10:49:23.403551+0000","last_unstale":"2024-09-14T12:41:23.415753+0000","last_undegraded":"2024-09-14T12:41:23.415753+0000","last_fullsized":"2024-09-14T12:41:23.415753+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:47.233133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224360,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":621,"num_read_kb":10639,"num_write":1173,"num_write_kb":29906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.535230+0000","last_change":"2024-09-14T10:49:27.373230+0000","last_active":"2024-09-14T12:40:01.535230+0000","last_peered":"2024-09-14T12:40:01.535230+0000","last_clean":"2024-09-14T12:40:01.535230+0000","last_became_active":"2024-09-14T10:49:27.372510+0000","last_became_peered":"2024-09-14T10:49:27.372510+0000","last_unstale":"2024-09-14T12:40:01.535230+0000","last_undegraded":"2024-09-14T12:40:01.535230+0000","last_fullsized":"2024-09-14T12:40:01.535230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:58.625869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'299","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.708769+0000","last_change":"2024-09-14T10:49:29.378472+0000","last_active":"2024-09-14T12:43:47.708769+0000","last_peered":"2024-09-14T12:43:47.708769+0000","last_clean":"2024-09-14T12:43:47.708769+0000","last_became_active":"2024-09-14T10:49:29.377710+0000","last_became_peered":"2024-09-14T10:49:29.377710+0000","last_unstale":"2024-09-14T12:43:47.708769+0000","last_undegraded":"2024-09-14T12:43:47.708769+0000","last_fullsized":"2024-09-14T12:43:47.708769+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:54.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53441,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":938,"num_write":382,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569489+0000","last_change":"2024-09-14T10:49:31.413000+0000","last_active":"2024-09-14T12:40:35.569489+0000","last_peered":"2024-09-14T12:40:35.569489+0000","last_clean":"2024-09-14T12:40:35.569489+0000","last_became_active":"2024-09-14T10:49:31.412080+0000","last_became_peered":"2024-09-14T10:49:31.412080+0000","last_unstale":"2024-09-14T12:40:35.569489+0000","last_undegraded":"2024-09-14T12:40:35.569489+0000","last_fullsized":"2024-09-14T12:40:35.569489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.692991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2528","reported_seq":4388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.576044+0000","last_change":"2024-09-14T10:49:33.479265+0000","last_active":"2024-09-14T12:42:30.576044+0000","last_peered":"2024-09-14T12:42:30.576044+0000","last_clean":"2024-09-14T12:42:30.576044+0000","last_became_active":"2024-09-14T10:49:33.478542+0000","last_became_peered":"2024-09-14T10:49:33.478542+0000","last_unstale":"2024-09-14T12:42:30.576044+0000","last_undegraded":"2024-09-14T12:42:30.576044+0000","last_fullsized":"2024-09-14T12:42:30.576044+0000","mapping_epoch":36,"log_start":"267'2500","ondisk_log_start":"267'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:52.785039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6246,"num_read_kb":6243,"num_write":5128,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'497","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.824180+0000","last_change":"2024-09-14T10:49:25.381367+0000","last_active":"2024-09-14T12:41:11.824180+0000","last_peered":"2024-09-14T12:41:11.824180+0000","last_clean":"2024-09-14T12:41:11.824180+0000","last_became_active":"2024-09-14T10:49:25.380967+0000","last_became_peered":"2024-09-14T10:49:25.380967+0000","last_unstale":"2024-09-14T12:41:11.824180+0000","last_undegraded":"2024-09-14T12:41:11.824180+0000","last_fullsized":"2024-09-14T12:41:11.824180+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:55.558427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2697,"num_read_kb":2531,"num_write":585,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'303","reported_seq":942,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:41.470216+0000","last_change":"2024-09-14T10:49:23.356775+0000","last_active":"2024-09-14T12:39:41.470216+0000","last_peered":"2024-09-14T12:39:41.470216+0000","last_clean":"2024-09-14T12:39:41.470216+0000","last_became_active":"2024-09-14T10:49:23.355809+0000","last_became_peered":"2024-09-14T10:49:23.355809+0000","last_unstale":"2024-09-14T12:39:41.470216+0000","last_undegraded":"2024-09-14T12:39:41.470216+0000","last_fullsized":"2024-09-14T12:39:41.470216+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:13.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11164066,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":501,"num_read_kb":12441,"num_write":1125,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:45.547722+0000","last_change":"2024-09-14T10:49:27.379127+0000","last_active":"2024-09-14T12:39:45.547722+0000","last_peered":"2024-09-14T12:39:45.547722+0000","last_clean":"2024-09-14T12:39:45.547722+0000","last_became_active":"2024-09-14T10:49:27.378028+0000","last_became_peered":"2024-09-14T10:49:27.378028+0000","last_unstale":"2024-09-14T12:39:45.547722+0000","last_undegraded":"2024-09-14T12:39:45.547722+0000","last_fullsized":"2024-09-14T12:39:45.547722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:49.172785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'394","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:42.933132+0000","last_change":"2024-09-14T10:49:29.389462+0000","last_active":"2024-09-14T12:43:42.933132+0000","last_peered":"2024-09-14T12:43:42.933132+0000","last_clean":"2024-09-14T12:43:42.933132+0000","last_became_active":"2024-09-14T10:49:29.388786+0000","last_became_peered":"2024-09-14T10:49:29.388786+0000","last_unstale":"2024-09-14T12:43:42.933132+0000","last_undegraded":"2024-09-14T12:43:42.933132+0000","last_fullsized":"2024-09-14T12:43:42.933132+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:53.840769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63295,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1173,"num_write":498,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'821","reported_seq":3416,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105522+0000","last_change":"2024-09-14T10:49:31.420988+0000","last_active":"2024-09-14T12:43:49.105522+0000","last_peered":"2024-09-14T12:43:49.105522+0000","last_clean":"2024-09-14T12:43:49.105522+0000","last_became_active":"2024-09-14T10:49:31.420178+0000","last_became_peered":"2024-09-14T10:49:31.420178+0000","last_unstale":"2024-09-14T12:43:49.105522+0000","last_undegraded":"2024-09-14T12:43:49.105522+0000","last_fullsized":"2024-09-14T12:43:49.105522+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:41.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'144","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.388041+0000","last_change":"2024-09-14T10:49:33.463351+0000","last_active":"2024-09-14T12:43:47.388041+0000","last_peered":"2024-09-14T12:43:47.388041+0000","last_clean":"2024-09-14T12:43:47.388041+0000","last_became_active":"2024-09-14T10:49:33.462780+0000","last_became_peered":"2024-09-14T10:49:33.462780+0000","last_unstale":"2024-09-14T12:43:47.388041+0000","last_undegraded":"2024-09-14T12:43:47.388041+0000","last_fullsized":"2024-09-14T12:43:47.388041+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:58.346452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'836","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.604978+0000","last_change":"2024-09-14T10:49:25.391283+0000","last_active":"2024-09-14T12:43:47.604978+0000","last_peered":"2024-09-14T12:43:47.604978+0000","last_clean":"2024-09-14T12:43:47.604978+0000","last_became_active":"2024-09-14T10:49:25.389567+0000","last_became_peered":"2024-09-14T10:49:25.389567+0000","last_unstale":"2024-09-14T12:43:47.604978+0000","last_undegraded":"2024-09-14T12:43:47.604978+0000","last_fullsized":"2024-09-14T12:43:47.604978+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:34.685545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4051,"num_read_kb":3641,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'305","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782903+0000","last_change":"2024-09-14T10:49:23.355908+0000","last_active":"2024-09-14T12:39:40.782903+0000","last_peered":"2024-09-14T12:39:40.782903+0000","last_clean":"2024-09-14T12:39:40.782903+0000","last_became_active":"2024-09-14T10:49:23.354452+0000","last_became_peered":"2024-09-14T10:49:23.354452+0000","last_unstale":"2024-09-14T12:39:40.782903+0000","last_undegraded":"2024-09-14T12:39:40.782903+0000","last_fullsized":"2024-09-14T12:39:40.782903+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:06:03.903748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16810810,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":531,"num_read_kb":20988,"num_write":1070,"num_write_kb":31512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:21.539587+0000","last_change":"2024-09-14T10:49:27.354654+0000","last_active":"2024-09-14T12:40:21.539587+0000","last_peered":"2024-09-14T12:40:21.539587+0000","last_clean":"2024-09-14T12:40:21.539587+0000","last_became_active":"2024-09-14T10:49:27.353932+0000","last_became_peered":"2024-09-14T10:49:27.353932+0000","last_unstale":"2024-09-14T12:40:21.539587+0000","last_undegraded":"2024-09-14T12:40:21.539587+0000","last_fullsized":"2024-09-14T12:40:21.539587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:21.532896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'488","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.578615+0000","last_change":"2024-09-14T10:49:29.379743+0000","last_active":"2024-09-14T12:43:48.578615+0000","last_peered":"2024-09-14T12:43:48.578615+0000","last_clean":"2024-09-14T12:43:48.578615+0000","last_became_active":"2024-09-14T10:49:29.378107+0000","last_became_peered":"2024-09-14T10:49:29.378107+0000","last_unstale":"2024-09-14T12:43:48.578615+0000","last_undegraded":"2024-09-14T12:43:48.578615+0000","last_fullsized":"2024-09-14T12:43:48.578615+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:49.708518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96126,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":820,"num_read_kb":1683,"num_write":664,"num_write_kb":517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:05.552752+0000","last_change":"2024-09-14T10:49:31.410161+0000","last_active":"2024-09-14T12:40:05.552752+0000","last_peered":"2024-09-14T12:40:05.552752+0000","last_clean":"2024-09-14T12:40:05.552752+0000","last_became_active":"2024-09-14T10:49:31.409247+0000","last_became_peered":"2024-09-14T10:49:31.409247+0000","last_unstale":"2024-09-14T12:40:05.552752+0000","last_undegraded":"2024-09-14T12:40:05.552752+0000","last_fullsized":"2024-09-14T12:40:05.552752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:49.593404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'132","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:14.764993+0000","last_change":"2024-09-14T10:49:33.462318+0000","last_active":"2024-09-14T12:42:14.764993+0000","last_peered":"2024-09-14T12:42:14.764993+0000","last_clean":"2024-09-14T12:42:14.764993+0000","last_became_active":"2024-09-14T10:49:33.461635+0000","last_became_peered":"2024-09-14T10:49:33.461635+0000","last_unstale":"2024-09-14T12:42:14.764993+0000","last_undegraded":"2024-09-14T12:42:14.764993+0000","last_fullsized":"2024-09-14T12:42:14.764993+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:57.796265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":314,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'839","reported_seq":2531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.621508+0000","last_change":"2024-09-14T10:49:25.361656+0000","last_active":"2024-09-14T12:43:47.621508+0000","last_peered":"2024-09-14T12:43:47.621508+0000","last_clean":"2024-09-14T12:43:47.621508+0000","last_became_active":"2024-09-14T10:49:25.361148+0000","last_became_peered":"2024-09-14T10:49:25.361148+0000","last_unstale":"2024-09-14T12:43:47.621508+0000","last_undegraded":"2024-09-14T12:43:47.621508+0000","last_fullsized":"2024-09-14T12:43:47.621508+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:41.324755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4070,"num_read_kb":3684,"num_write":1107,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'344","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.638949+0000","last_change":"2024-09-14T10:49:23.375908+0000","last_active":"2024-09-14T12:44:04.638949+0000","last_peered":"2024-09-14T12:44:04.638949+0000","last_clean":"2024-09-14T12:44:04.638949+0000","last_became_active":"2024-09-14T10:49:23.375005+0000","last_became_peered":"2024-09-14T10:49:23.375005+0000","last_unstale":"2024-09-14T12:44:04.638949+0000","last_undegraded":"2024-09-14T12:44:04.638949+0000","last_fullsized":"2024-09-14T12:44:04.638949+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:45.791369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":714,"num_read_kb":12064,"num_write":1097,"num_write_kb":35066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.730652+0000","last_change":"2024-09-14T10:49:27.386488+0000","last_active":"2024-09-14T12:39:44.730652+0000","last_peered":"2024-09-14T12:39:44.730652+0000","last_clean":"2024-09-14T12:39:44.730652+0000","last_became_active":"2024-09-14T10:49:27.385658+0000","last_became_peered":"2024-09-14T10:49:27.385658+0000","last_unstale":"2024-09-14T12:39:44.730652+0000","last_undegraded":"2024-09-14T12:39:44.730652+0000","last_fullsized":"2024-09-14T12:39:44.730652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:00.744114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'362","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.569445+0000","last_change":"2024-09-14T10:49:29.391486+0000","last_active":"2024-09-14T12:42:00.569445+0000","last_peered":"2024-09-14T12:42:00.569445+0000","last_clean":"2024-09-14T12:42:00.569445+0000","last_became_active":"2024-09-14T10:49:29.388618+0000","last_became_peered":"2024-09-14T10:49:29.388618+0000","last_unstale":"2024-09-14T12:42:00.569445+0000","last_undegraded":"2024-09-14T12:42:00.569445+0000","last_fullsized":"2024-09-14T12:42:00.569445+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:27.307665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":601,"num_read_kb":1144,"num_write":528,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:09.736444+0000","last_change":"2024-09-14T10:49:31.418529+0000","last_active":"2024-09-14T12:40:09.736444+0000","last_peered":"2024-09-14T12:40:09.736444+0000","last_clean":"2024-09-14T12:40:09.736444+0000","last_became_active":"2024-09-14T10:49:31.417797+0000","last_became_peered":"2024-09-14T10:49:31.417797+0000","last_unstale":"2024-09-14T12:40:09.736444+0000","last_undegraded":"2024-09-14T12:40:09.736444+0000","last_fullsized":"2024-09-14T12:40:09.736444+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:56.573341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'113","reported_seq":629,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.362386+0000","last_change":"2024-09-14T10:49:33.455868+0000","last_active":"2024-09-14T12:42:05.362386+0000","last_peered":"2024-09-14T12:42:05.362386+0000","last_clean":"2024-09-14T12:42:05.362386+0000","last_became_active":"2024-09-14T10:49:33.455162+0000","last_became_peered":"2024-09-14T10:49:33.455162+0000","last_unstale":"2024-09-14T12:42:05.362386+0000","last_undegraded":"2024-09-14T12:42:05.362386+0000","last_fullsized":"2024-09-14T12:42:05.362386+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:42.886276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'587","reported_seq":2424,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:57.861667+0000","last_change":"2024-09-14T10:49:25.378821+0000","last_active":"2024-09-14T12:39:57.861667+0000","last_peered":"2024-09-14T12:39:57.861667+0000","last_clean":"2024-09-14T12:39:57.861667+0000","last_became_active":"2024-09-14T10:49:25.377866+0000","last_became_peered":"2024-09-14T10:49:25.377866+0000","last_unstale":"2024-09-14T12:39:57.861667+0000","last_undegraded":"2024-09-14T12:39:57.861667+0000","last_fullsized":"2024-09-14T12:39:57.861667+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:16.585676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3293,"num_read_kb":3082,"num_write":722,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'257","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.477225+0000","last_change":"2024-09-14T10:49:23.362931+0000","last_active":"2024-09-14T12:40:11.477225+0000","last_peered":"2024-09-14T12:40:11.477225+0000","last_clean":"2024-09-14T12:40:11.477225+0000","last_became_active":"2024-09-14T10:49:23.362203+0000","last_became_peered":"2024-09-14T10:49:23.362203+0000","last_unstale":"2024-09-14T12:40:11.477225+0000","last_undegraded":"2024-09-14T12:40:11.477225+0000","last_fullsized":"2024-09-14T12:40:11.477225+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:22.083961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5248060,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":443,"num_read_kb":29276,"num_write":938,"num_write_kb":13260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:45.547789+0000","last_change":"2024-09-14T10:49:27.378611+0000","last_active":"2024-09-14T12:39:45.547789+0000","last_peered":"2024-09-14T12:39:45.547789+0000","last_clean":"2024-09-14T12:39:45.547789+0000","last_became_active":"2024-09-14T10:49:27.377674+0000","last_became_peered":"2024-09-14T10:49:27.377674+0000","last_unstale":"2024-09-14T12:39:45.547789+0000","last_undegraded":"2024-09-14T12:39:45.547789+0000","last_fullsized":"2024-09-14T12:39:45.547789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:20.096097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'391","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.369060+0000","last_change":"2024-09-14T10:49:29.394103+0000","last_active":"2024-09-14T12:42:30.369060+0000","last_peered":"2024-09-14T12:42:30.369060+0000","last_clean":"2024-09-14T12:42:30.369060+0000","last_became_active":"2024-09-14T10:49:29.393350+0000","last_became_peered":"2024-09-14T10:49:29.393350+0000","last_unstale":"2024-09-14T12:42:30.369060+0000","last_undegraded":"2024-09-14T12:42:30.369060+0000","last_fullsized":"2024-09-14T12:42:30.369060+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.411758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64930,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":641,"num_read_kb":1187,"num_write":506,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'793","reported_seq":5225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.691608+0000","last_change":"2024-09-14T10:49:31.423468+0000","last_active":"2024-09-14T12:44:01.691608+0000","last_peered":"2024-09-14T12:44:01.691608+0000","last_clean":"2024-09-14T12:44:01.691608+0000","last_became_active":"2024-09-14T10:49:31.422534+0000","last_became_peered":"2024-09-14T10:49:31.422534+0000","last_unstale":"2024-09-14T12:44:01.691608+0000","last_undegraded":"2024-09-14T12:44:01.691608+0000","last_fullsized":"2024-09-14T12:44:01.691608+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:58.304373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'158","reported_seq":729,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.415473+0000","last_change":"2024-09-14T10:49:33.466535+0000","last_active":"2024-09-14T12:42:29.415473+0000","last_peered":"2024-09-14T12:42:29.415473+0000","last_clean":"2024-09-14T12:42:29.415473+0000","last_became_active":"2024-09-14T10:49:33.466024+0000","last_became_peered":"2024-09-14T10:49:33.466024+0000","last_unstale":"2024-09-14T12:42:29.415473+0000","last_undegraded":"2024-09-14T12:42:29.415473+0000","last_fullsized":"2024-09-14T12:42:29.415473+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:24.127809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":335,"num_read_kb":285,"num_write":383,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'671","reported_seq":2389,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.135328+0000","last_change":"2024-09-14T10:49:25.381139+0000","last_active":"2024-09-14T12:42:22.135328+0000","last_peered":"2024-09-14T12:42:22.135328+0000","last_clean":"2024-09-14T12:42:22.135328+0000","last_became_active":"2024-09-14T10:49:25.380712+0000","last_became_peered":"2024-09-14T10:49:25.380712+0000","last_unstale":"2024-09-14T12:42:22.135328+0000","last_undegraded":"2024-09-14T12:42:22.135328+0000","last_fullsized":"2024-09-14T12:42:22.135328+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:50.719358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3719,"num_read_kb":3469,"num_write":935,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'293","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.507425+0000","last_change":"2024-09-14T10:49:23.367590+0000","last_active":"2024-09-14T12:42:06.507425+0000","last_peered":"2024-09-14T12:42:06.507425+0000","last_clean":"2024-09-14T12:42:06.507425+0000","last_became_active":"2024-09-14T10:49:23.367200+0000","last_became_peered":"2024-09-14T10:49:23.367200+0000","last_unstale":"2024-09-14T12:42:06.507425+0000","last_undegraded":"2024-09-14T12:42:06.507425+0000","last_fullsized":"2024-09-14T12:42:06.507425+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:06.469171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14338667,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":622,"num_read_kb":77246,"num_write":1091,"num_write_kb":38780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1489,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.516242+0000","last_change":"2024-09-14T10:49:27.380444+0000","last_active":"2024-09-14T12:43:48.516242+0000","last_peered":"2024-09-14T12:43:48.516242+0000","last_clean":"2024-09-14T12:43:48.516242+0000","last_became_active":"2024-09-14T10:49:27.379952+0000","last_became_peered":"2024-09-14T10:49:27.379952+0000","last_unstale":"2024-09-14T12:43:48.516242+0000","last_undegraded":"2024-09-14T12:43:48.516242+0000","last_fullsized":"2024-09-14T12:43:48.516242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:22.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'141","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561715+0000","last_change":"2024-09-14T10:49:29.373528+0000","last_active":"2024-09-14T12:42:01.561715+0000","last_peered":"2024-09-14T12:42:01.561715+0000","last_clean":"2024-09-14T12:42:01.561715+0000","last_became_active":"2024-09-14T10:49:29.371803+0000","last_became_peered":"2024-09-14T10:49:29.371803+0000","last_unstale":"2024-09-14T12:42:01.561715+0000","last_undegraded":"2024-09-14T12:42:01.561715+0000","last_fullsized":"2024-09-14T12:42:01.561715+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:44.432155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'793","reported_seq":3142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.104720+0000","last_change":"2024-09-14T10:49:31.427780+0000","last_active":"2024-09-14T12:43:49.104720+0000","last_peered":"2024-09-14T12:43:49.104720+0000","last_clean":"2024-09-14T12:43:49.104720+0000","last_became_active":"2024-09-14T10:49:31.427179+0000","last_became_peered":"2024-09-14T10:49:31.427179+0000","last_unstale":"2024-09-14T12:43:49.104720+0000","last_undegraded":"2024-09-14T12:43:49.104720+0000","last_fullsized":"2024-09-14T12:43:49.104720+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:38.189084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'134","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:28.826359+0000","last_change":"2024-09-14T10:49:33.471795+0000","last_active":"2024-09-14T12:42:28.826359+0000","last_peered":"2024-09-14T12:42:28.826359+0000","last_clean":"2024-09-14T12:42:28.826359+0000","last_became_active":"2024-09-14T10:49:33.468831+0000","last_became_peered":"2024-09-14T10:49:33.468831+0000","last_unstale":"2024-09-14T12:42:28.826359+0000","last_undegraded":"2024-09-14T12:42:28.826359+0000","last_fullsized":"2024-09-14T12:42:28.826359+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:46.840813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":148,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'487","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.736832+0000","last_change":"2024-09-14T10:49:25.371388+0000","last_active":"2024-09-14T12:41:23.736832+0000","last_peered":"2024-09-14T12:41:23.736832+0000","last_clean":"2024-09-14T12:41:23.736832+0000","last_became_active":"2024-09-14T10:49:25.370649+0000","last_became_peered":"2024-09-14T10:49:25.370649+0000","last_unstale":"2024-09-14T12:41:23.736832+0000","last_undegraded":"2024-09-14T12:41:23.736832+0000","last_fullsized":"2024-09-14T12:41:23.736832+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:54.984697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2839,"num_read_kb":2682,"num_write":610,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'310","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:21.114878+0000","last_change":"2024-09-14T10:49:23.359479+0000","last_active":"2024-09-14T12:41:21.114878+0000","last_peered":"2024-09-14T12:41:21.114878+0000","last_clean":"2024-09-14T12:41:21.114878+0000","last_became_active":"2024-09-14T10:49:23.355864+0000","last_became_peered":"2024-09-14T10:49:23.355864+0000","last_unstale":"2024-09-14T12:41:21.114878+0000","last_undegraded":"2024-09-14T12:41:21.114878+0000","last_fullsized":"2024-09-14T12:41:21.114878+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:44.897414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12833623,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":642,"num_read_kb":100725,"num_write":1023,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:46.471497+0000","last_change":"2024-09-14T10:49:27.391003+0000","last_active":"2024-09-14T12:39:46.471497+0000","last_peered":"2024-09-14T12:39:46.471497+0000","last_clean":"2024-09-14T12:39:46.471497+0000","last_became_active":"2024-09-14T10:49:27.390169+0000","last_became_peered":"2024-09-14T10:49:27.390169+0000","last_unstale":"2024-09-14T12:39:46.471497+0000","last_undegraded":"2024-09-14T12:39:46.471497+0000","last_fullsized":"2024-09-14T12:39:46.471497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:41.899346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'414","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.569385+0000","last_change":"2024-09-14T10:49:29.401131+0000","last_active":"2024-09-14T12:42:00.569385+0000","last_peered":"2024-09-14T12:42:00.569385+0000","last_clean":"2024-09-14T12:42:00.569385+0000","last_became_active":"2024-09-14T10:49:29.400776+0000","last_became_peered":"2024-09-14T10:49:29.400776+0000","last_unstale":"2024-09-14T12:42:00.569385+0000","last_undegraded":"2024-09-14T12:42:00.569385+0000","last_fullsized":"2024-09-14T12:42:00.569385+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:04.011436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54314,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":1124,"num_write":508,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140700+0000","last_change":"2024-09-14T10:49:31.421446+0000","last_active":"2024-09-14T12:39:51.140700+0000","last_peered":"2024-09-14T12:39:51.140700+0000","last_clean":"2024-09-14T12:39:51.140700+0000","last_became_active":"2024-09-14T10:49:31.418131+0000","last_became_peered":"2024-09-14T10:49:31.418131+0000","last_unstale":"2024-09-14T12:39:51.140700+0000","last_undegraded":"2024-09-14T12:39:51.140700+0000","last_fullsized":"2024-09-14T12:39:51.140700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:15.418822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'138","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.192828+0000","last_change":"2024-09-14T10:49:33.457926+0000","last_active":"2024-09-14T12:42:31.192828+0000","last_peered":"2024-09-14T12:42:31.192828+0000","last_clean":"2024-09-14T12:42:31.192828+0000","last_became_active":"2024-09-14T10:49:33.455953+0000","last_became_peered":"2024-09-14T10:49:33.455953+0000","last_unstale":"2024-09-14T12:42:31.192828+0000","last_undegraded":"2024-09-14T12:42:31.192828+0000","last_fullsized":"2024-09-14T12:42:31.192828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:50.433913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":155,"num_write":340,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'412","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.340214+0000","last_change":"2024-09-14T10:49:25.378560+0000","last_active":"2024-09-14T12:40:40.340214+0000","last_peered":"2024-09-14T12:40:40.340214+0000","last_clean":"2024-09-14T12:40:40.340214+0000","last_became_active":"2024-09-14T10:49:25.377841+0000","last_became_peered":"2024-09-14T10:49:25.377841+0000","last_unstale":"2024-09-14T12:40:40.340214+0000","last_undegraded":"2024-09-14T12:40:40.340214+0000","last_fullsized":"2024-09-14T12:40:40.340214+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:34.685545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2397,"num_read_kb":2304,"num_write":471,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.560546+0000","last_change":"2024-09-14T10:49:02.305650+0000","last_active":"2024-09-14T12:41:30.560546+0000","last_peered":"2024-09-14T12:41:30.560546+0000","last_clean":"2024-09-14T12:41:30.560546+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T12:41:30.560546+0000","last_undegraded":"2024-09-14T12:41:30.560546+0000","last_fullsized":"2024-09-14T12:41:30.560546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:00.978700+0000","last_clean_scrub_stamp":"2024-09-14T10:49:00.978700+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:28.964363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500441+0000","last_change":"2024-09-14T10:49:09.053703+0000","last_active":"2024-09-14T12:41:41.500441+0000","last_peered":"2024-09-14T12:41:41.500441+0000","last_clean":"2024-09-14T12:41:41.500441+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T12:41:41.500441+0000","last_undegraded":"2024-09-14T12:41:41.500441+0000","last_fullsized":"2024-09-14T12:41:41.500441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:01.458375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'272","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.587004+0000","last_change":"2024-09-14T10:49:23.371837+0000","last_active":"2024-09-14T12:41:55.587004+0000","last_peered":"2024-09-14T12:41:55.587004+0000","last_clean":"2024-09-14T12:41:55.587004+0000","last_became_active":"2024-09-14T10:49:23.371077+0000","last_became_peered":"2024-09-14T10:49:23.371077+0000","last_unstale":"2024-09-14T12:41:55.587004+0000","last_undegraded":"2024-09-14T12:41:55.587004+0000","last_fullsized":"2024-09-14T12:41:55.587004+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:28.149667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16978352,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":526,"num_read_kb":16360,"num_write":1056,"num_write_kb":33420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.786507+0000","last_change":"2024-09-14T10:49:27.375599+0000","last_active":"2024-09-14T12:39:55.786507+0000","last_peered":"2024-09-14T12:39:55.786507+0000","last_clean":"2024-09-14T12:39:55.786507+0000","last_became_active":"2024-09-14T10:49:27.372388+0000","last_became_peered":"2024-09-14T10:49:27.372388+0000","last_unstale":"2024-09-14T12:39:55.786507+0000","last_undegraded":"2024-09-14T12:39:55.786507+0000","last_fullsized":"2024-09-14T12:39:55.786507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:22.751936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'814","reported_seq":1545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.613172+0000","last_change":"2024-09-14T10:49:29.390925+0000","last_active":"2024-09-14T12:43:48.613172+0000","last_peered":"2024-09-14T12:43:48.613172+0000","last_clean":"2024-09-14T12:43:48.613172+0000","last_became_active":"2024-09-14T10:49:29.390014+0000","last_became_peered":"2024-09-14T10:49:29.390014+0000","last_unstale":"2024-09-14T12:43:48.613172+0000","last_undegraded":"2024-09-14T12:43:48.613172+0000","last_fullsized":"2024-09-14T12:43:48.613172+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.279366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209443,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1584,"num_read_kb":3253,"num_write":1568,"num_write_kb":1419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:05.552990+0000","last_change":"2024-09-14T10:49:31.411996+0000","last_active":"2024-09-14T12:40:05.552990+0000","last_peered":"2024-09-14T12:40:05.552990+0000","last_clean":"2024-09-14T12:40:05.552990+0000","last_became_active":"2024-09-14T10:49:31.411212+0000","last_became_peered":"2024-09-14T10:49:31.411212+0000","last_unstale":"2024-09-14T12:40:05.552990+0000","last_undegraded":"2024-09-14T12:40:05.552990+0000","last_fullsized":"2024-09-14T12:40:05.552990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:47.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'196","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.596985+0000","last_change":"2024-09-14T10:49:33.470365+0000","last_active":"2024-09-14T12:42:29.596985+0000","last_peered":"2024-09-14T12:42:29.596985+0000","last_clean":"2024-09-14T12:42:29.596985+0000","last_became_active":"2024-09-14T10:49:33.469611+0000","last_became_peered":"2024-09-14T10:49:33.469611+0000","last_unstale":"2024-09-14T12:42:29.596985+0000","last_undegraded":"2024-09-14T12:42:29.596985+0000","last_fullsized":"2024-09-14T12:42:29.596985+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:02.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":425,"num_write":402,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'780","reported_seq":2292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.583324+0000","last_change":"2024-09-14T10:49:25.391340+0000","last_active":"2024-09-14T12:41:29.583324+0000","last_peered":"2024-09-14T12:41:29.583324+0000","last_clean":"2024-09-14T12:41:29.583324+0000","last_became_active":"2024-09-14T10:49:25.390586+0000","last_became_peered":"2024-09-14T10:49:25.390586+0000","last_unstale":"2024-09-14T12:41:29.583324+0000","last_undegraded":"2024-09-14T12:41:29.583324+0000","last_fullsized":"2024-09-14T12:41:29.583324+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:28.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3382,"num_write":1057,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496631+0000","last_change":"2024-09-14T10:49:09.052857+0000","last_active":"2024-09-14T12:41:26.496631+0000","last_peered":"2024-09-14T12:41:26.496631+0000","last_clean":"2024-09-14T12:41:26.496631+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T12:41:26.496631+0000","last_undegraded":"2024-09-14T12:41:26.496631+0000","last_fullsized":"2024-09-14T12:41:26.496631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.713061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'289","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560334+0000","last_change":"2024-09-14T10:49:53.509685+0000","last_active":"2024-09-14T12:41:56.560334+0000","last_peered":"2024-09-14T12:41:56.560334+0000","last_clean":"2024-09-14T12:41:56.560334+0000","last_became_active":"2024-09-14T10:49:53.507913+0000","last_became_peered":"2024-09-14T10:49:53.507913+0000","last_unstale":"2024-09-14T12:41:56.560334+0000","last_undegraded":"2024-09-14T12:41:56.560334+0000","last_fullsized":"2024-09-14T12:41:56.560334+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.727574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11873036,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":518,"num_read_kb":56481,"num_write":1073,"num_write_kb":45113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,3],"acting":[6,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.474795+0000","last_change":"2024-09-14T10:49:27.389322+0000","last_active":"2024-09-14T12:40:01.474795+0000","last_peered":"2024-09-14T12:40:01.474795+0000","last_clean":"2024-09-14T12:40:01.474795+0000","last_became_active":"2024-09-14T10:49:27.388875+0000","last_became_peered":"2024-09-14T10:49:27.388875+0000","last_unstale":"2024-09-14T12:40:01.474795+0000","last_undegraded":"2024-09-14T12:40:01.474795+0000","last_fullsized":"2024-09-14T12:40:01.474795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:39.859202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1470","reported_seq":3843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.556102+0000","last_change":"2024-09-14T10:49:29.394197+0000","last_active":"2024-09-14T12:44:04.556102+0000","last_peered":"2024-09-14T12:44:04.556102+0000","last_clean":"2024-09-14T12:44:04.556102+0000","last_became_active":"2024-09-14T10:49:29.393295+0000","last_became_peered":"2024-09-14T10:49:29.393295+0000","last_unstale":"2024-09-14T12:44:04.556102+0000","last_undegraded":"2024-09-14T12:44:04.556102+0000","last_fullsized":"2024-09-14T12:44:04.556102+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:36.360396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2284,"num_read_kb":4194,"num_write":1394,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478561+0000","last_change":"2024-09-14T10:49:31.432764+0000","last_active":"2024-09-14T12:40:16.478561+0000","last_peered":"2024-09-14T12:40:16.478561+0000","last_clean":"2024-09-14T12:40:16.478561+0000","last_became_active":"2024-09-14T10:49:31.432054+0000","last_became_peered":"2024-09-14T10:49:31.432054+0000","last_unstale":"2024-09-14T12:40:16.478561+0000","last_undegraded":"2024-09-14T12:40:16.478561+0000","last_fullsized":"2024-09-14T12:40:16.478561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:16.891140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'83","reported_seq":607,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:30.558557+0000","last_change":"2024-09-14T10:49:33.466954+0000","last_active":"2024-09-14T12:40:30.558557+0000","last_peered":"2024-09-14T12:40:30.558557+0000","last_clean":"2024-09-14T12:40:30.558557+0000","last_became_active":"2024-09-14T10:49:33.466307+0000","last_became_peered":"2024-09-14T10:49:33.466307+0000","last_unstale":"2024-09-14T12:40:30.558557+0000","last_undegraded":"2024-09-14T12:40:30.558557+0000","last_fullsized":"2024-09-14T12:40:30.558557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:18.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":197,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'927","reported_seq":2492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.371619+0000","last_change":"2024-09-14T10:49:25.384251+0000","last_active":"2024-09-14T12:42:29.371619+0000","last_peered":"2024-09-14T12:42:29.371619+0000","last_clean":"2024-09-14T12:42:29.371619+0000","last_became_active":"2024-09-14T10:49:25.382937+0000","last_became_peered":"2024-09-14T10:49:25.382937+0000","last_unstale":"2024-09-14T12:42:29.371619+0000","last_undegraded":"2024-09-14T12:42:29.371619+0000","last_fullsized":"2024-09-14T12:42:29.371619+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:13.849834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":3892,"num_write":1285,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:39.756813+0000","last_change":"2024-09-14T10:49:09.482540+0000","last_active":"2024-09-14T12:41:39.756813+0000","last_peered":"2024-09-14T12:41:39.756813+0000","last_clean":"2024-09-14T12:41:39.756813+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T12:41:39.756813+0000","last_undegraded":"2024-09-14T12:41:39.756813+0000","last_fullsized":"2024-09-14T12:41:39.756813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:28.426232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'274","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.359813+0000","last_change":"2024-09-14T10:49:23.388674+0000","last_active":"2024-09-14T12:41:55.359813+0000","last_peered":"2024-09-14T12:41:55.359813+0000","last_clean":"2024-09-14T12:41:55.359813+0000","last_became_active":"2024-09-14T10:49:23.387885+0000","last_became_peered":"2024-09-14T10:49:23.387885+0000","last_unstale":"2024-09-14T12:41:55.359813+0000","last_undegraded":"2024-09-14T12:41:55.359813+0000","last_fullsized":"2024-09-14T12:41:55.359813+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:35.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9753178,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":500,"num_read_kb":25294,"num_write":1005,"num_write_kb":31965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:59.734121+0000","last_change":"2024-09-14T10:49:27.385977+0000","last_active":"2024-09-14T12:39:59.734121+0000","last_peered":"2024-09-14T12:39:59.734121+0000","last_clean":"2024-09-14T12:39:59.734121+0000","last_became_active":"2024-09-14T10:49:27.384973+0000","last_became_peered":"2024-09-14T10:49:27.384973+0000","last_unstale":"2024-09-14T12:39:59.734121+0000","last_undegraded":"2024-09-14T12:39:59.734121+0000","last_fullsized":"2024-09-14T12:39:59.734121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:44.532319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'415","reported_seq":2396,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:44.016898+0000","last_change":"2024-09-14T10:49:29.382733+0000","last_active":"2024-09-14T12:43:44.016898+0000","last_peered":"2024-09-14T12:43:44.016898+0000","last_clean":"2024-09-14T12:43:44.016898+0000","last_became_active":"2024-09-14T10:49:29.382485+0000","last_became_peered":"2024-09-14T10:49:29.382485+0000","last_unstale":"2024-09-14T12:43:44.016898+0000","last_undegraded":"2024-09-14T12:43:44.016898+0000","last_fullsized":"2024-09-14T12:43:44.016898+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:09.682817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":384,"num_read_kb":370,"num_write":379,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.562226+0000","last_change":"2024-09-14T10:49:31.421762+0000","last_active":"2024-09-14T12:40:00.562226+0000","last_peered":"2024-09-14T12:40:00.562226+0000","last_clean":"2024-09-14T12:40:00.562226+0000","last_became_active":"2024-09-14T10:49:31.420121+0000","last_became_peered":"2024-09-14T10:49:31.420121+0000","last_unstale":"2024-09-14T12:40:00.562226+0000","last_undegraded":"2024-09-14T12:40:00.562226+0000","last_fullsized":"2024-09-14T12:40:00.562226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:24.154484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'274","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.858379+0000","last_change":"2024-09-14T10:49:33.438284+0000","last_active":"2024-09-14T12:42:29.858379+0000","last_peered":"2024-09-14T12:42:29.858379+0000","last_clean":"2024-09-14T12:42:29.858379+0000","last_became_active":"2024-09-14T10:49:33.437564+0000","last_became_peered":"2024-09-14T10:49:33.437564+0000","last_unstale":"2024-09-14T12:42:29.858379+0000","last_undegraded":"2024-09-14T12:42:29.858379+0000","last_fullsized":"2024-09-14T12:42:29.858379+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:21.636592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":600,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'363","reported_seq":1770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.457004+0000","last_change":"2024-09-14T10:49:25.378315+0000","last_active":"2024-09-14T12:42:29.457004+0000","last_peered":"2024-09-14T12:42:29.457004+0000","last_clean":"2024-09-14T12:42:29.457004+0000","last_became_active":"2024-09-14T10:49:25.377606+0000","last_became_peered":"2024-09-14T10:49:25.377606+0000","last_unstale":"2024-09-14T12:42:29.457004+0000","last_undegraded":"2024-09-14T12:42:29.457004+0000","last_fullsized":"2024-09-14T12:42:29.457004+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:08.626742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2088,"num_read_kb":1981,"num_write":424,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500386+0000","last_change":"2024-09-14T10:49:09.053071+0000","last_active":"2024-09-14T12:41:41.500386+0000","last_peered":"2024-09-14T12:41:41.500386+0000","last_clean":"2024-09-14T12:41:41.500386+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T12:41:41.500386+0000","last_undegraded":"2024-09-14T12:41:41.500386+0000","last_fullsized":"2024-09-14T12:41:41.500386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:51.730662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'296","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:07.758881+0000","last_change":"2024-09-14T10:49:23.365487+0000","last_active":"2024-09-14T12:42:07.758881+0000","last_peered":"2024-09-14T12:42:07.758881+0000","last_clean":"2024-09-14T12:42:07.758881+0000","last_became_active":"2024-09-14T10:49:23.365016+0000","last_became_peered":"2024-09-14T10:49:23.365016+0000","last_unstale":"2024-09-14T12:42:07.758881+0000","last_undegraded":"2024-09-14T12:42:07.758881+0000","last_fullsized":"2024-09-14T12:42:07.758881+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.567826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28316518,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":588,"num_read_kb":160042,"num_write":1061,"num_write_kb":62525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737546+0000","last_change":"2024-09-14T10:49:27.374724+0000","last_active":"2024-09-14T12:40:14.737546+0000","last_peered":"2024-09-14T12:40:14.737546+0000","last_clean":"2024-09-14T12:40:14.737546+0000","last_became_active":"2024-09-14T10:49:27.373998+0000","last_became_peered":"2024-09-14T10:49:27.373998+0000","last_unstale":"2024-09-14T12:40:14.737546+0000","last_undegraded":"2024-09-14T12:40:14.737546+0000","last_fullsized":"2024-09-14T12:40:14.737546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:19.157690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'229","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:10.363823+0000","last_change":"2024-09-14T10:49:29.391820+0000","last_active":"2024-09-14T12:42:10.363823+0000","last_peered":"2024-09-14T12:42:10.363823+0000","last_clean":"2024-09-14T12:42:10.363823+0000","last_became_active":"2024-09-14T10:49:29.391056+0000","last_became_peered":"2024-09-14T10:49:29.391056+0000","last_unstale":"2024-09-14T12:42:10.363823+0000","last_undegraded":"2024-09-14T12:42:10.363823+0000","last_fullsized":"2024-09-14T12:42:10.363823+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:10.544422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":287,"num_read_kb":274,"num_write":212,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476208+0000","last_change":"2024-09-14T10:49:31.430127+0000","last_active":"2024-09-14T12:40:06.476208+0000","last_peered":"2024-09-14T12:40:06.476208+0000","last_clean":"2024-09-14T12:40:06.476208+0000","last_became_active":"2024-09-14T10:49:31.424769+0000","last_became_peered":"2024-09-14T10:49:31.424769+0000","last_unstale":"2024-09-14T12:40:06.476208+0000","last_undegraded":"2024-09-14T12:40:06.476208+0000","last_fullsized":"2024-09-14T12:40:06.476208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:42.138808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'129","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.097115+0000","last_change":"2024-09-14T10:49:33.469301+0000","last_active":"2024-09-14T12:42:31.097115+0000","last_peered":"2024-09-14T12:42:31.097115+0000","last_clean":"2024-09-14T12:42:31.097115+0000","last_became_active":"2024-09-14T10:49:33.468553+0000","last_became_peered":"2024-09-14T10:49:33.468553+0000","last_unstale":"2024-09-14T12:42:31.097115+0000","last_undegraded":"2024-09-14T12:42:31.097115+0000","last_fullsized":"2024-09-14T12:42:31.097115+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:38.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":228,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'553","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.456842+0000","last_change":"2024-09-14T10:49:25.381598+0000","last_active":"2024-09-14T12:42:29.456842+0000","last_peered":"2024-09-14T12:42:29.456842+0000","last_clean":"2024-09-14T12:42:29.456842+0000","last_became_active":"2024-09-14T10:49:25.379137+0000","last_became_peered":"2024-09-14T10:49:25.379137+0000","last_unstale":"2024-09-14T12:42:29.456842+0000","last_undegraded":"2024-09-14T12:42:29.456842+0000","last_fullsized":"2024-09-14T12:42:29.456842+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:41.217351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2924,"num_read_kb":2647,"num_write":735,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'302","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.144857+0000","last_change":"2024-09-14T10:49:23.389597+0000","last_active":"2024-09-14T12:40:06.144857+0000","last_peered":"2024-09-14T12:40:06.144857+0000","last_clean":"2024-09-14T12:40:06.144857+0000","last_became_active":"2024-09-14T10:49:23.389195+0000","last_became_peered":"2024-09-14T10:49:23.389195+0000","last_unstale":"2024-09-14T12:40:06.144857+0000","last_undegraded":"2024-09-14T12:40:06.144857+0000","last_fullsized":"2024-09-14T12:40:06.144857+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.064159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10717874,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":585,"num_read_kb":23841,"num_write":1092,"num_write_kb":31374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:40.575257+0000","last_change":"2024-09-14T10:49:09.318418+0000","last_active":"2024-09-14T12:41:40.575257+0000","last_peered":"2024-09-14T12:41:40.575257+0000","last_clean":"2024-09-14T12:41:40.575257+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T12:41:40.575257+0000","last_undegraded":"2024-09-14T12:41:40.575257+0000","last_fullsized":"2024-09-14T12:41:40.575257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:16.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.560955+0000","last_change":"2024-09-14T10:49:27.369178+0000","last_active":"2024-09-14T12:39:55.560955+0000","last_peered":"2024-09-14T12:39:55.560955+0000","last_clean":"2024-09-14T12:39:55.560955+0000","last_became_active":"2024-09-14T10:49:27.368412+0000","last_became_peered":"2024-09-14T10:49:27.368412+0000","last_unstale":"2024-09-14T12:39:55.560955+0000","last_undegraded":"2024-09-14T12:39:55.560955+0000","last_fullsized":"2024-09-14T12:39:55.560955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:12.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'755","reported_seq":1493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.153074+0000","last_change":"2024-09-14T10:49:29.389811+0000","last_active":"2024-09-14T12:44:04.153074+0000","last_peered":"2024-09-14T12:44:04.153074+0000","last_clean":"2024-09-14T12:44:04.153074+0000","last_became_active":"2024-09-14T10:49:29.383270+0000","last_became_peered":"2024-09-14T10:49:29.383270+0000","last_unstale":"2024-09-14T12:44:04.153074+0000","last_undegraded":"2024-09-14T12:44:04.153074+0000","last_fullsized":"2024-09-14T12:44:04.153074+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:51.681617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99398,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2001,"num_read_kb":3265,"num_write":2692,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.143642+0000","last_change":"2024-09-14T10:49:31.419150+0000","last_active":"2024-09-14T12:40:01.143642+0000","last_peered":"2024-09-14T12:40:01.143642+0000","last_clean":"2024-09-14T12:40:01.143642+0000","last_became_active":"2024-09-14T10:49:31.418385+0000","last_became_peered":"2024-09-14T10:49:31.418385+0000","last_unstale":"2024-09-14T12:40:01.143642+0000","last_undegraded":"2024-09-14T12:40:01.143642+0000","last_fullsized":"2024-09-14T12:40:01.143642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:53.967427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'130","reported_seq":662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.863696+0000","last_change":"2024-09-14T10:49:33.468510+0000","last_active":"2024-09-14T12:42:30.863696+0000","last_peered":"2024-09-14T12:42:30.863696+0000","last_clean":"2024-09-14T12:42:30.863696+0000","last_became_active":"2024-09-14T10:49:33.467268+0000","last_became_peered":"2024-09-14T10:49:33.467268+0000","last_unstale":"2024-09-14T12:42:30.863696+0000","last_undegraded":"2024-09-14T12:42:30.863696+0000","last_fullsized":"2024-09-14T12:42:30.863696+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:48.075987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":137,"num_write":301,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'744","reported_seq":2288,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560542+0000","last_change":"2024-09-14T10:49:25.378254+0000","last_active":"2024-09-14T12:41:56.560542+0000","last_peered":"2024-09-14T12:41:56.560542+0000","last_clean":"2024-09-14T12:41:56.560542+0000","last_became_active":"2024-09-14T10:49:25.377460+0000","last_became_peered":"2024-09-14T10:49:25.377460+0000","last_unstale":"2024-09-14T12:41:56.560542+0000","last_undegraded":"2024-09-14T12:41:56.560542+0000","last_fullsized":"2024-09-14T12:41:56.560542+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:40.959297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3587,"num_read_kb":3249,"num_write":953,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'288","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560585+0000","last_change":"2024-09-14T10:49:23.386787+0000","last_active":"2024-09-14T12:41:56.560585+0000","last_peered":"2024-09-14T12:41:56.560585+0000","last_clean":"2024-09-14T12:41:56.560585+0000","last_became_active":"2024-09-14T10:49:23.383686+0000","last_became_peered":"2024-09-14T10:49:23.383686+0000","last_unstale":"2024-09-14T12:41:56.560585+0000","last_undegraded":"2024-09-14T12:41:56.560585+0000","last_fullsized":"2024-09-14T12:41:56.560585+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:13.515080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8730875,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":470,"num_read_kb":8941,"num_write":1021,"num_write_kb":53511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504873+0000","last_change":"2024-09-14T10:49:09.053478+0000","last_active":"2024-09-14T12:41:56.504873+0000","last_peered":"2024-09-14T12:41:56.504873+0000","last_clean":"2024-09-14T12:41:56.504873+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T12:41:56.504873+0000","last_undegraded":"2024-09-14T12:41:56.504873+0000","last_fullsized":"2024-09-14T12:41:56.504873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.160900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.786411+0000","last_change":"2024-09-14T10:49:27.374268+0000","last_active":"2024-09-14T12:39:55.786411+0000","last_peered":"2024-09-14T12:39:55.786411+0000","last_clean":"2024-09-14T12:39:55.786411+0000","last_became_active":"2024-09-14T10:49:27.373801+0000","last_became_peered":"2024-09-14T10:49:27.373801+0000","last_unstale":"2024-09-14T12:39:55.786411+0000","last_undegraded":"2024-09-14T12:39:55.786411+0000","last_fullsized":"2024-09-14T12:39:55.786411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:26.573366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'247","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.851447+0000","last_change":"2024-09-14T10:49:29.387943+0000","last_active":"2024-09-14T12:40:15.851447+0000","last_peered":"2024-09-14T12:40:15.851447+0000","last_clean":"2024-09-14T12:40:15.851447+0000","last_became_active":"2024-09-14T10:49:29.387176+0000","last_became_peered":"2024-09-14T10:49:29.387176+0000","last_unstale":"2024-09-14T12:40:15.851447+0000","last_undegraded":"2024-09-14T12:40:15.851447+0000","last_fullsized":"2024-09-14T12:40:15.851447+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:04.926878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'792","reported_seq":3332,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:52.730993+0000","last_change":"2024-09-14T10:49:31.418103+0000","last_active":"2024-09-14T12:43:52.730993+0000","last_peered":"2024-09-14T12:43:52.730993+0000","last_clean":"2024-09-14T12:43:52.730993+0000","last_became_active":"2024-09-14T10:49:31.417376+0000","last_became_peered":"2024-09-14T10:49:31.417376+0000","last_unstale":"2024-09-14T12:43:52.730993+0000","last_undegraded":"2024-09-14T12:43:52.730993+0000","last_fullsized":"2024-09-14T12:43:52.730993+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:56.482438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'146","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.767330+0000","last_change":"2024-09-14T10:49:33.459885+0000","last_active":"2024-09-14T12:42:24.767330+0000","last_peered":"2024-09-14T12:42:24.767330+0000","last_clean":"2024-09-14T12:42:24.767330+0000","last_became_active":"2024-09-14T10:49:33.459122+0000","last_became_peered":"2024-09-14T10:49:33.459122+0000","last_unstale":"2024-09-14T12:42:24.767330+0000","last_undegraded":"2024-09-14T12:42:24.767330+0000","last_fullsized":"2024-09-14T12:42:24.767330+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:50.717373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":355,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'838","reported_seq":2546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.586893+0000","last_change":"2024-09-14T10:49:25.361390+0000","last_active":"2024-09-14T12:41:55.586893+0000","last_peered":"2024-09-14T12:41:55.586893+0000","last_clean":"2024-09-14T12:41:55.586893+0000","last_became_active":"2024-09-14T10:49:25.360655+0000","last_became_peered":"2024-09-14T10:49:25.360655+0000","last_unstale":"2024-09-14T12:41:55.586893+0000","last_undegraded":"2024-09-14T12:41:55.586893+0000","last_fullsized":"2024-09-14T12:41:55.586893+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:50.719358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4101,"num_read_kb":3716,"num_write":1090,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'379","reported_seq":1086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.561098+0000","last_change":"2024-09-14T10:49:23.361586+0000","last_active":"2024-09-14T12:39:55.561098+0000","last_peered":"2024-09-14T12:39:55.561098+0000","last_clean":"2024-09-14T12:39:55.561098+0000","last_became_active":"2024-09-14T10:49:23.359442+0000","last_became_peered":"2024-09-14T10:49:23.359442+0000","last_unstale":"2024-09-14T12:39:55.561098+0000","last_undegraded":"2024-09-14T12:39:55.561098+0000","last_fullsized":"2024-09-14T12:39:55.561098+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.017232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15319025,"num_objects":91,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":745,"num_read_kb":31084,"num_write":1277,"num_write_kb":31792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585909+0000","last_change":"2024-09-14T10:49:09.044027+0000","last_active":"2024-09-14T12:41:50.585909+0000","last_peered":"2024-09-14T12:41:50.585909+0000","last_clean":"2024-09-14T12:41:50.585909+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T12:41:50.585909+0000","last_undegraded":"2024-09-14T12:41:50.585909+0000","last_fullsized":"2024-09-14T12:41:50.585909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:42.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.473776+0000","last_change":"2024-09-14T10:49:27.385279+0000","last_active":"2024-09-14T12:39:56.473776+0000","last_peered":"2024-09-14T12:39:56.473776+0000","last_clean":"2024-09-14T12:39:56.473776+0000","last_became_active":"2024-09-14T10:49:27.384635+0000","last_became_peered":"2024-09-14T10:49:27.384635+0000","last_unstale":"2024-09-14T12:39:56.473776+0000","last_undegraded":"2024-09-14T12:39:56.473776+0000","last_fullsized":"2024-09-14T12:39:56.473776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.745658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'179","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.412351+0000","last_change":"2024-09-14T10:49:29.397010+0000","last_active":"2024-09-14T12:40:15.412351+0000","last_peered":"2024-09-14T12:40:15.412351+0000","last_clean":"2024-09-14T12:40:15.412351+0000","last_became_active":"2024-09-14T10:49:29.394105+0000","last_became_peered":"2024-09-14T10:49:29.394105+0000","last_unstale":"2024-09-14T12:40:15.412351+0000","last_undegraded":"2024-09-14T12:40:15.412351+0000","last_fullsized":"2024-09-14T12:40:15.412351+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:23.758962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'824","reported_seq":3139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.105369+0000","last_change":"2024-09-14T10:49:31.411841+0000","last_active":"2024-09-14T12:43:49.105369+0000","last_peered":"2024-09-14T12:43:49.105369+0000","last_clean":"2024-09-14T12:43:49.105369+0000","last_became_active":"2024-09-14T10:49:31.411055+0000","last_became_peered":"2024-09-14T10:49:31.411055+0000","last_unstale":"2024-09-14T12:43:49.105369+0000","last_undegraded":"2024-09-14T12:43:49.105369+0000","last_fullsized":"2024-09-14T12:43:49.105369+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:46.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'269","reported_seq":814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.548982+0000","last_change":"2024-09-14T10:49:33.457595+0000","last_active":"2024-09-14T12:39:50.548982+0000","last_peered":"2024-09-14T12:39:50.548982+0000","last_clean":"2024-09-14T12:39:50.548982+0000","last_became_active":"2024-09-14T10:49:33.456806+0000","last_became_peered":"2024-09-14T10:49:33.456806+0000","last_unstale":"2024-09-14T12:39:50.548982+0000","last_undegraded":"2024-09-14T12:39:50.548982+0000","last_fullsized":"2024-09-14T12:39:50.548982+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:15.247749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":331,"num_read_kb":330,"num_write":580,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'499","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.457164+0000","last_change":"2024-09-14T10:49:25.373350+0000","last_active":"2024-09-14T12:42:29.457164+0000","last_peered":"2024-09-14T12:42:29.457164+0000","last_clean":"2024-09-14T12:42:29.457164+0000","last_became_active":"2024-09-14T10:49:25.372923+0000","last_became_peered":"2024-09-14T10:49:25.372923+0000","last_unstale":"2024-09-14T12:42:29.457164+0000","last_undegraded":"2024-09-14T12:42:29.457164+0000","last_fullsized":"2024-09-14T12:42:29.457164+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:38.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2643,"num_read_kb":2487,"num_write":591,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'293","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.561028+0000","last_change":"2024-09-14T10:49:23.346381+0000","last_active":"2024-09-14T12:39:55.561028+0000","last_peered":"2024-09-14T12:39:55.561028+0000","last_clean":"2024-09-14T12:39:55.561028+0000","last_became_active":"2024-09-14T10:49:23.344863+0000","last_became_peered":"2024-09-14T10:49:23.344863+0000","last_unstale":"2024-09-14T12:39:55.561028+0000","last_undegraded":"2024-09-14T12:39:55.561028+0000","last_fullsized":"2024-09-14T12:39:55.561028+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:12.876419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6333334,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":497,"num_read_kb":37228,"num_write":1020,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503382+0000","last_change":"2024-09-14T10:49:09.054207+0000","last_active":"2024-09-14T12:41:51.503382+0000","last_peered":"2024-09-14T12:41:51.503382+0000","last_clean":"2024-09-14T12:41:51.503382+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T12:41:51.503382+0000","last_undegraded":"2024-09-14T12:41:51.503382+0000","last_fullsized":"2024-09-14T12:41:51.503382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.696418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.588173+0000","last_change":"2024-09-14T10:49:27.380671+0000","last_active":"2024-09-14T12:42:00.588173+0000","last_peered":"2024-09-14T12:42:00.588173+0000","last_clean":"2024-09-14T12:42:00.588173+0000","last_became_active":"2024-09-14T10:49:27.379820+0000","last_became_peered":"2024-09-14T10:49:27.379820+0000","last_unstale":"2024-09-14T12:42:00.588173+0000","last_undegraded":"2024-09-14T12:42:00.588173+0000","last_fullsized":"2024-09-14T12:42:00.588173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:08.601000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'834","reported_seq":1614,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.589148+0000","last_change":"2024-09-14T10:49:29.390161+0000","last_active":"2024-09-14T12:43:48.589148+0000","last_peered":"2024-09-14T12:43:48.589148+0000","last_clean":"2024-09-14T12:43:48.589148+0000","last_became_active":"2024-09-14T10:49:29.389500+0000","last_became_peered":"2024-09-14T10:49:29.389500+0000","last_unstale":"2024-09-14T12:43:48.589148+0000","last_undegraded":"2024-09-14T12:43:48.589148+0000","last_fullsized":"2024-09-14T12:43:48.589148+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:43.125499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196422,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1468,"num_read_kb":3084,"num_write":1208,"num_write_kb":978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.562166+0000","last_change":"2024-09-14T10:49:31.413780+0000","last_active":"2024-09-14T12:40:00.562166+0000","last_peered":"2024-09-14T12:40:00.562166+0000","last_clean":"2024-09-14T12:40:00.562166+0000","last_became_active":"2024-09-14T10:49:31.413008+0000","last_became_peered":"2024-09-14T10:49:31.413008+0000","last_unstale":"2024-09-14T12:40:00.562166+0000","last_undegraded":"2024-09-14T12:40:00.562166+0000","last_fullsized":"2024-09-14T12:40:00.562166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:58.384037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.643169+0000","last_change":"2024-09-14T10:49:33.471643+0000","last_active":"2024-09-14T12:42:31.643169+0000","last_peered":"2024-09-14T12:42:31.643169+0000","last_clean":"2024-09-14T12:42:31.643169+0000","last_became_active":"2024-09-14T10:49:33.468546+0000","last_became_peered":"2024-09-14T10:49:33.468546+0000","last_unstale":"2024-09-14T12:42:31.643169+0000","last_undegraded":"2024-09-14T12:42:31.643169+0000","last_fullsized":"2024-09-14T12:42:31.643169+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.990777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'160","reported_seq":765,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.764101+0000","last_change":"2024-09-14T10:49:33.462576+0000","last_active":"2024-09-14T12:42:29.764101+0000","last_peered":"2024-09-14T12:42:29.764101+0000","last_clean":"2024-09-14T12:42:29.764101+0000","last_became_active":"2024-09-14T10:49:33.461782+0000","last_became_peered":"2024-09-14T10:49:33.461782+0000","last_unstale":"2024-09-14T12:42:29.764101+0000","last_undegraded":"2024-09-14T12:42:29.764101+0000","last_fullsized":"2024-09-14T12:42:29.764101+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:38.902854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":264,"num_write":397,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'521","reported_seq":2247,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.163802+0000","last_change":"2024-09-14T10:49:25.381899+0000","last_active":"2024-09-14T12:41:26.163802+0000","last_peered":"2024-09-14T12:41:26.163802+0000","last_clean":"2024-09-14T12:41:26.163802+0000","last_became_active":"2024-09-14T10:49:25.381653+0000","last_became_peered":"2024-09-14T10:49:25.381653+0000","last_unstale":"2024-09-14T12:41:26.163802+0000","last_undegraded":"2024-09-14T12:41:26.163802+0000","last_fullsized":"2024-09-14T12:41:26.163802+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:01.827788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2737,"num_read_kb":2577,"num_write":621,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'301","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500472+0000","last_change":"2024-09-14T10:49:23.365867+0000","last_active":"2024-09-14T12:41:41.500472+0000","last_peered":"2024-09-14T12:41:41.500472+0000","last_clean":"2024-09-14T12:41:41.500472+0000","last_became_active":"2024-09-14T10:49:23.365341+0000","last_became_peered":"2024-09-14T10:49:23.365341+0000","last_unstale":"2024-09-14T12:41:41.500472+0000","last_undegraded":"2024-09-14T12:41:41.500472+0000","last_fullsized":"2024-09-14T12:41:41.500472+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:00.255631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10074569,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":607,"num_read_kb":37656,"num_write":1053,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.554957+0000","last_change":"2024-09-14T10:49:27.368112+0000","last_active":"2024-09-14T12:41:31.554957+0000","last_peered":"2024-09-14T12:41:31.554957+0000","last_clean":"2024-09-14T12:41:31.554957+0000","last_became_active":"2024-09-14T10:49:27.366990+0000","last_became_peered":"2024-09-14T10:49:27.366990+0000","last_unstale":"2024-09-14T12:41:31.554957+0000","last_undegraded":"2024-09-14T12:41:31.554957+0000","last_fullsized":"2024-09-14T12:41:31.554957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.945759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'330","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.617729+0000","last_change":"2024-09-14T10:49:29.372907+0000","last_active":"2024-09-14T12:43:48.617729+0000","last_peered":"2024-09-14T12:43:48.617729+0000","last_clean":"2024-09-14T12:43:48.617729+0000","last_became_active":"2024-09-14T10:49:29.371655+0000","last_became_peered":"2024-09-14T10:49:29.371655+0000","last_unstale":"2024-09-14T12:43:48.617729+0000","last_undegraded":"2024-09-14T12:43:48.617729+0000","last_fullsized":"2024-09-14T12:43:48.617729+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:51.332753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61251,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1050,"num_write":434,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755605+0000","last_change":"2024-09-14T10:49:31.418572+0000","last_active":"2024-09-14T12:41:34.755605+0000","last_peered":"2024-09-14T12:41:34.755605+0000","last_clean":"2024-09-14T12:41:34.755605+0000","last_became_active":"2024-09-14T10:49:31.417675+0000","last_became_peered":"2024-09-14T10:49:31.417675+0000","last_unstale":"2024-09-14T12:41:34.755605+0000","last_undegraded":"2024-09-14T12:41:34.755605+0000","last_fullsized":"2024-09-14T12:41:34.755605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:42.817490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'145","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.663503+0000","last_change":"2024-09-14T10:49:33.454370+0000","last_active":"2024-09-14T12:43:47.663503+0000","last_peered":"2024-09-14T12:43:47.663503+0000","last_clean":"2024-09-14T12:43:47.663503+0000","last_became_active":"2024-09-14T10:49:33.453630+0000","last_became_peered":"2024-09-14T10:49:33.453630+0000","last_unstale":"2024-09-14T12:43:47.663503+0000","last_undegraded":"2024-09-14T12:43:47.663503+0000","last_fullsized":"2024-09-14T12:43:47.663503+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:55.786343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":363,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'722","reported_seq":2161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.580335+0000","last_change":"2024-09-14T10:49:25.374565+0000","last_active":"2024-09-14T12:41:25.580335+0000","last_peered":"2024-09-14T12:41:25.580335+0000","last_clean":"2024-09-14T12:41:25.580335+0000","last_became_active":"2024-09-14T10:49:25.373876+0000","last_became_peered":"2024-09-14T10:49:25.373876+0000","last_unstale":"2024-09-14T12:41:25.580335+0000","last_undegraded":"2024-09-14T12:41:25.580335+0000","last_fullsized":"2024-09-14T12:41:25.580335+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:31.592836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3124,"num_write":967,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'273","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795748+0000","last_change":"2024-09-14T10:49:23.373710+0000","last_active":"2024-09-14T12:40:35.795748+0000","last_peered":"2024-09-14T12:40:35.795748+0000","last_clean":"2024-09-14T12:40:35.795748+0000","last_became_active":"2024-09-14T10:49:23.373206+0000","last_became_peered":"2024-09-14T10:49:23.373206+0000","last_unstale":"2024-09-14T12:40:35.795748+0000","last_undegraded":"2024-09-14T12:40:35.795748+0000","last_fullsized":"2024-09-14T12:40:35.795748+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:03.253858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489973,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":579,"num_read_kb":34264,"num_write":987,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581474+0000","last_change":"2024-09-14T10:49:27.371401+0000","last_active":"2024-09-14T12:41:30.581474+0000","last_peered":"2024-09-14T12:41:30.581474+0000","last_clean":"2024-09-14T12:41:30.581474+0000","last_became_active":"2024-09-14T10:49:27.370174+0000","last_became_peered":"2024-09-14T10:49:27.370174+0000","last_unstale":"2024-09-14T12:41:30.581474+0000","last_undegraded":"2024-09-14T12:41:30.581474+0000","last_fullsized":"2024-09-14T12:41:30.581474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.300623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581354+0000","last_change":"2024-09-14T10:49:29.376404+0000","last_active":"2024-09-14T12:41:30.581354+0000","last_peered":"2024-09-14T12:41:30.581354+0000","last_clean":"2024-09-14T12:41:30.581354+0000","last_became_active":"2024-09-14T10:49:29.375761+0000","last_became_peered":"2024-09-14T10:49:29.375761+0000","last_unstale":"2024-09-14T12:41:30.581354+0000","last_undegraded":"2024-09-14T12:41:30.581354+0000","last_fullsized":"2024-09-14T12:41:30.581354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:47.597945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:36.165985+0000","last_change":"2024-09-14T10:49:31.411967+0000","last_active":"2024-09-14T12:41:36.165985+0000","last_peered":"2024-09-14T12:41:36.165985+0000","last_clean":"2024-09-14T12:41:36.165985+0000","last_became_active":"2024-09-14T10:49:31.410915+0000","last_became_peered":"2024-09-14T10:49:31.410915+0000","last_unstale":"2024-09-14T12:41:36.165985+0000","last_undegraded":"2024-09-14T12:41:36.165985+0000","last_fullsized":"2024-09-14T12:41:36.165985+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:52.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'179","reported_seq":721,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.366754+0000","last_change":"2024-09-14T10:49:33.454043+0000","last_active":"2024-09-14T12:42:29.366754+0000","last_peered":"2024-09-14T12:42:29.366754+0000","last_clean":"2024-09-14T12:42:29.366754+0000","last_became_active":"2024-09-14T10:49:33.453278+0000","last_became_peered":"2024-09-14T10:49:33.453278+0000","last_unstale":"2024-09-14T12:42:29.366754+0000","last_undegraded":"2024-09-14T12:42:29.366754+0000","last_fullsized":"2024-09-14T12:42:29.366754+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:00.597295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":265,"num_write":381,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'431","reported_seq":2071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.579695+0000","last_change":"2024-09-14T10:49:25.353852+0000","last_active":"2024-09-14T12:41:29.579695+0000","last_peered":"2024-09-14T12:41:29.579695+0000","last_clean":"2024-09-14T12:41:29.579695+0000","last_became_active":"2024-09-14T10:49:25.353010+0000","last_became_peered":"2024-09-14T10:49:25.353010+0000","last_unstale":"2024-09-14T12:41:29.579695+0000","last_undegraded":"2024-09-14T12:41:29.579695+0000","last_fullsized":"2024-09-14T12:41:29.579695+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:33.291317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2606,"num_read_kb":2470,"num_write":495,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'293","reported_seq":1012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:15.686441+0000","last_change":"2024-09-14T10:49:23.404260+0000","last_active":"2024-09-14T12:41:15.686441+0000","last_peered":"2024-09-14T12:41:15.686441+0000","last_clean":"2024-09-14T12:41:15.686441+0000","last_became_active":"2024-09-14T10:49:23.403718+0000","last_became_peered":"2024-09-14T10:49:23.403718+0000","last_unstale":"2024-09-14T12:41:15.686441+0000","last_undegraded":"2024-09-14T12:41:15.686441+0000","last_fullsized":"2024-09-14T12:41:15.686441+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:18.065436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6885332,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":662,"num_read_kb":4161,"num_write":997,"num_write_kb":34340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164879+0000","last_change":"2024-09-14T10:49:27.378466+0000","last_active":"2024-09-14T12:41:31.164879+0000","last_peered":"2024-09-14T12:41:31.164879+0000","last_clean":"2024-09-14T12:41:31.164879+0000","last_became_active":"2024-09-14T10:49:27.377584+0000","last_became_peered":"2024-09-14T10:49:27.377584+0000","last_unstale":"2024-09-14T12:41:31.164879+0000","last_undegraded":"2024-09-14T12:41:31.164879+0000","last_fullsized":"2024-09-14T12:41:31.164879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:00.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'387","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.040268+0000","last_change":"2024-09-14T10:49:29.390323+0000","last_active":"2024-09-14T12:44:02.040268+0000","last_peered":"2024-09-14T12:44:02.040268+0000","last_clean":"2024-09-14T12:44:02.040268+0000","last_became_active":"2024-09-14T10:49:29.389523+0000","last_became_peered":"2024-09-14T10:49:29.389523+0000","last_unstale":"2024-09-14T12:44:02.040268+0000","last_undegraded":"2024-09-14T12:44:02.040268+0000","last_fullsized":"2024-09-14T12:44:02.040268+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:19.414203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":1411,"num_write":516,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.561781+0000","last_change":"2024-09-14T10:49:31.422662+0000","last_active":"2024-09-14T12:41:35.561781+0000","last_peered":"2024-09-14T12:41:35.561781+0000","last_clean":"2024-09-14T12:41:35.561781+0000","last_became_active":"2024-09-14T10:49:31.422113+0000","last_became_peered":"2024-09-14T10:49:31.422113+0000","last_unstale":"2024-09-14T12:41:35.561781+0000","last_undegraded":"2024-09-14T12:41:35.561781+0000","last_fullsized":"2024-09-14T12:41:35.561781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:51.224760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'154","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468918+0000","last_change":"2024-09-14T10:49:33.476247+0000","last_active":"2024-09-14T12:39:36.468918+0000","last_peered":"2024-09-14T12:39:36.468918+0000","last_clean":"2024-09-14T12:39:36.468918+0000","last_became_active":"2024-09-14T10:49:33.475156+0000","last_became_peered":"2024-09-14T10:49:33.475156+0000","last_unstale":"2024-09-14T12:39:36.468918+0000","last_undegraded":"2024-09-14T12:39:36.468918+0000","last_fullsized":"2024-09-14T12:39:36.468918+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:09.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'411","reported_seq":2093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.754459+0000","last_change":"2024-09-14T10:49:25.371715+0000","last_active":"2024-09-14T12:41:29.754459+0000","last_peered":"2024-09-14T12:41:29.754459+0000","last_clean":"2024-09-14T12:41:29.754459+0000","last_became_active":"2024-09-14T10:49:25.370901+0000","last_became_peered":"2024-09-14T10:49:25.370901+0000","last_unstale":"2024-09-14T12:41:29.754459+0000","last_undegraded":"2024-09-14T12:41:29.754459+0000","last_fullsized":"2024-09-14T12:41:29.754459+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:49.373960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2274,"num_write":465,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'321","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559911+0000","last_change":"2024-09-14T10:49:23.370421+0000","last_active":"2024-09-14T12:40:35.559911+0000","last_peered":"2024-09-14T12:40:35.559911+0000","last_clean":"2024-09-14T12:40:35.559911+0000","last_became_active":"2024-09-14T10:49:23.369669+0000","last_became_peered":"2024-09-14T10:49:23.369669+0000","last_unstale":"2024-09-14T12:40:35.559911+0000","last_undegraded":"2024-09-14T12:40:35.559911+0000","last_fullsized":"2024-09-14T12:40:35.559911+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:37.860070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14752595,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":717,"num_read_kb":9967,"num_write":1297,"num_write_kb":36861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.498091+0000","last_change":"2024-09-14T10:49:27.388330+0000","last_active":"2024-09-14T12:41:31.498091+0000","last_peered":"2024-09-14T12:41:31.498091+0000","last_clean":"2024-09-14T12:41:31.498091+0000","last_became_active":"2024-09-14T10:49:27.387840+0000","last_became_peered":"2024-09-14T10:49:27.387840+0000","last_unstale":"2024-09-14T12:41:31.498091+0000","last_undegraded":"2024-09-14T12:41:31.498091+0000","last_fullsized":"2024-09-14T12:41:31.498091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:31.040634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'319","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.585470+0000","last_change":"2024-09-14T10:49:29.392053+0000","last_active":"2024-09-14T12:43:48.585470+0000","last_peered":"2024-09-14T12:43:48.585470+0000","last_clean":"2024-09-14T12:43:48.585470+0000","last_became_active":"2024-09-14T10:49:29.391517+0000","last_became_peered":"2024-09-14T10:49:29.391517+0000","last_unstale":"2024-09-14T12:43:48.585470+0000","last_undegraded":"2024-09-14T12:43:48.585470+0000","last_fullsized":"2024-09-14T12:43:48.585470+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:03.721336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153127,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":1268,"num_write":432,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755694+0000","last_change":"2024-09-14T10:49:31.411523+0000","last_active":"2024-09-14T12:41:34.755694+0000","last_peered":"2024-09-14T12:41:34.755694+0000","last_clean":"2024-09-14T12:41:34.755694+0000","last_became_active":"2024-09-14T10:49:31.410633+0000","last_became_peered":"2024-09-14T10:49:31.410633+0000","last_unstale":"2024-09-14T12:41:34.755694+0000","last_undegraded":"2024-09-14T12:41:34.755694+0000","last_fullsized":"2024-09-14T12:41:34.755694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:56.976562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'747","reported_seq":2283,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.505119+0000","last_change":"2024-09-14T10:49:25.408540+0000","last_active":"2024-09-14T12:41:56.505119+0000","last_peered":"2024-09-14T12:41:56.505119+0000","last_clean":"2024-09-14T12:41:56.505119+0000","last_became_active":"2024-09-14T10:49:25.408028+0000","last_became_peered":"2024-09-14T10:49:25.408028+0000","last_unstale":"2024-09-14T12:41:56.505119+0000","last_undegraded":"2024-09-14T12:41:56.505119+0000","last_fullsized":"2024-09-14T12:41:56.505119+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:24.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3658,"num_read_kb":3304,"num_write":985,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'312","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:27.422883+0000","last_change":"2024-09-14T10:49:23.387201+0000","last_active":"2024-09-14T12:41:27.422883+0000","last_peered":"2024-09-14T12:41:27.422883+0000","last_clean":"2024-09-14T12:41:27.422883+0000","last_became_active":"2024-09-14T10:49:23.386404+0000","last_became_peered":"2024-09-14T10:49:23.386404+0000","last_unstale":"2024-09-14T12:41:27.422883+0000","last_undegraded":"2024-09-14T12:41:27.422883+0000","last_fullsized":"2024-09-14T12:41:27.422883+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:38.147399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9214153,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":614,"num_read_kb":6911,"num_write":1144,"num_write_kb":32272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:51.586033+0000","last_change":"2024-09-14T10:49:27.382769+0000","last_active":"2024-09-14T12:43:51.586033+0000","last_peered":"2024-09-14T12:43:51.586033+0000","last_clean":"2024-09-14T12:43:51.586033+0000","last_became_active":"2024-09-14T10:49:27.381931+0000","last_became_peered":"2024-09-14T10:49:27.381931+0000","last_unstale":"2024-09-14T12:43:51.586033+0000","last_undegraded":"2024-09-14T12:43:51.586033+0000","last_fullsized":"2024-09-14T12:43:51.586033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:55.209752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":730,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'546","reported_seq":1208,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.583410+0000","last_change":"2024-09-14T10:49:29.364784+0000","last_active":"2024-09-14T12:43:48.583410+0000","last_peered":"2024-09-14T12:43:48.583410+0000","last_clean":"2024-09-14T12:43:48.583410+0000","last_became_active":"2024-09-14T10:49:29.364013+0000","last_became_peered":"2024-09-14T10:49:29.364013+0000","last_unstale":"2024-09-14T12:43:48.583410+0000","last_undegraded":"2024-09-14T12:43:48.583410+0000","last_fullsized":"2024-09-14T12:43:48.583410+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:14.626395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119913,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":938,"num_read_kb":1929,"num_write":824,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.137434+0000","last_change":"2024-09-14T10:49:31.432562+0000","last_active":"2024-09-14T12:39:36.137434+0000","last_peered":"2024-09-14T12:39:36.137434+0000","last_clean":"2024-09-14T12:39:36.137434+0000","last_became_active":"2024-09-14T10:49:31.431550+0000","last_became_peered":"2024-09-14T10:49:31.431550+0000","last_unstale":"2024-09-14T12:39:36.137434+0000","last_undegraded":"2024-09-14T12:39:36.137434+0000","last_fullsized":"2024-09-14T12:39:36.137434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:21.094996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'162","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.573998+0000","last_change":"2024-09-14T10:49:33.467050+0000","last_active":"2024-09-14T12:41:35.573998+0000","last_peered":"2024-09-14T12:41:35.573998+0000","last_clean":"2024-09-14T12:41:35.573998+0000","last_became_active":"2024-09-14T10:49:33.466424+0000","last_became_peered":"2024-09-14T10:49:33.466424+0000","last_unstale":"2024-09-14T12:41:35.573998+0000","last_undegraded":"2024-09-14T12:41:35.573998+0000","last_fullsized":"2024-09-14T12:41:35.573998+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:16.563193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":247,"num_write":384,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'832","reported_seq":2406,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.767765+0000","last_change":"2024-09-14T10:49:25.367610+0000","last_active":"2024-09-14T12:42:31.767765+0000","last_peered":"2024-09-14T12:42:31.767765+0000","last_clean":"2024-09-14T12:42:31.767765+0000","last_became_active":"2024-09-14T10:49:25.364958+0000","last_became_peered":"2024-09-14T10:49:25.364958+0000","last_unstale":"2024-09-14T12:42:31.767765+0000","last_undegraded":"2024-09-14T12:42:31.767765+0000","last_fullsized":"2024-09-14T12:42:31.767765+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:15.525950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3911,"num_read_kb":3508,"num_write":1119,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'341","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:37.080833+0000","last_change":"2024-09-14T10:49:23.378450+0000","last_active":"2024-09-14T12:43:37.080833+0000","last_peered":"2024-09-14T12:43:37.080833+0000","last_clean":"2024-09-14T12:43:37.080833+0000","last_became_active":"2024-09-14T10:49:23.375310+0000","last_became_peered":"2024-09-14T10:49:23.375310+0000","last_unstale":"2024-09-14T12:43:37.080833+0000","last_undegraded":"2024-09-14T12:43:37.080833+0000","last_fullsized":"2024-09-14T12:43:37.080833+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:47.638057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22018826,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":753,"num_read_kb":30362,"num_write":1144,"num_write_kb":52321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'5","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.501490+0000","last_change":"2024-09-14T10:49:27.386902+0000","last_active":"2024-09-14T12:43:48.501490+0000","last_peered":"2024-09-14T12:43:48.501490+0000","last_clean":"2024-09-14T12:43:48.501490+0000","last_became_active":"2024-09-14T10:49:27.386412+0000","last_became_peered":"2024-09-14T10:49:27.386412+0000","last_unstale":"2024-09-14T12:43:48.501490+0000","last_undegraded":"2024-09-14T12:43:48.501490+0000","last_fullsized":"2024-09-14T12:43:48.501490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:24.661084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'353","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506319+0000","last_change":"2024-09-14T10:49:29.388733+0000","last_active":"2024-09-14T12:42:01.506319+0000","last_peered":"2024-09-14T12:42:01.506319+0000","last_clean":"2024-09-14T12:42:01.506319+0000","last_became_active":"2024-09-14T10:49:29.388370+0000","last_became_peered":"2024-09-14T10:49:29.388370+0000","last_unstale":"2024-09-14T12:42:01.506319+0000","last_undegraded":"2024-09-14T12:42:01.506319+0000","last_fullsized":"2024-09-14T12:42:01.506319+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.037315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46625,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":564,"num_read_kb":950,"num_write":456,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.545289+0000","last_change":"2024-09-14T10:49:31.430532+0000","last_active":"2024-09-14T12:39:35.545289+0000","last_peered":"2024-09-14T12:39:35.545289+0000","last_clean":"2024-09-14T12:39:35.545289+0000","last_became_active":"2024-09-14T10:49:31.429861+0000","last_became_peered":"2024-09-14T10:49:31.429861+0000","last_unstale":"2024-09-14T12:39:35.545289+0000","last_undegraded":"2024-09-14T12:39:35.545289+0000","last_fullsized":"2024-09-14T12:39:35.545289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:13.932023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'278","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.559029+0000","last_change":"2024-09-14T10:49:33.451361+0000","last_active":"2024-09-14T12:42:24.559029+0000","last_peered":"2024-09-14T12:42:24.559029+0000","last_clean":"2024-09-14T12:42:24.559029+0000","last_became_active":"2024-09-14T10:49:33.446698+0000","last_became_peered":"2024-09-14T10:49:33.446698+0000","last_unstale":"2024-09-14T12:42:24.559029+0000","last_undegraded":"2024-09-14T12:42:24.559029+0000","last_fullsized":"2024-09-14T12:42:24.559029+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:44.754797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":288,"num_write":643,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'442","reported_seq":2142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.508259+0000","last_change":"2024-09-14T10:49:25.396269+0000","last_active":"2024-09-14T12:39:44.508259+0000","last_peered":"2024-09-14T12:39:44.508259+0000","last_clean":"2024-09-14T12:39:44.508259+0000","last_became_active":"2024-09-14T10:49:25.395644+0000","last_became_peered":"2024-09-14T10:49:25.395644+0000","last_unstale":"2024-09-14T12:39:44.508259+0000","last_undegraded":"2024-09-14T12:39:44.508259+0000","last_fullsized":"2024-09-14T12:39:44.508259+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:11.713387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2723,"num_read_kb":2577,"num_write":520,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'282","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:07.338108+0000","last_change":"2024-09-14T10:49:23.395500+0000","last_active":"2024-09-14T12:40:07.338108+0000","last_peered":"2024-09-14T12:40:07.338108+0000","last_clean":"2024-09-14T12:40:07.338108+0000","last_became_active":"2024-09-14T10:49:23.394870+0000","last_became_peered":"2024-09-14T10:49:23.394870+0000","last_unstale":"2024-09-14T12:40:07.338108+0000","last_undegraded":"2024-09-14T12:40:07.338108+0000","last_fullsized":"2024-09-14T12:40:07.338108+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:09.297899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4540402,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":553,"num_read_kb":18368,"num_write":1036,"num_write_kb":30203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136301+0000","last_change":"2024-09-14T10:49:27.387706+0000","last_active":"2024-09-14T12:39:31.136301+0000","last_peered":"2024-09-14T12:39:31.136301+0000","last_clean":"2024-09-14T12:39:31.136301+0000","last_became_active":"2024-09-14T10:49:27.385720+0000","last_became_peered":"2024-09-14T10:49:27.385720+0000","last_unstale":"2024-09-14T12:39:31.136301+0000","last_undegraded":"2024-09-14T12:39:31.136301+0000","last_fullsized":"2024-09-14T12:39:31.136301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:41.338079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'333","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561794+0000","last_change":"2024-09-14T10:49:29.364739+0000","last_active":"2024-09-14T12:42:01.561794+0000","last_peered":"2024-09-14T12:42:01.561794+0000","last_clean":"2024-09-14T12:42:01.561794+0000","last_became_active":"2024-09-14T10:49:29.363989+0000","last_became_peered":"2024-09-14T10:49:29.363989+0000","last_unstale":"2024-09-14T12:42:01.561794+0000","last_undegraded":"2024-09-14T12:42:01.561794+0000","last_fullsized":"2024-09-14T12:42:01.561794+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:11.406587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56407,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":525,"num_read_kb":1007,"num_write":416,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760421+0000","last_change":"2024-09-14T10:49:31.423380+0000","last_active":"2024-09-14T12:41:54.760421+0000","last_peered":"2024-09-14T12:41:54.760421+0000","last_clean":"2024-09-14T12:41:54.760421+0000","last_became_active":"2024-09-14T10:49:31.421636+0000","last_became_peered":"2024-09-14T10:49:31.421636+0000","last_unstale":"2024-09-14T12:41:54.760421+0000","last_undegraded":"2024-09-14T12:41:54.760421+0000","last_fullsized":"2024-09-14T12:41:54.760421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:30.278841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.656575+0000","last_change":"2024-09-14T10:49:33.466507+0000","last_active":"2024-09-14T12:43:48.656575+0000","last_peered":"2024-09-14T12:43:48.656575+0000","last_clean":"2024-09-14T12:43:48.656575+0000","last_became_active":"2024-09-14T10:49:33.465638+0000","last_became_peered":"2024-09-14T10:49:33.465638+0000","last_unstale":"2024-09-14T12:43:48.656575+0000","last_undegraded":"2024-09-14T12:43:48.656575+0000","last_fullsized":"2024-09-14T12:43:48.656575+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:13.972982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'566","reported_seq":2222,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.703947+0000","last_change":"2024-09-14T10:49:25.384614+0000","last_active":"2024-09-14T12:42:31.703947+0000","last_peered":"2024-09-14T12:42:31.703947+0000","last_clean":"2024-09-14T12:42:31.703947+0000","last_became_active":"2024-09-14T10:49:25.383840+0000","last_became_peered":"2024-09-14T10:49:25.383840+0000","last_unstale":"2024-09-14T12:42:31.703947+0000","last_undegraded":"2024-09-14T12:42:31.703947+0000","last_fullsized":"2024-09-14T12:42:31.703947+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:21.627271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2923,"num_read_kb":2712,"num_write":720,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'399","reported_seq":1100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:34.760157+0000","last_change":"2024-09-14T10:49:23.340003+0000","last_active":"2024-09-14T12:39:34.760157+0000","last_peered":"2024-09-14T12:39:34.760157+0000","last_clean":"2024-09-14T12:39:34.760157+0000","last_became_active":"2024-09-14T10:49:23.338934+0000","last_became_peered":"2024-09-14T10:49:23.338934+0000","last_unstale":"2024-09-14T12:39:34.760157+0000","last_undegraded":"2024-09-14T12:39:34.760157+0000","last_fullsized":"2024-09-14T12:39:34.760157+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:53.526708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14158597,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":771,"num_read_kb":33265,"num_write":1244,"num_write_kb":49842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:30.555291+0000","last_change":"2024-09-14T10:49:27.369319+0000","last_active":"2024-09-14T12:39:30.555291+0000","last_peered":"2024-09-14T12:39:30.555291+0000","last_clean":"2024-09-14T12:39:30.555291+0000","last_became_active":"2024-09-14T10:49:27.368567+0000","last_became_peered":"2024-09-14T10:49:27.368567+0000","last_unstale":"2024-09-14T12:39:30.555291+0000","last_undegraded":"2024-09-14T12:39:30.555291+0000","last_fullsized":"2024-09-14T12:39:30.555291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:50.967591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'149","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:46.501799+0000","last_change":"2024-09-14T10:49:29.393578+0000","last_active":"2024-09-14T12:41:46.501799+0000","last_peered":"2024-09-14T12:41:46.501799+0000","last_clean":"2024-09-14T12:41:46.501799+0000","last_became_active":"2024-09-14T10:49:29.392965+0000","last_became_peered":"2024-09-14T10:49:29.392965+0000","last_unstale":"2024-09-14T12:41:46.501799+0000","last_undegraded":"2024-09-14T12:41:46.501799+0000","last_fullsized":"2024-09-14T12:41:46.501799+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.416866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":187,"num_read_kb":181,"num_write":132,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'788","reported_seq":3261,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:49.100675+0000","last_change":"2024-09-14T10:49:31.423609+0000","last_active":"2024-09-14T12:43:49.100675+0000","last_peered":"2024-09-14T12:43:49.100675+0000","last_clean":"2024-09-14T12:43:49.100675+0000","last_became_active":"2024-09-14T10:49:31.422765+0000","last_became_peered":"2024-09-14T10:49:31.422765+0000","last_unstale":"2024-09-14T12:43:49.100675+0000","last_undegraded":"2024-09-14T12:43:49.100675+0000","last_fullsized":"2024-09-14T12:43:49.100675+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:06.381324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'100","reported_seq":619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:27.666413+0000","last_change":"2024-09-14T10:49:33.443828+0000","last_active":"2024-09-14T12:42:27.666413+0000","last_peered":"2024-09-14T12:42:27.666413+0000","last_clean":"2024-09-14T12:42:27.666413+0000","last_became_active":"2024-09-14T10:49:33.443020+0000","last_became_peered":"2024-09-14T10:49:33.443020+0000","last_unstale":"2024-09-14T12:42:27.666413+0000","last_undegraded":"2024-09-14T12:42:27.666413+0000","last_fullsized":"2024-09-14T12:42:27.666413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.241734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":233,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'968","reported_seq":2582,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.506058+0000","last_change":"2024-09-14T10:49:25.401196+0000","last_active":"2024-09-14T12:39:44.506058+0000","last_peered":"2024-09-14T12:39:44.506058+0000","last_clean":"2024-09-14T12:39:44.506058+0000","last_became_active":"2024-09-14T10:49:25.400786+0000","last_became_peered":"2024-09-14T10:49:25.400786+0000","last_unstale":"2024-09-14T12:39:44.506058+0000","last_undegraded":"2024-09-14T12:39:44.506058+0000","last_fullsized":"2024-09-14T12:39:44.506058+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":900,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:26.988291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4481,"num_read_kb":3955,"num_write":1321,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'267","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.608528+0000","last_change":"2024-09-14T10:49:23.395425+0000","last_active":"2024-09-14T12:39:49.608528+0000","last_peered":"2024-09-14T12:39:49.608528+0000","last_clean":"2024-09-14T12:39:49.608528+0000","last_became_active":"2024-09-14T10:49:23.394973+0000","last_became_peered":"2024-09-14T10:49:23.394973+0000","last_unstale":"2024-09-14T12:39:49.608528+0000","last_undegraded":"2024-09-14T12:39:49.608528+0000","last_fullsized":"2024-09-14T12:39:49.608528+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.054954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8188169,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":541,"num_read_kb":75759,"num_write":965,"num_write_kb":39860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:30.533301+0000","last_change":"2024-09-14T10:49:27.378358+0000","last_active":"2024-09-14T12:39:30.533301+0000","last_peered":"2024-09-14T12:39:30.533301+0000","last_clean":"2024-09-14T12:39:30.533301+0000","last_became_active":"2024-09-14T10:49:27.377395+0000","last_became_peered":"2024-09-14T10:49:27.377395+0000","last_unstale":"2024-09-14T12:39:30.533301+0000","last_undegraded":"2024-09-14T12:39:30.533301+0000","last_fullsized":"2024-09-14T12:39:30.533301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:07.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'389","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:25.830017+0000","last_change":"2024-09-14T10:49:29.377185+0000","last_active":"2024-09-14T12:43:25.830017+0000","last_peered":"2024-09-14T12:43:25.830017+0000","last_clean":"2024-09-14T12:43:25.830017+0000","last_became_active":"2024-09-14T10:49:29.376813+0000","last_became_peered":"2024-09-14T10:49:29.376813+0000","last_unstale":"2024-09-14T12:43:25.830017+0000","last_undegraded":"2024-09-14T12:43:25.830017+0000","last_fullsized":"2024-09-14T12:43:25.830017+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.599152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53512,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":615,"num_read_kb":1099,"num_write":486,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571666+0000","last_change":"2024-09-14T10:49:31.425171+0000","last_active":"2024-09-14T12:40:45.571666+0000","last_peered":"2024-09-14T12:40:45.571666+0000","last_clean":"2024-09-14T12:40:45.571666+0000","last_became_active":"2024-09-14T10:49:31.424394+0000","last_became_peered":"2024-09-14T10:49:31.424394+0000","last_unstale":"2024-09-14T12:40:45.571666+0000","last_undegraded":"2024-09-14T12:40:45.571666+0000","last_fullsized":"2024-09-14T12:40:45.571666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:07.004493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'151","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.578263+0000","last_change":"2024-09-14T10:49:33.463294+0000","last_active":"2024-09-14T12:42:24.578263+0000","last_peered":"2024-09-14T12:42:24.578263+0000","last_clean":"2024-09-14T12:42:24.578263+0000","last_became_active":"2024-09-14T10:49:33.462582+0000","last_became_peered":"2024-09-14T10:49:33.462582+0000","last_unstale":"2024-09-14T12:42:24.578263+0000","last_undegraded":"2024-09-14T12:42:24.578263+0000","last_fullsized":"2024-09-14T12:42:24.578263+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:51.070074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":151,"num_write":347,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'487","reported_seq":2225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.769121+0000","last_change":"2024-09-14T10:49:25.387231+0000","last_active":"2024-09-14T12:42:31.769121+0000","last_peered":"2024-09-14T12:42:31.769121+0000","last_clean":"2024-09-14T12:42:31.769121+0000","last_became_active":"2024-09-14T10:49:25.386937+0000","last_became_peered":"2024-09-14T10:49:25.386937+0000","last_unstale":"2024-09-14T12:42:31.769121+0000","last_undegraded":"2024-09-14T12:42:31.769121+0000","last_fullsized":"2024-09-14T12:42:31.769121+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:41.631753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2676,"num_write":566,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'305","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:42.941916+0000","last_change":"2024-09-14T10:49:53.506313+0000","last_active":"2024-09-14T12:43:42.941916+0000","last_peered":"2024-09-14T12:43:42.941916+0000","last_clean":"2024-09-14T12:43:42.941916+0000","last_became_active":"2024-09-14T10:49:53.505479+0000","last_became_peered":"2024-09-14T10:49:53.505479+0000","last_unstale":"2024-09-14T12:43:42.941916+0000","last_undegraded":"2024-09-14T12:43:42.941916+0000","last_fullsized":"2024-09-14T12:43:42.941916+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:20.359828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7666583,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":607,"num_read_kb":68230,"num_write":1102,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1,6],"acting":[3,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136252+0000","last_change":"2024-09-14T10:49:27.371936+0000","last_active":"2024-09-14T12:39:31.136252+0000","last_peered":"2024-09-14T12:39:31.136252+0000","last_clean":"2024-09-14T12:39:31.136252+0000","last_became_active":"2024-09-14T10:49:27.371450+0000","last_became_peered":"2024-09-14T10:49:27.371450+0000","last_unstale":"2024-09-14T12:39:31.136252+0000","last_undegraded":"2024-09-14T12:39:31.136252+0000","last_fullsized":"2024-09-14T12:39:31.136252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:11.677326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'295","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:05.603542+0000","last_change":"2024-09-14T10:49:29.380669+0000","last_active":"2024-09-14T12:43:05.603542+0000","last_peered":"2024-09-14T12:43:05.603542+0000","last_clean":"2024-09-14T12:43:05.603542+0000","last_became_active":"2024-09-14T10:49:29.379942+0000","last_became_peered":"2024-09-14T10:49:29.379942+0000","last_unstale":"2024-09-14T12:43:05.603542+0000","last_undegraded":"2024-09-14T12:43:05.603542+0000","last_fullsized":"2024-09-14T12:43:05.603542+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:50.784831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55454,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":936,"num_write":380,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490245+0000","last_change":"2024-09-14T10:49:31.430688+0000","last_active":"2024-09-14T12:41:01.490245+0000","last_peered":"2024-09-14T12:41:01.490245+0000","last_clean":"2024-09-14T12:41:01.490245+0000","last_became_active":"2024-09-14T10:49:31.424882+0000","last_became_peered":"2024-09-14T10:49:31.424882+0000","last_unstale":"2024-09-14T12:41:01.490245+0000","last_undegraded":"2024-09-14T12:41:01.490245+0000","last_fullsized":"2024-09-14T12:41:01.490245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:10.035901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'115","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.540999+0000","last_change":"2024-09-14T10:49:33.469121+0000","last_active":"2024-09-14T12:41:29.540999+0000","last_peered":"2024-09-14T12:41:29.540999+0000","last_clean":"2024-09-14T12:41:29.540999+0000","last_became_active":"2024-09-14T10:49:33.468026+0000","last_became_peered":"2024-09-14T10:49:33.468026+0000","last_unstale":"2024-09-14T12:41:29.540999+0000","last_undegraded":"2024-09-14T12:41:29.540999+0000","last_fullsized":"2024-09-14T12:41:29.540999+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:54.591274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":167,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'978","reported_seq":2671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.736717+0000","last_change":"2024-09-14T10:49:25.386916+0000","last_active":"2024-09-14T12:41:23.736717+0000","last_peered":"2024-09-14T12:41:23.736717+0000","last_clean":"2024-09-14T12:41:23.736717+0000","last_became_active":"2024-09-14T10:49:25.386168+0000","last_became_peered":"2024-09-14T10:49:25.386168+0000","last_unstale":"2024-09-14T12:41:23.736717+0000","last_undegraded":"2024-09-14T12:41:23.736717+0000","last_fullsized":"2024-09-14T12:41:23.736717+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":900,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.415912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4881,"num_read_kb":4356,"num_write":1346,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'270","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360047+0000","last_change":"2024-09-14T10:49:23.368770+0000","last_active":"2024-09-14T12:41:55.360047+0000","last_peered":"2024-09-14T12:41:55.360047+0000","last_clean":"2024-09-14T12:41:55.360047+0000","last_became_active":"2024-09-14T10:49:23.367940+0000","last_became_peered":"2024-09-14T10:49:23.367940+0000","last_unstale":"2024-09-14T12:41:55.360047+0000","last_undegraded":"2024-09-14T12:41:55.360047+0000","last_fullsized":"2024-09-14T12:41:55.360047+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:45.609107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4273589,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":524,"num_read_kb":29389,"num_write":999,"num_write_kb":29053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549364+0000","last_change":"2024-09-14T10:49:27.381081+0000","last_active":"2024-09-14T12:40:40.549364+0000","last_peered":"2024-09-14T12:40:40.549364+0000","last_clean":"2024-09-14T12:40:40.549364+0000","last_became_active":"2024-09-14T10:49:27.380333+0000","last_became_peered":"2024-09-14T10:49:27.380333+0000","last_unstale":"2024-09-14T12:40:40.549364+0000","last_undegraded":"2024-09-14T12:40:40.549364+0000","last_fullsized":"2024-09-14T12:40:40.549364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:32.329024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'239","reported_seq":820,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561664+0000","last_change":"2024-09-14T10:49:29.378365+0000","last_active":"2024-09-14T12:42:01.561664+0000","last_peered":"2024-09-14T12:42:01.561664+0000","last_clean":"2024-09-14T12:42:01.561664+0000","last_became_active":"2024-09-14T10:49:29.377643+0000","last_became_peered":"2024-09-14T10:49:29.377643+0000","last_unstale":"2024-09-14T12:42:01.561664+0000","last_undegraded":"2024-09-14T12:42:01.561664+0000","last_fullsized":"2024-09-14T12:42:01.561664+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:11.214340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51632,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":376,"num_read_kb":788,"num_write":302,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468822+0000","last_change":"2024-09-14T10:49:31.431402+0000","last_active":"2024-09-14T12:39:36.468822+0000","last_peered":"2024-09-14T12:39:36.468822+0000","last_clean":"2024-09-14T12:39:36.468822+0000","last_became_active":"2024-09-14T10:49:31.430693+0000","last_became_peered":"2024-09-14T10:49:31.430693+0000","last_unstale":"2024-09-14T12:39:36.468822+0000","last_undegraded":"2024-09-14T12:39:36.468822+0000","last_fullsized":"2024-09-14T12:39:36.468822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:32.715814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'154","reported_seq":1639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.449796+0000","last_change":"2024-09-14T10:49:33.476298+0000","last_active":"2024-09-14T12:42:24.449796+0000","last_peered":"2024-09-14T12:42:24.449796+0000","last_clean":"2024-09-14T12:42:24.449796+0000","last_became_active":"2024-09-14T10:49:33.475592+0000","last_became_peered":"2024-09-14T10:49:33.475592+0000","last_unstale":"2024-09-14T12:42:24.449796+0000","last_undegraded":"2024-09-14T12:42:24.449796+0000","last_fullsized":"2024-09-14T12:42:24.449796+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:10.319176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1153,"num_read_kb":1151,"num_write":333,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'1200","reported_seq":2911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.582879+0000","last_change":"2024-09-14T10:49:25.362578+0000","last_active":"2024-09-14T12:41:29.582879+0000","last_peered":"2024-09-14T12:41:29.582879+0000","last_clean":"2024-09-14T12:41:29.582879+0000","last_became_active":"2024-09-14T10:49:25.362059+0000","last_became_peered":"2024-09-14T10:49:25.362059+0000","last_unstale":"2024-09-14T12:41:29.582879+0000","last_undegraded":"2024-09-14T12:41:29.582879+0000","last_fullsized":"2024-09-14T12:41:29.582879+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:36.132405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5522,"num_read_kb":4921,"num_write":1640,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'338","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.360131+0000","last_change":"2024-09-14T10:49:23.382568+0000","last_active":"2024-09-14T12:41:55.360131+0000","last_peered":"2024-09-14T12:41:55.360131+0000","last_clean":"2024-09-14T12:41:55.360131+0000","last_became_active":"2024-09-14T10:49:23.381620+0000","last_became_peered":"2024-09-14T10:49:23.381620+0000","last_unstale":"2024-09-14T12:41:55.360131+0000","last_undegraded":"2024-09-14T12:41:55.360131+0000","last_fullsized":"2024-09-14T12:41:55.360131+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:07.597062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381662,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":674,"num_read_kb":34199,"num_write":1177,"num_write_kb":46564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:10.577149+0000","last_change":"2024-09-14T10:49:27.373477+0000","last_active":"2024-09-14T12:41:10.577149+0000","last_peered":"2024-09-14T12:41:10.577149+0000","last_clean":"2024-09-14T12:41:10.577149+0000","last_became_active":"2024-09-14T10:49:27.372685+0000","last_became_peered":"2024-09-14T10:49:27.372685+0000","last_unstale":"2024-09-14T12:41:10.577149+0000","last_undegraded":"2024-09-14T12:41:10.577149+0000","last_fullsized":"2024-09-14T12:41:10.577149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:18.351337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'326","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506246+0000","last_change":"2024-09-14T10:49:29.397492+0000","last_active":"2024-09-14T12:42:01.506246+0000","last_peered":"2024-09-14T12:42:01.506246+0000","last_clean":"2024-09-14T12:42:01.506246+0000","last_became_active":"2024-09-14T10:49:29.396379+0000","last_became_peered":"2024-09-14T10:49:29.396379+0000","last_unstale":"2024-09-14T12:42:01.506246+0000","last_undegraded":"2024-09-14T12:42:01.506246+0000","last_fullsized":"2024-09-14T12:42:01.506246+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:50.814297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59903,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":539,"num_read_kb":1024,"num_write":426,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.556297+0000","last_change":"2024-09-14T10:49:31.420969+0000","last_active":"2024-09-14T12:39:35.556297+0000","last_peered":"2024-09-14T12:39:35.556297+0000","last_clean":"2024-09-14T12:39:35.556297+0000","last_became_active":"2024-09-14T10:49:31.418819+0000","last_became_peered":"2024-09-14T10:49:31.418819+0000","last_unstale":"2024-09-14T12:39:35.556297+0000","last_undegraded":"2024-09-14T12:39:35.556297+0000","last_fullsized":"2024-09-14T12:39:35.556297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:53.067509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'132","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.601534+0000","last_change":"2024-09-14T10:49:33.477067+0000","last_active":"2024-09-14T12:43:47.601534+0000","last_peered":"2024-09-14T12:43:47.601534+0000","last_clean":"2024-09-14T12:43:47.601534+0000","last_became_active":"2024-09-14T10:49:33.476455+0000","last_became_peered":"2024-09-14T10:49:33.476455+0000","last_unstale":"2024-09-14T12:43:47.601534+0000","last_undegraded":"2024-09-14T12:43:47.601534+0000","last_fullsized":"2024-09-14T12:43:47.601534+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:57.442153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":173,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'504","reported_seq":2191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.582161+0000","last_change":"2024-09-14T10:49:25.374531+0000","last_active":"2024-09-14T12:41:29.582161+0000","last_peered":"2024-09-14T12:41:29.582161+0000","last_clean":"2024-09-14T12:41:29.582161+0000","last_became_active":"2024-09-14T10:49:25.373337+0000","last_became_peered":"2024-09-14T10:49:25.373337+0000","last_unstale":"2024-09-14T12:41:29.582161+0000","last_undegraded":"2024-09-14T12:41:29.582161+0000","last_fullsized":"2024-09-14T12:41:29.582161+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:13.554009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2857,"num_read_kb":2693,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'281","reported_seq":954,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:46.809140+0000","last_change":"2024-09-14T10:49:23.378184+0000","last_active":"2024-09-14T12:43:46.809140+0000","last_peered":"2024-09-14T12:43:46.809140+0000","last_clean":"2024-09-14T12:43:46.809140+0000","last_became_active":"2024-09-14T10:49:23.377766+0000","last_became_peered":"2024-09-14T10:49:23.377766+0000","last_unstale":"2024-09-14T12:43:46.809140+0000","last_undegraded":"2024-09-14T12:43:46.809140+0000","last_fullsized":"2024-09-14T12:43:46.809140+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:23.916084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11876760,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":548,"num_read_kb":20990,"num_write":989,"num_write_kb":39444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'622","reported_seq":2307,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.828646+0000","last_change":"2024-09-14T10:49:25.376291+0000","last_active":"2024-09-14T12:41:11.828646+0000","last_peered":"2024-09-14T12:41:11.828646+0000","last_clean":"2024-09-14T12:41:11.828646+0000","last_became_active":"2024-09-14T10:49:25.375595+0000","last_became_peered":"2024-09-14T10:49:25.375595+0000","last_unstale":"2024-09-14T12:41:11.828646+0000","last_undegraded":"2024-09-14T12:41:11.828646+0000","last_fullsized":"2024-09-14T12:41:11.828646+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:54.871887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3344,"num_read_kb":3023,"num_write":799,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'292","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.677452+0000","last_change":"2024-09-14T10:49:23.392114+0000","last_active":"2024-09-14T12:44:04.677452+0000","last_peered":"2024-09-14T12:44:04.677452+0000","last_clean":"2024-09-14T12:44:04.677452+0000","last_became_active":"2024-09-14T10:49:23.390456+0000","last_became_peered":"2024-09-14T10:49:23.390456+0000","last_unstale":"2024-09-14T12:44:04.677452+0000","last_undegraded":"2024-09-14T12:44:04.677452+0000","last_fullsized":"2024-09-14T12:44:04.677452+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:19.921702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190342,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":449,"num_read_kb":9557,"num_write":874,"num_write_kb":19994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'455","reported_seq":2085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.608380+0000","last_change":"2024-09-14T10:49:25.377312+0000","last_active":"2024-09-14T12:43:47.608380+0000","last_peered":"2024-09-14T12:43:47.608380+0000","last_clean":"2024-09-14T12:43:47.608380+0000","last_became_active":"2024-09-14T10:49:25.372436+0000","last_became_peered":"2024-09-14T10:49:25.372436+0000","last_unstale":"2024-09-14T12:43:47.608380+0000","last_undegraded":"2024-09-14T12:43:47.608380+0000","last_fullsized":"2024-09-14T12:43:47.608380+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:05.450288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2453,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'274","reported_seq":970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504696+0000","last_change":"2024-09-14T10:49:23.395538+0000","last_active":"2024-09-14T12:41:56.504696+0000","last_peered":"2024-09-14T12:41:56.504696+0000","last_clean":"2024-09-14T12:41:56.504696+0000","last_became_active":"2024-09-14T10:49:23.395161+0000","last_became_peered":"2024-09-14T10:49:23.395161+0000","last_unstale":"2024-09-14T12:41:56.504696+0000","last_undegraded":"2024-09-14T12:41:56.504696+0000","last_fullsized":"2024-09-14T12:41:56.504696+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:29.846931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2318602,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":620,"num_read_kb":8858,"num_write":968,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'753","reported_seq":2450,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.132003+0000","last_change":"2024-09-14T10:49:25.391763+0000","last_active":"2024-09-14T12:42:22.132003+0000","last_peered":"2024-09-14T12:42:22.132003+0000","last_clean":"2024-09-14T12:42:22.132003+0000","last_became_active":"2024-09-14T10:49:25.390167+0000","last_became_peered":"2024-09-14T10:49:25.390167+0000","last_unstale":"2024-09-14T12:42:22.132003+0000","last_undegraded":"2024-09-14T12:42:22.132003+0000","last_fullsized":"2024-09-14T12:42:22.132003+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.035163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3780,"num_read_kb":3460,"num_write":968,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'297","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.046545+0000","last_change":"2024-09-14T10:49:23.375090+0000","last_active":"2024-09-14T12:41:06.046545+0000","last_peered":"2024-09-14T12:41:06.046545+0000","last_clean":"2024-09-14T12:41:06.046545+0000","last_became_active":"2024-09-14T10:49:23.374332+0000","last_became_peered":"2024-09-14T10:49:23.374332+0000","last_unstale":"2024-09-14T12:41:06.046545+0000","last_undegraded":"2024-09-14T12:41:06.046545+0000","last_fullsized":"2024-09-14T12:41:06.046545+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:00.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779726,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":610,"num_read_kb":1430,"num_write":1197,"num_write_kb":16611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'435","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.715675+0000","last_change":"2024-09-14T10:49:25.391424+0000","last_active":"2024-09-14T12:42:31.715675+0000","last_peered":"2024-09-14T12:42:31.715675+0000","last_clean":"2024-09-14T12:42:31.715675+0000","last_became_active":"2024-09-14T10:49:25.390444+0000","last_became_peered":"2024-09-14T10:49:25.390444+0000","last_unstale":"2024-09-14T12:42:31.715675+0000","last_undegraded":"2024-09-14T12:42:31.715675+0000","last_fullsized":"2024-09-14T12:42:31.715675+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:26.275135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2280,"num_write":506,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'263","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.534070+0000","last_change":"2024-09-14T10:49:23.365856+0000","last_active":"2024-09-14T12:39:56.534070+0000","last_peered":"2024-09-14T12:39:56.534070+0000","last_clean":"2024-09-14T12:39:56.534070+0000","last_became_active":"2024-09-14T10:49:23.365007+0000","last_became_peered":"2024-09-14T10:49:23.365007+0000","last_unstale":"2024-09-14T12:39:56.534070+0000","last_undegraded":"2024-09-14T12:39:56.534070+0000","last_fullsized":"2024-09-14T12:39:56.534070+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:22.123987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28000,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":465,"num_read_kb":40509,"num_write":970,"num_write_kb":34103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'617","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.811795+0000","last_change":"2024-09-14T10:49:25.381143+0000","last_active":"2024-09-14T12:41:55.811795+0000","last_peered":"2024-09-14T12:41:55.811795+0000","last_clean":"2024-09-14T12:41:55.811795+0000","last_became_active":"2024-09-14T10:49:25.380751+0000","last_became_peered":"2024-09-14T10:49:25.380751+0000","last_unstale":"2024-09-14T12:41:55.811795+0000","last_undegraded":"2024-09-14T12:41:55.811795+0000","last_fullsized":"2024-09-14T12:41:55.811795+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:26.129271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3385,"num_read_kb":3142,"num_write":784,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'303","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.663098+0000","last_change":"2024-09-14T10:49:23.367673+0000","last_active":"2024-09-14T12:39:56.663098+0000","last_peered":"2024-09-14T12:39:56.663098+0000","last_clean":"2024-09-14T12:39:56.663098+0000","last_became_active":"2024-09-14T10:49:23.366946+0000","last_became_peered":"2024-09-14T10:49:23.366946+0000","last_unstale":"2024-09-14T12:39:56.663098+0000","last_undegraded":"2024-09-14T12:39:56.663098+0000","last_fullsized":"2024-09-14T12:39:56.663098+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:45.550841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10887879,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":574,"num_read_kb":15337,"num_write":1132,"num_write_kb":33762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'817","reported_seq":2544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.209601+0000","last_change":"2024-09-14T10:49:25.395514+0000","last_active":"2024-09-14T12:42:22.209601+0000","last_peered":"2024-09-14T12:42:22.209601+0000","last_clean":"2024-09-14T12:42:22.209601+0000","last_became_active":"2024-09-14T10:49:25.394994+0000","last_became_peered":"2024-09-14T10:49:25.394994+0000","last_unstale":"2024-09-14T12:42:22.209601+0000","last_undegraded":"2024-09-14T12:42:22.209601+0000","last_fullsized":"2024-09-14T12:42:22.209601+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:10.461194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4031,"num_read_kb":3664,"num_write":1069,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'333","reported_seq":1182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142473+0000","last_change":"2024-09-14T10:49:23.373580+0000","last_active":"2024-09-14T12:39:56.142473+0000","last_peered":"2024-09-14T12:39:56.142473+0000","last_clean":"2024-09-14T12:39:56.142473+0000","last_became_active":"2024-09-14T10:49:23.373080+0000","last_became_peered":"2024-09-14T10:49:23.373080+0000","last_unstale":"2024-09-14T12:39:56.142473+0000","last_undegraded":"2024-09-14T12:39:56.142473+0000","last_fullsized":"2024-09-14T12:39:56.142473+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:31.818739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8600715,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1360,"num_read_kb":12734,"num_write":1166,"num_write_kb":19451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'534","reported_seq":2270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568255+0000","last_change":"2024-09-14T10:49:25.376719+0000","last_active":"2024-09-14T12:41:55.568255+0000","last_peered":"2024-09-14T12:41:55.568255+0000","last_clean":"2024-09-14T12:41:55.568255+0000","last_became_active":"2024-09-14T10:49:25.375465+0000","last_became_peered":"2024-09-14T10:49:25.375465+0000","last_unstale":"2024-09-14T12:41:55.568255+0000","last_undegraded":"2024-09-14T12:41:55.568255+0000","last_fullsized":"2024-09-14T12:41:55.568255+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.679259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2646,"num_write":644,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'278","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.550380+0000","last_change":"2024-09-14T10:49:23.378694+0000","last_active":"2024-09-14T12:39:55.550380+0000","last_peered":"2024-09-14T12:39:55.550380+0000","last_clean":"2024-09-14T12:39:55.550380+0000","last_became_active":"2024-09-14T10:49:23.377964+0000","last_became_peered":"2024-09-14T10:49:23.377964+0000","last_unstale":"2024-09-14T12:39:55.550380+0000","last_undegraded":"2024-09-14T12:39:55.550380+0000","last_fullsized":"2024-09-14T12:39:55.550380+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:24.829760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4248428,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":523,"num_read_kb":6819,"num_write":1034,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'851","reported_seq":2405,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.209489+0000","last_change":"2024-09-14T10:49:25.387331+0000","last_active":"2024-09-14T12:42:22.209489+0000","last_peered":"2024-09-14T12:42:22.209489+0000","last_clean":"2024-09-14T12:42:22.209489+0000","last_became_active":"2024-09-14T10:49:25.386541+0000","last_became_peered":"2024-09-14T10:49:25.386541+0000","last_unstale":"2024-09-14T12:42:22.209489+0000","last_undegraded":"2024-09-14T12:42:22.209489+0000","last_fullsized":"2024-09-14T12:42:22.209489+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:37.887330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3987,"num_read_kb":3560,"num_write":1145,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'327","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:39.983841+0000","last_change":"2024-09-14T10:49:23.387632+0000","last_active":"2024-09-14T12:40:39.983841+0000","last_peered":"2024-09-14T12:40:39.983841+0000","last_clean":"2024-09-14T12:40:39.983841+0000","last_became_active":"2024-09-14T10:49:23.387245+0000","last_became_peered":"2024-09-14T10:49:23.387245+0000","last_unstale":"2024-09-14T12:40:39.983841+0000","last_undegraded":"2024-09-14T12:40:39.983841+0000","last_fullsized":"2024-09-14T12:40:39.983841+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:39.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8100655,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":574,"num_read_kb":46177,"num_write":1211,"num_write_kb":35513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'848","reported_seq":2611,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.452842+0000","last_change":"2024-09-14T10:49:25.374040+0000","last_active":"2024-09-14T12:42:29.452842+0000","last_peered":"2024-09-14T12:42:29.452842+0000","last_clean":"2024-09-14T12:42:29.452842+0000","last_became_active":"2024-09-14T10:49:25.373511+0000","last_became_peered":"2024-09-14T10:49:25.373511+0000","last_unstale":"2024-09-14T12:42:29.452842+0000","last_undegraded":"2024-09-14T12:42:29.452842+0000","last_fullsized":"2024-09-14T12:42:29.452842+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:06.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4179,"num_read_kb":3797,"num_write":1119,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'304","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.546496+0000","last_change":"2024-09-14T10:49:23.378107+0000","last_active":"2024-09-14T12:39:40.546496+0000","last_peered":"2024-09-14T12:39:40.546496+0000","last_clean":"2024-09-14T12:39:40.546496+0000","last_became_active":"2024-09-14T10:49:23.377218+0000","last_became_peered":"2024-09-14T10:49:23.377218+0000","last_unstale":"2024-09-14T12:39:40.546496+0000","last_undegraded":"2024-09-14T12:39:40.546496+0000","last_fullsized":"2024-09-14T12:39:40.546496+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:31.856619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9551716,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":579,"num_read_kb":6958,"num_write":1125,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'524","reported_seq":2129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.731901+0000","last_change":"2024-09-14T10:49:25.395953+0000","last_active":"2024-09-14T12:41:23.731901+0000","last_peered":"2024-09-14T12:41:23.731901+0000","last_clean":"2024-09-14T12:41:23.731901+0000","last_became_active":"2024-09-14T10:49:25.394237+0000","last_became_peered":"2024-09-14T10:49:25.394237+0000","last_unstale":"2024-09-14T12:41:23.731901+0000","last_undegraded":"2024-09-14T12:41:23.731901+0000","last_fullsized":"2024-09-14T12:41:23.731901+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:13.449753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2610,"num_write":682,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'307","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.535444+0000","last_change":"2024-09-14T10:49:23.372390+0000","last_active":"2024-09-14T12:39:40.535444+0000","last_peered":"2024-09-14T12:39:40.535444+0000","last_clean":"2024-09-14T12:39:40.535444+0000","last_became_active":"2024-09-14T10:49:23.371845+0000","last_became_peered":"2024-09-14T10:49:23.371845+0000","last_unstale":"2024-09-14T12:39:40.535444+0000","last_undegraded":"2024-09-14T12:39:40.535444+0000","last_fullsized":"2024-09-14T12:39:40.535444+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:14.322795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7346908,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":665,"num_read_kb":30321,"num_write":1104,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'407","reported_seq":1828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.684104+0000","last_change":"2024-09-14T10:49:25.375748+0000","last_active":"2024-09-14T12:42:31.684104+0000","last_peered":"2024-09-14T12:42:31.684104+0000","last_clean":"2024-09-14T12:42:31.684104+0000","last_became_active":"2024-09-14T10:49:25.375374+0000","last_became_peered":"2024-09-14T10:49:25.375374+0000","last_unstale":"2024-09-14T12:42:31.684104+0000","last_undegraded":"2024-09-14T12:42:31.684104+0000","last_fullsized":"2024-09-14T12:42:31.684104+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:51.858708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2030,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'313","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.449533+0000","last_change":"2024-09-14T10:49:23.373160+0000","last_active":"2024-09-14T12:41:16.449533+0000","last_peered":"2024-09-14T12:41:16.449533+0000","last_clean":"2024-09-14T12:41:16.449533+0000","last_became_active":"2024-09-14T10:49:23.371987+0000","last_became_peered":"2024-09-14T10:49:23.371987+0000","last_unstale":"2024-09-14T12:41:16.449533+0000","last_undegraded":"2024-09-14T12:41:16.449533+0000","last_fullsized":"2024-09-14T12:41:16.449533+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:57.645505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18831056,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":645,"num_read_kb":54430,"num_write":1094,"num_write_kb":38478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'764","reported_seq":2315,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.401581+0000","last_change":"2024-09-14T10:49:25.404779+0000","last_active":"2024-09-14T12:42:29.401581+0000","last_peered":"2024-09-14T12:42:29.401581+0000","last_clean":"2024-09-14T12:42:29.401581+0000","last_became_active":"2024-09-14T10:49:25.404302+0000","last_became_peered":"2024-09-14T10:49:25.404302+0000","last_unstale":"2024-09-14T12:42:29.401581+0000","last_undegraded":"2024-09-14T12:42:29.401581+0000","last_fullsized":"2024-09-14T12:42:29.401581+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:18.123156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3673,"num_read_kb":3318,"num_write":995,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'315","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782950+0000","last_change":"2024-09-14T10:49:23.373328+0000","last_active":"2024-09-14T12:39:40.782950+0000","last_peered":"2024-09-14T12:39:40.782950+0000","last_clean":"2024-09-14T12:39:40.782950+0000","last_became_active":"2024-09-14T10:49:23.372362+0000","last_became_peered":"2024-09-14T10:49:23.372362+0000","last_unstale":"2024-09-14T12:39:40.782950+0000","last_undegraded":"2024-09-14T12:39:40.782950+0000","last_fullsized":"2024-09-14T12:39:40.782950+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:33.274164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5596178,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":526,"num_read_kb":10747,"num_write":1122,"num_write_kb":31883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"267'887","reported_seq":2536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.611847+0000","last_change":"2024-09-14T10:49:25.379008+0000","last_active":"2024-09-14T12:43:47.611847+0000","last_peered":"2024-09-14T12:43:47.611847+0000","last_clean":"2024-09-14T12:43:47.611847+0000","last_became_active":"2024-09-14T10:49:25.378231+0000","last_became_peered":"2024-09-14T10:49:25.378231+0000","last_unstale":"2024-09-14T12:43:47.611847+0000","last_undegraded":"2024-09-14T12:43:47.611847+0000","last_fullsized":"2024-09-14T12:43:47.611847+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:27.346745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4260,"num_read_kb":3817,"num_write":1188,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'318","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.415409+0000","last_change":"2024-09-14T10:49:23.396632+0000","last_active":"2024-09-14T12:42:05.415409+0000","last_peered":"2024-09-14T12:42:05.415409+0000","last_clean":"2024-09-14T12:42:05.415409+0000","last_became_active":"2024-09-14T10:49:23.396179+0000","last_became_peered":"2024-09-14T10:49:23.396179+0000","last_unstale":"2024-09-14T12:42:05.415409+0000","last_undegraded":"2024-09-14T12:42:05.415409+0000","last_fullsized":"2024-09-14T12:42:05.415409+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:19.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12572263,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":970,"num_read_kb":35151,"num_write":1188,"num_write_kb":27361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'452","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.639145+0000","last_change":"2024-09-14T10:49:25.387446+0000","last_active":"2024-09-14T12:43:47.639145+0000","last_peered":"2024-09-14T12:43:47.639145+0000","last_clean":"2024-09-14T12:43:47.639145+0000","last_became_active":"2024-09-14T10:49:25.386602+0000","last_became_peered":"2024-09-14T10:49:25.386602+0000","last_unstale":"2024-09-14T12:43:47.639145+0000","last_undegraded":"2024-09-14T12:43:47.639145+0000","last_fullsized":"2024-09-14T12:43:47.639145+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:41.415729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2532,"num_read_kb":2369,"num_write":580,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'359","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.738301+0000","last_change":"2024-09-14T10:49:23.370968+0000","last_active":"2024-09-14T12:44:04.738301+0000","last_peered":"2024-09-14T12:44:04.738301+0000","last_clean":"2024-09-14T12:44:04.738301+0000","last_became_active":"2024-09-14T10:49:23.369989+0000","last_became_peered":"2024-09-14T10:49:23.369989+0000","last_unstale":"2024-09-14T12:44:04.738301+0000","last_undegraded":"2024-09-14T12:44:04.738301+0000","last_fullsized":"2024-09-14T12:44:04.738301+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:46.807806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190304,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":690,"num_read_kb":14222,"num_write":1153,"num_write_kb":28974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'1263","reported_seq":2959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:20.544825+0000","last_change":"2024-09-14T10:49:25.408105+0000","last_active":"2024-09-14T12:40:20.544825+0000","last_peered":"2024-09-14T12:40:20.544825+0000","last_clean":"2024-09-14T12:40:20.544825+0000","last_became_active":"2024-09-14T10:49:25.407817+0000","last_became_peered":"2024-09-14T10:49:25.407817+0000","last_unstale":"2024-09-14T12:40:20.544825+0000","last_undegraded":"2024-09-14T12:40:20.544825+0000","last_fullsized":"2024-09-14T12:40:20.544825+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":1200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:28.857748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5850,"num_read_kb":5153,"num_write":1753,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'311","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.497020+0000","last_change":"2024-09-14T10:49:23.366572+0000","last_active":"2024-09-14T12:41:26.497020+0000","last_peered":"2024-09-14T12:41:26.497020+0000","last_clean":"2024-09-14T12:41:26.497020+0000","last_became_active":"2024-09-14T10:49:23.365975+0000","last_became_peered":"2024-09-14T10:49:23.365975+0000","last_unstale":"2024-09-14T12:41:26.497020+0000","last_undegraded":"2024-09-14T12:41:26.497020+0000","last_fullsized":"2024-09-14T12:41:26.497020+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:46.697172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21473224,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":895,"num_read_kb":99658,"num_write":1100,"num_write_kb":35935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'292","reported_seq":1030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496522+0000","last_change":"2024-09-14T10:49:23.374017+0000","last_active":"2024-09-14T12:41:26.496522+0000","last_peered":"2024-09-14T12:41:26.496522+0000","last_clean":"2024-09-14T12:41:26.496522+0000","last_became_active":"2024-09-14T10:49:23.373652+0000","last_became_peered":"2024-09-14T10:49:23.373652+0000","last_unstale":"2024-09-14T12:41:26.496522+0000","last_undegraded":"2024-09-14T12:41:26.496522+0000","last_fullsized":"2024-09-14T12:41:26.496522+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:34.956815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272146,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":806,"num_read_kb":808,"num_write":1029,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'429","reported_seq":2023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.767109+0000","last_change":"2024-09-14T10:49:25.400404+0000","last_active":"2024-09-14T12:42:31.767109+0000","last_peered":"2024-09-14T12:42:31.767109+0000","last_clean":"2024-09-14T12:42:31.767109+0000","last_became_active":"2024-09-14T10:49:25.399830+0000","last_became_peered":"2024-09-14T10:49:25.399830+0000","last_unstale":"2024-09-14T12:42:31.767109+0000","last_undegraded":"2024-09-14T12:42:31.767109+0000","last_fullsized":"2024-09-14T12:42:31.767109+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:56.425228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2288,"num_read_kb":2174,"num_write":485,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'285","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.571597+0000","last_change":"2024-09-14T10:49:23.384640+0000","last_active":"2024-09-14T12:41:25.571597+0000","last_peered":"2024-09-14T12:41:25.571597+0000","last_clean":"2024-09-14T12:41:25.571597+0000","last_became_active":"2024-09-14T10:49:23.382302+0000","last_became_peered":"2024-09-14T10:49:23.382302+0000","last_unstale":"2024-09-14T12:41:25.571597+0000","last_undegraded":"2024-09-14T12:41:25.571597+0000","last_fullsized":"2024-09-14T12:41:25.571597+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:19.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14347518,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":781,"num_read_kb":33665,"num_write":989,"num_write_kb":42742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'432","reported_seq":2105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.791117+0000","last_change":"2024-09-14T10:49:25.392230+0000","last_active":"2024-09-14T12:41:16.791117+0000","last_peered":"2024-09-14T12:41:16.791117+0000","last_clean":"2024-09-14T12:41:16.791117+0000","last_became_active":"2024-09-14T10:49:25.391680+0000","last_became_peered":"2024-09-14T10:49:25.391680+0000","last_unstale":"2024-09-14T12:41:16.791117+0000","last_undegraded":"2024-09-14T12:41:16.791117+0000","last_fullsized":"2024-09-14T12:41:16.791117+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:29.701571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2427,"num_read_kb":2321,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10880,"num_read_kb":8996,"num_write":3119,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15325,"num_read_kb":14960,"num_write":17100,"num_write_kb":5007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":539,"ondisk_log_size":539,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1949033,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":20817,"num_read_kb":37788,"num_write":17575,"num_write_kb":12732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3039232,"data_stored":2541282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1723,"ondisk_log_size":1723,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2425,"num_read_kb":2890,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221603,"num_read_kb":202842,"num_write":56199,"num_write_kb":19273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3589,"ondisk_log_size":3589,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":605614295,"num_objects":4263,"num_object_clones":0,"num_object_copies":17052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4263,"num_whiteouts":0,"num_read":40605,"num_read_kb":1985148,"num_write":69552,"num_write_kb":2196624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":822476800,"data_stored":822476800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4145,"ondisk_log_size":4145,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":64559776,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":168154,"num_write":160,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122826752,"data_stored":122815808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":49883808,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":139,"num_read_kb":167578,"num_write":165,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114917376,"data_stored":114907797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510827,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238896,"kb_used_data":139680,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94132944,"statfs":{"total":96636764160,"available":96392134656,"internally_reserved":0,"allocated":143032320,"data_stored":140972101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510825,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":403036,"kb_used_data":128908,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93968804,"statfs":{"total":96636764160,"available":96224055296,"internally_reserved":0,"allocated":132001792,"data_stored":129955770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510828,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":382744,"kb_used_data":162824,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":93989096,"statfs":{"total":96636764160,"available":96244834304,"internally_reserved":0,"allocated":166731776,"data_stored":164671390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225180101},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510829,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413496,"kb_used_data":161576,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93958344,"statfs":{"total":96636764160,"available":96213344256,"internally_reserved":0,"allocated":165453824,"data_stored":163399235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510828,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308284,"kb_used_data":168812,"kb_used_omap":1,"kb_used_meta":139454,"kb_avail":94063556,"statfs":{"total":96636764160,"available":96321081344,"internally_reserved":0,"allocated":172863488,"data_stored":170844255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142801349},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510825,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451388,"kb_used_data":131436,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":93920452,"statfs":{"total":96636764160,"available":96174542848,"internally_reserved":0,"allocated":134590464,"data_stored":132523079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":327612869},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510826,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":286608,"kb_used_data":156864,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94085232,"statfs":{"total":96636764160,"available":96343277568,"internally_reserved":0,"allocated":160628736,"data_stored":158530254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543533,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250332,"kb_used_data":24792,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94121508,"statfs":{"total":96636764160,"available":96380424192,"internally_reserved":0,"allocated":25387008,"data_stored":23377561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230881738},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":134848512,"data_stored":134848512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":104042496,"data_stored":104042496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":140152832,"data_stored":140152832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":129421312,"data_stored":129421312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":123695104,"data_stored":123695104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":84639744,"data_stored":84639744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86999040,"data_stored":86999040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18677760,"data_stored":18677760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":478941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":478031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":118964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":267778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":389581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":414006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":359552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":34429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12579690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19935232,"data_stored":19935232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18878464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11538432,"data_stored":11537547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18898944,"data_stored":18895722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7929856,"data_stored":7927606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":25153536,"data_stored":25153536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5238784,"data_stored":5238784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9453568,"data_stored":9452683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19935232,"data_stored":19932010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19451904,"data_stored":19449654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34148352,"data_stored":34143765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26218496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:44:07.001 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T12:44:07.338 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:44:07.338 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":267,"fsid":"34b25a2a-02e0-45bd-900d-fa93b60a7234","created":"2024-09-14T10:48:47.319876+0000","modified":"2024-09-14T11:40:09.896198+0000","last_up_change":"2024-09-14T10:48:59.975400+0000","last_in_change":"2024-09-14T10:48:49.663733+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":17,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:49:00.253091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:49:05.544895+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T10:49:21.306394+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T10:49:23.712211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T10:49:25.479663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T10:49:27.687686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T10:49:29.401498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T10:49:31.552620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:06:27.720230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:12:17.987559+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:12:24.573817+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:40:07.034634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"267","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b2e82c10-45a6-432d-9f50-b1019e527333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6809","nonce":1063069618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6811","nonce":1063069618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6815","nonce":1063069618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1063069618},{"type":"v1","addr":"172.21.15.148:6813","nonce":1063069618}]},"public_addr":"172.21.15.148:6809/1063069618","cluster_addr":"172.21.15.148:6811/1063069618","heartbeat_back_addr":"172.21.15.148:6815/1063069618","heartbeat_front_addr":"172.21.15.148:6813/1063069618","state":["exists","up"]},{"osd":1,"uuid":"823ea616-df7b-45c8-885a-bb308020de7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6825","nonce":1289265320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6827","nonce":1289265320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6831","nonce":1289265320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1289265320},{"type":"v1","addr":"172.21.15.148:6829","nonce":1289265320}]},"public_addr":"172.21.15.148:6825/1289265320","cluster_addr":"172.21.15.148:6827/1289265320","heartbeat_back_addr":"172.21.15.148:6831/1289265320","heartbeat_front_addr":"172.21.15.148:6829/1289265320","state":["exists","up"]},{"osd":2,"uuid":"cfdae3bb-c366-4e4e-809d-e907920b04b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6817","nonce":2601521059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6819","nonce":2601521059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6823","nonce":2601521059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":2601521059},{"type":"v1","addr":"172.21.15.148:6821","nonce":2601521059}]},"public_addr":"172.21.15.148:6817/2601521059","cluster_addr":"172.21.15.148:6819/2601521059","heartbeat_back_addr":"172.21.15.148:6823/2601521059","heartbeat_front_addr":"172.21.15.148:6821/2601521059","state":["exists","up"]},{"osd":3,"uuid":"ba89a661-d99e-48db-8dc4-80da196a3025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6801","nonce":2615370688}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6803","nonce":2615370688}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6807","nonce":2615370688}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2615370688},{"type":"v1","addr":"172.21.15.148:6805","nonce":2615370688}]},"public_addr":"172.21.15.148:6801/2615370688","cluster_addr":"172.21.15.148:6803/2615370688","heartbeat_back_addr":"172.21.15.148:6807/2615370688","heartbeat_front_addr":"172.21.15.148:6805/2615370688","state":["exists","up"]},{"osd":4,"uuid":"c6d32910-7bab-474e-b2c4-eda6efab998d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6818","nonce":485011589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6819","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6821","nonce":485011589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6828","nonce":485011589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6823","nonce":485011589},{"type":"v1","addr":"172.21.15.150:6824","nonce":485011589}]},"public_addr":"172.21.15.150:6818/485011589","cluster_addr":"172.21.15.150:6821/485011589","heartbeat_back_addr":"172.21.15.150:6828/485011589","heartbeat_front_addr":"172.21.15.150:6824/485011589","state":["exists","up"]},{"osd":5,"uuid":"8b53f305-5f46-458f-b2cb-763e13c6cf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6809","nonce":3664436114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6811","nonce":3664436114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6815","nonce":3664436114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":3664436114},{"type":"v1","addr":"172.21.15.150:6813","nonce":3664436114}]},"public_addr":"172.21.15.150:6809/3664436114","cluster_addr":"172.21.15.150:6811/3664436114","heartbeat_back_addr":"172.21.15.150:6815/3664436114","heartbeat_front_addr":"172.21.15.150:6813/3664436114","state":["exists","up"]},{"osd":6,"uuid":"60979f89-421a-48c9-bef8-c0af9c69de4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6817","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6820","nonce":2245691891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6825","nonce":2245691891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6831","nonce":2245691891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6827","nonce":2245691891},{"type":"v1","addr":"172.21.15.150:6829","nonce":2245691891}]},"public_addr":"172.21.15.150:6820/2245691891","cluster_addr":"172.21.15.150:6825/2245691891","heartbeat_back_addr":"172.21.15.150:6831/2245691891","heartbeat_front_addr":"172.21.15.150:6829/2245691891","state":["exists","up"]},{"osd":7,"uuid":"cb6d0e67-b1ae-41ba-857d-51218c6d9f34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6801","nonce":2640697978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6803","nonce":2640697978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6807","nonce":2640697978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2640697978},{"type":"v1","addr":"172.21.15.150:6805","nonce":2640697978}]},"public_addr":"172.21.15.150:6801/2640697978","cluster_addr":"172.21.15.150:6803/2640697978","heartbeat_back_addr":"172.21.15.150:6807/2640697978","heartbeat_front_addr":"172.21.15.150:6805/2640697978","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:57.228068+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.926531+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.755911+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.529954+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.630254+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.291404+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.434473+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:48:56.211132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1","mappings":[{"from":2,"to":5}]},{"pgid":"3.1d","mappings":[{"from":2,"to":6},{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T12:44:08.359 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T12:44:08.359 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:44:08.524 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T12:44:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:44:08.524 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T12:44:08.541 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T12:44:08.840 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T12:44:08.860 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T12:44:08.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:44:09.008 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T12:44:09.008 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:44:09.008 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T12:44:09.025 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T12:44:09.326 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T12:44:09.345 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T12:44:09.346 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:44:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T12:44:09.487 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:44:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T12:44:09.502 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T12:44:09.775 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T12:44:09.794 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T12:44:09.794 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:44:09.937 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T12:44:09.937 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:44:09.937 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T12:44:09.952 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T12:44:10.233 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T12:44:10.252 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T12:44:10.252 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:44:10.391 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T12:44:10.391 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:44:10.391 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T12:44:10.406 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T12:44:10.687 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T12:44:10.705 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T12:44:10.706 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:44:10.844 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T12:44:10.845 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:44:10.845 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T12:44:10.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T12:44:11.138 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T12:44:11.155 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T12:44:11.156 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:44:11.308 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T12:44:11.308 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:44:11.308 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T12:44:11.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T12:44:11.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-14T12:44:11.660+0000 7f55ad44c640 0 --2- 172.21.15.148:0/1186927459 >> [v2:172.21.15.148:3301/0,v1:172.21.15.148:6790/0] conn(0x7f55a80741f0 0x7f55a8074610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T12:44:11.836 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T12:44:11.855 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T12:44:11.855 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:44:12.004 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-14T12:44:12.004 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:44:12.004 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-14T12:44:12.019 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T12:44:12.302 INFO:teuthology.orchestra.run.smithi148.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T12:44:12.321 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:44:12.670 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:44:12.682 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T12:44:12.691 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":3714,"stamp":"2024-09-14T12:44:11.146996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44615192,"num_objects":748,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":316434,"num_read_kb":2591763,"num_write":168253,"num_write_kb":2487517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12876,"ondisk_log_size":12876,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1796840,"kb_used_data":91448,"kb_used_omap":12,"kb_used_meta":1704115,"kb_avail":753177880,"statfs":{"total":773094113280,"available":771254149120,"internally_reserved":0,"allocated":93642752,"data_stored":77474338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1745014320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-731623841,"num_objects":-4208,"num_object_clones":0,"num_object_copies":-16720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4208,"num_whiteouts":0,"num_read":4688,"num_read_kb":4198,"num_write":4455,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007343"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789873+0000","last_change":"2024-09-14T11:40:08.952510+0000","last_active":"2024-09-14T12:40:10.789873+0000","last_peered":"2024-09-14T12:40:10.789873+0000","last_clean":"2024-09-14T12:40:10.789873+0000","last_became_active":"2024-09-14T11:40:08.951795+0000","last_became_peered":"2024-09-14T11:40:08.951795+0000","last_unstale":"2024-09-14T12:40:10.789873+0000","last_undegraded":"2024-09-14T12:40:10.789873+0000","last_fullsized":"2024-09-14T12:40:10.789873+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:34.432945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538895+0000","last_change":"2024-09-14T11:12:26.252261+0000","last_active":"2024-09-14T12:39:55.538895+0000","last_peered":"2024-09-14T12:39:55.538895+0000","last_clean":"2024-09-14T12:39:55.538895+0000","last_became_active":"2024-09-14T11:12:26.251656+0000","last_became_peered":"2024-09-14T11:12:26.251656+0000","last_unstale":"2024-09-14T12:39:55.538895+0000","last_undegraded":"2024-09-14T12:39:55.538895+0000","last_fullsized":"2024-09-14T12:39:55.538895+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:01.924216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731815+0000","last_change":"2024-09-14T11:12:19.109493+0000","last_active":"2024-09-14T12:39:49.731815+0000","last_peered":"2024-09-14T12:39:49.731815+0000","last_clean":"2024-09-14T12:39:49.731815+0000","last_became_active":"2024-09-14T11:12:19.108050+0000","last_became_peered":"2024-09-14T11:12:19.108050+0000","last_unstale":"2024-09-14T12:39:49.731815+0000","last_undegraded":"2024-09-14T12:39:49.731815+0000","last_fullsized":"2024-09-14T12:39:49.731815+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:46.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'28","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.565399+0000","last_change":"2024-09-14T11:06:29.522001+0000","last_active":"2024-09-14T12:40:15.565399+0000","last_peered":"2024-09-14T12:40:15.565399+0000","last_clean":"2024-09-14T12:40:15.565399+0000","last_became_active":"2024-09-14T11:06:29.521269+0000","last_became_peered":"2024-09-14T11:06:29.521269+0000","last_unstale":"2024-09-14T12:40:15.565399+0000","last_undegraded":"2024-09-14T12:40:15.565399+0000","last_fullsized":"2024-09-14T12:40:15.565399+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:36.067094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":165,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537448+0000","last_change":"2024-09-14T11:40:08.947504+0000","last_active":"2024-09-14T12:40:11.537448+0000","last_peered":"2024-09-14T12:40:11.537448+0000","last_clean":"2024-09-14T12:40:11.537448+0000","last_became_active":"2024-09-14T11:40:08.946878+0000","last_became_peered":"2024-09-14T11:40:08.946878+0000","last_unstale":"2024-09-14T12:40:11.537448+0000","last_undegraded":"2024-09-14T12:40:11.537448+0000","last_fullsized":"2024-09-14T12:40:11.537448+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:13.424208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142354+0000","last_change":"2024-09-14T11:12:26.251932+0000","last_active":"2024-09-14T12:39:56.142354+0000","last_peered":"2024-09-14T12:39:56.142354+0000","last_clean":"2024-09-14T12:39:56.142354+0000","last_became_active":"2024-09-14T11:12:26.251518+0000","last_became_peered":"2024-09-14T11:12:26.251518+0000","last_unstale":"2024-09-14T12:39:56.142354+0000","last_undegraded":"2024-09-14T12:39:56.142354+0000","last_fullsized":"2024-09-14T12:39:56.142354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:18.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.549011+0000","last_change":"2024-09-14T11:12:19.078874+0000","last_active":"2024-09-14T12:39:50.549011+0000","last_peered":"2024-09-14T12:39:50.549011+0000","last_clean":"2024-09-14T12:39:50.549011+0000","last_became_active":"2024-09-14T11:12:19.078164+0000","last_became_peered":"2024-09-14T11:12:19.078164+0000","last_unstale":"2024-09-14T12:39:50.549011+0000","last_undegraded":"2024-09-14T12:39:50.549011+0000","last_fullsized":"2024-09-14T12:39:50.549011+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:07.851997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'14","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.573976+0000","last_change":"2024-09-14T11:06:29.539883+0000","last_active":"2024-09-14T12:40:55.573976+0000","last_peered":"2024-09-14T12:40:55.573976+0000","last_clean":"2024-09-14T12:40:55.573976+0000","last_became_active":"2024-09-14T11:06:29.538616+0000","last_became_peered":"2024-09-14T11:06:29.538616+0000","last_unstale":"2024-09-14T12:40:55.573976+0000","last_undegraded":"2024-09-14T12:40:55.573976+0000","last_fullsized":"2024-09-14T12:40:55.573976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:48.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":63,"num_write":44,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.548159+0000","last_change":"2024-09-14T11:40:08.943797+0000","last_active":"2024-09-14T12:40:35.548159+0000","last_peered":"2024-09-14T12:40:35.548159+0000","last_clean":"2024-09-14T12:40:35.548159+0000","last_became_active":"2024-09-14T11:40:08.942721+0000","last_became_peered":"2024-09-14T11:40:08.942721+0000","last_unstale":"2024-09-14T12:40:35.548159+0000","last_undegraded":"2024-09-14T12:40:35.548159+0000","last_fullsized":"2024-09-14T12:40:35.548159+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:17.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.361403+0000","last_change":"2024-09-14T11:12:26.228979+0000","last_active":"2024-09-14T12:42:00.361403+0000","last_peered":"2024-09-14T12:42:00.361403+0000","last_clean":"2024-09-14T12:42:00.361403+0000","last_became_active":"2024-09-14T11:12:26.228172+0000","last_became_peered":"2024-09-14T11:12:26.228172+0000","last_unstale":"2024-09-14T12:42:00.361403+0000","last_undegraded":"2024-09-14T12:42:00.361403+0000","last_fullsized":"2024-09-14T12:42:00.361403+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:34.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:34.769431+0000","last_change":"2024-09-14T11:12:19.111973+0000","last_active":"2024-09-14T12:42:34.769431+0000","last_peered":"2024-09-14T12:42:34.769431+0000","last_clean":"2024-09-14T12:42:34.769431+0000","last_became_active":"2024-09-14T11:12:19.110542+0000","last_became_peered":"2024-09-14T11:12:19.110542+0000","last_unstale":"2024-09-14T12:42:34.769431+0000","last_undegraded":"2024-09-14T12:42:34.769431+0000","last_fullsized":"2024-09-14T12:42:34.769431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.885368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555139+0000","last_change":"2024-09-14T11:06:29.532390+0000","last_active":"2024-09-14T12:41:31.555139+0000","last_peered":"2024-09-14T12:41:31.555139+0000","last_clean":"2024-09-14T12:41:31.555139+0000","last_became_active":"2024-09-14T11:06:29.531655+0000","last_became_peered":"2024-09-14T11:06:29.531655+0000","last_unstale":"2024-09-14T12:41:31.555139+0000","last_undegraded":"2024-09-14T12:41:31.555139+0000","last_fullsized":"2024-09-14T12:41:31.555139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:15.026446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":194,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563239+0000","last_change":"2024-09-14T11:40:08.940194+0000","last_active":"2024-09-14T12:40:50.563239+0000","last_peered":"2024-09-14T12:40:50.563239+0000","last_clean":"2024-09-14T12:40:50.563239+0000","last_became_active":"2024-09-14T11:40:08.939509+0000","last_became_peered":"2024-09-14T11:40:08.939509+0000","last_unstale":"2024-09-14T12:40:50.563239+0000","last_undegraded":"2024-09-14T12:40:50.563239+0000","last_fullsized":"2024-09-14T12:40:50.563239+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:14.099727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827825+0000","last_change":"2024-09-14T11:12:26.231260+0000","last_active":"2024-09-14T12:44:03.827825+0000","last_peered":"2024-09-14T12:44:03.827825+0000","last_clean":"2024-09-14T12:44:03.827825+0000","last_became_active":"2024-09-14T11:12:26.230403+0000","last_became_peered":"2024-09-14T11:12:26.230403+0000","last_unstale":"2024-09-14T12:44:03.827825+0000","last_undegraded":"2024-09-14T12:44:03.827825+0000","last_fullsized":"2024-09-14T12:44:03.827825+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:41.167301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7282,"num_write":12,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:00.592524+0000","last_change":"2024-09-14T11:12:19.105819+0000","last_active":"2024-09-14T12:44:00.592524+0000","last_peered":"2024-09-14T12:44:00.592524+0000","last_clean":"2024-09-14T12:44:00.592524+0000","last_became_active":"2024-09-14T11:12:19.105062+0000","last_became_peered":"2024-09-14T11:12:19.105062+0000","last_unstale":"2024-09-14T12:44:00.592524+0000","last_undegraded":"2024-09-14T12:44:00.592524+0000","last_fullsized":"2024-09-14T12:44:00.592524+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:15.694200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'12","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555085+0000","last_change":"2024-09-14T11:06:29.510354+0000","last_active":"2024-09-14T12:41:31.555085+0000","last_peered":"2024-09-14T12:41:31.555085+0000","last_clean":"2024-09-14T12:41:31.555085+0000","last_became_active":"2024-09-14T11:06:29.509556+0000","last_became_peered":"2024-09-14T11:06:29.509556+0000","last_unstale":"2024-09-14T12:41:31.555085+0000","last_undegraded":"2024-09-14T12:41:31.555085+0000","last_fullsized":"2024-09-14T12:41:31.555085+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:51.904786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:19.738657+0000","last_change":"2024-09-14T11:40:08.932176+0000","last_active":"2024-09-14T12:40:19.738657+0000","last_peered":"2024-09-14T12:40:19.738657+0000","last_clean":"2024-09-14T12:40:19.738657+0000","last_became_active":"2024-09-14T11:40:08.927702+0000","last_became_peered":"2024-09-14T11:40:08.927702+0000","last_unstale":"2024-09-14T12:40:19.738657+0000","last_undegraded":"2024-09-14T12:40:19.738657+0000","last_fullsized":"2024-09-14T12:40:19.738657+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:31.907550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.782814+0000","last_change":"2024-09-14T11:12:26.219704+0000","last_active":"2024-09-14T12:39:40.782814+0000","last_peered":"2024-09-14T12:39:40.782814+0000","last_clean":"2024-09-14T12:39:40.782814+0000","last_became_active":"2024-09-14T11:12:26.218925+0000","last_became_peered":"2024-09-14T11:12:26.218925+0000","last_unstale":"2024-09-14T12:39:40.782814+0000","last_undegraded":"2024-09-14T12:39:40.782814+0000","last_fullsized":"2024-09-14T12:39:40.782814+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:12.358912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"267'4","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.064367+0000","last_change":"2024-09-14T11:12:19.111180+0000","last_active":"2024-09-14T12:44:04.064367+0000","last_peered":"2024-09-14T12:44:04.064367+0000","last_clean":"2024-09-14T12:44:04.064367+0000","last_became_active":"2024-09-14T11:12:19.110528+0000","last_became_peered":"2024-09-14T11:12:19.110528+0000","last_unstale":"2024-09-14T12:44:04.064367+0000","last_undegraded":"2024-09-14T12:44:04.064367+0000","last_fullsized":"2024-09-14T12:44:04.064367+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:53.395221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'15","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555023+0000","last_change":"2024-09-14T11:06:29.539444+0000","last_active":"2024-09-14T12:41:31.555023+0000","last_peered":"2024-09-14T12:41:31.555023+0000","last_clean":"2024-09-14T12:41:31.555023+0000","last_became_active":"2024-09-14T11:06:29.538597+0000","last_became_peered":"2024-09-14T11:06:29.538597+0000","last_unstale":"2024-09-14T12:41:31.555023+0000","last_undegraded":"2024-09-14T12:41:31.555023+0000","last_fullsized":"2024-09-14T12:41:31.555023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:42.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569608+0000","last_change":"2024-09-14T11:40:08.925877+0000","last_active":"2024-09-14T12:40:35.569608+0000","last_peered":"2024-09-14T12:40:35.569608+0000","last_clean":"2024-09-14T12:40:35.569608+0000","last_became_active":"2024-09-14T11:40:08.924934+0000","last_became_peered":"2024-09-14T11:40:08.924934+0000","last_unstale":"2024-09-14T12:40:35.569608+0000","last_undegraded":"2024-09-14T12:40:35.569608+0000","last_fullsized":"2024-09-14T12:40:35.569608+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:38.137144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:26.465943+0000","last_change":"2024-09-14T11:12:26.246400+0000","last_active":"2024-09-14T12:39:26.465943+0000","last_peered":"2024-09-14T12:39:26.465943+0000","last_clean":"2024-09-14T12:39:26.465943+0000","last_became_active":"2024-09-14T11:12:26.245890+0000","last_became_peered":"2024-09-14T11:12:26.245890+0000","last_unstale":"2024-09-14T12:39:26.465943+0000","last_undegraded":"2024-09-14T12:39:26.465943+0000","last_fullsized":"2024-09-14T12:39:26.465943+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:48.151101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468681+0000","last_change":"2024-09-14T11:12:19.109400+0000","last_active":"2024-09-14T12:39:36.468681+0000","last_peered":"2024-09-14T12:39:36.468681+0000","last_clean":"2024-09-14T12:39:36.468681+0000","last_became_active":"2024-09-14T11:12:19.108158+0000","last_became_peered":"2024-09-14T11:12:19.108158+0000","last_unstale":"2024-09-14T12:39:36.468681+0000","last_undegraded":"2024-09-14T12:39:36.468681+0000","last_fullsized":"2024-09-14T12:39:36.468681+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:12.518068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'13","reported_seq":104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164957+0000","last_change":"2024-09-14T11:06:29.529584+0000","last_active":"2024-09-14T12:41:31.164957+0000","last_peered":"2024-09-14T12:41:31.164957+0000","last_clean":"2024-09-14T12:41:31.164957+0000","last_became_active":"2024-09-14T11:06:29.525271+0000","last_became_peered":"2024-09-14T11:06:29.525271+0000","last_unstale":"2024-09-14T12:41:31.164957+0000","last_undegraded":"2024-09-14T12:41:31.164957+0000","last_fullsized":"2024-09-14T12:41:31.164957+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:48.747370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.145918+0000","last_change":"2024-09-14T11:40:08.929934+0000","last_active":"2024-09-14T12:40:11.145918+0000","last_peered":"2024-09-14T12:40:11.145918+0000","last_clean":"2024-09-14T12:40:11.145918+0000","last_became_active":"2024-09-14T11:40:08.928406+0000","last_became_peered":"2024-09-14T11:40:08.928406+0000","last_unstale":"2024-09-14T12:40:11.145918+0000","last_undegraded":"2024-09-14T12:40:11.145918+0000","last_fullsized":"2024-09-14T12:40:11.145918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:59.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142297+0000","last_change":"2024-09-14T11:12:26.241901+0000","last_active":"2024-09-14T12:39:56.142297+0000","last_peered":"2024-09-14T12:39:56.142297+0000","last_clean":"2024-09-14T12:39:56.142297+0000","last_became_active":"2024-09-14T11:12:26.241189+0000","last_became_peered":"2024-09-14T11:12:26.241189+0000","last_unstale":"2024-09-14T12:39:56.142297+0000","last_undegraded":"2024-09-14T12:39:56.142297+0000","last_fullsized":"2024-09-14T12:39:56.142297+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:26.882785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"267'4","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.129112+0000","last_change":"2024-09-14T11:12:19.090881+0000","last_active":"2024-09-14T12:44:02.129112+0000","last_peered":"2024-09-14T12:44:02.129112+0000","last_clean":"2024-09-14T12:44:02.129112+0000","last_became_active":"2024-09-14T11:12:19.090134+0000","last_became_peered":"2024-09-14T11:12:19.090134+0000","last_unstale":"2024-09-14T12:44:02.129112+0000","last_undegraded":"2024-09-14T12:44:02.129112+0000","last_fullsized":"2024-09-14T12:44:02.129112+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.751661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4097,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'175","reported_seq":578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:59.747524+0000","last_change":"2024-09-14T11:06:29.533832+0000","last_active":"2024-09-14T12:40:59.747524+0000","last_peered":"2024-09-14T12:40:59.747524+0000","last_clean":"2024-09-14T12:40:59.747524+0000","last_became_active":"2024-09-14T11:06:29.531149+0000","last_became_peered":"2024-09-14T11:06:29.531149+0000","last_unstale":"2024-09-14T12:40:59.747524+0000","last_undegraded":"2024-09-14T12:40:59.747524+0000","last_fullsized":"2024-09-14T12:40:59.747524+0000","mapping_epoch":256,"log_start":"264'100","ondisk_log_start":"264'100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:45.535262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1578,"num_read_kb":1327,"num_write":388,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789984+0000","last_change":"2024-09-14T11:40:08.942903+0000","last_active":"2024-09-14T12:40:10.789984+0000","last_peered":"2024-09-14T12:40:10.789984+0000","last_clean":"2024-09-14T12:40:10.789984+0000","last_became_active":"2024-09-14T11:40:08.942208+0000","last_became_peered":"2024-09-14T11:40:08.942208+0000","last_unstale":"2024-09-14T12:40:10.789984+0000","last_undegraded":"2024-09-14T12:40:10.789984+0000","last_fullsized":"2024-09-14T12:40:10.789984+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:07.315198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.768253+0000","last_change":"2024-09-14T11:12:26.236668+0000","last_active":"2024-09-14T12:42:29.768253+0000","last_peered":"2024-09-14T12:42:29.768253+0000","last_clean":"2024-09-14T12:42:29.768253+0000","last_became_active":"2024-09-14T11:12:26.236221+0000","last_became_peered":"2024-09-14T11:12:26.236221+0000","last_unstale":"2024-09-14T12:42:29.768253+0000","last_undegraded":"2024-09-14T12:42:29.768253+0000","last_fullsized":"2024-09-14T12:42:29.768253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.780862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532656+0000","last_change":"2024-09-14T11:12:19.087602+0000","last_active":"2024-09-14T12:39:51.532656+0000","last_peered":"2024-09-14T12:39:51.532656+0000","last_clean":"2024-09-14T12:39:51.532656+0000","last_became_active":"2024-09-14T11:12:19.086765+0000","last_became_peered":"2024-09-14T11:12:19.086765+0000","last_unstale":"2024-09-14T12:39:51.532656+0000","last_undegraded":"2024-09-14T12:39:51.532656+0000","last_fullsized":"2024-09-14T12:39:51.532656+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.252636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.545007+0000","last_change":"2024-09-14T11:06:29.518739+0000","last_active":"2024-09-14T12:40:46.545007+0000","last_peered":"2024-09-14T12:40:46.545007+0000","last_clean":"2024-09-14T12:40:46.545007+0000","last_became_active":"2024-09-14T11:06:29.518028+0000","last_became_peered":"2024-09-14T11:06:29.518028+0000","last_unstale":"2024-09-14T12:40:46.545007+0000","last_undegraded":"2024-09-14T12:40:46.545007+0000","last_fullsized":"2024-09-14T12:40:46.545007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:31.356112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":96,"num_write":55,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563311+0000","last_change":"2024-09-14T11:40:08.953653+0000","last_active":"2024-09-14T12:40:50.563311+0000","last_peered":"2024-09-14T12:40:50.563311+0000","last_clean":"2024-09-14T12:40:50.563311+0000","last_became_active":"2024-09-14T11:40:08.953030+0000","last_became_peered":"2024-09-14T11:40:08.953030+0000","last_unstale":"2024-09-14T12:40:50.563311+0000","last_undegraded":"2024-09-14T12:40:50.563311+0000","last_fullsized":"2024-09-14T12:40:50.563311+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:54.553294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:29.727366+0000","last_change":"2024-09-14T11:12:26.248644+0000","last_active":"2024-09-14T12:39:29.727366+0000","last_peered":"2024-09-14T12:39:29.727366+0000","last_clean":"2024-09-14T12:39:29.727366+0000","last_became_active":"2024-09-14T11:12:26.247784+0000","last_became_peered":"2024-09-14T11:12:26.247784+0000","last_unstale":"2024-09-14T12:39:29.727366+0000","last_undegraded":"2024-09-14T12:39:29.727366+0000","last_fullsized":"2024-09-14T12:39:29.727366+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:06.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:36.527831+0000","last_change":"2024-09-14T11:12:19.114678+0000","last_active":"2024-09-14T12:43:36.527831+0000","last_peered":"2024-09-14T12:43:36.527831+0000","last_clean":"2024-09-14T12:43:36.527831+0000","last_became_active":"2024-09-14T11:12:19.113431+0000","last_became_peered":"2024-09-14T11:12:19.113431+0000","last_unstale":"2024-09-14T12:43:36.527831+0000","last_undegraded":"2024-09-14T12:43:36.527831+0000","last_fullsized":"2024-09-14T12:43:36.527831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:46.474061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7166,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'46","reported_seq":197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571890+0000","last_change":"2024-09-14T11:06:29.532883+0000","last_active":"2024-09-14T12:40:45.571890+0000","last_peered":"2024-09-14T12:40:45.571890+0000","last_clean":"2024-09-14T12:40:45.571890+0000","last_became_active":"2024-09-14T11:06:29.532061+0000","last_became_peered":"2024-09-14T11:06:29.532061+0000","last_unstale":"2024-09-14T12:40:45.571890+0000","last_undegraded":"2024-09-14T12:40:45.571890+0000","last_fullsized":"2024-09-14T12:40:45.571890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:13.641002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":235,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.546149+0000","last_change":"2024-09-14T11:40:08.938546+0000","last_active":"2024-09-14T12:40:51.546149+0000","last_peered":"2024-09-14T12:40:51.546149+0000","last_clean":"2024-09-14T12:40:51.546149+0000","last_became_active":"2024-09-14T11:40:08.937813+0000","last_became_peered":"2024-09-14T11:40:08.937813+0000","last_unstale":"2024-09-14T12:40:51.546149+0000","last_undegraded":"2024-09-14T12:40:51.546149+0000","last_fullsized":"2024-09-14T12:40:51.546149+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:07.510647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.828266+0000","last_change":"2024-09-14T11:12:26.244350+0000","last_active":"2024-09-14T12:44:03.828266+0000","last_peered":"2024-09-14T12:44:03.828266+0000","last_clean":"2024-09-14T12:44:03.828266+0000","last_became_active":"2024-09-14T11:12:26.243612+0000","last_became_peered":"2024-09-14T11:12:26.243612+0000","last_unstale":"2024-09-14T12:44:03.828266+0000","last_undegraded":"2024-09-14T12:44:03.828266+0000","last_fullsized":"2024-09-14T12:44:03.828266+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.954445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15364,"num_write":22,"num_write_kb":14340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.980363+0000","last_change":"2024-09-14T11:12:19.104603+0000","last_active":"2024-09-14T12:44:03.980363+0000","last_peered":"2024-09-14T12:44:03.980363+0000","last_clean":"2024-09-14T12:44:03.980363+0000","last_became_active":"2024-09-14T11:12:19.103871+0000","last_became_peered":"2024-09-14T11:12:19.103871+0000","last_unstale":"2024-09-14T12:44:03.980363+0000","last_undegraded":"2024-09-14T12:44:03.980363+0000","last_fullsized":"2024-09-14T12:44:03.980363+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'29","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571849+0000","last_change":"2024-09-14T11:06:29.530922+0000","last_active":"2024-09-14T12:40:45.571849+0000","last_peered":"2024-09-14T12:40:45.571849+0000","last_clean":"2024-09-14T12:40:45.571849+0000","last_became_active":"2024-09-14T11:06:29.529421+0000","last_became_peered":"2024-09-14T11:06:29.529421+0000","last_unstale":"2024-09-14T12:40:45.571849+0000","last_undegraded":"2024-09-14T12:40:45.571849+0000","last_fullsized":"2024-09-14T12:40:45.571849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:42.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":129,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.155363+0000","last_change":"2024-09-14T11:40:08.944753+0000","last_active":"2024-09-14T12:40:51.155363+0000","last_peered":"2024-09-14T12:40:51.155363+0000","last_clean":"2024-09-14T12:40:51.155363+0000","last_became_active":"2024-09-14T11:40:08.944066+0000","last_became_peered":"2024-09-14T11:40:08.944066+0000","last_unstale":"2024-09-14T12:40:51.155363+0000","last_undegraded":"2024-09-14T12:40:51.155363+0000","last_fullsized":"2024-09-14T12:40:51.155363+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:51.071467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:29.727468+0000","last_change":"2024-09-14T11:12:26.225753+0000","last_active":"2024-09-14T12:39:29.727468+0000","last_peered":"2024-09-14T12:39:29.727468+0000","last_clean":"2024-09-14T12:39:29.727468+0000","last_became_active":"2024-09-14T11:12:26.224877+0000","last_became_peered":"2024-09-14T11:12:26.224877+0000","last_unstale":"2024-09-14T12:39:29.727468+0000","last_undegraded":"2024-09-14T12:39:29.727468+0000","last_fullsized":"2024-09-14T12:39:29.727468+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:14.000285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'11","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.980218+0000","last_change":"2024-09-14T11:12:19.108246+0000","last_active":"2024-09-14T12:44:03.980218+0000","last_peered":"2024-09-14T12:44:03.980218+0000","last_clean":"2024-09-14T12:44:03.980218+0000","last_became_active":"2024-09-14T11:12:19.107563+0000","last_became_peered":"2024-09-14T11:12:19.107563+0000","last_unstale":"2024-09-14T12:44:03.980218+0000","last_undegraded":"2024-09-14T12:44:03.980218+0000","last_fullsized":"2024-09-14T12:44:03.980218+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9259,"num_write":16,"num_write_kb":6185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'15","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:44.744075+0000","last_change":"2024-09-14T11:06:29.535035+0000","last_active":"2024-09-14T12:40:44.744075+0000","last_peered":"2024-09-14T12:40:44.744075+0000","last_clean":"2024-09-14T12:40:44.744075+0000","last_became_active":"2024-09-14T11:06:29.534316+0000","last_became_peered":"2024-09-14T11:06:29.534316+0000","last_unstale":"2024-09-14T12:40:44.744075+0000","last_undegraded":"2024-09-14T12:40:44.744075+0000","last_fullsized":"2024-09-14T12:40:44.744075+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.975045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":71,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.798963+0000","last_change":"2024-09-14T11:40:08.945904+0000","last_active":"2024-09-14T12:40:50.798963+0000","last_peered":"2024-09-14T12:40:50.798963+0000","last_clean":"2024-09-14T12:40:50.798963+0000","last_became_active":"2024-09-14T11:40:08.945227+0000","last_became_peered":"2024-09-14T11:40:08.945227+0000","last_unstale":"2024-09-14T12:40:50.798963+0000","last_undegraded":"2024-09-14T12:40:50.798963+0000","last_fullsized":"2024-09-14T12:40:50.798963+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:52.335465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":56,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:25.779815+0000","last_change":"2024-09-14T11:12:26.239562+0000","last_active":"2024-09-14T12:39:25.779815+0000","last_peered":"2024-09-14T12:39:25.779815+0000","last_clean":"2024-09-14T12:39:25.779815+0000","last_became_active":"2024-09-14T11:12:26.238844+0000","last_became_peered":"2024-09-14T11:12:26.238844+0000","last_unstale":"2024-09-14T12:39:25.779815+0000","last_undegraded":"2024-09-14T12:39:25.779815+0000","last_fullsized":"2024-09-14T12:39:25.779815+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:15.939265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.951718+0000","last_change":"2024-09-14T11:12:19.074095+0000","last_active":"2024-09-14T12:44:02.951718+0000","last_peered":"2024-09-14T12:44:02.951718+0000","last_clean":"2024-09-14T12:44:02.951718+0000","last_became_active":"2024-09-14T11:12:19.072275+0000","last_became_peered":"2024-09-14T11:12:19.072275+0000","last_unstale":"2024-09-14T12:44:02.951718+0000","last_undegraded":"2024-09-14T12:44:02.951718+0000","last_fullsized":"2024-09-14T12:44:02.951718+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:16.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'30","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476064+0000","last_change":"2024-09-14T11:06:29.519394+0000","last_active":"2024-09-14T12:40:06.476064+0000","last_peered":"2024-09-14T12:40:06.476064+0000","last_clean":"2024-09-14T12:40:06.476064+0000","last_became_active":"2024-09-14T11:06:29.518650+0000","last_became_peered":"2024-09-14T11:06:29.518650+0000","last_unstale":"2024-09-14T12:40:06.476064+0000","last_undegraded":"2024-09-14T12:40:06.476064+0000","last_fullsized":"2024-09-14T12:40:06.476064+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.316442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":172,"num_write":81,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559828+0000","last_change":"2024-09-14T11:40:08.951327+0000","last_active":"2024-09-14T12:40:35.559828+0000","last_peered":"2024-09-14T12:40:35.559828+0000","last_clean":"2024-09-14T12:40:35.559828+0000","last_became_active":"2024-09-14T11:40:08.950670+0000","last_became_peered":"2024-09-14T11:40:08.950670+0000","last_unstale":"2024-09-14T12:40:35.559828+0000","last_undegraded":"2024-09-14T12:40:35.559828+0000","last_fullsized":"2024-09-14T12:40:35.559828+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:02.634753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.129271+0000","last_change":"2024-09-14T11:12:26.228814+0000","last_active":"2024-09-14T12:44:02.129271+0000","last_peered":"2024-09-14T12:44:02.129271+0000","last_clean":"2024-09-14T12:44:02.129271+0000","last_became_active":"2024-09-14T11:12:26.227851+0000","last_became_peered":"2024-09-14T11:12:26.227851+0000","last_unstale":"2024-09-14T12:44:02.129271+0000","last_undegraded":"2024-09-14T12:44:02.129271+0000","last_fullsized":"2024-09-14T12:44:02.129271+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:46.796979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.553829+0000","last_change":"2024-09-14T11:12:19.092586+0000","last_active":"2024-09-14T12:41:00.553829+0000","last_peered":"2024-09-14T12:41:00.553829+0000","last_clean":"2024-09-14T12:41:00.553829+0000","last_became_active":"2024-09-14T11:12:19.091893+0000","last_became_peered":"2024-09-14T11:12:19.091893+0000","last_unstale":"2024-09-14T12:41:00.553829+0000","last_undegraded":"2024-09-14T12:41:00.553829+0000","last_fullsized":"2024-09-14T12:41:00.553829+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:18.606010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'35","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.472861+0000","last_change":"2024-09-14T11:06:29.548605+0000","last_active":"2024-09-14T12:39:51.472861+0000","last_peered":"2024-09-14T12:39:51.472861+0000","last_clean":"2024-09-14T12:39:51.472861+0000","last_became_active":"2024-09-14T11:06:29.545575+0000","last_became_peered":"2024-09-14T11:06:29.545575+0000","last_unstale":"2024-09-14T12:39:51.472861+0000","last_undegraded":"2024-09-14T12:39:51.472861+0000","last_fullsized":"2024-09-14T12:39:51.472861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:04.244766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":183,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543115+0000","last_change":"2024-09-14T11:40:08.926123+0000","last_active":"2024-09-14T12:40:36.543115+0000","last_peered":"2024-09-14T12:40:36.543115+0000","last_clean":"2024-09-14T12:40:36.543115+0000","last_became_active":"2024-09-14T11:40:08.925358+0000","last_became_peered":"2024-09-14T11:40:08.925358+0000","last_unstale":"2024-09-14T12:40:36.543115+0000","last_undegraded":"2024-09-14T12:40:36.543115+0000","last_fullsized":"2024-09-14T12:40:36.543115+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:25.296629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566691+0000","last_change":"2024-09-14T11:12:26.247421+0000","last_active":"2024-09-14T12:41:05.566691+0000","last_peered":"2024-09-14T12:41:05.566691+0000","last_clean":"2024-09-14T12:41:05.566691+0000","last_became_active":"2024-09-14T11:12:26.246881+0000","last_became_peered":"2024-09-14T11:12:26.246881+0000","last_unstale":"2024-09-14T12:41:05.566691+0000","last_undegraded":"2024-09-14T12:41:05.566691+0000","last_fullsized":"2024-09-14T12:41:05.566691+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:19.198573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:20.380939+0000","last_change":"2024-09-14T11:12:19.096545+0000","last_active":"2024-09-14T12:43:20.380939+0000","last_peered":"2024-09-14T12:43:20.380939+0000","last_clean":"2024-09-14T12:43:20.380939+0000","last_became_active":"2024-09-14T11:12:19.095821+0000","last_became_peered":"2024-09-14T11:12:19.095821+0000","last_unstale":"2024-09-14T12:43:20.380939+0000","last_undegraded":"2024-09-14T12:43:20.380939+0000","last_fullsized":"2024-09-14T12:43:20.380939+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:19.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'26","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731762+0000","last_change":"2024-09-14T11:06:29.533209+0000","last_active":"2024-09-14T12:39:49.731762+0000","last_peered":"2024-09-14T12:39:49.731762+0000","last_clean":"2024-09-14T12:39:49.731762+0000","last_became_active":"2024-09-14T11:06:29.529753+0000","last_became_peered":"2024-09-14T11:06:29.529753+0000","last_unstale":"2024-09-14T12:39:49.731762+0000","last_undegraded":"2024-09-14T12:39:49.731762+0000","last_fullsized":"2024-09-14T12:39:49.731762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:45.017988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.576092+0000","last_change":"2024-09-14T11:40:08.925501+0000","last_active":"2024-09-14T12:41:05.576092+0000","last_peered":"2024-09-14T12:41:05.576092+0000","last_clean":"2024-09-14T12:41:05.576092+0000","last_became_active":"2024-09-14T11:40:08.924726+0000","last_became_peered":"2024-09-14T11:40:08.924726+0000","last_unstale":"2024-09-14T12:41:05.576092+0000","last_undegraded":"2024-09-14T12:41:05.576092+0000","last_fullsized":"2024-09-14T12:41:05.576092+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:22.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:09.749817+0000","last_change":"2024-09-14T11:12:26.219990+0000","last_active":"2024-09-14T12:41:09.749817+0000","last_peered":"2024-09-14T12:41:09.749817+0000","last_clean":"2024-09-14T12:41:09.749817+0000","last_became_active":"2024-09-14T11:12:26.219169+0000","last_became_peered":"2024-09-14T11:12:26.219169+0000","last_unstale":"2024-09-14T12:41:09.749817+0000","last_undegraded":"2024-09-14T12:41:09.749817+0000","last_fullsized":"2024-09-14T12:41:09.749817+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:09.344730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"267'10","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.311782+0000","last_change":"2024-09-14T11:12:19.099929+0000","last_active":"2024-09-14T12:44:04.311782+0000","last_peered":"2024-09-14T12:44:04.311782+0000","last_clean":"2024-09-14T12:44:04.311782+0000","last_became_active":"2024-09-14T11:12:19.099233+0000","last_became_peered":"2024-09-14T11:12:19.099233+0000","last_unstale":"2024-09-14T12:44:04.311782+0000","last_undegraded":"2024-09-14T12:44:04.311782+0000","last_fullsized":"2024-09-14T12:44:04.311782+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:44.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8230,"num_write":10,"num_write_kb":6172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'35","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140567+0000","last_change":"2024-09-14T11:06:29.524243+0000","last_active":"2024-09-14T12:39:51.140567+0000","last_peered":"2024-09-14T12:39:51.140567+0000","last_clean":"2024-09-14T12:39:51.140567+0000","last_became_active":"2024-09-14T11:06:29.508842+0000","last_became_peered":"2024-09-14T11:06:29.508842+0000","last_unstale":"2024-09-14T12:39:51.140567+0000","last_undegraded":"2024-09-14T12:39:51.140567+0000","last_fullsized":"2024-09-14T12:39:51.140567+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:47.904384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":189,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543061+0000","last_change":"2024-09-14T11:40:08.945136+0000","last_active":"2024-09-14T12:40:36.543061+0000","last_peered":"2024-09-14T12:40:36.543061+0000","last_clean":"2024-09-14T12:40:36.543061+0000","last_became_active":"2024-09-14T11:40:08.944382+0000","last_became_peered":"2024-09-14T11:40:08.944382+0000","last_unstale":"2024-09-14T12:40:36.543061+0000","last_undegraded":"2024-09-14T12:40:36.543061+0000","last_fullsized":"2024-09-14T12:40:36.543061+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:00.265362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:26.525182+0000","last_change":"2024-09-14T11:12:26.238084+0000","last_active":"2024-09-14T12:43:26.525182+0000","last_peered":"2024-09-14T12:43:26.525182+0000","last_clean":"2024-09-14T12:43:26.525182+0000","last_became_active":"2024-09-14T11:12:26.232336+0000","last_became_peered":"2024-09-14T11:12:26.232336+0000","last_unstale":"2024-09-14T12:43:26.525182+0000","last_undegraded":"2024-09-14T12:43:26.525182+0000","last_fullsized":"2024-09-14T12:43:26.525182+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:24.342020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:20.584614+0000","last_change":"2024-09-14T11:12:19.093047+0000","last_active":"2024-09-14T12:43:20.584614+0000","last_peered":"2024-09-14T12:43:20.584614+0000","last_clean":"2024-09-14T12:43:20.584614+0000","last_became_active":"2024-09-14T11:12:19.092223+0000","last_became_peered":"2024-09-14T11:12:19.092223+0000","last_unstale":"2024-09-14T12:43:20.584614+0000","last_undegraded":"2024-09-14T12:43:20.584614+0000","last_fullsized":"2024-09-14T12:43:20.584614+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:48.559915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'19","reported_seq":117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731645+0000","last_change":"2024-09-14T11:06:29.533456+0000","last_active":"2024-09-14T12:39:49.731645+0000","last_peered":"2024-09-14T12:39:49.731645+0000","last_clean":"2024-09-14T12:39:49.731645+0000","last_became_active":"2024-09-14T11:06:29.530722+0000","last_became_peered":"2024-09-14T11:06:29.530722+0000","last_unstale":"2024-09-14T12:39:49.731645+0000","last_undegraded":"2024-09-14T12:39:49.731645+0000","last_fullsized":"2024-09-14T12:39:49.731645+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:40.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":48,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566854+0000","last_change":"2024-09-14T11:40:08.948425+0000","last_active":"2024-09-14T12:41:05.566854+0000","last_peered":"2024-09-14T12:41:05.566854+0000","last_clean":"2024-09-14T12:41:05.566854+0000","last_became_active":"2024-09-14T11:40:08.947725+0000","last_became_peered":"2024-09-14T11:40:08.947725+0000","last_unstale":"2024-09-14T12:41:05.566854+0000","last_undegraded":"2024-09-14T12:41:05.566854+0000","last_fullsized":"2024-09-14T12:41:05.566854+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:01.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737522+0000","last_change":"2024-09-14T11:12:26.233658+0000","last_active":"2024-09-14T12:40:14.737522+0000","last_peered":"2024-09-14T12:40:14.737522+0000","last_clean":"2024-09-14T12:40:14.737522+0000","last_became_active":"2024-09-14T11:12:26.233006+0000","last_became_peered":"2024-09-14T11:12:26.233006+0000","last_unstale":"2024-09-14T12:40:14.737522+0000","last_undegraded":"2024-09-14T12:40:14.737522+0000","last_fullsized":"2024-09-14T12:40:14.737522+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:29.000670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"267'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.176442+0000","last_change":"2024-09-14T11:12:19.086179+0000","last_active":"2024-09-14T12:42:21.176442+0000","last_peered":"2024-09-14T12:42:21.176442+0000","last_clean":"2024-09-14T12:42:21.176442+0000","last_became_active":"2024-09-14T11:12:19.085380+0000","last_became_peered":"2024-09-14T11:12:19.085380+0000","last_unstale":"2024-09-14T12:42:21.176442+0000","last_undegraded":"2024-09-14T12:42:21.176442+0000","last_fullsized":"2024-09-14T12:42:21.176442+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:31.276536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'32","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:14.751168+0000","last_change":"2024-09-14T11:06:29.535049+0000","last_active":"2024-09-14T12:41:14.751168+0000","last_peered":"2024-09-14T12:41:14.751168+0000","last_clean":"2024-09-14T12:41:14.751168+0000","last_became_active":"2024-09-14T11:06:29.534458+0000","last_became_peered":"2024-09-14T11:06:29.534458+0000","last_unstale":"2024-09-14T12:41:14.751168+0000","last_undegraded":"2024-09-14T12:41:14.751168+0000","last_fullsized":"2024-09-14T12:41:14.751168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:56.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":170,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.552820+0000","last_change":"2024-09-14T11:40:08.950611+0000","last_active":"2024-09-14T12:40:55.552820+0000","last_peered":"2024-09-14T12:40:55.552820+0000","last_clean":"2024-09-14T12:40:55.552820+0000","last_became_active":"2024-09-14T11:40:08.949834+0000","last_became_peered":"2024-09-14T11:40:08.949834+0000","last_unstale":"2024-09-14T12:40:55.552820+0000","last_undegraded":"2024-09-14T12:40:55.552820+0000","last_fullsized":"2024-09-14T12:40:55.552820+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:57.861780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737457+0000","last_change":"2024-09-14T11:12:26.248461+0000","last_active":"2024-09-14T12:40:14.737457+0000","last_peered":"2024-09-14T12:40:14.737457+0000","last_clean":"2024-09-14T12:40:14.737457+0000","last_became_active":"2024-09-14T11:12:26.247614+0000","last_became_peered":"2024-09-14T11:12:26.247614+0000","last_unstale":"2024-09-14T12:40:14.737457+0000","last_undegraded":"2024-09-14T12:40:14.737457+0000","last_fullsized":"2024-09-14T12:40:14.737457+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:50.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'14","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.566228+0000","last_change":"2024-09-14T11:12:19.096853+0000","last_active":"2024-09-14T12:42:21.566228+0000","last_peered":"2024-09-14T12:42:21.566228+0000","last_clean":"2024-09-14T12:42:21.566228+0000","last_became_active":"2024-09-14T11:12:19.096087+0000","last_became_peered":"2024-09-14T11:12:19.096087+0000","last_unstale":"2024-09-14T12:42:21.566228+0000","last_undegraded":"2024-09-14T12:42:21.566228+0000","last_fullsized":"2024-09-14T12:42:21.566228+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:06.192659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":21525,"num_write":24,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'15","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490423+0000","last_change":"2024-09-14T11:06:29.545510+0000","last_active":"2024-09-14T12:41:01.490423+0000","last_peered":"2024-09-14T12:41:01.490423+0000","last_clean":"2024-09-14T12:41:01.490423+0000","last_became_active":"2024-09-14T11:06:29.544309+0000","last_became_peered":"2024-09-14T11:06:29.544309+0000","last_unstale":"2024-09-14T12:41:01.490423+0000","last_undegraded":"2024-09-14T12:41:01.490423+0000","last_fullsized":"2024-09-14T12:41:01.490423+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:06.467496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":80,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.487672+0000","last_change":"2024-09-14T11:40:08.941028+0000","last_active":"2024-09-14T12:40:51.487672+0000","last_peered":"2024-09-14T12:40:51.487672+0000","last_clean":"2024-09-14T12:40:51.487672+0000","last_became_active":"2024-09-14T11:40:08.934447+0000","last_became_peered":"2024-09-14T11:40:08.934447+0000","last_unstale":"2024-09-14T12:40:51.487672+0000","last_undegraded":"2024-09-14T12:40:51.487672+0000","last_fullsized":"2024-09-14T12:40:51.487672+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:15.709296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"267'11","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:44.771631+0000","last_change":"2024-09-14T11:12:26.254154+0000","last_active":"2024-09-14T12:42:44.771631+0000","last_peered":"2024-09-14T12:42:44.771631+0000","last_clean":"2024-09-14T12:42:44.771631+0000","last_became_active":"2024-09-14T11:12:26.253410+0000","last_became_peered":"2024-09-14T11:12:26.253410+0000","last_unstale":"2024-09-14T12:42:44.771631+0000","last_undegraded":"2024-09-14T12:42:44.771631+0000","last_fullsized":"2024-09-14T12:42:44.771631+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.081481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6160,"num_write":16,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:04.735243+0000","last_change":"2024-09-14T11:12:19.112482+0000","last_active":"2024-09-14T12:40:04.735243+0000","last_peered":"2024-09-14T12:40:04.735243+0000","last_clean":"2024-09-14T12:40:04.735243+0000","last_became_active":"2024-09-14T11:12:19.109807+0000","last_became_peered":"2024-09-14T11:12:19.109807+0000","last_unstale":"2024-09-14T12:40:04.735243+0000","last_undegraded":"2024-09-14T12:40:04.735243+0000","last_fullsized":"2024-09-14T12:40:04.735243+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:20.441664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'38","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.554078+0000","last_change":"2024-09-14T11:06:29.521507+0000","last_active":"2024-09-14T12:41:00.554078+0000","last_peered":"2024-09-14T12:41:00.554078+0000","last_clean":"2024-09-14T12:41:00.554078+0000","last_became_active":"2024-09-14T11:06:29.520734+0000","last_became_peered":"2024-09-14T11:06:29.520734+0000","last_unstale":"2024-09-14T12:41:00.554078+0000","last_undegraded":"2024-09-14T12:41:00.554078+0000","last_fullsized":"2024-09-14T12:41:00.554078+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:18.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":248,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.551623+0000","last_change":"2024-09-14T11:40:08.929963+0000","last_active":"2024-09-14T12:40:50.551623+0000","last_peered":"2024-09-14T12:40:50.551623+0000","last_clean":"2024-09-14T12:40:50.551623+0000","last_became_active":"2024-09-14T11:40:08.928855+0000","last_became_peered":"2024-09-14T11:40:08.928855+0000","last_unstale":"2024-09-14T12:40:50.551623+0000","last_undegraded":"2024-09-14T12:40:50.551623+0000","last_fullsized":"2024-09-14T12:40:50.551623+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:53.447923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.554007+0000","last_change":"2024-09-14T11:12:26.236373+0000","last_active":"2024-09-14T12:40:10.554007+0000","last_peered":"2024-09-14T12:40:10.554007+0000","last_clean":"2024-09-14T12:40:10.554007+0000","last_became_active":"2024-09-14T11:12:26.235707+0000","last_became_peered":"2024-09-14T11:12:26.235707+0000","last_unstale":"2024-09-14T12:40:10.554007+0000","last_undegraded":"2024-09-14T12:40:10.554007+0000","last_fullsized":"2024-09-14T12:40:10.554007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:08.153271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"267'5","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.951256+0000","last_change":"2024-09-14T11:12:19.112752+0000","last_active":"2024-09-14T12:44:02.951256+0000","last_peered":"2024-09-14T12:44:02.951256+0000","last_clean":"2024-09-14T12:44:02.951256+0000","last_became_active":"2024-09-14T11:12:19.112055+0000","last_became_peered":"2024-09-14T11:12:19.112055+0000","last_unstale":"2024-09-14T12:44:02.951256+0000","last_undegraded":"2024-09-14T12:44:02.951256+0000","last_fullsized":"2024-09-14T12:44:02.951256+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:44.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'65","reported_seq":253,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548334+0000","last_change":"2024-09-14T11:06:29.516817+0000","last_active":"2024-09-14T12:41:01.548334+0000","last_peered":"2024-09-14T12:41:01.548334+0000","last_clean":"2024-09-14T12:41:01.548334+0000","last_became_active":"2024-09-14T11:06:29.511360+0000","last_became_peered":"2024-09-14T11:06:29.511360+0000","last_unstale":"2024-09-14T12:41:01.548334+0000","last_undegraded":"2024-09-14T12:41:01.548334+0000","last_fullsized":"2024-09-14T12:41:01.548334+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:54.074956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":367,"num_write":155,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.564546+0000","last_change":"2024-09-14T11:40:08.949706+0000","last_active":"2024-09-14T12:40:55.564546+0000","last_peered":"2024-09-14T12:40:55.564546+0000","last_clean":"2024-09-14T12:40:55.564546+0000","last_became_active":"2024-09-14T11:40:08.949175+0000","last_became_peered":"2024-09-14T11:40:08.949175+0000","last_unstale":"2024-09-14T12:40:55.564546+0000","last_undegraded":"2024-09-14T12:40:55.564546+0000","last_fullsized":"2024-09-14T12:40:55.564546+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:24.365260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.227031+0000","last_change":"2024-09-14T11:12:26.229833+0000","last_active":"2024-09-14T12:44:03.227031+0000","last_peered":"2024-09-14T12:44:03.227031+0000","last_clean":"2024-09-14T12:44:03.227031+0000","last_became_active":"2024-09-14T11:12:26.228889+0000","last_became_peered":"2024-09-14T11:12:26.228889+0000","last_unstale":"2024-09-14T12:44:03.227031+0000","last_undegraded":"2024-09-14T12:44:03.227031+0000","last_fullsized":"2024-09-14T12:44:03.227031+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:37.357481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:19.779183+0000","last_change":"2024-09-14T11:12:19.099716+0000","last_active":"2024-09-14T12:43:19.779183+0000","last_peered":"2024-09-14T12:43:19.779183+0000","last_clean":"2024-09-14T12:43:19.779183+0000","last_became_active":"2024-09-14T11:12:19.098699+0000","last_became_peered":"2024-09-14T11:12:19.098699+0000","last_unstale":"2024-09-14T12:43:19.779183+0000","last_undegraded":"2024-09-14T12:43:19.779183+0000","last_fullsized":"2024-09-14T12:43:19.779183+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:03.576522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'39","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548268+0000","last_change":"2024-09-14T11:06:29.539103+0000","last_active":"2024-09-14T12:41:01.548268+0000","last_peered":"2024-09-14T12:41:01.548268+0000","last_clean":"2024-09-14T12:41:01.548268+0000","last_became_active":"2024-09-14T11:06:29.538432+0000","last_became_peered":"2024-09-14T11:06:29.538432+0000","last_unstale":"2024-09-14T12:41:01.548268+0000","last_undegraded":"2024-09-14T12:41:01.548268+0000","last_fullsized":"2024-09-14T12:41:01.548268+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.474730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":213,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.159302+0000","last_change":"2024-09-14T11:40:08.942492+0000","last_active":"2024-09-14T12:41:06.159302+0000","last_peered":"2024-09-14T12:41:06.159302+0000","last_clean":"2024-09-14T12:41:06.159302+0000","last_became_active":"2024-09-14T11:40:08.941924+0000","last_became_peered":"2024-09-14T11:40:08.941924+0000","last_unstale":"2024-09-14T12:41:06.159302+0000","last_undegraded":"2024-09-14T12:41:06.159302+0000","last_fullsized":"2024-09-14T12:41:06.159302+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:27.899066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'7","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:26.189523+0000","last_change":"2024-09-14T11:12:26.248413+0000","last_active":"2024-09-14T12:43:26.189523+0000","last_peered":"2024-09-14T12:43:26.189523+0000","last_clean":"2024-09-14T12:43:26.189523+0000","last_became_active":"2024-09-14T11:12:26.247849+0000","last_became_peered":"2024-09-14T11:12:26.247849+0000","last_unstale":"2024-09-14T12:43:26.189523+0000","last_undegraded":"2024-09-14T12:43:26.189523+0000","last_fullsized":"2024-09-14T12:43:26.189523+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:10.903087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5155,"num_write":12,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.208693+0000","last_change":"2024-09-14T11:12:19.096332+0000","last_active":"2024-09-14T12:44:02.208693+0000","last_peered":"2024-09-14T12:44:02.208693+0000","last_clean":"2024-09-14T12:44:02.208693+0000","last_became_active":"2024-09-14T11:12:19.095636+0000","last_became_peered":"2024-09-14T11:12:19.095636+0000","last_unstale":"2024-09-14T12:44:02.208693+0000","last_undegraded":"2024-09-14T12:44:02.208693+0000","last_fullsized":"2024-09-14T12:44:02.208693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:51.045024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'31","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142146+0000","last_change":"2024-09-14T11:06:29.508912+0000","last_active":"2024-09-14T12:39:56.142146+0000","last_peered":"2024-09-14T12:39:56.142146+0000","last_clean":"2024-09-14T12:39:56.142146+0000","last_became_active":"2024-09-14T11:06:29.508269+0000","last_became_peered":"2024-09-14T11:06:29.508269+0000","last_unstale":"2024-09-14T12:39:56.142146+0000","last_undegraded":"2024-09-14T12:39:56.142146+0000","last_fullsized":"2024-09-14T12:39:56.142146+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:53.190994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":149,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.800182+0000","last_change":"2024-09-14T11:40:08.945998+0000","last_active":"2024-09-14T12:40:55.800182+0000","last_peered":"2024-09-14T12:40:55.800182+0000","last_clean":"2024-09-14T12:40:55.800182+0000","last_became_active":"2024-09-14T11:40:08.945217+0000","last_became_peered":"2024-09-14T11:40:08.945217+0000","last_unstale":"2024-09-14T12:40:55.800182+0000","last_undegraded":"2024-09-14T12:40:55.800182+0000","last_fullsized":"2024-09-14T12:40:55.800182+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:49.290553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'5","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:26.567208+0000","last_change":"2024-09-14T11:12:26.247976+0000","last_active":"2024-09-14T12:42:26.567208+0000","last_peered":"2024-09-14T12:42:26.567208+0000","last_clean":"2024-09-14T12:42:26.567208+0000","last_became_active":"2024-09-14T11:12:26.247272+0000","last_became_peered":"2024-09-14T11:12:26.247272+0000","last_unstale":"2024-09-14T12:42:26.567208+0000","last_undegraded":"2024-09-14T12:42:26.567208+0000","last_fullsized":"2024-09-14T12:42:26.567208+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:11.612706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:34.782674+0000","last_change":"2024-09-14T11:12:19.106061+0000","last_active":"2024-09-14T12:43:34.782674+0000","last_peered":"2024-09-14T12:43:34.782674+0000","last_clean":"2024-09-14T12:43:34.782674+0000","last_became_active":"2024-09-14T11:12:19.103535+0000","last_became_peered":"2024-09-14T11:12:19.103535+0000","last_unstale":"2024-09-14T12:43:34.782674+0000","last_undegraded":"2024-09-14T12:43:34.782674+0000","last_fullsized":"2024-09-14T12:43:34.782674+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.680229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'7","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.358674+0000","last_change":"2024-09-14T11:06:29.510769+0000","last_active":"2024-09-14T12:41:50.358674+0000","last_peered":"2024-09-14T12:41:50.358674+0000","last_clean":"2024-09-14T12:41:50.358674+0000","last_became_active":"2024-09-14T11:06:29.510044+0000","last_became_peered":"2024-09-14T11:06:29.510044+0000","last_unstale":"2024-09-14T12:41:50.358674+0000","last_undegraded":"2024-09-14T12:41:50.358674+0000","last_fullsized":"2024-09-14T12:41:50.358674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:30.328430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:54.746472+0000","last_change":"2024-09-14T11:40:08.930752+0000","last_active":"2024-09-14T12:40:54.746472+0000","last_peered":"2024-09-14T12:40:54.746472+0000","last_clean":"2024-09-14T12:40:54.746472+0000","last_became_active":"2024-09-14T11:40:08.930065+0000","last_became_peered":"2024-09-14T11:40:08.930065+0000","last_unstale":"2024-09-14T12:40:54.746472+0000","last_undegraded":"2024-09-14T12:40:54.746472+0000","last_fullsized":"2024-09-14T12:40:54.746472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.939757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.807272+0000","last_change":"2024-09-14T11:12:26.234589+0000","last_active":"2024-09-14T12:41:30.807272+0000","last_peered":"2024-09-14T12:41:30.807272+0000","last_clean":"2024-09-14T12:41:30.807272+0000","last_became_active":"2024-09-14T11:12:26.233812+0000","last_became_peered":"2024-09-14T11:12:26.233812+0000","last_unstale":"2024-09-14T12:41:30.807272+0000","last_undegraded":"2024-09-14T12:41:30.807272+0000","last_fullsized":"2024-09-14T12:41:30.807272+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:49.220830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.511709+0000","last_change":"2024-09-14T11:12:19.108839+0000","last_active":"2024-09-14T12:42:21.511709+0000","last_peered":"2024-09-14T12:42:21.511709+0000","last_clean":"2024-09-14T12:42:21.511709+0000","last_became_active":"2024-09-14T11:12:19.107950+0000","last_became_peered":"2024-09-14T11:12:19.107950+0000","last_unstale":"2024-09-14T12:42:21.511709+0000","last_undegraded":"2024-09-14T12:42:21.511709+0000","last_fullsized":"2024-09-14T12:42:21.511709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:06.871908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'21","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.810485+0000","last_change":"2024-09-14T11:06:29.528799+0000","last_active":"2024-09-14T12:41:50.810485+0000","last_peered":"2024-09-14T12:41:50.810485+0000","last_clean":"2024-09-14T12:41:50.810485+0000","last_became_active":"2024-09-14T11:06:29.528153+0000","last_became_peered":"2024-09-14T11:06:29.528153+0000","last_unstale":"2024-09-14T12:41:50.810485+0000","last_undegraded":"2024-09-14T12:41:50.810485+0000","last_fullsized":"2024-09-14T12:41:50.810485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:32.956165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":111,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795593+0000","last_change":"2024-09-14T11:40:08.937198+0000","last_active":"2024-09-14T12:40:35.795593+0000","last_peered":"2024-09-14T12:40:35.795593+0000","last_clean":"2024-09-14T12:40:35.795593+0000","last_became_active":"2024-09-14T11:40:08.936369+0000","last_became_peered":"2024-09-14T11:40:08.936369+0000","last_unstale":"2024-09-14T12:40:35.795593+0000","last_undegraded":"2024-09-14T12:40:35.795593+0000","last_fullsized":"2024-09-14T12:40:35.795593+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:41.385885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:25.367775+0000","last_change":"2024-09-14T11:12:26.246616+0000","last_active":"2024-09-14T12:42:25.367775+0000","last_peered":"2024-09-14T12:42:25.367775+0000","last_clean":"2024-09-14T12:42:25.367775+0000","last_became_active":"2024-09-14T11:12:26.245930+0000","last_became_peered":"2024-09-14T11:12:26.245930+0000","last_unstale":"2024-09-14T12:42:25.367775+0000","last_undegraded":"2024-09-14T12:42:25.367775+0000","last_fullsized":"2024-09-14T12:42:25.367775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:04.624461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.534457+0000","last_change":"2024-09-14T11:12:19.109523+0000","last_active":"2024-09-14T12:44:01.534457+0000","last_peered":"2024-09-14T12:44:01.534457+0000","last_clean":"2024-09-14T12:44:01.534457+0000","last_became_active":"2024-09-14T11:12:19.108775+0000","last_became_peered":"2024-09-14T11:12:19.108775+0000","last_unstale":"2024-09-14T12:44:01.534457+0000","last_undegraded":"2024-09-14T12:44:01.534457+0000","last_fullsized":"2024-09-14T12:44:01.534457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:14.420097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'26","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585974+0000","last_change":"2024-09-14T11:06:29.513212+0000","last_active":"2024-09-14T12:41:50.585974+0000","last_peered":"2024-09-14T12:41:50.585974+0000","last_clean":"2024-09-14T12:41:50.585974+0000","last_became_active":"2024-09-14T11:06:29.512500+0000","last_became_peered":"2024-09-14T11:06:29.512500+0000","last_unstale":"2024-09-14T12:41:50.585974+0000","last_undegraded":"2024-09-14T12:41:50.585974+0000","last_fullsized":"2024-09-14T12:41:50.585974+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:16.159078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":126,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795654+0000","last_change":"2024-09-14T11:40:08.942991+0000","last_active":"2024-09-14T12:40:35.795654+0000","last_peered":"2024-09-14T12:40:35.795654+0000","last_clean":"2024-09-14T12:40:35.795654+0000","last_became_active":"2024-09-14T11:40:08.941346+0000","last_became_peered":"2024-09-14T11:40:08.941346+0000","last_unstale":"2024-09-14T12:40:35.795654+0000","last_undegraded":"2024-09-14T12:40:35.795654+0000","last_fullsized":"2024-09-14T12:40:35.795654+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.150412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827889+0000","last_change":"2024-09-14T11:12:26.243752+0000","last_active":"2024-09-14T12:44:03.827889+0000","last_peered":"2024-09-14T12:44:03.827889+0000","last_clean":"2024-09-14T12:44:03.827889+0000","last_became_active":"2024-09-14T11:12:26.243209+0000","last_became_peered":"2024-09-14T11:12:26.243209+0000","last_unstale":"2024-09-14T12:44:03.827889+0000","last_undegraded":"2024-09-14T12:44:03.827889+0000","last_fullsized":"2024-09-14T12:44:03.827889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:38.328679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'11","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.900631+0000","last_change":"2024-09-14T11:12:19.092074+0000","last_active":"2024-09-14T12:44:03.900631+0000","last_peered":"2024-09-14T12:44:03.900631+0000","last_clean":"2024-09-14T12:44:03.900631+0000","last_became_active":"2024-09-14T11:12:19.091327+0000","last_became_peered":"2024-09-14T11:12:19.091327+0000","last_unstale":"2024-09-14T12:44:03.900631+0000","last_undegraded":"2024-09-14T12:44:03.900631+0000","last_fullsized":"2024-09-14T12:44:03.900631+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:38.040984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":27638,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'29","reported_seq":155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503327+0000","last_change":"2024-09-14T11:06:29.545877+0000","last_active":"2024-09-14T12:41:51.503327+0000","last_peered":"2024-09-14T12:41:51.503327+0000","last_clean":"2024-09-14T12:41:51.503327+0000","last_became_active":"2024-09-14T11:06:29.539618+0000","last_became_peered":"2024-09-14T11:06:29.539618+0000","last_unstale":"2024-09-14T12:41:51.503327+0000","last_undegraded":"2024-09-14T12:41:51.503327+0000","last_fullsized":"2024-09-14T12:41:51.503327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:18.342360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":157,"num_write":71,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:25.557355+0000","last_change":"2024-09-14T11:40:08.946921+0000","last_active":"2024-09-14T12:40:25.557355+0000","last_peered":"2024-09-14T12:40:25.557355+0000","last_clean":"2024-09-14T12:40:25.557355+0000","last_became_active":"2024-09-14T11:40:08.946312+0000","last_became_peered":"2024-09-14T11:40:08.946312+0000","last_unstale":"2024-09-14T12:40:25.557355+0000","last_undegraded":"2024-09-14T12:40:25.557355+0000","last_fullsized":"2024-09-14T12:40:25.557355+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:31.836873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'9","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:25.830170+0000","last_change":"2024-09-14T11:12:26.229509+0000","last_active":"2024-09-14T12:43:25.830170+0000","last_peered":"2024-09-14T12:43:25.830170+0000","last_clean":"2024-09-14T12:43:25.830170+0000","last_became_active":"2024-09-14T11:12:26.228723+0000","last_became_peered":"2024-09-14T11:12:26.228723+0000","last_unstale":"2024-09-14T12:43:25.830170+0000","last_undegraded":"2024-09-14T12:43:25.830170+0000","last_fullsized":"2024-09-14T12:43:25.830170+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:02.621776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11303,"num_write":14,"num_write_kb":5161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.160475+0000","last_change":"2024-09-14T11:12:19.085868+0000","last_active":"2024-09-14T12:41:11.160475+0000","last_peered":"2024-09-14T12:41:11.160475+0000","last_clean":"2024-09-14T12:41:11.160475+0000","last_became_active":"2024-09-14T11:12:19.085023+0000","last_became_peered":"2024-09-14T11:12:19.085023+0000","last_unstale":"2024-09-14T12:41:11.160475+0000","last_undegraded":"2024-09-14T12:41:11.160475+0000","last_fullsized":"2024-09-14T12:41:11.160475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:18.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:31.150526+0000","last_change":"2024-09-14T11:06:29.529450+0000","last_active":"2024-09-14T12:40:31.150526+0000","last_peered":"2024-09-14T12:40:31.150526+0000","last_clean":"2024-09-14T12:40:31.150526+0000","last_became_active":"2024-09-14T11:06:29.527422+0000","last_became_peered":"2024-09-14T11:06:29.527422+0000","last_unstale":"2024-09-14T12:40:31.150526+0000","last_undegraded":"2024-09-14T12:40:31.150526+0000","last_fullsized":"2024-09-14T12:40:31.150526+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.481655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":97,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.483898+0000","last_change":"2024-09-14T11:40:08.934634+0000","last_active":"2024-09-14T12:40:36.483898+0000","last_peered":"2024-09-14T12:40:36.483898+0000","last_clean":"2024-09-14T12:40:36.483898+0000","last_became_active":"2024-09-14T11:40:08.933897+0000","last_became_peered":"2024-09-14T11:40:08.933897+0000","last_unstale":"2024-09-14T12:40:36.483898+0000","last_undegraded":"2024-09-14T12:40:36.483898+0000","last_fullsized":"2024-09-14T12:40:36.483898+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:56.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'7","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827832+0000","last_change":"2024-09-14T11:12:26.238345+0000","last_active":"2024-09-14T12:44:03.827832+0000","last_peered":"2024-09-14T12:44:03.827832+0000","last_clean":"2024-09-14T12:44:03.827832+0000","last_became_active":"2024-09-14T11:12:26.232736+0000","last_became_peered":"2024-09-14T11:12:26.232736+0000","last_unstale":"2024-09-14T12:44:03.827832+0000","last_undegraded":"2024-09-14T12:44:03.827832+0000","last_fullsized":"2024-09-14T12:44:03.827832+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:45.595070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":12,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:21.524121+0000","last_change":"2024-09-14T11:12:19.108780+0000","last_active":"2024-09-14T12:43:21.524121+0000","last_peered":"2024-09-14T12:43:21.524121+0000","last_clean":"2024-09-14T12:43:21.524121+0000","last_became_active":"2024-09-14T11:12:19.100258+0000","last_became_peered":"2024-09-14T11:12:19.100258+0000","last_unstale":"2024-09-14T12:43:21.524121+0000","last_undegraded":"2024-09-14T12:43:21.524121+0000","last_fullsized":"2024-09-14T12:43:21.524121+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.561655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2056,"num_write":10,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737495+0000","last_change":"2024-09-14T11:06:29.533686+0000","last_active":"2024-09-14T12:40:14.737495+0000","last_peered":"2024-09-14T12:40:14.737495+0000","last_clean":"2024-09-14T12:40:14.737495+0000","last_became_active":"2024-09-14T11:06:29.532958+0000","last_became_peered":"2024-09-14T11:06:29.532958+0000","last_unstale":"2024-09-14T12:40:14.737495+0000","last_undegraded":"2024-09-14T12:40:14.737495+0000","last_fullsized":"2024-09-14T12:40:14.737495+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:35.814419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":199,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:49.745345+0000","last_change":"2024-09-14T11:40:08.934320+0000","last_active":"2024-09-14T12:40:49.745345+0000","last_peered":"2024-09-14T12:40:49.745345+0000","last_clean":"2024-09-14T12:40:49.745345+0000","last_became_active":"2024-09-14T11:40:08.932939+0000","last_became_peered":"2024-09-14T11:40:08.932939+0000","last_unstale":"2024-09-14T12:40:49.745345+0000","last_undegraded":"2024-09-14T12:40:49.745345+0000","last_fullsized":"2024-09-14T12:40:49.745345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:01.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.876886+0000","last_change":"2024-09-14T11:12:26.245494+0000","last_active":"2024-09-14T12:44:04.876886+0000","last_peered":"2024-09-14T12:44:04.876886+0000","last_clean":"2024-09-14T12:44:04.876886+0000","last_became_active":"2024-09-14T11:12:26.236892+0000","last_became_peered":"2024-09-14T11:12:26.236892+0000","last_unstale":"2024-09-14T12:44:04.876886+0000","last_undegraded":"2024-09-14T12:44:04.876886+0000","last_fullsized":"2024-09-14T12:44:04.876886+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.142203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.151616+0000","last_change":"2024-09-14T11:12:19.085476+0000","last_active":"2024-09-14T12:40:36.151616+0000","last_peered":"2024-09-14T12:40:36.151616+0000","last_clean":"2024-09-14T12:40:36.151616+0000","last_became_active":"2024-09-14T11:12:19.084630+0000","last_became_peered":"2024-09-14T11:12:19.084630+0000","last_unstale":"2024-09-14T12:40:36.151616+0000","last_undegraded":"2024-09-14T12:40:36.151616+0000","last_fullsized":"2024-09-14T12:40:36.151616+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:40.347823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'305","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.147026+0000","last_change":"2024-09-14T11:06:29.529539+0000","last_active":"2024-09-14T12:40:16.147026+0000","last_peered":"2024-09-14T12:40:16.147026+0000","last_clean":"2024-09-14T12:40:16.147026+0000","last_became_active":"2024-09-14T11:06:29.524051+0000","last_became_peered":"2024-09-14T11:06:29.524051+0000","last_unstale":"2024-09-14T12:40:16.147026+0000","last_undegraded":"2024-09-14T12:40:16.147026+0000","last_fullsized":"2024-09-14T12:40:16.147026+0000","mapping_epoch":256,"log_start":"264'200","ondisk_log_start":"264'200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:40.592968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2841,"num_read_kb":3371,"num_write":621,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.572999+0000","last_change":"2024-09-14T11:40:08.938945+0000","last_active":"2024-09-14T12:40:50.572999+0000","last_peered":"2024-09-14T12:40:50.572999+0000","last_clean":"2024-09-14T12:40:50.572999+0000","last_became_active":"2024-09-14T11:40:08.938357+0000","last_became_peered":"2024-09-14T11:40:08.938357+0000","last_unstale":"2024-09-14T12:40:50.572999+0000","last_undegraded":"2024-09-14T12:40:50.572999+0000","last_fullsized":"2024-09-14T12:40:50.572999+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:36.211620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'10","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.128908+0000","last_change":"2024-09-14T11:12:26.252293+0000","last_active":"2024-09-14T12:44:02.128908+0000","last_peered":"2024-09-14T12:44:02.128908+0000","last_clean":"2024-09-14T12:44:02.128908+0000","last_became_active":"2024-09-14T11:12:26.251771+0000","last_became_peered":"2024-09-14T11:12:26.251771+0000","last_unstale":"2024-09-14T12:44:02.128908+0000","last_undegraded":"2024-09-14T12:44:02.128908+0000","last_fullsized":"2024-09-14T12:44:02.128908+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:13.079478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9222,"num_write":10,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.534253+0000","last_change":"2024-09-14T11:12:19.109609+0000","last_active":"2024-09-14T12:44:01.534253+0000","last_peered":"2024-09-14T12:44:01.534253+0000","last_clean":"2024-09-14T12:44:01.534253+0000","last_became_active":"2024-09-14T11:12:19.100323+0000","last_became_peered":"2024-09-14T11:12:19.100323+0000","last_unstale":"2024-09-14T12:44:01.534253+0000","last_undegraded":"2024-09-14T12:44:01.534253+0000","last_fullsized":"2024-09-14T12:44:01.534253+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'31","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478473+0000","last_change":"2024-09-14T11:06:29.545567+0000","last_active":"2024-09-14T12:40:16.478473+0000","last_peered":"2024-09-14T12:40:16.478473+0000","last_clean":"2024-09-14T12:40:16.478473+0000","last_became_active":"2024-09-14T11:06:29.545010+0000","last_became_peered":"2024-09-14T11:06:29.545010+0000","last_unstale":"2024-09-14T12:40:16.478473+0000","last_undegraded":"2024-09-14T12:40:16.478473+0000","last_fullsized":"2024-09-14T12:40:16.478473+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:33.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":160,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559740+0000","last_change":"2024-09-14T11:40:08.946756+0000","last_active":"2024-09-14T12:40:35.559740+0000","last_peered":"2024-09-14T12:40:35.559740+0000","last_clean":"2024-09-14T12:40:35.559740+0000","last_became_active":"2024-09-14T11:40:08.946192+0000","last_became_peered":"2024-09-14T11:40:08.946192+0000","last_unstale":"2024-09-14T12:40:35.559740+0000","last_undegraded":"2024-09-14T12:40:35.559740+0000","last_fullsized":"2024-09-14T12:40:35.559740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:33.765939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"267'14","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.052444+0000","last_change":"2024-09-14T11:12:26.252307+0000","last_active":"2024-09-14T12:44:03.052444+0000","last_peered":"2024-09-14T12:44:03.052444+0000","last_clean":"2024-09-14T12:44:03.052444+0000","last_became_active":"2024-09-14T11:12:26.251336+0000","last_became_peered":"2024-09-14T11:12:26.251336+0000","last_unstale":"2024-09-14T12:44:03.052444+0000","last_undegraded":"2024-09-14T12:44:03.052444+0000","last_fullsized":"2024-09-14T12:44:03.052444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:43.789676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":27664,"num_write":24,"num_write_kb":11276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560463+0000","last_change":"2024-09-14T11:12:19.090268+0000","last_active":"2024-09-14T12:41:56.560463+0000","last_peered":"2024-09-14T12:41:56.560463+0000","last_clean":"2024-09-14T12:41:56.560463+0000","last_became_active":"2024-09-14T11:12:19.089451+0000","last_became_peered":"2024-09-14T11:12:19.089451+0000","last_unstale":"2024-09-14T12:41:56.560463+0000","last_undegraded":"2024-09-14T12:41:56.560463+0000","last_fullsized":"2024-09-14T12:41:56.560463+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.308101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"267'36","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478384+0000","last_change":"2024-09-14T11:06:29.519496+0000","last_active":"2024-09-14T12:40:16.478384+0000","last_peered":"2024-09-14T12:40:16.478384+0000","last_clean":"2024-09-14T12:40:16.478384+0000","last_became_active":"2024-09-14T11:06:29.518775+0000","last_became_peered":"2024-09-14T11:06:29.518775+0000","last_unstale":"2024-09-14T12:40:16.478384+0000","last_undegraded":"2024-09-14T12:40:16.478384+0000","last_fullsized":"2024-09-14T12:40:16.478384+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:55.187103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":189,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485290+0000","last_change":"2024-09-14T11:40:08.934946+0000","last_active":"2024-09-14T12:40:41.485290+0000","last_peered":"2024-09-14T12:40:41.485290+0000","last_clean":"2024-09-14T12:40:41.485290+0000","last_became_active":"2024-09-14T11:40:08.934173+0000","last_became_peered":"2024-09-14T11:40:08.934173+0000","last_unstale":"2024-09-14T12:40:41.485290+0000","last_undegraded":"2024-09-14T12:40:41.485290+0000","last_fullsized":"2024-09-14T12:40:41.485290+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:19.698280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"267'6","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.320298+0000","last_change":"2024-09-14T11:12:26.243412+0000","last_active":"2024-09-14T12:44:03.320298+0000","last_peered":"2024-09-14T12:44:03.320298+0000","last_clean":"2024-09-14T12:44:03.320298+0000","last_became_active":"2024-09-14T11:12:26.242532+0000","last_became_peered":"2024-09-14T11:12:26.242532+0000","last_unstale":"2024-09-14T12:44:03.320298+0000","last_undegraded":"2024-09-14T12:44:03.320298+0000","last_fullsized":"2024-09-14T12:44:03.320298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:30.032531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9208,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568347+0000","last_change":"2024-09-14T11:12:19.115989+0000","last_active":"2024-09-14T12:41:55.568347+0000","last_peered":"2024-09-14T12:41:55.568347+0000","last_clean":"2024-09-14T12:41:55.568347+0000","last_became_active":"2024-09-14T11:12:19.115236+0000","last_became_peered":"2024-09-14T11:12:19.115236+0000","last_unstale":"2024-09-14T12:41:55.568347+0000","last_undegraded":"2024-09-14T12:41:55.568347+0000","last_fullsized":"2024-09-14T12:41:55.568347+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:10.915539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'6","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.154160+0000","last_change":"2024-09-14T11:06:29.526320+0000","last_active":"2024-09-14T12:40:46.154160+0000","last_peered":"2024-09-14T12:40:46.154160+0000","last_clean":"2024-09-14T12:40:46.154160+0000","last_became_active":"2024-09-14T11:06:29.525548+0000","last_became_peered":"2024-09-14T11:06:29.525548+0000","last_unstale":"2024-09-14T12:40:46.154160+0000","last_undegraded":"2024-09-14T12:40:46.154160+0000","last_fullsized":"2024-09-14T12:40:46.154160+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:11.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'395","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.980414+0000","last_change":"2024-09-14T10:49:23.373774+0000","last_active":"2024-09-14T12:44:04.980414+0000","last_peered":"2024-09-14T12:44:04.980414+0000","last_clean":"2024-09-14T12:44:04.980414+0000","last_became_active":"2024-09-14T10:49:23.372514+0000","last_became_peered":"2024-09-14T10:49:23.372514+0000","last_unstale":"2024-09-14T12:44:04.980414+0000","last_undegraded":"2024-09-14T12:44:04.980414+0000","last_fullsized":"2024-09-14T12:44:04.980414+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.036879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":698,"num_read_kb":89783,"num_write":1195,"num_write_kb":37856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'875","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.375040+0000","last_change":"2024-09-14T10:49:25.369326+0000","last_active":"2024-09-14T12:42:29.375040+0000","last_peered":"2024-09-14T12:42:29.375040+0000","last_clean":"2024-09-14T12:42:29.375040+0000","last_became_active":"2024-09-14T10:49:25.368861+0000","last_became_peered":"2024-09-14T10:49:25.368861+0000","last_unstale":"2024-09-14T12:42:29.375040+0000","last_undegraded":"2024-09-14T12:42:29.375040+0000","last_fullsized":"2024-09-14T12:42:29.375040+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:53.245258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4292,"num_read_kb":3786,"num_write":1290,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'389","reported_seq":1139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.900374+0000","last_change":"2024-09-14T10:49:23.387406+0000","last_active":"2024-09-14T12:44:04.900374+0000","last_peered":"2024-09-14T12:44:04.900374+0000","last_clean":"2024-09-14T12:44:04.900374+0000","last_became_active":"2024-09-14T10:49:23.386742+0000","last_became_peered":"2024-09-14T10:49:23.386742+0000","last_unstale":"2024-09-14T12:44:04.900374+0000","last_undegraded":"2024-09-14T12:44:04.900374+0000","last_fullsized":"2024-09-14T12:44:04.900374+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.860422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":967,"num_read_kb":14779,"num_write":1188,"num_write_kb":22069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'1157","reported_seq":2810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.680278+0000","last_change":"2024-09-14T10:49:25.371243+0000","last_active":"2024-09-14T12:42:31.680278+0000","last_peered":"2024-09-14T12:42:31.680278+0000","last_clean":"2024-09-14T12:42:31.680278+0000","last_became_active":"2024-09-14T10:49:25.370610+0000","last_became_peered":"2024-09-14T10:49:25.370610+0000","last_unstale":"2024-09-14T12:42:31.680278+0000","last_undegraded":"2024-09-14T12:42:31.680278+0000","last_fullsized":"2024-09-14T12:42:31.680278+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:18.603078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5343,"num_read_kb":4756,"num_write":1566,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'380","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.957016+0000","last_change":"2024-09-14T10:49:23.368497+0000","last_active":"2024-09-14T12:44:04.957016+0000","last_peered":"2024-09-14T12:44:04.957016+0000","last_clean":"2024-09-14T12:44:04.957016+0000","last_became_active":"2024-09-14T10:49:23.367647+0000","last_became_peered":"2024-09-14T10:49:23.367647+0000","last_unstale":"2024-09-14T12:44:04.957016+0000","last_undegraded":"2024-09-14T12:44:04.957016+0000","last_fullsized":"2024-09-14T12:44:04.957016+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:08.432641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":20304,"num_write":1229,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1240","reported_seq":2832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.728017+0000","last_change":"2024-09-14T10:49:25.380844+0000","last_active":"2024-09-14T12:41:23.728017+0000","last_peered":"2024-09-14T12:41:23.728017+0000","last_clean":"2024-09-14T12:41:23.728017+0000","last_became_active":"2024-09-14T10:49:25.380525+0000","last_became_peered":"2024-09-14T10:49:25.380525+0000","last_unstale":"2024-09-14T12:41:23.728017+0000","last_undegraded":"2024-09-14T12:41:23.728017+0000","last_fullsized":"2024-09-14T12:41:23.728017+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:39.949070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5594,"num_read_kb":4933,"num_write":1701,"num_write_kb":712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.886735+0000","last_change":"2024-09-14T10:49:23.395465+0000","last_active":"2024-09-14T12:44:04.886735+0000","last_peered":"2024-09-14T12:44:04.886735+0000","last_clean":"2024-09-14T12:44:04.886735+0000","last_became_active":"2024-09-14T10:49:23.395029+0000","last_became_peered":"2024-09-14T10:49:23.395029+0000","last_unstale":"2024-09-14T12:44:04.886735+0000","last_undegraded":"2024-09-14T12:44:04.886735+0000","last_fullsized":"2024-09-14T12:44:04.886735+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:51.643761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":13844,"num_write":1136,"num_write_kb":32575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'922","reported_seq":2538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:08.373535+0000","last_change":"2024-09-14T10:49:25.369478+0000","last_active":"2024-09-14T12:40:08.373535+0000","last_peered":"2024-09-14T12:40:08.373535+0000","last_clean":"2024-09-14T12:40:08.373535+0000","last_became_active":"2024-09-14T10:49:25.368723+0000","last_became_peered":"2024-09-14T10:49:25.368723+0000","last_unstale":"2024-09-14T12:40:08.373535+0000","last_undegraded":"2024-09-14T12:40:08.373535+0000","last_fullsized":"2024-09-14T12:40:08.373535+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":900,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:35.388355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6457,"num_read_kb":5960,"num_write":1431,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'365","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.842058+0000","last_change":"2024-09-14T10:49:23.397395+0000","last_active":"2024-09-14T12:44:04.842058+0000","last_peered":"2024-09-14T12:44:04.842058+0000","last_clean":"2024-09-14T12:44:04.842058+0000","last_became_active":"2024-09-14T10:49:23.396952+0000","last_became_peered":"2024-09-14T10:49:23.396952+0000","last_unstale":"2024-09-14T12:44:04.842058+0000","last_undegraded":"2024-09-14T12:44:04.842058+0000","last_fullsized":"2024-09-14T12:44:04.842058+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:46.006794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":730,"num_read_kb":15587,"num_write":1249,"num_write_kb":19198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'487","reported_seq":2234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.631742+0000","last_change":"2024-09-14T10:49:25.369573+0000","last_active":"2024-09-14T12:43:47.631742+0000","last_peered":"2024-09-14T12:43:47.631742+0000","last_clean":"2024-09-14T12:43:47.631742+0000","last_became_active":"2024-09-14T10:49:25.369197+0000","last_became_peered":"2024-09-14T10:49:25.369197+0000","last_unstale":"2024-09-14T12:43:47.631742+0000","last_undegraded":"2024-09-14T12:43:47.631742+0000","last_fullsized":"2024-09-14T12:43:47.631742+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:39.097092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2591,"num_write":558,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'328","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.910315+0000","last_change":"2024-09-14T10:49:23.387209+0000","last_active":"2024-09-14T12:44:04.910315+0000","last_peered":"2024-09-14T12:44:04.910315+0000","last_clean":"2024-09-14T12:44:04.910315+0000","last_became_active":"2024-09-14T10:49:23.386773+0000","last_became_peered":"2024-09-14T10:49:23.386773+0000","last_unstale":"2024-09-14T12:44:04.910315+0000","last_undegraded":"2024-09-14T12:44:04.910315+0000","last_fullsized":"2024-09-14T12:44:04.910315+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:38.080039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":548,"num_read_kb":8718,"num_write":1059,"num_write_kb":39714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'428","reported_seq":2070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.811994+0000","last_change":"2024-09-14T10:49:25.404535+0000","last_active":"2024-09-14T12:41:55.811994+0000","last_peered":"2024-09-14T12:41:55.811994+0000","last_clean":"2024-09-14T12:41:55.811994+0000","last_became_active":"2024-09-14T10:49:25.404189+0000","last_became_peered":"2024-09-14T10:49:25.404189+0000","last_unstale":"2024-09-14T12:41:55.811994+0000","last_undegraded":"2024-09-14T12:41:55.811994+0000","last_fullsized":"2024-09-14T12:41:55.811994+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:54.606077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2519,"num_read_kb":2387,"num_write":515,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'405","reported_seq":1084,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.902511+0000","last_change":"2024-09-14T10:49:23.354318+0000","last_active":"2024-09-14T12:44:04.902511+0000","last_peered":"2024-09-14T12:44:04.902511+0000","last_clean":"2024-09-14T12:44:04.902511+0000","last_became_active":"2024-09-14T10:49:23.353824+0000","last_became_peered":"2024-09-14T10:49:23.353824+0000","last_unstale":"2024-09-14T12:44:04.902511+0000","last_undegraded":"2024-09-14T12:44:04.902511+0000","last_fullsized":"2024-09-14T12:44:04.902511+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:21.688185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":687,"num_read_kb":3209,"num_write":1301,"num_write_kb":30473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'1236","reported_seq":2941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.170607+0000","last_change":"2024-09-14T10:49:25.388326+0000","last_active":"2024-09-14T12:41:56.170607+0000","last_peered":"2024-09-14T12:41:56.170607+0000","last_clean":"2024-09-14T12:41:56.170607+0000","last_became_active":"2024-09-14T10:49:25.388008+0000","last_became_peered":"2024-09-14T10:49:25.388008+0000","last_unstale":"2024-09-14T12:41:56.170607+0000","last_undegraded":"2024-09-14T12:41:56.170607+0000","last_fullsized":"2024-09-14T12:41:56.170607+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":1200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:16.569310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5023,"num_write":1696,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'317","reported_seq":941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.901858+0000","last_change":"2024-09-14T10:49:23.375365+0000","last_active":"2024-09-14T12:44:04.901858+0000","last_peered":"2024-09-14T12:44:04.901858+0000","last_clean":"2024-09-14T12:44:04.901858+0000","last_became_active":"2024-09-14T10:49:23.374194+0000","last_became_peered":"2024-09-14T10:49:23.374194+0000","last_unstale":"2024-09-14T12:44:04.901858+0000","last_undegraded":"2024-09-14T12:44:04.901858+0000","last_fullsized":"2024-09-14T12:44:04.901858+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:48.534483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730149,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":30724,"num_write":962,"num_write_kb":46577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'763","reported_seq":2187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.688694+0000","last_change":"2024-09-14T10:49:25.396557+0000","last_active":"2024-09-14T12:43:47.688694+0000","last_peered":"2024-09-14T12:43:47.688694+0000","last_clean":"2024-09-14T12:43:47.688694+0000","last_became_active":"2024-09-14T10:49:25.395625+0000","last_became_peered":"2024-09-14T10:49:25.395625+0000","last_unstale":"2024-09-14T12:43:47.688694+0000","last_undegraded":"2024-09-14T12:43:47.688694+0000","last_fullsized":"2024-09-14T12:43:47.688694+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:55.126134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3607,"num_read_kb":3221,"num_write":1031,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'923","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496603+0000","last_change":"2024-09-14T10:49:25.378305+0000","last_active":"2024-09-14T12:41:26.496603+0000","last_peered":"2024-09-14T12:41:26.496603+0000","last_clean":"2024-09-14T12:41:26.496603+0000","last_became_active":"2024-09-14T10:49:25.377697+0000","last_became_peered":"2024-09-14T10:49:25.377697+0000","last_unstale":"2024-09-14T12:41:26.496603+0000","last_undegraded":"2024-09-14T12:41:26.496603+0000","last_fullsized":"2024-09-14T12:41:26.496603+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:55.143987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4426,"num_read_kb":3954,"num_write":1251,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'319","reported_seq":1000,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.945989+0000","last_change":"2024-09-14T10:49:23.396284+0000","last_active":"2024-09-14T12:44:04.945989+0000","last_peered":"2024-09-14T12:44:04.945989+0000","last_clean":"2024-09-14T12:44:04.945989+0000","last_became_active":"2024-09-14T10:49:23.395881+0000","last_became_peered":"2024-09-14T10:49:23.395881+0000","last_unstale":"2024-09-14T12:44:04.945989+0000","last_undegraded":"2024-09-14T12:44:04.945989+0000","last_fullsized":"2024-09-14T12:44:04.945989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:37.290462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":45321,"num_write":937,"num_write_kb":34104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'503","reported_seq":2238,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.624807+0000","last_change":"2024-09-14T10:49:25.359959+0000","last_active":"2024-09-14T12:43:47.624807+0000","last_peered":"2024-09-14T12:43:47.624807+0000","last_clean":"2024-09-14T12:43:47.624807+0000","last_became_active":"2024-09-14T10:49:25.359419+0000","last_became_peered":"2024-09-14T10:49:25.359419+0000","last_unstale":"2024-09-14T12:43:47.624807+0000","last_undegraded":"2024-09-14T12:43:47.624807+0000","last_fullsized":"2024-09-14T12:43:47.624807+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:22.801370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2958,"num_read_kb":2787,"num_write":621,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'335","reported_seq":1015,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.910168+0000","last_change":"2024-09-14T10:49:23.374078+0000","last_active":"2024-09-14T12:44:04.910168+0000","last_peered":"2024-09-14T12:44:04.910168+0000","last_clean":"2024-09-14T12:44:04.910168+0000","last_became_active":"2024-09-14T10:49:23.372672+0000","last_became_peered":"2024-09-14T10:49:23.372672+0000","last_unstale":"2024-09-14T12:44:04.910168+0000","last_undegraded":"2024-09-14T12:44:04.910168+0000","last_fullsized":"2024-09-14T12:44:04.910168+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.831678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":589,"num_read_kb":8965,"num_write":1037,"num_write_kb":20473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'401","reported_seq":1911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.451799+0000","last_change":"2024-09-14T10:49:25.404208+0000","last_active":"2024-09-14T12:42:29.451799+0000","last_peered":"2024-09-14T12:42:29.451799+0000","last_clean":"2024-09-14T12:42:29.451799+0000","last_became_active":"2024-09-14T10:49:25.403885+0000","last_became_peered":"2024-09-14T10:49:25.403885+0000","last_unstale":"2024-09-14T12:42:29.451799+0000","last_undegraded":"2024-09-14T12:42:29.451799+0000","last_fullsized":"2024-09-14T12:42:29.451799+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2137,"num_read_kb":2023,"num_write":462,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'394","reported_seq":1111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.966298+0000","last_change":"2024-09-14T10:49:23.355237+0000","last_active":"2024-09-14T12:44:04.966298+0000","last_peered":"2024-09-14T12:44:04.966298+0000","last_clean":"2024-09-14T12:44:04.966298+0000","last_became_active":"2024-09-14T10:49:23.354127+0000","last_became_peered":"2024-09-14T10:49:23.354127+0000","last_unstale":"2024-09-14T12:44:04.966298+0000","last_undegraded":"2024-09-14T12:44:04.966298+0000","last_fullsized":"2024-09-14T12:44:04.966298+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:02.709768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":781,"num_read_kb":56952,"num_write":1264,"num_write_kb":28690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"267'803","reported_seq":2347,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.456789+0000","last_change":"2024-09-14T10:49:25.396880+0000","last_active":"2024-09-14T12:42:29.456789+0000","last_peered":"2024-09-14T12:42:29.456789+0000","last_clean":"2024-09-14T12:42:29.456789+0000","last_became_active":"2024-09-14T10:49:25.396001+0000","last_became_peered":"2024-09-14T10:49:25.396001+0000","last_unstale":"2024-09-14T12:42:29.456789+0000","last_undegraded":"2024-09-14T12:42:29.456789+0000","last_fullsized":"2024-09-14T12:42:29.456789+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:58.603959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3888,"num_read_kb":3489,"num_write":1086,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'386","reported_seq":1175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.876327+0000","last_change":"2024-09-14T10:49:23.387939+0000","last_active":"2024-09-14T12:44:04.876327+0000","last_peered":"2024-09-14T12:44:04.876327+0000","last_clean":"2024-09-14T12:44:04.876327+0000","last_became_active":"2024-09-14T10:49:23.387292+0000","last_became_peered":"2024-09-14T10:49:23.387292+0000","last_unstale":"2024-09-14T12:44:04.876327+0000","last_undegraded":"2024-09-14T12:44:04.876327+0000","last_fullsized":"2024-09-14T12:44:04.876327+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:32.221298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":721,"num_read_kb":37760,"num_write":1195,"num_write_kb":55114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'373","reported_seq":1802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.628580+0000","last_change":"2024-09-14T10:49:25.394672+0000","last_active":"2024-09-14T12:43:47.628580+0000","last_peered":"2024-09-14T12:43:47.628580+0000","last_clean":"2024-09-14T12:43:47.628580+0000","last_became_active":"2024-09-14T10:49:25.394106+0000","last_became_peered":"2024-09-14T10:49:25.394106+0000","last_unstale":"2024-09-14T12:43:47.628580+0000","last_undegraded":"2024-09-14T12:43:47.628580+0000","last_fullsized":"2024-09-14T12:43:47.628580+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:13.420566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2013,"num_read_kb":1909,"num_write":433,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'428","reported_seq":1101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.906154+0000","last_change":"2024-09-14T10:49:23.364844+0000","last_active":"2024-09-14T12:44:04.906154+0000","last_peered":"2024-09-14T12:44:04.906154+0000","last_clean":"2024-09-14T12:44:04.906154+0000","last_became_active":"2024-09-14T10:49:23.364035+0000","last_became_peered":"2024-09-14T10:49:23.364035+0000","last_unstale":"2024-09-14T12:44:04.906154+0000","last_undegraded":"2024-09-14T12:44:04.906154+0000","last_fullsized":"2024-09-14T12:44:04.906154+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:50.556342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":874,"num_read_kb":15225,"num_write":1232,"num_write_kb":26982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'779","reported_seq":2497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.206173+0000","last_change":"2024-09-14T10:49:25.372194+0000","last_active":"2024-09-14T12:42:22.206173+0000","last_peered":"2024-09-14T12:42:22.206173+0000","last_clean":"2024-09-14T12:42:22.206173+0000","last_became_active":"2024-09-14T10:49:25.371736+0000","last_became_peered":"2024-09-14T10:49:25.371736+0000","last_unstale":"2024-09-14T12:42:22.206173+0000","last_undegraded":"2024-09-14T12:42:22.206173+0000","last_fullsized":"2024-09-14T12:42:22.206173+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:00.150399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3876,"num_read_kb":3539,"num_write":1018,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'324","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.939860+0000","last_change":"2024-09-14T10:49:23.379017+0000","last_active":"2024-09-14T12:44:04.939860+0000","last_peered":"2024-09-14T12:44:04.939860+0000","last_clean":"2024-09-14T12:44:04.939860+0000","last_became_active":"2024-09-14T10:49:23.378269+0000","last_became_peered":"2024-09-14T10:49:23.378269+0000","last_unstale":"2024-09-14T12:44:04.939860+0000","last_undegraded":"2024-09-14T12:44:04.939860+0000","last_fullsized":"2024-09-14T12:44:04.939860+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:32.034490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":531,"num_read_kb":35954,"num_write":1090,"num_write_kb":39786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'141","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.101213+0000","last_change":"2024-09-14T10:49:33.465171+0000","last_active":"2024-09-14T12:42:32.101213+0000","last_peered":"2024-09-14T12:42:32.101213+0000","last_clean":"2024-09-14T12:42:32.101213+0000","last_became_active":"2024-09-14T10:49:33.464427+0000","last_became_peered":"2024-09-14T10:49:33.464427+0000","last_unstale":"2024-09-14T12:42:32.101213+0000","last_undegraded":"2024-09-14T12:42:32.101213+0000","last_fullsized":"2024-09-14T12:42:32.101213+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.777578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":140,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'434","reported_seq":2110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:46.558288+0000","last_change":"2024-09-14T10:49:25.381601+0000","last_active":"2024-09-14T12:41:46.558288+0000","last_peered":"2024-09-14T12:41:46.558288+0000","last_clean":"2024-09-14T12:41:46.558288+0000","last_became_active":"2024-09-14T10:49:25.379409+0000","last_became_peered":"2024-09-14T10:49:25.379409+0000","last_unstale":"2024-09-14T12:41:46.558288+0000","last_undegraded":"2024-09-14T12:41:46.558288+0000","last_fullsized":"2024-09-14T12:41:46.558288+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:45.958192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2548,"num_read_kb":2434,"num_write":516,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'355","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.901264+0000","last_change":"2024-09-14T10:49:23.366250+0000","last_active":"2024-09-14T12:44:04.901264+0000","last_peered":"2024-09-14T12:44:04.901264+0000","last_clean":"2024-09-14T12:44:04.901264+0000","last_became_active":"2024-09-14T10:49:23.365630+0000","last_became_peered":"2024-09-14T10:49:23.365630+0000","last_unstale":"2024-09-14T12:44:04.901264+0000","last_undegraded":"2024-09-14T12:44:04.901264+0000","last_fullsized":"2024-09-14T12:44:04.901264+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:00.413045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":11787,"num_write":1186,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485373+0000","last_change":"2024-09-14T10:49:27.388283+0000","last_active":"2024-09-14T12:40:41.485373+0000","last_peered":"2024-09-14T12:40:41.485373+0000","last_clean":"2024-09-14T12:40:41.485373+0000","last_became_active":"2024-09-14T10:49:27.387803+0000","last_became_peered":"2024-09-14T10:49:27.387803+0000","last_unstale":"2024-09-14T12:40:41.485373+0000","last_undegraded":"2024-09-14T12:40:41.485373+0000","last_fullsized":"2024-09-14T12:40:41.485373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:58.901691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'388","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.046144+0000","last_change":"2024-09-14T10:49:29.387542+0000","last_active":"2024-09-14T12:44:03.046144+0000","last_peered":"2024-09-14T12:44:03.046144+0000","last_clean":"2024-09-14T12:44:03.046144+0000","last_became_active":"2024-09-14T10:49:29.386799+0000","last_became_peered":"2024-09-14T10:49:29.386799+0000","last_unstale":"2024-09-14T12:44:03.046144+0000","last_undegraded":"2024-09-14T12:44:03.046144+0000","last_fullsized":"2024-09-14T12:44:03.046144+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.432275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":1248,"num_write":488,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550661+0000","last_change":"2024-09-14T10:49:31.408598+0000","last_active":"2024-09-14T12:40:45.550661+0000","last_peered":"2024-09-14T12:40:45.550661+0000","last_clean":"2024-09-14T12:40:45.550661+0000","last_became_active":"2024-09-14T10:49:31.407831+0000","last_became_peered":"2024-09-14T10:49:31.407831+0000","last_unstale":"2024-09-14T12:40:45.550661+0000","last_undegraded":"2024-09-14T12:40:45.550661+0000","last_fullsized":"2024-09-14T12:40:45.550661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:34.507742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'138","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:25.404481+0000","last_change":"2024-09-14T10:49:33.475510+0000","last_active":"2024-09-14T12:42:25.404481+0000","last_peered":"2024-09-14T12:42:25.404481+0000","last_clean":"2024-09-14T12:42:25.404481+0000","last_became_active":"2024-09-14T10:49:33.474458+0000","last_became_peered":"2024-09-14T10:49:33.474458+0000","last_unstale":"2024-09-14T12:42:25.404481+0000","last_undegraded":"2024-09-14T12:42:25.404481+0000","last_fullsized":"2024-09-14T12:42:25.404481+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:19.578114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":162,"num_write":341,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'692","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.618190+0000","last_change":"2024-09-14T10:49:25.378257+0000","last_active":"2024-09-14T12:43:47.618190+0000","last_peered":"2024-09-14T12:43:47.618190+0000","last_clean":"2024-09-14T12:43:47.618190+0000","last_became_active":"2024-09-14T10:49:25.375112+0000","last_became_peered":"2024-09-14T10:49:25.375112+0000","last_unstale":"2024-09-14T12:43:47.618190+0000","last_undegraded":"2024-09-14T12:43:47.618190+0000","last_fullsized":"2024-09-14T12:43:47.618190+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:16.262424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3284,"num_write":889,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'444","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.902763+0000","last_change":"2024-09-14T10:49:23.385621+0000","last_active":"2024-09-14T12:44:04.902763+0000","last_peered":"2024-09-14T12:44:04.902763+0000","last_clean":"2024-09-14T12:44:04.902763+0000","last_became_active":"2024-09-14T10:49:23.384801+0000","last_became_peered":"2024-09-14T10:49:23.384801+0000","last_unstale":"2024-09-14T12:44:04.902763+0000","last_undegraded":"2024-09-14T12:44:04.902763+0000","last_fullsized":"2024-09-14T12:44:04.902763+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:37.649524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":748,"num_read_kb":6714,"num_write":1308,"num_write_kb":31721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:40.557476+0000","last_change":"2024-09-14T10:49:27.379539+0000","last_active":"2024-09-14T12:39:40.557476+0000","last_peered":"2024-09-14T12:39:40.557476+0000","last_clean":"2024-09-14T12:39:40.557476+0000","last_became_active":"2024-09-14T10:49:27.378702+0000","last_became_peered":"2024-09-14T10:49:27.378702+0000","last_unstale":"2024-09-14T12:39:40.557476+0000","last_undegraded":"2024-09-14T12:39:40.557476+0000","last_fullsized":"2024-09-14T12:39:40.557476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:50.849295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'127","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549519+0000","last_change":"2024-09-14T10:49:29.398866+0000","last_active":"2024-09-14T12:40:40.549519+0000","last_peered":"2024-09-14T12:40:40.549519+0000","last_clean":"2024-09-14T12:40:40.549519+0000","last_became_active":"2024-09-14T10:49:29.398354+0000","last_became_peered":"2024-09-14T10:49:29.398354+0000","last_unstale":"2024-09-14T12:40:40.549519+0000","last_undegraded":"2024-09-14T12:40:40.549519+0000","last_fullsized":"2024-09-14T12:40:40.549519+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:55.441392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550575+0000","last_change":"2024-09-14T10:49:31.434144+0000","last_active":"2024-09-14T12:40:45.550575+0000","last_peered":"2024-09-14T12:40:45.550575+0000","last_clean":"2024-09-14T12:40:45.550575+0000","last_became_active":"2024-09-14T10:49:31.433431+0000","last_became_peered":"2024-09-14T10:49:31.433431+0000","last_unstale":"2024-09-14T12:40:45.550575+0000","last_undegraded":"2024-09-14T12:40:45.550575+0000","last_fullsized":"2024-09-14T12:40:45.550575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:01.989175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'115","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.484054+0000","last_change":"2024-09-14T10:49:33.463822+0000","last_active":"2024-09-14T12:39:44.484054+0000","last_peered":"2024-09-14T12:39:44.484054+0000","last_clean":"2024-09-14T12:39:44.484054+0000","last_became_active":"2024-09-14T10:49:33.463124+0000","last_became_peered":"2024-09-14T10:49:33.463124+0000","last_unstale":"2024-09-14T12:39:44.484054+0000","last_undegraded":"2024-09-14T12:39:44.484054+0000","last_fullsized":"2024-09-14T12:39:44.484054+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:53.103119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'851","reported_seq":2501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.772346+0000","last_change":"2024-09-14T10:49:25.389867+0000","last_active":"2024-09-14T12:42:31.772346+0000","last_peered":"2024-09-14T12:42:31.772346+0000","last_clean":"2024-09-14T12:42:31.772346+0000","last_became_active":"2024-09-14T10:49:25.385678+0000","last_became_peered":"2024-09-14T10:49:25.385678+0000","last_unstale":"2024-09-14T12:42:31.772346+0000","last_undegraded":"2024-09-14T12:42:31.772346+0000","last_fullsized":"2024-09-14T12:42:31.772346+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:25.356791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4238,"num_read_kb":3841,"num_write":1159,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'381","reported_seq":1277,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.957244+0000","last_change":"2024-09-14T10:49:23.372266+0000","last_active":"2024-09-14T12:44:04.957244+0000","last_peered":"2024-09-14T12:44:04.957244+0000","last_clean":"2024-09-14T12:44:04.957244+0000","last_became_active":"2024-09-14T10:49:23.371893+0000","last_became_peered":"2024-09-14T10:49:23.371893+0000","last_unstale":"2024-09-14T12:44:04.957244+0000","last_undegraded":"2024-09-14T12:44:04.957244+0000","last_fullsized":"2024-09-14T12:44:04.957244+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:31.260794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1366,"num_read_kb":59405,"num_write":1145,"num_write_kb":37706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.570738+0000","last_change":"2024-09-14T10:49:27.380154+0000","last_active":"2024-09-14T12:40:40.570738+0000","last_peered":"2024-09-14T12:40:40.570738+0000","last_clean":"2024-09-14T12:40:40.570738+0000","last_became_active":"2024-09-14T10:49:27.379355+0000","last_became_peered":"2024-09-14T10:49:27.379355+0000","last_unstale":"2024-09-14T12:40:40.570738+0000","last_undegraded":"2024-09-14T12:40:40.570738+0000","last_fullsized":"2024-09-14T12:40:40.570738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:52.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:15.371862+0000","last_change":"2024-09-14T10:49:29.387051+0000","last_active":"2024-09-14T12:40:15.371862+0000","last_peered":"2024-09-14T12:40:15.371862+0000","last_clean":"2024-09-14T12:40:15.371862+0000","last_became_active":"2024-09-14T10:49:29.386264+0000","last_became_peered":"2024-09-14T10:49:29.386264+0000","last_unstale":"2024-09-14T12:40:15.371862+0000","last_undegraded":"2024-09-14T12:40:15.371862+0000","last_fullsized":"2024-09-14T12:40:15.371862+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:32.852231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'810","reported_seq":3021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.149377+0000","last_change":"2024-09-14T10:49:31.432319+0000","last_active":"2024-09-14T12:44:02.149377+0000","last_peered":"2024-09-14T12:44:02.149377+0000","last_clean":"2024-09-14T12:44:02.149377+0000","last_became_active":"2024-09-14T10:49:31.431702+0000","last_became_peered":"2024-09-14T10:49:31.431702+0000","last_unstale":"2024-09-14T12:44:02.149377+0000","last_undegraded":"2024-09-14T12:44:02.149377+0000","last_fullsized":"2024-09-14T12:44:02.149377+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:52.750405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'216","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.705477+0000","last_change":"2024-09-14T10:49:33.473107+0000","last_active":"2024-09-14T12:42:29.705477+0000","last_peered":"2024-09-14T12:42:29.705477+0000","last_clean":"2024-09-14T12:42:29.705477+0000","last_became_active":"2024-09-14T10:49:33.472433+0000","last_became_peered":"2024-09-14T10:49:33.472433+0000","last_unstale":"2024-09-14T12:42:29.705477+0000","last_undegraded":"2024-09-14T12:42:29.705477+0000","last_fullsized":"2024-09-14T12:42:29.705477+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":612,"num_write":471,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'451","reported_seq":2012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559941+0000","last_change":"2024-09-14T10:49:25.398553+0000","last_active":"2024-09-14T12:40:35.559941+0000","last_peered":"2024-09-14T12:40:35.559941+0000","last_clean":"2024-09-14T12:40:35.559941+0000","last_became_active":"2024-09-14T10:49:25.395255+0000","last_became_peered":"2024-09-14T10:49:25.395255+0000","last_unstale":"2024-09-14T12:40:35.559941+0000","last_undegraded":"2024-09-14T12:40:35.559941+0000","last_fullsized":"2024-09-14T12:40:35.559941+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:50.419167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2444,"num_read_kb":2309,"num_write":533,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'370","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.867754+0000","last_change":"2024-09-14T10:49:23.403490+0000","last_active":"2024-09-14T12:44:04.867754+0000","last_peered":"2024-09-14T12:44:04.867754+0000","last_clean":"2024-09-14T12:44:04.867754+0000","last_became_active":"2024-09-14T10:49:23.403079+0000","last_became_peered":"2024-09-14T10:49:23.403079+0000","last_unstale":"2024-09-14T12:44:04.867754+0000","last_undegraded":"2024-09-14T12:44:04.867754+0000","last_fullsized":"2024-09-14T12:44:04.867754+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:43.895377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":46335,"num_write":1122,"num_write_kb":49327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485445+0000","last_change":"2024-09-14T10:49:27.392398+0000","last_active":"2024-09-14T12:40:41.485445+0000","last_peered":"2024-09-14T12:40:41.485445+0000","last_clean":"2024-09-14T12:40:41.485445+0000","last_became_active":"2024-09-14T10:49:27.391823+0000","last_became_peered":"2024-09-14T10:49:27.391823+0000","last_unstale":"2024-09-14T12:40:41.485445+0000","last_undegraded":"2024-09-14T12:40:41.485445+0000","last_fullsized":"2024-09-14T12:40:41.485445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:59.037074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'325","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.122893+0000","last_change":"2024-09-14T10:49:29.385602+0000","last_active":"2024-09-14T12:44:02.122893+0000","last_peered":"2024-09-14T12:44:02.122893+0000","last_clean":"2024-09-14T12:44:02.122893+0000","last_became_active":"2024-09-14T10:49:29.385023+0000","last_became_peered":"2024-09-14T10:49:29.385023+0000","last_unstale":"2024-09-14T12:44:02.122893+0000","last_undegraded":"2024-09-14T12:44:02.122893+0000","last_fullsized":"2024-09-14T12:44:02.122893+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:43.706717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":526,"num_read_kb":1146,"num_write":424,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'827","reported_seq":5660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.998749+0000","last_change":"2024-09-14T10:49:31.425706+0000","last_active":"2024-09-14T12:44:04.998749+0000","last_peered":"2024-09-14T12:44:04.998749+0000","last_clean":"2024-09-14T12:44:04.998749+0000","last_became_active":"2024-09-14T10:49:31.424873+0000","last_became_peered":"2024-09-14T10:49:31.424873+0000","last_unstale":"2024-09-14T12:44:04.998749+0000","last_undegraded":"2024-09-14T12:44:04.998749+0000","last_fullsized":"2024-09-14T12:44:04.998749+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:39.590615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'493","reported_seq":2117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.788525+0000","last_change":"2024-09-14T10:49:25.373828+0000","last_active":"2024-09-14T12:41:16.788525+0000","last_peered":"2024-09-14T12:41:16.788525+0000","last_clean":"2024-09-14T12:41:16.788525+0000","last_became_active":"2024-09-14T10:49:25.372711+0000","last_became_peered":"2024-09-14T10:49:25.372711+0000","last_unstale":"2024-09-14T12:41:16.788525+0000","last_undegraded":"2024-09-14T12:41:16.788525+0000","last_fullsized":"2024-09-14T12:41:16.788525+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:46.395982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2694,"num_read_kb":2523,"num_write":626,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'395","reported_seq":1121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.942113+0000","last_change":"2024-09-14T10:49:23.363597+0000","last_active":"2024-09-14T12:44:04.942113+0000","last_peered":"2024-09-14T12:44:04.942113+0000","last_clean":"2024-09-14T12:44:04.942113+0000","last_became_active":"2024-09-14T10:49:23.363126+0000","last_became_peered":"2024-09-14T10:49:23.363126+0000","last_unstale":"2024-09-14T12:44:04.942113+0000","last_undegraded":"2024-09-14T12:44:04.942113+0000","last_fullsized":"2024-09-14T12:44:04.942113+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:44.328445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":10241,"num_write":1214,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:00.540062+0000","last_change":"2024-09-14T10:49:27.382040+0000","last_active":"2024-09-14T12:40:00.540062+0000","last_peered":"2024-09-14T12:40:00.540062+0000","last_clean":"2024-09-14T12:40:00.540062+0000","last_became_active":"2024-09-14T10:49:27.380063+0000","last_became_peered":"2024-09-14T10:49:27.380063+0000","last_unstale":"2024-09-14T12:40:00.540062+0000","last_undegraded":"2024-09-14T12:40:00.540062+0000","last_fullsized":"2024-09-14T12:40:00.540062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:23.504934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'442","reported_seq":1147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.408514+0000","last_change":"2024-09-14T10:49:29.383878+0000","last_active":"2024-09-14T12:44:03.408514+0000","last_peered":"2024-09-14T12:44:03.408514+0000","last_clean":"2024-09-14T12:44:03.408514+0000","last_became_active":"2024-09-14T10:49:29.383306+0000","last_became_peered":"2024-09-14T10:49:29.383306+0000","last_unstale":"2024-09-14T12:44:03.408514+0000","last_undegraded":"2024-09-14T12:44:03.408514+0000","last_fullsized":"2024-09-14T12:44:03.408514+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:17.145956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48183,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":712,"num_read_kb":1289,"num_write":532,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532617+0000","last_change":"2024-09-14T10:49:31.407042+0000","last_active":"2024-09-14T12:39:51.532617+0000","last_peered":"2024-09-14T12:39:51.532617+0000","last_clean":"2024-09-14T12:39:51.532617+0000","last_became_active":"2024-09-14T10:49:31.406293+0000","last_became_peered":"2024-09-14T10:49:31.406293+0000","last_unstale":"2024-09-14T12:39:51.532617+0000","last_undegraded":"2024-09-14T12:39:51.532617+0000","last_fullsized":"2024-09-14T12:39:51.532617+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:15.969086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'561","reported_seq":1444,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.641698+0000","last_change":"2024-09-14T10:49:33.475077+0000","last_active":"2024-09-14T12:43:48.641698+0000","last_peered":"2024-09-14T12:43:48.641698+0000","last_clean":"2024-09-14T12:43:48.641698+0000","last_became_active":"2024-09-14T10:49:33.474412+0000","last_became_peered":"2024-09-14T10:49:33.474412+0000","last_unstale":"2024-09-14T12:43:48.641698+0000","last_undegraded":"2024-09-14T12:43:48.641698+0000","last_fullsized":"2024-09-14T12:43:48.641698+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:52.098600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1493,"num_read_kb":1442,"num_write":1188,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'446","reported_seq":2088,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538801+0000","last_change":"2024-09-14T10:49:25.405914+0000","last_active":"2024-09-14T12:39:55.538801+0000","last_peered":"2024-09-14T12:39:55.538801+0000","last_clean":"2024-09-14T12:39:55.538801+0000","last_became_active":"2024-09-14T10:49:25.405499+0000","last_became_peered":"2024-09-14T10:49:25.405499+0000","last_unstale":"2024-09-14T12:39:55.538801+0000","last_undegraded":"2024-09-14T12:39:55.538801+0000","last_fullsized":"2024-09-14T12:39:55.538801+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:54.507625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2382,"num_write":513,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'382","reported_seq":1058,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.886255+0000","last_change":"2024-09-14T10:49:23.403913+0000","last_active":"2024-09-14T12:44:04.886255+0000","last_peered":"2024-09-14T12:44:04.886255+0000","last_clean":"2024-09-14T12:44:04.886255+0000","last_became_active":"2024-09-14T10:49:23.403551+0000","last_became_peered":"2024-09-14T10:49:23.403551+0000","last_unstale":"2024-09-14T12:44:04.886255+0000","last_undegraded":"2024-09-14T12:44:04.886255+0000","last_fullsized":"2024-09-14T12:44:04.886255+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:47.233133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":687,"num_read_kb":10639,"num_write":1239,"num_write_kb":29906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.535230+0000","last_change":"2024-09-14T10:49:27.373230+0000","last_active":"2024-09-14T12:40:01.535230+0000","last_peered":"2024-09-14T12:40:01.535230+0000","last_clean":"2024-09-14T12:40:01.535230+0000","last_became_active":"2024-09-14T10:49:27.372510+0000","last_became_peered":"2024-09-14T10:49:27.372510+0000","last_unstale":"2024-09-14T12:40:01.535230+0000","last_undegraded":"2024-09-14T12:40:01.535230+0000","last_fullsized":"2024-09-14T12:40:01.535230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:58.625869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'304","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.471287+0000","last_change":"2024-09-14T10:49:29.378472+0000","last_active":"2024-09-14T12:44:04.471287+0000","last_peered":"2024-09-14T12:44:04.471287+0000","last_clean":"2024-09-14T12:44:04.471287+0000","last_became_active":"2024-09-14T10:49:29.377710+0000","last_became_peered":"2024-09-14T10:49:29.377710+0000","last_unstale":"2024-09-14T12:44:04.471287+0000","last_undegraded":"2024-09-14T12:44:04.471287+0000","last_fullsized":"2024-09-14T12:44:04.471287+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:54.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45337,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1057,"num_write":388,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569489+0000","last_change":"2024-09-14T10:49:31.413000+0000","last_active":"2024-09-14T12:40:35.569489+0000","last_peered":"2024-09-14T12:40:35.569489+0000","last_clean":"2024-09-14T12:40:35.569489+0000","last_became_active":"2024-09-14T10:49:31.412080+0000","last_became_peered":"2024-09-14T10:49:31.412080+0000","last_unstale":"2024-09-14T12:40:35.569489+0000","last_undegraded":"2024-09-14T12:40:35.569489+0000","last_fullsized":"2024-09-14T12:40:35.569489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.692991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2528","reported_seq":4388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.576044+0000","last_change":"2024-09-14T10:49:33.479265+0000","last_active":"2024-09-14T12:42:30.576044+0000","last_peered":"2024-09-14T12:42:30.576044+0000","last_clean":"2024-09-14T12:42:30.576044+0000","last_became_active":"2024-09-14T10:49:33.478542+0000","last_became_peered":"2024-09-14T10:49:33.478542+0000","last_unstale":"2024-09-14T12:42:30.576044+0000","last_undegraded":"2024-09-14T12:42:30.576044+0000","last_fullsized":"2024-09-14T12:42:30.576044+0000","mapping_epoch":36,"log_start":"267'2500","ondisk_log_start":"267'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:52.785039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6246,"num_read_kb":6243,"num_write":5128,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'497","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.824180+0000","last_change":"2024-09-14T10:49:25.381367+0000","last_active":"2024-09-14T12:41:11.824180+0000","last_peered":"2024-09-14T12:41:11.824180+0000","last_clean":"2024-09-14T12:41:11.824180+0000","last_became_active":"2024-09-14T10:49:25.380967+0000","last_became_peered":"2024-09-14T10:49:25.380967+0000","last_unstale":"2024-09-14T12:41:11.824180+0000","last_undegraded":"2024-09-14T12:41:11.824180+0000","last_fullsized":"2024-09-14T12:41:11.824180+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:55.558427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2697,"num_read_kb":2531,"num_write":585,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'361","reported_seq":1000,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.963492+0000","last_change":"2024-09-14T10:49:23.356775+0000","last_active":"2024-09-14T12:44:04.963492+0000","last_peered":"2024-09-14T12:44:04.963492+0000","last_clean":"2024-09-14T12:44:04.963492+0000","last_became_active":"2024-09-14T10:49:23.355809+0000","last_became_peered":"2024-09-14T10:49:23.355809+0000","last_unstale":"2024-09-14T12:44:04.963492+0000","last_undegraded":"2024-09-14T12:44:04.963492+0000","last_fullsized":"2024-09-14T12:44:04.963492+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:13.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":12441,"num_write":1183,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:45.547722+0000","last_change":"2024-09-14T10:49:27.379127+0000","last_active":"2024-09-14T12:39:45.547722+0000","last_peered":"2024-09-14T12:39:45.547722+0000","last_clean":"2024-09-14T12:39:45.547722+0000","last_became_active":"2024-09-14T10:49:27.378028+0000","last_became_peered":"2024-09-14T10:49:27.378028+0000","last_unstale":"2024-09-14T12:39:45.547722+0000","last_undegraded":"2024-09-14T12:39:45.547722+0000","last_fullsized":"2024-09-14T12:39:45.547722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:49.172785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'399","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.594539+0000","last_change":"2024-09-14T10:49:29.389462+0000","last_active":"2024-09-14T12:44:03.594539+0000","last_peered":"2024-09-14T12:44:03.594539+0000","last_clean":"2024-09-14T12:44:03.594539+0000","last_became_active":"2024-09-14T10:49:29.388786+0000","last_became_peered":"2024-09-14T10:49:29.388786+0000","last_unstale":"2024-09-14T12:44:03.594539+0000","last_undegraded":"2024-09-14T12:44:03.594539+0000","last_fullsized":"2024-09-14T12:44:03.594539+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:53.840769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53040,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":1302,"num_write":504,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'826","reported_seq":3421,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.999537+0000","last_change":"2024-09-14T10:49:31.420988+0000","last_active":"2024-09-14T12:44:04.999537+0000","last_peered":"2024-09-14T12:44:04.999537+0000","last_clean":"2024-09-14T12:44:04.999537+0000","last_became_active":"2024-09-14T10:49:31.420178+0000","last_became_peered":"2024-09-14T10:49:31.420178+0000","last_unstale":"2024-09-14T12:44:04.999537+0000","last_undegraded":"2024-09-14T12:44:04.999537+0000","last_fullsized":"2024-09-14T12:44:04.999537+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:41.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'144","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.388041+0000","last_change":"2024-09-14T10:49:33.463351+0000","last_active":"2024-09-14T12:43:47.388041+0000","last_peered":"2024-09-14T12:43:47.388041+0000","last_clean":"2024-09-14T12:43:47.388041+0000","last_became_active":"2024-09-14T10:49:33.462780+0000","last_became_peered":"2024-09-14T10:49:33.462780+0000","last_unstale":"2024-09-14T12:43:47.388041+0000","last_undegraded":"2024-09-14T12:43:47.388041+0000","last_fullsized":"2024-09-14T12:43:47.388041+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:58.346452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'836","reported_seq":2438,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.687173+0000","last_change":"2024-09-14T10:49:25.391283+0000","last_active":"2024-09-14T12:43:47.687173+0000","last_peered":"2024-09-14T12:43:47.687173+0000","last_clean":"2024-09-14T12:43:47.687173+0000","last_became_active":"2024-09-14T10:49:25.389567+0000","last_became_peered":"2024-09-14T10:49:25.389567+0000","last_unstale":"2024-09-14T12:43:47.687173+0000","last_undegraded":"2024-09-14T12:43:47.687173+0000","last_fullsized":"2024-09-14T12:43:47.687173+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:34.685545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4051,"num_read_kb":3641,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'382","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.406612+0000","last_change":"2024-09-14T12:44:09.406557+0000","last_active":"2024-09-14T12:44:09.406612+0000","last_peered":"2024-09-14T12:44:09.406612+0000","last_clean":"2024-09-14T12:44:09.406612+0000","last_became_active":"2024-09-14T10:49:23.354452+0000","last_became_peered":"2024-09-14T10:49:23.354452+0000","last_unstale":"2024-09-14T12:44:09.406612+0000","last_undegraded":"2024-09-14T12:44:09.406612+0000","last_fullsized":"2024-09-14T12:44:09.406612+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.406462+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:33.958379+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":20994,"num_write":1147,"num_write_kb":31512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:21.539587+0000","last_change":"2024-09-14T10:49:27.354654+0000","last_active":"2024-09-14T12:40:21.539587+0000","last_peered":"2024-09-14T12:40:21.539587+0000","last_clean":"2024-09-14T12:40:21.539587+0000","last_became_active":"2024-09-14T10:49:27.353932+0000","last_became_peered":"2024-09-14T10:49:27.353932+0000","last_unstale":"2024-09-14T12:40:21.539587+0000","last_undegraded":"2024-09-14T12:40:21.539587+0000","last_fullsized":"2024-09-14T12:40:21.539587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:21.532896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'498","reported_seq":1181,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.708181+0000","last_change":"2024-09-14T10:49:29.379743+0000","last_active":"2024-09-14T12:44:04.708181+0000","last_peered":"2024-09-14T12:44:04.708181+0000","last_clean":"2024-09-14T12:44:04.708181+0000","last_became_active":"2024-09-14T10:49:29.378107+0000","last_became_peered":"2024-09-14T10:49:29.378107+0000","last_unstale":"2024-09-14T12:44:04.708181+0000","last_undegraded":"2024-09-14T12:44:04.708181+0000","last_fullsized":"2024-09-14T12:44:04.708181+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:49.708518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89831,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":1885,"num_write":676,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:05.552752+0000","last_change":"2024-09-14T10:49:31.410161+0000","last_active":"2024-09-14T12:40:05.552752+0000","last_peered":"2024-09-14T12:40:05.552752+0000","last_clean":"2024-09-14T12:40:05.552752+0000","last_became_active":"2024-09-14T10:49:31.409247+0000","last_became_peered":"2024-09-14T10:49:31.409247+0000","last_unstale":"2024-09-14T12:40:05.552752+0000","last_undegraded":"2024-09-14T12:40:05.552752+0000","last_fullsized":"2024-09-14T12:40:05.552752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:49.593404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'132","reported_seq":677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:14.764993+0000","last_change":"2024-09-14T10:49:33.462318+0000","last_active":"2024-09-14T12:42:14.764993+0000","last_peered":"2024-09-14T12:42:14.764993+0000","last_clean":"2024-09-14T12:42:14.764993+0000","last_became_active":"2024-09-14T10:49:33.461635+0000","last_became_peered":"2024-09-14T10:49:33.461635+0000","last_unstale":"2024-09-14T12:42:14.764993+0000","last_undegraded":"2024-09-14T12:42:14.764993+0000","last_fullsized":"2024-09-14T12:42:14.764993+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:57.796265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":314,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'839","reported_seq":2532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.687714+0000","last_change":"2024-09-14T10:49:25.361656+0000","last_active":"2024-09-14T12:43:47.687714+0000","last_peered":"2024-09-14T12:43:47.687714+0000","last_clean":"2024-09-14T12:43:47.687714+0000","last_became_active":"2024-09-14T10:49:25.361148+0000","last_became_peered":"2024-09-14T10:49:25.361148+0000","last_unstale":"2024-09-14T12:43:47.687714+0000","last_undegraded":"2024-09-14T12:43:47.687714+0000","last_fullsized":"2024-09-14T12:43:47.687714+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4070,"num_read_kb":3684,"num_write":1107,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'346","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.952158+0000","last_change":"2024-09-14T10:49:23.375908+0000","last_active":"2024-09-14T12:44:04.952158+0000","last_peered":"2024-09-14T12:44:04.952158+0000","last_clean":"2024-09-14T12:44:04.952158+0000","last_became_active":"2024-09-14T10:49:23.375005+0000","last_became_peered":"2024-09-14T10:49:23.375005+0000","last_unstale":"2024-09-14T12:44:04.952158+0000","last_undegraded":"2024-09-14T12:44:04.952158+0000","last_fullsized":"2024-09-14T12:44:04.952158+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:45.791369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":716,"num_read_kb":12064,"num_write":1099,"num_write_kb":35066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.730652+0000","last_change":"2024-09-14T10:49:27.386488+0000","last_active":"2024-09-14T12:39:44.730652+0000","last_peered":"2024-09-14T12:39:44.730652+0000","last_clean":"2024-09-14T12:39:44.730652+0000","last_became_active":"2024-09-14T10:49:27.385658+0000","last_became_peered":"2024-09-14T10:49:27.385658+0000","last_unstale":"2024-09-14T12:39:44.730652+0000","last_undegraded":"2024-09-14T12:39:44.730652+0000","last_fullsized":"2024-09-14T12:39:44.730652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:00.744114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'367","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.784034+0000","last_change":"2024-09-14T10:49:29.391486+0000","last_active":"2024-09-14T12:44:04.784034+0000","last_peered":"2024-09-14T12:44:04.784034+0000","last_clean":"2024-09-14T12:44:04.784034+0000","last_became_active":"2024-09-14T10:49:29.388618+0000","last_became_peered":"2024-09-14T10:49:29.388618+0000","last_unstale":"2024-09-14T12:44:04.784034+0000","last_undegraded":"2024-09-14T12:44:04.784034+0000","last_fullsized":"2024-09-14T12:44:04.784034+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:27.307665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53436,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":1275,"num_write":534,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:09.736444+0000","last_change":"2024-09-14T10:49:31.418529+0000","last_active":"2024-09-14T12:40:09.736444+0000","last_peered":"2024-09-14T12:40:09.736444+0000","last_clean":"2024-09-14T12:40:09.736444+0000","last_became_active":"2024-09-14T10:49:31.417797+0000","last_became_peered":"2024-09-14T10:49:31.417797+0000","last_unstale":"2024-09-14T12:40:09.736444+0000","last_undegraded":"2024-09-14T12:40:09.736444+0000","last_fullsized":"2024-09-14T12:40:09.736444+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:56.573341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'113","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:36.096922+0000","last_change":"2024-09-14T10:49:33.455868+0000","last_active":"2024-09-14T12:43:36.096922+0000","last_peered":"2024-09-14T12:43:36.096922+0000","last_clean":"2024-09-14T12:43:36.096922+0000","last_became_active":"2024-09-14T10:49:33.455162+0000","last_became_peered":"2024-09-14T10:49:33.455162+0000","last_unstale":"2024-09-14T12:43:36.096922+0000","last_undegraded":"2024-09-14T12:43:36.096922+0000","last_fullsized":"2024-09-14T12:43:36.096922+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:42.886276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'587","reported_seq":2424,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:57.861667+0000","last_change":"2024-09-14T10:49:25.378821+0000","last_active":"2024-09-14T12:39:57.861667+0000","last_peered":"2024-09-14T12:39:57.861667+0000","last_clean":"2024-09-14T12:39:57.861667+0000","last_became_active":"2024-09-14T10:49:25.377866+0000","last_became_peered":"2024-09-14T10:49:25.377866+0000","last_unstale":"2024-09-14T12:39:57.861667+0000","last_undegraded":"2024-09-14T12:39:57.861667+0000","last_fullsized":"2024-09-14T12:39:57.861667+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:16.585676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3293,"num_read_kb":3082,"num_write":722,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'319","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.951495+0000","last_change":"2024-09-14T10:49:23.362931+0000","last_active":"2024-09-14T12:44:04.951495+0000","last_peered":"2024-09-14T12:44:04.951495+0000","last_clean":"2024-09-14T12:44:04.951495+0000","last_became_active":"2024-09-14T10:49:23.362203+0000","last_became_peered":"2024-09-14T10:49:23.362203+0000","last_unstale":"2024-09-14T12:44:04.951495+0000","last_undegraded":"2024-09-14T12:44:04.951495+0000","last_fullsized":"2024-09-14T12:44:04.951495+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:22.083961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":29276,"num_write":1000,"num_write_kb":13260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:45.547789+0000","last_change":"2024-09-14T10:49:27.378611+0000","last_active":"2024-09-14T12:39:45.547789+0000","last_peered":"2024-09-14T12:39:45.547789+0000","last_clean":"2024-09-14T12:39:45.547789+0000","last_became_active":"2024-09-14T10:49:27.377674+0000","last_became_peered":"2024-09-14T10:49:27.377674+0000","last_unstale":"2024-09-14T12:39:45.547789+0000","last_undegraded":"2024-09-14T12:39:45.547789+0000","last_fullsized":"2024-09-14T12:39:45.547789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:20.096097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'396","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.238169+0000","last_change":"2024-09-14T10:49:29.394103+0000","last_active":"2024-09-14T12:44:04.238169+0000","last_peered":"2024-09-14T12:44:04.238169+0000","last_clean":"2024-09-14T12:44:04.238169+0000","last_became_active":"2024-09-14T10:49:29.393350+0000","last_became_peered":"2024-09-14T10:49:29.393350+0000","last_unstale":"2024-09-14T12:44:04.238169+0000","last_undegraded":"2024-09-14T12:44:04.238169+0000","last_fullsized":"2024-09-14T12:44:04.238169+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.411758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50275,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":654,"num_read_kb":1334,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'794","reported_seq":5226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.182605+0000","last_change":"2024-09-14T10:49:31.423468+0000","last_active":"2024-09-14T12:44:04.182605+0000","last_peered":"2024-09-14T12:44:04.182605+0000","last_clean":"2024-09-14T12:44:04.182605+0000","last_became_active":"2024-09-14T10:49:31.422534+0000","last_became_peered":"2024-09-14T10:49:31.422534+0000","last_unstale":"2024-09-14T12:44:04.182605+0000","last_undegraded":"2024-09-14T12:44:04.182605+0000","last_fullsized":"2024-09-14T12:44:04.182605+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:58.304373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'158","reported_seq":729,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.415473+0000","last_change":"2024-09-14T10:49:33.466535+0000","last_active":"2024-09-14T12:42:29.415473+0000","last_peered":"2024-09-14T12:42:29.415473+0000","last_clean":"2024-09-14T12:42:29.415473+0000","last_became_active":"2024-09-14T10:49:33.466024+0000","last_became_peered":"2024-09-14T10:49:33.466024+0000","last_unstale":"2024-09-14T12:42:29.415473+0000","last_undegraded":"2024-09-14T12:42:29.415473+0000","last_fullsized":"2024-09-14T12:42:29.415473+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:24.127809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":335,"num_read_kb":285,"num_write":383,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'671","reported_seq":2389,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.135328+0000","last_change":"2024-09-14T10:49:25.381139+0000","last_active":"2024-09-14T12:42:22.135328+0000","last_peered":"2024-09-14T12:42:22.135328+0000","last_clean":"2024-09-14T12:42:22.135328+0000","last_became_active":"2024-09-14T10:49:25.380712+0000","last_became_peered":"2024-09-14T10:49:25.380712+0000","last_unstale":"2024-09-14T12:42:22.135328+0000","last_undegraded":"2024-09-14T12:42:22.135328+0000","last_fullsized":"2024-09-14T12:42:22.135328+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:50.719358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3719,"num_read_kb":3469,"num_write":935,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'349","reported_seq":1042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.934048+0000","last_change":"2024-09-14T10:49:23.367590+0000","last_active":"2024-09-14T12:44:04.934048+0000","last_peered":"2024-09-14T12:44:04.934048+0000","last_clean":"2024-09-14T12:44:04.934048+0000","last_became_active":"2024-09-14T10:49:23.367200+0000","last_became_peered":"2024-09-14T10:49:23.367200+0000","last_unstale":"2024-09-14T12:44:04.934048+0000","last_undegraded":"2024-09-14T12:44:04.934048+0000","last_fullsized":"2024-09-14T12:44:04.934048+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:06.469171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":77246,"num_write":1147,"num_write_kb":38780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.234964+0000","last_change":"2024-09-14T10:49:27.380444+0000","last_active":"2024-09-14T12:44:01.234964+0000","last_peered":"2024-09-14T12:44:01.234964+0000","last_clean":"2024-09-14T12:44:01.234964+0000","last_became_active":"2024-09-14T10:49:27.379952+0000","last_became_peered":"2024-09-14T10:49:27.379952+0000","last_unstale":"2024-09-14T12:44:01.234964+0000","last_undegraded":"2024-09-14T12:44:01.234964+0000","last_fullsized":"2024-09-14T12:44:01.234964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:22.468850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'141","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561715+0000","last_change":"2024-09-14T10:49:29.373528+0000","last_active":"2024-09-14T12:42:01.561715+0000","last_peered":"2024-09-14T12:42:01.561715+0000","last_clean":"2024-09-14T12:42:01.561715+0000","last_became_active":"2024-09-14T10:49:29.371803+0000","last_became_peered":"2024-09-14T10:49:29.371803+0000","last_unstale":"2024-09-14T12:42:01.561715+0000","last_undegraded":"2024-09-14T12:42:01.561715+0000","last_fullsized":"2024-09-14T12:42:01.561715+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:44.432155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'797","reported_seq":3146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.447458+0000","last_change":"2024-09-14T10:49:31.427780+0000","last_active":"2024-09-14T12:44:03.447458+0000","last_peered":"2024-09-14T12:44:03.447458+0000","last_clean":"2024-09-14T12:44:03.447458+0000","last_became_active":"2024-09-14T10:49:31.427179+0000","last_became_peered":"2024-09-14T10:49:31.427179+0000","last_unstale":"2024-09-14T12:44:03.447458+0000","last_undegraded":"2024-09-14T12:44:03.447458+0000","last_fullsized":"2024-09-14T12:44:03.447458+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:38.189084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'134","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:28.826359+0000","last_change":"2024-09-14T10:49:33.471795+0000","last_active":"2024-09-14T12:42:28.826359+0000","last_peered":"2024-09-14T12:42:28.826359+0000","last_clean":"2024-09-14T12:42:28.826359+0000","last_became_active":"2024-09-14T10:49:33.468831+0000","last_became_peered":"2024-09-14T10:49:33.468831+0000","last_unstale":"2024-09-14T12:42:28.826359+0000","last_undegraded":"2024-09-14T12:42:28.826359+0000","last_fullsized":"2024-09-14T12:42:28.826359+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:46.840813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":148,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'487","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.736832+0000","last_change":"2024-09-14T10:49:25.371388+0000","last_active":"2024-09-14T12:41:23.736832+0000","last_peered":"2024-09-14T12:41:23.736832+0000","last_clean":"2024-09-14T12:41:23.736832+0000","last_became_active":"2024-09-14T10:49:25.370649+0000","last_became_peered":"2024-09-14T10:49:25.370649+0000","last_unstale":"2024-09-14T12:41:23.736832+0000","last_undegraded":"2024-09-14T12:41:23.736832+0000","last_fullsized":"2024-09-14T12:41:23.736832+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:54.984697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2839,"num_read_kb":2682,"num_write":610,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'390","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.981011+0000","last_change":"2024-09-14T10:49:23.359479+0000","last_active":"2024-09-14T12:44:04.981011+0000","last_peered":"2024-09-14T12:44:04.981011+0000","last_clean":"2024-09-14T12:44:04.981011+0000","last_became_active":"2024-09-14T10:49:23.355864+0000","last_became_peered":"2024-09-14T10:49:23.355864+0000","last_unstale":"2024-09-14T12:44:04.981011+0000","last_undegraded":"2024-09-14T12:44:04.981011+0000","last_fullsized":"2024-09-14T12:44:04.981011+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:44.897414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":100725,"num_write":1103,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:46.471497+0000","last_change":"2024-09-14T10:49:27.391003+0000","last_active":"2024-09-14T12:39:46.471497+0000","last_peered":"2024-09-14T12:39:46.471497+0000","last_clean":"2024-09-14T12:39:46.471497+0000","last_became_active":"2024-09-14T10:49:27.390169+0000","last_became_peered":"2024-09-14T10:49:27.390169+0000","last_unstale":"2024-09-14T12:39:46.471497+0000","last_undegraded":"2024-09-14T12:39:46.471497+0000","last_fullsized":"2024-09-14T12:39:46.471497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:41.899346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'419","reported_seq":1103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.136008+0000","last_change":"2024-09-14T10:49:29.401131+0000","last_active":"2024-09-14T12:44:03.136008+0000","last_peered":"2024-09-14T12:44:03.136008+0000","last_clean":"2024-09-14T12:44:03.136008+0000","last_became_active":"2024-09-14T10:49:29.400776+0000","last_became_peered":"2024-09-14T10:49:29.400776+0000","last_unstale":"2024-09-14T12:44:03.136008+0000","last_undegraded":"2024-09-14T12:44:03.136008+0000","last_fullsized":"2024-09-14T12:44:03.136008+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:04.011436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1253,"num_write":514,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140700+0000","last_change":"2024-09-14T10:49:31.421446+0000","last_active":"2024-09-14T12:39:51.140700+0000","last_peered":"2024-09-14T12:39:51.140700+0000","last_clean":"2024-09-14T12:39:51.140700+0000","last_became_active":"2024-09-14T10:49:31.418131+0000","last_became_peered":"2024-09-14T10:49:31.418131+0000","last_unstale":"2024-09-14T12:39:51.140700+0000","last_undegraded":"2024-09-14T12:39:51.140700+0000","last_fullsized":"2024-09-14T12:39:51.140700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:15.418822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'138","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.744011+0000","last_change":"2024-09-14T10:49:33.457926+0000","last_active":"2024-09-14T12:42:31.744011+0000","last_peered":"2024-09-14T12:42:31.744011+0000","last_clean":"2024-09-14T12:42:31.744011+0000","last_became_active":"2024-09-14T10:49:33.455953+0000","last_became_peered":"2024-09-14T10:49:33.455953+0000","last_unstale":"2024-09-14T12:42:31.744011+0000","last_undegraded":"2024-09-14T12:42:31.744011+0000","last_fullsized":"2024-09-14T12:42:31.744011+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:50.433913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":155,"num_write":340,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'412","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.340214+0000","last_change":"2024-09-14T10:49:25.378560+0000","last_active":"2024-09-14T12:40:40.340214+0000","last_peered":"2024-09-14T12:40:40.340214+0000","last_clean":"2024-09-14T12:40:40.340214+0000","last_became_active":"2024-09-14T10:49:25.377841+0000","last_became_peered":"2024-09-14T10:49:25.377841+0000","last_unstale":"2024-09-14T12:40:40.340214+0000","last_undegraded":"2024-09-14T12:40:40.340214+0000","last_fullsized":"2024-09-14T12:40:40.340214+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:34.685545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2397,"num_read_kb":2304,"num_write":471,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.886990+0000","last_change":"2024-09-14T12:44:09.886990+0000","last_active":"2024-09-14T12:44:09.886990+0000","last_peered":"2024-09-14T12:44:09.886990+0000","last_clean":"2024-09-14T12:44:09.886990+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T12:44:09.886990+0000","last_undegraded":"2024-09-14T12:44:09.886990+0000","last_fullsized":"2024-09-14T12:44:09.886990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.886874+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:32.555870+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500441+0000","last_change":"2024-09-14T10:49:09.053703+0000","last_active":"2024-09-14T12:41:41.500441+0000","last_peered":"2024-09-14T12:41:41.500441+0000","last_clean":"2024-09-14T12:41:41.500441+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T12:41:41.500441+0000","last_undegraded":"2024-09-14T12:41:41.500441+0000","last_fullsized":"2024-09-14T12:41:41.500441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:01.458375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'329","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.972824+0000","last_change":"2024-09-14T10:49:23.371837+0000","last_active":"2024-09-14T12:44:04.972824+0000","last_peered":"2024-09-14T12:44:04.972824+0000","last_clean":"2024-09-14T12:44:04.972824+0000","last_became_active":"2024-09-14T10:49:23.371077+0000","last_became_peered":"2024-09-14T10:49:23.371077+0000","last_unstale":"2024-09-14T12:44:04.972824+0000","last_undegraded":"2024-09-14T12:44:04.972824+0000","last_fullsized":"2024-09-14T12:44:04.972824+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:28.149667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":16360,"num_write":1113,"num_write_kb":33420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.813111+0000","last_change":"2024-09-14T10:49:27.375599+0000","last_active":"2024-09-14T12:42:00.813111+0000","last_peered":"2024-09-14T12:42:00.813111+0000","last_clean":"2024-09-14T12:42:00.813111+0000","last_became_active":"2024-09-14T10:49:27.372388+0000","last_became_peered":"2024-09-14T10:49:27.372388+0000","last_unstale":"2024-09-14T12:42:00.813111+0000","last_undegraded":"2024-09-14T12:42:00.813111+0000","last_fullsized":"2024-09-14T12:42:00.813111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:22.751936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'829","reported_seq":1575,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.056807+0000","last_change":"2024-09-14T10:49:29.390925+0000","last_active":"2024-09-14T12:44:04.056807+0000","last_peered":"2024-09-14T12:44:04.056807+0000","last_clean":"2024-09-14T12:44:04.056807+0000","last_became_active":"2024-09-14T10:49:29.390014+0000","last_became_peered":"2024-09-14T10:49:29.390014+0000","last_unstale":"2024-09-14T12:44:04.056807+0000","last_undegraded":"2024-09-14T12:44:04.056807+0000","last_fullsized":"2024-09-14T12:44:04.056807+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.279366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167259,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1623,"num_read_kb":3686,"num_write":1586,"num_write_kb":1425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:05.552990+0000","last_change":"2024-09-14T10:49:31.411996+0000","last_active":"2024-09-14T12:40:05.552990+0000","last_peered":"2024-09-14T12:40:05.552990+0000","last_clean":"2024-09-14T12:40:05.552990+0000","last_became_active":"2024-09-14T10:49:31.411212+0000","last_became_peered":"2024-09-14T10:49:31.411212+0000","last_unstale":"2024-09-14T12:40:05.552990+0000","last_undegraded":"2024-09-14T12:40:05.552990+0000","last_fullsized":"2024-09-14T12:40:05.552990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:47.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'196","reported_seq":932,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.596985+0000","last_change":"2024-09-14T10:49:33.470365+0000","last_active":"2024-09-14T12:42:29.596985+0000","last_peered":"2024-09-14T12:42:29.596985+0000","last_clean":"2024-09-14T12:42:29.596985+0000","last_became_active":"2024-09-14T10:49:33.469611+0000","last_became_peered":"2024-09-14T10:49:33.469611+0000","last_unstale":"2024-09-14T12:42:29.596985+0000","last_undegraded":"2024-09-14T12:42:29.596985+0000","last_fullsized":"2024-09-14T12:42:29.596985+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:02.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":425,"num_write":402,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'780","reported_seq":2292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.583324+0000","last_change":"2024-09-14T10:49:25.391340+0000","last_active":"2024-09-14T12:41:29.583324+0000","last_peered":"2024-09-14T12:41:29.583324+0000","last_clean":"2024-09-14T12:41:29.583324+0000","last_became_active":"2024-09-14T10:49:25.390586+0000","last_became_peered":"2024-09-14T10:49:25.390586+0000","last_unstale":"2024-09-14T12:41:29.583324+0000","last_undegraded":"2024-09-14T12:41:29.583324+0000","last_fullsized":"2024-09-14T12:41:29.583324+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:28.423661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3382,"num_write":1057,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496631+0000","last_change":"2024-09-14T10:49:09.052857+0000","last_active":"2024-09-14T12:41:26.496631+0000","last_peered":"2024-09-14T12:41:26.496631+0000","last_clean":"2024-09-14T12:41:26.496631+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T12:41:26.496631+0000","last_undegraded":"2024-09-14T12:41:26.496631+0000","last_fullsized":"2024-09-14T12:41:26.496631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.713061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'352","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.894476+0000","last_change":"2024-09-14T10:49:53.509685+0000","last_active":"2024-09-14T12:44:04.894476+0000","last_peered":"2024-09-14T12:44:04.894476+0000","last_clean":"2024-09-14T12:44:04.894476+0000","last_became_active":"2024-09-14T10:49:53.507913+0000","last_became_peered":"2024-09-14T10:49:53.507913+0000","last_unstale":"2024-09-14T12:44:04.894476+0000","last_undegraded":"2024-09-14T12:44:04.894476+0000","last_fullsized":"2024-09-14T12:44:04.894476+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:02.727574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":56481,"num_write":1136,"num_write_kb":45113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,3],"acting":[6,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.474795+0000","last_change":"2024-09-14T10:49:27.389322+0000","last_active":"2024-09-14T12:40:01.474795+0000","last_peered":"2024-09-14T12:40:01.474795+0000","last_clean":"2024-09-14T12:40:01.474795+0000","last_became_active":"2024-09-14T10:49:27.388875+0000","last_became_peered":"2024-09-14T10:49:27.388875+0000","last_unstale":"2024-09-14T12:40:01.474795+0000","last_undegraded":"2024-09-14T12:40:01.474795+0000","last_fullsized":"2024-09-14T12:40:01.474795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:39.859202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1471","reported_seq":3844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.789582+0000","last_change":"2024-09-14T10:49:29.394197+0000","last_active":"2024-09-14T12:44:04.789582+0000","last_peered":"2024-09-14T12:44:04.789582+0000","last_clean":"2024-09-14T12:44:04.789582+0000","last_became_active":"2024-09-14T10:49:29.393295+0000","last_became_peered":"2024-09-14T10:49:29.393295+0000","last_unstale":"2024-09-14T12:44:04.789582+0000","last_undegraded":"2024-09-14T12:44:04.789582+0000","last_fullsized":"2024-09-14T12:44:04.789582+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":1400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:36.360396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2284,"num_read_kb":4194,"num_write":1394,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:16.478561+0000","last_change":"2024-09-14T10:49:31.432764+0000","last_active":"2024-09-14T12:40:16.478561+0000","last_peered":"2024-09-14T12:40:16.478561+0000","last_clean":"2024-09-14T12:40:16.478561+0000","last_became_active":"2024-09-14T10:49:31.432054+0000","last_became_peered":"2024-09-14T10:49:31.432054+0000","last_unstale":"2024-09-14T12:40:16.478561+0000","last_undegraded":"2024-09-14T12:40:16.478561+0000","last_fullsized":"2024-09-14T12:40:16.478561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:16.891140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'83","reported_seq":607,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:30.558557+0000","last_change":"2024-09-14T10:49:33.466954+0000","last_active":"2024-09-14T12:40:30.558557+0000","last_peered":"2024-09-14T12:40:30.558557+0000","last_clean":"2024-09-14T12:40:30.558557+0000","last_became_active":"2024-09-14T10:49:33.466307+0000","last_became_peered":"2024-09-14T10:49:33.466307+0000","last_unstale":"2024-09-14T12:40:30.558557+0000","last_undegraded":"2024-09-14T12:40:30.558557+0000","last_fullsized":"2024-09-14T12:40:30.558557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:18.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":197,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'927","reported_seq":2492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.371619+0000","last_change":"2024-09-14T10:49:25.384251+0000","last_active":"2024-09-14T12:42:29.371619+0000","last_peered":"2024-09-14T12:42:29.371619+0000","last_clean":"2024-09-14T12:42:29.371619+0000","last_became_active":"2024-09-14T10:49:25.382937+0000","last_became_peered":"2024-09-14T10:49:25.382937+0000","last_unstale":"2024-09-14T12:42:29.371619+0000","last_undegraded":"2024-09-14T12:42:29.371619+0000","last_fullsized":"2024-09-14T12:42:29.371619+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:13.849834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":3892,"num_write":1285,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:39.756813+0000","last_change":"2024-09-14T10:49:09.482540+0000","last_active":"2024-09-14T12:41:39.756813+0000","last_peered":"2024-09-14T12:41:39.756813+0000","last_clean":"2024-09-14T12:41:39.756813+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T12:41:39.756813+0000","last_undegraded":"2024-09-14T12:41:39.756813+0000","last_fullsized":"2024-09-14T12:41:39.756813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:28.426232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'330","reported_seq":981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.915301+0000","last_change":"2024-09-14T10:49:23.388674+0000","last_active":"2024-09-14T12:44:04.915301+0000","last_peered":"2024-09-14T12:44:04.915301+0000","last_clean":"2024-09-14T12:44:04.915301+0000","last_became_active":"2024-09-14T10:49:23.387885+0000","last_became_peered":"2024-09-14T10:49:23.387885+0000","last_unstale":"2024-09-14T12:44:04.915301+0000","last_undegraded":"2024-09-14T12:44:04.915301+0000","last_fullsized":"2024-09-14T12:44:04.915301+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:35.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":25294,"num_write":1061,"num_write_kb":31965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:59.734121+0000","last_change":"2024-09-14T10:49:27.385977+0000","last_active":"2024-09-14T12:39:59.734121+0000","last_peered":"2024-09-14T12:39:59.734121+0000","last_clean":"2024-09-14T12:39:59.734121+0000","last_became_active":"2024-09-14T10:49:27.384973+0000","last_became_peered":"2024-09-14T10:49:27.384973+0000","last_unstale":"2024-09-14T12:39:59.734121+0000","last_undegraded":"2024-09-14T12:39:59.734121+0000","last_fullsized":"2024-09-14T12:39:59.734121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:44.532319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'415","reported_seq":2396,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:44.016898+0000","last_change":"2024-09-14T10:49:29.382733+0000","last_active":"2024-09-14T12:43:44.016898+0000","last_peered":"2024-09-14T12:43:44.016898+0000","last_clean":"2024-09-14T12:43:44.016898+0000","last_became_active":"2024-09-14T10:49:29.382485+0000","last_became_peered":"2024-09-14T10:49:29.382485+0000","last_unstale":"2024-09-14T12:43:44.016898+0000","last_undegraded":"2024-09-14T12:43:44.016898+0000","last_fullsized":"2024-09-14T12:43:44.016898+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:09.682817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":384,"num_read_kb":370,"num_write":379,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.590006+0000","last_change":"2024-09-14T10:49:31.421762+0000","last_active":"2024-09-14T12:42:05.590006+0000","last_peered":"2024-09-14T12:42:05.590006+0000","last_clean":"2024-09-14T12:42:05.590006+0000","last_became_active":"2024-09-14T10:49:31.420121+0000","last_became_peered":"2024-09-14T10:49:31.420121+0000","last_unstale":"2024-09-14T12:42:05.590006+0000","last_undegraded":"2024-09-14T12:42:05.590006+0000","last_fullsized":"2024-09-14T12:42:05.590006+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:24.154484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'274","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.858379+0000","last_change":"2024-09-14T10:49:33.438284+0000","last_active":"2024-09-14T12:42:29.858379+0000","last_peered":"2024-09-14T12:42:29.858379+0000","last_clean":"2024-09-14T12:42:29.858379+0000","last_became_active":"2024-09-14T10:49:33.437564+0000","last_became_peered":"2024-09-14T10:49:33.437564+0000","last_unstale":"2024-09-14T12:42:29.858379+0000","last_undegraded":"2024-09-14T12:42:29.858379+0000","last_fullsized":"2024-09-14T12:42:29.858379+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:21.636592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":600,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'363","reported_seq":1770,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.457004+0000","last_change":"2024-09-14T10:49:25.378315+0000","last_active":"2024-09-14T12:42:29.457004+0000","last_peered":"2024-09-14T12:42:29.457004+0000","last_clean":"2024-09-14T12:42:29.457004+0000","last_became_active":"2024-09-14T10:49:25.377606+0000","last_became_peered":"2024-09-14T10:49:25.377606+0000","last_unstale":"2024-09-14T12:42:29.457004+0000","last_undegraded":"2024-09-14T12:42:29.457004+0000","last_fullsized":"2024-09-14T12:42:29.457004+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:08.626742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2088,"num_read_kb":1981,"num_write":424,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:41.500386+0000","last_change":"2024-09-14T10:49:09.053071+0000","last_active":"2024-09-14T12:41:41.500386+0000","last_peered":"2024-09-14T12:41:41.500386+0000","last_clean":"2024-09-14T12:41:41.500386+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T12:41:41.500386+0000","last_undegraded":"2024-09-14T12:41:41.500386+0000","last_fullsized":"2024-09-14T12:41:41.500386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:51.730662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'374","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.946209+0000","last_change":"2024-09-14T10:49:23.365487+0000","last_active":"2024-09-14T12:44:04.946209+0000","last_peered":"2024-09-14T12:44:04.946209+0000","last_clean":"2024-09-14T12:44:04.946209+0000","last_became_active":"2024-09-14T10:49:23.365016+0000","last_became_peered":"2024-09-14T10:49:23.365016+0000","last_unstale":"2024-09-14T12:44:04.946209+0000","last_undegraded":"2024-09-14T12:44:04.946209+0000","last_fullsized":"2024-09-14T12:44:04.946209+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.567826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":666,"num_read_kb":160044,"num_write":1139,"num_write_kb":62525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737546+0000","last_change":"2024-09-14T10:49:27.374724+0000","last_active":"2024-09-14T12:40:14.737546+0000","last_peered":"2024-09-14T12:40:14.737546+0000","last_clean":"2024-09-14T12:40:14.737546+0000","last_became_active":"2024-09-14T10:49:27.373998+0000","last_became_peered":"2024-09-14T10:49:27.373998+0000","last_unstale":"2024-09-14T12:40:14.737546+0000","last_undegraded":"2024-09-14T12:40:14.737546+0000","last_fullsized":"2024-09-14T12:40:14.737546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:19.157690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'229","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:10.363823+0000","last_change":"2024-09-14T10:49:29.391820+0000","last_active":"2024-09-14T12:42:10.363823+0000","last_peered":"2024-09-14T12:42:10.363823+0000","last_clean":"2024-09-14T12:42:10.363823+0000","last_became_active":"2024-09-14T10:49:29.391056+0000","last_became_peered":"2024-09-14T10:49:29.391056+0000","last_unstale":"2024-09-14T12:42:10.363823+0000","last_undegraded":"2024-09-14T12:42:10.363823+0000","last_fullsized":"2024-09-14T12:42:10.363823+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:10.544422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":287,"num_read_kb":274,"num_write":212,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476208+0000","last_change":"2024-09-14T10:49:31.430127+0000","last_active":"2024-09-14T12:40:06.476208+0000","last_peered":"2024-09-14T12:40:06.476208+0000","last_clean":"2024-09-14T12:40:06.476208+0000","last_became_active":"2024-09-14T10:49:31.424769+0000","last_became_peered":"2024-09-14T10:49:31.424769+0000","last_unstale":"2024-09-14T12:40:06.476208+0000","last_undegraded":"2024-09-14T12:40:06.476208+0000","last_fullsized":"2024-09-14T12:40:06.476208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:42.138808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'129","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.097115+0000","last_change":"2024-09-14T10:49:33.469301+0000","last_active":"2024-09-14T12:42:31.097115+0000","last_peered":"2024-09-14T12:42:31.097115+0000","last_clean":"2024-09-14T12:42:31.097115+0000","last_became_active":"2024-09-14T10:49:33.468553+0000","last_became_peered":"2024-09-14T10:49:33.468553+0000","last_unstale":"2024-09-14T12:42:31.097115+0000","last_undegraded":"2024-09-14T12:42:31.097115+0000","last_fullsized":"2024-09-14T12:42:31.097115+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:38.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":228,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'553","reported_seq":2109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.456842+0000","last_change":"2024-09-14T10:49:25.381598+0000","last_active":"2024-09-14T12:42:29.456842+0000","last_peered":"2024-09-14T12:42:29.456842+0000","last_clean":"2024-09-14T12:42:29.456842+0000","last_became_active":"2024-09-14T10:49:25.379137+0000","last_became_peered":"2024-09-14T10:49:25.379137+0000","last_unstale":"2024-09-14T12:42:29.456842+0000","last_undegraded":"2024-09-14T12:42:29.456842+0000","last_fullsized":"2024-09-14T12:42:29.456842+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:41.217351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2924,"num_read_kb":2647,"num_write":735,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'367","reported_seq":1060,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.866158+0000","last_change":"2024-09-14T10:49:23.389597+0000","last_active":"2024-09-14T12:44:04.866158+0000","last_peered":"2024-09-14T12:44:04.866158+0000","last_clean":"2024-09-14T12:44:04.866158+0000","last_became_active":"2024-09-14T10:49:23.389195+0000","last_became_peered":"2024-09-14T10:49:23.389195+0000","last_unstale":"2024-09-14T12:44:04.866158+0000","last_undegraded":"2024-09-14T12:44:04.866158+0000","last_fullsized":"2024-09-14T12:44:04.866158+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:12.064159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984745,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":650,"num_read_kb":23846,"num_write":1157,"num_write_kb":31374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:40.575257+0000","last_change":"2024-09-14T10:49:09.318418+0000","last_active":"2024-09-14T12:41:40.575257+0000","last_peered":"2024-09-14T12:41:40.575257+0000","last_clean":"2024-09-14T12:41:40.575257+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T12:41:40.575257+0000","last_undegraded":"2024-09-14T12:41:40.575257+0000","last_fullsized":"2024-09-14T12:41:40.575257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:16.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.588347+0000","last_change":"2024-09-14T10:49:27.369178+0000","last_active":"2024-09-14T12:42:00.588347+0000","last_peered":"2024-09-14T12:42:00.588347+0000","last_clean":"2024-09-14T12:42:00.588347+0000","last_became_active":"2024-09-14T10:49:27.368412+0000","last_became_peered":"2024-09-14T10:49:27.368412+0000","last_unstale":"2024-09-14T12:42:00.588347+0000","last_undegraded":"2024-09-14T12:42:00.588347+0000","last_fullsized":"2024-09-14T12:42:00.588347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:12.491677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'755","reported_seq":1493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.153074+0000","last_change":"2024-09-14T10:49:29.389811+0000","last_active":"2024-09-14T12:44:04.153074+0000","last_peered":"2024-09-14T12:44:04.153074+0000","last_clean":"2024-09-14T12:44:04.153074+0000","last_became_active":"2024-09-14T10:49:29.383270+0000","last_became_peered":"2024-09-14T10:49:29.383270+0000","last_unstale":"2024-09-14T12:44:04.153074+0000","last_undegraded":"2024-09-14T12:44:04.153074+0000","last_fullsized":"2024-09-14T12:44:04.153074+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:51.681617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99398,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2001,"num_read_kb":3265,"num_write":2692,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:01.143642+0000","last_change":"2024-09-14T10:49:31.419150+0000","last_active":"2024-09-14T12:40:01.143642+0000","last_peered":"2024-09-14T12:40:01.143642+0000","last_clean":"2024-09-14T12:40:01.143642+0000","last_became_active":"2024-09-14T10:49:31.418385+0000","last_became_peered":"2024-09-14T10:49:31.418385+0000","last_unstale":"2024-09-14T12:40:01.143642+0000","last_undegraded":"2024-09-14T12:40:01.143642+0000","last_fullsized":"2024-09-14T12:40:01.143642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:53.967427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'130","reported_seq":662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.863696+0000","last_change":"2024-09-14T10:49:33.468510+0000","last_active":"2024-09-14T12:42:30.863696+0000","last_peered":"2024-09-14T12:42:30.863696+0000","last_clean":"2024-09-14T12:42:30.863696+0000","last_became_active":"2024-09-14T10:49:33.467268+0000","last_became_peered":"2024-09-14T10:49:33.467268+0000","last_unstale":"2024-09-14T12:42:30.863696+0000","last_undegraded":"2024-09-14T12:42:30.863696+0000","last_fullsized":"2024-09-14T12:42:30.863696+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:48.075987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":137,"num_write":301,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'744","reported_seq":2288,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560542+0000","last_change":"2024-09-14T10:49:25.378254+0000","last_active":"2024-09-14T12:41:56.560542+0000","last_peered":"2024-09-14T12:41:56.560542+0000","last_clean":"2024-09-14T12:41:56.560542+0000","last_became_active":"2024-09-14T10:49:25.377460+0000","last_became_peered":"2024-09-14T10:49:25.377460+0000","last_unstale":"2024-09-14T12:41:56.560542+0000","last_undegraded":"2024-09-14T12:41:56.560542+0000","last_fullsized":"2024-09-14T12:41:56.560542+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:40.959297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3587,"num_read_kb":3249,"num_write":953,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'349","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.997851+0000","last_change":"2024-09-14T10:49:23.386787+0000","last_active":"2024-09-14T12:44:04.997851+0000","last_peered":"2024-09-14T12:44:04.997851+0000","last_clean":"2024-09-14T12:44:04.997851+0000","last_became_active":"2024-09-14T10:49:23.383686+0000","last_became_peered":"2024-09-14T10:49:23.383686+0000","last_unstale":"2024-09-14T12:44:04.997851+0000","last_undegraded":"2024-09-14T12:44:04.997851+0000","last_fullsized":"2024-09-14T12:44:04.997851+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:13.515080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":8945,"num_write":1082,"num_write_kb":53511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504873+0000","last_change":"2024-09-14T10:49:09.053478+0000","last_active":"2024-09-14T12:41:56.504873+0000","last_peered":"2024-09-14T12:41:56.504873+0000","last_clean":"2024-09-14T12:41:56.504873+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T12:41:56.504873+0000","last_undegraded":"2024-09-14T12:41:56.504873+0000","last_fullsized":"2024-09-14T12:41:56.504873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.160900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.813002+0000","last_change":"2024-09-14T10:49:27.374268+0000","last_active":"2024-09-14T12:42:00.813002+0000","last_peered":"2024-09-14T12:42:00.813002+0000","last_clean":"2024-09-14T12:42:00.813002+0000","last_became_active":"2024-09-14T10:49:27.373801+0000","last_became_peered":"2024-09-14T10:49:27.373801+0000","last_unstale":"2024-09-14T12:42:00.813002+0000","last_undegraded":"2024-09-14T12:42:00.813002+0000","last_fullsized":"2024-09-14T12:42:00.813002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:26.573366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'247","reported_seq":885,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561543+0000","last_change":"2024-09-14T10:49:29.387943+0000","last_active":"2024-09-14T12:42:01.561543+0000","last_peered":"2024-09-14T12:42:01.561543+0000","last_clean":"2024-09-14T12:42:01.561543+0000","last_became_active":"2024-09-14T10:49:29.387176+0000","last_became_peered":"2024-09-14T10:49:29.387176+0000","last_unstale":"2024-09-14T12:42:01.561543+0000","last_undegraded":"2024-09-14T12:42:01.561543+0000","last_fullsized":"2024-09-14T12:42:01.561543+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:04.926878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'796","reported_seq":3336,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.447721+0000","last_change":"2024-09-14T10:49:31.418103+0000","last_active":"2024-09-14T12:44:03.447721+0000","last_peered":"2024-09-14T12:44:03.447721+0000","last_clean":"2024-09-14T12:44:03.447721+0000","last_became_active":"2024-09-14T10:49:31.417376+0000","last_became_peered":"2024-09-14T10:49:31.417376+0000","last_unstale":"2024-09-14T12:44:03.447721+0000","last_undegraded":"2024-09-14T12:44:03.447721+0000","last_fullsized":"2024-09-14T12:44:03.447721+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:56.482438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'146","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.767330+0000","last_change":"2024-09-14T10:49:33.459885+0000","last_active":"2024-09-14T12:42:24.767330+0000","last_peered":"2024-09-14T12:42:24.767330+0000","last_clean":"2024-09-14T12:42:24.767330+0000","last_became_active":"2024-09-14T10:49:33.459122+0000","last_became_peered":"2024-09-14T10:49:33.459122+0000","last_unstale":"2024-09-14T12:42:24.767330+0000","last_undegraded":"2024-09-14T12:42:24.767330+0000","last_fullsized":"2024-09-14T12:42:24.767330+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:50.717373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":355,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'838","reported_seq":2546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.586893+0000","last_change":"2024-09-14T10:49:25.361390+0000","last_active":"2024-09-14T12:41:55.586893+0000","last_peered":"2024-09-14T12:41:55.586893+0000","last_clean":"2024-09-14T12:41:55.586893+0000","last_became_active":"2024-09-14T10:49:25.360655+0000","last_became_peered":"2024-09-14T10:49:25.360655+0000","last_unstale":"2024-09-14T12:41:55.586893+0000","last_undegraded":"2024-09-14T12:41:55.586893+0000","last_fullsized":"2024-09-14T12:41:55.586893+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:50.719358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4101,"num_read_kb":3716,"num_write":1090,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'464","reported_seq":1171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.972722+0000","last_change":"2024-09-14T10:49:23.361586+0000","last_active":"2024-09-14T12:44:04.972722+0000","last_peered":"2024-09-14T12:44:04.972722+0000","last_clean":"2024-09-14T12:44:04.972722+0000","last_became_active":"2024-09-14T10:49:23.359442+0000","last_became_peered":"2024-09-14T10:49:23.359442+0000","last_unstale":"2024-09-14T12:44:04.972722+0000","last_undegraded":"2024-09-14T12:44:04.972722+0000","last_fullsized":"2024-09-14T12:44:04.972722+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.017232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":830,"num_read_kb":31084,"num_write":1362,"num_write_kb":31792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585909+0000","last_change":"2024-09-14T10:49:09.044027+0000","last_active":"2024-09-14T12:41:50.585909+0000","last_peered":"2024-09-14T12:41:50.585909+0000","last_clean":"2024-09-14T12:41:50.585909+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T12:41:50.585909+0000","last_undegraded":"2024-09-14T12:41:50.585909+0000","last_fullsized":"2024-09-14T12:41:50.585909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:42.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506175+0000","last_change":"2024-09-14T10:49:27.385279+0000","last_active":"2024-09-14T12:42:01.506175+0000","last_peered":"2024-09-14T12:42:01.506175+0000","last_clean":"2024-09-14T12:42:01.506175+0000","last_became_active":"2024-09-14T10:49:27.384635+0000","last_became_peered":"2024-09-14T10:49:27.384635+0000","last_unstale":"2024-09-14T12:42:01.506175+0000","last_undegraded":"2024-09-14T12:42:01.506175+0000","last_fullsized":"2024-09-14T12:42:01.506175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.745658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'179","reported_seq":778,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506219+0000","last_change":"2024-09-14T10:49:29.397010+0000","last_active":"2024-09-14T12:42:01.506219+0000","last_peered":"2024-09-14T12:42:01.506219+0000","last_clean":"2024-09-14T12:42:01.506219+0000","last_became_active":"2024-09-14T10:49:29.394105+0000","last_became_peered":"2024-09-14T10:49:29.394105+0000","last_unstale":"2024-09-14T12:42:01.506219+0000","last_undegraded":"2024-09-14T12:42:01.506219+0000","last_fullsized":"2024-09-14T12:42:01.506219+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:23.758962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'829","reported_seq":3145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.013634+0000","last_change":"2024-09-14T10:49:31.411841+0000","last_active":"2024-09-14T12:44:05.013634+0000","last_peered":"2024-09-14T12:44:05.013634+0000","last_clean":"2024-09-14T12:44:05.013634+0000","last_became_active":"2024-09-14T10:49:31.411055+0000","last_became_peered":"2024-09-14T10:49:31.411055+0000","last_unstale":"2024-09-14T12:44:05.013634+0000","last_undegraded":"2024-09-14T12:44:05.013634+0000","last_fullsized":"2024-09-14T12:44:05.013634+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:46.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'269","reported_seq":814,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.548982+0000","last_change":"2024-09-14T10:49:33.457595+0000","last_active":"2024-09-14T12:39:50.548982+0000","last_peered":"2024-09-14T12:39:50.548982+0000","last_clean":"2024-09-14T12:39:50.548982+0000","last_became_active":"2024-09-14T10:49:33.456806+0000","last_became_peered":"2024-09-14T10:49:33.456806+0000","last_unstale":"2024-09-14T12:39:50.548982+0000","last_undegraded":"2024-09-14T12:39:50.548982+0000","last_fullsized":"2024-09-14T12:39:50.548982+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:15.247749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":331,"num_read_kb":330,"num_write":580,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'499","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.457164+0000","last_change":"2024-09-14T10:49:25.373350+0000","last_active":"2024-09-14T12:42:29.457164+0000","last_peered":"2024-09-14T12:42:29.457164+0000","last_clean":"2024-09-14T12:42:29.457164+0000","last_became_active":"2024-09-14T10:49:25.372923+0000","last_became_peered":"2024-09-14T10:49:25.372923+0000","last_unstale":"2024-09-14T12:42:29.457164+0000","last_undegraded":"2024-09-14T12:42:29.457164+0000","last_fullsized":"2024-09-14T12:42:29.457164+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:38.893953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2643,"num_read_kb":2487,"num_write":591,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'357","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.920168+0000","last_change":"2024-09-14T10:49:23.346381+0000","last_active":"2024-09-14T12:44:04.920168+0000","last_peered":"2024-09-14T12:44:04.920168+0000","last_clean":"2024-09-14T12:44:04.920168+0000","last_became_active":"2024-09-14T10:49:23.344863+0000","last_became_peered":"2024-09-14T10:49:23.344863+0000","last_unstale":"2024-09-14T12:44:04.920168+0000","last_undegraded":"2024-09-14T12:44:04.920168+0000","last_fullsized":"2024-09-14T12:44:04.920168+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:12.876419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":37228,"num_write":1084,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503382+0000","last_change":"2024-09-14T10:49:09.054207+0000","last_active":"2024-09-14T12:41:51.503382+0000","last_peered":"2024-09-14T12:41:51.503382+0000","last_clean":"2024-09-14T12:41:51.503382+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T12:41:51.503382+0000","last_undegraded":"2024-09-14T12:41:51.503382+0000","last_fullsized":"2024-09-14T12:41:51.503382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:06.006953+0000","last_clean_scrub_stamp":"2024-09-14T10:49:06.006953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.696418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.588173+0000","last_change":"2024-09-14T10:49:27.380671+0000","last_active":"2024-09-14T12:42:00.588173+0000","last_peered":"2024-09-14T12:42:00.588173+0000","last_clean":"2024-09-14T12:42:00.588173+0000","last_became_active":"2024-09-14T10:49:27.379820+0000","last_became_peered":"2024-09-14T10:49:27.379820+0000","last_unstale":"2024-09-14T12:42:00.588173+0000","last_undegraded":"2024-09-14T12:42:00.588173+0000","last_fullsized":"2024-09-14T12:42:00.588173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:08.601000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'849","reported_seq":1645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.641355+0000","last_change":"2024-09-14T10:49:29.390161+0000","last_active":"2024-09-14T12:44:04.641355+0000","last_peered":"2024-09-14T12:44:04.641355+0000","last_clean":"2024-09-14T12:44:04.641355+0000","last_became_active":"2024-09-14T10:49:29.389500+0000","last_became_peered":"2024-09-14T10:49:29.389500+0000","last_unstale":"2024-09-14T12:44:04.641355+0000","last_undegraded":"2024-09-14T12:44:04.641355+0000","last_fullsized":"2024-09-14T12:44:04.641355+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:43.125499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1507,"num_read_kb":3507,"num_write":1226,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.589836+0000","last_change":"2024-09-14T10:49:31.413780+0000","last_active":"2024-09-14T12:42:05.589836+0000","last_peered":"2024-09-14T12:42:05.589836+0000","last_clean":"2024-09-14T12:42:05.589836+0000","last_became_active":"2024-09-14T10:49:31.413008+0000","last_became_peered":"2024-09-14T10:49:31.413008+0000","last_unstale":"2024-09-14T12:42:05.589836+0000","last_undegraded":"2024-09-14T12:42:05.589836+0000","last_fullsized":"2024-09-14T12:42:05.589836+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:58.384037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.643169+0000","last_change":"2024-09-14T10:49:33.471643+0000","last_active":"2024-09-14T12:42:31.643169+0000","last_peered":"2024-09-14T12:42:31.643169+0000","last_clean":"2024-09-14T12:42:31.643169+0000","last_became_active":"2024-09-14T10:49:33.468546+0000","last_became_peered":"2024-09-14T10:49:33.468546+0000","last_unstale":"2024-09-14T12:42:31.643169+0000","last_undegraded":"2024-09-14T12:42:31.643169+0000","last_fullsized":"2024-09-14T12:42:31.643169+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.990777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'160","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.258037+0000","last_change":"2024-09-14T10:49:33.462576+0000","last_active":"2024-09-14T12:42:32.258037+0000","last_peered":"2024-09-14T12:42:32.258037+0000","last_clean":"2024-09-14T12:42:32.258037+0000","last_became_active":"2024-09-14T10:49:33.461782+0000","last_became_peered":"2024-09-14T10:49:33.461782+0000","last_unstale":"2024-09-14T12:42:32.258037+0000","last_undegraded":"2024-09-14T12:42:32.258037+0000","last_fullsized":"2024-09-14T12:42:32.258037+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:38.902854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":264,"num_write":397,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'521","reported_seq":2247,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.163802+0000","last_change":"2024-09-14T10:49:25.381899+0000","last_active":"2024-09-14T12:41:26.163802+0000","last_peered":"2024-09-14T12:41:26.163802+0000","last_clean":"2024-09-14T12:41:26.163802+0000","last_became_active":"2024-09-14T10:49:25.381653+0000","last_became_peered":"2024-09-14T10:49:25.381653+0000","last_unstale":"2024-09-14T12:41:26.163802+0000","last_undegraded":"2024-09-14T12:41:26.163802+0000","last_fullsized":"2024-09-14T12:41:26.163802+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:01.827788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2737,"num_read_kb":2577,"num_write":621,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'379","reported_seq":1160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.882112+0000","last_change":"2024-09-14T10:49:23.365867+0000","last_active":"2024-09-14T12:44:04.882112+0000","last_peered":"2024-09-14T12:44:04.882112+0000","last_clean":"2024-09-14T12:44:04.882112+0000","last_became_active":"2024-09-14T10:49:23.365341+0000","last_became_peered":"2024-09-14T10:49:23.365341+0000","last_unstale":"2024-09-14T12:44:04.882112+0000","last_undegraded":"2024-09-14T12:44:04.882112+0000","last_fullsized":"2024-09-14T12:44:04.882112+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:00.255631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":685,"num_read_kb":37659,"num_write":1131,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.554957+0000","last_change":"2024-09-14T10:49:27.368112+0000","last_active":"2024-09-14T12:41:31.554957+0000","last_peered":"2024-09-14T12:41:31.554957+0000","last_clean":"2024-09-14T12:41:31.554957+0000","last_became_active":"2024-09-14T10:49:27.366990+0000","last_became_peered":"2024-09-14T10:49:27.366990+0000","last_unstale":"2024-09-14T12:41:31.554957+0000","last_undegraded":"2024-09-14T12:41:31.554957+0000","last_fullsized":"2024-09-14T12:41:31.554957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.945759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'335","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.502948+0000","last_change":"2024-09-14T10:49:29.372907+0000","last_active":"2024-09-14T12:44:03.502948+0000","last_peered":"2024-09-14T12:44:03.502948+0000","last_clean":"2024-09-14T12:44:03.502948+0000","last_became_active":"2024-09-14T10:49:29.371655+0000","last_became_peered":"2024-09-14T10:49:29.371655+0000","last_unstale":"2024-09-14T12:44:03.502948+0000","last_undegraded":"2024-09-14T12:44:03.502948+0000","last_fullsized":"2024-09-14T12:44:03.502948+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:51.332753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49045,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":1185,"num_write":440,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755605+0000","last_change":"2024-09-14T10:49:31.418572+0000","last_active":"2024-09-14T12:41:34.755605+0000","last_peered":"2024-09-14T12:41:34.755605+0000","last_clean":"2024-09-14T12:41:34.755605+0000","last_became_active":"2024-09-14T10:49:31.417675+0000","last_became_peered":"2024-09-14T10:49:31.417675+0000","last_unstale":"2024-09-14T12:41:34.755605+0000","last_undegraded":"2024-09-14T12:41:34.755605+0000","last_fullsized":"2024-09-14T12:41:34.755605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:42.817490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'145","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.663503+0000","last_change":"2024-09-14T10:49:33.454370+0000","last_active":"2024-09-14T12:43:47.663503+0000","last_peered":"2024-09-14T12:43:47.663503+0000","last_clean":"2024-09-14T12:43:47.663503+0000","last_became_active":"2024-09-14T10:49:33.453630+0000","last_became_peered":"2024-09-14T10:49:33.453630+0000","last_unstale":"2024-09-14T12:43:47.663503+0000","last_undegraded":"2024-09-14T12:43:47.663503+0000","last_fullsized":"2024-09-14T12:43:47.663503+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:55.786343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":363,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'722","reported_seq":2161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:25.580335+0000","last_change":"2024-09-14T10:49:25.374565+0000","last_active":"2024-09-14T12:41:25.580335+0000","last_peered":"2024-09-14T12:41:25.580335+0000","last_clean":"2024-09-14T12:41:25.580335+0000","last_became_active":"2024-09-14T10:49:25.373876+0000","last_became_peered":"2024-09-14T10:49:25.373876+0000","last_unstale":"2024-09-14T12:41:25.580335+0000","last_undegraded":"2024-09-14T12:41:25.580335+0000","last_fullsized":"2024-09-14T12:41:25.580335+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:31.592836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3124,"num_write":967,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'350","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.354231+0000","last_change":"2024-09-14T12:44:10.354231+0000","last_active":"2024-09-14T12:44:10.354231+0000","last_peered":"2024-09-14T12:44:10.354231+0000","last_clean":"2024-09-14T12:44:10.354231+0000","last_became_active":"2024-09-14T10:49:23.373206+0000","last_became_peered":"2024-09-14T10:49:23.373206+0000","last_unstale":"2024-09-14T12:44:10.354231+0000","last_undegraded":"2024-09-14T12:44:10.354231+0000","last_fullsized":"2024-09-14T12:44:10.354231+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.354149+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:26.010856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":656,"num_read_kb":34264,"num_write":1064,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581474+0000","last_change":"2024-09-14T10:49:27.371401+0000","last_active":"2024-09-14T12:41:30.581474+0000","last_peered":"2024-09-14T12:41:30.581474+0000","last_clean":"2024-09-14T12:41:30.581474+0000","last_became_active":"2024-09-14T10:49:27.370174+0000","last_became_peered":"2024-09-14T10:49:27.370174+0000","last_unstale":"2024-09-14T12:41:30.581474+0000","last_undegraded":"2024-09-14T12:41:30.581474+0000","last_fullsized":"2024-09-14T12:41:30.581474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.300623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581354+0000","last_change":"2024-09-14T10:49:29.376404+0000","last_active":"2024-09-14T12:41:30.581354+0000","last_peered":"2024-09-14T12:41:30.581354+0000","last_clean":"2024-09-14T12:41:30.581354+0000","last_became_active":"2024-09-14T10:49:29.375761+0000","last_became_peered":"2024-09-14T10:49:29.375761+0000","last_unstale":"2024-09-14T12:41:30.581354+0000","last_undegraded":"2024-09-14T12:41:30.581354+0000","last_fullsized":"2024-09-14T12:41:30.581354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:47.597945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:36.165985+0000","last_change":"2024-09-14T10:49:31.411967+0000","last_active":"2024-09-14T12:41:36.165985+0000","last_peered":"2024-09-14T12:41:36.165985+0000","last_clean":"2024-09-14T12:41:36.165985+0000","last_became_active":"2024-09-14T10:49:31.410915+0000","last_became_peered":"2024-09-14T10:49:31.410915+0000","last_unstale":"2024-09-14T12:41:36.165985+0000","last_undegraded":"2024-09-14T12:41:36.165985+0000","last_fullsized":"2024-09-14T12:41:36.165985+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:52.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'179","reported_seq":721,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.366754+0000","last_change":"2024-09-14T10:49:33.454043+0000","last_active":"2024-09-14T12:42:29.366754+0000","last_peered":"2024-09-14T12:42:29.366754+0000","last_clean":"2024-09-14T12:42:29.366754+0000","last_became_active":"2024-09-14T10:49:33.453278+0000","last_became_peered":"2024-09-14T10:49:33.453278+0000","last_unstale":"2024-09-14T12:42:29.366754+0000","last_undegraded":"2024-09-14T12:42:29.366754+0000","last_fullsized":"2024-09-14T12:42:29.366754+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:00.597295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":265,"num_write":381,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'431","reported_seq":2071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.579695+0000","last_change":"2024-09-14T10:49:25.353852+0000","last_active":"2024-09-14T12:41:29.579695+0000","last_peered":"2024-09-14T12:41:29.579695+0000","last_clean":"2024-09-14T12:41:29.579695+0000","last_became_active":"2024-09-14T10:49:25.353010+0000","last_became_peered":"2024-09-14T10:49:25.353010+0000","last_unstale":"2024-09-14T12:41:29.579695+0000","last_undegraded":"2024-09-14T12:41:29.579695+0000","last_fullsized":"2024-09-14T12:41:29.579695+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:33.291317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2606,"num_read_kb":2470,"num_write":495,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'374","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.957101+0000","last_change":"2024-09-14T10:49:23.404260+0000","last_active":"2024-09-14T12:44:04.957101+0000","last_peered":"2024-09-14T12:44:04.957101+0000","last_clean":"2024-09-14T12:44:04.957101+0000","last_became_active":"2024-09-14T10:49:23.403718+0000","last_became_peered":"2024-09-14T10:49:23.403718+0000","last_unstale":"2024-09-14T12:44:04.957101+0000","last_undegraded":"2024-09-14T12:44:04.957101+0000","last_fullsized":"2024-09-14T12:44:04.957101+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:18.065436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":743,"num_read_kb":4167,"num_write":1078,"num_write_kb":34340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164879+0000","last_change":"2024-09-14T10:49:27.378466+0000","last_active":"2024-09-14T12:41:31.164879+0000","last_peered":"2024-09-14T12:41:31.164879+0000","last_clean":"2024-09-14T12:41:31.164879+0000","last_became_active":"2024-09-14T10:49:27.377584+0000","last_became_peered":"2024-09-14T10:49:27.377584+0000","last_unstale":"2024-09-14T12:41:31.164879+0000","last_undegraded":"2024-09-14T12:41:31.164879+0000","last_fullsized":"2024-09-14T12:41:31.164879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:00.183352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'387","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.040268+0000","last_change":"2024-09-14T10:49:29.390323+0000","last_active":"2024-09-14T12:44:02.040268+0000","last_peered":"2024-09-14T12:44:02.040268+0000","last_clean":"2024-09-14T12:44:02.040268+0000","last_became_active":"2024-09-14T10:49:29.389523+0000","last_became_peered":"2024-09-14T10:49:29.389523+0000","last_unstale":"2024-09-14T12:44:02.040268+0000","last_undegraded":"2024-09-14T12:44:02.040268+0000","last_fullsized":"2024-09-14T12:44:02.040268+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:19.414203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":1411,"num_write":516,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.561781+0000","last_change":"2024-09-14T10:49:31.422662+0000","last_active":"2024-09-14T12:41:35.561781+0000","last_peered":"2024-09-14T12:41:35.561781+0000","last_clean":"2024-09-14T12:41:35.561781+0000","last_became_active":"2024-09-14T10:49:31.422113+0000","last_became_peered":"2024-09-14T10:49:31.422113+0000","last_unstale":"2024-09-14T12:41:35.561781+0000","last_undegraded":"2024-09-14T12:41:35.561781+0000","last_fullsized":"2024-09-14T12:41:35.561781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:51.224760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'154","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468918+0000","last_change":"2024-09-14T10:49:33.476247+0000","last_active":"2024-09-14T12:39:36.468918+0000","last_peered":"2024-09-14T12:39:36.468918+0000","last_clean":"2024-09-14T12:39:36.468918+0000","last_became_active":"2024-09-14T10:49:33.475156+0000","last_became_peered":"2024-09-14T10:49:33.475156+0000","last_unstale":"2024-09-14T12:39:36.468918+0000","last_undegraded":"2024-09-14T12:39:36.468918+0000","last_fullsized":"2024-09-14T12:39:36.468918+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:09.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'411","reported_seq":2093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.754459+0000","last_change":"2024-09-14T10:49:25.371715+0000","last_active":"2024-09-14T12:41:29.754459+0000","last_peered":"2024-09-14T12:41:29.754459+0000","last_clean":"2024-09-14T12:41:29.754459+0000","last_became_active":"2024-09-14T10:49:25.370901+0000","last_became_peered":"2024-09-14T10:49:25.370901+0000","last_unstale":"2024-09-14T12:41:29.754459+0000","last_undegraded":"2024-09-14T12:41:29.754459+0000","last_fullsized":"2024-09-14T12:41:29.754459+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:49.373960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2274,"num_write":465,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'391","reported_seq":1081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.978421+0000","last_change":"2024-09-14T10:49:23.370421+0000","last_active":"2024-09-14T12:44:04.978421+0000","last_peered":"2024-09-14T12:44:04.978421+0000","last_clean":"2024-09-14T12:44:04.978421+0000","last_became_active":"2024-09-14T10:49:23.369669+0000","last_became_peered":"2024-09-14T10:49:23.369669+0000","last_unstale":"2024-09-14T12:44:04.978421+0000","last_undegraded":"2024-09-14T12:44:04.978421+0000","last_fullsized":"2024-09-14T12:44:04.978421+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:37.860070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":9973,"num_write":1367,"num_write_kb":36861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.498091+0000","last_change":"2024-09-14T10:49:27.388330+0000","last_active":"2024-09-14T12:41:31.498091+0000","last_peered":"2024-09-14T12:41:31.498091+0000","last_clean":"2024-09-14T12:41:31.498091+0000","last_became_active":"2024-09-14T10:49:27.387840+0000","last_became_peered":"2024-09-14T10:49:27.387840+0000","last_unstale":"2024-09-14T12:41:31.498091+0000","last_undegraded":"2024-09-14T12:41:31.498091+0000","last_fullsized":"2024-09-14T12:41:31.498091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:31.040634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'323","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.927527+0000","last_change":"2024-09-14T10:49:29.392053+0000","last_active":"2024-09-14T12:44:04.927527+0000","last_peered":"2024-09-14T12:44:04.927527+0000","last_clean":"2024-09-14T12:44:04.927527+0000","last_became_active":"2024-09-14T10:49:29.391517+0000","last_became_peered":"2024-09-14T10:49:29.391517+0000","last_unstale":"2024-09-14T12:44:04.927527+0000","last_undegraded":"2024-09-14T12:44:04.927527+0000","last_fullsized":"2024-09-14T12:44:04.927527+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:03.721336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1347,"num_write":436,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755694+0000","last_change":"2024-09-14T10:49:31.411523+0000","last_active":"2024-09-14T12:41:34.755694+0000","last_peered":"2024-09-14T12:41:34.755694+0000","last_clean":"2024-09-14T12:41:34.755694+0000","last_became_active":"2024-09-14T10:49:31.410633+0000","last_became_peered":"2024-09-14T10:49:31.410633+0000","last_unstale":"2024-09-14T12:41:34.755694+0000","last_undegraded":"2024-09-14T12:41:34.755694+0000","last_fullsized":"2024-09-14T12:41:34.755694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:56.976562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'747","reported_seq":2283,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.505119+0000","last_change":"2024-09-14T10:49:25.408540+0000","last_active":"2024-09-14T12:41:56.505119+0000","last_peered":"2024-09-14T12:41:56.505119+0000","last_clean":"2024-09-14T12:41:56.505119+0000","last_became_active":"2024-09-14T10:49:25.408028+0000","last_became_peered":"2024-09-14T10:49:25.408028+0000","last_unstale":"2024-09-14T12:41:56.505119+0000","last_undegraded":"2024-09-14T12:41:56.505119+0000","last_fullsized":"2024-09-14T12:41:56.505119+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:24.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3658,"num_read_kb":3304,"num_write":985,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'372","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.950465+0000","last_change":"2024-09-14T10:49:23.387201+0000","last_active":"2024-09-14T12:44:04.950465+0000","last_peered":"2024-09-14T12:44:04.950465+0000","last_clean":"2024-09-14T12:44:04.950465+0000","last_became_active":"2024-09-14T10:49:23.386404+0000","last_became_peered":"2024-09-14T10:49:23.386404+0000","last_unstale":"2024-09-14T12:44:04.950465+0000","last_undegraded":"2024-09-14T12:44:04.950465+0000","last_fullsized":"2024-09-14T12:44:04.950465+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:38.147399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":6911,"num_write":1204,"num_write_kb":32272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.222429+0000","last_change":"2024-09-14T10:49:27.382769+0000","last_active":"2024-09-14T12:44:01.222429+0000","last_peered":"2024-09-14T12:44:01.222429+0000","last_clean":"2024-09-14T12:44:01.222429+0000","last_became_active":"2024-09-14T10:49:27.381931+0000","last_became_peered":"2024-09-14T10:49:27.381931+0000","last_unstale":"2024-09-14T12:44:01.222429+0000","last_undegraded":"2024-09-14T12:44:01.222429+0000","last_fullsized":"2024-09-14T12:44:01.222429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:55.209752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'556","reported_seq":1228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.869432+0000","last_change":"2024-09-14T10:49:29.364784+0000","last_active":"2024-09-14T12:44:04.869432+0000","last_peered":"2024-09-14T12:44:04.869432+0000","last_clean":"2024-09-14T12:44:04.869432+0000","last_became_active":"2024-09-14T10:49:29.364013+0000","last_became_peered":"2024-09-14T10:49:29.364013+0000","last_unstale":"2024-09-14T12:44:04.869432+0000","last_undegraded":"2024-09-14T12:44:04.869432+0000","last_fullsized":"2024-09-14T12:44:04.869432+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:14.626395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98236,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":964,"num_read_kb":2193,"num_write":836,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.137434+0000","last_change":"2024-09-14T10:49:31.432562+0000","last_active":"2024-09-14T12:39:36.137434+0000","last_peered":"2024-09-14T12:39:36.137434+0000","last_clean":"2024-09-14T12:39:36.137434+0000","last_became_active":"2024-09-14T10:49:31.431550+0000","last_became_peered":"2024-09-14T10:49:31.431550+0000","last_unstale":"2024-09-14T12:39:36.137434+0000","last_undegraded":"2024-09-14T12:39:36.137434+0000","last_fullsized":"2024-09-14T12:39:36.137434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:21.094996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'162","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.573998+0000","last_change":"2024-09-14T10:49:33.467050+0000","last_active":"2024-09-14T12:41:35.573998+0000","last_peered":"2024-09-14T12:41:35.573998+0000","last_clean":"2024-09-14T12:41:35.573998+0000","last_became_active":"2024-09-14T10:49:33.466424+0000","last_became_peered":"2024-09-14T10:49:33.466424+0000","last_unstale":"2024-09-14T12:41:35.573998+0000","last_undegraded":"2024-09-14T12:41:35.573998+0000","last_fullsized":"2024-09-14T12:41:35.573998+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:16.563193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":247,"num_write":384,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'832","reported_seq":2406,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.767765+0000","last_change":"2024-09-14T10:49:25.367610+0000","last_active":"2024-09-14T12:42:31.767765+0000","last_peered":"2024-09-14T12:42:31.767765+0000","last_clean":"2024-09-14T12:42:31.767765+0000","last_became_active":"2024-09-14T10:49:25.364958+0000","last_became_peered":"2024-09-14T10:49:25.364958+0000","last_unstale":"2024-09-14T12:42:31.767765+0000","last_undegraded":"2024-09-14T12:42:31.767765+0000","last_fullsized":"2024-09-14T12:42:31.767765+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:15.525950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3911,"num_read_kb":3508,"num_write":1119,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'415","reported_seq":1157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.937508+0000","last_change":"2024-09-14T10:49:23.378450+0000","last_active":"2024-09-14T12:44:04.937508+0000","last_peered":"2024-09-14T12:44:04.937508+0000","last_clean":"2024-09-14T12:44:04.937508+0000","last_became_active":"2024-09-14T10:49:23.375310+0000","last_became_peered":"2024-09-14T10:49:23.375310+0000","last_unstale":"2024-09-14T12:44:04.937508+0000","last_undegraded":"2024-09-14T12:44:04.937508+0000","last_fullsized":"2024-09-14T12:44:04.937508+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:47.638057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":827,"num_read_kb":30368,"num_write":1218,"num_write_kb":52321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'5","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.235705+0000","last_change":"2024-09-14T10:49:27.386902+0000","last_active":"2024-09-14T12:44:01.235705+0000","last_peered":"2024-09-14T12:44:01.235705+0000","last_clean":"2024-09-14T12:44:01.235705+0000","last_became_active":"2024-09-14T10:49:27.386412+0000","last_became_peered":"2024-09-14T10:49:27.386412+0000","last_unstale":"2024-09-14T12:44:01.235705+0000","last_undegraded":"2024-09-14T12:44:01.235705+0000","last_fullsized":"2024-09-14T12:44:01.235705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:24.661084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'358","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.004469+0000","last_change":"2024-09-14T10:49:29.388733+0000","last_active":"2024-09-14T12:44:05.004469+0000","last_peered":"2024-09-14T12:44:05.004469+0000","last_clean":"2024-09-14T12:44:05.004469+0000","last_became_active":"2024-09-14T10:49:29.388370+0000","last_became_peered":"2024-09-14T10:49:29.388370+0000","last_unstale":"2024-09-14T12:44:05.004469+0000","last_undegraded":"2024-09-14T12:44:05.004469+0000","last_fullsized":"2024-09-14T12:44:05.004469+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.037315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46292,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":1047,"num_write":462,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.545289+0000","last_change":"2024-09-14T10:49:31.430532+0000","last_active":"2024-09-14T12:39:35.545289+0000","last_peered":"2024-09-14T12:39:35.545289+0000","last_clean":"2024-09-14T12:39:35.545289+0000","last_became_active":"2024-09-14T10:49:31.429861+0000","last_became_peered":"2024-09-14T10:49:31.429861+0000","last_unstale":"2024-09-14T12:39:35.545289+0000","last_undegraded":"2024-09-14T12:39:35.545289+0000","last_fullsized":"2024-09-14T12:39:35.545289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:13.932023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'278","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.559029+0000","last_change":"2024-09-14T10:49:33.451361+0000","last_active":"2024-09-14T12:42:24.559029+0000","last_peered":"2024-09-14T12:42:24.559029+0000","last_clean":"2024-09-14T12:42:24.559029+0000","last_became_active":"2024-09-14T10:49:33.446698+0000","last_became_peered":"2024-09-14T10:49:33.446698+0000","last_unstale":"2024-09-14T12:42:24.559029+0000","last_undegraded":"2024-09-14T12:42:24.559029+0000","last_fullsized":"2024-09-14T12:42:24.559029+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:44.754797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":288,"num_write":643,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'442","reported_seq":2142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.508259+0000","last_change":"2024-09-14T10:49:25.396269+0000","last_active":"2024-09-14T12:39:44.508259+0000","last_peered":"2024-09-14T12:39:44.508259+0000","last_clean":"2024-09-14T12:39:44.508259+0000","last_became_active":"2024-09-14T10:49:25.395644+0000","last_became_peered":"2024-09-14T10:49:25.395644+0000","last_unstale":"2024-09-14T12:39:44.508259+0000","last_undegraded":"2024-09-14T12:39:44.508259+0000","last_fullsized":"2024-09-14T12:39:44.508259+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:11.713387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2723,"num_read_kb":2577,"num_write":520,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'336","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.880592+0000","last_change":"2024-09-14T10:49:23.395500+0000","last_active":"2024-09-14T12:44:04.880592+0000","last_peered":"2024-09-14T12:44:04.880592+0000","last_clean":"2024-09-14T12:44:04.880592+0000","last_became_active":"2024-09-14T10:49:23.394870+0000","last_became_peered":"2024-09-14T10:49:23.394870+0000","last_unstale":"2024-09-14T12:44:04.880592+0000","last_undegraded":"2024-09-14T12:44:04.880592+0000","last_fullsized":"2024-09-14T12:44:04.880592+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:09.297899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":18368,"num_write":1090,"num_write_kb":30203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136301+0000","last_change":"2024-09-14T10:49:27.387706+0000","last_active":"2024-09-14T12:39:31.136301+0000","last_peered":"2024-09-14T12:39:31.136301+0000","last_clean":"2024-09-14T12:39:31.136301+0000","last_became_active":"2024-09-14T10:49:27.385720+0000","last_became_peered":"2024-09-14T10:49:27.385720+0000","last_unstale":"2024-09-14T12:39:31.136301+0000","last_undegraded":"2024-09-14T12:39:31.136301+0000","last_fullsized":"2024-09-14T12:39:31.136301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:41.338079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'338","reported_seq":970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.821897+0000","last_change":"2024-09-14T10:49:29.364739+0000","last_active":"2024-09-14T12:44:03.821897+0000","last_peered":"2024-09-14T12:44:03.821897+0000","last_clean":"2024-09-14T12:44:03.821897+0000","last_became_active":"2024-09-14T10:49:29.363989+0000","last_became_peered":"2024-09-14T10:49:29.363989+0000","last_unstale":"2024-09-14T12:44:03.821897+0000","last_undegraded":"2024-09-14T12:44:03.821897+0000","last_fullsized":"2024-09-14T12:44:03.821897+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:11.406587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1124,"num_write":422,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760421+0000","last_change":"2024-09-14T10:49:31.423380+0000","last_active":"2024-09-14T12:41:54.760421+0000","last_peered":"2024-09-14T12:41:54.760421+0000","last_clean":"2024-09-14T12:41:54.760421+0000","last_became_active":"2024-09-14T10:49:31.421636+0000","last_became_peered":"2024-09-14T10:49:31.421636+0000","last_unstale":"2024-09-14T12:41:54.760421+0000","last_undegraded":"2024-09-14T12:41:54.760421+0000","last_fullsized":"2024-09-14T12:41:54.760421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:30.278841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.656575+0000","last_change":"2024-09-14T10:49:33.466507+0000","last_active":"2024-09-14T12:43:48.656575+0000","last_peered":"2024-09-14T12:43:48.656575+0000","last_clean":"2024-09-14T12:43:48.656575+0000","last_became_active":"2024-09-14T10:49:33.465638+0000","last_became_peered":"2024-09-14T10:49:33.465638+0000","last_unstale":"2024-09-14T12:43:48.656575+0000","last_undegraded":"2024-09-14T12:43:48.656575+0000","last_fullsized":"2024-09-14T12:43:48.656575+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:13.972982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'566","reported_seq":2222,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.703947+0000","last_change":"2024-09-14T10:49:25.384614+0000","last_active":"2024-09-14T12:42:31.703947+0000","last_peered":"2024-09-14T12:42:31.703947+0000","last_clean":"2024-09-14T12:42:31.703947+0000","last_became_active":"2024-09-14T10:49:25.383840+0000","last_became_peered":"2024-09-14T10:49:25.383840+0000","last_unstale":"2024-09-14T12:42:31.703947+0000","last_undegraded":"2024-09-14T12:42:31.703947+0000","last_fullsized":"2024-09-14T12:42:31.703947+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:21.627271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2923,"num_read_kb":2712,"num_write":720,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'483","reported_seq":1184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.988945+0000","last_change":"2024-09-14T10:49:23.340003+0000","last_active":"2024-09-14T12:44:04.988945+0000","last_peered":"2024-09-14T12:44:04.988945+0000","last_clean":"2024-09-14T12:44:04.988945+0000","last_became_active":"2024-09-14T10:49:23.338934+0000","last_became_peered":"2024-09-14T10:49:23.338934+0000","last_unstale":"2024-09-14T12:44:04.988945+0000","last_undegraded":"2024-09-14T12:44:04.988945+0000","last_fullsized":"2024-09-14T12:44:04.988945+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:53.526708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":33265,"num_write":1328,"num_write_kb":49842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:30.555291+0000","last_change":"2024-09-14T10:49:27.369319+0000","last_active":"2024-09-14T12:39:30.555291+0000","last_peered":"2024-09-14T12:39:30.555291+0000","last_clean":"2024-09-14T12:39:30.555291+0000","last_became_active":"2024-09-14T10:49:27.368567+0000","last_became_peered":"2024-09-14T10:49:27.368567+0000","last_unstale":"2024-09-14T12:39:30.555291+0000","last_undegraded":"2024-09-14T12:39:30.555291+0000","last_fullsized":"2024-09-14T12:39:30.555291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:50.967591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'149","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:46.501799+0000","last_change":"2024-09-14T10:49:29.393578+0000","last_active":"2024-09-14T12:41:46.501799+0000","last_peered":"2024-09-14T12:41:46.501799+0000","last_clean":"2024-09-14T12:41:46.501799+0000","last_became_active":"2024-09-14T10:49:29.392965+0000","last_became_peered":"2024-09-14T10:49:29.392965+0000","last_unstale":"2024-09-14T12:41:46.501799+0000","last_undegraded":"2024-09-14T12:41:46.501799+0000","last_fullsized":"2024-09-14T12:41:46.501799+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.416866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":187,"num_read_kb":181,"num_write":132,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'791","reported_seq":3265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.008148+0000","last_change":"2024-09-14T10:49:31.423609+0000","last_active":"2024-09-14T12:44:05.008148+0000","last_peered":"2024-09-14T12:44:05.008148+0000","last_clean":"2024-09-14T12:44:05.008148+0000","last_became_active":"2024-09-14T10:49:31.422765+0000","last_became_peered":"2024-09-14T10:49:31.422765+0000","last_unstale":"2024-09-14T12:44:05.008148+0000","last_undegraded":"2024-09-14T12:44:05.008148+0000","last_fullsized":"2024-09-14T12:44:05.008148+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'100","reported_seq":619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:27.666413+0000","last_change":"2024-09-14T10:49:33.443828+0000","last_active":"2024-09-14T12:42:27.666413+0000","last_peered":"2024-09-14T12:42:27.666413+0000","last_clean":"2024-09-14T12:42:27.666413+0000","last_became_active":"2024-09-14T10:49:33.443020+0000","last_became_peered":"2024-09-14T10:49:33.443020+0000","last_unstale":"2024-09-14T12:42:27.666413+0000","last_undegraded":"2024-09-14T12:42:27.666413+0000","last_fullsized":"2024-09-14T12:42:27.666413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.241734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":233,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'968","reported_seq":2582,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.506058+0000","last_change":"2024-09-14T10:49:25.401196+0000","last_active":"2024-09-14T12:39:44.506058+0000","last_peered":"2024-09-14T12:39:44.506058+0000","last_clean":"2024-09-14T12:39:44.506058+0000","last_became_active":"2024-09-14T10:49:25.400786+0000","last_became_peered":"2024-09-14T10:49:25.400786+0000","last_unstale":"2024-09-14T12:39:44.506058+0000","last_undegraded":"2024-09-14T12:39:44.506058+0000","last_fullsized":"2024-09-14T12:39:44.506058+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":900,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:26.988291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4481,"num_read_kb":3955,"num_write":1321,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'333","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.925724+0000","last_change":"2024-09-14T10:49:23.395425+0000","last_active":"2024-09-14T12:44:04.925724+0000","last_peered":"2024-09-14T12:44:04.925724+0000","last_clean":"2024-09-14T12:44:04.925724+0000","last_became_active":"2024-09-14T10:49:23.394973+0000","last_became_peered":"2024-09-14T10:49:23.394973+0000","last_unstale":"2024-09-14T12:44:04.925724+0000","last_undegraded":"2024-09-14T12:44:04.925724+0000","last_fullsized":"2024-09-14T12:44:04.925724+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.054954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":75765,"num_write":1031,"num_write_kb":39860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:30.533301+0000","last_change":"2024-09-14T10:49:27.378358+0000","last_active":"2024-09-14T12:39:30.533301+0000","last_peered":"2024-09-14T12:39:30.533301+0000","last_clean":"2024-09-14T12:39:30.533301+0000","last_became_active":"2024-09-14T10:49:27.377395+0000","last_became_peered":"2024-09-14T10:49:27.377395+0000","last_unstale":"2024-09-14T12:39:30.533301+0000","last_undegraded":"2024-09-14T12:39:30.533301+0000","last_fullsized":"2024-09-14T12:39:30.533301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:07.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'394","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.305397+0000","last_change":"2024-09-14T10:49:29.377185+0000","last_active":"2024-09-14T12:44:04.305397+0000","last_peered":"2024-09-14T12:44:04.305397+0000","last_clean":"2024-09-14T12:44:04.305397+0000","last_became_active":"2024-09-14T10:49:29.376813+0000","last_became_peered":"2024-09-14T10:49:29.376813+0000","last_unstale":"2024-09-14T12:44:04.305397+0000","last_undegraded":"2024-09-14T12:44:04.305397+0000","last_fullsized":"2024-09-14T12:44:04.305397+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.599152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":628,"num_read_kb":1214,"num_write":492,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571666+0000","last_change":"2024-09-14T10:49:31.425171+0000","last_active":"2024-09-14T12:40:45.571666+0000","last_peered":"2024-09-14T12:40:45.571666+0000","last_clean":"2024-09-14T12:40:45.571666+0000","last_became_active":"2024-09-14T10:49:31.424394+0000","last_became_peered":"2024-09-14T10:49:31.424394+0000","last_unstale":"2024-09-14T12:40:45.571666+0000","last_undegraded":"2024-09-14T12:40:45.571666+0000","last_fullsized":"2024-09-14T12:40:45.571666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:07.004493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'151","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.578263+0000","last_change":"2024-09-14T10:49:33.463294+0000","last_active":"2024-09-14T12:42:24.578263+0000","last_peered":"2024-09-14T12:42:24.578263+0000","last_clean":"2024-09-14T12:42:24.578263+0000","last_became_active":"2024-09-14T10:49:33.462582+0000","last_became_peered":"2024-09-14T10:49:33.462582+0000","last_unstale":"2024-09-14T12:42:24.578263+0000","last_undegraded":"2024-09-14T12:42:24.578263+0000","last_fullsized":"2024-09-14T12:42:24.578263+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:51.070074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":151,"num_write":347,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'487","reported_seq":2225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.769121+0000","last_change":"2024-09-14T10:49:25.387231+0000","last_active":"2024-09-14T12:42:31.769121+0000","last_peered":"2024-09-14T12:42:31.769121+0000","last_clean":"2024-09-14T12:42:31.769121+0000","last_became_active":"2024-09-14T10:49:25.386937+0000","last_became_peered":"2024-09-14T10:49:25.386937+0000","last_unstale":"2024-09-14T12:42:31.769121+0000","last_undegraded":"2024-09-14T12:42:31.769121+0000","last_fullsized":"2024-09-14T12:42:31.769121+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:41.631753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2676,"num_write":566,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'362","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.972243+0000","last_change":"2024-09-14T10:49:53.506313+0000","last_active":"2024-09-14T12:44:04.972243+0000","last_peered":"2024-09-14T12:44:04.972243+0000","last_clean":"2024-09-14T12:44:04.972243+0000","last_became_active":"2024-09-14T10:49:53.505479+0000","last_became_peered":"2024-09-14T10:49:53.505479+0000","last_unstale":"2024-09-14T12:44:04.972243+0000","last_undegraded":"2024-09-14T12:44:04.972243+0000","last_fullsized":"2024-09-14T12:44:04.972243+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:20.359828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3150208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":68230,"num_write":1159,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1,6],"acting":[3,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136252+0000","last_change":"2024-09-14T10:49:27.371936+0000","last_active":"2024-09-14T12:39:31.136252+0000","last_peered":"2024-09-14T12:39:31.136252+0000","last_clean":"2024-09-14T12:39:31.136252+0000","last_became_active":"2024-09-14T10:49:27.371450+0000","last_became_peered":"2024-09-14T10:49:27.371450+0000","last_unstale":"2024-09-14T12:39:31.136252+0000","last_undegraded":"2024-09-14T12:39:31.136252+0000","last_fullsized":"2024-09-14T12:39:31.136252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:11.677326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'300","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.384380+0000","last_change":"2024-09-14T10:49:29.380669+0000","last_active":"2024-09-14T12:44:04.384380+0000","last_peered":"2024-09-14T12:44:04.384380+0000","last_clean":"2024-09-14T12:44:04.384380+0000","last_became_active":"2024-09-14T10:49:29.379942+0000","last_became_peered":"2024-09-14T10:49:29.379942+0000","last_unstale":"2024-09-14T12:44:04.384380+0000","last_undegraded":"2024-09-14T12:44:04.384380+0000","last_fullsized":"2024-09-14T12:44:04.384380+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:50.784831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1051,"num_write":386,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490245+0000","last_change":"2024-09-14T10:49:31.430688+0000","last_active":"2024-09-14T12:41:01.490245+0000","last_peered":"2024-09-14T12:41:01.490245+0000","last_clean":"2024-09-14T12:41:01.490245+0000","last_became_active":"2024-09-14T10:49:31.424882+0000","last_became_peered":"2024-09-14T10:49:31.424882+0000","last_unstale":"2024-09-14T12:41:01.490245+0000","last_undegraded":"2024-09-14T12:41:01.490245+0000","last_fullsized":"2024-09-14T12:41:01.490245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:10.035901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'115","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.540999+0000","last_change":"2024-09-14T10:49:33.469121+0000","last_active":"2024-09-14T12:41:29.540999+0000","last_peered":"2024-09-14T12:41:29.540999+0000","last_clean":"2024-09-14T12:41:29.540999+0000","last_became_active":"2024-09-14T10:49:33.468026+0000","last_became_peered":"2024-09-14T10:49:33.468026+0000","last_unstale":"2024-09-14T12:41:29.540999+0000","last_undegraded":"2024-09-14T12:41:29.540999+0000","last_fullsized":"2024-09-14T12:41:29.540999+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:54.591274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":167,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'978","reported_seq":2671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.736717+0000","last_change":"2024-09-14T10:49:25.386916+0000","last_active":"2024-09-14T12:41:23.736717+0000","last_peered":"2024-09-14T12:41:23.736717+0000","last_clean":"2024-09-14T12:41:23.736717+0000","last_became_active":"2024-09-14T10:49:25.386168+0000","last_became_peered":"2024-09-14T10:49:25.386168+0000","last_unstale":"2024-09-14T12:41:23.736717+0000","last_undegraded":"2024-09-14T12:41:23.736717+0000","last_fullsized":"2024-09-14T12:41:23.736717+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":900,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.415912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4881,"num_read_kb":4356,"num_write":1346,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'333","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.794312+0000","last_change":"2024-09-14T10:49:23.368770+0000","last_active":"2024-09-14T12:44:04.794312+0000","last_peered":"2024-09-14T12:44:04.794312+0000","last_clean":"2024-09-14T12:44:04.794312+0000","last_became_active":"2024-09-14T10:49:23.367940+0000","last_became_peered":"2024-09-14T10:49:23.367940+0000","last_unstale":"2024-09-14T12:44:04.794312+0000","last_undegraded":"2024-09-14T12:44:04.794312+0000","last_fullsized":"2024-09-14T12:44:04.794312+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:45.609107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":29401,"num_write":1062,"num_write_kb":29053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549364+0000","last_change":"2024-09-14T10:49:27.381081+0000","last_active":"2024-09-14T12:40:40.549364+0000","last_peered":"2024-09-14T12:40:40.549364+0000","last_clean":"2024-09-14T12:40:40.549364+0000","last_became_active":"2024-09-14T10:49:27.380333+0000","last_became_peered":"2024-09-14T10:49:27.380333+0000","last_unstale":"2024-09-14T12:40:40.549364+0000","last_undegraded":"2024-09-14T12:40:40.549364+0000","last_fullsized":"2024-09-14T12:40:40.549364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:32.329024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'243","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.668768+0000","last_change":"2024-09-14T10:49:29.378365+0000","last_active":"2024-09-14T12:44:03.668768+0000","last_peered":"2024-09-14T12:44:03.668768+0000","last_clean":"2024-09-14T12:44:03.668768+0000","last_became_active":"2024-09-14T10:49:29.377643+0000","last_became_peered":"2024-09-14T10:49:29.377643+0000","last_unstale":"2024-09-14T12:44:03.668768+0000","last_undegraded":"2024-09-14T12:44:03.668768+0000","last_fullsized":"2024-09-14T12:44:03.668768+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:11.214340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":877,"num_write":306,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468822+0000","last_change":"2024-09-14T10:49:31.431402+0000","last_active":"2024-09-14T12:39:36.468822+0000","last_peered":"2024-09-14T12:39:36.468822+0000","last_clean":"2024-09-14T12:39:36.468822+0000","last_became_active":"2024-09-14T10:49:31.430693+0000","last_became_peered":"2024-09-14T10:49:31.430693+0000","last_unstale":"2024-09-14T12:39:36.468822+0000","last_undegraded":"2024-09-14T12:39:36.468822+0000","last_fullsized":"2024-09-14T12:39:36.468822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:32.715814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'154","reported_seq":1639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.449796+0000","last_change":"2024-09-14T10:49:33.476298+0000","last_active":"2024-09-14T12:42:24.449796+0000","last_peered":"2024-09-14T12:42:24.449796+0000","last_clean":"2024-09-14T12:42:24.449796+0000","last_became_active":"2024-09-14T10:49:33.475592+0000","last_became_peered":"2024-09-14T10:49:33.475592+0000","last_unstale":"2024-09-14T12:42:24.449796+0000","last_undegraded":"2024-09-14T12:42:24.449796+0000","last_fullsized":"2024-09-14T12:42:24.449796+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:10.319176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1153,"num_read_kb":1151,"num_write":333,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'1200","reported_seq":2911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.582879+0000","last_change":"2024-09-14T10:49:25.362578+0000","last_active":"2024-09-14T12:41:29.582879+0000","last_peered":"2024-09-14T12:41:29.582879+0000","last_clean":"2024-09-14T12:41:29.582879+0000","last_became_active":"2024-09-14T10:49:25.362059+0000","last_became_peered":"2024-09-14T10:49:25.362059+0000","last_unstale":"2024-09-14T12:41:29.582879+0000","last_undegraded":"2024-09-14T12:41:29.582879+0000","last_fullsized":"2024-09-14T12:41:29.582879+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:36.132405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5522,"num_read_kb":4921,"num_write":1640,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'397","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.970941+0000","last_change":"2024-09-14T10:49:23.382568+0000","last_active":"2024-09-14T12:44:04.970941+0000","last_peered":"2024-09-14T12:44:04.970941+0000","last_clean":"2024-09-14T12:44:04.970941+0000","last_became_active":"2024-09-14T10:49:23.381620+0000","last_became_peered":"2024-09-14T10:49:23.381620+0000","last_unstale":"2024-09-14T12:44:04.970941+0000","last_undegraded":"2024-09-14T12:44:04.970941+0000","last_fullsized":"2024-09-14T12:44:04.970941+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:07.597062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":34199,"num_write":1236,"num_write_kb":46564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:10.577149+0000","last_change":"2024-09-14T10:49:27.373477+0000","last_active":"2024-09-14T12:41:10.577149+0000","last_peered":"2024-09-14T12:41:10.577149+0000","last_clean":"2024-09-14T12:41:10.577149+0000","last_became_active":"2024-09-14T10:49:27.372685+0000","last_became_peered":"2024-09-14T10:49:27.372685+0000","last_unstale":"2024-09-14T12:41:10.577149+0000","last_undegraded":"2024-09-14T12:41:10.577149+0000","last_fullsized":"2024-09-14T12:41:10.577149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:18.351337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'331","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.893167+0000","last_change":"2024-09-14T10:49:29.397492+0000","last_active":"2024-09-14T12:44:03.893167+0000","last_peered":"2024-09-14T12:44:03.893167+0000","last_clean":"2024-09-14T12:44:03.893167+0000","last_became_active":"2024-09-14T10:49:29.396379+0000","last_became_peered":"2024-09-14T10:49:29.396379+0000","last_unstale":"2024-09-14T12:44:03.893167+0000","last_undegraded":"2024-09-14T12:44:03.893167+0000","last_fullsized":"2024-09-14T12:44:03.893167+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:50.814297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":1145,"num_write":432,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.556297+0000","last_change":"2024-09-14T10:49:31.420969+0000","last_active":"2024-09-14T12:39:35.556297+0000","last_peered":"2024-09-14T12:39:35.556297+0000","last_clean":"2024-09-14T12:39:35.556297+0000","last_became_active":"2024-09-14T10:49:31.418819+0000","last_became_peered":"2024-09-14T10:49:31.418819+0000","last_unstale":"2024-09-14T12:39:35.556297+0000","last_undegraded":"2024-09-14T12:39:35.556297+0000","last_fullsized":"2024-09-14T12:39:35.556297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:53.067509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'132","reported_seq":679,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.601534+0000","last_change":"2024-09-14T10:49:33.477067+0000","last_active":"2024-09-14T12:43:47.601534+0000","last_peered":"2024-09-14T12:43:47.601534+0000","last_clean":"2024-09-14T12:43:47.601534+0000","last_became_active":"2024-09-14T10:49:33.476455+0000","last_became_peered":"2024-09-14T10:49:33.476455+0000","last_unstale":"2024-09-14T12:43:47.601534+0000","last_undegraded":"2024-09-14T12:43:47.601534+0000","last_fullsized":"2024-09-14T12:43:47.601534+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:57.442153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":173,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'504","reported_seq":2191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.582161+0000","last_change":"2024-09-14T10:49:25.374531+0000","last_active":"2024-09-14T12:41:29.582161+0000","last_peered":"2024-09-14T12:41:29.582161+0000","last_clean":"2024-09-14T12:41:29.582161+0000","last_became_active":"2024-09-14T10:49:25.373337+0000","last_became_peered":"2024-09-14T10:49:25.373337+0000","last_unstale":"2024-09-14T12:41:29.582161+0000","last_undegraded":"2024-09-14T12:41:29.582161+0000","last_fullsized":"2024-09-14T12:41:29.582161+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:13.554009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2857,"num_read_kb":2693,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'347","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.947242+0000","last_change":"2024-09-14T10:49:23.378184+0000","last_active":"2024-09-14T12:44:04.947242+0000","last_peered":"2024-09-14T12:44:04.947242+0000","last_clean":"2024-09-14T12:44:04.947242+0000","last_became_active":"2024-09-14T10:49:23.377766+0000","last_became_peered":"2024-09-14T10:49:23.377766+0000","last_unstale":"2024-09-14T12:44:04.947242+0000","last_undegraded":"2024-09-14T12:44:04.947242+0000","last_fullsized":"2024-09-14T12:44:04.947242+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:23.916084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":614,"num_read_kb":20992,"num_write":1055,"num_write_kb":39444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'622","reported_seq":2307,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.828646+0000","last_change":"2024-09-14T10:49:25.376291+0000","last_active":"2024-09-14T12:41:11.828646+0000","last_peered":"2024-09-14T12:41:11.828646+0000","last_clean":"2024-09-14T12:41:11.828646+0000","last_became_active":"2024-09-14T10:49:25.375595+0000","last_became_peered":"2024-09-14T10:49:25.375595+0000","last_unstale":"2024-09-14T12:41:11.828646+0000","last_undegraded":"2024-09-14T12:41:11.828646+0000","last_fullsized":"2024-09-14T12:41:11.828646+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:54.871887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3344,"num_read_kb":3023,"num_write":799,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'295","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.954678+0000","last_change":"2024-09-14T10:49:23.392114+0000","last_active":"2024-09-14T12:44:04.954678+0000","last_peered":"2024-09-14T12:44:04.954678+0000","last_clean":"2024-09-14T12:44:04.954678+0000","last_became_active":"2024-09-14T10:49:23.390456+0000","last_became_peered":"2024-09-14T10:49:23.390456+0000","last_unstale":"2024-09-14T12:44:04.954678+0000","last_undegraded":"2024-09-14T12:44:04.954678+0000","last_fullsized":"2024-09-14T12:44:04.954678+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:19.921702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":9558,"num_write":877,"num_write_kb":19994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'455","reported_seq":2085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.608380+0000","last_change":"2024-09-14T10:49:25.377312+0000","last_active":"2024-09-14T12:43:47.608380+0000","last_peered":"2024-09-14T12:43:47.608380+0000","last_clean":"2024-09-14T12:43:47.608380+0000","last_became_active":"2024-09-14T10:49:25.372436+0000","last_became_peered":"2024-09-14T10:49:25.372436+0000","last_unstale":"2024-09-14T12:43:47.608380+0000","last_undegraded":"2024-09-14T12:43:47.608380+0000","last_fullsized":"2024-09-14T12:43:47.608380+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:05.450288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2453,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'344","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.908956+0000","last_change":"2024-09-14T10:49:23.395538+0000","last_active":"2024-09-14T12:44:04.908956+0000","last_peered":"2024-09-14T12:44:04.908956+0000","last_clean":"2024-09-14T12:44:04.908956+0000","last_became_active":"2024-09-14T10:49:23.395161+0000","last_became_peered":"2024-09-14T10:49:23.395161+0000","last_unstale":"2024-09-14T12:44:04.908956+0000","last_undegraded":"2024-09-14T12:44:04.908956+0000","last_fullsized":"2024-09-14T12:44:04.908956+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:29.846931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":8858,"num_write":1038,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'753","reported_seq":2450,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.132003+0000","last_change":"2024-09-14T10:49:25.391763+0000","last_active":"2024-09-14T12:42:22.132003+0000","last_peered":"2024-09-14T12:42:22.132003+0000","last_clean":"2024-09-14T12:42:22.132003+0000","last_became_active":"2024-09-14T10:49:25.390167+0000","last_became_peered":"2024-09-14T10:49:25.390167+0000","last_unstale":"2024-09-14T12:42:22.132003+0000","last_undegraded":"2024-09-14T12:42:22.132003+0000","last_fullsized":"2024-09-14T12:42:22.132003+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:14.035163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3780,"num_read_kb":3460,"num_write":968,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'367","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.841485+0000","last_change":"2024-09-14T10:49:23.375090+0000","last_active":"2024-09-14T12:44:04.841485+0000","last_peered":"2024-09-14T12:44:04.841485+0000","last_clean":"2024-09-14T12:44:04.841485+0000","last_became_active":"2024-09-14T10:49:23.374332+0000","last_became_peered":"2024-09-14T10:49:23.374332+0000","last_unstale":"2024-09-14T12:44:04.841485+0000","last_undegraded":"2024-09-14T12:44:04.841485+0000","last_fullsized":"2024-09-14T12:44:04.841485+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:00.345348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":1430,"num_write":1267,"num_write_kb":16611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'435","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.715675+0000","last_change":"2024-09-14T10:49:25.391424+0000","last_active":"2024-09-14T12:42:31.715675+0000","last_peered":"2024-09-14T12:42:31.715675+0000","last_clean":"2024-09-14T12:42:31.715675+0000","last_became_active":"2024-09-14T10:49:25.390444+0000","last_became_peered":"2024-09-14T10:49:25.390444+0000","last_unstale":"2024-09-14T12:42:31.715675+0000","last_undegraded":"2024-09-14T12:42:31.715675+0000","last_fullsized":"2024-09-14T12:42:31.715675+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:26.275135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2280,"num_write":506,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'317","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.973198+0000","last_change":"2024-09-14T10:49:23.365856+0000","last_active":"2024-09-14T12:44:04.973198+0000","last_peered":"2024-09-14T12:44:04.973198+0000","last_clean":"2024-09-14T12:44:04.973198+0000","last_became_active":"2024-09-14T10:49:23.365007+0000","last_became_peered":"2024-09-14T10:49:23.365007+0000","last_unstale":"2024-09-14T12:44:04.973198+0000","last_undegraded":"2024-09-14T12:44:04.973198+0000","last_fullsized":"2024-09-14T12:44:04.973198+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:22.123987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":40511,"num_write":1024,"num_write_kb":34103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'617","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.811795+0000","last_change":"2024-09-14T10:49:25.381143+0000","last_active":"2024-09-14T12:41:55.811795+0000","last_peered":"2024-09-14T12:41:55.811795+0000","last_clean":"2024-09-14T12:41:55.811795+0000","last_became_active":"2024-09-14T10:49:25.380751+0000","last_became_peered":"2024-09-14T10:49:25.380751+0000","last_unstale":"2024-09-14T12:41:55.811795+0000","last_undegraded":"2024-09-14T12:41:55.811795+0000","last_fullsized":"2024-09-14T12:41:55.811795+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:26.129271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3385,"num_read_kb":3142,"num_write":784,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'366","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.898940+0000","last_change":"2024-09-14T10:49:23.367673+0000","last_active":"2024-09-14T12:44:04.898940+0000","last_peered":"2024-09-14T12:44:04.898940+0000","last_clean":"2024-09-14T12:44:04.898940+0000","last_became_active":"2024-09-14T10:49:23.366946+0000","last_became_peered":"2024-09-14T10:49:23.366946+0000","last_unstale":"2024-09-14T12:44:04.898940+0000","last_undegraded":"2024-09-14T12:44:04.898940+0000","last_fullsized":"2024-09-14T12:44:04.898940+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:45.550841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":15339,"num_write":1195,"num_write_kb":33762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'817","reported_seq":2544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.209601+0000","last_change":"2024-09-14T10:49:25.395514+0000","last_active":"2024-09-14T12:42:22.209601+0000","last_peered":"2024-09-14T12:42:22.209601+0000","last_clean":"2024-09-14T12:42:22.209601+0000","last_became_active":"2024-09-14T10:49:25.394994+0000","last_became_peered":"2024-09-14T10:49:25.394994+0000","last_unstale":"2024-09-14T12:42:22.209601+0000","last_undegraded":"2024-09-14T12:42:22.209601+0000","last_fullsized":"2024-09-14T12:42:22.209601+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:10.461194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4031,"num_read_kb":3664,"num_write":1069,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'391","reported_seq":1240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.977390+0000","last_change":"2024-09-14T10:49:23.373580+0000","last_active":"2024-09-14T12:44:04.977390+0000","last_peered":"2024-09-14T12:44:04.977390+0000","last_clean":"2024-09-14T12:44:04.977390+0000","last_became_active":"2024-09-14T10:49:23.373080+0000","last_became_peered":"2024-09-14T10:49:23.373080+0000","last_unstale":"2024-09-14T12:44:04.977390+0000","last_undegraded":"2024-09-14T12:44:04.977390+0000","last_fullsized":"2024-09-14T12:44:04.977390+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:31.818739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1418,"num_read_kb":12734,"num_write":1224,"num_write_kb":19451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'534","reported_seq":2270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568255+0000","last_change":"2024-09-14T10:49:25.376719+0000","last_active":"2024-09-14T12:41:55.568255+0000","last_peered":"2024-09-14T12:41:55.568255+0000","last_clean":"2024-09-14T12:41:55.568255+0000","last_became_active":"2024-09-14T10:49:25.375465+0000","last_became_peered":"2024-09-14T10:49:25.375465+0000","last_unstale":"2024-09-14T12:41:55.568255+0000","last_undegraded":"2024-09-14T12:41:55.568255+0000","last_fullsized":"2024-09-14T12:41:55.568255+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.679259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2646,"num_write":644,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'334","reported_seq":987,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.883276+0000","last_change":"2024-09-14T10:49:23.378694+0000","last_active":"2024-09-14T12:44:04.883276+0000","last_peered":"2024-09-14T12:44:04.883276+0000","last_clean":"2024-09-14T12:44:04.883276+0000","last_became_active":"2024-09-14T10:49:23.377964+0000","last_became_peered":"2024-09-14T10:49:23.377964+0000","last_unstale":"2024-09-14T12:44:04.883276+0000","last_undegraded":"2024-09-14T12:44:04.883276+0000","last_fullsized":"2024-09-14T12:44:04.883276+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:24.829760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":579,"num_read_kb":6819,"num_write":1090,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'851","reported_seq":2405,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.209489+0000","last_change":"2024-09-14T10:49:25.387331+0000","last_active":"2024-09-14T12:42:22.209489+0000","last_peered":"2024-09-14T12:42:22.209489+0000","last_clean":"2024-09-14T12:42:22.209489+0000","last_became_active":"2024-09-14T10:49:25.386541+0000","last_became_peered":"2024-09-14T10:49:25.386541+0000","last_unstale":"2024-09-14T12:42:22.209489+0000","last_undegraded":"2024-09-14T12:42:22.209489+0000","last_fullsized":"2024-09-14T12:42:22.209489+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:37.887330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3987,"num_read_kb":3560,"num_write":1145,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'399","reported_seq":1075,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.882345+0000","last_change":"2024-09-14T10:49:23.387632+0000","last_active":"2024-09-14T12:44:04.882345+0000","last_peered":"2024-09-14T12:44:04.882345+0000","last_clean":"2024-09-14T12:44:04.882345+0000","last_became_active":"2024-09-14T10:49:23.387245+0000","last_became_peered":"2024-09-14T10:49:23.387245+0000","last_unstale":"2024-09-14T12:44:04.882345+0000","last_undegraded":"2024-09-14T12:44:04.882345+0000","last_fullsized":"2024-09-14T12:44:04.882345+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:39.385206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":46181,"num_write":1283,"num_write_kb":35513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'848","reported_seq":2611,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.452842+0000","last_change":"2024-09-14T10:49:25.374040+0000","last_active":"2024-09-14T12:42:29.452842+0000","last_peered":"2024-09-14T12:42:29.452842+0000","last_clean":"2024-09-14T12:42:29.452842+0000","last_became_active":"2024-09-14T10:49:25.373511+0000","last_became_peered":"2024-09-14T10:49:25.373511+0000","last_unstale":"2024-09-14T12:42:29.452842+0000","last_undegraded":"2024-09-14T12:42:29.452842+0000","last_fullsized":"2024-09-14T12:42:29.452842+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:06.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4179,"num_read_kb":3797,"num_write":1119,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'377","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.935169+0000","last_change":"2024-09-14T10:49:23.378107+0000","last_active":"2024-09-14T12:44:04.935169+0000","last_peered":"2024-09-14T12:44:04.935169+0000","last_clean":"2024-09-14T12:44:04.935169+0000","last_became_active":"2024-09-14T10:49:23.377218+0000","last_became_peered":"2024-09-14T10:49:23.377218+0000","last_unstale":"2024-09-14T12:44:04.935169+0000","last_undegraded":"2024-09-14T12:44:04.935169+0000","last_fullsized":"2024-09-14T12:44:04.935169+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:31.856619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5360649,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":652,"num_read_kb":6958,"num_write":1198,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'524","reported_seq":2129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.731901+0000","last_change":"2024-09-14T10:49:25.395953+0000","last_active":"2024-09-14T12:41:23.731901+0000","last_peered":"2024-09-14T12:41:23.731901+0000","last_clean":"2024-09-14T12:41:23.731901+0000","last_became_active":"2024-09-14T10:49:25.394237+0000","last_became_peered":"2024-09-14T10:49:25.394237+0000","last_unstale":"2024-09-14T12:41:23.731901+0000","last_undegraded":"2024-09-14T12:41:23.731901+0000","last_fullsized":"2024-09-14T12:41:23.731901+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:13.449753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2610,"num_write":682,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'385","reported_seq":1090,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.985942+0000","last_change":"2024-09-14T10:49:23.372390+0000","last_active":"2024-09-14T12:44:04.985942+0000","last_peered":"2024-09-14T12:44:04.985942+0000","last_clean":"2024-09-14T12:44:04.985942+0000","last_became_active":"2024-09-14T10:49:23.371845+0000","last_became_peered":"2024-09-14T10:49:23.371845+0000","last_unstale":"2024-09-14T12:44:04.985942+0000","last_undegraded":"2024-09-14T12:44:04.985942+0000","last_fullsized":"2024-09-14T12:44:04.985942+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":30325,"num_write":1182,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'407","reported_seq":1829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.763979+0000","last_change":"2024-09-14T10:49:25.375748+0000","last_active":"2024-09-14T12:42:31.763979+0000","last_peered":"2024-09-14T12:42:31.763979+0000","last_clean":"2024-09-14T12:42:31.763979+0000","last_became_active":"2024-09-14T10:49:25.375374+0000","last_became_peered":"2024-09-14T10:49:25.375374+0000","last_unstale":"2024-09-14T12:42:31.763979+0000","last_undegraded":"2024-09-14T12:42:31.763979+0000","last_fullsized":"2024-09-14T12:42:31.763979+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2030,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'390","reported_seq":1115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.989030+0000","last_change":"2024-09-14T10:49:23.373160+0000","last_active":"2024-09-14T12:44:04.989030+0000","last_peered":"2024-09-14T12:44:04.989030+0000","last_clean":"2024-09-14T12:44:04.989030+0000","last_became_active":"2024-09-14T10:49:23.371987+0000","last_became_peered":"2024-09-14T10:49:23.371987+0000","last_unstale":"2024-09-14T12:44:04.989030+0000","last_undegraded":"2024-09-14T12:44:04.989030+0000","last_fullsized":"2024-09-14T12:44:04.989030+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:57.645505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":722,"num_read_kb":54432,"num_write":1171,"num_write_kb":38478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'764","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.452056+0000","last_change":"2024-09-14T10:49:25.404779+0000","last_active":"2024-09-14T12:42:29.452056+0000","last_peered":"2024-09-14T12:42:29.452056+0000","last_clean":"2024-09-14T12:42:29.452056+0000","last_became_active":"2024-09-14T10:49:25.404302+0000","last_became_peered":"2024-09-14T10:49:25.404302+0000","last_unstale":"2024-09-14T12:42:29.452056+0000","last_undegraded":"2024-09-14T12:42:29.452056+0000","last_fullsized":"2024-09-14T12:42:29.452056+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3673,"num_read_kb":3318,"num_write":995,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'392","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.973110+0000","last_change":"2024-09-14T10:49:23.373328+0000","last_active":"2024-09-14T12:44:04.973110+0000","last_peered":"2024-09-14T12:44:04.973110+0000","last_clean":"2024-09-14T12:44:04.973110+0000","last_became_active":"2024-09-14T10:49:23.372362+0000","last_became_peered":"2024-09-14T10:49:23.372362+0000","last_unstale":"2024-09-14T12:44:04.973110+0000","last_undegraded":"2024-09-14T12:44:04.973110+0000","last_fullsized":"2024-09-14T12:44:04.973110+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":10747,"num_write":1199,"num_write_kb":31883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"267'887","reported_seq":2536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.611847+0000","last_change":"2024-09-14T10:49:25.379008+0000","last_active":"2024-09-14T12:43:47.611847+0000","last_peered":"2024-09-14T12:43:47.611847+0000","last_clean":"2024-09-14T12:43:47.611847+0000","last_became_active":"2024-09-14T10:49:25.378231+0000","last_became_peered":"2024-09-14T10:49:25.378231+0000","last_unstale":"2024-09-14T12:43:47.611847+0000","last_undegraded":"2024-09-14T12:43:47.611847+0000","last_fullsized":"2024-09-14T12:43:47.611847+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:27.346745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4260,"num_read_kb":3817,"num_write":1188,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'382","reported_seq":1156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.908514+0000","last_change":"2024-09-14T10:49:23.396632+0000","last_active":"2024-09-14T12:44:04.908514+0000","last_peered":"2024-09-14T12:44:04.908514+0000","last_clean":"2024-09-14T12:44:04.908514+0000","last_became_active":"2024-09-14T10:49:23.396179+0000","last_became_peered":"2024-09-14T10:49:23.396179+0000","last_unstale":"2024-09-14T12:44:04.908514+0000","last_undegraded":"2024-09-14T12:44:04.908514+0000","last_fullsized":"2024-09-14T12:44:04.908514+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:19.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1034,"num_read_kb":35151,"num_write":1252,"num_write_kb":27361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'452","reported_seq":1989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.690518+0000","last_change":"2024-09-14T10:49:25.387446+0000","last_active":"2024-09-14T12:43:47.690518+0000","last_peered":"2024-09-14T12:43:47.690518+0000","last_clean":"2024-09-14T12:43:47.690518+0000","last_became_active":"2024-09-14T10:49:25.386602+0000","last_became_peered":"2024-09-14T10:49:25.386602+0000","last_unstale":"2024-09-14T12:43:47.690518+0000","last_undegraded":"2024-09-14T12:43:47.690518+0000","last_fullsized":"2024-09-14T12:43:47.690518+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:41.415729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2532,"num_read_kb":2369,"num_write":580,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'365","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.970208+0000","last_change":"2024-09-14T10:49:23.370968+0000","last_active":"2024-09-14T12:44:04.970208+0000","last_peered":"2024-09-14T12:44:04.970208+0000","last_clean":"2024-09-14T12:44:04.970208+0000","last_became_active":"2024-09-14T10:49:23.369989+0000","last_became_peered":"2024-09-14T10:49:23.369989+0000","last_unstale":"2024-09-14T12:44:04.970208+0000","last_undegraded":"2024-09-14T12:44:04.970208+0000","last_fullsized":"2024-09-14T12:44:04.970208+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:46.807806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":696,"num_read_kb":14222,"num_write":1159,"num_write_kb":28974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'1263","reported_seq":2959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:20.544825+0000","last_change":"2024-09-14T10:49:25.408105+0000","last_active":"2024-09-14T12:40:20.544825+0000","last_peered":"2024-09-14T12:40:20.544825+0000","last_clean":"2024-09-14T12:40:20.544825+0000","last_became_active":"2024-09-14T10:49:25.407817+0000","last_became_peered":"2024-09-14T10:49:25.407817+0000","last_unstale":"2024-09-14T12:40:20.544825+0000","last_undegraded":"2024-09-14T12:40:20.544825+0000","last_fullsized":"2024-09-14T12:40:20.544825+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":1200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:28.857748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5850,"num_read_kb":5153,"num_write":1753,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'378","reported_seq":1136,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.941687+0000","last_change":"2024-09-14T10:49:23.366572+0000","last_active":"2024-09-14T12:44:04.941687+0000","last_peered":"2024-09-14T12:44:04.941687+0000","last_clean":"2024-09-14T12:44:04.941687+0000","last_became_active":"2024-09-14T10:49:23.365975+0000","last_became_peered":"2024-09-14T10:49:23.365975+0000","last_unstale":"2024-09-14T12:44:04.941687+0000","last_undegraded":"2024-09-14T12:44:04.941687+0000","last_fullsized":"2024-09-14T12:44:04.941687+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:46.697172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":962,"num_read_kb":99658,"num_write":1167,"num_write_kb":35935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'346","reported_seq":1084,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.962269+0000","last_change":"2024-09-14T10:49:23.374017+0000","last_active":"2024-09-14T12:44:04.962269+0000","last_peered":"2024-09-14T12:44:04.962269+0000","last_clean":"2024-09-14T12:44:04.962269+0000","last_became_active":"2024-09-14T10:49:23.373652+0000","last_became_peered":"2024-09-14T10:49:23.373652+0000","last_unstale":"2024-09-14T12:44:04.962269+0000","last_undegraded":"2024-09-14T12:44:04.962269+0000","last_fullsized":"2024-09-14T12:44:04.962269+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:34.956815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":808,"num_write":1082,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'429","reported_seq":2023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.767109+0000","last_change":"2024-09-14T10:49:25.400404+0000","last_active":"2024-09-14T12:42:31.767109+0000","last_peered":"2024-09-14T12:42:31.767109+0000","last_clean":"2024-09-14T12:42:31.767109+0000","last_became_active":"2024-09-14T10:49:25.399830+0000","last_became_peered":"2024-09-14T10:49:25.399830+0000","last_unstale":"2024-09-14T12:42:31.767109+0000","last_undegraded":"2024-09-14T12:42:31.767109+0000","last_fullsized":"2024-09-14T12:42:31.767109+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:56.425228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2288,"num_read_kb":2174,"num_write":485,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'357","reported_seq":1109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.957591+0000","last_change":"2024-09-14T10:49:23.384640+0000","last_active":"2024-09-14T12:44:04.957591+0000","last_peered":"2024-09-14T12:44:04.957591+0000","last_clean":"2024-09-14T12:44:04.957591+0000","last_became_active":"2024-09-14T10:49:23.382302+0000","last_became_peered":"2024-09-14T10:49:23.382302+0000","last_unstale":"2024-09-14T12:44:04.957591+0000","last_undegraded":"2024-09-14T12:44:04.957591+0000","last_fullsized":"2024-09-14T12:44:04.957591+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:19.687554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":853,"num_read_kb":33665,"num_write":1061,"num_write_kb":42742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'432","reported_seq":2105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:16.791117+0000","last_change":"2024-09-14T10:49:25.392230+0000","last_active":"2024-09-14T12:41:16.791117+0000","last_peered":"2024-09-14T12:41:16.791117+0000","last_clean":"2024-09-14T12:41:16.791117+0000","last_became_active":"2024-09-14T10:49:25.391680+0000","last_became_peered":"2024-09-14T10:49:25.391680+0000","last_unstale":"2024-09-14T12:41:16.791117+0000","last_undegraded":"2024-09-14T12:41:16.791117+0000","last_fullsized":"2024-09-14T12:41:16.791117+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:29.701571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2427,"num_read_kb":2321,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10880,"num_read_kb":8996,"num_write":3119,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15325,"num_read_kb":14960,"num_write":17100,"num_write_kb":5007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":570,"ondisk_log_size":570,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637897,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":21147,"num_read_kb":41034,"num_write":17727,"num_write_kb":12782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221603,"num_read_kb":202842,"num_write":56199,"num_write_kb":19273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3589,"ondisk_log_size":3589,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42369360,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44646,"num_read_kb":1985232,"num_write":73593,"num_write_kb":2196624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58359808,"data_stored":58359808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3987,"ondisk_log_size":3987,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":168154,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":167578,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510828,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117032,"kb_used_data":9404,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94254808,"statfs":{"total":96636764160,"available":96516923392,"internally_reserved":0,"allocated":9629696,"data_stored":7595829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510827,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281840,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94090000,"statfs":{"total":96636764160,"available":96348160000,"internally_reserved":0,"allocated":11919360,"data_stored":9909527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510830,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225532,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146308,"statfs":{"total":96636764160,"available":96405819392,"internally_reserved":0,"allocated":9764864,"data_stored":7751439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510830,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259352,"kb_used_data":11412,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94112488,"statfs":{"total":96636764160,"available":96371187712,"internally_reserved":0,"allocated":11685888,"data_stored":9655008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510829,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":197212,"kb_used_data":13244,"kb_used_omap":1,"kb_used_meta":183870,"kb_avail":94174628,"statfs":{"total":96636764160,"available":96434819072,"internally_reserved":0,"allocated":13561856,"data_stored":11555946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188283333},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510827,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339548,"kb_used_data":11048,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94032292,"statfs":{"total":96636764160,"available":96289067008,"internally_reserved":0,"allocated":11313152,"data_stored":9301608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510828,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138204,"kb_used_data":12620,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94233636,"statfs":{"total":96636764160,"available":96495243264,"internally_reserved":0,"allocated":12922880,"data_stored":10866139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543534,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238120,"kb_used_data":12544,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94133720,"statfs":{"total":96636764160,"available":96392929280,"internally_reserved":0,"allocated":12845056,"data_stored":10838842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":230881738},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8622080,"data_stored":8622080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6471680,"data_stored":6471680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9314304,"data_stored":9314304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7413760,"data_stored":7413760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5509120,"data_stored":5509120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7077888,"data_stored":7077888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5353472,"data_stored":5353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8597504,"data_stored":8597504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:44:12.756 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.756 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.756 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.756 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.757 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.758 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.759 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.760 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.761 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.762 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.763 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.764 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.765 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.766 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.767 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.768 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.769 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.770 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.771 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.772 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.773 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.774 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.775 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.776 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.777 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.778 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.779 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T10:49:06.006953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.780 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T10:49:06.006953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.781 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T10:49:06.006953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T10:49:06.006953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.782 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T10:49:06.006953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.783 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T10:49:06.006953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.784 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.785 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.785 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T10:49:06.006953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.785 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.785 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.785 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.785 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.785 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.785 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T10:49:06.006953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.786 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.787 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.788 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.789 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.790 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.791 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.792 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.793 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.794 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.795 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.796 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.797 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.797 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.797 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.797 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:12.797 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:44:32.798 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:44:33.154 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:44:33.171 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T12:44:33.172 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":3724,"stamp":"2024-09-14T12:44:31.162476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44615192,"num_objects":748,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":316434,"num_read_kb":2591763,"num_write":168253,"num_write_kb":2487517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":598288,"num_omap_keys":1419,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13059,"ondisk_log_size":13059,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1804024,"kb_used_data":91448,"kb_used_omap":12,"kb_used_meta":1712435,"kb_avail":753170696,"statfs":{"total":773094113280,"available":771246792704,"internally_reserved":0,"allocated":93642752,"data_stored":77474338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1753534000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":598288,"num_omap_keys":1419,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008525"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789873+0000","last_change":"2024-09-14T11:40:08.952510+0000","last_active":"2024-09-14T12:40:10.789873+0000","last_peered":"2024-09-14T12:40:10.789873+0000","last_clean":"2024-09-14T12:40:10.789873+0000","last_became_active":"2024-09-14T11:40:08.951795+0000","last_became_peered":"2024-09-14T11:40:08.951795+0000","last_unstale":"2024-09-14T12:40:10.789873+0000","last_undegraded":"2024-09-14T12:40:10.789873+0000","last_fullsized":"2024-09-14T12:40:10.789873+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:34.432945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:55.538895+0000","last_change":"2024-09-14T11:12:26.252261+0000","last_active":"2024-09-14T12:39:55.538895+0000","last_peered":"2024-09-14T12:39:55.538895+0000","last_clean":"2024-09-14T12:39:55.538895+0000","last_became_active":"2024-09-14T11:12:26.251656+0000","last_became_peered":"2024-09-14T11:12:26.251656+0000","last_unstale":"2024-09-14T12:39:55.538895+0000","last_undegraded":"2024-09-14T12:39:55.538895+0000","last_fullsized":"2024-09-14T12:39:55.538895+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:01.924216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:49.731815+0000","last_change":"2024-09-14T11:12:19.109493+0000","last_active":"2024-09-14T12:39:49.731815+0000","last_peered":"2024-09-14T12:39:49.731815+0000","last_clean":"2024-09-14T12:39:49.731815+0000","last_became_active":"2024-09-14T11:12:19.108050+0000","last_became_peered":"2024-09-14T11:12:19.108050+0000","last_unstale":"2024-09-14T12:39:49.731815+0000","last_undegraded":"2024-09-14T12:39:49.731815+0000","last_fullsized":"2024-09-14T12:39:49.731815+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:46.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'28","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:20.593684+0000","last_change":"2024-09-14T11:06:29.522001+0000","last_active":"2024-09-14T12:42:20.593684+0000","last_peered":"2024-09-14T12:42:20.593684+0000","last_clean":"2024-09-14T12:42:20.593684+0000","last_became_active":"2024-09-14T11:06:29.521269+0000","last_became_peered":"2024-09-14T11:06:29.521269+0000","last_unstale":"2024-09-14T12:42:20.593684+0000","last_undegraded":"2024-09-14T12:42:20.593684+0000","last_fullsized":"2024-09-14T12:42:20.593684+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":165,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537448+0000","last_change":"2024-09-14T11:40:08.947504+0000","last_active":"2024-09-14T12:40:11.537448+0000","last_peered":"2024-09-14T12:40:11.537448+0000","last_clean":"2024-09-14T12:40:11.537448+0000","last_became_active":"2024-09-14T11:40:08.946878+0000","last_became_peered":"2024-09-14T11:40:08.946878+0000","last_unstale":"2024-09-14T12:40:11.537448+0000","last_undegraded":"2024-09-14T12:40:11.537448+0000","last_fullsized":"2024-09-14T12:40:11.537448+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:13.424208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142354+0000","last_change":"2024-09-14T11:12:26.251932+0000","last_active":"2024-09-14T12:39:56.142354+0000","last_peered":"2024-09-14T12:39:56.142354+0000","last_clean":"2024-09-14T12:39:56.142354+0000","last_became_active":"2024-09-14T11:12:26.251518+0000","last_became_peered":"2024-09-14T11:12:26.251518+0000","last_unstale":"2024-09-14T12:39:56.142354+0000","last_undegraded":"2024-09-14T12:39:56.142354+0000","last_fullsized":"2024-09-14T12:39:56.142354+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:18.782289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:50.549011+0000","last_change":"2024-09-14T11:12:19.078874+0000","last_active":"2024-09-14T12:39:50.549011+0000","last_peered":"2024-09-14T12:39:50.549011+0000","last_clean":"2024-09-14T12:39:50.549011+0000","last_became_active":"2024-09-14T11:12:19.078164+0000","last_became_peered":"2024-09-14T11:12:19.078164+0000","last_unstale":"2024-09-14T12:39:50.549011+0000","last_undegraded":"2024-09-14T12:39:50.549011+0000","last_fullsized":"2024-09-14T12:39:50.549011+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:07.851997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'14","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.573976+0000","last_change":"2024-09-14T11:06:29.539883+0000","last_active":"2024-09-14T12:40:55.573976+0000","last_peered":"2024-09-14T12:40:55.573976+0000","last_clean":"2024-09-14T12:40:55.573976+0000","last_became_active":"2024-09-14T11:06:29.538616+0000","last_became_peered":"2024-09-14T11:06:29.538616+0000","last_unstale":"2024-09-14T12:40:55.573976+0000","last_undegraded":"2024-09-14T12:40:55.573976+0000","last_fullsized":"2024-09-14T12:40:55.573976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:48.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":63,"num_write":44,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.548159+0000","last_change":"2024-09-14T11:40:08.943797+0000","last_active":"2024-09-14T12:40:35.548159+0000","last_peered":"2024-09-14T12:40:35.548159+0000","last_clean":"2024-09-14T12:40:35.548159+0000","last_became_active":"2024-09-14T11:40:08.942721+0000","last_became_peered":"2024-09-14T11:40:08.942721+0000","last_unstale":"2024-09-14T12:40:35.548159+0000","last_undegraded":"2024-09-14T12:40:35.548159+0000","last_fullsized":"2024-09-14T12:40:35.548159+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:17.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.361403+0000","last_change":"2024-09-14T11:12:26.228979+0000","last_active":"2024-09-14T12:42:00.361403+0000","last_peered":"2024-09-14T12:42:00.361403+0000","last_clean":"2024-09-14T12:42:00.361403+0000","last_became_active":"2024-09-14T11:12:26.228172+0000","last_became_peered":"2024-09-14T11:12:26.228172+0000","last_unstale":"2024-09-14T12:42:00.361403+0000","last_undegraded":"2024-09-14T12:42:00.361403+0000","last_fullsized":"2024-09-14T12:42:00.361403+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:34.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:34.769431+0000","last_change":"2024-09-14T11:12:19.111973+0000","last_active":"2024-09-14T12:42:34.769431+0000","last_peered":"2024-09-14T12:42:34.769431+0000","last_clean":"2024-09-14T12:42:34.769431+0000","last_became_active":"2024-09-14T11:12:19.110542+0000","last_became_peered":"2024-09-14T11:12:19.110542+0000","last_unstale":"2024-09-14T12:42:34.769431+0000","last_undegraded":"2024-09-14T12:42:34.769431+0000","last_fullsized":"2024-09-14T12:42:34.769431+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.885368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555139+0000","last_change":"2024-09-14T11:06:29.532390+0000","last_active":"2024-09-14T12:41:31.555139+0000","last_peered":"2024-09-14T12:41:31.555139+0000","last_clean":"2024-09-14T12:41:31.555139+0000","last_became_active":"2024-09-14T11:06:29.531655+0000","last_became_peered":"2024-09-14T11:06:29.531655+0000","last_unstale":"2024-09-14T12:41:31.555139+0000","last_undegraded":"2024-09-14T12:41:31.555139+0000","last_fullsized":"2024-09-14T12:41:31.555139+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:15.026446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":194,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563239+0000","last_change":"2024-09-14T11:40:08.940194+0000","last_active":"2024-09-14T12:40:50.563239+0000","last_peered":"2024-09-14T12:40:50.563239+0000","last_clean":"2024-09-14T12:40:50.563239+0000","last_became_active":"2024-09-14T11:40:08.939509+0000","last_became_peered":"2024-09-14T11:40:08.939509+0000","last_unstale":"2024-09-14T12:40:50.563239+0000","last_undegraded":"2024-09-14T12:40:50.563239+0000","last_fullsized":"2024-09-14T12:40:50.563239+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:14.099727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827825+0000","last_change":"2024-09-14T11:12:26.231260+0000","last_active":"2024-09-14T12:44:03.827825+0000","last_peered":"2024-09-14T12:44:03.827825+0000","last_clean":"2024-09-14T12:44:03.827825+0000","last_became_active":"2024-09-14T11:12:26.230403+0000","last_became_peered":"2024-09-14T11:12:26.230403+0000","last_unstale":"2024-09-14T12:44:03.827825+0000","last_undegraded":"2024-09-14T12:44:03.827825+0000","last_fullsized":"2024-09-14T12:44:03.827825+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:41.167301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7282,"num_write":12,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:00.592524+0000","last_change":"2024-09-14T11:12:19.105819+0000","last_active":"2024-09-14T12:44:00.592524+0000","last_peered":"2024-09-14T12:44:00.592524+0000","last_clean":"2024-09-14T12:44:00.592524+0000","last_became_active":"2024-09-14T11:12:19.105062+0000","last_became_peered":"2024-09-14T11:12:19.105062+0000","last_unstale":"2024-09-14T12:44:00.592524+0000","last_undegraded":"2024-09-14T12:44:00.592524+0000","last_fullsized":"2024-09-14T12:44:00.592524+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:15.694200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'12","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555085+0000","last_change":"2024-09-14T11:06:29.510354+0000","last_active":"2024-09-14T12:41:31.555085+0000","last_peered":"2024-09-14T12:41:31.555085+0000","last_clean":"2024-09-14T12:41:31.555085+0000","last_became_active":"2024-09-14T11:06:29.509556+0000","last_became_peered":"2024-09-14T11:06:29.509556+0000","last_unstale":"2024-09-14T12:41:31.555085+0000","last_undegraded":"2024-09-14T12:41:31.555085+0000","last_fullsized":"2024-09-14T12:41:31.555085+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:51.904786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:19.766089+0000","last_change":"2024-09-14T11:40:08.932176+0000","last_active":"2024-09-14T12:42:19.766089+0000","last_peered":"2024-09-14T12:42:19.766089+0000","last_clean":"2024-09-14T12:42:19.766089+0000","last_became_active":"2024-09-14T11:40:08.927702+0000","last_became_peered":"2024-09-14T11:40:08.927702+0000","last_unstale":"2024-09-14T12:42:19.766089+0000","last_undegraded":"2024-09-14T12:42:19.766089+0000","last_fullsized":"2024-09-14T12:42:19.766089+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.814065+0000","last_change":"2024-09-14T11:12:26.219704+0000","last_active":"2024-09-14T12:42:05.814065+0000","last_peered":"2024-09-14T12:42:05.814065+0000","last_clean":"2024-09-14T12:42:05.814065+0000","last_became_active":"2024-09-14T11:12:26.218925+0000","last_became_peered":"2024-09-14T11:12:26.218925+0000","last_unstale":"2024-09-14T12:42:05.814065+0000","last_undegraded":"2024-09-14T12:42:05.814065+0000","last_fullsized":"2024-09-14T12:42:05.814065+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"267'4","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.064367+0000","last_change":"2024-09-14T11:12:19.111180+0000","last_active":"2024-09-14T12:44:04.064367+0000","last_peered":"2024-09-14T12:44:04.064367+0000","last_clean":"2024-09-14T12:44:04.064367+0000","last_became_active":"2024-09-14T11:12:19.110528+0000","last_became_peered":"2024-09-14T11:12:19.110528+0000","last_unstale":"2024-09-14T12:44:04.064367+0000","last_undegraded":"2024-09-14T12:44:04.064367+0000","last_fullsized":"2024-09-14T12:44:04.064367+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:53.395221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'15","reported_seq":107,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.555023+0000","last_change":"2024-09-14T11:06:29.539444+0000","last_active":"2024-09-14T12:41:31.555023+0000","last_peered":"2024-09-14T12:41:31.555023+0000","last_clean":"2024-09-14T12:41:31.555023+0000","last_became_active":"2024-09-14T11:06:29.538597+0000","last_became_peered":"2024-09-14T11:06:29.538597+0000","last_unstale":"2024-09-14T12:41:31.555023+0000","last_undegraded":"2024-09-14T12:41:31.555023+0000","last_fullsized":"2024-09-14T12:41:31.555023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:42.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569608+0000","last_change":"2024-09-14T11:40:08.925877+0000","last_active":"2024-09-14T12:40:35.569608+0000","last_peered":"2024-09-14T12:40:35.569608+0000","last_clean":"2024-09-14T12:40:35.569608+0000","last_became_active":"2024-09-14T11:40:08.924934+0000","last_became_peered":"2024-09-14T11:40:08.924934+0000","last_unstale":"2024-09-14T12:40:35.569608+0000","last_undegraded":"2024-09-14T12:40:35.569608+0000","last_fullsized":"2024-09-14T12:40:35.569608+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:38.137144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.502951+0000","last_change":"2024-09-14T11:12:26.246400+0000","last_active":"2024-09-14T12:41:51.502951+0000","last_peered":"2024-09-14T12:41:51.502951+0000","last_clean":"2024-09-14T12:41:51.502951+0000","last_became_active":"2024-09-14T11:12:26.245890+0000","last_became_peered":"2024-09-14T11:12:26.245890+0000","last_unstale":"2024-09-14T12:41:51.502951+0000","last_undegraded":"2024-09-14T12:41:51.502951+0000","last_fullsized":"2024-09-14T12:41:51.502951+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506139+0000","last_change":"2024-09-14T11:12:19.109400+0000","last_active":"2024-09-14T12:42:01.506139+0000","last_peered":"2024-09-14T12:42:01.506139+0000","last_clean":"2024-09-14T12:42:01.506139+0000","last_became_active":"2024-09-14T11:12:19.108158+0000","last_became_peered":"2024-09-14T11:12:19.108158+0000","last_unstale":"2024-09-14T12:42:01.506139+0000","last_undegraded":"2024-09-14T12:42:01.506139+0000","last_fullsized":"2024-09-14T12:42:01.506139+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'13","reported_seq":104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.164957+0000","last_change":"2024-09-14T11:06:29.529584+0000","last_active":"2024-09-14T12:41:31.164957+0000","last_peered":"2024-09-14T12:41:31.164957+0000","last_clean":"2024-09-14T12:41:31.164957+0000","last_became_active":"2024-09-14T11:06:29.525271+0000","last_became_peered":"2024-09-14T11:06:29.525271+0000","last_unstale":"2024-09-14T12:41:31.164957+0000","last_undegraded":"2024-09-14T12:41:31.164957+0000","last_fullsized":"2024-09-14T12:41:31.164957+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:48.747370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.145918+0000","last_change":"2024-09-14T11:40:08.929934+0000","last_active":"2024-09-14T12:40:11.145918+0000","last_peered":"2024-09-14T12:40:11.145918+0000","last_clean":"2024-09-14T12:40:11.145918+0000","last_became_active":"2024-09-14T11:40:08.928406+0000","last_became_peered":"2024-09-14T11:40:08.928406+0000","last_unstale":"2024-09-14T12:40:11.145918+0000","last_undegraded":"2024-09-14T12:40:11.145918+0000","last_fullsized":"2024-09-14T12:40:11.145918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:59.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":55,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:56.142297+0000","last_change":"2024-09-14T11:12:26.241901+0000","last_active":"2024-09-14T12:39:56.142297+0000","last_peered":"2024-09-14T12:39:56.142297+0000","last_clean":"2024-09-14T12:39:56.142297+0000","last_became_active":"2024-09-14T11:12:26.241189+0000","last_became_peered":"2024-09-14T11:12:26.241189+0000","last_unstale":"2024-09-14T12:39:56.142297+0000","last_undegraded":"2024-09-14T12:39:56.142297+0000","last_fullsized":"2024-09-14T12:39:56.142297+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:26.882785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"267'4","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.129112+0000","last_change":"2024-09-14T11:12:19.090881+0000","last_active":"2024-09-14T12:44:02.129112+0000","last_peered":"2024-09-14T12:44:02.129112+0000","last_clean":"2024-09-14T12:44:02.129112+0000","last_became_active":"2024-09-14T11:12:19.090134+0000","last_became_peered":"2024-09-14T11:12:19.090134+0000","last_unstale":"2024-09-14T12:44:02.129112+0000","last_undegraded":"2024-09-14T12:44:02.129112+0000","last_fullsized":"2024-09-14T12:44:02.129112+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:01.751661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4097,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'175","reported_seq":578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:59.747524+0000","last_change":"2024-09-14T11:06:29.533832+0000","last_active":"2024-09-14T12:40:59.747524+0000","last_peered":"2024-09-14T12:40:59.747524+0000","last_clean":"2024-09-14T12:40:59.747524+0000","last_became_active":"2024-09-14T11:06:29.531149+0000","last_became_peered":"2024-09-14T11:06:29.531149+0000","last_unstale":"2024-09-14T12:40:59.747524+0000","last_undegraded":"2024-09-14T12:40:59.747524+0000","last_fullsized":"2024-09-14T12:40:59.747524+0000","mapping_epoch":256,"log_start":"264'100","ondisk_log_start":"264'100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:45.535262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1578,"num_read_kb":1327,"num_write":388,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.789984+0000","last_change":"2024-09-14T11:40:08.942903+0000","last_active":"2024-09-14T12:40:10.789984+0000","last_peered":"2024-09-14T12:40:10.789984+0000","last_clean":"2024-09-14T12:40:10.789984+0000","last_became_active":"2024-09-14T11:40:08.942208+0000","last_became_peered":"2024-09-14T11:40:08.942208+0000","last_unstale":"2024-09-14T12:40:10.789984+0000","last_undegraded":"2024-09-14T12:40:10.789984+0000","last_fullsized":"2024-09-14T12:40:10.789984+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:07.315198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.768253+0000","last_change":"2024-09-14T11:12:26.236668+0000","last_active":"2024-09-14T12:42:29.768253+0000","last_peered":"2024-09-14T12:42:29.768253+0000","last_clean":"2024-09-14T12:42:29.768253+0000","last_became_active":"2024-09-14T11:12:26.236221+0000","last_became_peered":"2024-09-14T11:12:26.236221+0000","last_unstale":"2024-09-14T12:42:29.768253+0000","last_undegraded":"2024-09-14T12:42:29.768253+0000","last_fullsized":"2024-09-14T12:42:29.768253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.780862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.532656+0000","last_change":"2024-09-14T11:12:19.087602+0000","last_active":"2024-09-14T12:39:51.532656+0000","last_peered":"2024-09-14T12:39:51.532656+0000","last_clean":"2024-09-14T12:39:51.532656+0000","last_became_active":"2024-09-14T11:12:19.086765+0000","last_became_peered":"2024-09-14T11:12:19.086765+0000","last_unstale":"2024-09-14T12:39:51.532656+0000","last_undegraded":"2024-09-14T12:39:51.532656+0000","last_fullsized":"2024-09-14T12:39:51.532656+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.252636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'21","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.545007+0000","last_change":"2024-09-14T11:06:29.518739+0000","last_active":"2024-09-14T12:40:46.545007+0000","last_peered":"2024-09-14T12:40:46.545007+0000","last_clean":"2024-09-14T12:40:46.545007+0000","last_became_active":"2024-09-14T11:06:29.518028+0000","last_became_peered":"2024-09-14T11:06:29.518028+0000","last_unstale":"2024-09-14T12:40:46.545007+0000","last_undegraded":"2024-09-14T12:40:46.545007+0000","last_fullsized":"2024-09-14T12:40:46.545007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:31.356112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":96,"num_write":55,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563311+0000","last_change":"2024-09-14T11:40:08.953653+0000","last_active":"2024-09-14T12:40:50.563311+0000","last_peered":"2024-09-14T12:40:50.563311+0000","last_clean":"2024-09-14T12:40:50.563311+0000","last_became_active":"2024-09-14T11:40:08.953030+0000","last_became_peered":"2024-09-14T11:40:08.953030+0000","last_unstale":"2024-09-14T12:40:50.563311+0000","last_undegraded":"2024-09-14T12:40:50.563311+0000","last_fullsized":"2024-09-14T12:40:50.563311+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:54.553294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760330+0000","last_change":"2024-09-14T11:12:26.248644+0000","last_active":"2024-09-14T12:41:54.760330+0000","last_peered":"2024-09-14T12:41:54.760330+0000","last_clean":"2024-09-14T12:41:54.760330+0000","last_became_active":"2024-09-14T11:12:26.247784+0000","last_became_peered":"2024-09-14T11:12:26.247784+0000","last_unstale":"2024-09-14T12:41:54.760330+0000","last_undegraded":"2024-09-14T12:41:54.760330+0000","last_fullsized":"2024-09-14T12:41:54.760330+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:36.527831+0000","last_change":"2024-09-14T11:12:19.114678+0000","last_active":"2024-09-14T12:43:36.527831+0000","last_peered":"2024-09-14T12:43:36.527831+0000","last_clean":"2024-09-14T12:43:36.527831+0000","last_became_active":"2024-09-14T11:12:19.113431+0000","last_became_peered":"2024-09-14T11:12:19.113431+0000","last_unstale":"2024-09-14T12:43:36.527831+0000","last_undegraded":"2024-09-14T12:43:36.527831+0000","last_fullsized":"2024-09-14T12:43:36.527831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:46.474061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7166,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'46","reported_seq":197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571890+0000","last_change":"2024-09-14T11:06:29.532883+0000","last_active":"2024-09-14T12:40:45.571890+0000","last_peered":"2024-09-14T12:40:45.571890+0000","last_clean":"2024-09-14T12:40:45.571890+0000","last_became_active":"2024-09-14T11:06:29.532061+0000","last_became_peered":"2024-09-14T11:06:29.532061+0000","last_unstale":"2024-09-14T12:40:45.571890+0000","last_undegraded":"2024-09-14T12:40:45.571890+0000","last_fullsized":"2024-09-14T12:40:45.571890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:13.641002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":235,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.546149+0000","last_change":"2024-09-14T11:40:08.938546+0000","last_active":"2024-09-14T12:40:51.546149+0000","last_peered":"2024-09-14T12:40:51.546149+0000","last_clean":"2024-09-14T12:40:51.546149+0000","last_became_active":"2024-09-14T11:40:08.937813+0000","last_became_peered":"2024-09-14T11:40:08.937813+0000","last_unstale":"2024-09-14T12:40:51.546149+0000","last_undegraded":"2024-09-14T12:40:51.546149+0000","last_fullsized":"2024-09-14T12:40:51.546149+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:07.510647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.828266+0000","last_change":"2024-09-14T11:12:26.244350+0000","last_active":"2024-09-14T12:44:03.828266+0000","last_peered":"2024-09-14T12:44:03.828266+0000","last_clean":"2024-09-14T12:44:03.828266+0000","last_became_active":"2024-09-14T11:12:26.243612+0000","last_became_peered":"2024-09-14T11:12:26.243612+0000","last_unstale":"2024-09-14T12:44:03.828266+0000","last_undegraded":"2024-09-14T12:44:03.828266+0000","last_fullsized":"2024-09-14T12:44:03.828266+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.954445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15364,"num_write":22,"num_write_kb":14340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.980363+0000","last_change":"2024-09-14T11:12:19.104603+0000","last_active":"2024-09-14T12:44:03.980363+0000","last_peered":"2024-09-14T12:44:03.980363+0000","last_clean":"2024-09-14T12:44:03.980363+0000","last_became_active":"2024-09-14T11:12:19.103871+0000","last_became_peered":"2024-09-14T11:12:19.103871+0000","last_unstale":"2024-09-14T12:44:03.980363+0000","last_undegraded":"2024-09-14T12:44:03.980363+0000","last_fullsized":"2024-09-14T12:44:03.980363+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'29","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571849+0000","last_change":"2024-09-14T11:06:29.530922+0000","last_active":"2024-09-14T12:40:45.571849+0000","last_peered":"2024-09-14T12:40:45.571849+0000","last_clean":"2024-09-14T12:40:45.571849+0000","last_became_active":"2024-09-14T11:06:29.529421+0000","last_became_peered":"2024-09-14T11:06:29.529421+0000","last_unstale":"2024-09-14T12:40:45.571849+0000","last_undegraded":"2024-09-14T12:40:45.571849+0000","last_fullsized":"2024-09-14T12:40:45.571849+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:42.789285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":129,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.155363+0000","last_change":"2024-09-14T11:40:08.944753+0000","last_active":"2024-09-14T12:40:51.155363+0000","last_peered":"2024-09-14T12:40:51.155363+0000","last_clean":"2024-09-14T12:40:51.155363+0000","last_became_active":"2024-09-14T11:40:08.944066+0000","last_became_peered":"2024-09-14T11:40:08.944066+0000","last_unstale":"2024-09-14T12:40:51.155363+0000","last_undegraded":"2024-09-14T12:40:51.155363+0000","last_fullsized":"2024-09-14T12:40:51.155363+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:51.071467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760439+0000","last_change":"2024-09-14T11:12:26.225753+0000","last_active":"2024-09-14T12:41:54.760439+0000","last_peered":"2024-09-14T12:41:54.760439+0000","last_clean":"2024-09-14T12:41:54.760439+0000","last_became_active":"2024-09-14T11:12:26.224877+0000","last_became_peered":"2024-09-14T11:12:26.224877+0000","last_unstale":"2024-09-14T12:41:54.760439+0000","last_undegraded":"2024-09-14T12:41:54.760439+0000","last_fullsized":"2024-09-14T12:41:54.760439+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'11","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.980218+0000","last_change":"2024-09-14T11:12:19.108246+0000","last_active":"2024-09-14T12:44:03.980218+0000","last_peered":"2024-09-14T12:44:03.980218+0000","last_clean":"2024-09-14T12:44:03.980218+0000","last_became_active":"2024-09-14T11:12:19.107563+0000","last_became_peered":"2024-09-14T11:12:19.107563+0000","last_unstale":"2024-09-14T12:44:03.980218+0000","last_undegraded":"2024-09-14T12:44:03.980218+0000","last_fullsized":"2024-09-14T12:44:03.980218+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:29.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9259,"num_write":16,"num_write_kb":6185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'15","reported_seq":110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:44.744075+0000","last_change":"2024-09-14T11:06:29.535035+0000","last_active":"2024-09-14T12:40:44.744075+0000","last_peered":"2024-09-14T12:40:44.744075+0000","last_clean":"2024-09-14T12:40:44.744075+0000","last_became_active":"2024-09-14T11:06:29.534316+0000","last_became_peered":"2024-09-14T11:06:29.534316+0000","last_unstale":"2024-09-14T12:40:44.744075+0000","last_undegraded":"2024-09-14T12:40:44.744075+0000","last_fullsized":"2024-09-14T12:40:44.744075+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.975045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":71,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.798963+0000","last_change":"2024-09-14T11:40:08.945904+0000","last_active":"2024-09-14T12:40:50.798963+0000","last_peered":"2024-09-14T12:40:50.798963+0000","last_clean":"2024-09-14T12:40:50.798963+0000","last_became_active":"2024-09-14T11:40:08.945227+0000","last_became_peered":"2024-09-14T11:40:08.945227+0000","last_unstale":"2024-09-14T12:40:50.798963+0000","last_undegraded":"2024-09-14T12:40:50.798963+0000","last_fullsized":"2024-09-14T12:40:50.798963+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:52.335465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.810673+0000","last_change":"2024-09-14T11:12:26.239562+0000","last_active":"2024-09-14T12:41:50.810673+0000","last_peered":"2024-09-14T12:41:50.810673+0000","last_clean":"2024-09-14T12:41:50.810673+0000","last_became_active":"2024-09-14T11:12:26.238844+0000","last_became_peered":"2024-09-14T11:12:26.238844+0000","last_unstale":"2024-09-14T12:41:50.810673+0000","last_undegraded":"2024-09-14T12:41:50.810673+0000","last_fullsized":"2024-09-14T12:41:50.810673+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.951718+0000","last_change":"2024-09-14T11:12:19.074095+0000","last_active":"2024-09-14T12:44:02.951718+0000","last_peered":"2024-09-14T12:44:02.951718+0000","last_clean":"2024-09-14T12:44:02.951718+0000","last_became_active":"2024-09-14T11:12:19.072275+0000","last_became_peered":"2024-09-14T11:12:19.072275+0000","last_unstale":"2024-09-14T12:44:02.951718+0000","last_undegraded":"2024-09-14T12:44:02.951718+0000","last_fullsized":"2024-09-14T12:44:02.951718+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:16.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'30","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:06.476064+0000","last_change":"2024-09-14T11:06:29.519394+0000","last_active":"2024-09-14T12:40:06.476064+0000","last_peered":"2024-09-14T12:40:06.476064+0000","last_clean":"2024-09-14T12:40:06.476064+0000","last_became_active":"2024-09-14T11:06:29.518650+0000","last_became_peered":"2024-09-14T11:06:29.518650+0000","last_unstale":"2024-09-14T12:40:06.476064+0000","last_undegraded":"2024-09-14T12:40:06.476064+0000","last_fullsized":"2024-09-14T12:40:06.476064+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.316442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":172,"num_write":81,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559828+0000","last_change":"2024-09-14T11:40:08.951327+0000","last_active":"2024-09-14T12:40:35.559828+0000","last_peered":"2024-09-14T12:40:35.559828+0000","last_clean":"2024-09-14T12:40:35.559828+0000","last_became_active":"2024-09-14T11:40:08.950670+0000","last_became_peered":"2024-09-14T11:40:08.950670+0000","last_unstale":"2024-09-14T12:40:35.559828+0000","last_undegraded":"2024-09-14T12:40:35.559828+0000","last_fullsized":"2024-09-14T12:40:35.559828+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:02.634753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.129271+0000","last_change":"2024-09-14T11:12:26.228814+0000","last_active":"2024-09-14T12:44:02.129271+0000","last_peered":"2024-09-14T12:44:02.129271+0000","last_clean":"2024-09-14T12:44:02.129271+0000","last_became_active":"2024-09-14T11:12:26.227851+0000","last_became_peered":"2024-09-14T11:12:26.227851+0000","last_unstale":"2024-09-14T12:44:02.129271+0000","last_undegraded":"2024-09-14T12:44:02.129271+0000","last_fullsized":"2024-09-14T12:44:02.129271+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:46.796979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.553829+0000","last_change":"2024-09-14T11:12:19.092586+0000","last_active":"2024-09-14T12:41:00.553829+0000","last_peered":"2024-09-14T12:41:00.553829+0000","last_clean":"2024-09-14T12:41:00.553829+0000","last_became_active":"2024-09-14T11:12:19.091893+0000","last_became_peered":"2024-09-14T11:12:19.091893+0000","last_unstale":"2024-09-14T12:41:00.553829+0000","last_undegraded":"2024-09-14T12:41:00.553829+0000","last_fullsized":"2024-09-14T12:41:00.553829+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:18.606010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'35","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.472861+0000","last_change":"2024-09-14T11:06:29.548605+0000","last_active":"2024-09-14T12:39:51.472861+0000","last_peered":"2024-09-14T12:39:51.472861+0000","last_clean":"2024-09-14T12:39:51.472861+0000","last_became_active":"2024-09-14T11:06:29.545575+0000","last_became_peered":"2024-09-14T11:06:29.545575+0000","last_unstale":"2024-09-14T12:39:51.472861+0000","last_undegraded":"2024-09-14T12:39:51.472861+0000","last_fullsized":"2024-09-14T12:39:51.472861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:04.244766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":183,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543115+0000","last_change":"2024-09-14T11:40:08.926123+0000","last_active":"2024-09-14T12:40:36.543115+0000","last_peered":"2024-09-14T12:40:36.543115+0000","last_clean":"2024-09-14T12:40:36.543115+0000","last_became_active":"2024-09-14T11:40:08.925358+0000","last_became_peered":"2024-09-14T11:40:08.925358+0000","last_unstale":"2024-09-14T12:40:36.543115+0000","last_undegraded":"2024-09-14T12:40:36.543115+0000","last_fullsized":"2024-09-14T12:40:36.543115+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:25.296629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566691+0000","last_change":"2024-09-14T11:12:26.247421+0000","last_active":"2024-09-14T12:41:05.566691+0000","last_peered":"2024-09-14T12:41:05.566691+0000","last_clean":"2024-09-14T12:41:05.566691+0000","last_became_active":"2024-09-14T11:12:26.246881+0000","last_became_peered":"2024-09-14T11:12:26.246881+0000","last_unstale":"2024-09-14T12:41:05.566691+0000","last_undegraded":"2024-09-14T12:41:05.566691+0000","last_fullsized":"2024-09-14T12:41:05.566691+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:19.198573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:20.380939+0000","last_change":"2024-09-14T11:12:19.096545+0000","last_active":"2024-09-14T12:43:20.380939+0000","last_peered":"2024-09-14T12:43:20.380939+0000","last_clean":"2024-09-14T12:43:20.380939+0000","last_became_active":"2024-09-14T11:12:19.095821+0000","last_became_peered":"2024-09-14T11:12:19.095821+0000","last_unstale":"2024-09-14T12:43:20.380939+0000","last_undegraded":"2024-09-14T12:43:20.380939+0000","last_fullsized":"2024-09-14T12:43:20.380939+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:19.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'26","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:09.763736+0000","last_change":"2024-09-14T11:06:29.533209+0000","last_active":"2024-09-14T12:42:09.763736+0000","last_peered":"2024-09-14T12:42:09.763736+0000","last_clean":"2024-09-14T12:42:09.763736+0000","last_became_active":"2024-09-14T11:06:29.529753+0000","last_became_peered":"2024-09-14T11:06:29.529753+0000","last_unstale":"2024-09-14T12:42:09.763736+0000","last_undegraded":"2024-09-14T12:42:09.763736+0000","last_fullsized":"2024-09-14T12:42:09.763736+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.576092+0000","last_change":"2024-09-14T11:40:08.925501+0000","last_active":"2024-09-14T12:41:05.576092+0000","last_peered":"2024-09-14T12:41:05.576092+0000","last_clean":"2024-09-14T12:41:05.576092+0000","last_became_active":"2024-09-14T11:40:08.924726+0000","last_became_peered":"2024-09-14T11:40:08.924726+0000","last_unstale":"2024-09-14T12:41:05.576092+0000","last_undegraded":"2024-09-14T12:41:05.576092+0000","last_fullsized":"2024-09-14T12:41:05.576092+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:22.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:09.749817+0000","last_change":"2024-09-14T11:12:26.219990+0000","last_active":"2024-09-14T12:41:09.749817+0000","last_peered":"2024-09-14T12:41:09.749817+0000","last_clean":"2024-09-14T12:41:09.749817+0000","last_became_active":"2024-09-14T11:12:26.219169+0000","last_became_peered":"2024-09-14T11:12:26.219169+0000","last_unstale":"2024-09-14T12:41:09.749817+0000","last_undegraded":"2024-09-14T12:41:09.749817+0000","last_fullsized":"2024-09-14T12:41:09.749817+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:09.344730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"267'10","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.311782+0000","last_change":"2024-09-14T11:12:19.099929+0000","last_active":"2024-09-14T12:44:04.311782+0000","last_peered":"2024-09-14T12:44:04.311782+0000","last_clean":"2024-09-14T12:44:04.311782+0000","last_became_active":"2024-09-14T11:12:19.099233+0000","last_became_peered":"2024-09-14T11:12:19.099233+0000","last_unstale":"2024-09-14T12:44:04.311782+0000","last_undegraded":"2024-09-14T12:44:04.311782+0000","last_fullsized":"2024-09-14T12:44:04.311782+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:44.480469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8230,"num_write":10,"num_write_kb":6172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'35","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:51.140567+0000","last_change":"2024-09-14T11:06:29.524243+0000","last_active":"2024-09-14T12:39:51.140567+0000","last_peered":"2024-09-14T12:39:51.140567+0000","last_clean":"2024-09-14T12:39:51.140567+0000","last_became_active":"2024-09-14T11:06:29.508842+0000","last_became_peered":"2024-09-14T11:06:29.508842+0000","last_unstale":"2024-09-14T12:39:51.140567+0000","last_undegraded":"2024-09-14T12:39:51.140567+0000","last_fullsized":"2024-09-14T12:39:51.140567+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:47.904384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":189,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543061+0000","last_change":"2024-09-14T11:40:08.945136+0000","last_active":"2024-09-14T12:40:36.543061+0000","last_peered":"2024-09-14T12:40:36.543061+0000","last_clean":"2024-09-14T12:40:36.543061+0000","last_became_active":"2024-09-14T11:40:08.944382+0000","last_became_peered":"2024-09-14T11:40:08.944382+0000","last_unstale":"2024-09-14T12:40:36.543061+0000","last_undegraded":"2024-09-14T12:40:36.543061+0000","last_fullsized":"2024-09-14T12:40:36.543061+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:00.265362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:26.525182+0000","last_change":"2024-09-14T11:12:26.238084+0000","last_active":"2024-09-14T12:43:26.525182+0000","last_peered":"2024-09-14T12:43:26.525182+0000","last_clean":"2024-09-14T12:43:26.525182+0000","last_became_active":"2024-09-14T11:12:26.232336+0000","last_became_peered":"2024-09-14T11:12:26.232336+0000","last_unstale":"2024-09-14T12:43:26.525182+0000","last_undegraded":"2024-09-14T12:43:26.525182+0000","last_fullsized":"2024-09-14T12:43:26.525182+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:24.342020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:20.584614+0000","last_change":"2024-09-14T11:12:19.093047+0000","last_active":"2024-09-14T12:43:20.584614+0000","last_peered":"2024-09-14T12:43:20.584614+0000","last_clean":"2024-09-14T12:43:20.584614+0000","last_became_active":"2024-09-14T11:12:19.092223+0000","last_became_peered":"2024-09-14T11:12:19.092223+0000","last_unstale":"2024-09-14T12:43:20.584614+0000","last_undegraded":"2024-09-14T12:43:20.584614+0000","last_fullsized":"2024-09-14T12:43:20.584614+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:48.559915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'19","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:09.763626+0000","last_change":"2024-09-14T11:06:29.533456+0000","last_active":"2024-09-14T12:42:09.763626+0000","last_peered":"2024-09-14T12:42:09.763626+0000","last_clean":"2024-09-14T12:42:09.763626+0000","last_became_active":"2024-09-14T11:06:29.530722+0000","last_became_peered":"2024-09-14T11:06:29.530722+0000","last_unstale":"2024-09-14T12:42:09.763626+0000","last_undegraded":"2024-09-14T12:42:09.763626+0000","last_fullsized":"2024-09-14T12:42:09.763626+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":48,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566854+0000","last_change":"2024-09-14T11:40:08.948425+0000","last_active":"2024-09-14T12:41:05.566854+0000","last_peered":"2024-09-14T12:41:05.566854+0000","last_clean":"2024-09-14T12:41:05.566854+0000","last_became_active":"2024-09-14T11:40:08.947725+0000","last_became_peered":"2024-09-14T11:40:08.947725+0000","last_unstale":"2024-09-14T12:41:05.566854+0000","last_undegraded":"2024-09-14T12:41:05.566854+0000","last_fullsized":"2024-09-14T12:41:05.566854+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:01.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737522+0000","last_change":"2024-09-14T11:12:26.233658+0000","last_active":"2024-09-14T12:40:14.737522+0000","last_peered":"2024-09-14T12:40:14.737522+0000","last_clean":"2024-09-14T12:40:14.737522+0000","last_became_active":"2024-09-14T11:12:26.233006+0000","last_became_peered":"2024-09-14T11:12:26.233006+0000","last_unstale":"2024-09-14T12:40:14.737522+0000","last_undegraded":"2024-09-14T12:40:14.737522+0000","last_fullsized":"2024-09-14T12:40:14.737522+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:29.000670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"267'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.176442+0000","last_change":"2024-09-14T11:12:19.086179+0000","last_active":"2024-09-14T12:42:21.176442+0000","last_peered":"2024-09-14T12:42:21.176442+0000","last_clean":"2024-09-14T12:42:21.176442+0000","last_became_active":"2024-09-14T11:12:19.085380+0000","last_became_peered":"2024-09-14T11:12:19.085380+0000","last_unstale":"2024-09-14T12:42:21.176442+0000","last_undegraded":"2024-09-14T12:42:21.176442+0000","last_fullsized":"2024-09-14T12:42:21.176442+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:31.276536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'32","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:14.751168+0000","last_change":"2024-09-14T11:06:29.535049+0000","last_active":"2024-09-14T12:41:14.751168+0000","last_peered":"2024-09-14T12:41:14.751168+0000","last_clean":"2024-09-14T12:41:14.751168+0000","last_became_active":"2024-09-14T11:06:29.534458+0000","last_became_peered":"2024-09-14T11:06:29.534458+0000","last_unstale":"2024-09-14T12:41:14.751168+0000","last_undegraded":"2024-09-14T12:41:14.751168+0000","last_fullsized":"2024-09-14T12:41:14.751168+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:56.304642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":170,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.552820+0000","last_change":"2024-09-14T11:40:08.950611+0000","last_active":"2024-09-14T12:40:55.552820+0000","last_peered":"2024-09-14T12:40:55.552820+0000","last_clean":"2024-09-14T12:40:55.552820+0000","last_became_active":"2024-09-14T11:40:08.949834+0000","last_became_peered":"2024-09-14T11:40:08.949834+0000","last_unstale":"2024-09-14T12:40:55.552820+0000","last_undegraded":"2024-09-14T12:40:55.552820+0000","last_fullsized":"2024-09-14T12:40:55.552820+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:57.861780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:14.737457+0000","last_change":"2024-09-14T11:12:26.248461+0000","last_active":"2024-09-14T12:40:14.737457+0000","last_peered":"2024-09-14T12:40:14.737457+0000","last_clean":"2024-09-14T12:40:14.737457+0000","last_became_active":"2024-09-14T11:12:26.247614+0000","last_became_peered":"2024-09-14T11:12:26.247614+0000","last_unstale":"2024-09-14T12:40:14.737457+0000","last_undegraded":"2024-09-14T12:40:14.737457+0000","last_fullsized":"2024-09-14T12:40:14.737457+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:50.064486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'14","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.566228+0000","last_change":"2024-09-14T11:12:19.096853+0000","last_active":"2024-09-14T12:42:21.566228+0000","last_peered":"2024-09-14T12:42:21.566228+0000","last_clean":"2024-09-14T12:42:21.566228+0000","last_became_active":"2024-09-14T11:12:19.096087+0000","last_became_peered":"2024-09-14T11:12:19.096087+0000","last_unstale":"2024-09-14T12:42:21.566228+0000","last_undegraded":"2024-09-14T12:42:21.566228+0000","last_fullsized":"2024-09-14T12:42:21.566228+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:06.192659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":21525,"num_write":24,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'15","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490423+0000","last_change":"2024-09-14T11:06:29.545510+0000","last_active":"2024-09-14T12:41:01.490423+0000","last_peered":"2024-09-14T12:41:01.490423+0000","last_clean":"2024-09-14T12:41:01.490423+0000","last_became_active":"2024-09-14T11:06:29.544309+0000","last_became_peered":"2024-09-14T11:06:29.544309+0000","last_unstale":"2024-09-14T12:41:01.490423+0000","last_undegraded":"2024-09-14T12:41:01.490423+0000","last_fullsized":"2024-09-14T12:41:01.490423+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:06.467496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":80,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.487672+0000","last_change":"2024-09-14T11:40:08.941028+0000","last_active":"2024-09-14T12:40:51.487672+0000","last_peered":"2024-09-14T12:40:51.487672+0000","last_clean":"2024-09-14T12:40:51.487672+0000","last_became_active":"2024-09-14T11:40:08.934447+0000","last_became_peered":"2024-09-14T11:40:08.934447+0000","last_unstale":"2024-09-14T12:40:51.487672+0000","last_undegraded":"2024-09-14T12:40:51.487672+0000","last_fullsized":"2024-09-14T12:40:51.487672+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:15.709296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"267'11","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:44.771631+0000","last_change":"2024-09-14T11:12:26.254154+0000","last_active":"2024-09-14T12:42:44.771631+0000","last_peered":"2024-09-14T12:42:44.771631+0000","last_clean":"2024-09-14T12:42:44.771631+0000","last_became_active":"2024-09-14T11:12:26.253410+0000","last_became_peered":"2024-09-14T11:12:26.253410+0000","last_unstale":"2024-09-14T12:42:44.771631+0000","last_undegraded":"2024-09-14T12:42:44.771631+0000","last_fullsized":"2024-09-14T12:42:44.771631+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.081481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6160,"num_write":16,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:04.735243+0000","last_change":"2024-09-14T11:12:19.112482+0000","last_active":"2024-09-14T12:40:04.735243+0000","last_peered":"2024-09-14T12:40:04.735243+0000","last_clean":"2024-09-14T12:40:04.735243+0000","last_became_active":"2024-09-14T11:12:19.109807+0000","last_became_peered":"2024-09-14T11:12:19.109807+0000","last_unstale":"2024-09-14T12:40:04.735243+0000","last_undegraded":"2024-09-14T12:40:04.735243+0000","last_fullsized":"2024-09-14T12:40:04.735243+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:20.441664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'38","reported_seq":180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:00.554078+0000","last_change":"2024-09-14T11:06:29.521507+0000","last_active":"2024-09-14T12:41:00.554078+0000","last_peered":"2024-09-14T12:41:00.554078+0000","last_clean":"2024-09-14T12:41:00.554078+0000","last_became_active":"2024-09-14T11:06:29.520734+0000","last_became_peered":"2024-09-14T11:06:29.520734+0000","last_unstale":"2024-09-14T12:41:00.554078+0000","last_undegraded":"2024-09-14T12:41:00.554078+0000","last_fullsized":"2024-09-14T12:41:00.554078+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:18.770348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":248,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.551623+0000","last_change":"2024-09-14T11:40:08.929963+0000","last_active":"2024-09-14T12:40:50.551623+0000","last_peered":"2024-09-14T12:40:50.551623+0000","last_clean":"2024-09-14T12:40:50.551623+0000","last_became_active":"2024-09-14T11:40:08.928855+0000","last_became_peered":"2024-09-14T11:40:08.928855+0000","last_unstale":"2024-09-14T12:40:50.551623+0000","last_undegraded":"2024-09-14T12:40:50.551623+0000","last_fullsized":"2024-09-14T12:40:50.551623+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:53.447923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:10.554007+0000","last_change":"2024-09-14T11:12:26.236373+0000","last_active":"2024-09-14T12:40:10.554007+0000","last_peered":"2024-09-14T12:40:10.554007+0000","last_clean":"2024-09-14T12:40:10.554007+0000","last_became_active":"2024-09-14T11:12:26.235707+0000","last_became_peered":"2024-09-14T11:12:26.235707+0000","last_unstale":"2024-09-14T12:40:10.554007+0000","last_undegraded":"2024-09-14T12:40:10.554007+0000","last_fullsized":"2024-09-14T12:40:10.554007+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:08.153271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"267'5","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.951256+0000","last_change":"2024-09-14T11:12:19.112752+0000","last_active":"2024-09-14T12:44:02.951256+0000","last_peered":"2024-09-14T12:44:02.951256+0000","last_clean":"2024-09-14T12:44:02.951256+0000","last_became_active":"2024-09-14T11:12:19.112055+0000","last_became_peered":"2024-09-14T11:12:19.112055+0000","last_unstale":"2024-09-14T12:44:02.951256+0000","last_undegraded":"2024-09-14T12:44:02.951256+0000","last_fullsized":"2024-09-14T12:44:02.951256+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:44.097342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'65","reported_seq":253,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548334+0000","last_change":"2024-09-14T11:06:29.516817+0000","last_active":"2024-09-14T12:41:01.548334+0000","last_peered":"2024-09-14T12:41:01.548334+0000","last_clean":"2024-09-14T12:41:01.548334+0000","last_became_active":"2024-09-14T11:06:29.511360+0000","last_became_peered":"2024-09-14T11:06:29.511360+0000","last_unstale":"2024-09-14T12:41:01.548334+0000","last_undegraded":"2024-09-14T12:41:01.548334+0000","last_fullsized":"2024-09-14T12:41:01.548334+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:54.074956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":367,"num_write":155,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.564546+0000","last_change":"2024-09-14T11:40:08.949706+0000","last_active":"2024-09-14T12:40:55.564546+0000","last_peered":"2024-09-14T12:40:55.564546+0000","last_clean":"2024-09-14T12:40:55.564546+0000","last_became_active":"2024-09-14T11:40:08.949175+0000","last_became_peered":"2024-09-14T11:40:08.949175+0000","last_unstale":"2024-09-14T12:40:55.564546+0000","last_undegraded":"2024-09-14T12:40:55.564546+0000","last_fullsized":"2024-09-14T12:40:55.564546+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:24.365260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.227031+0000","last_change":"2024-09-14T11:12:26.229833+0000","last_active":"2024-09-14T12:44:03.227031+0000","last_peered":"2024-09-14T12:44:03.227031+0000","last_clean":"2024-09-14T12:44:03.227031+0000","last_became_active":"2024-09-14T11:12:26.228889+0000","last_became_peered":"2024-09-14T11:12:26.228889+0000","last_unstale":"2024-09-14T12:44:03.227031+0000","last_undegraded":"2024-09-14T12:44:03.227031+0000","last_fullsized":"2024-09-14T12:44:03.227031+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:37.357481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:19.779183+0000","last_change":"2024-09-14T11:12:19.099716+0000","last_active":"2024-09-14T12:43:19.779183+0000","last_peered":"2024-09-14T12:43:19.779183+0000","last_clean":"2024-09-14T12:43:19.779183+0000","last_became_active":"2024-09-14T11:12:19.098699+0000","last_became_peered":"2024-09-14T11:12:19.098699+0000","last_unstale":"2024-09-14T12:43:19.779183+0000","last_undegraded":"2024-09-14T12:43:19.779183+0000","last_fullsized":"2024-09-14T12:43:19.779183+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:03.576522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'39","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.548268+0000","last_change":"2024-09-14T11:06:29.539103+0000","last_active":"2024-09-14T12:41:01.548268+0000","last_peered":"2024-09-14T12:41:01.548268+0000","last_clean":"2024-09-14T12:41:01.548268+0000","last_became_active":"2024-09-14T11:06:29.538432+0000","last_became_peered":"2024-09-14T11:06:29.538432+0000","last_unstale":"2024-09-14T12:41:01.548268+0000","last_undegraded":"2024-09-14T12:41:01.548268+0000","last_fullsized":"2024-09-14T12:41:01.548268+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.474730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":213,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.159302+0000","last_change":"2024-09-14T11:40:08.942492+0000","last_active":"2024-09-14T12:41:06.159302+0000","last_peered":"2024-09-14T12:41:06.159302+0000","last_clean":"2024-09-14T12:41:06.159302+0000","last_became_active":"2024-09-14T11:40:08.941924+0000","last_became_peered":"2024-09-14T11:40:08.941924+0000","last_unstale":"2024-09-14T12:41:06.159302+0000","last_undegraded":"2024-09-14T12:41:06.159302+0000","last_fullsized":"2024-09-14T12:41:06.159302+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:27.899066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'7","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:26.189523+0000","last_change":"2024-09-14T11:12:26.248413+0000","last_active":"2024-09-14T12:43:26.189523+0000","last_peered":"2024-09-14T12:43:26.189523+0000","last_clean":"2024-09-14T12:43:26.189523+0000","last_became_active":"2024-09-14T11:12:26.247849+0000","last_became_peered":"2024-09-14T11:12:26.247849+0000","last_unstale":"2024-09-14T12:43:26.189523+0000","last_undegraded":"2024-09-14T12:43:26.189523+0000","last_fullsized":"2024-09-14T12:43:26.189523+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:10.903087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5155,"num_write":12,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.208693+0000","last_change":"2024-09-14T11:12:19.096332+0000","last_active":"2024-09-14T12:44:02.208693+0000","last_peered":"2024-09-14T12:44:02.208693+0000","last_clean":"2024-09-14T12:44:02.208693+0000","last_became_active":"2024-09-14T11:12:19.095636+0000","last_became_peered":"2024-09-14T11:12:19.095636+0000","last_unstale":"2024-09-14T12:44:02.208693+0000","last_undegraded":"2024-09-14T12:44:02.208693+0000","last_fullsized":"2024-09-14T12:44:02.208693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:51.045024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'31","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.172872+0000","last_change":"2024-09-14T11:06:29.508912+0000","last_active":"2024-09-14T12:42:06.172872+0000","last_peered":"2024-09-14T12:42:06.172872+0000","last_clean":"2024-09-14T12:42:06.172872+0000","last_became_active":"2024-09-14T11:06:29.508269+0000","last_became_peered":"2024-09-14T11:06:29.508269+0000","last_unstale":"2024-09-14T12:42:06.172872+0000","last_undegraded":"2024-09-14T12:42:06.172872+0000","last_fullsized":"2024-09-14T12:42:06.172872+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":149,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.800182+0000","last_change":"2024-09-14T11:40:08.945998+0000","last_active":"2024-09-14T12:40:55.800182+0000","last_peered":"2024-09-14T12:40:55.800182+0000","last_clean":"2024-09-14T12:40:55.800182+0000","last_became_active":"2024-09-14T11:40:08.945217+0000","last_became_peered":"2024-09-14T11:40:08.945217+0000","last_unstale":"2024-09-14T12:40:55.800182+0000","last_undegraded":"2024-09-14T12:40:55.800182+0000","last_fullsized":"2024-09-14T12:40:55.800182+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:49.290553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'5","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:26.567208+0000","last_change":"2024-09-14T11:12:26.247976+0000","last_active":"2024-09-14T12:42:26.567208+0000","last_peered":"2024-09-14T12:42:26.567208+0000","last_clean":"2024-09-14T12:42:26.567208+0000","last_became_active":"2024-09-14T11:12:26.247272+0000","last_became_peered":"2024-09-14T11:12:26.247272+0000","last_unstale":"2024-09-14T12:42:26.567208+0000","last_undegraded":"2024-09-14T12:42:26.567208+0000","last_fullsized":"2024-09-14T12:42:26.567208+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:11.612706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:34.782674+0000","last_change":"2024-09-14T11:12:19.106061+0000","last_active":"2024-09-14T12:43:34.782674+0000","last_peered":"2024-09-14T12:43:34.782674+0000","last_clean":"2024-09-14T12:43:34.782674+0000","last_became_active":"2024-09-14T11:12:19.103535+0000","last_became_peered":"2024-09-14T11:12:19.103535+0000","last_unstale":"2024-09-14T12:43:34.782674+0000","last_undegraded":"2024-09-14T12:43:34.782674+0000","last_fullsized":"2024-09-14T12:43:34.782674+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:54.680229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'7","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.358674+0000","last_change":"2024-09-14T11:06:29.510769+0000","last_active":"2024-09-14T12:41:50.358674+0000","last_peered":"2024-09-14T12:41:50.358674+0000","last_clean":"2024-09-14T12:41:50.358674+0000","last_became_active":"2024-09-14T11:06:29.510044+0000","last_became_peered":"2024-09-14T11:06:29.510044+0000","last_unstale":"2024-09-14T12:41:50.358674+0000","last_undegraded":"2024-09-14T12:41:50.358674+0000","last_fullsized":"2024-09-14T12:41:50.358674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:30.328430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:54.746472+0000","last_change":"2024-09-14T11:40:08.930752+0000","last_active":"2024-09-14T12:40:54.746472+0000","last_peered":"2024-09-14T12:40:54.746472+0000","last_clean":"2024-09-14T12:40:54.746472+0000","last_became_active":"2024-09-14T11:40:08.930065+0000","last_became_peered":"2024-09-14T11:40:08.930065+0000","last_unstale":"2024-09-14T12:40:54.746472+0000","last_undegraded":"2024-09-14T12:40:54.746472+0000","last_fullsized":"2024-09-14T12:40:54.746472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.939757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.807272+0000","last_change":"2024-09-14T11:12:26.234589+0000","last_active":"2024-09-14T12:41:30.807272+0000","last_peered":"2024-09-14T12:41:30.807272+0000","last_clean":"2024-09-14T12:41:30.807272+0000","last_became_active":"2024-09-14T11:12:26.233812+0000","last_became_peered":"2024-09-14T11:12:26.233812+0000","last_unstale":"2024-09-14T12:41:30.807272+0000","last_undegraded":"2024-09-14T12:41:30.807272+0000","last_fullsized":"2024-09-14T12:41:30.807272+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:49.220830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.511709+0000","last_change":"2024-09-14T11:12:19.108839+0000","last_active":"2024-09-14T12:42:21.511709+0000","last_peered":"2024-09-14T12:42:21.511709+0000","last_clean":"2024-09-14T12:42:21.511709+0000","last_became_active":"2024-09-14T11:12:19.107950+0000","last_became_peered":"2024-09-14T11:12:19.107950+0000","last_unstale":"2024-09-14T12:42:21.511709+0000","last_undegraded":"2024-09-14T12:42:21.511709+0000","last_fullsized":"2024-09-14T12:42:21.511709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:06.871908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'21","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.810485+0000","last_change":"2024-09-14T11:06:29.528799+0000","last_active":"2024-09-14T12:41:50.810485+0000","last_peered":"2024-09-14T12:41:50.810485+0000","last_clean":"2024-09-14T12:41:50.810485+0000","last_became_active":"2024-09-14T11:06:29.528153+0000","last_became_peered":"2024-09-14T11:06:29.528153+0000","last_unstale":"2024-09-14T12:41:50.810485+0000","last_undegraded":"2024-09-14T12:41:50.810485+0000","last_fullsized":"2024-09-14T12:41:50.810485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:32.956165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":111,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795593+0000","last_change":"2024-09-14T11:40:08.937198+0000","last_active":"2024-09-14T12:40:35.795593+0000","last_peered":"2024-09-14T12:40:35.795593+0000","last_clean":"2024-09-14T12:40:35.795593+0000","last_became_active":"2024-09-14T11:40:08.936369+0000","last_became_peered":"2024-09-14T11:40:08.936369+0000","last_unstale":"2024-09-14T12:40:35.795593+0000","last_undegraded":"2024-09-14T12:40:35.795593+0000","last_fullsized":"2024-09-14T12:40:35.795593+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:41.385885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.479399+0000","last_change":"2024-09-14T11:12:26.246616+0000","last_active":"2024-09-14T12:44:04.479399+0000","last_peered":"2024-09-14T12:44:04.479399+0000","last_clean":"2024-09-14T12:44:04.479399+0000","last_became_active":"2024-09-14T11:12:26.245930+0000","last_became_peered":"2024-09-14T11:12:26.245930+0000","last_unstale":"2024-09-14T12:44:04.479399+0000","last_undegraded":"2024-09-14T12:44:04.479399+0000","last_fullsized":"2024-09-14T12:44:04.479399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.534457+0000","last_change":"2024-09-14T11:12:19.109523+0000","last_active":"2024-09-14T12:44:01.534457+0000","last_peered":"2024-09-14T12:44:01.534457+0000","last_clean":"2024-09-14T12:44:01.534457+0000","last_became_active":"2024-09-14T11:12:19.108775+0000","last_became_peered":"2024-09-14T11:12:19.108775+0000","last_unstale":"2024-09-14T12:44:01.534457+0000","last_undegraded":"2024-09-14T12:44:01.534457+0000","last_fullsized":"2024-09-14T12:44:01.534457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:14.420097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'26","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:50.585974+0000","last_change":"2024-09-14T11:06:29.513212+0000","last_active":"2024-09-14T12:41:50.585974+0000","last_peered":"2024-09-14T12:41:50.585974+0000","last_clean":"2024-09-14T12:41:50.585974+0000","last_became_active":"2024-09-14T11:06:29.512500+0000","last_became_peered":"2024-09-14T11:06:29.512500+0000","last_unstale":"2024-09-14T12:41:50.585974+0000","last_undegraded":"2024-09-14T12:41:50.585974+0000","last_fullsized":"2024-09-14T12:41:50.585974+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:16.159078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":126,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.795654+0000","last_change":"2024-09-14T11:40:08.942991+0000","last_active":"2024-09-14T12:40:35.795654+0000","last_peered":"2024-09-14T12:40:35.795654+0000","last_clean":"2024-09-14T12:40:35.795654+0000","last_became_active":"2024-09-14T11:40:08.941346+0000","last_became_peered":"2024-09-14T11:40:08.941346+0000","last_unstale":"2024-09-14T12:40:35.795654+0000","last_undegraded":"2024-09-14T12:40:35.795654+0000","last_fullsized":"2024-09-14T12:40:35.795654+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.150412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827889+0000","last_change":"2024-09-14T11:12:26.243752+0000","last_active":"2024-09-14T12:44:03.827889+0000","last_peered":"2024-09-14T12:44:03.827889+0000","last_clean":"2024-09-14T12:44:03.827889+0000","last_became_active":"2024-09-14T11:12:26.243209+0000","last_became_peered":"2024-09-14T11:12:26.243209+0000","last_unstale":"2024-09-14T12:44:03.827889+0000","last_undegraded":"2024-09-14T12:44:03.827889+0000","last_fullsized":"2024-09-14T12:44:03.827889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:38.328679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'11","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.159543+0000","last_change":"2024-09-14T11:12:19.092074+0000","last_active":"2024-09-14T12:44:04.159543+0000","last_peered":"2024-09-14T12:44:04.159543+0000","last_clean":"2024-09-14T12:44:04.159543+0000","last_became_active":"2024-09-14T11:12:19.091327+0000","last_became_peered":"2024-09-14T11:12:19.091327+0000","last_unstale":"2024-09-14T12:44:04.159543+0000","last_undegraded":"2024-09-14T12:44:04.159543+0000","last_fullsized":"2024-09-14T12:44:04.159543+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":27638,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'29","reported_seq":155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503327+0000","last_change":"2024-09-14T11:06:29.545877+0000","last_active":"2024-09-14T12:41:51.503327+0000","last_peered":"2024-09-14T12:41:51.503327+0000","last_clean":"2024-09-14T12:41:51.503327+0000","last_became_active":"2024-09-14T11:06:29.539618+0000","last_became_peered":"2024-09-14T11:06:29.539618+0000","last_unstale":"2024-09-14T12:41:51.503327+0000","last_undegraded":"2024-09-14T12:41:51.503327+0000","last_fullsized":"2024-09-14T12:41:51.503327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:18.342360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":157,"num_write":71,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.368808+0000","last_change":"2024-09-14T11:40:08.946921+0000","last_active":"2024-09-14T12:42:30.368808+0000","last_peered":"2024-09-14T12:42:30.368808+0000","last_clean":"2024-09-14T12:42:30.368808+0000","last_became_active":"2024-09-14T11:40:08.946312+0000","last_became_peered":"2024-09-14T11:40:08.946312+0000","last_unstale":"2024-09-14T12:42:30.368808+0000","last_undegraded":"2024-09-14T12:42:30.368808+0000","last_fullsized":"2024-09-14T12:42:30.368808+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'9","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:25.830170+0000","last_change":"2024-09-14T11:12:26.229509+0000","last_active":"2024-09-14T12:43:25.830170+0000","last_peered":"2024-09-14T12:43:25.830170+0000","last_clean":"2024-09-14T12:43:25.830170+0000","last_became_active":"2024-09-14T11:12:26.228723+0000","last_became_peered":"2024-09-14T11:12:26.228723+0000","last_unstale":"2024-09-14T12:43:25.830170+0000","last_undegraded":"2024-09-14T12:43:25.830170+0000","last_fullsized":"2024-09-14T12:43:25.830170+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:02.621776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11303,"num_write":14,"num_write_kb":5161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:11.160475+0000","last_change":"2024-09-14T11:12:19.085868+0000","last_active":"2024-09-14T12:41:11.160475+0000","last_peered":"2024-09-14T12:41:11.160475+0000","last_clean":"2024-09-14T12:41:11.160475+0000","last_became_active":"2024-09-14T11:12:19.085023+0000","last_became_peered":"2024-09-14T11:12:19.085023+0000","last_unstale":"2024-09-14T12:41:11.160475+0000","last_undegraded":"2024-09-14T12:41:11.160475+0000","last_fullsized":"2024-09-14T12:41:11.160475+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:18.952727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'37","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:31.150526+0000","last_change":"2024-09-14T11:06:29.529450+0000","last_active":"2024-09-14T12:40:31.150526+0000","last_peered":"2024-09-14T12:40:31.150526+0000","last_clean":"2024-09-14T12:40:31.150526+0000","last_became_active":"2024-09-14T11:06:29.527422+0000","last_became_peered":"2024-09-14T11:06:29.527422+0000","last_unstale":"2024-09-14T12:40:31.150526+0000","last_undegraded":"2024-09-14T12:40:31.150526+0000","last_fullsized":"2024-09-14T12:40:31.150526+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.481655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":97,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.483898+0000","last_change":"2024-09-14T11:40:08.934634+0000","last_active":"2024-09-14T12:40:36.483898+0000","last_peered":"2024-09-14T12:40:36.483898+0000","last_clean":"2024-09-14T12:40:36.483898+0000","last_became_active":"2024-09-14T11:40:08.933897+0000","last_became_peered":"2024-09-14T11:40:08.933897+0000","last_unstale":"2024-09-14T12:40:36.483898+0000","last_undegraded":"2024-09-14T12:40:36.483898+0000","last_fullsized":"2024-09-14T12:40:36.483898+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:56.970787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'7","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827832+0000","last_change":"2024-09-14T11:12:26.238345+0000","last_active":"2024-09-14T12:44:03.827832+0000","last_peered":"2024-09-14T12:44:03.827832+0000","last_clean":"2024-09-14T12:44:03.827832+0000","last_became_active":"2024-09-14T11:12:26.232736+0000","last_became_peered":"2024-09-14T11:12:26.232736+0000","last_unstale":"2024-09-14T12:44:03.827832+0000","last_undegraded":"2024-09-14T12:44:03.827832+0000","last_fullsized":"2024-09-14T12:44:03.827832+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:45.595070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":12,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:21.524121+0000","last_change":"2024-09-14T11:12:19.108780+0000","last_active":"2024-09-14T12:43:21.524121+0000","last_peered":"2024-09-14T12:43:21.524121+0000","last_clean":"2024-09-14T12:43:21.524121+0000","last_became_active":"2024-09-14T11:12:19.100258+0000","last_became_peered":"2024-09-14T11:12:19.100258+0000","last_unstale":"2024-09-14T12:43:21.524121+0000","last_undegraded":"2024-09-14T12:43:21.524121+0000","last_fullsized":"2024-09-14T12:43:21.524121+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.561655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2056,"num_write":10,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'41","reported_seq":189,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:19.765933+0000","last_change":"2024-09-14T11:06:29.533686+0000","last_active":"2024-09-14T12:42:19.765933+0000","last_peered":"2024-09-14T12:42:19.765933+0000","last_clean":"2024-09-14T12:42:19.765933+0000","last_became_active":"2024-09-14T11:06:29.532958+0000","last_became_peered":"2024-09-14T11:06:29.532958+0000","last_unstale":"2024-09-14T12:42:19.765933+0000","last_undegraded":"2024-09-14T12:42:19.765933+0000","last_fullsized":"2024-09-14T12:42:19.765933+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":199,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:49.745345+0000","last_change":"2024-09-14T11:40:08.934320+0000","last_active":"2024-09-14T12:40:49.745345+0000","last_peered":"2024-09-14T12:40:49.745345+0000","last_clean":"2024-09-14T12:40:49.745345+0000","last_became_active":"2024-09-14T11:40:08.932939+0000","last_became_peered":"2024-09-14T11:40:08.932939+0000","last_unstale":"2024-09-14T12:40:49.745345+0000","last_undegraded":"2024-09-14T12:40:49.745345+0000","last_fullsized":"2024-09-14T12:40:49.745345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:01.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.876886+0000","last_change":"2024-09-14T11:12:26.245494+0000","last_active":"2024-09-14T12:44:04.876886+0000","last_peered":"2024-09-14T12:44:04.876886+0000","last_clean":"2024-09-14T12:44:04.876886+0000","last_became_active":"2024-09-14T11:12:26.236892+0000","last_became_peered":"2024-09-14T11:12:26.236892+0000","last_unstale":"2024-09-14T12:44:04.876886+0000","last_undegraded":"2024-09-14T12:44:04.876886+0000","last_fullsized":"2024-09-14T12:44:04.876886+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.142203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.151616+0000","last_change":"2024-09-14T11:12:19.085476+0000","last_active":"2024-09-14T12:40:36.151616+0000","last_peered":"2024-09-14T12:40:36.151616+0000","last_clean":"2024-09-14T12:40:36.151616+0000","last_became_active":"2024-09-14T11:12:19.084630+0000","last_became_peered":"2024-09-14T11:12:19.084630+0000","last_unstale":"2024-09-14T12:40:36.151616+0000","last_undegraded":"2024-09-14T12:40:36.151616+0000","last_fullsized":"2024-09-14T12:40:36.151616+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:40.347823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'305","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.176343+0000","last_change":"2024-09-14T11:06:29.529539+0000","last_active":"2024-09-14T12:42:21.176343+0000","last_peered":"2024-09-14T12:42:21.176343+0000","last_clean":"2024-09-14T12:42:21.176343+0000","last_became_active":"2024-09-14T11:06:29.524051+0000","last_became_peered":"2024-09-14T11:06:29.524051+0000","last_unstale":"2024-09-14T12:42:21.176343+0000","last_undegraded":"2024-09-14T12:42:21.176343+0000","last_fullsized":"2024-09-14T12:42:21.176343+0000","mapping_epoch":256,"log_start":"264'200","ondisk_log_start":"264'200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2841,"num_read_kb":3371,"num_write":621,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.572999+0000","last_change":"2024-09-14T11:40:08.938945+0000","last_active":"2024-09-14T12:40:50.572999+0000","last_peered":"2024-09-14T12:40:50.572999+0000","last_clean":"2024-09-14T12:40:50.572999+0000","last_became_active":"2024-09-14T11:40:08.938357+0000","last_became_peered":"2024-09-14T11:40:08.938357+0000","last_unstale":"2024-09-14T12:40:50.572999+0000","last_undegraded":"2024-09-14T12:40:50.572999+0000","last_fullsized":"2024-09-14T12:40:50.572999+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:36.211620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'10","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.128908+0000","last_change":"2024-09-14T11:12:26.252293+0000","last_active":"2024-09-14T12:44:02.128908+0000","last_peered":"2024-09-14T12:44:02.128908+0000","last_clean":"2024-09-14T12:44:02.128908+0000","last_became_active":"2024-09-14T11:12:26.251771+0000","last_became_peered":"2024-09-14T11:12:26.251771+0000","last_unstale":"2024-09-14T12:44:02.128908+0000","last_undegraded":"2024-09-14T12:44:02.128908+0000","last_fullsized":"2024-09-14T12:44:02.128908+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:13.079478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9222,"num_write":10,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.534253+0000","last_change":"2024-09-14T11:12:19.109609+0000","last_active":"2024-09-14T12:44:01.534253+0000","last_peered":"2024-09-14T12:44:01.534253+0000","last_clean":"2024-09-14T12:44:01.534253+0000","last_became_active":"2024-09-14T11:12:19.100323+0000","last_became_peered":"2024-09-14T11:12:19.100323+0000","last_unstale":"2024-09-14T12:44:01.534253+0000","last_undegraded":"2024-09-14T12:44:01.534253+0000","last_fullsized":"2024-09-14T12:44:01.534253+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'31","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.511604+0000","last_change":"2024-09-14T11:06:29.545567+0000","last_active":"2024-09-14T12:42:21.511604+0000","last_peered":"2024-09-14T12:42:21.511604+0000","last_clean":"2024-09-14T12:42:21.511604+0000","last_became_active":"2024-09-14T11:06:29.545010+0000","last_became_peered":"2024-09-14T11:06:29.545010+0000","last_unstale":"2024-09-14T12:42:21.511604+0000","last_undegraded":"2024-09-14T12:42:21.511604+0000","last_fullsized":"2024-09-14T12:42:21.511604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":160,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559740+0000","last_change":"2024-09-14T11:40:08.946756+0000","last_active":"2024-09-14T12:40:35.559740+0000","last_peered":"2024-09-14T12:40:35.559740+0000","last_clean":"2024-09-14T12:40:35.559740+0000","last_became_active":"2024-09-14T11:40:08.946192+0000","last_became_peered":"2024-09-14T11:40:08.946192+0000","last_unstale":"2024-09-14T12:40:35.559740+0000","last_undegraded":"2024-09-14T12:40:35.559740+0000","last_fullsized":"2024-09-14T12:40:35.559740+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:33.765939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"267'14","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.052444+0000","last_change":"2024-09-14T11:12:26.252307+0000","last_active":"2024-09-14T12:44:03.052444+0000","last_peered":"2024-09-14T12:44:03.052444+0000","last_clean":"2024-09-14T12:44:03.052444+0000","last_became_active":"2024-09-14T11:12:26.251336+0000","last_became_peered":"2024-09-14T11:12:26.251336+0000","last_unstale":"2024-09-14T12:44:03.052444+0000","last_undegraded":"2024-09-14T12:44:03.052444+0000","last_fullsized":"2024-09-14T12:44:03.052444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:43.789676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":27664,"num_write":24,"num_write_kb":11276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.560463+0000","last_change":"2024-09-14T11:12:19.090268+0000","last_active":"2024-09-14T12:41:56.560463+0000","last_peered":"2024-09-14T12:41:56.560463+0000","last_clean":"2024-09-14T12:41:56.560463+0000","last_became_active":"2024-09-14T11:12:19.089451+0000","last_became_peered":"2024-09-14T11:12:19.089451+0000","last_unstale":"2024-09-14T12:41:56.560463+0000","last_undegraded":"2024-09-14T12:41:56.560463+0000","last_fullsized":"2024-09-14T12:41:56.560463+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:37.308101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"267'36","reported_seq":177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.511510+0000","last_change":"2024-09-14T11:06:29.519496+0000","last_active":"2024-09-14T12:42:21.511510+0000","last_peered":"2024-09-14T12:42:21.511510+0000","last_clean":"2024-09-14T12:42:21.511510+0000","last_became_active":"2024-09-14T11:06:29.518775+0000","last_became_peered":"2024-09-14T11:06:29.518775+0000","last_unstale":"2024-09-14T12:42:21.511510+0000","last_undegraded":"2024-09-14T12:42:21.511510+0000","last_fullsized":"2024-09-14T12:42:21.511510+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":189,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485290+0000","last_change":"2024-09-14T11:40:08.934946+0000","last_active":"2024-09-14T12:40:41.485290+0000","last_peered":"2024-09-14T12:40:41.485290+0000","last_clean":"2024-09-14T12:40:41.485290+0000","last_became_active":"2024-09-14T11:40:08.934173+0000","last_became_peered":"2024-09-14T11:40:08.934173+0000","last_unstale":"2024-09-14T12:40:41.485290+0000","last_undegraded":"2024-09-14T12:40:41.485290+0000","last_fullsized":"2024-09-14T12:40:41.485290+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:19.698280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"267'6","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.320298+0000","last_change":"2024-09-14T11:12:26.243412+0000","last_active":"2024-09-14T12:44:03.320298+0000","last_peered":"2024-09-14T12:44:03.320298+0000","last_clean":"2024-09-14T12:44:03.320298+0000","last_became_active":"2024-09-14T11:12:26.242532+0000","last_became_peered":"2024-09-14T11:12:26.242532+0000","last_unstale":"2024-09-14T12:44:03.320298+0000","last_undegraded":"2024-09-14T12:44:03.320298+0000","last_fullsized":"2024-09-14T12:44:03.320298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:30.032531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9208,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:55.568347+0000","last_change":"2024-09-14T11:12:19.115989+0000","last_active":"2024-09-14T12:41:55.568347+0000","last_peered":"2024-09-14T12:41:55.568347+0000","last_clean":"2024-09-14T12:41:55.568347+0000","last_became_active":"2024-09-14T11:12:19.115236+0000","last_became_peered":"2024-09-14T11:12:19.115236+0000","last_unstale":"2024-09-14T12:41:55.568347+0000","last_undegraded":"2024-09-14T12:41:55.568347+0000","last_fullsized":"2024-09-14T12:41:55.568347+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:10.915539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'6","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:46.154160+0000","last_change":"2024-09-14T11:06:29.526320+0000","last_active":"2024-09-14T12:40:46.154160+0000","last_peered":"2024-09-14T12:40:46.154160+0000","last_clean":"2024-09-14T12:40:46.154160+0000","last_became_active":"2024-09-14T11:06:29.525548+0000","last_became_peered":"2024-09-14T11:06:29.525548+0000","last_unstale":"2024-09-14T12:40:46.154160+0000","last_undegraded":"2024-09-14T12:40:46.154160+0000","last_fullsized":"2024-09-14T12:40:46.154160+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:11.592331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'395","reported_seq":1128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.241668+0000","last_change":"2024-09-14T12:44:20.241668+0000","last_active":"2024-09-14T12:44:20.241668+0000","last_peered":"2024-09-14T12:44:20.241668+0000","last_clean":"2024-09-14T12:44:20.241668+0000","last_became_active":"2024-09-14T10:49:23.372514+0000","last_became_peered":"2024-09-14T10:49:23.372514+0000","last_unstale":"2024-09-14T12:44:20.241668+0000","last_undegraded":"2024-09-14T12:44:20.241668+0000","last_fullsized":"2024-09-14T12:44:20.241668+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T12:44:20.241424+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T12:44:20.241424+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.241424+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:25.118550+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":698,"num_read_kb":89783,"num_write":1195,"num_write_kb":37856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'879","reported_seq":2591,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.049229+0000","last_change":"2024-09-14T12:44:23.049066+0000","last_active":"2024-09-14T12:44:23.049229+0000","last_peered":"2024-09-14T12:44:23.049229+0000","last_clean":"2024-09-14T12:44:23.049229+0000","last_became_active":"2024-09-14T10:49:25.368861+0000","last_became_peered":"2024-09-14T10:49:25.368861+0000","last_unstale":"2024-09-14T12:44:23.049229+0000","last_undegraded":"2024-09-14T12:44:23.049229+0000","last_fullsized":"2024-09-14T12:44:23.049229+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'879","last_scrub_stamp":"2024-09-14T12:44:23.048885+0000","last_deep_scrub":"267'879","last_deep_scrub_stamp":"2024-09-14T12:44:23.048885+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.048885+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:35:29.666443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4292,"num_read_kb":3786,"num_write":1290,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'389","reported_seq":1147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.841857+0000","last_change":"2024-09-14T12:44:23.841857+0000","last_active":"2024-09-14T12:44:23.841857+0000","last_peered":"2024-09-14T12:44:23.841857+0000","last_clean":"2024-09-14T12:44:23.841857+0000","last_became_active":"2024-09-14T10:49:23.386742+0000","last_became_peered":"2024-09-14T10:49:23.386742+0000","last_unstale":"2024-09-14T12:44:23.841857+0000","last_undegraded":"2024-09-14T12:44:23.841857+0000","last_fullsized":"2024-09-14T12:44:23.841857+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-09-14T12:44:23.841630+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-09-14T12:44:23.841630+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.841630+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:47.077958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":967,"num_read_kb":14779,"num_write":1188,"num_write_kb":22069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'1157","reported_seq":2811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.762884+0000","last_change":"2024-09-14T10:49:25.371243+0000","last_active":"2024-09-14T12:42:31.762884+0000","last_peered":"2024-09-14T12:42:31.762884+0000","last_clean":"2024-09-14T12:42:31.762884+0000","last_became_active":"2024-09-14T10:49:25.370610+0000","last_became_peered":"2024-09-14T10:49:25.370610+0000","last_unstale":"2024-09-14T12:42:31.762884+0000","last_undegraded":"2024-09-14T12:42:31.762884+0000","last_fullsized":"2024-09-14T12:42:31.762884+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5343,"num_read_kb":4756,"num_write":1566,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'380","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.834788+0000","last_change":"2024-09-14T12:44:22.834788+0000","last_active":"2024-09-14T12:44:22.834788+0000","last_peered":"2024-09-14T12:44:22.834788+0000","last_clean":"2024-09-14T12:44:22.834788+0000","last_became_active":"2024-09-14T10:49:23.367647+0000","last_became_peered":"2024-09-14T10:49:23.367647+0000","last_unstale":"2024-09-14T12:44:22.834788+0000","last_undegraded":"2024-09-14T12:44:22.834788+0000","last_fullsized":"2024-09-14T12:44:22.834788+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-14T12:44:22.834585+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-14T12:44:22.834585+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.834585+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:40.778231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":20304,"num_write":1229,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1240","reported_seq":2833,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.504731+0000","last_change":"2024-09-14T10:49:25.380844+0000","last_active":"2024-09-14T12:41:56.504731+0000","last_peered":"2024-09-14T12:41:56.504731+0000","last_clean":"2024-09-14T12:41:56.504731+0000","last_became_active":"2024-09-14T10:49:25.380525+0000","last_became_peered":"2024-09-14T10:49:25.380525+0000","last_unstale":"2024-09-14T12:41:56.504731+0000","last_undegraded":"2024-09-14T12:41:56.504731+0000","last_fullsized":"2024-09-14T12:41:56.504731+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5594,"num_read_kb":4933,"num_write":1701,"num_write_kb":712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.857351+0000","last_change":"2024-09-14T12:44:15.857351+0000","last_active":"2024-09-14T12:44:15.857351+0000","last_peered":"2024-09-14T12:44:15.857351+0000","last_clean":"2024-09-14T12:44:15.857351+0000","last_became_active":"2024-09-14T10:49:23.395029+0000","last_became_peered":"2024-09-14T10:49:23.395029+0000","last_unstale":"2024-09-14T12:44:15.857351+0000","last_undegraded":"2024-09-14T12:44:15.857351+0000","last_fullsized":"2024-09-14T12:44:15.857351+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-09-14T12:44:15.857104+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-09-14T12:44:15.857104+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.857104+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:35.578952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":13844,"num_write":1136,"num_write_kb":32575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'923","reported_seq":2548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.832708+0000","last_change":"2024-09-14T12:44:26.832708+0000","last_active":"2024-09-14T12:44:26.832708+0000","last_peered":"2024-09-14T12:44:26.832708+0000","last_clean":"2024-09-14T12:44:26.832708+0000","last_became_active":"2024-09-14T10:49:25.368723+0000","last_became_peered":"2024-09-14T10:49:25.368723+0000","last_unstale":"2024-09-14T12:44:26.832708+0000","last_undegraded":"2024-09-14T12:44:26.832708+0000","last_fullsized":"2024-09-14T12:44:26.832708+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'923","last_scrub_stamp":"2024-09-14T12:44:26.832504+0000","last_deep_scrub":"267'923","last_deep_scrub_stamp":"2024-09-14T12:44:26.832504+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.832504+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:38.827676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6457,"num_read_kb":5960,"num_write":1431,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'365","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.327853+0000","last_change":"2024-09-14T12:44:18.327687+0000","last_active":"2024-09-14T12:44:18.327853+0000","last_peered":"2024-09-14T12:44:18.327853+0000","last_clean":"2024-09-14T12:44:18.327853+0000","last_became_active":"2024-09-14T10:49:23.396952+0000","last_became_peered":"2024-09-14T10:49:23.396952+0000","last_unstale":"2024-09-14T12:44:18.327853+0000","last_undegraded":"2024-09-14T12:44:18.327853+0000","last_fullsized":"2024-09-14T12:44:18.327853+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-14T12:44:18.327453+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-14T12:44:18.327453+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.327453+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:39.003445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":730,"num_read_kb":15587,"num_write":1249,"num_write_kb":19198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'490","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.118914+0000","last_change":"2024-09-14T12:44:24.118914+0000","last_active":"2024-09-14T12:44:24.118914+0000","last_peered":"2024-09-14T12:44:24.118914+0000","last_clean":"2024-09-14T12:44:24.118914+0000","last_became_active":"2024-09-14T10:49:25.369197+0000","last_became_peered":"2024-09-14T10:49:25.369197+0000","last_unstale":"2024-09-14T12:44:24.118914+0000","last_undegraded":"2024-09-14T12:44:24.118914+0000","last_fullsized":"2024-09-14T12:44:24.118914+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-14T12:44:24.118736+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-14T12:44:24.118736+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.118736+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:43.727353+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2591,"num_write":558,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'328","reported_seq":987,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.891194+0000","last_change":"2024-09-14T12:44:14.891054+0000","last_active":"2024-09-14T12:44:14.891194+0000","last_peered":"2024-09-14T12:44:14.891194+0000","last_clean":"2024-09-14T12:44:14.891194+0000","last_became_active":"2024-09-14T10:49:23.386773+0000","last_became_peered":"2024-09-14T10:49:23.386773+0000","last_unstale":"2024-09-14T12:44:14.891194+0000","last_undegraded":"2024-09-14T12:44:14.891194+0000","last_fullsized":"2024-09-14T12:44:14.891194+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-14T12:44:14.890841+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-14T12:44:14.890841+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.890841+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:33.495347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":548,"num_read_kb":8718,"num_write":1059,"num_write_kb":39714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'430","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.155332+0000","last_change":"2024-09-14T12:44:25.155332+0000","last_active":"2024-09-14T12:44:25.155332+0000","last_peered":"2024-09-14T12:44:25.155332+0000","last_clean":"2024-09-14T12:44:25.155332+0000","last_became_active":"2024-09-14T10:49:25.404189+0000","last_became_peered":"2024-09-14T10:49:25.404189+0000","last_unstale":"2024-09-14T12:44:25.155332+0000","last_undegraded":"2024-09-14T12:44:25.155332+0000","last_fullsized":"2024-09-14T12:44:25.155332+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-14T12:44:25.155091+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-14T12:44:25.155091+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.155091+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:47.356155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2519,"num_read_kb":2387,"num_write":515,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'405","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.416312+0000","last_change":"2024-09-14T12:44:15.416147+0000","last_active":"2024-09-14T12:44:15.416312+0000","last_peered":"2024-09-14T12:44:15.416312+0000","last_clean":"2024-09-14T12:44:15.416312+0000","last_became_active":"2024-09-14T10:49:23.353824+0000","last_became_peered":"2024-09-14T10:49:23.353824+0000","last_unstale":"2024-09-14T12:44:15.416312+0000","last_undegraded":"2024-09-14T12:44:15.416312+0000","last_fullsized":"2024-09-14T12:44:15.416312+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'405","last_scrub_stamp":"2024-09-14T12:44:15.415866+0000","last_deep_scrub":"267'405","last_deep_scrub_stamp":"2024-09-14T12:44:15.415866+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.415866+0000","objects_scrubbed":12,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:43.030406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":687,"num_read_kb":3209,"num_write":1301,"num_write_kb":30473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'1239","reported_seq":2952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.863432+0000","last_change":"2024-09-14T12:44:23.863432+0000","last_active":"2024-09-14T12:44:23.863432+0000","last_peered":"2024-09-14T12:44:23.863432+0000","last_clean":"2024-09-14T12:44:23.863432+0000","last_became_active":"2024-09-14T10:49:25.388008+0000","last_became_peered":"2024-09-14T10:49:25.388008+0000","last_unstale":"2024-09-14T12:44:23.863432+0000","last_undegraded":"2024-09-14T12:44:23.863432+0000","last_fullsized":"2024-09-14T12:44:23.863432+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1239","last_scrub_stamp":"2024-09-14T12:44:23.863231+0000","last_deep_scrub":"267'1239","last_deep_scrub_stamp":"2024-09-14T12:44:23.863231+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.863231+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:30.652457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5023,"num_write":1696,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'317","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.811876+0000","last_change":"2024-09-14T12:44:21.811716+0000","last_active":"2024-09-14T12:44:21.811876+0000","last_peered":"2024-09-14T12:44:21.811876+0000","last_clean":"2024-09-14T12:44:21.811876+0000","last_became_active":"2024-09-14T10:49:23.374194+0000","last_became_peered":"2024-09-14T10:49:23.374194+0000","last_unstale":"2024-09-14T12:44:21.811876+0000","last_undegraded":"2024-09-14T12:44:21.811876+0000","last_fullsized":"2024-09-14T12:44:21.811876+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-14T12:44:21.811471+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-14T12:44:21.811471+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.811471+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:14:34.008333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730149,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":30724,"num_write":962,"num_write_kb":46577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'763","reported_seq":2187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.688694+0000","last_change":"2024-09-14T10:49:25.396557+0000","last_active":"2024-09-14T12:43:47.688694+0000","last_peered":"2024-09-14T12:43:47.688694+0000","last_clean":"2024-09-14T12:43:47.688694+0000","last_became_active":"2024-09-14T10:49:25.395625+0000","last_became_peered":"2024-09-14T10:49:25.395625+0000","last_unstale":"2024-09-14T12:43:47.688694+0000","last_undegraded":"2024-09-14T12:43:47.688694+0000","last_fullsized":"2024-09-14T12:43:47.688694+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:55.126134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3607,"num_read_kb":3221,"num_write":1031,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'923","reported_seq":2610,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:26.496603+0000","last_change":"2024-09-14T10:49:25.378305+0000","last_active":"2024-09-14T12:41:26.496603+0000","last_peered":"2024-09-14T12:41:26.496603+0000","last_clean":"2024-09-14T12:41:26.496603+0000","last_became_active":"2024-09-14T10:49:25.377697+0000","last_became_peered":"2024-09-14T10:49:25.377697+0000","last_unstale":"2024-09-14T12:41:26.496603+0000","last_undegraded":"2024-09-14T12:41:26.496603+0000","last_fullsized":"2024-09-14T12:41:26.496603+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:55.143987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4426,"num_read_kb":3954,"num_write":1251,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'319","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.982570+0000","last_change":"2024-09-14T12:44:14.982570+0000","last_active":"2024-09-14T12:44:14.982570+0000","last_peered":"2024-09-14T12:44:14.982570+0000","last_clean":"2024-09-14T12:44:14.982570+0000","last_became_active":"2024-09-14T10:49:23.395881+0000","last_became_peered":"2024-09-14T10:49:23.395881+0000","last_unstale":"2024-09-14T12:44:14.982570+0000","last_undegraded":"2024-09-14T12:44:14.982570+0000","last_fullsized":"2024-09-14T12:44:14.982570+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-14T12:44:14.982349+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-14T12:44:14.982349+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.982349+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.098578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":45321,"num_write":937,"num_write_kb":34104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'503","reported_seq":2246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.198419+0000","last_change":"2024-09-14T12:44:21.198419+0000","last_active":"2024-09-14T12:44:21.198419+0000","last_peered":"2024-09-14T12:44:21.198419+0000","last_clean":"2024-09-14T12:44:21.198419+0000","last_became_active":"2024-09-14T10:49:25.359419+0000","last_became_peered":"2024-09-14T10:49:25.359419+0000","last_unstale":"2024-09-14T12:44:21.198419+0000","last_undegraded":"2024-09-14T12:44:21.198419+0000","last_fullsized":"2024-09-14T12:44:21.198419+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'503","last_scrub_stamp":"2024-09-14T12:44:21.198212+0000","last_deep_scrub":"267'503","last_deep_scrub_stamp":"2024-09-14T12:44:21.198212+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.198212+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:09.718517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2958,"num_read_kb":2787,"num_write":621,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'335","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.375590+0000","last_change":"2024-09-14T12:44:17.375590+0000","last_active":"2024-09-14T12:44:17.375590+0000","last_peered":"2024-09-14T12:44:17.375590+0000","last_clean":"2024-09-14T12:44:17.375590+0000","last_became_active":"2024-09-14T10:49:23.372672+0000","last_became_peered":"2024-09-14T10:49:23.372672+0000","last_unstale":"2024-09-14T12:44:17.375590+0000","last_undegraded":"2024-09-14T12:44:17.375590+0000","last_fullsized":"2024-09-14T12:44:17.375590+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-14T12:44:17.375353+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-14T12:44:17.375353+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.375353+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:32.309861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":589,"num_read_kb":8965,"num_write":1037,"num_write_kb":20473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'402","reported_seq":1920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.005658+0000","last_change":"2024-09-14T12:44:21.005658+0000","last_active":"2024-09-14T12:44:21.005658+0000","last_peered":"2024-09-14T12:44:21.005658+0000","last_clean":"2024-09-14T12:44:21.005658+0000","last_became_active":"2024-09-14T10:49:25.403885+0000","last_became_peered":"2024-09-14T10:49:25.403885+0000","last_unstale":"2024-09-14T12:44:21.005658+0000","last_undegraded":"2024-09-14T12:44:21.005658+0000","last_fullsized":"2024-09-14T12:44:21.005658+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:21.005460+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:21.005460+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.005460+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:39.200942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2137,"num_read_kb":2023,"num_write":462,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'394","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.346147+0000","last_change":"2024-09-14T12:44:13.346147+0000","last_active":"2024-09-14T12:44:13.346147+0000","last_peered":"2024-09-14T12:44:13.346147+0000","last_clean":"2024-09-14T12:44:13.346147+0000","last_became_active":"2024-09-14T10:49:23.354127+0000","last_became_peered":"2024-09-14T10:49:23.354127+0000","last_unstale":"2024-09-14T12:44:13.346147+0000","last_undegraded":"2024-09-14T12:44:13.346147+0000","last_fullsized":"2024-09-14T12:44:13.346147+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'394","last_scrub_stamp":"2024-09-14T12:44:13.345931+0000","last_deep_scrub":"267'394","last_deep_scrub_stamp":"2024-09-14T12:44:13.345931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.345931+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:48.706335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":781,"num_read_kb":56952,"num_write":1264,"num_write_kb":28690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"267'805","reported_seq":2357,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.811470+0000","last_change":"2024-09-14T12:44:24.811470+0000","last_active":"2024-09-14T12:44:24.811470+0000","last_peered":"2024-09-14T12:44:24.811470+0000","last_clean":"2024-09-14T12:44:24.811470+0000","last_became_active":"2024-09-14T10:49:25.396001+0000","last_became_peered":"2024-09-14T10:49:25.396001+0000","last_unstale":"2024-09-14T12:44:24.811470+0000","last_undegraded":"2024-09-14T12:44:24.811470+0000","last_fullsized":"2024-09-14T12:44:24.811470+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'805","last_scrub_stamp":"2024-09-14T12:44:24.811267+0000","last_deep_scrub":"267'805","last_deep_scrub_stamp":"2024-09-14T12:44:24.811267+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.811267+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:43:01.444670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3888,"num_read_kb":3489,"num_write":1086,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1380,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'386","reported_seq":1183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.337240+0000","last_change":"2024-09-14T12:44:12.337240+0000","last_active":"2024-09-14T12:44:12.337240+0000","last_peered":"2024-09-14T12:44:12.337240+0000","last_clean":"2024-09-14T12:44:12.337240+0000","last_became_active":"2024-09-14T10:49:23.387292+0000","last_became_peered":"2024-09-14T10:49:23.387292+0000","last_unstale":"2024-09-14T12:44:12.337240+0000","last_undegraded":"2024-09-14T12:44:12.337240+0000","last_fullsized":"2024-09-14T12:44:12.337240+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T12:44:12.337076+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T12:44:12.337076+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.337076+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:05.269545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":721,"num_read_kb":37760,"num_write":1195,"num_write_kb":55114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'374","reported_seq":1811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.937851+0000","last_change":"2024-09-14T12:44:29.937851+0000","last_active":"2024-09-14T12:44:29.937851+0000","last_peered":"2024-09-14T12:44:29.937851+0000","last_clean":"2024-09-14T12:44:29.937851+0000","last_became_active":"2024-09-14T10:49:25.394106+0000","last_became_peered":"2024-09-14T10:49:25.394106+0000","last_unstale":"2024-09-14T12:44:29.937851+0000","last_undegraded":"2024-09-14T12:44:29.937851+0000","last_fullsized":"2024-09-14T12:44:29.937851+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:29.937641+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:29.937641+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.937641+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:07.766027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2013,"num_read_kb":1909,"num_write":433,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'428","reported_seq":1109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.764159+0000","last_change":"2024-09-14T12:44:17.764159+0000","last_active":"2024-09-14T12:44:17.764159+0000","last_peered":"2024-09-14T12:44:17.764159+0000","last_clean":"2024-09-14T12:44:17.764159+0000","last_became_active":"2024-09-14T10:49:23.364035+0000","last_became_peered":"2024-09-14T10:49:23.364035+0000","last_unstale":"2024-09-14T12:44:17.764159+0000","last_undegraded":"2024-09-14T12:44:17.764159+0000","last_fullsized":"2024-09-14T12:44:17.764159+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'428","last_scrub_stamp":"2024-09-14T12:44:17.763953+0000","last_deep_scrub":"267'428","last_deep_scrub_stamp":"2024-09-14T12:44:17.763953+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.763953+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:02.372941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":874,"num_read_kb":15225,"num_write":1232,"num_write_kb":26982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'781","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.009755+0000","last_change":"2024-09-14T12:44:22.009755+0000","last_active":"2024-09-14T12:44:22.009755+0000","last_peered":"2024-09-14T12:44:22.009755+0000","last_clean":"2024-09-14T12:44:22.009755+0000","last_became_active":"2024-09-14T10:49:25.371736+0000","last_became_peered":"2024-09-14T10:49:25.371736+0000","last_unstale":"2024-09-14T12:44:22.009755+0000","last_undegraded":"2024-09-14T12:44:22.009755+0000","last_fullsized":"2024-09-14T12:44:22.009755+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-14T12:44:22.009539+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-14T12:44:22.009539+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.009539+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:37.997398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3876,"num_read_kb":3539,"num_write":1018,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'324","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.754320+0000","last_change":"2024-09-14T12:44:19.754320+0000","last_active":"2024-09-14T12:44:19.754320+0000","last_peered":"2024-09-14T12:44:19.754320+0000","last_clean":"2024-09-14T12:44:19.754320+0000","last_became_active":"2024-09-14T10:49:23.378269+0000","last_became_peered":"2024-09-14T10:49:23.378269+0000","last_unstale":"2024-09-14T12:44:19.754320+0000","last_undegraded":"2024-09-14T12:44:19.754320+0000","last_fullsized":"2024-09-14T12:44:19.754320+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-14T12:44:19.754019+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-14T12:44:19.754019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.754019+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:31.083867+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":531,"num_read_kb":35954,"num_write":1090,"num_write_kb":39786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'141","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.101213+0000","last_change":"2024-09-14T10:49:33.465171+0000","last_active":"2024-09-14T12:42:32.101213+0000","last_peered":"2024-09-14T12:42:32.101213+0000","last_clean":"2024-09-14T12:42:32.101213+0000","last_became_active":"2024-09-14T10:49:33.464427+0000","last_became_peered":"2024-09-14T10:49:33.464427+0000","last_unstale":"2024-09-14T12:42:32.101213+0000","last_undegraded":"2024-09-14T12:42:32.101213+0000","last_fullsized":"2024-09-14T12:42:32.101213+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.777578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":140,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'436","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.764177+0000","last_change":"2024-09-14T12:44:23.764177+0000","last_active":"2024-09-14T12:44:23.764177+0000","last_peered":"2024-09-14T12:44:23.764177+0000","last_clean":"2024-09-14T12:44:23.764177+0000","last_became_active":"2024-09-14T10:49:25.379409+0000","last_became_peered":"2024-09-14T10:49:25.379409+0000","last_unstale":"2024-09-14T12:44:23.764177+0000","last_undegraded":"2024-09-14T12:44:23.764177+0000","last_fullsized":"2024-09-14T12:44:23.764177+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'436","last_scrub_stamp":"2024-09-14T12:44:23.763977+0000","last_deep_scrub":"267'436","last_deep_scrub_stamp":"2024-09-14T12:44:23.763977+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.763977+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:39.979945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2548,"num_read_kb":2434,"num_write":516,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'355","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.685459+0000","last_change":"2024-09-14T12:44:21.685459+0000","last_active":"2024-09-14T12:44:21.685459+0000","last_peered":"2024-09-14T12:44:21.685459+0000","last_clean":"2024-09-14T12:44:21.685459+0000","last_became_active":"2024-09-14T10:49:23.365630+0000","last_became_peered":"2024-09-14T10:49:23.365630+0000","last_unstale":"2024-09-14T12:44:21.685459+0000","last_undegraded":"2024-09-14T12:44:21.685459+0000","last_fullsized":"2024-09-14T12:44:21.685459+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'355","last_scrub_stamp":"2024-09-14T12:44:21.685251+0000","last_deep_scrub":"267'355","last_deep_scrub_stamp":"2024-09-14T12:44:21.685251+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.685251+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:58.835156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":11787,"num_write":1186,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485373+0000","last_change":"2024-09-14T10:49:27.388283+0000","last_active":"2024-09-14T12:40:41.485373+0000","last_peered":"2024-09-14T12:40:41.485373+0000","last_clean":"2024-09-14T12:40:41.485373+0000","last_became_active":"2024-09-14T10:49:27.387803+0000","last_became_peered":"2024-09-14T10:49:27.387803+0000","last_unstale":"2024-09-14T12:40:41.485373+0000","last_undegraded":"2024-09-14T12:40:41.485373+0000","last_fullsized":"2024-09-14T12:40:41.485373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:58.901691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'388","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.046144+0000","last_change":"2024-09-14T10:49:29.387542+0000","last_active":"2024-09-14T12:44:03.046144+0000","last_peered":"2024-09-14T12:44:03.046144+0000","last_clean":"2024-09-14T12:44:03.046144+0000","last_became_active":"2024-09-14T10:49:29.386799+0000","last_became_peered":"2024-09-14T10:49:29.386799+0000","last_unstale":"2024-09-14T12:44:03.046144+0000","last_undegraded":"2024-09-14T12:44:03.046144+0000","last_fullsized":"2024-09-14T12:44:03.046144+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:42.432275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":1248,"num_write":488,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550661+0000","last_change":"2024-09-14T10:49:31.408598+0000","last_active":"2024-09-14T12:40:45.550661+0000","last_peered":"2024-09-14T12:40:45.550661+0000","last_clean":"2024-09-14T12:40:45.550661+0000","last_became_active":"2024-09-14T10:49:31.407831+0000","last_became_peered":"2024-09-14T10:49:31.407831+0000","last_unstale":"2024-09-14T12:40:45.550661+0000","last_undegraded":"2024-09-14T12:40:45.550661+0000","last_fullsized":"2024-09-14T12:40:45.550661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:34.507742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'138","reported_seq":670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:25.404481+0000","last_change":"2024-09-14T10:49:33.475510+0000","last_active":"2024-09-14T12:42:25.404481+0000","last_peered":"2024-09-14T12:42:25.404481+0000","last_clean":"2024-09-14T12:42:25.404481+0000","last_became_active":"2024-09-14T10:49:33.474458+0000","last_became_peered":"2024-09-14T10:49:33.474458+0000","last_unstale":"2024-09-14T12:42:25.404481+0000","last_undegraded":"2024-09-14T12:42:25.404481+0000","last_fullsized":"2024-09-14T12:42:25.404481+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:19.578114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":162,"num_write":341,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'692","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.618190+0000","last_change":"2024-09-14T10:49:25.378257+0000","last_active":"2024-09-14T12:43:47.618190+0000","last_peered":"2024-09-14T12:43:47.618190+0000","last_clean":"2024-09-14T12:43:47.618190+0000","last_became_active":"2024-09-14T10:49:25.375112+0000","last_became_peered":"2024-09-14T10:49:25.375112+0000","last_unstale":"2024-09-14T12:43:47.618190+0000","last_undegraded":"2024-09-14T12:43:47.618190+0000","last_fullsized":"2024-09-14T12:43:47.618190+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:16.262424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3284,"num_write":889,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'444","reported_seq":1127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.709594+0000","last_change":"2024-09-14T12:44:13.709594+0000","last_active":"2024-09-14T12:44:13.709594+0000","last_peered":"2024-09-14T12:44:13.709594+0000","last_clean":"2024-09-14T12:44:13.709594+0000","last_became_active":"2024-09-14T10:49:23.384801+0000","last_became_peered":"2024-09-14T10:49:23.384801+0000","last_unstale":"2024-09-14T12:44:13.709594+0000","last_undegraded":"2024-09-14T12:44:13.709594+0000","last_fullsized":"2024-09-14T12:44:13.709594+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'444","last_scrub_stamp":"2024-09-14T12:44:13.709388+0000","last_deep_scrub":"267'444","last_deep_scrub_stamp":"2024-09-14T12:44:13.709388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.709388+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:35.749429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":748,"num_read_kb":6714,"num_write":1308,"num_write_kb":31721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.588459+0000","last_change":"2024-09-14T10:49:27.379539+0000","last_active":"2024-09-14T12:42:00.588459+0000","last_peered":"2024-09-14T12:42:00.588459+0000","last_clean":"2024-09-14T12:42:00.588459+0000","last_became_active":"2024-09-14T10:49:27.378702+0000","last_became_peered":"2024-09-14T10:49:27.378702+0000","last_unstale":"2024-09-14T12:42:00.588459+0000","last_undegraded":"2024-09-14T12:42:00.588459+0000","last_fullsized":"2024-09-14T12:42:00.588459+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'127","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.549519+0000","last_change":"2024-09-14T10:49:29.398866+0000","last_active":"2024-09-14T12:40:40.549519+0000","last_peered":"2024-09-14T12:40:40.549519+0000","last_clean":"2024-09-14T12:40:40.549519+0000","last_became_active":"2024-09-14T10:49:29.398354+0000","last_became_peered":"2024-09-14T10:49:29.398354+0000","last_unstale":"2024-09-14T12:40:40.549519+0000","last_undegraded":"2024-09-14T12:40:40.549519+0000","last_fullsized":"2024-09-14T12:40:40.549519+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:55.441392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.550575+0000","last_change":"2024-09-14T10:49:31.434144+0000","last_active":"2024-09-14T12:40:45.550575+0000","last_peered":"2024-09-14T12:40:45.550575+0000","last_clean":"2024-09-14T12:40:45.550575+0000","last_became_active":"2024-09-14T10:49:31.433431+0000","last_became_peered":"2024-09-14T10:49:31.433431+0000","last_unstale":"2024-09-14T12:40:45.550575+0000","last_undegraded":"2024-09-14T12:40:45.550575+0000","last_fullsized":"2024-09-14T12:40:45.550575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:01.989175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'115","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:44.484054+0000","last_change":"2024-09-14T10:49:33.463822+0000","last_active":"2024-09-14T12:39:44.484054+0000","last_peered":"2024-09-14T12:39:44.484054+0000","last_clean":"2024-09-14T12:39:44.484054+0000","last_became_active":"2024-09-14T10:49:33.463124+0000","last_became_peered":"2024-09-14T10:49:33.463124+0000","last_unstale":"2024-09-14T12:39:44.484054+0000","last_undegraded":"2024-09-14T12:39:44.484054+0000","last_fullsized":"2024-09-14T12:39:44.484054+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:53.103119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'851","reported_seq":2501,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.772346+0000","last_change":"2024-09-14T10:49:25.389867+0000","last_active":"2024-09-14T12:42:31.772346+0000","last_peered":"2024-09-14T12:42:31.772346+0000","last_clean":"2024-09-14T12:42:31.772346+0000","last_became_active":"2024-09-14T10:49:25.385678+0000","last_became_peered":"2024-09-14T10:49:25.385678+0000","last_unstale":"2024-09-14T12:42:31.772346+0000","last_undegraded":"2024-09-14T12:42:31.772346+0000","last_fullsized":"2024-09-14T12:42:31.772346+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:25.356791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4238,"num_read_kb":3841,"num_write":1159,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'381","reported_seq":1285,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.727211+0000","last_change":"2024-09-14T12:44:17.727211+0000","last_active":"2024-09-14T12:44:17.727211+0000","last_peered":"2024-09-14T12:44:17.727211+0000","last_clean":"2024-09-14T12:44:17.727211+0000","last_became_active":"2024-09-14T10:49:23.371893+0000","last_became_peered":"2024-09-14T10:49:23.371893+0000","last_unstale":"2024-09-14T12:44:17.727211+0000","last_undegraded":"2024-09-14T12:44:17.727211+0000","last_fullsized":"2024-09-14T12:44:17.727211+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-09-14T12:44:17.726976+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-09-14T12:44:17.726976+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.726976+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:08.246693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1366,"num_read_kb":59405,"num_write":1145,"num_write_kb":37706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:40.570738+0000","last_change":"2024-09-14T10:49:27.380154+0000","last_active":"2024-09-14T12:40:40.570738+0000","last_peered":"2024-09-14T12:40:40.570738+0000","last_clean":"2024-09-14T12:40:40.570738+0000","last_became_active":"2024-09-14T10:49:27.379355+0000","last_became_peered":"2024-09-14T10:49:27.379355+0000","last_unstale":"2024-09-14T12:40:40.570738+0000","last_undegraded":"2024-09-14T12:40:40.570738+0000","last_fullsized":"2024-09-14T12:40:40.570738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:52.884569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.588491+0000","last_change":"2024-09-14T10:49:29.387051+0000","last_active":"2024-09-14T12:42:00.588491+0000","last_peered":"2024-09-14T12:42:00.588491+0000","last_clean":"2024-09-14T12:42:00.588491+0000","last_became_active":"2024-09-14T10:49:29.386264+0000","last_became_peered":"2024-09-14T10:49:29.386264+0000","last_unstale":"2024-09-14T12:42:00.588491+0000","last_undegraded":"2024-09-14T12:42:00.588491+0000","last_fullsized":"2024-09-14T12:42:00.588491+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'810","reported_seq":3021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.149377+0000","last_change":"2024-09-14T10:49:31.432319+0000","last_active":"2024-09-14T12:44:02.149377+0000","last_peered":"2024-09-14T12:44:02.149377+0000","last_clean":"2024-09-14T12:44:02.149377+0000","last_became_active":"2024-09-14T10:49:31.431702+0000","last_became_peered":"2024-09-14T10:49:31.431702+0000","last_unstale":"2024-09-14T12:44:02.149377+0000","last_undegraded":"2024-09-14T12:44:02.149377+0000","last_fullsized":"2024-09-14T12:44:02.149377+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:52.750405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'216","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.705477+0000","last_change":"2024-09-14T10:49:33.473107+0000","last_active":"2024-09-14T12:42:29.705477+0000","last_peered":"2024-09-14T12:42:29.705477+0000","last_clean":"2024-09-14T12:42:29.705477+0000","last_became_active":"2024-09-14T10:49:33.472433+0000","last_became_peered":"2024-09-14T10:49:33.472433+0000","last_unstale":"2024-09-14T12:42:29.705477+0000","last_undegraded":"2024-09-14T12:42:29.705477+0000","last_fullsized":"2024-09-14T12:42:29.705477+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.692107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":612,"num_write":471,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'454","reported_seq":2023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.904764+0000","last_change":"2024-09-14T12:44:26.904764+0000","last_active":"2024-09-14T12:44:26.904764+0000","last_peered":"2024-09-14T12:44:26.904764+0000","last_clean":"2024-09-14T12:44:26.904764+0000","last_became_active":"2024-09-14T10:49:25.395255+0000","last_became_peered":"2024-09-14T10:49:25.395255+0000","last_unstale":"2024-09-14T12:44:26.904764+0000","last_undegraded":"2024-09-14T12:44:26.904764+0000","last_fullsized":"2024-09-14T12:44:26.904764+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-09-14T12:44:26.904534+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-09-14T12:44:26.904534+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.904534+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:00.169555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2444,"num_read_kb":2309,"num_write":533,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'370","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.932856+0000","last_change":"2024-09-14T12:44:10.932856+0000","last_active":"2024-09-14T12:44:10.932856+0000","last_peered":"2024-09-14T12:44:10.932856+0000","last_clean":"2024-09-14T12:44:10.932856+0000","last_became_active":"2024-09-14T10:49:23.403079+0000","last_became_peered":"2024-09-14T10:49:23.403079+0000","last_unstale":"2024-09-14T12:44:10.932856+0000","last_undegraded":"2024-09-14T12:44:10.932856+0000","last_fullsized":"2024-09-14T12:44:10.932856+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-14T12:44:10.932702+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-14T12:44:10.932702+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.932702+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.564642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":46335,"num_write":1122,"num_write_kb":49327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:41.485445+0000","last_change":"2024-09-14T10:49:27.392398+0000","last_active":"2024-09-14T12:40:41.485445+0000","last_peered":"2024-09-14T12:40:41.485445+0000","last_clean":"2024-09-14T12:40:41.485445+0000","last_became_active":"2024-09-14T10:49:27.391823+0000","last_became_peered":"2024-09-14T10:49:27.391823+0000","last_unstale":"2024-09-14T12:40:41.485445+0000","last_undegraded":"2024-09-14T12:40:41.485445+0000","last_fullsized":"2024-09-14T12:40:41.485445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:59.037074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'325","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.122893+0000","last_change":"2024-09-14T10:49:29.385602+0000","last_active":"2024-09-14T12:44:02.122893+0000","last_peered":"2024-09-14T12:44:02.122893+0000","last_clean":"2024-09-14T12:44:02.122893+0000","last_became_active":"2024-09-14T10:49:29.385023+0000","last_became_peered":"2024-09-14T10:49:29.385023+0000","last_unstale":"2024-09-14T12:44:02.122893+0000","last_undegraded":"2024-09-14T12:44:02.122893+0000","last_fullsized":"2024-09-14T12:44:02.122893+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:43.706717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":526,"num_read_kb":1146,"num_write":424,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'827","reported_seq":5661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.014706+0000","last_change":"2024-09-14T10:49:31.425706+0000","last_active":"2024-09-14T12:44:05.014706+0000","last_peered":"2024-09-14T12:44:05.014706+0000","last_clean":"2024-09-14T12:44:05.014706+0000","last_became_active":"2024-09-14T10:49:31.424873+0000","last_became_peered":"2024-09-14T10:49:31.424873+0000","last_unstale":"2024-09-14T12:44:05.014706+0000","last_undegraded":"2024-09-14T12:44:05.014706+0000","last_fullsized":"2024-09-14T12:44:05.014706+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'493","reported_seq":2118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.507350+0000","last_change":"2024-09-14T10:49:25.373828+0000","last_active":"2024-09-14T12:42:06.507350+0000","last_peered":"2024-09-14T12:42:06.507350+0000","last_clean":"2024-09-14T12:42:06.507350+0000","last_became_active":"2024-09-14T10:49:25.372711+0000","last_became_peered":"2024-09-14T10:49:25.372711+0000","last_unstale":"2024-09-14T12:42:06.507350+0000","last_undegraded":"2024-09-14T12:42:06.507350+0000","last_fullsized":"2024-09-14T12:42:06.507350+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2694,"num_read_kb":2523,"num_write":626,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'395","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.372090+0000","last_change":"2024-09-14T12:44:14.371801+0000","last_active":"2024-09-14T12:44:14.372090+0000","last_peered":"2024-09-14T12:44:14.372090+0000","last_clean":"2024-09-14T12:44:14.372090+0000","last_became_active":"2024-09-14T10:49:23.363126+0000","last_became_peered":"2024-09-14T10:49:23.363126+0000","last_unstale":"2024-09-14T12:44:14.372090+0000","last_undegraded":"2024-09-14T12:44:14.372090+0000","last_fullsized":"2024-09-14T12:44:14.372090+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T12:44:14.371349+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T12:44:14.371349+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.371349+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:18.212093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":10241,"num_write":1214,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.064863+0000","last_change":"2024-09-14T12:44:24.064863+0000","last_active":"2024-09-14T12:44:24.064863+0000","last_peered":"2024-09-14T12:44:24.064863+0000","last_clean":"2024-09-14T12:44:24.064863+0000","last_became_active":"2024-09-14T10:49:27.380063+0000","last_became_peered":"2024-09-14T10:49:27.380063+0000","last_unstale":"2024-09-14T12:44:24.064863+0000","last_undegraded":"2024-09-14T12:44:24.064863+0000","last_fullsized":"2024-09-14T12:44:24.064863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.064652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.064652+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.064652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.956294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'450","reported_seq":1163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.174135+0000","last_change":"2024-09-14T12:44:29.174135+0000","last_active":"2024-09-14T12:44:29.174135+0000","last_peered":"2024-09-14T12:44:29.174135+0000","last_clean":"2024-09-14T12:44:29.174135+0000","last_became_active":"2024-09-14T10:49:29.383306+0000","last_became_peered":"2024-09-14T10:49:29.383306+0000","last_unstale":"2024-09-14T12:44:29.174135+0000","last_undegraded":"2024-09-14T12:44:29.174135+0000","last_fullsized":"2024-09-14T12:44:29.174135+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'450","last_scrub_stamp":"2024-09-14T12:44:29.173918+0000","last_deep_scrub":"267'450","last_deep_scrub_stamp":"2024-09-14T12:44:29.173918+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.173918+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:13.227443+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48183,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":712,"num_read_kb":1289,"num_write":532,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.562754+0000","last_change":"2024-09-14T10:49:31.407042+0000","last_active":"2024-09-14T12:42:06.562754+0000","last_peered":"2024-09-14T12:42:06.562754+0000","last_clean":"2024-09-14T12:42:06.562754+0000","last_became_active":"2024-09-14T10:49:31.406293+0000","last_became_peered":"2024-09-14T10:49:31.406293+0000","last_unstale":"2024-09-14T12:42:06.562754+0000","last_undegraded":"2024-09-14T12:42:06.562754+0000","last_fullsized":"2024-09-14T12:42:06.562754+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'561","reported_seq":1445,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.652725+0000","last_change":"2024-09-14T10:49:33.475077+0000","last_active":"2024-09-14T12:43:48.652725+0000","last_peered":"2024-09-14T12:43:48.652725+0000","last_clean":"2024-09-14T12:43:48.652725+0000","last_became_active":"2024-09-14T10:49:33.474412+0000","last_became_peered":"2024-09-14T10:49:33.474412+0000","last_unstale":"2024-09-14T12:43:48.652725+0000","last_undegraded":"2024-09-14T12:43:48.652725+0000","last_fullsized":"2024-09-14T12:43:48.652725+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1493,"num_read_kb":1442,"num_write":1188,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'447","reported_seq":2098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.951633+0000","last_change":"2024-09-14T12:44:15.951633+0000","last_active":"2024-09-14T12:44:15.951633+0000","last_peered":"2024-09-14T12:44:15.951633+0000","last_clean":"2024-09-14T12:44:15.951633+0000","last_became_active":"2024-09-14T10:49:25.405499+0000","last_became_peered":"2024-09-14T10:49:25.405499+0000","last_unstale":"2024-09-14T12:44:15.951633+0000","last_undegraded":"2024-09-14T12:44:15.951633+0000","last_fullsized":"2024-09-14T12:44:15.951633+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-14T12:44:15.951454+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-14T12:44:15.951454+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.951454+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:25.508784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2382,"num_write":513,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'382","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.840424+0000","last_change":"2024-09-14T12:44:10.840331+0000","last_active":"2024-09-14T12:44:10.840424+0000","last_peered":"2024-09-14T12:44:10.840424+0000","last_clean":"2024-09-14T12:44:10.840424+0000","last_became_active":"2024-09-14T10:49:23.403551+0000","last_became_peered":"2024-09-14T10:49:23.403551+0000","last_unstale":"2024-09-14T12:44:10.840424+0000","last_undegraded":"2024-09-14T12:44:10.840424+0000","last_fullsized":"2024-09-14T12:44:10.840424+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:10.840221+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:10.840221+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.840221+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:13.320242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":687,"num_read_kb":10639,"num_write":1239,"num_write_kb":29906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:11.563820+0000","last_change":"2024-09-14T10:49:27.373230+0000","last_active":"2024-09-14T12:42:11.563820+0000","last_peered":"2024-09-14T12:42:11.563820+0000","last_clean":"2024-09-14T12:42:11.563820+0000","last_became_active":"2024-09-14T10:49:27.372510+0000","last_became_peered":"2024-09-14T10:49:27.372510+0000","last_unstale":"2024-09-14T12:42:11.563820+0000","last_undegraded":"2024-09-14T12:42:11.563820+0000","last_fullsized":"2024-09-14T12:42:11.563820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'304","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.472173+0000","last_change":"2024-09-14T10:49:29.378472+0000","last_active":"2024-09-14T12:44:04.472173+0000","last_peered":"2024-09-14T12:44:04.472173+0000","last_clean":"2024-09-14T12:44:04.472173+0000","last_became_active":"2024-09-14T10:49:29.377710+0000","last_became_peered":"2024-09-14T10:49:29.377710+0000","last_unstale":"2024-09-14T12:44:04.472173+0000","last_undegraded":"2024-09-14T12:44:04.472173+0000","last_fullsized":"2024-09-14T12:44:04.472173+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45337,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1057,"num_write":388,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.569489+0000","last_change":"2024-09-14T10:49:31.413000+0000","last_active":"2024-09-14T12:40:35.569489+0000","last_peered":"2024-09-14T12:40:35.569489+0000","last_clean":"2024-09-14T12:40:35.569489+0000","last_became_active":"2024-09-14T10:49:31.412080+0000","last_became_peered":"2024-09-14T10:49:31.412080+0000","last_unstale":"2024-09-14T12:40:35.569489+0000","last_undegraded":"2024-09-14T12:40:35.569489+0000","last_fullsized":"2024-09-14T12:40:35.569489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.692991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2528","reported_seq":4388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.576044+0000","last_change":"2024-09-14T10:49:33.479265+0000","last_active":"2024-09-14T12:42:30.576044+0000","last_peered":"2024-09-14T12:42:30.576044+0000","last_clean":"2024-09-14T12:42:30.576044+0000","last_became_active":"2024-09-14T10:49:33.478542+0000","last_became_peered":"2024-09-14T10:49:33.478542+0000","last_unstale":"2024-09-14T12:42:30.576044+0000","last_undegraded":"2024-09-14T12:42:30.576044+0000","last_fullsized":"2024-09-14T12:42:30.576044+0000","mapping_epoch":36,"log_start":"267'2500","ondisk_log_start":"267'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:52.785039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6246,"num_read_kb":6243,"num_write":5128,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'501","reported_seq":2191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.884652+0000","last_change":"2024-09-14T12:44:16.884652+0000","last_active":"2024-09-14T12:44:16.884652+0000","last_peered":"2024-09-14T12:44:16.884652+0000","last_clean":"2024-09-14T12:44:16.884652+0000","last_became_active":"2024-09-14T10:49:25.380967+0000","last_became_peered":"2024-09-14T10:49:25.380967+0000","last_unstale":"2024-09-14T12:44:16.884652+0000","last_undegraded":"2024-09-14T12:44:16.884652+0000","last_fullsized":"2024-09-14T12:44:16.884652+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'501","last_scrub_stamp":"2024-09-14T12:44:16.884453+0000","last_deep_scrub":"267'501","last_deep_scrub_stamp":"2024-09-14T12:44:16.884453+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.884453+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:11.460810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2697,"num_read_kb":2531,"num_write":585,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'361","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.727178+0000","last_change":"2024-09-14T12:44:16.727178+0000","last_active":"2024-09-14T12:44:16.727178+0000","last_peered":"2024-09-14T12:44:16.727178+0000","last_clean":"2024-09-14T12:44:16.727178+0000","last_became_active":"2024-09-14T10:49:23.355809+0000","last_became_peered":"2024-09-14T10:49:23.355809+0000","last_unstale":"2024-09-14T12:44:16.727178+0000","last_undegraded":"2024-09-14T12:44:16.727178+0000","last_fullsized":"2024-09-14T12:44:16.727178+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-09-14T12:44:16.726929+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-09-14T12:44:16.726929+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.726929+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:07.328476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":12441,"num_write":1183,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.361226+0000","last_change":"2024-09-14T10:49:27.379127+0000","last_active":"2024-09-14T12:42:00.361226+0000","last_peered":"2024-09-14T12:42:00.361226+0000","last_clean":"2024-09-14T12:42:00.361226+0000","last_became_active":"2024-09-14T10:49:27.378028+0000","last_became_peered":"2024-09-14T10:49:27.378028+0000","last_unstale":"2024-09-14T12:42:00.361226+0000","last_undegraded":"2024-09-14T12:42:00.361226+0000","last_fullsized":"2024-09-14T12:42:00.361226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'399","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.595603+0000","last_change":"2024-09-14T10:49:29.389462+0000","last_active":"2024-09-14T12:44:03.595603+0000","last_peered":"2024-09-14T12:44:03.595603+0000","last_clean":"2024-09-14T12:44:03.595603+0000","last_became_active":"2024-09-14T10:49:29.388786+0000","last_became_peered":"2024-09-14T10:49:29.388786+0000","last_unstale":"2024-09-14T12:44:03.595603+0000","last_undegraded":"2024-09-14T12:44:03.595603+0000","last_fullsized":"2024-09-14T12:44:03.595603+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53040,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":1302,"num_write":504,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'826","reported_seq":3422,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.015909+0000","last_change":"2024-09-14T10:49:31.420988+0000","last_active":"2024-09-14T12:44:05.015909+0000","last_peered":"2024-09-14T12:44:05.015909+0000","last_clean":"2024-09-14T12:44:05.015909+0000","last_became_active":"2024-09-14T10:49:31.420178+0000","last_became_peered":"2024-09-14T10:49:31.420178+0000","last_unstale":"2024-09-14T12:44:05.015909+0000","last_undegraded":"2024-09-14T12:44:05.015909+0000","last_fullsized":"2024-09-14T12:44:05.015909+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'144","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.647159+0000","last_change":"2024-09-14T10:49:33.463351+0000","last_active":"2024-09-14T12:43:47.647159+0000","last_peered":"2024-09-14T12:43:47.647159+0000","last_clean":"2024-09-14T12:43:47.647159+0000","last_became_active":"2024-09-14T10:49:33.462780+0000","last_became_peered":"2024-09-14T10:49:33.462780+0000","last_unstale":"2024-09-14T12:43:47.647159+0000","last_undegraded":"2024-09-14T12:43:47.647159+0000","last_fullsized":"2024-09-14T12:43:47.647159+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'837","reported_seq":2447,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.916505+0000","last_change":"2024-09-14T12:44:25.916505+0000","last_active":"2024-09-14T12:44:25.916505+0000","last_peered":"2024-09-14T12:44:25.916505+0000","last_clean":"2024-09-14T12:44:25.916505+0000","last_became_active":"2024-09-14T10:49:25.389567+0000","last_became_peered":"2024-09-14T10:49:25.389567+0000","last_unstale":"2024-09-14T12:44:25.916505+0000","last_undegraded":"2024-09-14T12:44:25.916505+0000","last_fullsized":"2024-09-14T12:44:25.916505+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'837","last_scrub_stamp":"2024-09-14T12:44:25.916317+0000","last_deep_scrub":"267'837","last_deep_scrub_stamp":"2024-09-14T12:44:25.916317+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.916317+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:29.573496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4051,"num_read_kb":3641,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'382","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.406612+0000","last_change":"2024-09-14T12:44:09.406557+0000","last_active":"2024-09-14T12:44:09.406612+0000","last_peered":"2024-09-14T12:44:09.406612+0000","last_clean":"2024-09-14T12:44:09.406612+0000","last_became_active":"2024-09-14T10:49:23.354452+0000","last_became_peered":"2024-09-14T10:49:23.354452+0000","last_unstale":"2024-09-14T12:44:09.406612+0000","last_undegraded":"2024-09-14T12:44:09.406612+0000","last_fullsized":"2024-09-14T12:44:09.406612+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.406462+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:33.958379+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":20994,"num_write":1147,"num_write_kb":31512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:21.539587+0000","last_change":"2024-09-14T10:49:27.354654+0000","last_active":"2024-09-14T12:40:21.539587+0000","last_peered":"2024-09-14T12:40:21.539587+0000","last_clean":"2024-09-14T12:40:21.539587+0000","last_became_active":"2024-09-14T10:49:27.353932+0000","last_became_peered":"2024-09-14T10:49:27.353932+0000","last_unstale":"2024-09-14T12:40:21.539587+0000","last_undegraded":"2024-09-14T12:40:21.539587+0000","last_fullsized":"2024-09-14T12:40:21.539587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:21.532896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'498","reported_seq":1182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.709054+0000","last_change":"2024-09-14T10:49:29.379743+0000","last_active":"2024-09-14T12:44:04.709054+0000","last_peered":"2024-09-14T12:44:04.709054+0000","last_clean":"2024-09-14T12:44:04.709054+0000","last_became_active":"2024-09-14T10:49:29.378107+0000","last_became_peered":"2024-09-14T10:49:29.378107+0000","last_unstale":"2024-09-14T12:44:04.709054+0000","last_undegraded":"2024-09-14T12:44:04.709054+0000","last_fullsized":"2024-09-14T12:44:04.709054+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89831,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":1885,"num_write":676,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:15.364881+0000","last_change":"2024-09-14T10:49:31.410161+0000","last_active":"2024-09-14T12:42:15.364881+0000","last_peered":"2024-09-14T12:42:15.364881+0000","last_clean":"2024-09-14T12:42:15.364881+0000","last_became_active":"2024-09-14T10:49:31.409247+0000","last_became_peered":"2024-09-14T10:49:31.409247+0000","last_unstale":"2024-09-14T12:42:15.364881+0000","last_undegraded":"2024-09-14T12:42:15.364881+0000","last_fullsized":"2024-09-14T12:42:15.364881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'132","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.614339+0000","last_change":"2024-09-14T10:49:33.462318+0000","last_active":"2024-09-14T12:42:21.614339+0000","last_peered":"2024-09-14T12:42:21.614339+0000","last_clean":"2024-09-14T12:42:21.614339+0000","last_became_active":"2024-09-14T10:49:33.461635+0000","last_became_peered":"2024-09-14T10:49:33.461635+0000","last_unstale":"2024-09-14T12:42:21.614339+0000","last_undegraded":"2024-09-14T12:42:21.614339+0000","last_fullsized":"2024-09-14T12:42:21.614339+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":314,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'839","reported_seq":2540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.408128+0000","last_change":"2024-09-14T12:44:16.408128+0000","last_active":"2024-09-14T12:44:16.408128+0000","last_peered":"2024-09-14T12:44:16.408128+0000","last_clean":"2024-09-14T12:44:16.408128+0000","last_became_active":"2024-09-14T10:49:25.361148+0000","last_became_peered":"2024-09-14T10:49:25.361148+0000","last_unstale":"2024-09-14T12:44:16.408128+0000","last_undegraded":"2024-09-14T12:44:16.408128+0000","last_fullsized":"2024-09-14T12:44:16.408128+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-09-14T12:44:16.407940+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-09-14T12:44:16.407940+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.407940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:23.435248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4070,"num_read_kb":3684,"num_write":1107,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'346","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.668424+0000","last_change":"2024-09-14T12:44:12.668424+0000","last_active":"2024-09-14T12:44:12.668424+0000","last_peered":"2024-09-14T12:44:12.668424+0000","last_clean":"2024-09-14T12:44:12.668424+0000","last_became_active":"2024-09-14T10:49:23.375005+0000","last_became_peered":"2024-09-14T10:49:23.375005+0000","last_unstale":"2024-09-14T12:44:12.668424+0000","last_undegraded":"2024-09-14T12:44:12.668424+0000","last_fullsized":"2024-09-14T12:44:12.668424+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-14T12:44:12.668139+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-14T12:44:12.668139+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.668139+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:32.312612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":716,"num_read_kb":12064,"num_write":1099,"num_write_kb":35066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.438078+0000","last_change":"2024-09-14T12:44:24.438078+0000","last_active":"2024-09-14T12:44:24.438078+0000","last_peered":"2024-09-14T12:44:24.438078+0000","last_clean":"2024-09-14T12:44:24.438078+0000","last_became_active":"2024-09-14T10:49:27.385658+0000","last_became_peered":"2024-09-14T10:49:27.385658+0000","last_unstale":"2024-09-14T12:44:24.438078+0000","last_undegraded":"2024-09-14T12:44:24.438078+0000","last_fullsized":"2024-09-14T12:44:24.438078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.437896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.437896+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.437896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:21.541048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'372","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.049012+0000","last_change":"2024-09-14T12:44:30.049012+0000","last_active":"2024-09-14T12:44:30.049012+0000","last_peered":"2024-09-14T12:44:30.049012+0000","last_clean":"2024-09-14T12:44:30.049012+0000","last_became_active":"2024-09-14T10:49:29.388618+0000","last_became_peered":"2024-09-14T10:49:29.388618+0000","last_unstale":"2024-09-14T12:44:30.049012+0000","last_undegraded":"2024-09-14T12:44:30.049012+0000","last_fullsized":"2024-09-14T12:44:30.049012+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-09-14T12:44:30.048826+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-09-14T12:44:30.048826+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.048826+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:35.349305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53436,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":1275,"num_write":534,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17022,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:09.736444+0000","last_change":"2024-09-14T10:49:31.418529+0000","last_active":"2024-09-14T12:40:09.736444+0000","last_peered":"2024-09-14T12:40:09.736444+0000","last_clean":"2024-09-14T12:40:09.736444+0000","last_became_active":"2024-09-14T10:49:31.417797+0000","last_became_peered":"2024-09-14T10:49:31.417797+0000","last_unstale":"2024-09-14T12:40:09.736444+0000","last_undegraded":"2024-09-14T12:40:09.736444+0000","last_fullsized":"2024-09-14T12:40:09.736444+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:56.573341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'113","reported_seq":630,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:36.096922+0000","last_change":"2024-09-14T10:49:33.455868+0000","last_active":"2024-09-14T12:43:36.096922+0000","last_peered":"2024-09-14T12:43:36.096922+0000","last_clean":"2024-09-14T12:43:36.096922+0000","last_became_active":"2024-09-14T10:49:33.455162+0000","last_became_peered":"2024-09-14T10:49:33.455162+0000","last_unstale":"2024-09-14T12:43:36.096922+0000","last_undegraded":"2024-09-14T12:43:36.096922+0000","last_fullsized":"2024-09-14T12:43:36.096922+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:42.886276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'587","reported_seq":2425,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.505027+0000","last_change":"2024-09-14T10:49:25.378821+0000","last_active":"2024-09-14T12:41:56.505027+0000","last_peered":"2024-09-14T12:41:56.505027+0000","last_clean":"2024-09-14T12:41:56.505027+0000","last_became_active":"2024-09-14T10:49:25.377866+0000","last_became_peered":"2024-09-14T10:49:25.377866+0000","last_unstale":"2024-09-14T12:41:56.505027+0000","last_undegraded":"2024-09-14T12:41:56.505027+0000","last_fullsized":"2024-09-14T12:41:56.505027+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3293,"num_read_kb":3082,"num_write":722,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'319","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.689208+0000","last_change":"2024-09-14T12:44:18.689208+0000","last_active":"2024-09-14T12:44:18.689208+0000","last_peered":"2024-09-14T12:44:18.689208+0000","last_clean":"2024-09-14T12:44:18.689208+0000","last_became_active":"2024-09-14T10:49:23.362203+0000","last_became_peered":"2024-09-14T10:49:23.362203+0000","last_unstale":"2024-09-14T12:44:18.689208+0000","last_undegraded":"2024-09-14T12:44:18.689208+0000","last_fullsized":"2024-09-14T12:44:18.689208+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-14T12:44:18.688974+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-14T12:44:18.688974+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.688974+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:03.279044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":29276,"num_write":1000,"num_write_kb":13260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.361319+0000","last_change":"2024-09-14T10:49:27.378611+0000","last_active":"2024-09-14T12:42:00.361319+0000","last_peered":"2024-09-14T12:42:00.361319+0000","last_clean":"2024-09-14T12:42:00.361319+0000","last_became_active":"2024-09-14T10:49:27.377674+0000","last_became_peered":"2024-09-14T10:49:27.377674+0000","last_unstale":"2024-09-14T12:42:00.361319+0000","last_undegraded":"2024-09-14T12:42:00.361319+0000","last_fullsized":"2024-09-14T12:42:00.361319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'396","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.238169+0000","last_change":"2024-09-14T10:49:29.394103+0000","last_active":"2024-09-14T12:44:04.238169+0000","last_peered":"2024-09-14T12:44:04.238169+0000","last_clean":"2024-09-14T12:44:04.238169+0000","last_became_active":"2024-09-14T10:49:29.393350+0000","last_became_peered":"2024-09-14T10:49:29.393350+0000","last_unstale":"2024-09-14T12:44:04.238169+0000","last_undegraded":"2024-09-14T12:44:04.238169+0000","last_fullsized":"2024-09-14T12:44:04.238169+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.411758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50275,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":654,"num_read_kb":1334,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'794","reported_seq":5235,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.443351+0000","last_change":"2024-09-14T12:44:29.443351+0000","last_active":"2024-09-14T12:44:29.443351+0000","last_peered":"2024-09-14T12:44:29.443351+0000","last_clean":"2024-09-14T12:44:29.443351+0000","last_became_active":"2024-09-14T10:49:31.422534+0000","last_became_peered":"2024-09-14T10:49:31.422534+0000","last_unstale":"2024-09-14T12:44:29.443351+0000","last_undegraded":"2024-09-14T12:44:29.443351+0000","last_fullsized":"2024-09-14T12:44:29.443351+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'794","last_scrub_stamp":"2024-09-14T12:44:29.443166+0000","last_deep_scrub":"267'794","last_deep_scrub_stamp":"2024-09-14T12:44:29.443166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.443166+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.967521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'158","reported_seq":730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.581257+0000","last_change":"2024-09-14T10:49:33.466535+0000","last_active":"2024-09-14T12:42:29.581257+0000","last_peered":"2024-09-14T12:42:29.581257+0000","last_clean":"2024-09-14T12:42:29.581257+0000","last_became_active":"2024-09-14T10:49:33.466024+0000","last_became_peered":"2024-09-14T10:49:33.466024+0000","last_unstale":"2024-09-14T12:42:29.581257+0000","last_undegraded":"2024-09-14T12:42:29.581257+0000","last_fullsized":"2024-09-14T12:42:29.581257+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:24.127809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":335,"num_read_kb":285,"num_write":383,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'673","reported_seq":2400,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.795938+0000","last_change":"2024-09-14T12:44:19.795938+0000","last_active":"2024-09-14T12:44:19.795938+0000","last_peered":"2024-09-14T12:44:19.795938+0000","last_clean":"2024-09-14T12:44:19.795938+0000","last_became_active":"2024-09-14T10:49:25.380712+0000","last_became_peered":"2024-09-14T10:49:25.380712+0000","last_unstale":"2024-09-14T12:44:19.795938+0000","last_undegraded":"2024-09-14T12:44:19.795938+0000","last_fullsized":"2024-09-14T12:44:19.795938+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'673","last_scrub_stamp":"2024-09-14T12:44:19.795731+0000","last_deep_scrub":"267'673","last_deep_scrub_stamp":"2024-09-14T12:44:19.795731+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.795731+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:58.049805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3719,"num_read_kb":3469,"num_write":935,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'349","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.741343+0000","last_change":"2024-09-14T12:44:14.741194+0000","last_active":"2024-09-14T12:44:14.741343+0000","last_peered":"2024-09-14T12:44:14.741343+0000","last_clean":"2024-09-14T12:44:14.741343+0000","last_became_active":"2024-09-14T10:49:23.367200+0000","last_became_peered":"2024-09-14T10:49:23.367200+0000","last_unstale":"2024-09-14T12:44:14.741343+0000","last_undegraded":"2024-09-14T12:44:14.741343+0000","last_fullsized":"2024-09-14T12:44:14.741343+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-14T12:44:14.740931+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-14T12:44:14.740931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.740931+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:26.381621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":77246,"num_write":1147,"num_write_kb":38780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.043611+0000","last_change":"2024-09-14T12:44:26.043611+0000","last_active":"2024-09-14T12:44:26.043611+0000","last_peered":"2024-09-14T12:44:26.043611+0000","last_clean":"2024-09-14T12:44:26.043611+0000","last_became_active":"2024-09-14T10:49:27.379952+0000","last_became_peered":"2024-09-14T10:49:27.379952+0000","last_unstale":"2024-09-14T12:44:26.043611+0000","last_undegraded":"2024-09-14T12:44:26.043611+0000","last_fullsized":"2024-09-14T12:44:26.043611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:26.043404+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:26.043404+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.043404+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:43.208508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'141","reported_seq":719,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:22.227118+0000","last_change":"2024-09-14T10:49:29.373528+0000","last_active":"2024-09-14T12:42:22.227118+0000","last_peered":"2024-09-14T12:42:22.227118+0000","last_clean":"2024-09-14T12:42:22.227118+0000","last_became_active":"2024-09-14T10:49:29.371803+0000","last_became_peered":"2024-09-14T10:49:29.371803+0000","last_unstale":"2024-09-14T12:42:22.227118+0000","last_undegraded":"2024-09-14T12:42:22.227118+0000","last_fullsized":"2024-09-14T12:42:22.227118+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'797","reported_seq":3147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.012224+0000","last_change":"2024-09-14T10:49:31.427780+0000","last_active":"2024-09-14T12:44:05.012224+0000","last_peered":"2024-09-14T12:44:05.012224+0000","last_clean":"2024-09-14T12:44:05.012224+0000","last_became_active":"2024-09-14T10:49:31.427179+0000","last_became_peered":"2024-09-14T10:49:31.427179+0000","last_unstale":"2024-09-14T12:44:05.012224+0000","last_undegraded":"2024-09-14T12:44:05.012224+0000","last_fullsized":"2024-09-14T12:44:05.012224+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'134","reported_seq":666,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.431694+0000","last_change":"2024-09-14T10:49:33.471795+0000","last_active":"2024-09-14T12:42:29.431694+0000","last_peered":"2024-09-14T12:42:29.431694+0000","last_clean":"2024-09-14T12:42:29.431694+0000","last_became_active":"2024-09-14T10:49:33.468831+0000","last_became_peered":"2024-09-14T10:49:33.468831+0000","last_unstale":"2024-09-14T12:42:29.431694+0000","last_undegraded":"2024-09-14T12:42:29.431694+0000","last_fullsized":"2024-09-14T12:42:29.431694+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":148,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'488","reported_seq":2229,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.501701+0000","last_change":"2024-09-14T12:44:19.501701+0000","last_active":"2024-09-14T12:44:19.501701+0000","last_peered":"2024-09-14T12:44:19.501701+0000","last_clean":"2024-09-14T12:44:19.501701+0000","last_became_active":"2024-09-14T10:49:25.370649+0000","last_became_peered":"2024-09-14T10:49:25.370649+0000","last_unstale":"2024-09-14T12:44:19.501701+0000","last_undegraded":"2024-09-14T12:44:19.501701+0000","last_fullsized":"2024-09-14T12:44:19.501701+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'488","last_scrub_stamp":"2024-09-14T12:44:19.501488+0000","last_deep_scrub":"267'488","last_deep_scrub_stamp":"2024-09-14T12:44:19.501488+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.501488+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:41.258394+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2839,"num_read_kb":2682,"num_write":610,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'390","reported_seq":1121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.742825+0000","last_change":"2024-09-14T12:44:12.742681+0000","last_active":"2024-09-14T12:44:12.742825+0000","last_peered":"2024-09-14T12:44:12.742825+0000","last_clean":"2024-09-14T12:44:12.742825+0000","last_became_active":"2024-09-14T10:49:23.355864+0000","last_became_peered":"2024-09-14T10:49:23.355864+0000","last_unstale":"2024-09-14T12:44:12.742825+0000","last_undegraded":"2024-09-14T12:44:12.742825+0000","last_fullsized":"2024-09-14T12:44:12.742825+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-09-14T12:44:12.742461+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-09-14T12:44:12.742461+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.742461+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:50.949947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":100725,"num_write":1103,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506421+0000","last_change":"2024-09-14T10:49:27.391003+0000","last_active":"2024-09-14T12:42:01.506421+0000","last_peered":"2024-09-14T12:42:01.506421+0000","last_clean":"2024-09-14T12:42:01.506421+0000","last_became_active":"2024-09-14T10:49:27.390169+0000","last_became_peered":"2024-09-14T10:49:27.390169+0000","last_unstale":"2024-09-14T12:42:01.506421+0000","last_undegraded":"2024-09-14T12:42:01.506421+0000","last_fullsized":"2024-09-14T12:42:01.506421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'426","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.059437+0000","last_change":"2024-09-14T12:44:29.059437+0000","last_active":"2024-09-14T12:44:29.059437+0000","last_peered":"2024-09-14T12:44:29.059437+0000","last_clean":"2024-09-14T12:44:29.059437+0000","last_became_active":"2024-09-14T10:49:29.400776+0000","last_became_peered":"2024-09-14T10:49:29.400776+0000","last_unstale":"2024-09-14T12:44:29.059437+0000","last_undegraded":"2024-09-14T12:44:29.059437+0000","last_fullsized":"2024-09-14T12:44:29.059437+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'426","last_scrub_stamp":"2024-09-14T12:44:29.059340+0000","last_deep_scrub":"267'426","last_deep_scrub_stamp":"2024-09-14T12:44:29.059340+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.059340+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:24.036786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1253,"num_write":514,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.173067+0000","last_change":"2024-09-14T10:49:31.421446+0000","last_active":"2024-09-14T12:42:06.173067+0000","last_peered":"2024-09-14T12:42:06.173067+0000","last_clean":"2024-09-14T12:42:06.173067+0000","last_became_active":"2024-09-14T10:49:31.418131+0000","last_became_peered":"2024-09-14T10:49:31.418131+0000","last_unstale":"2024-09-14T12:42:06.173067+0000","last_undegraded":"2024-09-14T12:42:06.173067+0000","last_fullsized":"2024-09-14T12:42:06.173067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'138","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.744011+0000","last_change":"2024-09-14T10:49:33.457926+0000","last_active":"2024-09-14T12:42:31.744011+0000","last_peered":"2024-09-14T12:42:31.744011+0000","last_clean":"2024-09-14T12:42:31.744011+0000","last_became_active":"2024-09-14T10:49:33.455953+0000","last_became_peered":"2024-09-14T10:49:33.455953+0000","last_unstale":"2024-09-14T12:42:31.744011+0000","last_undegraded":"2024-09-14T12:42:31.744011+0000","last_fullsized":"2024-09-14T12:42:31.744011+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:50.433913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":155,"num_write":340,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'412","reported_seq":2110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:11.508964+0000","last_change":"2024-09-14T10:49:25.378560+0000","last_active":"2024-09-14T12:42:11.508964+0000","last_peered":"2024-09-14T12:42:11.508964+0000","last_clean":"2024-09-14T12:42:11.508964+0000","last_became_active":"2024-09-14T10:49:25.377841+0000","last_became_peered":"2024-09-14T10:49:25.377841+0000","last_unstale":"2024-09-14T12:42:11.508964+0000","last_undegraded":"2024-09-14T12:42:11.508964+0000","last_fullsized":"2024-09-14T12:42:11.508964+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2397,"num_read_kb":2304,"num_write":471,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.886990+0000","last_change":"2024-09-14T12:44:09.886990+0000","last_active":"2024-09-14T12:44:09.886990+0000","last_peered":"2024-09-14T12:44:09.886990+0000","last_clean":"2024-09-14T12:44:09.886990+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T12:44:09.886990+0000","last_undegraded":"2024-09-14T12:44:09.886990+0000","last_fullsized":"2024-09-14T12:44:09.886990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.886874+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:32.555870+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.693554+0000","last_change":"2024-09-14T12:44:11.693554+0000","last_active":"2024-09-14T12:44:11.693554+0000","last_peered":"2024-09-14T12:44:11.693554+0000","last_clean":"2024-09-14T12:44:11.693554+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T12:44:11.693554+0000","last_undegraded":"2024-09-14T12:44:11.693554+0000","last_fullsized":"2024-09-14T12:44:11.693554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:11.693472+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:11.693472+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.693472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:19.157490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'329","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.793286+0000","last_change":"2024-09-14T12:44:10.793286+0000","last_active":"2024-09-14T12:44:10.793286+0000","last_peered":"2024-09-14T12:44:10.793286+0000","last_clean":"2024-09-14T12:44:10.793286+0000","last_became_active":"2024-09-14T10:49:23.371077+0000","last_became_peered":"2024-09-14T10:49:23.371077+0000","last_unstale":"2024-09-14T12:44:10.793286+0000","last_undegraded":"2024-09-14T12:44:10.793286+0000","last_fullsized":"2024-09-14T12:44:10.793286+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-09-14T12:44:10.793074+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-09-14T12:44:10.793074+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.793074+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:06.598298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":16360,"num_write":1113,"num_write_kb":33420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.166090+0000","last_change":"2024-09-14T12:44:27.166090+0000","last_active":"2024-09-14T12:44:27.166090+0000","last_peered":"2024-09-14T12:44:27.166090+0000","last_clean":"2024-09-14T12:44:27.166090+0000","last_became_active":"2024-09-14T10:49:27.372388+0000","last_became_peered":"2024-09-14T10:49:27.372388+0000","last_unstale":"2024-09-14T12:44:27.166090+0000","last_undegraded":"2024-09-14T12:44:27.166090+0000","last_fullsized":"2024-09-14T12:44:27.166090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.165821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.165821+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.165821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:15.547531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'829","reported_seq":1576,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.057700+0000","last_change":"2024-09-14T10:49:29.390925+0000","last_active":"2024-09-14T12:44:04.057700+0000","last_peered":"2024-09-14T12:44:04.057700+0000","last_clean":"2024-09-14T12:44:04.057700+0000","last_became_active":"2024-09-14T10:49:29.390014+0000","last_became_peered":"2024-09-14T10:49:29.390014+0000","last_unstale":"2024-09-14T12:44:04.057700+0000","last_undegraded":"2024-09-14T12:44:04.057700+0000","last_fullsized":"2024-09-14T12:44:04.057700+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167259,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1623,"num_read_kb":3686,"num_write":1586,"num_write_kb":1425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:15.365157+0000","last_change":"2024-09-14T10:49:31.411996+0000","last_active":"2024-09-14T12:42:15.365157+0000","last_peered":"2024-09-14T12:42:15.365157+0000","last_clean":"2024-09-14T12:42:15.365157+0000","last_became_active":"2024-09-14T10:49:31.411212+0000","last_became_peered":"2024-09-14T10:49:31.411212+0000","last_unstale":"2024-09-14T12:42:15.365157+0000","last_undegraded":"2024-09-14T12:42:15.365157+0000","last_fullsized":"2024-09-14T12:42:15.365157+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'196","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.841779+0000","last_change":"2024-09-14T10:49:33.470365+0000","last_active":"2024-09-14T12:42:31.841779+0000","last_peered":"2024-09-14T12:42:31.841779+0000","last_clean":"2024-09-14T12:42:31.841779+0000","last_became_active":"2024-09-14T10:49:33.469611+0000","last_became_peered":"2024-09-14T10:49:33.469611+0000","last_unstale":"2024-09-14T12:42:31.841779+0000","last_undegraded":"2024-09-14T12:42:31.841779+0000","last_fullsized":"2024-09-14T12:42:31.841779+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":425,"num_write":402,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'780","reported_seq":2301,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.874559+0000","last_change":"2024-09-14T12:44:24.874559+0000","last_active":"2024-09-14T12:44:24.874559+0000","last_peered":"2024-09-14T12:44:24.874559+0000","last_clean":"2024-09-14T12:44:24.874559+0000","last_became_active":"2024-09-14T10:49:25.390586+0000","last_became_peered":"2024-09-14T10:49:25.390586+0000","last_unstale":"2024-09-14T12:44:24.874559+0000","last_undegraded":"2024-09-14T12:44:24.874559+0000","last_fullsized":"2024-09-14T12:44:24.874559+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'780","last_scrub_stamp":"2024-09-14T12:44:24.874284+0000","last_deep_scrub":"267'780","last_deep_scrub_stamp":"2024-09-14T12:44:24.874284+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.874284+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:51.757493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3382,"num_write":1057,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.718117+0000","last_change":"2024-09-14T12:44:10.718117+0000","last_active":"2024-09-14T12:44:10.718117+0000","last_peered":"2024-09-14T12:44:10.718117+0000","last_clean":"2024-09-14T12:44:10.718117+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T12:44:10.718117+0000","last_undegraded":"2024-09-14T12:44:10.718117+0000","last_fullsized":"2024-09-14T12:44:10.718117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:10.718056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:10.718056+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.718056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:29.760263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'352","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.735411+0000","last_change":"2024-09-14T12:44:12.735411+0000","last_active":"2024-09-14T12:44:12.735411+0000","last_peered":"2024-09-14T12:44:12.735411+0000","last_clean":"2024-09-14T12:44:12.735411+0000","last_became_active":"2024-09-14T10:49:53.507913+0000","last_became_peered":"2024-09-14T10:49:53.507913+0000","last_unstale":"2024-09-14T12:44:12.735411+0000","last_undegraded":"2024-09-14T12:44:12.735411+0000","last_fullsized":"2024-09-14T12:44:12.735411+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-09-14T12:44:12.735166+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-09-14T12:44:12.735166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.735166+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:17.278126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":56481,"num_write":1136,"num_write_kb":45113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,3],"acting":[6,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:11.509107+0000","last_change":"2024-09-14T10:49:27.389322+0000","last_active":"2024-09-14T12:42:11.509107+0000","last_peered":"2024-09-14T12:42:11.509107+0000","last_clean":"2024-09-14T12:42:11.509107+0000","last_became_active":"2024-09-14T10:49:27.388875+0000","last_became_peered":"2024-09-14T10:49:27.388875+0000","last_unstale":"2024-09-14T12:42:11.509107+0000","last_undegraded":"2024-09-14T12:42:11.509107+0000","last_fullsized":"2024-09-14T12:42:11.509107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1478","reported_seq":3859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.438518+0000","last_change":"2024-09-14T12:44:27.438518+0000","last_active":"2024-09-14T12:44:27.438518+0000","last_peered":"2024-09-14T12:44:27.438518+0000","last_clean":"2024-09-14T12:44:27.438518+0000","last_became_active":"2024-09-14T10:49:29.393295+0000","last_became_peered":"2024-09-14T10:49:29.393295+0000","last_unstale":"2024-09-14T12:44:27.438518+0000","last_undegraded":"2024-09-14T12:44:27.438518+0000","last_fullsized":"2024-09-14T12:44:27.438518+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1478","last_scrub_stamp":"2024-09-14T12:44:27.438310+0000","last_deep_scrub":"267'1478","last_deep_scrub_stamp":"2024-09-14T12:44:27.438310+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.438310+0000","objects_scrubbed":11,"log_size":78,"log_dups_size":1400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:41.883467+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2284,"num_read_kb":4194,"num_write":1394,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.511788+0000","last_change":"2024-09-14T10:49:31.432764+0000","last_active":"2024-09-14T12:42:21.511788+0000","last_peered":"2024-09-14T12:42:21.511788+0000","last_clean":"2024-09-14T12:42:21.511788+0000","last_became_active":"2024-09-14T10:49:31.432054+0000","last_became_peered":"2024-09-14T10:49:31.432054+0000","last_unstale":"2024-09-14T12:42:21.511788+0000","last_undegraded":"2024-09-14T12:42:21.511788+0000","last_fullsized":"2024-09-14T12:42:21.511788+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'83","reported_seq":607,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:30.558557+0000","last_change":"2024-09-14T10:49:33.466954+0000","last_active":"2024-09-14T12:40:30.558557+0000","last_peered":"2024-09-14T12:40:30.558557+0000","last_clean":"2024-09-14T12:40:30.558557+0000","last_became_active":"2024-09-14T10:49:33.466307+0000","last_became_peered":"2024-09-14T10:49:33.466307+0000","last_unstale":"2024-09-14T12:40:30.558557+0000","last_undegraded":"2024-09-14T12:40:30.558557+0000","last_fullsized":"2024-09-14T12:40:30.558557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:18.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":197,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'931","reported_seq":2505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.741494+0000","last_change":"2024-09-14T12:44:22.741494+0000","last_active":"2024-09-14T12:44:22.741494+0000","last_peered":"2024-09-14T12:44:22.741494+0000","last_clean":"2024-09-14T12:44:22.741494+0000","last_became_active":"2024-09-14T10:49:25.382937+0000","last_became_peered":"2024-09-14T10:49:25.382937+0000","last_unstale":"2024-09-14T12:44:22.741494+0000","last_undegraded":"2024-09-14T12:44:22.741494+0000","last_fullsized":"2024-09-14T12:44:22.741494+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'931","last_scrub_stamp":"2024-09-14T12:44:22.741320+0000","last_deep_scrub":"267'931","last_deep_scrub_stamp":"2024-09-14T12:44:22.741320+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.741320+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:45.020675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":3892,"num_write":1285,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.618578+0000","last_change":"2024-09-14T12:44:13.618578+0000","last_active":"2024-09-14T12:44:13.618578+0000","last_peered":"2024-09-14T12:44:13.618578+0000","last_clean":"2024-09-14T12:44:13.618578+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T12:44:13.618578+0000","last_undegraded":"2024-09-14T12:44:13.618578+0000","last_fullsized":"2024-09-14T12:44:13.618578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:13.618399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:13.618399+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.618399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:36:10.021666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'330","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.875989+0000","last_change":"2024-09-14T12:44:12.875989+0000","last_active":"2024-09-14T12:44:12.875989+0000","last_peered":"2024-09-14T12:44:12.875989+0000","last_clean":"2024-09-14T12:44:12.875989+0000","last_became_active":"2024-09-14T10:49:23.387885+0000","last_became_peered":"2024-09-14T10:49:23.387885+0000","last_unstale":"2024-09-14T12:44:12.875989+0000","last_undegraded":"2024-09-14T12:44:12.875989+0000","last_fullsized":"2024-09-14T12:44:12.875989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-14T12:44:12.875716+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-14T12:44:12.875716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.875716+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:32.075745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":25294,"num_write":1061,"num_write_kb":31965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.456328+0000","last_change":"2024-09-14T12:44:25.456328+0000","last_active":"2024-09-14T12:44:25.456328+0000","last_peered":"2024-09-14T12:44:25.456328+0000","last_clean":"2024-09-14T12:44:25.456328+0000","last_became_active":"2024-09-14T10:49:27.384973+0000","last_became_peered":"2024-09-14T10:49:27.384973+0000","last_unstale":"2024-09-14T12:44:25.456328+0000","last_undegraded":"2024-09-14T12:44:25.456328+0000","last_fullsized":"2024-09-14T12:44:25.456328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:25.456147+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:25.456147+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.456147+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:48.132295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'424","reported_seq":2414,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.164324+0000","last_change":"2024-09-14T12:44:28.164324+0000","last_active":"2024-09-14T12:44:28.164324+0000","last_peered":"2024-09-14T12:44:28.164324+0000","last_clean":"2024-09-14T12:44:28.164324+0000","last_became_active":"2024-09-14T10:49:29.382485+0000","last_became_peered":"2024-09-14T10:49:29.382485+0000","last_unstale":"2024-09-14T12:44:28.164324+0000","last_undegraded":"2024-09-14T12:44:28.164324+0000","last_fullsized":"2024-09-14T12:44:28.164324+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'424","last_scrub_stamp":"2024-09-14T12:44:28.164109+0000","last_deep_scrub":"267'424","last_deep_scrub_stamp":"2024-09-14T12:44:28.164109+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.164109+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:10.149631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":384,"num_read_kb":370,"num_write":379,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.590006+0000","last_change":"2024-09-14T10:49:31.421762+0000","last_active":"2024-09-14T12:42:05.590006+0000","last_peered":"2024-09-14T12:42:05.590006+0000","last_clean":"2024-09-14T12:42:05.590006+0000","last_became_active":"2024-09-14T10:49:31.420121+0000","last_became_peered":"2024-09-14T10:49:31.420121+0000","last_unstale":"2024-09-14T12:42:05.590006+0000","last_undegraded":"2024-09-14T12:42:05.590006+0000","last_fullsized":"2024-09-14T12:42:05.590006+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:24.154484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'274","reported_seq":903,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.349973+0000","last_change":"2024-09-14T10:49:33.438284+0000","last_active":"2024-09-14T12:42:32.349973+0000","last_peered":"2024-09-14T12:42:32.349973+0000","last_clean":"2024-09-14T12:42:32.349973+0000","last_became_active":"2024-09-14T10:49:33.437564+0000","last_became_peered":"2024-09-14T10:49:33.437564+0000","last_unstale":"2024-09-14T12:42:32.349973+0000","last_undegraded":"2024-09-14T12:42:32.349973+0000","last_fullsized":"2024-09-14T12:42:32.349973+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":600,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'364","reported_seq":1779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.762886+0000","last_change":"2024-09-14T12:44:21.762886+0000","last_active":"2024-09-14T12:44:21.762886+0000","last_peered":"2024-09-14T12:44:21.762886+0000","last_clean":"2024-09-14T12:44:21.762886+0000","last_became_active":"2024-09-14T10:49:25.377606+0000","last_became_peered":"2024-09-14T10:49:25.377606+0000","last_unstale":"2024-09-14T12:44:21.762886+0000","last_undegraded":"2024-09-14T12:44:21.762886+0000","last_fullsized":"2024-09-14T12:44:21.762886+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-14T12:44:21.762699+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-14T12:44:21.762699+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.762699+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:46.620062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2088,"num_read_kb":1981,"num_write":424,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.689647+0000","last_change":"2024-09-14T12:44:12.689647+0000","last_active":"2024-09-14T12:44:12.689647+0000","last_peered":"2024-09-14T12:44:12.689647+0000","last_clean":"2024-09-14T12:44:12.689647+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T12:44:12.689647+0000","last_undegraded":"2024-09-14T12:44:12.689647+0000","last_fullsized":"2024-09-14T12:44:12.689647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:12.689558+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:12.689558+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.689558+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:00.729814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'374","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.159271+0000","last_change":"2024-09-14T12:44:22.159271+0000","last_active":"2024-09-14T12:44:22.159271+0000","last_peered":"2024-09-14T12:44:22.159271+0000","last_clean":"2024-09-14T12:44:22.159271+0000","last_became_active":"2024-09-14T10:49:23.365016+0000","last_became_peered":"2024-09-14T10:49:23.365016+0000","last_unstale":"2024-09-14T12:44:22.159271+0000","last_undegraded":"2024-09-14T12:44:22.159271+0000","last_fullsized":"2024-09-14T12:44:22.159271+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:22.158986+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:22.158986+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.158986+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:14.641518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":666,"num_read_kb":160044,"num_write":1139,"num_write_kb":62525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.529218+0000","last_change":"2024-09-14T12:44:20.528981+0000","last_active":"2024-09-14T12:44:20.529218+0000","last_peered":"2024-09-14T12:44:20.529218+0000","last_clean":"2024-09-14T12:44:20.529218+0000","last_became_active":"2024-09-14T10:49:27.373998+0000","last_became_peered":"2024-09-14T10:49:27.373998+0000","last_unstale":"2024-09-14T12:44:20.529218+0000","last_undegraded":"2024-09-14T12:44:20.529218+0000","last_fullsized":"2024-09-14T12:44:20.529218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:20.528772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:20.528772+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.528772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:55.424574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'229","reported_seq":837,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.886678+0000","last_change":"2024-09-14T10:49:29.391820+0000","last_active":"2024-09-14T12:43:48.886678+0000","last_peered":"2024-09-14T12:43:48.886678+0000","last_clean":"2024-09-14T12:43:48.886678+0000","last_became_active":"2024-09-14T10:49:29.391056+0000","last_became_peered":"2024-09-14T10:49:29.391056+0000","last_unstale":"2024-09-14T12:43:48.886678+0000","last_undegraded":"2024-09-14T12:43:48.886678+0000","last_fullsized":"2024-09-14T12:43:48.886678+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":287,"num_read_kb":274,"num_write":212,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:16.510315+0000","last_change":"2024-09-14T10:49:31.430127+0000","last_active":"2024-09-14T12:42:16.510315+0000","last_peered":"2024-09-14T12:42:16.510315+0000","last_clean":"2024-09-14T12:42:16.510315+0000","last_became_active":"2024-09-14T10:49:31.424769+0000","last_became_peered":"2024-09-14T10:49:31.424769+0000","last_unstale":"2024-09-14T12:42:16.510315+0000","last_undegraded":"2024-09-14T12:42:16.510315+0000","last_fullsized":"2024-09-14T12:42:16.510315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'129","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.069055+0000","last_change":"2024-09-14T10:49:33.469301+0000","last_active":"2024-09-14T12:42:32.069055+0000","last_peered":"2024-09-14T12:42:32.069055+0000","last_clean":"2024-09-14T12:42:32.069055+0000","last_became_active":"2024-09-14T10:49:33.468553+0000","last_became_peered":"2024-09-14T10:49:33.468553+0000","last_unstale":"2024-09-14T12:42:32.069055+0000","last_undegraded":"2024-09-14T12:42:32.069055+0000","last_fullsized":"2024-09-14T12:42:32.069055+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":228,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'559","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.750875+0000","last_change":"2024-09-14T12:44:18.750875+0000","last_active":"2024-09-14T12:44:18.750875+0000","last_peered":"2024-09-14T12:44:18.750875+0000","last_clean":"2024-09-14T12:44:18.750875+0000","last_became_active":"2024-09-14T10:49:25.379137+0000","last_became_peered":"2024-09-14T10:49:25.379137+0000","last_unstale":"2024-09-14T12:44:18.750875+0000","last_undegraded":"2024-09-14T12:44:18.750875+0000","last_fullsized":"2024-09-14T12:44:18.750875+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'559","last_scrub_stamp":"2024-09-14T12:44:18.750687+0000","last_deep_scrub":"267'559","last_deep_scrub_stamp":"2024-09-14T12:44:18.750687+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.750687+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:29.411317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2924,"num_read_kb":2647,"num_write":735,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'367","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.850994+0000","last_change":"2024-09-14T12:44:09.850920+0000","last_active":"2024-09-14T12:44:09.850994+0000","last_peered":"2024-09-14T12:44:09.850994+0000","last_clean":"2024-09-14T12:44:09.850994+0000","last_became_active":"2024-09-14T10:49:23.389195+0000","last_became_peered":"2024-09-14T10:49:23.389195+0000","last_unstale":"2024-09-14T12:44:09.850994+0000","last_undegraded":"2024-09-14T12:44:09.850994+0000","last_fullsized":"2024-09-14T12:44:09.850994+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'367","last_scrub_stamp":"2024-09-14T12:44:09.850762+0000","last_deep_scrub":"267'367","last_deep_scrub_stamp":"2024-09-14T12:44:09.850762+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.850762+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:37.171130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984745,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":650,"num_read_kb":23846,"num_write":1157,"num_write_kb":31374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.835515+0000","last_change":"2024-09-14T12:44:11.835515+0000","last_active":"2024-09-14T12:44:11.835515+0000","last_peered":"2024-09-14T12:44:11.835515+0000","last_clean":"2024-09-14T12:44:11.835515+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T12:44:11.835515+0000","last_undegraded":"2024-09-14T12:44:11.835515+0000","last_fullsized":"2024-09-14T12:44:11.835515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:11.835327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:11.835327+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.835327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:41.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.895413+0000","last_change":"2024-09-14T12:44:28.895413+0000","last_active":"2024-09-14T12:44:28.895413+0000","last_peered":"2024-09-14T12:44:28.895413+0000","last_clean":"2024-09-14T12:44:28.895413+0000","last_became_active":"2024-09-14T10:49:27.368412+0000","last_became_peered":"2024-09-14T10:49:27.368412+0000","last_unstale":"2024-09-14T12:44:28.895413+0000","last_undegraded":"2024-09-14T12:44:28.895413+0000","last_fullsized":"2024-09-14T12:44:28.895413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.895241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.895241+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.895241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.614078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'762","reported_seq":1508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.440351+0000","last_change":"2024-09-14T12:44:26.440351+0000","last_active":"2024-09-14T12:44:26.440351+0000","last_peered":"2024-09-14T12:44:26.440351+0000","last_clean":"2024-09-14T12:44:26.440351+0000","last_became_active":"2024-09-14T10:49:29.383270+0000","last_became_peered":"2024-09-14T10:49:29.383270+0000","last_unstale":"2024-09-14T12:44:26.440351+0000","last_undegraded":"2024-09-14T12:44:26.440351+0000","last_fullsized":"2024-09-14T12:44:26.440351+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-09-14T12:44:26.440152+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-09-14T12:44:26.440152+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.440152+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.264773+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99398,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2001,"num_read_kb":3265,"num_write":2692,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537558,"num_omap_keys":1218,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.172829+0000","last_change":"2024-09-14T10:49:31.419150+0000","last_active":"2024-09-14T12:42:06.172829+0000","last_peered":"2024-09-14T12:42:06.172829+0000","last_clean":"2024-09-14T12:42:06.172829+0000","last_became_active":"2024-09-14T10:49:31.418385+0000","last_became_peered":"2024-09-14T10:49:31.418385+0000","last_unstale":"2024-09-14T12:42:06.172829+0000","last_undegraded":"2024-09-14T12:42:06.172829+0000","last_fullsized":"2024-09-14T12:42:06.172829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'130","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:31.728580+0000","last_change":"2024-09-14T10:49:33.468510+0000","last_active":"2024-09-14T12:42:31.728580+0000","last_peered":"2024-09-14T12:42:31.728580+0000","last_clean":"2024-09-14T12:42:31.728580+0000","last_became_active":"2024-09-14T10:49:33.467268+0000","last_became_peered":"2024-09-14T10:49:33.467268+0000","last_unstale":"2024-09-14T12:42:31.728580+0000","last_undegraded":"2024-09-14T12:42:31.728580+0000","last_fullsized":"2024-09-14T12:42:31.728580+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":137,"num_write":301,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'747","reported_seq":2299,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.794948+0000","last_change":"2024-09-14T12:44:20.794948+0000","last_active":"2024-09-14T12:44:20.794948+0000","last_peered":"2024-09-14T12:44:20.794948+0000","last_clean":"2024-09-14T12:44:20.794948+0000","last_became_active":"2024-09-14T10:49:25.377460+0000","last_became_peered":"2024-09-14T10:49:25.377460+0000","last_unstale":"2024-09-14T12:44:20.794948+0000","last_undegraded":"2024-09-14T12:44:20.794948+0000","last_fullsized":"2024-09-14T12:44:20.794948+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'747","last_scrub_stamp":"2024-09-14T12:44:20.794733+0000","last_deep_scrub":"267'747","last_deep_scrub_stamp":"2024-09-14T12:44:20.794733+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.794733+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:04.985527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3587,"num_read_kb":3249,"num_write":953,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'349","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.684281+0000","last_change":"2024-09-14T12:44:14.684281+0000","last_active":"2024-09-14T12:44:14.684281+0000","last_peered":"2024-09-14T12:44:14.684281+0000","last_clean":"2024-09-14T12:44:14.684281+0000","last_became_active":"2024-09-14T10:49:23.383686+0000","last_became_peered":"2024-09-14T10:49:23.383686+0000","last_unstale":"2024-09-14T12:44:14.684281+0000","last_undegraded":"2024-09-14T12:44:14.684281+0000","last_fullsized":"2024-09-14T12:44:14.684281+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-14T12:44:14.683982+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-14T12:44:14.683982+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.683982+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:25.301976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":8945,"num_write":1082,"num_write_kb":53511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.707852+0000","last_change":"2024-09-14T12:44:13.707852+0000","last_active":"2024-09-14T12:44:13.707852+0000","last_peered":"2024-09-14T12:44:13.707852+0000","last_clean":"2024-09-14T12:44:13.707852+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T12:44:13.707852+0000","last_undegraded":"2024-09-14T12:44:13.707852+0000","last_fullsized":"2024-09-14T12:44:13.707852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:13.707645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:13.707645+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.707645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:41.725258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.137911+0000","last_change":"2024-09-14T12:44:26.137911+0000","last_active":"2024-09-14T12:44:26.137911+0000","last_peered":"2024-09-14T12:44:26.137911+0000","last_clean":"2024-09-14T12:44:26.137911+0000","last_became_active":"2024-09-14T10:49:27.373801+0000","last_became_peered":"2024-09-14T10:49:27.373801+0000","last_unstale":"2024-09-14T12:44:26.137911+0000","last_undegraded":"2024-09-14T12:44:26.137911+0000","last_fullsized":"2024-09-14T12:44:26.137911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:26.137730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:26.137730+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.137730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:24.785770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'247","reported_seq":885,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.561543+0000","last_change":"2024-09-14T10:49:29.387943+0000","last_active":"2024-09-14T12:42:01.561543+0000","last_peered":"2024-09-14T12:42:01.561543+0000","last_clean":"2024-09-14T12:42:01.561543+0000","last_became_active":"2024-09-14T10:49:29.387176+0000","last_became_peered":"2024-09-14T10:49:29.387176+0000","last_unstale":"2024-09-14T12:42:01.561543+0000","last_undegraded":"2024-09-14T12:42:01.561543+0000","last_fullsized":"2024-09-14T12:42:01.561543+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:04.926878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'796","reported_seq":3336,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.447721+0000","last_change":"2024-09-14T10:49:31.418103+0000","last_active":"2024-09-14T12:44:03.447721+0000","last_peered":"2024-09-14T12:44:03.447721+0000","last_clean":"2024-09-14T12:44:03.447721+0000","last_became_active":"2024-09-14T10:49:31.417376+0000","last_became_peered":"2024-09-14T10:49:31.417376+0000","last_unstale":"2024-09-14T12:44:03.447721+0000","last_undegraded":"2024-09-14T12:44:03.447721+0000","last_fullsized":"2024-09-14T12:44:03.447721+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:56.482438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'146","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.767330+0000","last_change":"2024-09-14T10:49:33.459885+0000","last_active":"2024-09-14T12:42:24.767330+0000","last_peered":"2024-09-14T12:42:24.767330+0000","last_clean":"2024-09-14T12:42:24.767330+0000","last_became_active":"2024-09-14T10:49:33.459122+0000","last_became_peered":"2024-09-14T10:49:33.459122+0000","last_unstale":"2024-09-14T12:42:24.767330+0000","last_undegraded":"2024-09-14T12:42:24.767330+0000","last_fullsized":"2024-09-14T12:42:24.767330+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:50.717373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":355,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'840","reported_seq":2556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.829846+0000","last_change":"2024-09-14T12:44:18.829846+0000","last_active":"2024-09-14T12:44:18.829846+0000","last_peered":"2024-09-14T12:44:18.829846+0000","last_clean":"2024-09-14T12:44:18.829846+0000","last_became_active":"2024-09-14T10:49:25.360655+0000","last_became_peered":"2024-09-14T10:49:25.360655+0000","last_unstale":"2024-09-14T12:44:18.829846+0000","last_undegraded":"2024-09-14T12:44:18.829846+0000","last_fullsized":"2024-09-14T12:44:18.829846+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'840","last_scrub_stamp":"2024-09-14T12:44:18.829679+0000","last_deep_scrub":"267'840","last_deep_scrub_stamp":"2024-09-14T12:44:18.829679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.829679+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:29.657903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4101,"num_read_kb":3716,"num_write":1090,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2812,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'464","reported_seq":1180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.768697+0000","last_change":"2024-09-14T12:44:13.768407+0000","last_active":"2024-09-14T12:44:13.768697+0000","last_peered":"2024-09-14T12:44:13.768697+0000","last_clean":"2024-09-14T12:44:13.768697+0000","last_became_active":"2024-09-14T10:49:23.359442+0000","last_became_peered":"2024-09-14T10:49:23.359442+0000","last_unstale":"2024-09-14T12:44:13.768697+0000","last_undegraded":"2024-09-14T12:44:13.768697+0000","last_fullsized":"2024-09-14T12:44:13.768697+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'464","last_scrub_stamp":"2024-09-14T12:44:13.768049+0000","last_deep_scrub":"267'464","last_deep_scrub_stamp":"2024-09-14T12:44:13.768049+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.768049+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:42.033691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":830,"num_read_kb":31084,"num_write":1362,"num_write_kb":31792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.756536+0000","last_change":"2024-09-14T12:44:11.756536+0000","last_active":"2024-09-14T12:44:11.756536+0000","last_peered":"2024-09-14T12:44:11.756536+0000","last_clean":"2024-09-14T12:44:11.756536+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T12:44:11.756536+0000","last_undegraded":"2024-09-14T12:44:11.756536+0000","last_fullsized":"2024-09-14T12:44:11.756536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:11.756350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:11.756350+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.756350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:46.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506175+0000","last_change":"2024-09-14T10:49:27.385279+0000","last_active":"2024-09-14T12:42:01.506175+0000","last_peered":"2024-09-14T12:42:01.506175+0000","last_clean":"2024-09-14T12:42:01.506175+0000","last_became_active":"2024-09-14T10:49:27.384635+0000","last_became_peered":"2024-09-14T10:49:27.384635+0000","last_unstale":"2024-09-14T12:42:01.506175+0000","last_undegraded":"2024-09-14T12:42:01.506175+0000","last_fullsized":"2024-09-14T12:42:01.506175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.745658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'179","reported_seq":778,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506219+0000","last_change":"2024-09-14T10:49:29.397010+0000","last_active":"2024-09-14T12:42:01.506219+0000","last_peered":"2024-09-14T12:42:01.506219+0000","last_clean":"2024-09-14T12:42:01.506219+0000","last_became_active":"2024-09-14T10:49:29.394105+0000","last_became_peered":"2024-09-14T10:49:29.394105+0000","last_unstale":"2024-09-14T12:42:01.506219+0000","last_undegraded":"2024-09-14T12:42:01.506219+0000","last_fullsized":"2024-09-14T12:42:01.506219+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:23.758962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'829","reported_seq":3145,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.013634+0000","last_change":"2024-09-14T10:49:31.411841+0000","last_active":"2024-09-14T12:44:05.013634+0000","last_peered":"2024-09-14T12:44:05.013634+0000","last_clean":"2024-09-14T12:44:05.013634+0000","last_became_active":"2024-09-14T10:49:31.411055+0000","last_became_peered":"2024-09-14T10:49:31.411055+0000","last_unstale":"2024-09-14T12:44:05.013634+0000","last_undegraded":"2024-09-14T12:44:05.013634+0000","last_fullsized":"2024-09-14T12:44:05.013634+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:46.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'269","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.362574+0000","last_change":"2024-09-14T10:49:33.457595+0000","last_active":"2024-09-14T12:42:05.362574+0000","last_peered":"2024-09-14T12:42:05.362574+0000","last_clean":"2024-09-14T12:42:05.362574+0000","last_became_active":"2024-09-14T10:49:33.456806+0000","last_became_peered":"2024-09-14T10:49:33.456806+0000","last_unstale":"2024-09-14T12:42:05.362574+0000","last_undegraded":"2024-09-14T12:42:05.362574+0000","last_fullsized":"2024-09-14T12:42:05.362574+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":331,"num_read_kb":330,"num_write":580,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'504","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.868409+0000","last_change":"2024-09-14T12:44:17.868409+0000","last_active":"2024-09-14T12:44:17.868409+0000","last_peered":"2024-09-14T12:44:17.868409+0000","last_clean":"2024-09-14T12:44:17.868409+0000","last_became_active":"2024-09-14T10:49:25.372923+0000","last_became_peered":"2024-09-14T10:49:25.372923+0000","last_unstale":"2024-09-14T12:44:17.868409+0000","last_undegraded":"2024-09-14T12:44:17.868409+0000","last_fullsized":"2024-09-14T12:44:17.868409+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'504","last_scrub_stamp":"2024-09-14T12:44:17.868183+0000","last_deep_scrub":"267'504","last_deep_scrub_stamp":"2024-09-14T12:44:17.868183+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.868183+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:43:56.368622+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2643,"num_read_kb":2487,"num_write":591,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'357","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.806944+0000","last_change":"2024-09-14T12:44:15.806944+0000","last_active":"2024-09-14T12:44:15.806944+0000","last_peered":"2024-09-14T12:44:15.806944+0000","last_clean":"2024-09-14T12:44:15.806944+0000","last_became_active":"2024-09-14T10:49:23.344863+0000","last_became_peered":"2024-09-14T10:49:23.344863+0000","last_unstale":"2024-09-14T12:44:15.806944+0000","last_undegraded":"2024-09-14T12:44:15.806944+0000","last_fullsized":"2024-09-14T12:44:15.806944+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-14T12:44:15.806628+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-14T12:44:15.806628+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.806628+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:08.490411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":37228,"num_write":1084,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.734938+0000","last_change":"2024-09-14T12:44:15.734938+0000","last_active":"2024-09-14T12:44:15.734938+0000","last_peered":"2024-09-14T12:44:15.734938+0000","last_clean":"2024-09-14T12:44:15.734938+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T12:44:15.734938+0000","last_undegraded":"2024-09-14T12:44:15.734938+0000","last_fullsized":"2024-09-14T12:44:15.734938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:15.734744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:15.734744+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.734744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:19.978999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.862888+0000","last_change":"2024-09-14T12:44:27.862888+0000","last_active":"2024-09-14T12:44:27.862888+0000","last_peered":"2024-09-14T12:44:27.862888+0000","last_clean":"2024-09-14T12:44:27.862888+0000","last_became_active":"2024-09-14T10:49:27.379820+0000","last_became_peered":"2024-09-14T10:49:27.379820+0000","last_unstale":"2024-09-14T12:44:27.862888+0000","last_undegraded":"2024-09-14T12:44:27.862888+0000","last_fullsized":"2024-09-14T12:44:27.862888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.862707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.862707+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.862707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:05.909921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'854","reported_seq":1658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.125584+0000","last_change":"2024-09-14T12:44:30.125584+0000","last_active":"2024-09-14T12:44:30.125584+0000","last_peered":"2024-09-14T12:44:30.125584+0000","last_clean":"2024-09-14T12:44:30.125584+0000","last_became_active":"2024-09-14T10:49:29.389500+0000","last_became_peered":"2024-09-14T10:49:29.389500+0000","last_unstale":"2024-09-14T12:44:30.125584+0000","last_undegraded":"2024-09-14T12:44:30.125584+0000","last_fullsized":"2024-09-14T12:44:30.125584+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'854","last_scrub_stamp":"2024-09-14T12:44:30.125277+0000","last_deep_scrub":"267'854","last_deep_scrub_stamp":"2024-09-14T12:44:30.125277+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.125277+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:14.671455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1507,"num_read_kb":3507,"num_write":1226,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:05.589836+0000","last_change":"2024-09-14T10:49:31.413780+0000","last_active":"2024-09-14T12:42:05.589836+0000","last_peered":"2024-09-14T12:42:05.589836+0000","last_clean":"2024-09-14T12:42:05.589836+0000","last_became_active":"2024-09-14T10:49:31.413008+0000","last_became_peered":"2024-09-14T10:49:31.413008+0000","last_unstale":"2024-09-14T12:42:05.589836+0000","last_undegraded":"2024-09-14T12:42:05.589836+0000","last_fullsized":"2024-09-14T12:42:05.589836+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:58.384037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'119","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.085188+0000","last_change":"2024-09-14T10:49:33.471643+0000","last_active":"2024-09-14T12:42:32.085188+0000","last_peered":"2024-09-14T12:42:32.085188+0000","last_clean":"2024-09-14T12:42:32.085188+0000","last_became_active":"2024-09-14T10:49:33.468546+0000","last_became_peered":"2024-09-14T10:49:33.468546+0000","last_unstale":"2024-09-14T12:42:32.085188+0000","last_undegraded":"2024-09-14T12:42:32.085188+0000","last_fullsized":"2024-09-14T12:42:32.085188+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'160","reported_seq":766,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:32.258037+0000","last_change":"2024-09-14T10:49:33.462576+0000","last_active":"2024-09-14T12:42:32.258037+0000","last_peered":"2024-09-14T12:42:32.258037+0000","last_clean":"2024-09-14T12:42:32.258037+0000","last_became_active":"2024-09-14T10:49:33.461782+0000","last_became_peered":"2024-09-14T10:49:33.461782+0000","last_unstale":"2024-09-14T12:42:32.258037+0000","last_undegraded":"2024-09-14T12:42:32.258037+0000","last_fullsized":"2024-09-14T12:42:32.258037+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:38.902854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":264,"num_write":397,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'522","reported_seq":2256,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.824159+0000","last_change":"2024-09-14T12:44:18.824159+0000","last_active":"2024-09-14T12:44:18.824159+0000","last_peered":"2024-09-14T12:44:18.824159+0000","last_clean":"2024-09-14T12:44:18.824159+0000","last_became_active":"2024-09-14T10:49:25.381653+0000","last_became_peered":"2024-09-14T10:49:25.381653+0000","last_unstale":"2024-09-14T12:44:18.824159+0000","last_undegraded":"2024-09-14T12:44:18.824159+0000","last_fullsized":"2024-09-14T12:44:18.824159+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'522","last_scrub_stamp":"2024-09-14T12:44:18.823867+0000","last_deep_scrub":"267'522","last_deep_scrub_stamp":"2024-09-14T12:44:18.823867+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.823867+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:50.458414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2737,"num_read_kb":2577,"num_write":621,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'379","reported_seq":1168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.737083+0000","last_change":"2024-09-14T12:44:19.737083+0000","last_active":"2024-09-14T12:44:19.737083+0000","last_peered":"2024-09-14T12:44:19.737083+0000","last_clean":"2024-09-14T12:44:19.737083+0000","last_became_active":"2024-09-14T10:49:23.365341+0000","last_became_peered":"2024-09-14T10:49:23.365341+0000","last_unstale":"2024-09-14T12:44:19.737083+0000","last_undegraded":"2024-09-14T12:44:19.737083+0000","last_fullsized":"2024-09-14T12:44:19.737083+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-14T12:44:19.736779+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-14T12:44:19.736779+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.736779+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:24.797053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":685,"num_read_kb":37659,"num_write":1131,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.554957+0000","last_change":"2024-09-14T10:49:27.368112+0000","last_active":"2024-09-14T12:41:31.554957+0000","last_peered":"2024-09-14T12:41:31.554957+0000","last_clean":"2024-09-14T12:41:31.554957+0000","last_became_active":"2024-09-14T10:49:27.366990+0000","last_became_peered":"2024-09-14T10:49:27.366990+0000","last_unstale":"2024-09-14T12:41:31.554957+0000","last_undegraded":"2024-09-14T12:41:31.554957+0000","last_fullsized":"2024-09-14T12:41:31.554957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.945759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'335","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.502948+0000","last_change":"2024-09-14T10:49:29.372907+0000","last_active":"2024-09-14T12:44:03.502948+0000","last_peered":"2024-09-14T12:44:03.502948+0000","last_clean":"2024-09-14T12:44:03.502948+0000","last_became_active":"2024-09-14T10:49:29.371655+0000","last_became_peered":"2024-09-14T10:49:29.371655+0000","last_unstale":"2024-09-14T12:44:03.502948+0000","last_undegraded":"2024-09-14T12:44:03.502948+0000","last_fullsized":"2024-09-14T12:44:03.502948+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:51.332753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49045,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":1185,"num_write":440,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755605+0000","last_change":"2024-09-14T10:49:31.418572+0000","last_active":"2024-09-14T12:41:34.755605+0000","last_peered":"2024-09-14T12:41:34.755605+0000","last_clean":"2024-09-14T12:41:34.755605+0000","last_became_active":"2024-09-14T10:49:31.417675+0000","last_became_peered":"2024-09-14T10:49:31.417675+0000","last_unstale":"2024-09-14T12:41:34.755605+0000","last_undegraded":"2024-09-14T12:41:34.755605+0000","last_fullsized":"2024-09-14T12:41:34.755605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:42.817490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'145","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.663503+0000","last_change":"2024-09-14T10:49:33.454370+0000","last_active":"2024-09-14T12:43:47.663503+0000","last_peered":"2024-09-14T12:43:47.663503+0000","last_clean":"2024-09-14T12:43:47.663503+0000","last_became_active":"2024-09-14T10:49:33.453630+0000","last_became_peered":"2024-09-14T10:49:33.453630+0000","last_unstale":"2024-09-14T12:43:47.663503+0000","last_undegraded":"2024-09-14T12:43:47.663503+0000","last_fullsized":"2024-09-14T12:43:47.663503+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:55.786343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":363,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'723","reported_seq":2170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.861931+0000","last_change":"2024-09-14T12:44:20.861931+0000","last_active":"2024-09-14T12:44:20.861931+0000","last_peered":"2024-09-14T12:44:20.861931+0000","last_clean":"2024-09-14T12:44:20.861931+0000","last_became_active":"2024-09-14T10:49:25.373876+0000","last_became_peered":"2024-09-14T10:49:25.373876+0000","last_unstale":"2024-09-14T12:44:20.861931+0000","last_undegraded":"2024-09-14T12:44:20.861931+0000","last_fullsized":"2024-09-14T12:44:20.861931+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'723","last_scrub_stamp":"2024-09-14T12:44:20.861737+0000","last_deep_scrub":"267'723","last_deep_scrub_stamp":"2024-09-14T12:44:20.861737+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.861737+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.715221+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3124,"num_write":967,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'350","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.354231+0000","last_change":"2024-09-14T12:44:10.354231+0000","last_active":"2024-09-14T12:44:10.354231+0000","last_peered":"2024-09-14T12:44:10.354231+0000","last_clean":"2024-09-14T12:44:10.354231+0000","last_became_active":"2024-09-14T10:49:23.373206+0000","last_became_peered":"2024-09-14T10:49:23.373206+0000","last_unstale":"2024-09-14T12:44:10.354231+0000","last_undegraded":"2024-09-14T12:44:10.354231+0000","last_fullsized":"2024-09-14T12:44:10.354231+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.354149+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:26.010856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":656,"num_read_kb":34264,"num_write":1064,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.921353+0000","last_change":"2024-09-14T12:44:29.921353+0000","last_active":"2024-09-14T12:44:29.921353+0000","last_peered":"2024-09-14T12:44:29.921353+0000","last_clean":"2024-09-14T12:44:29.921353+0000","last_became_active":"2024-09-14T10:49:27.370174+0000","last_became_peered":"2024-09-14T10:49:27.370174+0000","last_unstale":"2024-09-14T12:44:29.921353+0000","last_undegraded":"2024-09-14T12:44:29.921353+0000","last_fullsized":"2024-09-14T12:44:29.921353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:29.921175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:29.921175+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.921175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.172813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:30.581354+0000","last_change":"2024-09-14T10:49:29.376404+0000","last_active":"2024-09-14T12:41:30.581354+0000","last_peered":"2024-09-14T12:41:30.581354+0000","last_clean":"2024-09-14T12:41:30.581354+0000","last_became_active":"2024-09-14T10:49:29.375761+0000","last_became_peered":"2024-09-14T10:49:29.375761+0000","last_unstale":"2024-09-14T12:41:30.581354+0000","last_undegraded":"2024-09-14T12:41:30.581354+0000","last_fullsized":"2024-09-14T12:41:30.581354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:47.597945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:36.165985+0000","last_change":"2024-09-14T10:49:31.411967+0000","last_active":"2024-09-14T12:41:36.165985+0000","last_peered":"2024-09-14T12:41:36.165985+0000","last_clean":"2024-09-14T12:41:36.165985+0000","last_became_active":"2024-09-14T10:49:31.410915+0000","last_became_peered":"2024-09-14T10:49:31.410915+0000","last_unstale":"2024-09-14T12:41:36.165985+0000","last_undegraded":"2024-09-14T12:41:36.165985+0000","last_fullsized":"2024-09-14T12:41:36.165985+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:52.454082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'179","reported_seq":721,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.366754+0000","last_change":"2024-09-14T10:49:33.454043+0000","last_active":"2024-09-14T12:42:29.366754+0000","last_peered":"2024-09-14T12:42:29.366754+0000","last_clean":"2024-09-14T12:42:29.366754+0000","last_became_active":"2024-09-14T10:49:33.453278+0000","last_became_peered":"2024-09-14T10:49:33.453278+0000","last_unstale":"2024-09-14T12:42:29.366754+0000","last_undegraded":"2024-09-14T12:42:29.366754+0000","last_fullsized":"2024-09-14T12:42:29.366754+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:00.597295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":265,"num_write":381,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'434","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.823436+0000","last_change":"2024-09-14T12:44:19.823436+0000","last_active":"2024-09-14T12:44:19.823436+0000","last_peered":"2024-09-14T12:44:19.823436+0000","last_clean":"2024-09-14T12:44:19.823436+0000","last_became_active":"2024-09-14T10:49:25.353010+0000","last_became_peered":"2024-09-14T10:49:25.353010+0000","last_unstale":"2024-09-14T12:44:19.823436+0000","last_undegraded":"2024-09-14T12:44:19.823436+0000","last_fullsized":"2024-09-14T12:44:19.823436+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T12:44:19.823256+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T12:44:19.823256+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.823256+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:53.762038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2606,"num_read_kb":2470,"num_write":495,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2789,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'374","reported_seq":1101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.874359+0000","last_change":"2024-09-14T12:44:12.874359+0000","last_active":"2024-09-14T12:44:12.874359+0000","last_peered":"2024-09-14T12:44:12.874359+0000","last_clean":"2024-09-14T12:44:12.874359+0000","last_became_active":"2024-09-14T10:49:23.403718+0000","last_became_peered":"2024-09-14T10:49:23.403718+0000","last_unstale":"2024-09-14T12:44:12.874359+0000","last_undegraded":"2024-09-14T12:44:12.874359+0000","last_fullsized":"2024-09-14T12:44:12.874359+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:12.874166+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:12.874166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.874166+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.218268+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":743,"num_read_kb":4167,"num_write":1078,"num_write_kb":34340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.937501+0000","last_change":"2024-09-14T12:44:25.937501+0000","last_active":"2024-09-14T12:44:25.937501+0000","last_peered":"2024-09-14T12:44:25.937501+0000","last_clean":"2024-09-14T12:44:25.937501+0000","last_became_active":"2024-09-14T10:49:27.377584+0000","last_became_peered":"2024-09-14T10:49:27.377584+0000","last_unstale":"2024-09-14T12:44:25.937501+0000","last_undegraded":"2024-09-14T12:44:25.937501+0000","last_fullsized":"2024-09-14T12:44:25.937501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:25.937326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:25.937326+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.937326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:22:46.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'391","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.463215+0000","last_change":"2024-09-14T12:44:28.463215+0000","last_active":"2024-09-14T12:44:28.463215+0000","last_peered":"2024-09-14T12:44:28.463215+0000","last_clean":"2024-09-14T12:44:28.463215+0000","last_became_active":"2024-09-14T10:49:29.389523+0000","last_became_peered":"2024-09-14T10:49:29.389523+0000","last_unstale":"2024-09-14T12:44:28.463215+0000","last_undegraded":"2024-09-14T12:44:28.463215+0000","last_fullsized":"2024-09-14T12:44:28.463215+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:28.462999+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:28.462999+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.462999+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:51.561087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":1411,"num_write":516,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.561781+0000","last_change":"2024-09-14T10:49:31.422662+0000","last_active":"2024-09-14T12:41:35.561781+0000","last_peered":"2024-09-14T12:41:35.561781+0000","last_clean":"2024-09-14T12:41:35.561781+0000","last_became_active":"2024-09-14T10:49:31.422113+0000","last_became_peered":"2024-09-14T10:49:31.422113+0000","last_unstale":"2024-09-14T12:41:35.561781+0000","last_undegraded":"2024-09-14T12:41:35.561781+0000","last_fullsized":"2024-09-14T12:41:35.561781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:51.224760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'154","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468918+0000","last_change":"2024-09-14T10:49:33.476247+0000","last_active":"2024-09-14T12:39:36.468918+0000","last_peered":"2024-09-14T12:39:36.468918+0000","last_clean":"2024-09-14T12:39:36.468918+0000","last_became_active":"2024-09-14T10:49:33.475156+0000","last_became_peered":"2024-09-14T10:49:33.475156+0000","last_unstale":"2024-09-14T12:39:36.468918+0000","last_undegraded":"2024-09-14T12:39:36.468918+0000","last_fullsized":"2024-09-14T12:39:36.468918+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:09.764500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'414","reported_seq":2104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.582365+0000","last_change":"2024-09-14T12:44:15.582365+0000","last_active":"2024-09-14T12:44:15.582365+0000","last_peered":"2024-09-14T12:44:15.582365+0000","last_clean":"2024-09-14T12:44:15.582365+0000","last_became_active":"2024-09-14T10:49:25.370901+0000","last_became_peered":"2024-09-14T10:49:25.370901+0000","last_unstale":"2024-09-14T12:44:15.582365+0000","last_undegraded":"2024-09-14T12:44:15.582365+0000","last_fullsized":"2024-09-14T12:44:15.582365+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-14T12:44:15.582102+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-14T12:44:15.582102+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.582102+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.776690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2274,"num_write":465,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'391","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.879398+0000","last_change":"2024-09-14T12:44:13.879398+0000","last_active":"2024-09-14T12:44:13.879398+0000","last_peered":"2024-09-14T12:44:13.879398+0000","last_clean":"2024-09-14T12:44:13.879398+0000","last_became_active":"2024-09-14T10:49:23.369669+0000","last_became_peered":"2024-09-14T10:49:23.369669+0000","last_unstale":"2024-09-14T12:44:13.879398+0000","last_undegraded":"2024-09-14T12:44:13.879398+0000","last_fullsized":"2024-09-14T12:44:13.879398+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:13.879160+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:13.879160+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.879160+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:49.729813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":9973,"num_write":1367,"num_write_kb":36861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:31.498091+0000","last_change":"2024-09-14T10:49:27.388330+0000","last_active":"2024-09-14T12:41:31.498091+0000","last_peered":"2024-09-14T12:41:31.498091+0000","last_clean":"2024-09-14T12:41:31.498091+0000","last_became_active":"2024-09-14T10:49:27.387840+0000","last_became_peered":"2024-09-14T10:49:27.387840+0000","last_unstale":"2024-09-14T12:41:31.498091+0000","last_undegraded":"2024-09-14T12:41:31.498091+0000","last_fullsized":"2024-09-14T12:41:31.498091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:31.040634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'323","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.927527+0000","last_change":"2024-09-14T10:49:29.392053+0000","last_active":"2024-09-14T12:44:04.927527+0000","last_peered":"2024-09-14T12:44:04.927527+0000","last_clean":"2024-09-14T12:44:04.927527+0000","last_became_active":"2024-09-14T10:49:29.391517+0000","last_became_peered":"2024-09-14T10:49:29.391517+0000","last_unstale":"2024-09-14T12:44:04.927527+0000","last_undegraded":"2024-09-14T12:44:04.927527+0000","last_fullsized":"2024-09-14T12:44:04.927527+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:03.721336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1347,"num_write":436,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:34.755694+0000","last_change":"2024-09-14T10:49:31.411523+0000","last_active":"2024-09-14T12:41:34.755694+0000","last_peered":"2024-09-14T12:41:34.755694+0000","last_clean":"2024-09-14T12:41:34.755694+0000","last_became_active":"2024-09-14T10:49:31.410633+0000","last_became_peered":"2024-09-14T10:49:31.410633+0000","last_unstale":"2024-09-14T12:41:34.755694+0000","last_undegraded":"2024-09-14T12:41:34.755694+0000","last_fullsized":"2024-09-14T12:41:34.755694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:56.976562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'747","reported_seq":2283,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:56.505119+0000","last_change":"2024-09-14T10:49:25.408540+0000","last_active":"2024-09-14T12:41:56.505119+0000","last_peered":"2024-09-14T12:41:56.505119+0000","last_clean":"2024-09-14T12:41:56.505119+0000","last_became_active":"2024-09-14T10:49:25.408028+0000","last_became_peered":"2024-09-14T10:49:25.408028+0000","last_unstale":"2024-09-14T12:41:56.505119+0000","last_undegraded":"2024-09-14T12:41:56.505119+0000","last_fullsized":"2024-09-14T12:41:56.505119+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:24.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3658,"num_read_kb":3304,"num_write":985,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'372","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.827233+0000","last_change":"2024-09-14T12:44:16.827233+0000","last_active":"2024-09-14T12:44:16.827233+0000","last_peered":"2024-09-14T12:44:16.827233+0000","last_clean":"2024-09-14T12:44:16.827233+0000","last_became_active":"2024-09-14T10:49:23.386404+0000","last_became_peered":"2024-09-14T10:49:23.386404+0000","last_unstale":"2024-09-14T12:44:16.827233+0000","last_undegraded":"2024-09-14T12:44:16.827233+0000","last_fullsized":"2024-09-14T12:44:16.827233+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-09-14T12:44:16.827021+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-09-14T12:44:16.827021+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.827021+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:13.386836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":6911,"num_write":1204,"num_write_kb":32272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'3","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.222429+0000","last_change":"2024-09-14T10:49:27.382769+0000","last_active":"2024-09-14T12:44:01.222429+0000","last_peered":"2024-09-14T12:44:01.222429+0000","last_clean":"2024-09-14T12:44:01.222429+0000","last_became_active":"2024-09-14T10:49:27.381931+0000","last_became_peered":"2024-09-14T10:49:27.381931+0000","last_unstale":"2024-09-14T12:44:01.222429+0000","last_undegraded":"2024-09-14T12:44:01.222429+0000","last_fullsized":"2024-09-14T12:44:01.222429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:55.209752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'556","reported_seq":1228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.869432+0000","last_change":"2024-09-14T10:49:29.364784+0000","last_active":"2024-09-14T12:44:04.869432+0000","last_peered":"2024-09-14T12:44:04.869432+0000","last_clean":"2024-09-14T12:44:04.869432+0000","last_became_active":"2024-09-14T10:49:29.364013+0000","last_became_peered":"2024-09-14T10:49:29.364013+0000","last_unstale":"2024-09-14T12:44:04.869432+0000","last_undegraded":"2024-09-14T12:44:04.869432+0000","last_fullsized":"2024-09-14T12:44:04.869432+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:14.626395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98236,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":964,"num_read_kb":2193,"num_write":836,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.137434+0000","last_change":"2024-09-14T10:49:31.432562+0000","last_active":"2024-09-14T12:39:36.137434+0000","last_peered":"2024-09-14T12:39:36.137434+0000","last_clean":"2024-09-14T12:39:36.137434+0000","last_became_active":"2024-09-14T10:49:31.431550+0000","last_became_peered":"2024-09-14T10:49:31.431550+0000","last_unstale":"2024-09-14T12:39:36.137434+0000","last_undegraded":"2024-09-14T12:39:36.137434+0000","last_fullsized":"2024-09-14T12:39:36.137434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:21.094996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'162","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:35.573998+0000","last_change":"2024-09-14T10:49:33.467050+0000","last_active":"2024-09-14T12:41:35.573998+0000","last_peered":"2024-09-14T12:41:35.573998+0000","last_clean":"2024-09-14T12:41:35.573998+0000","last_became_active":"2024-09-14T10:49:33.466424+0000","last_became_peered":"2024-09-14T10:49:33.466424+0000","last_unstale":"2024-09-14T12:41:35.573998+0000","last_undegraded":"2024-09-14T12:41:35.573998+0000","last_fullsized":"2024-09-14T12:41:35.573998+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:16.563193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":247,"num_write":384,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'833","reported_seq":2415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.875239+0000","last_change":"2024-09-14T12:44:22.875239+0000","last_active":"2024-09-14T12:44:22.875239+0000","last_peered":"2024-09-14T12:44:22.875239+0000","last_clean":"2024-09-14T12:44:22.875239+0000","last_became_active":"2024-09-14T10:49:25.364958+0000","last_became_peered":"2024-09-14T10:49:25.364958+0000","last_unstale":"2024-09-14T12:44:22.875239+0000","last_undegraded":"2024-09-14T12:44:22.875239+0000","last_fullsized":"2024-09-14T12:44:22.875239+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'833","last_scrub_stamp":"2024-09-14T12:44:22.875065+0000","last_deep_scrub":"267'833","last_deep_scrub_stamp":"2024-09-14T12:44:22.875065+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.875065+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.794954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3911,"num_read_kb":3508,"num_write":1119,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'415","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.788261+0000","last_change":"2024-09-14T12:44:14.788261+0000","last_active":"2024-09-14T12:44:14.788261+0000","last_peered":"2024-09-14T12:44:14.788261+0000","last_clean":"2024-09-14T12:44:14.788261+0000","last_became_active":"2024-09-14T10:49:23.375310+0000","last_became_peered":"2024-09-14T10:49:23.375310+0000","last_unstale":"2024-09-14T12:44:14.788261+0000","last_undegraded":"2024-09-14T12:44:14.788261+0000","last_fullsized":"2024-09-14T12:44:14.788261+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'415","last_scrub_stamp":"2024-09-14T12:44:14.788046+0000","last_deep_scrub":"267'415","last_deep_scrub_stamp":"2024-09-14T12:44:14.788046+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.788046+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:33.478823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":827,"num_read_kb":30368,"num_write":1218,"num_write_kb":52321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"38'5","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.235705+0000","last_change":"2024-09-14T10:49:27.386902+0000","last_active":"2024-09-14T12:44:01.235705+0000","last_peered":"2024-09-14T12:44:01.235705+0000","last_clean":"2024-09-14T12:44:01.235705+0000","last_became_active":"2024-09-14T10:49:27.386412+0000","last_became_peered":"2024-09-14T10:49:27.386412+0000","last_unstale":"2024-09-14T12:44:01.235705+0000","last_undegraded":"2024-09-14T12:44:01.235705+0000","last_fullsized":"2024-09-14T12:44:01.235705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:24.661084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'358","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.004469+0000","last_change":"2024-09-14T10:49:29.388733+0000","last_active":"2024-09-14T12:44:05.004469+0000","last_peered":"2024-09-14T12:44:05.004469+0000","last_clean":"2024-09-14T12:44:05.004469+0000","last_became_active":"2024-09-14T10:49:29.388370+0000","last_became_peered":"2024-09-14T10:49:29.388370+0000","last_unstale":"2024-09-14T12:44:05.004469+0000","last_undegraded":"2024-09-14T12:44:05.004469+0000","last_fullsized":"2024-09-14T12:44:05.004469+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.037315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46292,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":1047,"num_write":462,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.545289+0000","last_change":"2024-09-14T10:49:31.430532+0000","last_active":"2024-09-14T12:39:35.545289+0000","last_peered":"2024-09-14T12:39:35.545289+0000","last_clean":"2024-09-14T12:39:35.545289+0000","last_became_active":"2024-09-14T10:49:31.429861+0000","last_became_peered":"2024-09-14T10:49:31.429861+0000","last_unstale":"2024-09-14T12:39:35.545289+0000","last_undegraded":"2024-09-14T12:39:35.545289+0000","last_fullsized":"2024-09-14T12:39:35.545289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:13.932023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'278","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.559029+0000","last_change":"2024-09-14T10:49:33.451361+0000","last_active":"2024-09-14T12:42:24.559029+0000","last_peered":"2024-09-14T12:42:24.559029+0000","last_clean":"2024-09-14T12:42:24.559029+0000","last_became_active":"2024-09-14T10:49:33.446698+0000","last_became_peered":"2024-09-14T10:49:33.446698+0000","last_unstale":"2024-09-14T12:42:24.559029+0000","last_undegraded":"2024-09-14T12:42:24.559029+0000","last_fullsized":"2024-09-14T12:42:24.559029+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:44.754797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":288,"num_write":643,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'447","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.545524+0000","last_change":"2024-09-14T12:44:17.545357+0000","last_active":"2024-09-14T12:44:17.545524+0000","last_peered":"2024-09-14T12:44:17.545524+0000","last_clean":"2024-09-14T12:44:17.545524+0000","last_became_active":"2024-09-14T10:49:25.395644+0000","last_became_peered":"2024-09-14T10:49:25.395644+0000","last_unstale":"2024-09-14T12:44:17.545524+0000","last_undegraded":"2024-09-14T12:44:17.545524+0000","last_fullsized":"2024-09-14T12:44:17.545524+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-14T12:44:17.545155+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-14T12:44:17.545155+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.545155+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:13.025501+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2723,"num_read_kb":2577,"num_write":520,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4341,"num_omap_keys":17,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'336","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.899355+0000","last_change":"2024-09-14T12:44:12.899210+0000","last_active":"2024-09-14T12:44:12.899355+0000","last_peered":"2024-09-14T12:44:12.899355+0000","last_clean":"2024-09-14T12:44:12.899355+0000","last_became_active":"2024-09-14T10:49:23.394870+0000","last_became_peered":"2024-09-14T10:49:23.394870+0000","last_unstale":"2024-09-14T12:44:12.899355+0000","last_undegraded":"2024-09-14T12:44:12.899355+0000","last_fullsized":"2024-09-14T12:44:12.899355+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-14T12:44:12.898987+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-14T12:44:12.898987+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.898987+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:41.227802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":18368,"num_write":1090,"num_write_kb":30203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:31.136301+0000","last_change":"2024-09-14T10:49:27.387706+0000","last_active":"2024-09-14T12:39:31.136301+0000","last_peered":"2024-09-14T12:39:31.136301+0000","last_clean":"2024-09-14T12:39:31.136301+0000","last_became_active":"2024-09-14T10:49:27.385720+0000","last_became_peered":"2024-09-14T10:49:27.385720+0000","last_unstale":"2024-09-14T12:39:31.136301+0000","last_undegraded":"2024-09-14T12:39:31.136301+0000","last_fullsized":"2024-09-14T12:39:31.136301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:41.338079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'338","reported_seq":970,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.821897+0000","last_change":"2024-09-14T10:49:29.364739+0000","last_active":"2024-09-14T12:44:03.821897+0000","last_peered":"2024-09-14T12:44:03.821897+0000","last_clean":"2024-09-14T12:44:03.821897+0000","last_became_active":"2024-09-14T10:49:29.363989+0000","last_became_peered":"2024-09-14T10:49:29.363989+0000","last_unstale":"2024-09-14T12:44:03.821897+0000","last_undegraded":"2024-09-14T12:44:03.821897+0000","last_fullsized":"2024-09-14T12:44:03.821897+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:11.406587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1124,"num_write":422,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760421+0000","last_change":"2024-09-14T10:49:31.423380+0000","last_active":"2024-09-14T12:41:54.760421+0000","last_peered":"2024-09-14T12:41:54.760421+0000","last_clean":"2024-09-14T12:41:54.760421+0000","last_became_active":"2024-09-14T10:49:31.421636+0000","last_became_peered":"2024-09-14T10:49:31.421636+0000","last_unstale":"2024-09-14T12:41:54.760421+0000","last_undegraded":"2024-09-14T12:41:54.760421+0000","last_fullsized":"2024-09-14T12:41:54.760421+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:30.278841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.656575+0000","last_change":"2024-09-14T10:49:33.466507+0000","last_active":"2024-09-14T12:43:48.656575+0000","last_peered":"2024-09-14T12:43:48.656575+0000","last_clean":"2024-09-14T12:43:48.656575+0000","last_became_active":"2024-09-14T10:49:33.465638+0000","last_became_peered":"2024-09-14T10:49:33.465638+0000","last_unstale":"2024-09-14T12:43:48.656575+0000","last_undegraded":"2024-09-14T12:43:48.656575+0000","last_fullsized":"2024-09-14T12:43:48.656575+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:13.972982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'571","reported_seq":2236,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.880853+0000","last_change":"2024-09-14T12:44:21.880578+0000","last_active":"2024-09-14T12:44:21.880853+0000","last_peered":"2024-09-14T12:44:21.880853+0000","last_clean":"2024-09-14T12:44:21.880853+0000","last_became_active":"2024-09-14T10:49:25.383840+0000","last_became_peered":"2024-09-14T10:49:25.383840+0000","last_unstale":"2024-09-14T12:44:21.880853+0000","last_undegraded":"2024-09-14T12:44:21.880853+0000","last_fullsized":"2024-09-14T12:44:21.880853+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'571","last_scrub_stamp":"2024-09-14T12:44:21.880347+0000","last_deep_scrub":"267'571","last_deep_scrub_stamp":"2024-09-14T12:44:21.880347+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.880347+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:27.080812+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2923,"num_read_kb":2712,"num_write":720,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'483","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.844983+0000","last_change":"2024-09-14T12:44:16.844845+0000","last_active":"2024-09-14T12:44:16.844983+0000","last_peered":"2024-09-14T12:44:16.844983+0000","last_clean":"2024-09-14T12:44:16.844983+0000","last_became_active":"2024-09-14T10:49:23.338934+0000","last_became_peered":"2024-09-14T10:49:23.338934+0000","last_unstale":"2024-09-14T12:44:16.844983+0000","last_undegraded":"2024-09-14T12:44:16.844983+0000","last_fullsized":"2024-09-14T12:44:16.844983+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'483","last_scrub_stamp":"2024-09-14T12:44:16.844628+0000","last_deep_scrub":"267'483","last_deep_scrub_stamp":"2024-09-14T12:44:16.844628+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.844628+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.573418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":33265,"num_write":1328,"num_write_kb":49842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.588541+0000","last_change":"2024-09-14T10:49:27.369319+0000","last_active":"2024-09-14T12:42:00.588541+0000","last_peered":"2024-09-14T12:42:00.588541+0000","last_clean":"2024-09-14T12:42:00.588541+0000","last_became_active":"2024-09-14T10:49:27.368567+0000","last_became_peered":"2024-09-14T10:49:27.368567+0000","last_unstale":"2024-09-14T12:42:00.588541+0000","last_undegraded":"2024-09-14T12:42:00.588541+0000","last_fullsized":"2024-09-14T12:42:00.588541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'149","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:46.501799+0000","last_change":"2024-09-14T10:49:29.393578+0000","last_active":"2024-09-14T12:41:46.501799+0000","last_peered":"2024-09-14T12:41:46.501799+0000","last_clean":"2024-09-14T12:41:46.501799+0000","last_became_active":"2024-09-14T10:49:29.392965+0000","last_became_peered":"2024-09-14T10:49:29.392965+0000","last_unstale":"2024-09-14T12:41:46.501799+0000","last_undegraded":"2024-09-14T12:41:46.501799+0000","last_fullsized":"2024-09-14T12:41:46.501799+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.416866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":187,"num_read_kb":181,"num_write":132,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'791","reported_seq":3265,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:05.008148+0000","last_change":"2024-09-14T10:49:31.423609+0000","last_active":"2024-09-14T12:44:05.008148+0000","last_peered":"2024-09-14T12:44:05.008148+0000","last_clean":"2024-09-14T12:44:05.008148+0000","last_became_active":"2024-09-14T10:49:31.422765+0000","last_became_peered":"2024-09-14T10:49:31.422765+0000","last_unstale":"2024-09-14T12:44:05.008148+0000","last_undegraded":"2024-09-14T12:44:05.008148+0000","last_fullsized":"2024-09-14T12:44:05.008148+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'100","reported_seq":619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:27.666413+0000","last_change":"2024-09-14T10:49:33.443828+0000","last_active":"2024-09-14T12:42:27.666413+0000","last_peered":"2024-09-14T12:42:27.666413+0000","last_clean":"2024-09-14T12:42:27.666413+0000","last_became_active":"2024-09-14T10:49:33.443020+0000","last_became_peered":"2024-09-14T10:49:33.443020+0000","last_unstale":"2024-09-14T12:42:27.666413+0000","last_undegraded":"2024-09-14T12:42:27.666413+0000","last_fullsized":"2024-09-14T12:42:27.666413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.241734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":233,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'970","reported_seq":2593,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.816889+0000","last_change":"2024-09-14T12:44:21.816713+0000","last_active":"2024-09-14T12:44:21.816889+0000","last_peered":"2024-09-14T12:44:21.816889+0000","last_clean":"2024-09-14T12:44:21.816889+0000","last_became_active":"2024-09-14T10:49:25.400786+0000","last_became_peered":"2024-09-14T10:49:25.400786+0000","last_unstale":"2024-09-14T12:44:21.816889+0000","last_undegraded":"2024-09-14T12:44:21.816889+0000","last_fullsized":"2024-09-14T12:44:21.816889+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'970","last_scrub_stamp":"2024-09-14T12:44:21.816523+0000","last_deep_scrub":"267'970","last_deep_scrub_stamp":"2024-09-14T12:44:21.816523+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.816523+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:09.527962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4481,"num_read_kb":3955,"num_write":1321,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'333","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.924005+0000","last_change":"2024-09-14T12:44:11.923935+0000","last_active":"2024-09-14T12:44:11.924005+0000","last_peered":"2024-09-14T12:44:11.924005+0000","last_clean":"2024-09-14T12:44:11.924005+0000","last_became_active":"2024-09-14T10:49:23.394973+0000","last_became_peered":"2024-09-14T10:49:23.394973+0000","last_unstale":"2024-09-14T12:44:11.924005+0000","last_undegraded":"2024-09-14T12:44:11.924005+0000","last_fullsized":"2024-09-14T12:44:11.924005+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-14T12:44:11.923816+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-14T12:44:11.923816+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.923816+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:11.570601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":75765,"num_write":1031,"num_write_kb":39860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.012498+0000","last_change":"2024-09-14T12:44:28.012242+0000","last_active":"2024-09-14T12:44:28.012498+0000","last_peered":"2024-09-14T12:44:28.012498+0000","last_clean":"2024-09-14T12:44:28.012498+0000","last_became_active":"2024-09-14T10:49:27.377395+0000","last_became_peered":"2024-09-14T10:49:27.377395+0000","last_unstale":"2024-09-14T12:44:28.012498+0000","last_undegraded":"2024-09-14T12:44:28.012498+0000","last_fullsized":"2024-09-14T12:44:28.012498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.011952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.011952+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.011952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:18.742458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'394","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.305397+0000","last_change":"2024-09-14T10:49:29.377185+0000","last_active":"2024-09-14T12:44:04.305397+0000","last_peered":"2024-09-14T12:44:04.305397+0000","last_clean":"2024-09-14T12:44:04.305397+0000","last_became_active":"2024-09-14T10:49:29.376813+0000","last_became_peered":"2024-09-14T10:49:29.376813+0000","last_unstale":"2024-09-14T12:44:04.305397+0000","last_undegraded":"2024-09-14T12:44:04.305397+0000","last_fullsized":"2024-09-14T12:44:04.305397+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:27.599152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":628,"num_read_kb":1214,"num_write":492,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:45.571666+0000","last_change":"2024-09-14T10:49:31.425171+0000","last_active":"2024-09-14T12:40:45.571666+0000","last_peered":"2024-09-14T12:40:45.571666+0000","last_clean":"2024-09-14T12:40:45.571666+0000","last_became_active":"2024-09-14T10:49:31.424394+0000","last_became_peered":"2024-09-14T10:49:31.424394+0000","last_unstale":"2024-09-14T12:40:45.571666+0000","last_undegraded":"2024-09-14T12:40:45.571666+0000","last_fullsized":"2024-09-14T12:40:45.571666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:07.004493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'151","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.578263+0000","last_change":"2024-09-14T10:49:33.463294+0000","last_active":"2024-09-14T12:42:24.578263+0000","last_peered":"2024-09-14T12:42:24.578263+0000","last_clean":"2024-09-14T12:42:24.578263+0000","last_became_active":"2024-09-14T10:49:33.462582+0000","last_became_peered":"2024-09-14T10:49:33.462582+0000","last_unstale":"2024-09-14T12:42:24.578263+0000","last_undegraded":"2024-09-14T12:42:24.578263+0000","last_fullsized":"2024-09-14T12:42:24.578263+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:51.070074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":151,"num_write":347,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'490","reported_seq":2237,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.838896+0000","last_change":"2024-09-14T12:44:22.838759+0000","last_active":"2024-09-14T12:44:22.838896+0000","last_peered":"2024-09-14T12:44:22.838896+0000","last_clean":"2024-09-14T12:44:22.838896+0000","last_became_active":"2024-09-14T10:49:25.386937+0000","last_became_peered":"2024-09-14T10:49:25.386937+0000","last_unstale":"2024-09-14T12:44:22.838896+0000","last_undegraded":"2024-09-14T12:44:22.838896+0000","last_fullsized":"2024-09-14T12:44:22.838896+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-14T12:44:22.838569+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-14T12:44:22.838569+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.838569+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:03.633378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2676,"num_write":566,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'362","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.713951+0000","last_change":"2024-09-14T12:44:20.713683+0000","last_active":"2024-09-14T12:44:20.713951+0000","last_peered":"2024-09-14T12:44:20.713951+0000","last_clean":"2024-09-14T12:44:20.713951+0000","last_became_active":"2024-09-14T10:49:53.505479+0000","last_became_peered":"2024-09-14T10:49:53.505479+0000","last_unstale":"2024-09-14T12:44:20.713951+0000","last_undegraded":"2024-09-14T12:44:20.713951+0000","last_fullsized":"2024-09-14T12:44:20.713951+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-14T12:44:20.713333+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-14T12:44:20.713333+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.713333+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:04.232788+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3150208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":68230,"num_write":1159,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1,6],"acting":[3,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.888871+0000","last_change":"2024-09-14T12:44:24.888871+0000","last_active":"2024-09-14T12:44:24.888871+0000","last_peered":"2024-09-14T12:44:24.888871+0000","last_clean":"2024-09-14T12:44:24.888871+0000","last_became_active":"2024-09-14T10:49:27.371450+0000","last_became_peered":"2024-09-14T10:49:27.371450+0000","last_unstale":"2024-09-14T12:44:24.888871+0000","last_undegraded":"2024-09-14T12:44:24.888871+0000","last_fullsized":"2024-09-14T12:44:24.888871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.888693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.888693+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.888693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:48.211818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'300","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.384380+0000","last_change":"2024-09-14T10:49:29.380669+0000","last_active":"2024-09-14T12:44:04.384380+0000","last_peered":"2024-09-14T12:44:04.384380+0000","last_clean":"2024-09-14T12:44:04.384380+0000","last_became_active":"2024-09-14T10:49:29.379942+0000","last_became_peered":"2024-09-14T10:49:29.379942+0000","last_unstale":"2024-09-14T12:44:04.384380+0000","last_undegraded":"2024-09-14T12:44:04.384380+0000","last_fullsized":"2024-09-14T12:44:04.384380+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:50.784831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1051,"num_write":386,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490245+0000","last_change":"2024-09-14T10:49:31.430688+0000","last_active":"2024-09-14T12:41:01.490245+0000","last_peered":"2024-09-14T12:41:01.490245+0000","last_clean":"2024-09-14T12:41:01.490245+0000","last_became_active":"2024-09-14T10:49:31.424882+0000","last_became_peered":"2024-09-14T10:49:31.424882+0000","last_unstale":"2024-09-14T12:41:01.490245+0000","last_undegraded":"2024-09-14T12:41:01.490245+0000","last_fullsized":"2024-09-14T12:41:01.490245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:10.035901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'115","reported_seq":658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:29.540999+0000","last_change":"2024-09-14T10:49:33.469121+0000","last_active":"2024-09-14T12:41:29.540999+0000","last_peered":"2024-09-14T12:41:29.540999+0000","last_clean":"2024-09-14T12:41:29.540999+0000","last_became_active":"2024-09-14T10:49:33.468026+0000","last_became_peered":"2024-09-14T10:49:33.468026+0000","last_unstale":"2024-09-14T12:41:29.540999+0000","last_undegraded":"2024-09-14T12:41:29.540999+0000","last_fullsized":"2024-09-14T12:41:29.540999+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:54.591274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":167,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'980","reported_seq":2681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.498418+0000","last_change":"2024-09-14T12:44:18.498418+0000","last_active":"2024-09-14T12:44:18.498418+0000","last_peered":"2024-09-14T12:44:18.498418+0000","last_clean":"2024-09-14T12:44:18.498418+0000","last_became_active":"2024-09-14T10:49:25.386168+0000","last_became_peered":"2024-09-14T10:49:25.386168+0000","last_unstale":"2024-09-14T12:44:18.498418+0000","last_undegraded":"2024-09-14T12:44:18.498418+0000","last_fullsized":"2024-09-14T12:44:18.498418+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'980","last_scrub_stamp":"2024-09-14T12:44:18.498226+0000","last_deep_scrub":"267'980","last_deep_scrub_stamp":"2024-09-14T12:44:18.498226+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.498226+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":900,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:55.963844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4881,"num_read_kb":4356,"num_write":1346,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'333","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.874395+0000","last_change":"2024-09-14T12:44:14.874395+0000","last_active":"2024-09-14T12:44:14.874395+0000","last_peered":"2024-09-14T12:44:14.874395+0000","last_clean":"2024-09-14T12:44:14.874395+0000","last_became_active":"2024-09-14T10:49:23.367940+0000","last_became_peered":"2024-09-14T10:49:23.367940+0000","last_unstale":"2024-09-14T12:44:14.874395+0000","last_undegraded":"2024-09-14T12:44:14.874395+0000","last_fullsized":"2024-09-14T12:44:14.874395+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-14T12:44:14.874116+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-14T12:44:14.874116+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.874116+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:30.960138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":29401,"num_write":1062,"num_write_kb":29053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.057865+0000","last_change":"2024-09-14T12:44:27.057865+0000","last_active":"2024-09-14T12:44:27.057865+0000","last_peered":"2024-09-14T12:44:27.057865+0000","last_clean":"2024-09-14T12:44:27.057865+0000","last_became_active":"2024-09-14T10:49:27.380333+0000","last_became_peered":"2024-09-14T10:49:27.380333+0000","last_unstale":"2024-09-14T12:44:27.057865+0000","last_undegraded":"2024-09-14T12:44:27.057865+0000","last_fullsized":"2024-09-14T12:44:27.057865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.057679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.057679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.057679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:58.978461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'243","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.668768+0000","last_change":"2024-09-14T10:49:29.378365+0000","last_active":"2024-09-14T12:44:03.668768+0000","last_peered":"2024-09-14T12:44:03.668768+0000","last_clean":"2024-09-14T12:44:03.668768+0000","last_became_active":"2024-09-14T10:49:29.377643+0000","last_became_peered":"2024-09-14T10:49:29.377643+0000","last_unstale":"2024-09-14T12:44:03.668768+0000","last_undegraded":"2024-09-14T12:44:03.668768+0000","last_fullsized":"2024-09-14T12:44:03.668768+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:11.214340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":877,"num_write":306,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:36.468822+0000","last_change":"2024-09-14T10:49:31.431402+0000","last_active":"2024-09-14T12:39:36.468822+0000","last_peered":"2024-09-14T12:39:36.468822+0000","last_clean":"2024-09-14T12:39:36.468822+0000","last_became_active":"2024-09-14T10:49:31.430693+0000","last_became_peered":"2024-09-14T10:49:31.430693+0000","last_unstale":"2024-09-14T12:39:36.468822+0000","last_undegraded":"2024-09-14T12:39:36.468822+0000","last_fullsized":"2024-09-14T12:39:36.468822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:32.715814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'154","reported_seq":1639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.449796+0000","last_change":"2024-09-14T10:49:33.476298+0000","last_active":"2024-09-14T12:42:24.449796+0000","last_peered":"2024-09-14T12:42:24.449796+0000","last_clean":"2024-09-14T12:42:24.449796+0000","last_became_active":"2024-09-14T10:49:33.475592+0000","last_became_peered":"2024-09-14T10:49:33.475592+0000","last_unstale":"2024-09-14T12:42:24.449796+0000","last_undegraded":"2024-09-14T12:42:24.449796+0000","last_fullsized":"2024-09-14T12:42:24.449796+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:10.319176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1153,"num_read_kb":1151,"num_write":333,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'1203","reported_seq":2922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.787205+0000","last_change":"2024-09-14T12:44:20.787205+0000","last_active":"2024-09-14T12:44:20.787205+0000","last_peered":"2024-09-14T12:44:20.787205+0000","last_clean":"2024-09-14T12:44:20.787205+0000","last_became_active":"2024-09-14T10:49:25.362059+0000","last_became_peered":"2024-09-14T10:49:25.362059+0000","last_unstale":"2024-09-14T12:44:20.787205+0000","last_undegraded":"2024-09-14T12:44:20.787205+0000","last_fullsized":"2024-09-14T12:44:20.787205+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1203","last_scrub_stamp":"2024-09-14T12:44:20.786965+0000","last_deep_scrub":"267'1203","last_deep_scrub_stamp":"2024-09-14T12:44:20.786965+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.786965+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:56.073347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5522,"num_read_kb":4921,"num_write":1640,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'397","reported_seq":1097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.828976+0000","last_change":"2024-09-14T12:44:15.828976+0000","last_active":"2024-09-14T12:44:15.828976+0000","last_peered":"2024-09-14T12:44:15.828976+0000","last_clean":"2024-09-14T12:44:15.828976+0000","last_became_active":"2024-09-14T10:49:23.381620+0000","last_became_peered":"2024-09-14T10:49:23.381620+0000","last_unstale":"2024-09-14T12:44:15.828976+0000","last_undegraded":"2024-09-14T12:44:15.828976+0000","last_fullsized":"2024-09-14T12:44:15.828976+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'397","last_scrub_stamp":"2024-09-14T12:44:15.828640+0000","last_deep_scrub":"267'397","last_deep_scrub_stamp":"2024-09-14T12:44:15.828640+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.828640+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:00.548137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":34199,"num_write":1236,"num_write_kb":46564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:10.577149+0000","last_change":"2024-09-14T10:49:27.373477+0000","last_active":"2024-09-14T12:41:10.577149+0000","last_peered":"2024-09-14T12:41:10.577149+0000","last_clean":"2024-09-14T12:41:10.577149+0000","last_became_active":"2024-09-14T10:49:27.372685+0000","last_became_peered":"2024-09-14T10:49:27.372685+0000","last_unstale":"2024-09-14T12:41:10.577149+0000","last_undegraded":"2024-09-14T12:41:10.577149+0000","last_fullsized":"2024-09-14T12:41:10.577149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:26.344101+0000","last_clean_scrub_stamp":"2024-09-14T10:49:26.344101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:18.351337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'331","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.893167+0000","last_change":"2024-09-14T10:49:29.397492+0000","last_active":"2024-09-14T12:44:03.893167+0000","last_peered":"2024-09-14T12:44:03.893167+0000","last_clean":"2024-09-14T12:44:03.893167+0000","last_became_active":"2024-09-14T10:49:29.396379+0000","last_became_peered":"2024-09-14T10:49:29.396379+0000","last_unstale":"2024-09-14T12:44:03.893167+0000","last_undegraded":"2024-09-14T12:44:03.893167+0000","last_fullsized":"2024-09-14T12:44:03.893167+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:28.350220+0000","last_clean_scrub_stamp":"2024-09-14T10:49:28.350220+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:50.814297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":1145,"num_write":432,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":512,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:39:35.556297+0000","last_change":"2024-09-14T10:49:31.420969+0000","last_active":"2024-09-14T12:39:35.556297+0000","last_peered":"2024-09-14T12:39:35.556297+0000","last_clean":"2024-09-14T12:39:35.556297+0000","last_became_active":"2024-09-14T10:49:31.418819+0000","last_became_peered":"2024-09-14T10:49:31.418819+0000","last_unstale":"2024-09-14T12:39:35.556297+0000","last_undegraded":"2024-09-14T12:39:35.556297+0000","last_fullsized":"2024-09-14T12:39:35.556297+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:53.067509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'132","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.714351+0000","last_change":"2024-09-14T10:49:33.477067+0000","last_active":"2024-09-14T12:43:47.714351+0000","last_peered":"2024-09-14T12:43:47.714351+0000","last_clean":"2024-09-14T12:43:47.714351+0000","last_became_active":"2024-09-14T10:49:33.476455+0000","last_became_peered":"2024-09-14T10:49:33.476455+0000","last_unstale":"2024-09-14T12:43:47.714351+0000","last_undegraded":"2024-09-14T12:43:47.714351+0000","last_fullsized":"2024-09-14T12:43:47.714351+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":173,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'506","reported_seq":2202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.882618+0000","last_change":"2024-09-14T12:44:23.882618+0000","last_active":"2024-09-14T12:44:23.882618+0000","last_peered":"2024-09-14T12:44:23.882618+0000","last_clean":"2024-09-14T12:44:23.882618+0000","last_became_active":"2024-09-14T10:49:25.373337+0000","last_became_peered":"2024-09-14T10:49:25.373337+0000","last_unstale":"2024-09-14T12:44:23.882618+0000","last_undegraded":"2024-09-14T12:44:23.882618+0000","last_fullsized":"2024-09-14T12:44:23.882618+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'506","last_scrub_stamp":"2024-09-14T12:44:23.882442+0000","last_deep_scrub":"267'506","last_deep_scrub_stamp":"2024-09-14T12:44:23.882442+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.882442+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:44.958416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2857,"num_read_kb":2693,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'347","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.908298+0000","last_change":"2024-09-14T12:44:13.908298+0000","last_active":"2024-09-14T12:44:13.908298+0000","last_peered":"2024-09-14T12:44:13.908298+0000","last_clean":"2024-09-14T12:44:13.908298+0000","last_became_active":"2024-09-14T10:49:23.377766+0000","last_became_peered":"2024-09-14T10:49:23.377766+0000","last_unstale":"2024-09-14T12:44:13.908298+0000","last_undegraded":"2024-09-14T12:44:13.908298+0000","last_fullsized":"2024-09-14T12:44:13.908298+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-14T12:44:13.908057+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-14T12:44:13.908057+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.908057+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:07.725881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":614,"num_read_kb":20992,"num_write":1055,"num_write_kb":39444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'626","reported_seq":2320,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.551496+0000","last_change":"2024-09-14T12:44:21.551496+0000","last_active":"2024-09-14T12:44:21.551496+0000","last_peered":"2024-09-14T12:44:21.551496+0000","last_clean":"2024-09-14T12:44:21.551496+0000","last_became_active":"2024-09-14T10:49:25.375595+0000","last_became_peered":"2024-09-14T10:49:25.375595+0000","last_unstale":"2024-09-14T12:44:21.551496+0000","last_undegraded":"2024-09-14T12:44:21.551496+0000","last_fullsized":"2024-09-14T12:44:21.551496+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'626","last_scrub_stamp":"2024-09-14T12:44:21.551295+0000","last_deep_scrub":"267'626","last_deep_scrub_stamp":"2024-09-14T12:44:21.551295+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.551295+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:00.863868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3344,"num_read_kb":3023,"num_write":799,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3029,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'295","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.544796+0000","last_change":"2024-09-14T12:44:16.544796+0000","last_active":"2024-09-14T12:44:16.544796+0000","last_peered":"2024-09-14T12:44:16.544796+0000","last_clean":"2024-09-14T12:44:16.544796+0000","last_became_active":"2024-09-14T10:49:23.390456+0000","last_became_peered":"2024-09-14T10:49:23.390456+0000","last_unstale":"2024-09-14T12:44:16.544796+0000","last_undegraded":"2024-09-14T12:44:16.544796+0000","last_fullsized":"2024-09-14T12:44:16.544796+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-09-14T12:44:16.544513+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-09-14T12:44:16.544513+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.544513+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:27.941670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":9558,"num_write":877,"num_write_kb":19994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'455","reported_seq":2086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:47.685848+0000","last_change":"2024-09-14T10:49:25.377312+0000","last_active":"2024-09-14T12:43:47.685848+0000","last_peered":"2024-09-14T12:43:47.685848+0000","last_clean":"2024-09-14T12:43:47.685848+0000","last_became_active":"2024-09-14T10:49:25.372436+0000","last_became_peered":"2024-09-14T10:49:25.372436+0000","last_unstale":"2024-09-14T12:43:47.685848+0000","last_undegraded":"2024-09-14T12:43:47.685848+0000","last_fullsized":"2024-09-14T12:43:47.685848+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2453,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'344","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.667244+0000","last_change":"2024-09-14T12:44:24.667244+0000","last_active":"2024-09-14T12:44:24.667244+0000","last_peered":"2024-09-14T12:44:24.667244+0000","last_clean":"2024-09-14T12:44:24.667244+0000","last_became_active":"2024-09-14T10:49:23.395161+0000","last_became_peered":"2024-09-14T10:49:23.395161+0000","last_unstale":"2024-09-14T12:44:24.667244+0000","last_undegraded":"2024-09-14T12:44:24.667244+0000","last_fullsized":"2024-09-14T12:44:24.667244+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-09-14T12:44:24.666983+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-09-14T12:44:24.666983+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.666983+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:27.684732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":8858,"num_write":1038,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'758","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.904506+0000","last_change":"2024-09-14T12:44:28.904506+0000","last_active":"2024-09-14T12:44:28.904506+0000","last_peered":"2024-09-14T12:44:28.904506+0000","last_clean":"2024-09-14T12:44:28.904506+0000","last_became_active":"2024-09-14T10:49:25.390167+0000","last_became_peered":"2024-09-14T10:49:25.390167+0000","last_unstale":"2024-09-14T12:44:28.904506+0000","last_undegraded":"2024-09-14T12:44:28.904506+0000","last_fullsized":"2024-09-14T12:44:28.904506+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'758","last_scrub_stamp":"2024-09-14T12:44:28.904302+0000","last_deep_scrub":"267'758","last_deep_scrub_stamp":"2024-09-14T12:44:28.904302+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.904302+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:02.551450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3780,"num_read_kb":3460,"num_write":968,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'367","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.819989+0000","last_change":"2024-09-14T12:44:17.819655+0000","last_active":"2024-09-14T12:44:17.819989+0000","last_peered":"2024-09-14T12:44:17.819989+0000","last_clean":"2024-09-14T12:44:17.819989+0000","last_became_active":"2024-09-14T10:49:23.374332+0000","last_became_peered":"2024-09-14T10:49:23.374332+0000","last_unstale":"2024-09-14T12:44:17.819989+0000","last_undegraded":"2024-09-14T12:44:17.819989+0000","last_fullsized":"2024-09-14T12:44:17.819989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'367","last_scrub_stamp":"2024-09-14T12:44:17.819331+0000","last_deep_scrub":"267'367","last_deep_scrub_stamp":"2024-09-14T12:44:17.819331+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.819331+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:05.848392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":1430,"num_write":1267,"num_write_kb":16611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'437","reported_seq":2059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.858194+0000","last_change":"2024-09-14T12:44:27.858045+0000","last_active":"2024-09-14T12:44:27.858194+0000","last_peered":"2024-09-14T12:44:27.858194+0000","last_clean":"2024-09-14T12:44:27.858194+0000","last_became_active":"2024-09-14T10:49:25.390444+0000","last_became_peered":"2024-09-14T10:49:25.390444+0000","last_unstale":"2024-09-14T12:44:27.858194+0000","last_undegraded":"2024-09-14T12:44:27.858194+0000","last_fullsized":"2024-09-14T12:44:27.858194+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'437","last_scrub_stamp":"2024-09-14T12:44:27.857854+0000","last_deep_scrub":"267'437","last_deep_scrub_stamp":"2024-09-14T12:44:27.857854+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.857854+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.672313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2280,"num_write":506,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'317","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.767469+0000","last_change":"2024-09-14T12:44:16.767469+0000","last_active":"2024-09-14T12:44:16.767469+0000","last_peered":"2024-09-14T12:44:16.767469+0000","last_clean":"2024-09-14T12:44:16.767469+0000","last_became_active":"2024-09-14T10:49:23.365007+0000","last_became_peered":"2024-09-14T10:49:23.365007+0000","last_unstale":"2024-09-14T12:44:16.767469+0000","last_undegraded":"2024-09-14T12:44:16.767469+0000","last_fullsized":"2024-09-14T12:44:16.767469+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-14T12:44:16.766978+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-14T12:44:16.766978+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.766978+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:13.735465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":40511,"num_write":1024,"num_write_kb":34103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'622","reported_seq":2500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.287191+0000","last_change":"2024-09-14T12:44:19.287191+0000","last_active":"2024-09-14T12:44:19.287191+0000","last_peered":"2024-09-14T12:44:19.287191+0000","last_clean":"2024-09-14T12:44:19.287191+0000","last_became_active":"2024-09-14T10:49:25.380751+0000","last_became_peered":"2024-09-14T10:49:25.380751+0000","last_unstale":"2024-09-14T12:44:19.287191+0000","last_undegraded":"2024-09-14T12:44:19.287191+0000","last_fullsized":"2024-09-14T12:44:19.287191+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'622","last_scrub_stamp":"2024-09-14T12:44:19.287009+0000","last_deep_scrub":"267'622","last_deep_scrub_stamp":"2024-09-14T12:44:19.287009+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.287009+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:57.547324+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3385,"num_read_kb":3142,"num_write":784,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2004,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'366","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.728428+0000","last_change":"2024-09-14T12:44:15.728259+0000","last_active":"2024-09-14T12:44:15.728428+0000","last_peered":"2024-09-14T12:44:15.728428+0000","last_clean":"2024-09-14T12:44:15.728428+0000","last_became_active":"2024-09-14T10:49:23.366946+0000","last_became_peered":"2024-09-14T10:49:23.366946+0000","last_unstale":"2024-09-14T12:44:15.728428+0000","last_undegraded":"2024-09-14T12:44:15.728428+0000","last_fullsized":"2024-09-14T12:44:15.728428+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-14T12:44:15.728035+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-14T12:44:15.728035+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.728035+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:18.238063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":15339,"num_write":1195,"num_write_kb":33762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'818","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.856250+0000","last_change":"2024-09-14T12:44:25.856250+0000","last_active":"2024-09-14T12:44:25.856250+0000","last_peered":"2024-09-14T12:44:25.856250+0000","last_clean":"2024-09-14T12:44:25.856250+0000","last_became_active":"2024-09-14T10:49:25.394994+0000","last_became_peered":"2024-09-14T10:49:25.394994+0000","last_unstale":"2024-09-14T12:44:25.856250+0000","last_undegraded":"2024-09-14T12:44:25.856250+0000","last_fullsized":"2024-09-14T12:44:25.856250+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-09-14T12:44:25.856059+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-09-14T12:44:25.856059+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.856059+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:11:53.081476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4031,"num_read_kb":3664,"num_write":1069,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'391","reported_seq":1249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.840145+0000","last_change":"2024-09-14T12:44:11.839965+0000","last_active":"2024-09-14T12:44:11.840145+0000","last_peered":"2024-09-14T12:44:11.840145+0000","last_clean":"2024-09-14T12:44:11.840145+0000","last_became_active":"2024-09-14T10:49:23.373080+0000","last_became_peered":"2024-09-14T10:49:23.373080+0000","last_unstale":"2024-09-14T12:44:11.840145+0000","last_undegraded":"2024-09-14T12:44:11.840145+0000","last_fullsized":"2024-09-14T12:44:11.840145+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:11.839750+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:11.839750+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.839750+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:46.935339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1418,"num_read_kb":12734,"num_write":1224,"num_write_kb":19451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'537","reported_seq":2281,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.973009+0000","last_change":"2024-09-14T12:44:16.973009+0000","last_active":"2024-09-14T12:44:16.973009+0000","last_peered":"2024-09-14T12:44:16.973009+0000","last_clean":"2024-09-14T12:44:16.973009+0000","last_became_active":"2024-09-14T10:49:25.375465+0000","last_became_peered":"2024-09-14T10:49:25.375465+0000","last_unstale":"2024-09-14T12:44:16.973009+0000","last_undegraded":"2024-09-14T12:44:16.973009+0000","last_fullsized":"2024-09-14T12:44:16.973009+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'537","last_scrub_stamp":"2024-09-14T12:44:16.972830+0000","last_deep_scrub":"267'537","last_deep_scrub_stamp":"2024-09-14T12:44:16.972830+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.972830+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:54.021748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2646,"num_write":644,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'334","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.846014+0000","last_change":"2024-09-14T12:44:18.846014+0000","last_active":"2024-09-14T12:44:18.846014+0000","last_peered":"2024-09-14T12:44:18.846014+0000","last_clean":"2024-09-14T12:44:18.846014+0000","last_became_active":"2024-09-14T10:49:23.377964+0000","last_became_peered":"2024-09-14T10:49:23.377964+0000","last_unstale":"2024-09-14T12:44:18.846014+0000","last_undegraded":"2024-09-14T12:44:18.846014+0000","last_fullsized":"2024-09-14T12:44:18.846014+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-09-14T12:44:18.845792+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-09-14T12:44:18.845792+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.845792+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:26.978554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":579,"num_read_kb":6819,"num_write":1090,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'855","reported_seq":2417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.520037+0000","last_change":"2024-09-14T12:44:22.520037+0000","last_active":"2024-09-14T12:44:22.520037+0000","last_peered":"2024-09-14T12:44:22.520037+0000","last_clean":"2024-09-14T12:44:22.520037+0000","last_became_active":"2024-09-14T10:49:25.386541+0000","last_became_peered":"2024-09-14T10:49:25.386541+0000","last_unstale":"2024-09-14T12:44:22.520037+0000","last_undegraded":"2024-09-14T12:44:22.520037+0000","last_fullsized":"2024-09-14T12:44:22.520037+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'855","last_scrub_stamp":"2024-09-14T12:44:22.519854+0000","last_deep_scrub":"267'855","last_deep_scrub_stamp":"2024-09-14T12:44:22.519854+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.519854+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:12.468305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3987,"num_read_kb":3560,"num_write":1145,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'399","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.638936+0000","last_change":"2024-09-14T12:44:22.638936+0000","last_active":"2024-09-14T12:44:22.638936+0000","last_peered":"2024-09-14T12:44:22.638936+0000","last_clean":"2024-09-14T12:44:22.638936+0000","last_became_active":"2024-09-14T10:49:23.387245+0000","last_became_peered":"2024-09-14T10:49:23.387245+0000","last_unstale":"2024-09-14T12:44:22.638936+0000","last_undegraded":"2024-09-14T12:44:22.638936+0000","last_fullsized":"2024-09-14T12:44:22.638936+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-14T12:44:22.638724+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-14T12:44:22.638724+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.638724+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:48.167793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":46181,"num_write":1283,"num_write_kb":35513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'851","reported_seq":2622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.131143+0000","last_change":"2024-09-14T12:44:23.131143+0000","last_active":"2024-09-14T12:44:23.131143+0000","last_peered":"2024-09-14T12:44:23.131143+0000","last_clean":"2024-09-14T12:44:23.131143+0000","last_became_active":"2024-09-14T10:49:25.373511+0000","last_became_peered":"2024-09-14T10:49:25.373511+0000","last_unstale":"2024-09-14T12:44:23.131143+0000","last_undegraded":"2024-09-14T12:44:23.131143+0000","last_fullsized":"2024-09-14T12:44:23.131143+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-14T12:44:23.130952+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-14T12:44:23.130952+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.130952+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:53.058385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4179,"num_read_kb":3797,"num_write":1119,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'377","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.860583+0000","last_change":"2024-09-14T12:44:19.860583+0000","last_active":"2024-09-14T12:44:19.860583+0000","last_peered":"2024-09-14T12:44:19.860583+0000","last_clean":"2024-09-14T12:44:19.860583+0000","last_became_active":"2024-09-14T10:49:23.377218+0000","last_became_peered":"2024-09-14T10:49:23.377218+0000","last_unstale":"2024-09-14T12:44:19.860583+0000","last_undegraded":"2024-09-14T12:44:19.860583+0000","last_fullsized":"2024-09-14T12:44:19.860583+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-09-14T12:44:19.860120+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-09-14T12:44:19.860120+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.860120+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:24.595003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5360649,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":652,"num_read_kb":6958,"num_write":1198,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'524","reported_seq":2129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:23.731901+0000","last_change":"2024-09-14T10:49:25.395953+0000","last_active":"2024-09-14T12:41:23.731901+0000","last_peered":"2024-09-14T12:41:23.731901+0000","last_clean":"2024-09-14T12:41:23.731901+0000","last_became_active":"2024-09-14T10:49:25.394237+0000","last_became_peered":"2024-09-14T10:49:25.394237+0000","last_unstale":"2024-09-14T12:41:23.731901+0000","last_undegraded":"2024-09-14T12:41:23.731901+0000","last_fullsized":"2024-09-14T12:41:23.731901+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:24.332280+0000","last_clean_scrub_stamp":"2024-09-14T10:49:24.332280+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:13.449753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2610,"num_write":682,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'385","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.937989+0000","last_change":"2024-09-14T12:44:13.937989+0000","last_active":"2024-09-14T12:44:13.937989+0000","last_peered":"2024-09-14T12:44:13.937989+0000","last_clean":"2024-09-14T12:44:13.937989+0000","last_became_active":"2024-09-14T10:49:23.371845+0000","last_became_peered":"2024-09-14T10:49:23.371845+0000","last_unstale":"2024-09-14T12:44:13.937989+0000","last_undegraded":"2024-09-14T12:44:13.937989+0000","last_fullsized":"2024-09-14T12:44:13.937989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-14T12:44:13.937713+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-14T12:44:13.937713+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.937713+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.516351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":30325,"num_write":1182,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'407","reported_seq":1837,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.949255+0000","last_change":"2024-09-14T12:44:18.949255+0000","last_active":"2024-09-14T12:44:18.949255+0000","last_peered":"2024-09-14T12:44:18.949255+0000","last_clean":"2024-09-14T12:44:18.949255+0000","last_became_active":"2024-09-14T10:49:25.375374+0000","last_became_peered":"2024-09-14T10:49:25.375374+0000","last_unstale":"2024-09-14T12:44:18.949255+0000","last_undegraded":"2024-09-14T12:44:18.949255+0000","last_fullsized":"2024-09-14T12:44:18.949255+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-14T12:44:18.949068+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-14T12:44:18.949068+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.949068+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:26.275108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2030,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'390","reported_seq":1123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.807384+0000","last_change":"2024-09-14T12:44:17.807384+0000","last_active":"2024-09-14T12:44:17.807384+0000","last_peered":"2024-09-14T12:44:17.807384+0000","last_clean":"2024-09-14T12:44:17.807384+0000","last_became_active":"2024-09-14T10:49:23.371987+0000","last_became_peered":"2024-09-14T10:49:23.371987+0000","last_unstale":"2024-09-14T12:44:17.807384+0000","last_undegraded":"2024-09-14T12:44:17.807384+0000","last_fullsized":"2024-09-14T12:44:17.807384+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-09-14T12:44:17.807136+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-09-14T12:44:17.807136+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.807136+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:11.677728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":722,"num_read_kb":54432,"num_write":1171,"num_write_kb":38478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'768","reported_seq":2328,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.970413+0000","last_change":"2024-09-14T12:44:17.970413+0000","last_active":"2024-09-14T12:44:17.970413+0000","last_peered":"2024-09-14T12:44:17.970413+0000","last_clean":"2024-09-14T12:44:17.970413+0000","last_became_active":"2024-09-14T10:49:25.404302+0000","last_became_peered":"2024-09-14T10:49:25.404302+0000","last_unstale":"2024-09-14T12:44:17.970413+0000","last_undegraded":"2024-09-14T12:44:17.970413+0000","last_fullsized":"2024-09-14T12:44:17.970413+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'768","last_scrub_stamp":"2024-09-14T12:44:17.970223+0000","last_deep_scrub":"267'768","last_deep_scrub_stamp":"2024-09-14T12:44:17.970223+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.970223+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:07.913253+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3673,"num_read_kb":3318,"num_write":995,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'392","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.355966+0000","last_change":"2024-09-14T12:44:11.355966+0000","last_active":"2024-09-14T12:44:11.355966+0000","last_peered":"2024-09-14T12:44:11.355966+0000","last_clean":"2024-09-14T12:44:11.355966+0000","last_became_active":"2024-09-14T10:49:23.372362+0000","last_became_peered":"2024-09-14T10:49:23.372362+0000","last_unstale":"2024-09-14T12:44:11.355966+0000","last_undegraded":"2024-09-14T12:44:11.355966+0000","last_fullsized":"2024-09-14T12:44:11.355966+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-14T12:44:11.355879+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-14T12:44:11.355879+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.355879+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:43.785705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":10747,"num_write":1199,"num_write_kb":31883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"267'889","reported_seq":2547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.471116+0000","last_change":"2024-09-14T12:44:23.471116+0000","last_active":"2024-09-14T12:44:23.471116+0000","last_peered":"2024-09-14T12:44:23.471116+0000","last_clean":"2024-09-14T12:44:23.471116+0000","last_became_active":"2024-09-14T10:49:25.378231+0000","last_became_peered":"2024-09-14T10:49:25.378231+0000","last_unstale":"2024-09-14T12:44:23.471116+0000","last_undegraded":"2024-09-14T12:44:23.471116+0000","last_fullsized":"2024-09-14T12:44:23.471116+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'889","last_scrub_stamp":"2024-09-14T12:44:23.470931+0000","last_deep_scrub":"267'889","last_deep_scrub_stamp":"2024-09-14T12:44:23.470931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.470931+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:44.766183+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4260,"num_read_kb":3817,"num_write":1188,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'382","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.687570+0000","last_change":"2024-09-14T12:44:23.687320+0000","last_active":"2024-09-14T12:44:23.687570+0000","last_peered":"2024-09-14T12:44:23.687570+0000","last_clean":"2024-09-14T12:44:23.687570+0000","last_became_active":"2024-09-14T10:49:23.396179+0000","last_became_peered":"2024-09-14T10:49:23.396179+0000","last_unstale":"2024-09-14T12:44:23.687570+0000","last_undegraded":"2024-09-14T12:44:23.687570+0000","last_fullsized":"2024-09-14T12:44:23.687570+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:23.686889+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:23.686889+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.686889+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:10.063554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1034,"num_read_kb":35151,"num_write":1252,"num_write_kb":27361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'453","reported_seq":1998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.835269+0000","last_change":"2024-09-14T12:44:24.835269+0000","last_active":"2024-09-14T12:44:24.835269+0000","last_peered":"2024-09-14T12:44:24.835269+0000","last_clean":"2024-09-14T12:44:24.835269+0000","last_became_active":"2024-09-14T10:49:25.386602+0000","last_became_peered":"2024-09-14T10:49:25.386602+0000","last_unstale":"2024-09-14T12:44:24.835269+0000","last_undegraded":"2024-09-14T12:44:24.835269+0000","last_fullsized":"2024-09-14T12:44:24.835269+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'453","last_scrub_stamp":"2024-09-14T12:44:24.835090+0000","last_deep_scrub":"267'453","last_deep_scrub_stamp":"2024-09-14T12:44:24.835090+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.835090+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:19:05.573525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2532,"num_read_kb":2369,"num_write":580,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'365","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.600332+0000","last_change":"2024-09-14T12:44:14.600332+0000","last_active":"2024-09-14T12:44:14.600332+0000","last_peered":"2024-09-14T12:44:14.600332+0000","last_clean":"2024-09-14T12:44:14.600332+0000","last_became_active":"2024-09-14T10:49:23.369989+0000","last_became_peered":"2024-09-14T10:49:23.369989+0000","last_unstale":"2024-09-14T12:44:14.600332+0000","last_undegraded":"2024-09-14T12:44:14.600332+0000","last_fullsized":"2024-09-14T12:44:14.600332+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-14T12:44:14.600114+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-14T12:44:14.600114+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.600114+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.010341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":696,"num_read_kb":14222,"num_write":1159,"num_write_kb":28974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'1267","reported_seq":2971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.985004+0000","last_change":"2024-09-14T12:44:19.985004+0000","last_active":"2024-09-14T12:44:19.985004+0000","last_peered":"2024-09-14T12:44:19.985004+0000","last_clean":"2024-09-14T12:44:19.985004+0000","last_became_active":"2024-09-14T10:49:25.407817+0000","last_became_peered":"2024-09-14T10:49:25.407817+0000","last_unstale":"2024-09-14T12:44:19.985004+0000","last_undegraded":"2024-09-14T12:44:19.985004+0000","last_fullsized":"2024-09-14T12:44:19.985004+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1267","last_scrub_stamp":"2024-09-14T12:44:19.984761+0000","last_deep_scrub":"267'1267","last_deep_scrub_stamp":"2024-09-14T12:44:19.984761+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.984761+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":1200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:38.185470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5850,"num_read_kb":5153,"num_write":1753,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'378","reported_seq":1136,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.941687+0000","last_change":"2024-09-14T10:49:23.366572+0000","last_active":"2024-09-14T12:44:04.941687+0000","last_peered":"2024-09-14T12:44:04.941687+0000","last_clean":"2024-09-14T12:44:04.941687+0000","last_became_active":"2024-09-14T10:49:23.365975+0000","last_became_peered":"2024-09-14T10:49:23.365975+0000","last_unstale":"2024-09-14T12:44:04.941687+0000","last_undegraded":"2024-09-14T12:44:04.941687+0000","last_fullsized":"2024-09-14T12:44:04.941687+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:22.301758+0000","last_clean_scrub_stamp":"2024-09-14T10:49:22.301758+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:46.697172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":962,"num_read_kb":99658,"num_write":1167,"num_write_kb":35935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'346","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.701550+0000","last_change":"2024-09-14T12:44:25.701550+0000","last_active":"2024-09-14T12:44:25.701550+0000","last_peered":"2024-09-14T12:44:25.701550+0000","last_clean":"2024-09-14T12:44:25.701550+0000","last_became_active":"2024-09-14T10:49:23.373652+0000","last_became_peered":"2024-09-14T10:49:23.373652+0000","last_unstale":"2024-09-14T12:44:25.701550+0000","last_undegraded":"2024-09-14T12:44:25.701550+0000","last_fullsized":"2024-09-14T12:44:25.701550+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-14T12:44:25.701274+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-14T12:44:25.701274+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.701274+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:04.194083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":808,"num_write":1082,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'430","reported_seq":2032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.803698+0000","last_change":"2024-09-14T12:44:25.803698+0000","last_active":"2024-09-14T12:44:25.803698+0000","last_peered":"2024-09-14T12:44:25.803698+0000","last_clean":"2024-09-14T12:44:25.803698+0000","last_became_active":"2024-09-14T10:49:25.399830+0000","last_became_peered":"2024-09-14T10:49:25.399830+0000","last_unstale":"2024-09-14T12:44:25.803698+0000","last_undegraded":"2024-09-14T12:44:25.803698+0000","last_fullsized":"2024-09-14T12:44:25.803698+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-14T12:44:25.803503+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-14T12:44:25.803503+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.803503+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:00.772915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2288,"num_read_kb":2174,"num_write":485,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'357","reported_seq":1117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.812240+0000","last_change":"2024-09-14T12:44:20.812240+0000","last_active":"2024-09-14T12:44:20.812240+0000","last_peered":"2024-09-14T12:44:20.812240+0000","last_clean":"2024-09-14T12:44:20.812240+0000","last_became_active":"2024-09-14T10:49:23.382302+0000","last_became_peered":"2024-09-14T10:49:23.382302+0000","last_unstale":"2024-09-14T12:44:20.812240+0000","last_undegraded":"2024-09-14T12:44:20.812240+0000","last_fullsized":"2024-09-14T12:44:20.812240+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-14T12:44:20.812034+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-14T12:44:20.812034+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.812034+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:33.756604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":853,"num_read_kb":33665,"num_write":1061,"num_write_kb":42742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'434","reported_seq":2115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.047241+0000","last_change":"2024-09-14T12:44:25.047241+0000","last_active":"2024-09-14T12:44:25.047241+0000","last_peered":"2024-09-14T12:44:25.047241+0000","last_clean":"2024-09-14T12:44:25.047241+0000","last_became_active":"2024-09-14T10:49:25.391680+0000","last_became_peered":"2024-09-14T10:49:25.391680+0000","last_unstale":"2024-09-14T12:44:25.047241+0000","last_undegraded":"2024-09-14T12:44:25.047241+0000","last_fullsized":"2024-09-14T12:44:25.047241+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T12:44:25.047002+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T12:44:25.047002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.047002+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:34.093527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2427,"num_read_kb":2321,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10880,"num_read_kb":8996,"num_write":3119,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15325,"num_read_kb":14960,"num_write":17100,"num_write_kb":5007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":570,"ondisk_log_size":570,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637897,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":21147,"num_read_kb":41034,"num_write":17727,"num_write_kb":12782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":566642,"num_omap_keys":1292,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1904,"ondisk_log_size":1904,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221603,"num_read_kb":202842,"num_write":56199,"num_write_kb":19273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31646,"num_omap_keys":127,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3715,"ondisk_log_size":3715,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42369360,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44646,"num_read_kb":1985232,"num_write":73593,"num_write_kb":2196624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58359808,"data_stored":58359808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3987,"ondisk_log_size":3987,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":168154,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":167578,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510832,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116940,"kb_used_data":9404,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94254900,"statfs":{"total":96636764160,"available":96517017600,"internally_reserved":0,"allocated":9629696,"data_stored":7595829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510831,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281608,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94090232,"statfs":{"total":96636764160,"available":96348397568,"internally_reserved":0,"allocated":11919360,"data_stored":9909527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510834,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225296,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146544,"statfs":{"total":96636764160,"available":96406061056,"internally_reserved":0,"allocated":9764864,"data_stored":7751439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510834,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259172,"kb_used_data":11412,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94112668,"statfs":{"total":96636764160,"available":96371372032,"internally_reserved":0,"allocated":11685888,"data_stored":9655008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510833,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201292,"kb_used_data":13244,"kb_used_omap":1,"kb_used_meta":188030,"kb_avail":94170548,"statfs":{"total":96636764160,"available":96430641152,"internally_reserved":0,"allocated":13561856,"data_stored":11555946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":192543173},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510831,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339320,"kb_used_data":11048,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94032520,"statfs":{"total":96636764160,"available":96289300480,"internally_reserved":0,"allocated":11313152,"data_stored":9301608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510832,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138204,"kb_used_data":12620,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94233636,"statfs":{"total":96636764160,"available":96495243264,"internally_reserved":0,"allocated":12922880,"data_stored":10866139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543538,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242192,"kb_used_data":12544,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94129648,"statfs":{"total":96636764160,"available":96388759552,"internally_reserved":0,"allocated":12845056,"data_stored":10838842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235141578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8622080,"data_stored":8622080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6471680,"data_stored":6471680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9314304,"data_stored":9314304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7413760,"data_stored":7413760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5509120,"data_stored":5509120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7077888,"data_stored":7077888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5353472,"data_stored":5353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8597504,"data_stored":8597504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:44:33.188 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.188 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.188 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.188 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.188 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.189 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.189 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.189 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.189 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.189 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.189 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.189 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.189 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.190 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.190 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.190 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.190 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.190 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.190 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.190 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.190 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.191 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.191 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.191 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.191 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.191 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.191 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.191 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.191 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.192 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.192 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.192 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.192 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.192 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.192 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.192 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.192 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.193 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.194 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.195 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.196 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.196 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.196 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.196 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.196 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.196 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.196 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.196 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.197 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.197 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.197 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.197 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.197 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.197 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.197 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.197 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.198 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.199 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.199 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.199 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.199 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.199 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.199 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.199 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.199 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.200 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.201 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.201 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.201 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.201 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.201 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.201 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.201 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.201 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.202 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.202 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.202 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.202 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.202 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.202 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.202 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.202 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.203 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.203 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.203 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.203 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.203 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.203 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.203 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.203 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.204 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.204 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.204 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.204 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.204 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.204 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.205 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.205 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.205 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.205 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.205 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.205 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.205 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.205 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.206 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.207 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.207 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.207 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.207 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.207 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.207 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.207 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.207 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.208 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.208 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.208 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.208 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.208 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.208 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.208 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.208 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.209 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.209 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.209 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.209 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.209 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.209 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.209 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.210 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.210 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.210 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.210 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.210 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.210 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.210 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.210 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.211 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.211 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.211 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.211 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.211 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.211 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.211 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.212 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.212 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.212 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.212 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.212 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.212 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.212 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.213 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.213 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.213 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.213 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.213 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.213 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.213 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.213 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.214 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.214 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.214 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.214 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.214 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.214 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.214 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.214 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.215 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.215 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.215 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.215 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.215 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.215 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.215 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.215 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.216 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.216 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.216 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.216 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.216 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.216 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.216 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.216 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.217 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.217 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.217 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.217 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.217 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.217 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.217 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.217 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.218 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.218 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:49:26.344101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.218 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:49:28.350220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.218 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.218 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.218 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.218 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:49:24.332280+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.219 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:49:22.301758+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:33.219 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:44:53.220 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:44:53.574 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:44:53.590 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T12:44:53.592 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":3735,"stamp":"2024-09-14T12:44:53.179310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44615192,"num_objects":748,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":316434,"num_read_kb":2591763,"num_write":168253,"num_write_kb":2487517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":754895,"num_omap_keys":1804,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13295,"ondisk_log_size":13295,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1826232,"kb_used_data":91448,"kb_used_omap":12,"kb_used_meta":1734643,"kb_avail":753148488,"statfs":{"total":773094113280,"available":771224051712,"internally_reserved":0,"allocated":93642752,"data_stored":77474338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1776274992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":122598,"num_omap_keys":301,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009494"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.061396+0000","last_change":"2024-09-14T12:44:49.061396+0000","last_active":"2024-09-14T12:44:49.061396+0000","last_peered":"2024-09-14T12:44:49.061396+0000","last_clean":"2024-09-14T12:44:49.061396+0000","last_became_active":"2024-09-14T11:40:08.951795+0000","last_became_peered":"2024-09-14T11:40:08.951795+0000","last_unstale":"2024-09-14T12:44:49.061396+0000","last_undegraded":"2024-09-14T12:44:49.061396+0000","last_fullsized":"2024-09-14T12:44:49.061396+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.061231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.061231+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.061231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:09.033750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.966635+0000","last_change":"2024-09-14T12:44:46.966635+0000","last_active":"2024-09-14T12:44:46.966635+0000","last_peered":"2024-09-14T12:44:46.966635+0000","last_clean":"2024-09-14T12:44:46.966635+0000","last_became_active":"2024-09-14T11:12:26.251656+0000","last_became_peered":"2024-09-14T11:12:26.251656+0000","last_unstale":"2024-09-14T12:44:46.966635+0000","last_undegraded":"2024-09-14T12:44:46.966635+0000","last_fullsized":"2024-09-14T12:44:46.966635+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.966463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.966463+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.966463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.298507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.391220+0000","last_change":"2024-09-14T12:44:49.390972+0000","last_active":"2024-09-14T12:44:49.391220+0000","last_peered":"2024-09-14T12:44:49.391220+0000","last_clean":"2024-09-14T12:44:49.391220+0000","last_became_active":"2024-09-14T11:12:19.108050+0000","last_became_peered":"2024-09-14T11:12:19.108050+0000","last_unstale":"2024-09-14T12:44:49.391220+0000","last_undegraded":"2024-09-14T12:44:49.391220+0000","last_fullsized":"2024-09-14T12:44:49.391220+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:49.390668+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:49.390668+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.390668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.745726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'28","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:20.593684+0000","last_change":"2024-09-14T11:06:29.522001+0000","last_active":"2024-09-14T12:42:20.593684+0000","last_peered":"2024-09-14T12:42:20.593684+0000","last_clean":"2024-09-14T12:42:20.593684+0000","last_became_active":"2024-09-14T11:06:29.521269+0000","last_became_peered":"2024-09-14T11:06:29.521269+0000","last_unstale":"2024-09-14T12:42:20.593684+0000","last_undegraded":"2024-09-14T12:42:20.593684+0000","last_fullsized":"2024-09-14T12:42:20.593684+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":165,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.537448+0000","last_change":"2024-09-14T11:40:08.947504+0000","last_active":"2024-09-14T12:40:11.537448+0000","last_peered":"2024-09-14T12:40:11.537448+0000","last_clean":"2024-09-14T12:40:11.537448+0000","last_became_active":"2024-09-14T11:40:08.946878+0000","last_became_peered":"2024-09-14T11:40:08.946878+0000","last_unstale":"2024-09-14T12:40:11.537448+0000","last_undegraded":"2024-09-14T12:40:11.537448+0000","last_fullsized":"2024-09-14T12:40:11.537448+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:13.424208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.940877+0000","last_change":"2024-09-14T12:44:50.940877+0000","last_active":"2024-09-14T12:44:50.940877+0000","last_peered":"2024-09-14T12:44:50.940877+0000","last_clean":"2024-09-14T12:44:50.940877+0000","last_became_active":"2024-09-14T11:12:26.251518+0000","last_became_peered":"2024-09-14T11:12:26.251518+0000","last_unstale":"2024-09-14T12:44:50.940877+0000","last_undegraded":"2024-09-14T12:44:50.940877+0000","last_fullsized":"2024-09-14T12:44:50.940877+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T12:44:50.940699+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T12:44:50.940699+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.940699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:49.749243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:20.366382+0000","last_change":"2024-09-14T11:12:19.078874+0000","last_active":"2024-09-14T12:42:20.366382+0000","last_peered":"2024-09-14T12:42:20.366382+0000","last_clean":"2024-09-14T12:42:20.366382+0000","last_became_active":"2024-09-14T11:12:19.078164+0000","last_became_peered":"2024-09-14T11:12:19.078164+0000","last_unstale":"2024-09-14T12:42:20.366382+0000","last_undegraded":"2024-09-14T12:42:20.366382+0000","last_fullsized":"2024-09-14T12:42:20.366382+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'14","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.573976+0000","last_change":"2024-09-14T11:06:29.539883+0000","last_active":"2024-09-14T12:40:55.573976+0000","last_peered":"2024-09-14T12:40:55.573976+0000","last_clean":"2024-09-14T12:40:55.573976+0000","last_became_active":"2024-09-14T11:06:29.538616+0000","last_became_peered":"2024-09-14T11:06:29.538616+0000","last_unstale":"2024-09-14T12:40:55.573976+0000","last_undegraded":"2024-09-14T12:40:55.573976+0000","last_fullsized":"2024-09-14T12:40:55.573976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:48.502785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":63,"num_write":44,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.913175+0000","last_change":"2024-09-14T12:44:49.913175+0000","last_active":"2024-09-14T12:44:49.913175+0000","last_peered":"2024-09-14T12:44:49.913175+0000","last_clean":"2024-09-14T12:44:49.913175+0000","last_became_active":"2024-09-14T11:40:08.942721+0000","last_became_peered":"2024-09-14T11:40:08.942721+0000","last_unstale":"2024-09-14T12:44:49.913175+0000","last_undegraded":"2024-09-14T12:44:49.913175+0000","last_fullsized":"2024-09-14T12:44:49.913175+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.912990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.912990+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.912990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:51.708919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:00.361403+0000","last_change":"2024-09-14T11:12:26.228979+0000","last_active":"2024-09-14T12:42:00.361403+0000","last_peered":"2024-09-14T12:42:00.361403+0000","last_clean":"2024-09-14T12:42:00.361403+0000","last_became_active":"2024-09-14T11:12:26.228172+0000","last_became_peered":"2024-09-14T11:12:26.228172+0000","last_unstale":"2024-09-14T12:42:00.361403+0000","last_undegraded":"2024-09-14T12:42:00.361403+0000","last_fullsized":"2024-09-14T12:42:00.361403+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:34.390438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"267'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.208919+0000","last_change":"2024-09-14T11:12:19.111973+0000","last_active":"2024-09-14T12:44:02.208919+0000","last_peered":"2024-09-14T12:44:02.208919+0000","last_clean":"2024-09-14T12:44:02.208919+0000","last_became_active":"2024-09-14T11:12:19.110542+0000","last_became_peered":"2024-09-14T11:12:19.110542+0000","last_unstale":"2024-09-14T12:44:02.208919+0000","last_undegraded":"2024-09-14T12:44:02.208919+0000","last_fullsized":"2024-09-14T12:44:02.208919+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'37","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.787831+0000","last_change":"2024-09-14T12:44:46.787831+0000","last_active":"2024-09-14T12:44:46.787831+0000","last_peered":"2024-09-14T12:44:46.787831+0000","last_clean":"2024-09-14T12:44:46.787831+0000","last_became_active":"2024-09-14T11:06:29.531655+0000","last_became_peered":"2024-09-14T11:06:29.531655+0000","last_unstale":"2024-09-14T12:44:46.787831+0000","last_undegraded":"2024-09-14T12:44:46.787831+0000","last_fullsized":"2024-09-14T12:44:46.787831+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-09-14T12:44:46.787606+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-09-14T12:44:46.787606+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.787606+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:04.426417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":194,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563239+0000","last_change":"2024-09-14T11:40:08.940194+0000","last_active":"2024-09-14T12:40:50.563239+0000","last_peered":"2024-09-14T12:40:50.563239+0000","last_clean":"2024-09-14T12:40:50.563239+0000","last_became_active":"2024-09-14T11:40:08.939509+0000","last_became_peered":"2024-09-14T11:40:08.939509+0000","last_unstale":"2024-09-14T12:40:50.563239+0000","last_undegraded":"2024-09-14T12:40:50.563239+0000","last_fullsized":"2024-09-14T12:40:50.563239+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:14.099727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'7","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.560986+0000","last_change":"2024-09-14T11:12:26.231260+0000","last_active":"2024-09-14T12:44:04.560986+0000","last_peered":"2024-09-14T12:44:04.560986+0000","last_clean":"2024-09-14T12:44:04.560986+0000","last_became_active":"2024-09-14T11:12:26.230403+0000","last_became_peered":"2024-09-14T11:12:26.230403+0000","last_unstale":"2024-09-14T12:44:04.560986+0000","last_undegraded":"2024-09-14T12:44:04.560986+0000","last_fullsized":"2024-09-14T12:44:04.560986+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7282,"num_write":12,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.956468+0000","last_change":"2024-09-14T12:44:45.956468+0000","last_active":"2024-09-14T12:44:45.956468+0000","last_peered":"2024-09-14T12:44:45.956468+0000","last_clean":"2024-09-14T12:44:45.956468+0000","last_became_active":"2024-09-14T11:12:19.105062+0000","last_became_peered":"2024-09-14T11:12:19.105062+0000","last_unstale":"2024-09-14T12:44:45.956468+0000","last_undegraded":"2024-09-14T12:44:45.956468+0000","last_fullsized":"2024-09-14T12:44:45.956468+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:45.956287+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:45.956287+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.956287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:26.856074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'12","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.795373+0000","last_change":"2024-09-14T12:44:45.795373+0000","last_active":"2024-09-14T12:44:45.795373+0000","last_peered":"2024-09-14T12:44:45.795373+0000","last_clean":"2024-09-14T12:44:45.795373+0000","last_became_active":"2024-09-14T11:06:29.509556+0000","last_became_peered":"2024-09-14T11:06:29.509556+0000","last_unstale":"2024-09-14T12:44:45.795373+0000","last_undegraded":"2024-09-14T12:44:45.795373+0000","last_fullsized":"2024-09-14T12:44:45.795373+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T12:44:45.795160+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T12:44:45.795160+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.795160+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:53.237709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:19.766089+0000","last_change":"2024-09-14T11:40:08.932176+0000","last_active":"2024-09-14T12:42:19.766089+0000","last_peered":"2024-09-14T12:42:19.766089+0000","last_clean":"2024-09-14T12:42:19.766089+0000","last_became_active":"2024-09-14T11:40:08.927702+0000","last_became_peered":"2024-09-14T11:40:08.927702+0000","last_unstale":"2024-09-14T12:42:19.766089+0000","last_undegraded":"2024-09-14T12:42:19.766089+0000","last_fullsized":"2024-09-14T12:42:19.766089+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.116492+0000","last_change":"2024-09-14T12:44:43.116492+0000","last_active":"2024-09-14T12:44:43.116492+0000","last_peered":"2024-09-14T12:44:43.116492+0000","last_clean":"2024-09-14T12:44:43.116492+0000","last_became_active":"2024-09-14T11:12:26.218925+0000","last_became_peered":"2024-09-14T11:12:26.218925+0000","last_unstale":"2024-09-14T12:44:43.116492+0000","last_undegraded":"2024-09-14T12:44:43.116492+0000","last_fullsized":"2024-09-14T12:44:43.116492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.116288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.116288+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.116288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:25.426487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"267'4","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.064367+0000","last_change":"2024-09-14T11:12:19.111180+0000","last_active":"2024-09-14T12:44:04.064367+0000","last_peered":"2024-09-14T12:44:04.064367+0000","last_clean":"2024-09-14T12:44:04.064367+0000","last_became_active":"2024-09-14T11:12:19.110528+0000","last_became_peered":"2024-09-14T11:12:19.110528+0000","last_unstale":"2024-09-14T12:44:04.064367+0000","last_undegraded":"2024-09-14T12:44:04.064367+0000","last_fullsized":"2024-09-14T12:44:04.064367+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:53.395221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'15","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.794541+0000","last_change":"2024-09-14T12:44:44.794541+0000","last_active":"2024-09-14T12:44:44.794541+0000","last_peered":"2024-09-14T12:44:44.794541+0000","last_clean":"2024-09-14T12:44:44.794541+0000","last_became_active":"2024-09-14T11:06:29.538597+0000","last_became_peered":"2024-09-14T11:06:29.538597+0000","last_unstale":"2024-09-14T12:44:44.794541+0000","last_undegraded":"2024-09-14T12:44:44.794541+0000","last_fullsized":"2024-09-14T12:44:44.794541+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T12:44:44.794358+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T12:44:44.794358+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.794358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:00.653289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:40.598148+0000","last_change":"2024-09-14T11:40:08.925877+0000","last_active":"2024-09-14T12:42:40.598148+0000","last_peered":"2024-09-14T12:42:40.598148+0000","last_clean":"2024-09-14T12:42:40.598148+0000","last_became_active":"2024-09-14T11:40:08.924934+0000","last_became_peered":"2024-09-14T11:40:08.924934+0000","last_unstale":"2024-09-14T12:42:40.598148+0000","last_undegraded":"2024-09-14T12:42:40.598148+0000","last_fullsized":"2024-09-14T12:42:40.598148+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.502951+0000","last_change":"2024-09-14T11:12:26.246400+0000","last_active":"2024-09-14T12:41:51.502951+0000","last_peered":"2024-09-14T12:41:51.502951+0000","last_clean":"2024-09-14T12:41:51.502951+0000","last_became_active":"2024-09-14T11:12:26.245890+0000","last_became_peered":"2024-09-14T11:12:26.245890+0000","last_unstale":"2024-09-14T12:41:51.502951+0000","last_undegraded":"2024-09-14T12:41:51.502951+0000","last_fullsized":"2024-09-14T12:41:51.502951+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:01.506139+0000","last_change":"2024-09-14T11:12:19.109400+0000","last_active":"2024-09-14T12:42:01.506139+0000","last_peered":"2024-09-14T12:42:01.506139+0000","last_clean":"2024-09-14T12:42:01.506139+0000","last_became_active":"2024-09-14T11:12:19.108158+0000","last_became_peered":"2024-09-14T11:12:19.108158+0000","last_unstale":"2024-09-14T12:42:01.506139+0000","last_undegraded":"2024-09-14T12:42:01.506139+0000","last_fullsized":"2024-09-14T12:42:01.506139+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'13","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.955336+0000","last_change":"2024-09-14T12:44:39.955336+0000","last_active":"2024-09-14T12:44:39.955336+0000","last_peered":"2024-09-14T12:44:39.955336+0000","last_clean":"2024-09-14T12:44:39.955336+0000","last_became_active":"2024-09-14T11:06:29.525271+0000","last_became_peered":"2024-09-14T11:06:29.525271+0000","last_unstale":"2024-09-14T12:44:39.955336+0000","last_undegraded":"2024-09-14T12:44:39.955336+0000","last_fullsized":"2024-09-14T12:44:39.955336+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T12:44:39.955145+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T12:44:39.955145+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.955145+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:17.903750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:11.145918+0000","last_change":"2024-09-14T11:40:08.929934+0000","last_active":"2024-09-14T12:40:11.145918+0000","last_peered":"2024-09-14T12:40:11.145918+0000","last_clean":"2024-09-14T12:40:11.145918+0000","last_became_active":"2024-09-14T11:40:08.928406+0000","last_became_peered":"2024-09-14T11:40:08.928406+0000","last_unstale":"2024-09-14T12:40:11.145918+0000","last_undegraded":"2024-09-14T12:40:11.145918+0000","last_fullsized":"2024-09-14T12:40:11.145918+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:59.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.890960+0000","last_change":"2024-09-14T12:44:49.890960+0000","last_active":"2024-09-14T12:44:49.890960+0000","last_peered":"2024-09-14T12:44:49.890960+0000","last_clean":"2024-09-14T12:44:49.890960+0000","last_became_active":"2024-09-14T11:12:26.241189+0000","last_became_peered":"2024-09-14T11:12:26.241189+0000","last_unstale":"2024-09-14T12:44:49.890960+0000","last_undegraded":"2024-09-14T12:44:49.890960+0000","last_fullsized":"2024-09-14T12:44:49.890960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.890785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.890785+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.890785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:48.122625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.098700+0000","last_change":"2024-09-14T12:44:39.098574+0000","last_active":"2024-09-14T12:44:39.098700+0000","last_peered":"2024-09-14T12:44:39.098700+0000","last_clean":"2024-09-14T12:44:39.098700+0000","last_became_active":"2024-09-14T11:12:19.090134+0000","last_became_peered":"2024-09-14T11:12:19.090134+0000","last_unstale":"2024-09-14T12:44:39.098700+0000","last_undegraded":"2024-09-14T12:44:39.098700+0000","last_fullsized":"2024-09-14T12:44:39.098700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:39.098388+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:39.098388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.098388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:33.763161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4097,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'175","reported_seq":586,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.327884+0000","last_change":"2024-09-14T12:44:43.327884+0000","last_active":"2024-09-14T12:44:43.327884+0000","last_peered":"2024-09-14T12:44:43.327884+0000","last_clean":"2024-09-14T12:44:43.327884+0000","last_became_active":"2024-09-14T11:06:29.531149+0000","last_became_peered":"2024-09-14T11:06:29.531149+0000","last_unstale":"2024-09-14T12:44:43.327884+0000","last_undegraded":"2024-09-14T12:44:43.327884+0000","last_fullsized":"2024-09-14T12:44:43.327884+0000","mapping_epoch":256,"log_start":"264'100","ondisk_log_start":"264'100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-14T12:44:43.327621+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-14T12:44:43.327621+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.327621+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:13.301203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1578,"num_read_kb":1327,"num_write":388,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.066809+0000","last_change":"2024-09-14T12:44:48.066809+0000","last_active":"2024-09-14T12:44:48.066809+0000","last_peered":"2024-09-14T12:44:48.066809+0000","last_clean":"2024-09-14T12:44:48.066809+0000","last_became_active":"2024-09-14T11:40:08.942208+0000","last_became_peered":"2024-09-14T11:40:08.942208+0000","last_unstale":"2024-09-14T12:44:48.066809+0000","last_undegraded":"2024-09-14T12:44:48.066809+0000","last_fullsized":"2024-09-14T12:44:48.066809+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:48.066632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:48.066632+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.066632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:17.322690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.768253+0000","last_change":"2024-09-14T11:12:26.236668+0000","last_active":"2024-09-14T12:42:29.768253+0000","last_peered":"2024-09-14T12:42:29.768253+0000","last_clean":"2024-09-14T12:42:29.768253+0000","last_became_active":"2024-09-14T11:12:26.236221+0000","last_became_peered":"2024-09-14T11:12:26.236221+0000","last_unstale":"2024-09-14T12:42:29.768253+0000","last_undegraded":"2024-09-14T12:42:29.768253+0000","last_fullsized":"2024-09-14T12:42:29.768253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.780862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.806332+0000","last_change":"2024-09-14T12:44:49.806204+0000","last_active":"2024-09-14T12:44:49.806332+0000","last_peered":"2024-09-14T12:44:49.806332+0000","last_clean":"2024-09-14T12:44:49.806332+0000","last_became_active":"2024-09-14T11:12:19.086765+0000","last_became_peered":"2024-09-14T11:12:19.086765+0000","last_unstale":"2024-09-14T12:44:49.806332+0000","last_undegraded":"2024-09-14T12:44:49.806332+0000","last_fullsized":"2024-09-14T12:44:49.806332+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.806019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.806019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.806019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:34.322738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'21","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.794605+0000","last_change":"2024-09-14T12:44:43.794605+0000","last_active":"2024-09-14T12:44:43.794605+0000","last_peered":"2024-09-14T12:44:43.794605+0000","last_clean":"2024-09-14T12:44:43.794605+0000","last_became_active":"2024-09-14T11:06:29.518028+0000","last_became_peered":"2024-09-14T11:06:29.518028+0000","last_unstale":"2024-09-14T12:44:43.794605+0000","last_undegraded":"2024-09-14T12:44:43.794605+0000","last_fullsized":"2024-09-14T12:44:43.794605+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-14T12:44:43.794424+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-14T12:44:43.794424+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.794424+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.700307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":96,"num_write":55,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.563311+0000","last_change":"2024-09-14T11:40:08.953653+0000","last_active":"2024-09-14T12:40:50.563311+0000","last_peered":"2024-09-14T12:40:50.563311+0000","last_clean":"2024-09-14T12:40:50.563311+0000","last_became_active":"2024-09-14T11:40:08.953030+0000","last_became_peered":"2024-09-14T11:40:08.953030+0000","last_unstale":"2024-09-14T12:40:50.563311+0000","last_undegraded":"2024-09-14T12:40:50.563311+0000","last_fullsized":"2024-09-14T12:40:50.563311+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:54.553294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760330+0000","last_change":"2024-09-14T11:12:26.248644+0000","last_active":"2024-09-14T12:41:54.760330+0000","last_peered":"2024-09-14T12:41:54.760330+0000","last_clean":"2024-09-14T12:41:54.760330+0000","last_became_active":"2024-09-14T11:12:26.247784+0000","last_became_peered":"2024-09-14T11:12:26.247784+0000","last_unstale":"2024-09-14T12:41:54.760330+0000","last_undegraded":"2024-09-14T12:41:54.760330+0000","last_fullsized":"2024-09-14T12:41:54.760330+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:36.527831+0000","last_change":"2024-09-14T11:12:19.114678+0000","last_active":"2024-09-14T12:43:36.527831+0000","last_peered":"2024-09-14T12:43:36.527831+0000","last_clean":"2024-09-14T12:43:36.527831+0000","last_became_active":"2024-09-14T11:12:19.113431+0000","last_became_peered":"2024-09-14T11:12:19.113431+0000","last_unstale":"2024-09-14T12:43:36.527831+0000","last_undegraded":"2024-09-14T12:43:36.527831+0000","last_fullsized":"2024-09-14T12:43:36.527831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:46.474061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7166,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'46","reported_seq":205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.782030+0000","last_change":"2024-09-14T12:44:48.782030+0000","last_active":"2024-09-14T12:44:48.782030+0000","last_peered":"2024-09-14T12:44:48.782030+0000","last_clean":"2024-09-14T12:44:48.782030+0000","last_became_active":"2024-09-14T11:06:29.532061+0000","last_became_peered":"2024-09-14T11:06:29.532061+0000","last_unstale":"2024-09-14T12:44:48.782030+0000","last_undegraded":"2024-09-14T12:44:48.782030+0000","last_fullsized":"2024-09-14T12:44:48.782030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'46","last_scrub_stamp":"2024-09-14T12:44:48.781878+0000","last_deep_scrub":"267'46","last_deep_scrub_stamp":"2024-09-14T12:44:48.781878+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.781878+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:12.193204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":235,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.546149+0000","last_change":"2024-09-14T11:40:08.938546+0000","last_active":"2024-09-14T12:40:51.546149+0000","last_peered":"2024-09-14T12:40:51.546149+0000","last_clean":"2024-09-14T12:40:51.546149+0000","last_became_active":"2024-09-14T11:40:08.937813+0000","last_became_peered":"2024-09-14T11:40:08.937813+0000","last_unstale":"2024-09-14T12:40:51.546149+0000","last_undegraded":"2024-09-14T12:40:51.546149+0000","last_fullsized":"2024-09-14T12:40:51.546149+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:07.510647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"267'12","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.828266+0000","last_change":"2024-09-14T11:12:26.244350+0000","last_active":"2024-09-14T12:44:03.828266+0000","last_peered":"2024-09-14T12:44:03.828266+0000","last_clean":"2024-09-14T12:44:03.828266+0000","last_became_active":"2024-09-14T11:12:26.243612+0000","last_became_peered":"2024-09-14T11:12:26.243612+0000","last_unstale":"2024-09-14T12:44:03.828266+0000","last_undegraded":"2024-09-14T12:44:03.828266+0000","last_fullsized":"2024-09-14T12:44:03.828266+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.954445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15364,"num_write":22,"num_write_kb":14340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.149402+0000","last_change":"2024-09-14T12:44:37.149402+0000","last_active":"2024-09-14T12:44:37.149402+0000","last_peered":"2024-09-14T12:44:37.149402+0000","last_clean":"2024-09-14T12:44:37.149402+0000","last_became_active":"2024-09-14T11:12:19.103871+0000","last_became_peered":"2024-09-14T11:12:19.103871+0000","last_unstale":"2024-09-14T12:44:37.149402+0000","last_undegraded":"2024-09-14T12:44:37.149402+0000","last_fullsized":"2024-09-14T12:44:37.149402+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:37.149216+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:37.149216+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.149216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:20.246009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'29","reported_seq":152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.800677+0000","last_change":"2024-09-14T12:44:49.800677+0000","last_active":"2024-09-14T12:44:49.800677+0000","last_peered":"2024-09-14T12:44:49.800677+0000","last_clean":"2024-09-14T12:44:49.800677+0000","last_became_active":"2024-09-14T11:06:29.529421+0000","last_became_peered":"2024-09-14T11:06:29.529421+0000","last_unstale":"2024-09-14T12:44:49.800677+0000","last_undegraded":"2024-09-14T12:44:49.800677+0000","last_fullsized":"2024-09-14T12:44:49.800677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T12:44:49.800471+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T12:44:49.800471+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.800471+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:47.936186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":129,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.155363+0000","last_change":"2024-09-14T11:40:08.944753+0000","last_active":"2024-09-14T12:40:51.155363+0000","last_peered":"2024-09-14T12:40:51.155363+0000","last_clean":"2024-09-14T12:40:51.155363+0000","last_became_active":"2024-09-14T11:40:08.944066+0000","last_became_peered":"2024-09-14T11:40:08.944066+0000","last_unstale":"2024-09-14T12:40:51.155363+0000","last_undegraded":"2024-09-14T12:40:51.155363+0000","last_fullsized":"2024-09-14T12:40:51.155363+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:51.071467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:54.760439+0000","last_change":"2024-09-14T11:12:26.225753+0000","last_active":"2024-09-14T12:41:54.760439+0000","last_peered":"2024-09-14T12:41:54.760439+0000","last_clean":"2024-09-14T12:41:54.760439+0000","last_became_active":"2024-09-14T11:12:26.224877+0000","last_became_peered":"2024-09-14T11:12:26.224877+0000","last_unstale":"2024-09-14T12:41:54.760439+0000","last_undegraded":"2024-09-14T12:41:54.760439+0000","last_fullsized":"2024-09-14T12:41:54.760439+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'11","reported_seq":92,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.360372+0000","last_change":"2024-09-14T12:44:47.360372+0000","last_active":"2024-09-14T12:44:47.360372+0000","last_peered":"2024-09-14T12:44:47.360372+0000","last_clean":"2024-09-14T12:44:47.360372+0000","last_became_active":"2024-09-14T11:12:19.107563+0000","last_became_peered":"2024-09-14T11:12:19.107563+0000","last_unstale":"2024-09-14T12:44:47.360372+0000","last_undegraded":"2024-09-14T12:44:47.360372+0000","last_fullsized":"2024-09-14T12:44:47.360372+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T12:44:47.360187+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T12:44:47.360187+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.360187+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.915198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9259,"num_write":16,"num_write_kb":6185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.366789+0000","last_change":"2024-09-14T12:44:42.366789+0000","last_active":"2024-09-14T12:44:42.366789+0000","last_peered":"2024-09-14T12:44:42.366789+0000","last_clean":"2024-09-14T12:44:42.366789+0000","last_became_active":"2024-09-14T11:06:29.534316+0000","last_became_peered":"2024-09-14T11:06:29.534316+0000","last_unstale":"2024-09-14T12:44:42.366789+0000","last_undegraded":"2024-09-14T12:44:42.366789+0000","last_fullsized":"2024-09-14T12:44:42.366789+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T12:44:42.366563+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T12:44:42.366563+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.366563+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:29.776445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":71,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.053744+0000","last_change":"2024-09-14T12:44:47.053744+0000","last_active":"2024-09-14T12:44:47.053744+0000","last_peered":"2024-09-14T12:44:47.053744+0000","last_clean":"2024-09-14T12:44:47.053744+0000","last_became_active":"2024-09-14T11:40:08.945227+0000","last_became_peered":"2024-09-14T11:40:08.945227+0000","last_unstale":"2024-09-14T12:44:47.053744+0000","last_undegraded":"2024-09-14T12:44:47.053744+0000","last_fullsized":"2024-09-14T12:44:47.053744+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.053527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.053527+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.053527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:03.906857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.137784+0000","last_change":"2024-09-14T12:44:42.137784+0000","last_active":"2024-09-14T12:44:42.137784+0000","last_peered":"2024-09-14T12:44:42.137784+0000","last_clean":"2024-09-14T12:44:42.137784+0000","last_became_active":"2024-09-14T11:12:26.238844+0000","last_became_peered":"2024-09-14T11:12:26.238844+0000","last_unstale":"2024-09-14T12:44:42.137784+0000","last_undegraded":"2024-09-14T12:44:42.137784+0000","last_fullsized":"2024-09-14T12:44:42.137784+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:42.137575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:42.137575+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.137575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:12.523037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.951718+0000","last_change":"2024-09-14T11:12:19.074095+0000","last_active":"2024-09-14T12:44:02.951718+0000","last_peered":"2024-09-14T12:44:02.951718+0000","last_clean":"2024-09-14T12:44:02.951718+0000","last_became_active":"2024-09-14T11:12:19.072275+0000","last_became_peered":"2024-09-14T11:12:19.072275+0000","last_unstale":"2024-09-14T12:44:02.951718+0000","last_undegraded":"2024-09-14T12:44:02.951718+0000","last_fullsized":"2024-09-14T12:44:02.951718+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:16.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'30","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:26.513056+0000","last_change":"2024-09-14T11:06:29.519394+0000","last_active":"2024-09-14T12:42:26.513056+0000","last_peered":"2024-09-14T12:42:26.513056+0000","last_clean":"2024-09-14T12:42:26.513056+0000","last_became_active":"2024-09-14T11:06:29.518650+0000","last_became_peered":"2024-09-14T11:06:29.518650+0000","last_unstale":"2024-09-14T12:42:26.513056+0000","last_undegraded":"2024-09-14T12:42:26.513056+0000","last_fullsized":"2024-09-14T12:42:26.513056+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":172,"num_write":81,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:35.559828+0000","last_change":"2024-09-14T11:40:08.951327+0000","last_active":"2024-09-14T12:40:35.559828+0000","last_peered":"2024-09-14T12:40:35.559828+0000","last_clean":"2024-09-14T12:40:35.559828+0000","last_became_active":"2024-09-14T11:40:08.950670+0000","last_became_peered":"2024-09-14T11:40:08.950670+0000","last_unstale":"2024-09-14T12:40:35.559828+0000","last_undegraded":"2024-09-14T12:40:35.559828+0000","last_fullsized":"2024-09-14T12:40:35.559828+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:02.634753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'5","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.129271+0000","last_change":"2024-09-14T11:12:26.228814+0000","last_active":"2024-09-14T12:44:02.129271+0000","last_peered":"2024-09-14T12:44:02.129271+0000","last_clean":"2024-09-14T12:44:02.129271+0000","last_became_active":"2024-09-14T11:12:26.227851+0000","last_became_peered":"2024-09-14T11:12:26.227851+0000","last_unstale":"2024-09-14T12:44:02.129271+0000","last_undegraded":"2024-09-14T12:44:02.129271+0000","last_fullsized":"2024-09-14T12:44:02.129271+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:46.796979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.969195+0000","last_change":"2024-09-14T12:44:44.969195+0000","last_active":"2024-09-14T12:44:44.969195+0000","last_peered":"2024-09-14T12:44:44.969195+0000","last_clean":"2024-09-14T12:44:44.969195+0000","last_became_active":"2024-09-14T11:12:19.091893+0000","last_became_peered":"2024-09-14T11:12:19.091893+0000","last_unstale":"2024-09-14T12:44:44.969195+0000","last_undegraded":"2024-09-14T12:44:44.969195+0000","last_fullsized":"2024-09-14T12:44:44.969195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T12:44:44.969008+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T12:44:44.969008+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.969008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:21.602815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'35","reported_seq":164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:11.508828+0000","last_change":"2024-09-14T11:06:29.548605+0000","last_active":"2024-09-14T12:42:11.508828+0000","last_peered":"2024-09-14T12:42:11.508828+0000","last_clean":"2024-09-14T12:42:11.508828+0000","last_became_active":"2024-09-14T11:06:29.545575+0000","last_became_peered":"2024-09-14T11:06:29.545575+0000","last_unstale":"2024-09-14T12:42:11.508828+0000","last_undegraded":"2024-09-14T12:42:11.508828+0000","last_fullsized":"2024-09-14T12:42:11.508828+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":183,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543115+0000","last_change":"2024-09-14T11:40:08.926123+0000","last_active":"2024-09-14T12:40:36.543115+0000","last_peered":"2024-09-14T12:40:36.543115+0000","last_clean":"2024-09-14T12:40:36.543115+0000","last_became_active":"2024-09-14T11:40:08.925358+0000","last_became_peered":"2024-09-14T11:40:08.925358+0000","last_unstale":"2024-09-14T12:40:36.543115+0000","last_undegraded":"2024-09-14T12:40:36.543115+0000","last_fullsized":"2024-09-14T12:40:36.543115+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:25.296629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":58,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566691+0000","last_change":"2024-09-14T11:12:26.247421+0000","last_active":"2024-09-14T12:41:05.566691+0000","last_peered":"2024-09-14T12:41:05.566691+0000","last_clean":"2024-09-14T12:41:05.566691+0000","last_became_active":"2024-09-14T11:12:26.246881+0000","last_became_peered":"2024-09-14T11:12:26.246881+0000","last_unstale":"2024-09-14T12:41:05.566691+0000","last_undegraded":"2024-09-14T12:41:05.566691+0000","last_fullsized":"2024-09-14T12:41:05.566691+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:19.198573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:20.380939+0000","last_change":"2024-09-14T11:12:19.096545+0000","last_active":"2024-09-14T12:43:20.380939+0000","last_peered":"2024-09-14T12:43:20.380939+0000","last_clean":"2024-09-14T12:43:20.380939+0000","last_became_active":"2024-09-14T11:12:19.095821+0000","last_became_peered":"2024-09-14T11:12:19.095821+0000","last_unstale":"2024-09-14T12:43:20.380939+0000","last_undegraded":"2024-09-14T12:43:20.380939+0000","last_fullsized":"2024-09-14T12:43:20.380939+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:19.186342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'26","reported_seq":150,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.377484+0000","last_change":"2024-09-14T12:44:41.377484+0000","last_active":"2024-09-14T12:44:41.377484+0000","last_peered":"2024-09-14T12:44:41.377484+0000","last_clean":"2024-09-14T12:44:41.377484+0000","last_became_active":"2024-09-14T11:06:29.529753+0000","last_became_peered":"2024-09-14T11:06:29.529753+0000","last_unstale":"2024-09-14T12:44:41.377484+0000","last_undegraded":"2024-09-14T12:44:41.377484+0000","last_fullsized":"2024-09-14T12:44:41.377484+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-14T12:44:41.377309+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-14T12:44:41.377309+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.377309+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.262253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.576092+0000","last_change":"2024-09-14T11:40:08.925501+0000","last_active":"2024-09-14T12:41:05.576092+0000","last_peered":"2024-09-14T12:41:05.576092+0000","last_clean":"2024-09-14T12:41:05.576092+0000","last_became_active":"2024-09-14T11:40:08.924726+0000","last_became_peered":"2024-09-14T11:40:08.924726+0000","last_unstale":"2024-09-14T12:41:05.576092+0000","last_undegraded":"2024-09-14T12:41:05.576092+0000","last_fullsized":"2024-09-14T12:41:05.576092+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:22.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:09.749817+0000","last_change":"2024-09-14T11:12:26.219990+0000","last_active":"2024-09-14T12:41:09.749817+0000","last_peered":"2024-09-14T12:41:09.749817+0000","last_clean":"2024-09-14T12:41:09.749817+0000","last_became_active":"2024-09-14T11:12:26.219169+0000","last_became_peered":"2024-09-14T11:12:26.219169+0000","last_unstale":"2024-09-14T12:41:09.749817+0000","last_undegraded":"2024-09-14T12:41:09.749817+0000","last_fullsized":"2024-09-14T12:41:09.749817+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:09.344730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"267'10","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.981302+0000","last_change":"2024-09-14T12:44:42.981302+0000","last_active":"2024-09-14T12:44:42.981302+0000","last_peered":"2024-09-14T12:44:42.981302+0000","last_clean":"2024-09-14T12:44:42.981302+0000","last_became_active":"2024-09-14T11:12:19.099233+0000","last_became_peered":"2024-09-14T11:12:19.099233+0000","last_unstale":"2024-09-14T12:44:42.981302+0000","last_undegraded":"2024-09-14T12:44:42.981302+0000","last_fullsized":"2024-09-14T12:44:42.981302+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-14T12:44:42.981106+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-14T12:44:42.981106+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.981106+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:17.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8230,"num_write":10,"num_write_kb":6172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'35","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.935737+0000","last_change":"2024-09-14T12:44:42.935737+0000","last_active":"2024-09-14T12:44:42.935737+0000","last_peered":"2024-09-14T12:44:42.935737+0000","last_clean":"2024-09-14T12:44:42.935737+0000","last_became_active":"2024-09-14T11:06:29.508842+0000","last_became_peered":"2024-09-14T11:06:29.508842+0000","last_unstale":"2024-09-14T12:44:42.935737+0000","last_undegraded":"2024-09-14T12:44:42.935737+0000","last_fullsized":"2024-09-14T12:44:42.935737+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'35","last_scrub_stamp":"2024-09-14T12:44:42.935551+0000","last_deep_scrub":"267'35","last_deep_scrub_stamp":"2024-09-14T12:44:42.935551+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.935551+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:26:40.214950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":189,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:36.543061+0000","last_change":"2024-09-14T11:40:08.945136+0000","last_active":"2024-09-14T12:40:36.543061+0000","last_peered":"2024-09-14T12:40:36.543061+0000","last_clean":"2024-09-14T12:40:36.543061+0000","last_became_active":"2024-09-14T11:40:08.944382+0000","last_became_peered":"2024-09-14T11:40:08.944382+0000","last_unstale":"2024-09-14T12:40:36.543061+0000","last_undegraded":"2024-09-14T12:40:36.543061+0000","last_fullsized":"2024-09-14T12:40:36.543061+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:00.265362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:26.525182+0000","last_change":"2024-09-14T11:12:26.238084+0000","last_active":"2024-09-14T12:43:26.525182+0000","last_peered":"2024-09-14T12:43:26.525182+0000","last_clean":"2024-09-14T12:43:26.525182+0000","last_became_active":"2024-09-14T11:12:26.232336+0000","last_became_peered":"2024-09-14T11:12:26.232336+0000","last_unstale":"2024-09-14T12:43:26.525182+0000","last_undegraded":"2024-09-14T12:43:26.525182+0000","last_fullsized":"2024-09-14T12:43:26.525182+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:24.342020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.977146+0000","last_change":"2024-09-14T12:44:43.977146+0000","last_active":"2024-09-14T12:44:43.977146+0000","last_peered":"2024-09-14T12:44:43.977146+0000","last_clean":"2024-09-14T12:44:43.977146+0000","last_became_active":"2024-09-14T11:12:19.092223+0000","last_became_peered":"2024-09-14T11:12:19.092223+0000","last_unstale":"2024-09-14T12:44:43.977146+0000","last_undegraded":"2024-09-14T12:44:43.977146+0000","last_fullsized":"2024-09-14T12:44:43.977146+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:43.976958+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:43.976958+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.976958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:16.792611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'19","reported_seq":126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.373910+0000","last_change":"2024-09-14T12:44:40.373910+0000","last_active":"2024-09-14T12:44:40.373910+0000","last_peered":"2024-09-14T12:44:40.373910+0000","last_clean":"2024-09-14T12:44:40.373910+0000","last_became_active":"2024-09-14T11:06:29.530722+0000","last_became_peered":"2024-09-14T11:06:29.530722+0000","last_unstale":"2024-09-14T12:44:40.373910+0000","last_undegraded":"2024-09-14T12:44:40.373910+0000","last_fullsized":"2024-09-14T12:44:40.373910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'19","last_scrub_stamp":"2024-09-14T12:44:40.373679+0000","last_deep_scrub":"267'19","last_deep_scrub_stamp":"2024-09-14T12:44:40.373679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.373679+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:10.466093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":48,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:05.566854+0000","last_change":"2024-09-14T11:40:08.948425+0000","last_active":"2024-09-14T12:41:05.566854+0000","last_peered":"2024-09-14T12:41:05.566854+0000","last_clean":"2024-09-14T12:41:05.566854+0000","last_became_active":"2024-09-14T11:40:08.947725+0000","last_became_peered":"2024-09-14T11:40:08.947725+0000","last_unstale":"2024-09-14T12:41:05.566854+0000","last_undegraded":"2024-09-14T12:41:05.566854+0000","last_fullsized":"2024-09-14T12:41:05.566854+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:01.712986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.768378+0000","last_change":"2024-09-14T11:12:26.233658+0000","last_active":"2024-09-14T12:42:29.768378+0000","last_peered":"2024-09-14T12:42:29.768378+0000","last_clean":"2024-09-14T12:42:29.768378+0000","last_became_active":"2024-09-14T11:12:26.233006+0000","last_became_peered":"2024-09-14T11:12:26.233006+0000","last_unstale":"2024-09-14T12:42:29.768378+0000","last_undegraded":"2024-09-14T12:42:29.768378+0000","last_fullsized":"2024-09-14T12:42:29.768378+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"267'2","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.963949+0000","last_change":"2024-09-14T12:44:43.963949+0000","last_active":"2024-09-14T12:44:43.963949+0000","last_peered":"2024-09-14T12:44:43.963949+0000","last_clean":"2024-09-14T12:44:43.963949+0000","last_became_active":"2024-09-14T11:12:19.085380+0000","last_became_peered":"2024-09-14T11:12:19.085380+0000","last_unstale":"2024-09-14T12:44:43.963949+0000","last_undegraded":"2024-09-14T12:44:43.963949+0000","last_fullsized":"2024-09-14T12:44:43.963949+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:43.963747+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:43.963747+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.963747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:43.558499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'32","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.400381+0000","last_change":"2024-09-14T12:44:39.400381+0000","last_active":"2024-09-14T12:44:39.400381+0000","last_peered":"2024-09-14T12:44:39.400381+0000","last_clean":"2024-09-14T12:44:39.400381+0000","last_became_active":"2024-09-14T11:06:29.534458+0000","last_became_peered":"2024-09-14T11:06:29.534458+0000","last_unstale":"2024-09-14T12:44:39.400381+0000","last_undegraded":"2024-09-14T12:44:39.400381+0000","last_fullsized":"2024-09-14T12:44:39.400381+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'32","last_scrub_stamp":"2024-09-14T12:44:39.400200+0000","last_deep_scrub":"267'32","last_deep_scrub_stamp":"2024-09-14T12:44:39.400200+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.400200+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:02.119729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":170,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.946973+0000","last_change":"2024-09-14T12:44:47.946973+0000","last_active":"2024-09-14T12:44:47.946973+0000","last_peered":"2024-09-14T12:44:47.946973+0000","last_clean":"2024-09-14T12:44:47.946973+0000","last_became_active":"2024-09-14T11:40:08.949834+0000","last_became_peered":"2024-09-14T11:40:08.949834+0000","last_unstale":"2024-09-14T12:44:47.946973+0000","last_undegraded":"2024-09-14T12:44:47.946973+0000","last_fullsized":"2024-09-14T12:44:47.946973+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.946794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.946794+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.946794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:04.666311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:29.768344+0000","last_change":"2024-09-14T11:12:26.248461+0000","last_active":"2024-09-14T12:42:29.768344+0000","last_peered":"2024-09-14T12:42:29.768344+0000","last_clean":"2024-09-14T12:42:29.768344+0000","last_became_active":"2024-09-14T11:12:26.247614+0000","last_became_peered":"2024-09-14T11:12:26.247614+0000","last_unstale":"2024-09-14T12:42:29.768344+0000","last_undegraded":"2024-09-14T12:42:29.768344+0000","last_fullsized":"2024-09-14T12:42:29.768344+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'14","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.774373+0000","last_change":"2024-09-14T12:44:48.774373+0000","last_active":"2024-09-14T12:44:48.774373+0000","last_peered":"2024-09-14T12:44:48.774373+0000","last_clean":"2024-09-14T12:44:48.774373+0000","last_became_active":"2024-09-14T11:12:19.096087+0000","last_became_peered":"2024-09-14T11:12:19.096087+0000","last_unstale":"2024-09-14T12:44:48.774373+0000","last_undegraded":"2024-09-14T12:44:48.774373+0000","last_fullsized":"2024-09-14T12:44:48.774373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T12:44:48.774134+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T12:44:48.774134+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.774134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:21.183878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":21525,"num_write":24,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'15","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:01.490423+0000","last_change":"2024-09-14T11:06:29.545510+0000","last_active":"2024-09-14T12:41:01.490423+0000","last_peered":"2024-09-14T12:41:01.490423+0000","last_clean":"2024-09-14T12:41:01.490423+0000","last_became_active":"2024-09-14T11:06:29.544309+0000","last_became_peered":"2024-09-14T11:06:29.544309+0000","last_unstale":"2024-09-14T12:41:01.490423+0000","last_undegraded":"2024-09-14T12:41:01.490423+0000","last_fullsized":"2024-09-14T12:41:01.490423+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:06.467496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":80,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:51.487672+0000","last_change":"2024-09-14T11:40:08.941028+0000","last_active":"2024-09-14T12:40:51.487672+0000","last_peered":"2024-09-14T12:40:51.487672+0000","last_clean":"2024-09-14T12:40:51.487672+0000","last_became_active":"2024-09-14T11:40:08.934447+0000","last_became_peered":"2024-09-14T11:40:08.934447+0000","last_unstale":"2024-09-14T12:40:51.487672+0000","last_undegraded":"2024-09-14T12:40:51.487672+0000","last_fullsized":"2024-09-14T12:40:51.487672+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:15.709296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"267'11","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:44.771631+0000","last_change":"2024-09-14T11:12:26.254154+0000","last_active":"2024-09-14T12:42:44.771631+0000","last_peered":"2024-09-14T12:42:44.771631+0000","last_clean":"2024-09-14T12:42:44.771631+0000","last_became_active":"2024-09-14T11:12:26.253410+0000","last_became_peered":"2024-09-14T11:12:26.253410+0000","last_unstale":"2024-09-14T12:42:44.771631+0000","last_undegraded":"2024-09-14T12:42:44.771631+0000","last_fullsized":"2024-09-14T12:42:44.771631+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.081481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6160,"num_write":16,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.371033+0000","last_change":"2024-09-14T12:44:46.371033+0000","last_active":"2024-09-14T12:44:46.371033+0000","last_peered":"2024-09-14T12:44:46.371033+0000","last_clean":"2024-09-14T12:44:46.371033+0000","last_became_active":"2024-09-14T11:12:19.109807+0000","last_became_peered":"2024-09-14T11:12:19.109807+0000","last_unstale":"2024-09-14T12:44:46.371033+0000","last_undegraded":"2024-09-14T12:44:46.371033+0000","last_fullsized":"2024-09-14T12:44:46.371033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T12:44:46.370806+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T12:44:46.370806+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.370806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:11.684257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'38","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.937380+0000","last_change":"2024-09-14T12:44:39.937380+0000","last_active":"2024-09-14T12:44:39.937380+0000","last_peered":"2024-09-14T12:44:39.937380+0000","last_clean":"2024-09-14T12:44:39.937380+0000","last_became_active":"2024-09-14T11:06:29.520734+0000","last_became_peered":"2024-09-14T11:06:29.520734+0000","last_unstale":"2024-09-14T12:44:39.937380+0000","last_undegraded":"2024-09-14T12:44:39.937380+0000","last_fullsized":"2024-09-14T12:44:39.937380+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-14T12:44:39.937198+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-14T12:44:39.937198+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.937198+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.273746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":248,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.908010+0000","last_change":"2024-09-14T12:44:48.908010+0000","last_active":"2024-09-14T12:44:48.908010+0000","last_peered":"2024-09-14T12:44:48.908010+0000","last_clean":"2024-09-14T12:44:48.908010+0000","last_became_active":"2024-09-14T11:40:08.928855+0000","last_became_peered":"2024-09-14T11:40:08.928855+0000","last_unstale":"2024-09-14T12:44:48.908010+0000","last_undegraded":"2024-09-14T12:44:48.908010+0000","last_fullsized":"2024-09-14T12:44:48.908010+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:48.907783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:48.907783+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.907783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:31.883367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:25.367838+0000","last_change":"2024-09-14T11:12:26.236373+0000","last_active":"2024-09-14T12:42:25.367838+0000","last_peered":"2024-09-14T12:42:25.367838+0000","last_clean":"2024-09-14T12:42:25.367838+0000","last_became_active":"2024-09-14T11:12:26.235707+0000","last_became_peered":"2024-09-14T11:12:26.235707+0000","last_unstale":"2024-09-14T12:42:25.367838+0000","last_undegraded":"2024-09-14T12:42:25.367838+0000","last_fullsized":"2024-09-14T12:42:25.367838+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"267'5","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.357531+0000","last_change":"2024-09-14T12:44:48.357379+0000","last_active":"2024-09-14T12:44:48.357531+0000","last_peered":"2024-09-14T12:44:48.357531+0000","last_clean":"2024-09-14T12:44:48.357531+0000","last_became_active":"2024-09-14T11:12:19.112055+0000","last_became_peered":"2024-09-14T11:12:19.112055+0000","last_unstale":"2024-09-14T12:44:48.357531+0000","last_undegraded":"2024-09-14T12:44:48.357531+0000","last_fullsized":"2024-09-14T12:44:48.357531+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:44:48.357195+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:44:48.357195+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.357195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:54.183829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'65","reported_seq":261,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.841340+0000","last_change":"2024-09-14T12:44:42.841340+0000","last_active":"2024-09-14T12:44:42.841340+0000","last_peered":"2024-09-14T12:44:42.841340+0000","last_clean":"2024-09-14T12:44:42.841340+0000","last_became_active":"2024-09-14T11:06:29.511360+0000","last_became_peered":"2024-09-14T11:06:29.511360+0000","last_unstale":"2024-09-14T12:44:42.841340+0000","last_undegraded":"2024-09-14T12:44:42.841340+0000","last_fullsized":"2024-09-14T12:44:42.841340+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'65","last_scrub_stamp":"2024-09-14T12:44:42.841149+0000","last_deep_scrub":"267'65","last_deep_scrub_stamp":"2024-09-14T12:44:42.841149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.841149+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:58.426066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":367,"num_write":155,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:55.564546+0000","last_change":"2024-09-14T11:40:08.949706+0000","last_active":"2024-09-14T12:40:55.564546+0000","last_peered":"2024-09-14T12:40:55.564546+0000","last_clean":"2024-09-14T12:40:55.564546+0000","last_became_active":"2024-09-14T11:40:08.949175+0000","last_became_peered":"2024-09-14T11:40:08.949175+0000","last_unstale":"2024-09-14T12:40:55.564546+0000","last_undegraded":"2024-09-14T12:40:55.564546+0000","last_fullsized":"2024-09-14T12:40:55.564546+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:24.365260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.227031+0000","last_change":"2024-09-14T11:12:26.229833+0000","last_active":"2024-09-14T12:44:03.227031+0000","last_peered":"2024-09-14T12:44:03.227031+0000","last_clean":"2024-09-14T12:44:03.227031+0000","last_became_active":"2024-09-14T11:12:26.228889+0000","last_became_peered":"2024-09-14T11:12:26.228889+0000","last_unstale":"2024-09-14T12:44:03.227031+0000","last_undegraded":"2024-09-14T12:44:03.227031+0000","last_fullsized":"2024-09-14T12:44:03.227031+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:37.357481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.295264+0000","last_change":"2024-09-14T12:44:44.295264+0000","last_active":"2024-09-14T12:44:44.295264+0000","last_peered":"2024-09-14T12:44:44.295264+0000","last_clean":"2024-09-14T12:44:44.295264+0000","last_became_active":"2024-09-14T11:12:19.098699+0000","last_became_peered":"2024-09-14T11:12:19.098699+0000","last_unstale":"2024-09-14T12:44:44.295264+0000","last_undegraded":"2024-09-14T12:44:44.295264+0000","last_fullsized":"2024-09-14T12:44:44.295264+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:44.295047+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:44.295047+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.295047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:23.424767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'39","reported_seq":194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.870529+0000","last_change":"2024-09-14T12:44:41.870529+0000","last_active":"2024-09-14T12:44:41.870529+0000","last_peered":"2024-09-14T12:44:41.870529+0000","last_clean":"2024-09-14T12:44:41.870529+0000","last_became_active":"2024-09-14T11:06:29.538432+0000","last_became_peered":"2024-09-14T11:06:29.538432+0000","last_unstale":"2024-09-14T12:44:41.870529+0000","last_undegraded":"2024-09-14T12:44:41.870529+0000","last_fullsized":"2024-09-14T12:44:41.870529+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'39","last_scrub_stamp":"2024-09-14T12:44:41.870351+0000","last_deep_scrub":"267'39","last_deep_scrub_stamp":"2024-09-14T12:44:41.870351+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.870351+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:42.636474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":213,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:06.159302+0000","last_change":"2024-09-14T11:40:08.942492+0000","last_active":"2024-09-14T12:41:06.159302+0000","last_peered":"2024-09-14T12:41:06.159302+0000","last_clean":"2024-09-14T12:41:06.159302+0000","last_became_active":"2024-09-14T11:40:08.941924+0000","last_became_peered":"2024-09-14T11:40:08.941924+0000","last_unstale":"2024-09-14T12:41:06.159302+0000","last_undegraded":"2024-09-14T12:41:06.159302+0000","last_fullsized":"2024-09-14T12:41:06.159302+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:27.899066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.898624+0000","last_change":"2024-09-14T12:44:47.898624+0000","last_active":"2024-09-14T12:44:47.898624+0000","last_peered":"2024-09-14T12:44:47.898624+0000","last_clean":"2024-09-14T12:44:47.898624+0000","last_became_active":"2024-09-14T11:12:26.247849+0000","last_became_peered":"2024-09-14T11:12:26.247849+0000","last_unstale":"2024-09-14T12:44:47.898624+0000","last_undegraded":"2024-09-14T12:44:47.898624+0000","last_fullsized":"2024-09-14T12:44:47.898624+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T12:44:47.898410+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T12:44:47.898410+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.898410+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:52.699926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5155,"num_write":12,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.208693+0000","last_change":"2024-09-14T11:12:19.096332+0000","last_active":"2024-09-14T12:44:02.208693+0000","last_peered":"2024-09-14T12:44:02.208693+0000","last_clean":"2024-09-14T12:44:02.208693+0000","last_became_active":"2024-09-14T11:12:19.095636+0000","last_became_peered":"2024-09-14T11:12:19.095636+0000","last_unstale":"2024-09-14T12:44:02.208693+0000","last_undegraded":"2024-09-14T12:44:02.208693+0000","last_fullsized":"2024-09-14T12:44:02.208693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:51.045024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'31","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.996749+0000","last_change":"2024-09-14T12:44:38.996749+0000","last_active":"2024-09-14T12:44:38.996749+0000","last_peered":"2024-09-14T12:44:38.996749+0000","last_clean":"2024-09-14T12:44:38.996749+0000","last_became_active":"2024-09-14T11:06:29.508269+0000","last_became_peered":"2024-09-14T11:06:29.508269+0000","last_unstale":"2024-09-14T12:44:38.996749+0000","last_undegraded":"2024-09-14T12:44:38.996749+0000","last_fullsized":"2024-09-14T12:44:38.996749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'31","last_scrub_stamp":"2024-09-14T12:44:38.996567+0000","last_deep_scrub":"267'31","last_deep_scrub_stamp":"2024-09-14T12:44:38.996567+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.996567+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:40.061214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":149,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.088629+0000","last_change":"2024-09-14T12:44:45.088629+0000","last_active":"2024-09-14T12:44:45.088629+0000","last_peered":"2024-09-14T12:44:45.088629+0000","last_clean":"2024-09-14T12:44:45.088629+0000","last_became_active":"2024-09-14T11:40:08.945217+0000","last_became_peered":"2024-09-14T11:40:08.945217+0000","last_unstale":"2024-09-14T12:44:45.088629+0000","last_undegraded":"2024-09-14T12:44:45.088629+0000","last_fullsized":"2024-09-14T12:44:45.088629+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:45.088435+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:45.088435+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.088435+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:17.997786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.760937+0000","last_change":"2024-09-14T12:44:50.760937+0000","last_active":"2024-09-14T12:44:50.760937+0000","last_peered":"2024-09-14T12:44:50.760937+0000","last_clean":"2024-09-14T12:44:50.760937+0000","last_became_active":"2024-09-14T11:12:26.247272+0000","last_became_peered":"2024-09-14T11:12:26.247272+0000","last_unstale":"2024-09-14T12:44:50.760937+0000","last_undegraded":"2024-09-14T12:44:50.760937+0000","last_fullsized":"2024-09-14T12:44:50.760937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:44:50.760673+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:44:50.760673+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.760673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:35.549898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.327168+0000","last_change":"2024-09-14T12:44:45.327168+0000","last_active":"2024-09-14T12:44:45.327168+0000","last_peered":"2024-09-14T12:44:45.327168+0000","last_clean":"2024-09-14T12:44:45.327168+0000","last_became_active":"2024-09-14T11:12:19.103535+0000","last_became_peered":"2024-09-14T11:12:19.103535+0000","last_unstale":"2024-09-14T12:44:45.327168+0000","last_undegraded":"2024-09-14T12:44:45.327168+0000","last_fullsized":"2024-09-14T12:44:45.327168+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:45.326979+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:45.326979+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.326979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:21.405703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'7","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.817123+0000","last_change":"2024-09-14T12:44:47.817123+0000","last_active":"2024-09-14T12:44:47.817123+0000","last_peered":"2024-09-14T12:44:47.817123+0000","last_clean":"2024-09-14T12:44:47.817123+0000","last_became_active":"2024-09-14T11:06:29.510044+0000","last_became_peered":"2024-09-14T11:06:29.510044+0000","last_unstale":"2024-09-14T12:44:47.817123+0000","last_undegraded":"2024-09-14T12:44:47.817123+0000","last_fullsized":"2024-09-14T12:44:47.817123+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:47.816835+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:47.816835+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.816835+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:48.553505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:54.746472+0000","last_change":"2024-09-14T11:40:08.930752+0000","last_active":"2024-09-14T12:40:54.746472+0000","last_peered":"2024-09-14T12:40:54.746472+0000","last_clean":"2024-09-14T12:40:54.746472+0000","last_became_active":"2024-09-14T11:40:08.930065+0000","last_became_peered":"2024-09-14T11:40:08.930065+0000","last_unstale":"2024-09-14T12:40:54.746472+0000","last_undegraded":"2024-09-14T12:40:54.746472+0000","last_fullsized":"2024-09-14T12:40:54.746472+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:18.939757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.111348+0000","last_change":"2024-09-14T12:44:41.111348+0000","last_active":"2024-09-14T12:44:41.111348+0000","last_peered":"2024-09-14T12:44:41.111348+0000","last_clean":"2024-09-14T12:44:41.111348+0000","last_became_active":"2024-09-14T11:12:26.233812+0000","last_became_peered":"2024-09-14T11:12:26.233812+0000","last_unstale":"2024-09-14T12:44:41.111348+0000","last_undegraded":"2024-09-14T12:44:41.111348+0000","last_fullsized":"2024-09-14T12:44:41.111348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.111161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.111161+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.111161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:06.814018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.158713+0000","last_change":"2024-09-14T11:12:19.108839+0000","last_active":"2024-09-14T12:44:04.158713+0000","last_peered":"2024-09-14T12:44:04.158713+0000","last_clean":"2024-09-14T12:44:04.158713+0000","last_became_active":"2024-09-14T11:12:19.107950+0000","last_became_peered":"2024-09-14T11:12:19.107950+0000","last_unstale":"2024-09-14T12:44:04.158713+0000","last_undegraded":"2024-09-14T12:44:04.158713+0000","last_fullsized":"2024-09-14T12:44:04.158713+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'21","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.118104+0000","last_change":"2024-09-14T12:44:38.118104+0000","last_active":"2024-09-14T12:44:38.118104+0000","last_peered":"2024-09-14T12:44:38.118104+0000","last_clean":"2024-09-14T12:44:38.118104+0000","last_became_active":"2024-09-14T11:06:29.528153+0000","last_became_peered":"2024-09-14T11:06:29.528153+0000","last_unstale":"2024-09-14T12:44:38.118104+0000","last_undegraded":"2024-09-14T12:44:38.118104+0000","last_fullsized":"2024-09-14T12:44:38.118104+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-14T12:44:38.117922+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-14T12:44:38.117922+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.117922+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:42.907829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":111,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.064501+0000","last_change":"2024-09-14T12:44:46.064501+0000","last_active":"2024-09-14T12:44:46.064501+0000","last_peered":"2024-09-14T12:44:46.064501+0000","last_clean":"2024-09-14T12:44:46.064501+0000","last_became_active":"2024-09-14T11:40:08.936369+0000","last_became_peered":"2024-09-14T11:40:08.936369+0000","last_unstale":"2024-09-14T12:44:46.064501+0000","last_undegraded":"2024-09-14T12:44:46.064501+0000","last_fullsized":"2024-09-14T12:44:46.064501+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.064323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.064323+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.064323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:12.689238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.479399+0000","last_change":"2024-09-14T11:12:26.246616+0000","last_active":"2024-09-14T12:44:04.479399+0000","last_peered":"2024-09-14T12:44:04.479399+0000","last_clean":"2024-09-14T12:44:04.479399+0000","last_became_active":"2024-09-14T11:12:26.245930+0000","last_became_peered":"2024-09-14T11:12:26.245930+0000","last_unstale":"2024-09-14T12:44:04.479399+0000","last_undegraded":"2024-09-14T12:44:04.479399+0000","last_fullsized":"2024-09-14T12:44:04.479399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.534457+0000","last_change":"2024-09-14T11:12:19.109523+0000","last_active":"2024-09-14T12:44:01.534457+0000","last_peered":"2024-09-14T12:44:01.534457+0000","last_clean":"2024-09-14T12:44:01.534457+0000","last_became_active":"2024-09-14T11:12:19.108775+0000","last_became_peered":"2024-09-14T11:12:19.108775+0000","last_unstale":"2024-09-14T12:44:01.534457+0000","last_undegraded":"2024-09-14T12:44:01.534457+0000","last_fullsized":"2024-09-14T12:44:01.534457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:14.420097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'26","reported_seq":150,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.802237+0000","last_change":"2024-09-14T12:44:47.802237+0000","last_active":"2024-09-14T12:44:47.802237+0000","last_peered":"2024-09-14T12:44:47.802237+0000","last_clean":"2024-09-14T12:44:47.802237+0000","last_became_active":"2024-09-14T11:06:29.512500+0000","last_became_peered":"2024-09-14T11:06:29.512500+0000","last_unstale":"2024-09-14T12:44:47.802237+0000","last_undegraded":"2024-09-14T12:44:47.802237+0000","last_fullsized":"2024-09-14T12:44:47.802237+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-14T12:44:47.802052+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-14T12:44:47.802052+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.802052+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:06.755343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":126,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.118297+0000","last_change":"2024-09-14T12:44:44.118166+0000","last_active":"2024-09-14T12:44:44.118297+0000","last_peered":"2024-09-14T12:44:44.118297+0000","last_clean":"2024-09-14T12:44:44.118297+0000","last_became_active":"2024-09-14T11:40:08.941346+0000","last_became_peered":"2024-09-14T11:40:08.941346+0000","last_unstale":"2024-09-14T12:44:44.118297+0000","last_undegraded":"2024-09-14T12:44:44.118297+0000","last_fullsized":"2024-09-14T12:44:44.118297+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.118002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.118002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.118002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:18.132212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"267'4","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827889+0000","last_change":"2024-09-14T11:12:26.243752+0000","last_active":"2024-09-14T12:44:03.827889+0000","last_peered":"2024-09-14T12:44:03.827889+0000","last_clean":"2024-09-14T12:44:03.827889+0000","last_became_active":"2024-09-14T11:12:26.243209+0000","last_became_peered":"2024-09-14T11:12:26.243209+0000","last_unstale":"2024-09-14T12:44:03.827889+0000","last_undegraded":"2024-09-14T12:44:03.827889+0000","last_fullsized":"2024-09-14T12:44:03.827889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:38.328679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'11","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.159543+0000","last_change":"2024-09-14T11:12:19.092074+0000","last_active":"2024-09-14T12:44:04.159543+0000","last_peered":"2024-09-14T12:44:04.159543+0000","last_clean":"2024-09-14T12:44:04.159543+0000","last_became_active":"2024-09-14T11:12:19.091327+0000","last_became_peered":"2024-09-14T11:12:19.091327+0000","last_unstale":"2024-09-14T12:44:04.159543+0000","last_undegraded":"2024-09-14T12:44:04.159543+0000","last_fullsized":"2024-09-14T12:44:04.159543+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":27638,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'29","reported_seq":155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.503327+0000","last_change":"2024-09-14T11:06:29.545877+0000","last_active":"2024-09-14T12:41:51.503327+0000","last_peered":"2024-09-14T12:41:51.503327+0000","last_clean":"2024-09-14T12:41:51.503327+0000","last_became_active":"2024-09-14T11:06:29.539618+0000","last_became_peered":"2024-09-14T11:06:29.539618+0000","last_unstale":"2024-09-14T12:41:51.503327+0000","last_undegraded":"2024-09-14T12:41:51.503327+0000","last_fullsized":"2024-09-14T12:41:51.503327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:18.342360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":157,"num_write":71,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:30.368808+0000","last_change":"2024-09-14T11:40:08.946921+0000","last_active":"2024-09-14T12:42:30.368808+0000","last_peered":"2024-09-14T12:42:30.368808+0000","last_clean":"2024-09-14T12:42:30.368808+0000","last_became_active":"2024-09-14T11:40:08.946312+0000","last_became_peered":"2024-09-14T11:40:08.946312+0000","last_unstale":"2024-09-14T12:42:30.368808+0000","last_undegraded":"2024-09-14T12:42:30.368808+0000","last_fullsized":"2024-09-14T12:42:30.368808+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'9","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.118913+0000","last_change":"2024-09-14T12:44:40.118913+0000","last_active":"2024-09-14T12:44:40.118913+0000","last_peered":"2024-09-14T12:44:40.118913+0000","last_clean":"2024-09-14T12:44:40.118913+0000","last_became_active":"2024-09-14T11:12:26.228723+0000","last_became_peered":"2024-09-14T11:12:26.228723+0000","last_unstale":"2024-09-14T12:44:40.118913+0000","last_undegraded":"2024-09-14T12:44:40.118913+0000","last_fullsized":"2024-09-14T12:44:40.118913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-14T12:44:40.118688+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-14T12:44:40.118688+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.118688+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:29.274770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11303,"num_write":14,"num_write_kb":5161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.915108+0000","last_change":"2024-09-14T12:44:46.915108+0000","last_active":"2024-09-14T12:44:46.915108+0000","last_peered":"2024-09-14T12:44:46.915108+0000","last_clean":"2024-09-14T12:44:46.915108+0000","last_became_active":"2024-09-14T11:12:19.085023+0000","last_became_peered":"2024-09-14T11:12:19.085023+0000","last_unstale":"2024-09-14T12:44:46.915108+0000","last_undegraded":"2024-09-14T12:44:46.915108+0000","last_fullsized":"2024-09-14T12:44:46.915108+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.914925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.914925+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.914925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:28.424831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'37","reported_seq":179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.002327+0000","last_change":"2024-09-14T12:44:41.002189+0000","last_active":"2024-09-14T12:44:41.002327+0000","last_peered":"2024-09-14T12:44:41.002327+0000","last_clean":"2024-09-14T12:44:41.002327+0000","last_became_active":"2024-09-14T11:06:29.527422+0000","last_became_peered":"2024-09-14T11:06:29.527422+0000","last_unstale":"2024-09-14T12:44:41.002327+0000","last_undegraded":"2024-09-14T12:44:41.002327+0000","last_fullsized":"2024-09-14T12:44:41.002327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-09-14T12:44:41.002019+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-09-14T12:44:41.002019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.002019+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:11.659212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":97,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:41.516845+0000","last_change":"2024-09-14T11:40:08.934634+0000","last_active":"2024-09-14T12:42:41.516845+0000","last_peered":"2024-09-14T12:42:41.516845+0000","last_clean":"2024-09-14T12:42:41.516845+0000","last_became_active":"2024-09-14T11:40:08.933897+0000","last_became_peered":"2024-09-14T11:40:08.933897+0000","last_unstale":"2024-09-14T12:42:41.516845+0000","last_undegraded":"2024-09-14T12:42:41.516845+0000","last_fullsized":"2024-09-14T12:42:41.516845+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'7","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827832+0000","last_change":"2024-09-14T11:12:26.238345+0000","last_active":"2024-09-14T12:44:03.827832+0000","last_peered":"2024-09-14T12:44:03.827832+0000","last_clean":"2024-09-14T12:44:03.827832+0000","last_became_active":"2024-09-14T11:12:26.232736+0000","last_became_peered":"2024-09-14T11:12:26.232736+0000","last_unstale":"2024-09-14T12:44:03.827832+0000","last_undegraded":"2024-09-14T12:44:03.827832+0000","last_fullsized":"2024-09-14T12:44:03.827832+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:45.595070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":12,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:21.524121+0000","last_change":"2024-09-14T11:12:19.108780+0000","last_active":"2024-09-14T12:43:21.524121+0000","last_peered":"2024-09-14T12:43:21.524121+0000","last_clean":"2024-09-14T12:43:21.524121+0000","last_became_active":"2024-09-14T11:12:19.100258+0000","last_became_peered":"2024-09-14T11:12:19.100258+0000","last_unstale":"2024-09-14T12:43:21.524121+0000","last_undegraded":"2024-09-14T12:43:21.524121+0000","last_fullsized":"2024-09-14T12:43:21.524121+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.561655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2056,"num_write":10,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'41","reported_seq":197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.370853+0000","last_change":"2024-09-14T12:44:38.370853+0000","last_active":"2024-09-14T12:44:38.370853+0000","last_peered":"2024-09-14T12:44:38.370853+0000","last_clean":"2024-09-14T12:44:38.370853+0000","last_became_active":"2024-09-14T11:06:29.532958+0000","last_became_peered":"2024-09-14T11:06:29.532958+0000","last_unstale":"2024-09-14T12:44:38.370853+0000","last_undegraded":"2024-09-14T12:44:38.370853+0000","last_fullsized":"2024-09-14T12:44:38.370853+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'41","last_scrub_stamp":"2024-09-14T12:44:38.370671+0000","last_deep_scrub":"267'41","last_deep_scrub_stamp":"2024-09-14T12:44:38.370671+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.370671+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:47.399639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":199,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:49.745345+0000","last_change":"2024-09-14T11:40:08.934320+0000","last_active":"2024-09-14T12:40:49.745345+0000","last_peered":"2024-09-14T12:40:49.745345+0000","last_clean":"2024-09-14T12:40:49.745345+0000","last_became_active":"2024-09-14T11:40:08.932939+0000","last_became_peered":"2024-09-14T11:40:08.932939+0000","last_unstale":"2024-09-14T12:40:49.745345+0000","last_undegraded":"2024-09-14T12:40:49.745345+0000","last_fullsized":"2024-09-14T12:40:49.745345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:01.913004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.876886+0000","last_change":"2024-09-14T11:12:26.245494+0000","last_active":"2024-09-14T12:44:04.876886+0000","last_peered":"2024-09-14T12:44:04.876886+0000","last_clean":"2024-09-14T12:44:04.876886+0000","last_became_active":"2024-09-14T11:12:26.236892+0000","last_became_peered":"2024-09-14T11:12:26.236892+0000","last_unstale":"2024-09-14T12:44:04.876886+0000","last_undegraded":"2024-09-14T12:44:04.876886+0000","last_fullsized":"2024-09-14T12:44:04.876886+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.142203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.955542+0000","last_change":"2024-09-14T12:44:44.955542+0000","last_active":"2024-09-14T12:44:44.955542+0000","last_peered":"2024-09-14T12:44:44.955542+0000","last_clean":"2024-09-14T12:44:44.955542+0000","last_became_active":"2024-09-14T11:12:19.084630+0000","last_became_peered":"2024-09-14T11:12:19.084630+0000","last_unstale":"2024-09-14T12:44:44.955542+0000","last_undegraded":"2024-09-14T12:44:44.955542+0000","last_fullsized":"2024-09-14T12:44:44.955542+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.955318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.955318+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.955318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:27.480020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'305","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.956616+0000","last_change":"2024-09-14T12:44:41.956616+0000","last_active":"2024-09-14T12:44:41.956616+0000","last_peered":"2024-09-14T12:44:41.956616+0000","last_clean":"2024-09-14T12:44:41.956616+0000","last_became_active":"2024-09-14T11:06:29.524051+0000","last_became_peered":"2024-09-14T11:06:29.524051+0000","last_unstale":"2024-09-14T12:44:41.956616+0000","last_undegraded":"2024-09-14T12:44:41.956616+0000","last_fullsized":"2024-09-14T12:44:41.956616+0000","mapping_epoch":256,"log_start":"264'200","ondisk_log_start":"264'200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'305","last_scrub_stamp":"2024-09-14T12:44:41.956433+0000","last_deep_scrub":"267'305","last_deep_scrub_stamp":"2024-09-14T12:44:41.956433+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.956433+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:41.194763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2841,"num_read_kb":3371,"num_write":621,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:40:50.572999+0000","last_change":"2024-09-14T11:40:08.938945+0000","last_active":"2024-09-14T12:40:50.572999+0000","last_peered":"2024-09-14T12:40:50.572999+0000","last_clean":"2024-09-14T12:40:50.572999+0000","last_became_active":"2024-09-14T11:40:08.938357+0000","last_became_peered":"2024-09-14T11:40:08.938357+0000","last_unstale":"2024-09-14T12:40:50.572999+0000","last_undegraded":"2024-09-14T12:40:50.572999+0000","last_fullsized":"2024-09-14T12:40:50.572999+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:36.211620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'10","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:04.478181+0000","last_change":"2024-09-14T11:12:26.252293+0000","last_active":"2024-09-14T12:44:04.478181+0000","last_peered":"2024-09-14T12:44:04.478181+0000","last_clean":"2024-09-14T12:44:04.478181+0000","last_became_active":"2024-09-14T11:12:26.251771+0000","last_became_peered":"2024-09-14T11:12:26.251771+0000","last_unstale":"2024-09-14T12:44:04.478181+0000","last_undegraded":"2024-09-14T12:44:04.478181+0000","last_fullsized":"2024-09-14T12:44:04.478181+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9222,"num_write":10,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:01.534253+0000","last_change":"2024-09-14T11:12:19.109609+0000","last_active":"2024-09-14T12:44:01.534253+0000","last_peered":"2024-09-14T12:44:01.534253+0000","last_clean":"2024-09-14T12:44:01.534253+0000","last_became_active":"2024-09-14T11:12:19.100323+0000","last_became_peered":"2024-09-14T11:12:19.100323+0000","last_unstale":"2024-09-14T12:44:01.534253+0000","last_undegraded":"2024-09-14T12:44:01.534253+0000","last_fullsized":"2024-09-14T12:44:01.534253+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:18.050830+0000","last_clean_scrub_stamp":"2024-09-14T11:12:18.050830+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:05.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'31","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.511604+0000","last_change":"2024-09-14T11:06:29.545567+0000","last_active":"2024-09-14T12:42:21.511604+0000","last_peered":"2024-09-14T12:42:21.511604+0000","last_clean":"2024-09-14T12:42:21.511604+0000","last_became_active":"2024-09-14T11:06:29.545010+0000","last_became_peered":"2024-09-14T11:06:29.545010+0000","last_unstale":"2024-09-14T12:42:21.511604+0000","last_undegraded":"2024-09-14T12:42:21.511604+0000","last_fullsized":"2024-09-14T12:42:21.511604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":160,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:40.371274+0000","last_change":"2024-09-14T11:40:08.946756+0000","last_active":"2024-09-14T12:42:40.371274+0000","last_peered":"2024-09-14T12:42:40.371274+0000","last_clean":"2024-09-14T12:42:40.371274+0000","last_became_active":"2024-09-14T11:40:08.946192+0000","last_became_peered":"2024-09-14T11:40:08.946192+0000","last_unstale":"2024-09-14T12:42:40.371274+0000","last_undegraded":"2024-09-14T12:42:40.371274+0000","last_fullsized":"2024-09-14T12:42:40.371274+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"267'14","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.858662+0000","last_change":"2024-09-14T12:44:48.858662+0000","last_active":"2024-09-14T12:44:48.858662+0000","last_peered":"2024-09-14T12:44:48.858662+0000","last_clean":"2024-09-14T12:44:48.858662+0000","last_became_active":"2024-09-14T11:12:26.251336+0000","last_became_peered":"2024-09-14T11:12:26.251336+0000","last_unstale":"2024-09-14T12:44:48.858662+0000","last_undegraded":"2024-09-14T12:44:48.858662+0000","last_fullsized":"2024-09-14T12:44:48.858662+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T12:44:48.858479+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T12:44:48.858479+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.858479+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:37.751198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":27664,"num_write":24,"num_write_kb":11276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.782700+0000","last_change":"2024-09-14T12:44:47.782700+0000","last_active":"2024-09-14T12:44:47.782700+0000","last_peered":"2024-09-14T12:44:47.782700+0000","last_clean":"2024-09-14T12:44:47.782700+0000","last_became_active":"2024-09-14T11:12:19.089451+0000","last_became_peered":"2024-09-14T11:12:19.089451+0000","last_unstale":"2024-09-14T12:44:47.782700+0000","last_undegraded":"2024-09-14T12:44:47.782700+0000","last_fullsized":"2024-09-14T12:44:47.782700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.782509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.782509+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.782509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.496882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"267'36","reported_seq":177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:21.511510+0000","last_change":"2024-09-14T11:06:29.519496+0000","last_active":"2024-09-14T12:42:21.511510+0000","last_peered":"2024-09-14T12:42:21.511510+0000","last_clean":"2024-09-14T12:42:21.511510+0000","last_became_active":"2024-09-14T11:06:29.518775+0000","last_became_peered":"2024-09-14T11:06:29.518775+0000","last_unstale":"2024-09-14T12:42:21.511510+0000","last_undegraded":"2024-09-14T12:42:21.511510+0000","last_fullsized":"2024-09-14T12:42:21.511510+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:06:28.469133+0000","last_clean_scrub_stamp":"2024-09-14T11:06:28.469133+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":189,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:46.518361+0000","last_change":"2024-09-14T11:40:08.934946+0000","last_active":"2024-09-14T12:42:46.518361+0000","last_peered":"2024-09-14T12:42:46.518361+0000","last_clean":"2024-09-14T12:42:46.518361+0000","last_became_active":"2024-09-14T11:40:08.934173+0000","last_became_peered":"2024-09-14T11:40:08.934173+0000","last_unstale":"2024-09-14T12:42:46.518361+0000","last_undegraded":"2024-09-14T12:42:46.518361+0000","last_fullsized":"2024-09-14T12:42:46.518361+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"267'6","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.907542+0000","last_change":"2024-09-14T12:44:45.907542+0000","last_active":"2024-09-14T12:44:45.907542+0000","last_peered":"2024-09-14T12:44:45.907542+0000","last_clean":"2024-09-14T12:44:45.907542+0000","last_became_active":"2024-09-14T11:12:26.242532+0000","last_became_peered":"2024-09-14T11:12:26.242532+0000","last_unstale":"2024-09-14T12:44:45.907542+0000","last_undegraded":"2024-09-14T12:44:45.907542+0000","last_fullsized":"2024-09-14T12:44:45.907542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:44:45.907357+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:44:45.907357+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.907357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:45.964370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9208,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.014276+0000","last_change":"2024-09-14T12:44:42.014276+0000","last_active":"2024-09-14T12:44:42.014276+0000","last_peered":"2024-09-14T12:44:42.014276+0000","last_clean":"2024-09-14T12:44:42.014276+0000","last_became_active":"2024-09-14T11:12:19.115236+0000","last_became_peered":"2024-09-14T11:12:19.115236+0000","last_unstale":"2024-09-14T12:44:42.014276+0000","last_undegraded":"2024-09-14T12:44:42.014276+0000","last_fullsized":"2024-09-14T12:44:42.014276+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:42.014088+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:42.014088+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.014088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:47.858064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'6","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.053405+0000","last_change":"2024-09-14T12:44:37.053152+0000","last_active":"2024-09-14T12:44:37.053405+0000","last_peered":"2024-09-14T12:44:37.053405+0000","last_clean":"2024-09-14T12:44:37.053405+0000","last_became_active":"2024-09-14T11:06:29.525548+0000","last_became_peered":"2024-09-14T11:06:29.525548+0000","last_unstale":"2024-09-14T12:44:37.053405+0000","last_undegraded":"2024-09-14T12:44:37.053405+0000","last_fullsized":"2024-09-14T12:44:37.053405+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T12:44:37.052939+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T12:44:37.052939+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.052939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:59.273968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'395","reported_seq":1128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.241668+0000","last_change":"2024-09-14T12:44:20.241668+0000","last_active":"2024-09-14T12:44:20.241668+0000","last_peered":"2024-09-14T12:44:20.241668+0000","last_clean":"2024-09-14T12:44:20.241668+0000","last_became_active":"2024-09-14T10:49:23.372514+0000","last_became_peered":"2024-09-14T10:49:23.372514+0000","last_unstale":"2024-09-14T12:44:20.241668+0000","last_undegraded":"2024-09-14T12:44:20.241668+0000","last_fullsized":"2024-09-14T12:44:20.241668+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T12:44:20.241424+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T12:44:20.241424+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.241424+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:25.118550+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":698,"num_read_kb":89783,"num_write":1195,"num_write_kb":37856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'879","reported_seq":2591,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.049229+0000","last_change":"2024-09-14T12:44:23.049066+0000","last_active":"2024-09-14T12:44:23.049229+0000","last_peered":"2024-09-14T12:44:23.049229+0000","last_clean":"2024-09-14T12:44:23.049229+0000","last_became_active":"2024-09-14T10:49:25.368861+0000","last_became_peered":"2024-09-14T10:49:25.368861+0000","last_unstale":"2024-09-14T12:44:23.049229+0000","last_undegraded":"2024-09-14T12:44:23.049229+0000","last_fullsized":"2024-09-14T12:44:23.049229+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'879","last_scrub_stamp":"2024-09-14T12:44:23.048885+0000","last_deep_scrub":"267'879","last_deep_scrub_stamp":"2024-09-14T12:44:23.048885+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.048885+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:35:29.666443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4292,"num_read_kb":3786,"num_write":1290,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'389","reported_seq":1147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.841857+0000","last_change":"2024-09-14T12:44:23.841857+0000","last_active":"2024-09-14T12:44:23.841857+0000","last_peered":"2024-09-14T12:44:23.841857+0000","last_clean":"2024-09-14T12:44:23.841857+0000","last_became_active":"2024-09-14T10:49:23.386742+0000","last_became_peered":"2024-09-14T10:49:23.386742+0000","last_unstale":"2024-09-14T12:44:23.841857+0000","last_undegraded":"2024-09-14T12:44:23.841857+0000","last_fullsized":"2024-09-14T12:44:23.841857+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-09-14T12:44:23.841630+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-09-14T12:44:23.841630+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.841630+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:47.077958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":967,"num_read_kb":14779,"num_write":1188,"num_write_kb":22069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'1160","reported_seq":2822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.692483+0000","last_change":"2024-09-14T12:44:35.692483+0000","last_active":"2024-09-14T12:44:35.692483+0000","last_peered":"2024-09-14T12:44:35.692483+0000","last_clean":"2024-09-14T12:44:35.692483+0000","last_became_active":"2024-09-14T10:49:25.370610+0000","last_became_peered":"2024-09-14T10:49:25.370610+0000","last_unstale":"2024-09-14T12:44:35.692483+0000","last_undegraded":"2024-09-14T12:44:35.692483+0000","last_fullsized":"2024-09-14T12:44:35.692483+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1160","last_scrub_stamp":"2024-09-14T12:44:35.692262+0000","last_deep_scrub":"267'1160","last_deep_scrub_stamp":"2024-09-14T12:44:35.692262+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.692262+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:51.550361+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5343,"num_read_kb":4756,"num_write":1566,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'380","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.834788+0000","last_change":"2024-09-14T12:44:22.834788+0000","last_active":"2024-09-14T12:44:22.834788+0000","last_peered":"2024-09-14T12:44:22.834788+0000","last_clean":"2024-09-14T12:44:22.834788+0000","last_became_active":"2024-09-14T10:49:23.367647+0000","last_became_peered":"2024-09-14T10:49:23.367647+0000","last_unstale":"2024-09-14T12:44:22.834788+0000","last_undegraded":"2024-09-14T12:44:22.834788+0000","last_fullsized":"2024-09-14T12:44:22.834788+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-14T12:44:22.834585+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-14T12:44:22.834585+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.834585+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:40.778231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":20304,"num_write":1229,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1240","reported_seq":2841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.688467+0000","last_change":"2024-09-14T12:44:34.688467+0000","last_active":"2024-09-14T12:44:34.688467+0000","last_peered":"2024-09-14T12:44:34.688467+0000","last_clean":"2024-09-14T12:44:34.688467+0000","last_became_active":"2024-09-14T10:49:25.380525+0000","last_became_peered":"2024-09-14T10:49:25.380525+0000","last_unstale":"2024-09-14T12:44:34.688467+0000","last_undegraded":"2024-09-14T12:44:34.688467+0000","last_fullsized":"2024-09-14T12:44:34.688467+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1240","last_scrub_stamp":"2024-09-14T12:44:34.688273+0000","last_deep_scrub":"267'1240","last_deep_scrub_stamp":"2024-09-14T12:44:34.688273+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.688273+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:58.651664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5594,"num_read_kb":4933,"num_write":1701,"num_write_kb":712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.857351+0000","last_change":"2024-09-14T12:44:15.857351+0000","last_active":"2024-09-14T12:44:15.857351+0000","last_peered":"2024-09-14T12:44:15.857351+0000","last_clean":"2024-09-14T12:44:15.857351+0000","last_became_active":"2024-09-14T10:49:23.395029+0000","last_became_peered":"2024-09-14T10:49:23.395029+0000","last_unstale":"2024-09-14T12:44:15.857351+0000","last_undegraded":"2024-09-14T12:44:15.857351+0000","last_fullsized":"2024-09-14T12:44:15.857351+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-09-14T12:44:15.857104+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-09-14T12:44:15.857104+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.857104+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:35.578952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":13844,"num_write":1136,"num_write_kb":32575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'923","reported_seq":2548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.832708+0000","last_change":"2024-09-14T12:44:26.832708+0000","last_active":"2024-09-14T12:44:26.832708+0000","last_peered":"2024-09-14T12:44:26.832708+0000","last_clean":"2024-09-14T12:44:26.832708+0000","last_became_active":"2024-09-14T10:49:25.368723+0000","last_became_peered":"2024-09-14T10:49:25.368723+0000","last_unstale":"2024-09-14T12:44:26.832708+0000","last_undegraded":"2024-09-14T12:44:26.832708+0000","last_fullsized":"2024-09-14T12:44:26.832708+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'923","last_scrub_stamp":"2024-09-14T12:44:26.832504+0000","last_deep_scrub":"267'923","last_deep_scrub_stamp":"2024-09-14T12:44:26.832504+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.832504+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:38.827676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6457,"num_read_kb":5960,"num_write":1431,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'365","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.327853+0000","last_change":"2024-09-14T12:44:18.327687+0000","last_active":"2024-09-14T12:44:18.327853+0000","last_peered":"2024-09-14T12:44:18.327853+0000","last_clean":"2024-09-14T12:44:18.327853+0000","last_became_active":"2024-09-14T10:49:23.396952+0000","last_became_peered":"2024-09-14T10:49:23.396952+0000","last_unstale":"2024-09-14T12:44:18.327853+0000","last_undegraded":"2024-09-14T12:44:18.327853+0000","last_fullsized":"2024-09-14T12:44:18.327853+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-14T12:44:18.327453+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-14T12:44:18.327453+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.327453+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:39.003445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":730,"num_read_kb":15587,"num_write":1249,"num_write_kb":19198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'490","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.118914+0000","last_change":"2024-09-14T12:44:24.118914+0000","last_active":"2024-09-14T12:44:24.118914+0000","last_peered":"2024-09-14T12:44:24.118914+0000","last_clean":"2024-09-14T12:44:24.118914+0000","last_became_active":"2024-09-14T10:49:25.369197+0000","last_became_peered":"2024-09-14T10:49:25.369197+0000","last_unstale":"2024-09-14T12:44:24.118914+0000","last_undegraded":"2024-09-14T12:44:24.118914+0000","last_fullsized":"2024-09-14T12:44:24.118914+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-14T12:44:24.118736+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-14T12:44:24.118736+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.118736+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:43.727353+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2591,"num_write":558,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'328","reported_seq":987,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.891194+0000","last_change":"2024-09-14T12:44:14.891054+0000","last_active":"2024-09-14T12:44:14.891194+0000","last_peered":"2024-09-14T12:44:14.891194+0000","last_clean":"2024-09-14T12:44:14.891194+0000","last_became_active":"2024-09-14T10:49:23.386773+0000","last_became_peered":"2024-09-14T10:49:23.386773+0000","last_unstale":"2024-09-14T12:44:14.891194+0000","last_undegraded":"2024-09-14T12:44:14.891194+0000","last_fullsized":"2024-09-14T12:44:14.891194+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-14T12:44:14.890841+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-14T12:44:14.890841+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.890841+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:33.495347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":548,"num_read_kb":8718,"num_write":1059,"num_write_kb":39714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'430","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.155332+0000","last_change":"2024-09-14T12:44:25.155332+0000","last_active":"2024-09-14T12:44:25.155332+0000","last_peered":"2024-09-14T12:44:25.155332+0000","last_clean":"2024-09-14T12:44:25.155332+0000","last_became_active":"2024-09-14T10:49:25.404189+0000","last_became_peered":"2024-09-14T10:49:25.404189+0000","last_unstale":"2024-09-14T12:44:25.155332+0000","last_undegraded":"2024-09-14T12:44:25.155332+0000","last_fullsized":"2024-09-14T12:44:25.155332+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-14T12:44:25.155091+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-14T12:44:25.155091+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.155091+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:47.356155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2519,"num_read_kb":2387,"num_write":515,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'405","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.416312+0000","last_change":"2024-09-14T12:44:15.416147+0000","last_active":"2024-09-14T12:44:15.416312+0000","last_peered":"2024-09-14T12:44:15.416312+0000","last_clean":"2024-09-14T12:44:15.416312+0000","last_became_active":"2024-09-14T10:49:23.353824+0000","last_became_peered":"2024-09-14T10:49:23.353824+0000","last_unstale":"2024-09-14T12:44:15.416312+0000","last_undegraded":"2024-09-14T12:44:15.416312+0000","last_fullsized":"2024-09-14T12:44:15.416312+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'405","last_scrub_stamp":"2024-09-14T12:44:15.415866+0000","last_deep_scrub":"267'405","last_deep_scrub_stamp":"2024-09-14T12:44:15.415866+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.415866+0000","objects_scrubbed":12,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:43.030406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":687,"num_read_kb":3209,"num_write":1301,"num_write_kb":30473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'1239","reported_seq":2952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.863432+0000","last_change":"2024-09-14T12:44:23.863432+0000","last_active":"2024-09-14T12:44:23.863432+0000","last_peered":"2024-09-14T12:44:23.863432+0000","last_clean":"2024-09-14T12:44:23.863432+0000","last_became_active":"2024-09-14T10:49:25.388008+0000","last_became_peered":"2024-09-14T10:49:25.388008+0000","last_unstale":"2024-09-14T12:44:23.863432+0000","last_undegraded":"2024-09-14T12:44:23.863432+0000","last_fullsized":"2024-09-14T12:44:23.863432+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1239","last_scrub_stamp":"2024-09-14T12:44:23.863231+0000","last_deep_scrub":"267'1239","last_deep_scrub_stamp":"2024-09-14T12:44:23.863231+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.863231+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:30.652457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5023,"num_write":1696,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'317","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.811876+0000","last_change":"2024-09-14T12:44:21.811716+0000","last_active":"2024-09-14T12:44:21.811876+0000","last_peered":"2024-09-14T12:44:21.811876+0000","last_clean":"2024-09-14T12:44:21.811876+0000","last_became_active":"2024-09-14T10:49:23.374194+0000","last_became_peered":"2024-09-14T10:49:23.374194+0000","last_unstale":"2024-09-14T12:44:21.811876+0000","last_undegraded":"2024-09-14T12:44:21.811876+0000","last_fullsized":"2024-09-14T12:44:21.811876+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-14T12:44:21.811471+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-14T12:44:21.811471+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.811471+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:14:34.008333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730149,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":30724,"num_write":962,"num_write_kb":46577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'766","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.970390+0000","last_change":"2024-09-14T12:44:30.970390+0000","last_active":"2024-09-14T12:44:30.970390+0000","last_peered":"2024-09-14T12:44:30.970390+0000","last_clean":"2024-09-14T12:44:30.970390+0000","last_became_active":"2024-09-14T10:49:25.395625+0000","last_became_peered":"2024-09-14T10:49:25.395625+0000","last_unstale":"2024-09-14T12:44:30.970390+0000","last_undegraded":"2024-09-14T12:44:30.970390+0000","last_fullsized":"2024-09-14T12:44:30.970390+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'766","last_scrub_stamp":"2024-09-14T12:44:30.970201+0000","last_deep_scrub":"267'766","last_deep_scrub_stamp":"2024-09-14T12:44:30.970201+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.970201+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:00.805728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3607,"num_read_kb":3221,"num_write":1031,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'928","reported_seq":2623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.642891+0000","last_change":"2024-09-14T12:44:31.642891+0000","last_active":"2024-09-14T12:44:31.642891+0000","last_peered":"2024-09-14T12:44:31.642891+0000","last_clean":"2024-09-14T12:44:31.642891+0000","last_became_active":"2024-09-14T10:49:25.377697+0000","last_became_peered":"2024-09-14T10:49:25.377697+0000","last_unstale":"2024-09-14T12:44:31.642891+0000","last_undegraded":"2024-09-14T12:44:31.642891+0000","last_fullsized":"2024-09-14T12:44:31.642891+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'928","last_scrub_stamp":"2024-09-14T12:44:31.642716+0000","last_deep_scrub":"267'928","last_deep_scrub_stamp":"2024-09-14T12:44:31.642716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.642716+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.252576+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4426,"num_read_kb":3954,"num_write":1251,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'319","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.982570+0000","last_change":"2024-09-14T12:44:14.982570+0000","last_active":"2024-09-14T12:44:14.982570+0000","last_peered":"2024-09-14T12:44:14.982570+0000","last_clean":"2024-09-14T12:44:14.982570+0000","last_became_active":"2024-09-14T10:49:23.395881+0000","last_became_peered":"2024-09-14T10:49:23.395881+0000","last_unstale":"2024-09-14T12:44:14.982570+0000","last_undegraded":"2024-09-14T12:44:14.982570+0000","last_fullsized":"2024-09-14T12:44:14.982570+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-14T12:44:14.982349+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-14T12:44:14.982349+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.982349+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.098578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":45321,"num_write":937,"num_write_kb":34104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'503","reported_seq":2246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.198419+0000","last_change":"2024-09-14T12:44:21.198419+0000","last_active":"2024-09-14T12:44:21.198419+0000","last_peered":"2024-09-14T12:44:21.198419+0000","last_clean":"2024-09-14T12:44:21.198419+0000","last_became_active":"2024-09-14T10:49:25.359419+0000","last_became_peered":"2024-09-14T10:49:25.359419+0000","last_unstale":"2024-09-14T12:44:21.198419+0000","last_undegraded":"2024-09-14T12:44:21.198419+0000","last_fullsized":"2024-09-14T12:44:21.198419+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'503","last_scrub_stamp":"2024-09-14T12:44:21.198212+0000","last_deep_scrub":"267'503","last_deep_scrub_stamp":"2024-09-14T12:44:21.198212+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.198212+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:09.718517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2958,"num_read_kb":2787,"num_write":621,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'335","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.375590+0000","last_change":"2024-09-14T12:44:17.375590+0000","last_active":"2024-09-14T12:44:17.375590+0000","last_peered":"2024-09-14T12:44:17.375590+0000","last_clean":"2024-09-14T12:44:17.375590+0000","last_became_active":"2024-09-14T10:49:23.372672+0000","last_became_peered":"2024-09-14T10:49:23.372672+0000","last_unstale":"2024-09-14T12:44:17.375590+0000","last_undegraded":"2024-09-14T12:44:17.375590+0000","last_fullsized":"2024-09-14T12:44:17.375590+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-14T12:44:17.375353+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-14T12:44:17.375353+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.375353+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:32.309861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":589,"num_read_kb":8965,"num_write":1037,"num_write_kb":20473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'402","reported_seq":1920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.005658+0000","last_change":"2024-09-14T12:44:21.005658+0000","last_active":"2024-09-14T12:44:21.005658+0000","last_peered":"2024-09-14T12:44:21.005658+0000","last_clean":"2024-09-14T12:44:21.005658+0000","last_became_active":"2024-09-14T10:49:25.403885+0000","last_became_peered":"2024-09-14T10:49:25.403885+0000","last_unstale":"2024-09-14T12:44:21.005658+0000","last_undegraded":"2024-09-14T12:44:21.005658+0000","last_fullsized":"2024-09-14T12:44:21.005658+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:21.005460+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:21.005460+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.005460+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:39.200942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2137,"num_read_kb":2023,"num_write":462,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'394","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.346147+0000","last_change":"2024-09-14T12:44:13.346147+0000","last_active":"2024-09-14T12:44:13.346147+0000","last_peered":"2024-09-14T12:44:13.346147+0000","last_clean":"2024-09-14T12:44:13.346147+0000","last_became_active":"2024-09-14T10:49:23.354127+0000","last_became_peered":"2024-09-14T10:49:23.354127+0000","last_unstale":"2024-09-14T12:44:13.346147+0000","last_undegraded":"2024-09-14T12:44:13.346147+0000","last_fullsized":"2024-09-14T12:44:13.346147+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'394","last_scrub_stamp":"2024-09-14T12:44:13.345931+0000","last_deep_scrub":"267'394","last_deep_scrub_stamp":"2024-09-14T12:44:13.345931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.345931+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:48.706335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":781,"num_read_kb":56952,"num_write":1264,"num_write_kb":28690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"267'805","reported_seq":2357,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.811470+0000","last_change":"2024-09-14T12:44:24.811470+0000","last_active":"2024-09-14T12:44:24.811470+0000","last_peered":"2024-09-14T12:44:24.811470+0000","last_clean":"2024-09-14T12:44:24.811470+0000","last_became_active":"2024-09-14T10:49:25.396001+0000","last_became_peered":"2024-09-14T10:49:25.396001+0000","last_unstale":"2024-09-14T12:44:24.811470+0000","last_undegraded":"2024-09-14T12:44:24.811470+0000","last_fullsized":"2024-09-14T12:44:24.811470+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'805","last_scrub_stamp":"2024-09-14T12:44:24.811267+0000","last_deep_scrub":"267'805","last_deep_scrub_stamp":"2024-09-14T12:44:24.811267+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.811267+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:43:01.444670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3888,"num_read_kb":3489,"num_write":1086,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1380,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'386","reported_seq":1183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.337240+0000","last_change":"2024-09-14T12:44:12.337240+0000","last_active":"2024-09-14T12:44:12.337240+0000","last_peered":"2024-09-14T12:44:12.337240+0000","last_clean":"2024-09-14T12:44:12.337240+0000","last_became_active":"2024-09-14T10:49:23.387292+0000","last_became_peered":"2024-09-14T10:49:23.387292+0000","last_unstale":"2024-09-14T12:44:12.337240+0000","last_undegraded":"2024-09-14T12:44:12.337240+0000","last_fullsized":"2024-09-14T12:44:12.337240+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T12:44:12.337076+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T12:44:12.337076+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.337076+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:05.269545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":721,"num_read_kb":37760,"num_write":1195,"num_write_kb":55114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'374","reported_seq":1811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.937851+0000","last_change":"2024-09-14T12:44:29.937851+0000","last_active":"2024-09-14T12:44:29.937851+0000","last_peered":"2024-09-14T12:44:29.937851+0000","last_clean":"2024-09-14T12:44:29.937851+0000","last_became_active":"2024-09-14T10:49:25.394106+0000","last_became_peered":"2024-09-14T10:49:25.394106+0000","last_unstale":"2024-09-14T12:44:29.937851+0000","last_undegraded":"2024-09-14T12:44:29.937851+0000","last_fullsized":"2024-09-14T12:44:29.937851+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:29.937641+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:29.937641+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.937641+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:07.766027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2013,"num_read_kb":1909,"num_write":433,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'428","reported_seq":1109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.764159+0000","last_change":"2024-09-14T12:44:17.764159+0000","last_active":"2024-09-14T12:44:17.764159+0000","last_peered":"2024-09-14T12:44:17.764159+0000","last_clean":"2024-09-14T12:44:17.764159+0000","last_became_active":"2024-09-14T10:49:23.364035+0000","last_became_peered":"2024-09-14T10:49:23.364035+0000","last_unstale":"2024-09-14T12:44:17.764159+0000","last_undegraded":"2024-09-14T12:44:17.764159+0000","last_fullsized":"2024-09-14T12:44:17.764159+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'428","last_scrub_stamp":"2024-09-14T12:44:17.763953+0000","last_deep_scrub":"267'428","last_deep_scrub_stamp":"2024-09-14T12:44:17.763953+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.763953+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:02.372941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":874,"num_read_kb":15225,"num_write":1232,"num_write_kb":26982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'781","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.009755+0000","last_change":"2024-09-14T12:44:22.009755+0000","last_active":"2024-09-14T12:44:22.009755+0000","last_peered":"2024-09-14T12:44:22.009755+0000","last_clean":"2024-09-14T12:44:22.009755+0000","last_became_active":"2024-09-14T10:49:25.371736+0000","last_became_peered":"2024-09-14T10:49:25.371736+0000","last_unstale":"2024-09-14T12:44:22.009755+0000","last_undegraded":"2024-09-14T12:44:22.009755+0000","last_fullsized":"2024-09-14T12:44:22.009755+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-14T12:44:22.009539+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-14T12:44:22.009539+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.009539+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:37.997398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3876,"num_read_kb":3539,"num_write":1018,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'324","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.754320+0000","last_change":"2024-09-14T12:44:19.754320+0000","last_active":"2024-09-14T12:44:19.754320+0000","last_peered":"2024-09-14T12:44:19.754320+0000","last_clean":"2024-09-14T12:44:19.754320+0000","last_became_active":"2024-09-14T10:49:23.378269+0000","last_became_peered":"2024-09-14T10:49:23.378269+0000","last_unstale":"2024-09-14T12:44:19.754320+0000","last_undegraded":"2024-09-14T12:44:19.754320+0000","last_fullsized":"2024-09-14T12:44:19.754320+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-14T12:44:19.754019+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-14T12:44:19.754019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.754019+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:31.083867+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":531,"num_read_kb":35954,"num_write":1090,"num_write_kb":39786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'146","reported_seq":689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.118227+0000","last_change":"2024-09-14T12:44:36.118227+0000","last_active":"2024-09-14T12:44:36.118227+0000","last_peered":"2024-09-14T12:44:36.118227+0000","last_clean":"2024-09-14T12:44:36.118227+0000","last_became_active":"2024-09-14T10:49:33.464427+0000","last_became_peered":"2024-09-14T10:49:33.464427+0000","last_unstale":"2024-09-14T12:44:36.118227+0000","last_undegraded":"2024-09-14T12:44:36.118227+0000","last_fullsized":"2024-09-14T12:44:36.118227+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-14T12:44:36.118026+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-14T12:44:36.118026+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.118026+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.250408+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":140,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'436","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.764177+0000","last_change":"2024-09-14T12:44:23.764177+0000","last_active":"2024-09-14T12:44:23.764177+0000","last_peered":"2024-09-14T12:44:23.764177+0000","last_clean":"2024-09-14T12:44:23.764177+0000","last_became_active":"2024-09-14T10:49:25.379409+0000","last_became_peered":"2024-09-14T10:49:25.379409+0000","last_unstale":"2024-09-14T12:44:23.764177+0000","last_undegraded":"2024-09-14T12:44:23.764177+0000","last_fullsized":"2024-09-14T12:44:23.764177+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'436","last_scrub_stamp":"2024-09-14T12:44:23.763977+0000","last_deep_scrub":"267'436","last_deep_scrub_stamp":"2024-09-14T12:44:23.763977+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.763977+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:39.979945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2548,"num_read_kb":2434,"num_write":516,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'355","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.685459+0000","last_change":"2024-09-14T12:44:21.685459+0000","last_active":"2024-09-14T12:44:21.685459+0000","last_peered":"2024-09-14T12:44:21.685459+0000","last_clean":"2024-09-14T12:44:21.685459+0000","last_became_active":"2024-09-14T10:49:23.365630+0000","last_became_peered":"2024-09-14T10:49:23.365630+0000","last_unstale":"2024-09-14T12:44:21.685459+0000","last_undegraded":"2024-09-14T12:44:21.685459+0000","last_fullsized":"2024-09-14T12:44:21.685459+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'355","last_scrub_stamp":"2024-09-14T12:44:21.685251+0000","last_deep_scrub":"267'355","last_deep_scrub_stamp":"2024-09-14T12:44:21.685251+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.685251+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:58.835156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":11787,"num_write":1186,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.657644+0000","last_change":"2024-09-14T12:44:41.657644+0000","last_active":"2024-09-14T12:44:41.657644+0000","last_peered":"2024-09-14T12:44:41.657644+0000","last_clean":"2024-09-14T12:44:41.657644+0000","last_became_active":"2024-09-14T10:49:27.387803+0000","last_became_peered":"2024-09-14T10:49:27.387803+0000","last_unstale":"2024-09-14T12:44:41.657644+0000","last_undegraded":"2024-09-14T12:44:41.657644+0000","last_fullsized":"2024-09-14T12:44:41.657644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.657431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.657431+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.657431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:59.045915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'393","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.923884+0000","last_change":"2024-09-14T12:44:38.923884+0000","last_active":"2024-09-14T12:44:38.923884+0000","last_peered":"2024-09-14T12:44:38.923884+0000","last_clean":"2024-09-14T12:44:38.923884+0000","last_became_active":"2024-09-14T10:49:29.386799+0000","last_became_peered":"2024-09-14T10:49:29.386799+0000","last_unstale":"2024-09-14T12:44:38.923884+0000","last_undegraded":"2024-09-14T12:44:38.923884+0000","last_fullsized":"2024-09-14T12:44:38.923884+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'393","last_scrub_stamp":"2024-09-14T12:44:38.923710+0000","last_deep_scrub":"267'393","last_deep_scrub_stamp":"2024-09-14T12:44:38.923710+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.923710+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:34:45.084082+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":1248,"num_write":488,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.978310+0000","last_change":"2024-09-14T12:44:35.978310+0000","last_active":"2024-09-14T12:44:35.978310+0000","last_peered":"2024-09-14T12:44:35.978310+0000","last_clean":"2024-09-14T12:44:35.978310+0000","last_became_active":"2024-09-14T10:49:31.407831+0000","last_became_peered":"2024-09-14T10:49:31.407831+0000","last_unstale":"2024-09-14T12:44:35.978310+0000","last_undegraded":"2024-09-14T12:44:35.978310+0000","last_fullsized":"2024-09-14T12:44:35.978310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:35.978133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:35.978133+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.978133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:09.426844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'141","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.986180+0000","last_change":"2024-09-14T12:44:40.986180+0000","last_active":"2024-09-14T12:44:40.986180+0000","last_peered":"2024-09-14T12:44:40.986180+0000","last_clean":"2024-09-14T12:44:40.986180+0000","last_became_active":"2024-09-14T10:49:33.474458+0000","last_became_peered":"2024-09-14T10:49:33.474458+0000","last_unstale":"2024-09-14T12:44:40.986180+0000","last_undegraded":"2024-09-14T12:44:40.986180+0000","last_fullsized":"2024-09-14T12:44:40.986180+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T12:44:40.985995+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T12:44:40.985995+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.985995+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:08.181189+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":162,"num_write":341,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'696","reported_seq":2375,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.675073+0000","last_change":"2024-09-14T12:44:30.675073+0000","last_active":"2024-09-14T12:44:30.675073+0000","last_peered":"2024-09-14T12:44:30.675073+0000","last_clean":"2024-09-14T12:44:30.675073+0000","last_became_active":"2024-09-14T10:49:25.375112+0000","last_became_peered":"2024-09-14T10:49:25.375112+0000","last_unstale":"2024-09-14T12:44:30.675073+0000","last_undegraded":"2024-09-14T12:44:30.675073+0000","last_fullsized":"2024-09-14T12:44:30.675073+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'696","last_scrub_stamp":"2024-09-14T12:44:30.674832+0000","last_deep_scrub":"267'696","last_deep_scrub_stamp":"2024-09-14T12:44:30.674832+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.674832+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:57.902612+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3284,"num_write":889,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'444","reported_seq":1127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.709594+0000","last_change":"2024-09-14T12:44:13.709594+0000","last_active":"2024-09-14T12:44:13.709594+0000","last_peered":"2024-09-14T12:44:13.709594+0000","last_clean":"2024-09-14T12:44:13.709594+0000","last_became_active":"2024-09-14T10:49:23.384801+0000","last_became_peered":"2024-09-14T10:49:23.384801+0000","last_unstale":"2024-09-14T12:44:13.709594+0000","last_undegraded":"2024-09-14T12:44:13.709594+0000","last_fullsized":"2024-09-14T12:44:13.709594+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'444","last_scrub_stamp":"2024-09-14T12:44:13.709388+0000","last_deep_scrub":"267'444","last_deep_scrub_stamp":"2024-09-14T12:44:13.709388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.709388+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:35.749429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":748,"num_read_kb":6714,"num_write":1308,"num_write_kb":31721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.944680+0000","last_change":"2024-09-14T12:44:30.944680+0000","last_active":"2024-09-14T12:44:30.944680+0000","last_peered":"2024-09-14T12:44:30.944680+0000","last_clean":"2024-09-14T12:44:30.944680+0000","last_became_active":"2024-09-14T10:49:27.378702+0000","last_became_peered":"2024-09-14T10:49:27.378702+0000","last_unstale":"2024-09-14T12:44:30.944680+0000","last_undegraded":"2024-09-14T12:44:30.944680+0000","last_fullsized":"2024-09-14T12:44:30.944680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.944442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.944442+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.944442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:56.936931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'130","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.023597+0000","last_change":"2024-09-14T12:44:31.023597+0000","last_active":"2024-09-14T12:44:31.023597+0000","last_peered":"2024-09-14T12:44:31.023597+0000","last_clean":"2024-09-14T12:44:31.023597+0000","last_became_active":"2024-09-14T10:49:29.398354+0000","last_became_peered":"2024-09-14T10:49:29.398354+0000","last_unstale":"2024-09-14T12:44:31.023597+0000","last_undegraded":"2024-09-14T12:44:31.023597+0000","last_fullsized":"2024-09-14T12:44:31.023597+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'130","last_scrub_stamp":"2024-09-14T12:44:31.023398+0000","last_deep_scrub":"267'130","last_deep_scrub_stamp":"2024-09-14T12:44:31.023398+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.023398+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:28.834905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.956210+0000","last_change":"2024-09-14T12:44:34.956210+0000","last_active":"2024-09-14T12:44:34.956210+0000","last_peered":"2024-09-14T12:44:34.956210+0000","last_clean":"2024-09-14T12:44:34.956210+0000","last_became_active":"2024-09-14T10:49:31.433431+0000","last_became_peered":"2024-09-14T10:49:31.433431+0000","last_unstale":"2024-09-14T12:44:34.956210+0000","last_undegraded":"2024-09-14T12:44:34.956210+0000","last_fullsized":"2024-09-14T12:44:34.956210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:34.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:34.956037+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.956037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:10.177612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'120","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.860408+0000","last_change":"2024-09-14T12:44:39.860408+0000","last_active":"2024-09-14T12:44:39.860408+0000","last_peered":"2024-09-14T12:44:39.860408+0000","last_clean":"2024-09-14T12:44:39.860408+0000","last_became_active":"2024-09-14T10:49:33.463124+0000","last_became_peered":"2024-09-14T10:49:33.463124+0000","last_unstale":"2024-09-14T12:44:39.860408+0000","last_undegraded":"2024-09-14T12:44:39.860408+0000","last_fullsized":"2024-09-14T12:44:39.860408+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-14T12:44:39.860275+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-14T12:44:39.860275+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.860275+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:29.364501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'851","reported_seq":2509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.018574+0000","last_change":"2024-09-14T12:44:41.018574+0000","last_active":"2024-09-14T12:44:41.018574+0000","last_peered":"2024-09-14T12:44:41.018574+0000","last_clean":"2024-09-14T12:44:41.018574+0000","last_became_active":"2024-09-14T10:49:25.385678+0000","last_became_peered":"2024-09-14T10:49:25.385678+0000","last_unstale":"2024-09-14T12:44:41.018574+0000","last_undegraded":"2024-09-14T12:44:41.018574+0000","last_fullsized":"2024-09-14T12:44:41.018574+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-14T12:44:41.018389+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-14T12:44:41.018389+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.018389+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:48.677271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4238,"num_read_kb":3841,"num_write":1159,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'381","reported_seq":1285,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.727211+0000","last_change":"2024-09-14T12:44:17.727211+0000","last_active":"2024-09-14T12:44:17.727211+0000","last_peered":"2024-09-14T12:44:17.727211+0000","last_clean":"2024-09-14T12:44:17.727211+0000","last_became_active":"2024-09-14T10:49:23.371893+0000","last_became_peered":"2024-09-14T10:49:23.371893+0000","last_unstale":"2024-09-14T12:44:17.727211+0000","last_undegraded":"2024-09-14T12:44:17.727211+0000","last_fullsized":"2024-09-14T12:44:17.727211+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-09-14T12:44:17.726976+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-09-14T12:44:17.726976+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.726976+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:08.246693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1366,"num_read_kb":59405,"num_write":1145,"num_write_kb":37706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.992777+0000","last_change":"2024-09-14T12:44:31.992777+0000","last_active":"2024-09-14T12:44:31.992777+0000","last_peered":"2024-09-14T12:44:31.992777+0000","last_clean":"2024-09-14T12:44:31.992777+0000","last_became_active":"2024-09-14T10:49:27.379355+0000","last_became_peered":"2024-09-14T10:49:27.379355+0000","last_unstale":"2024-09-14T12:44:31.992777+0000","last_undegraded":"2024-09-14T12:44:31.992777+0000","last_fullsized":"2024-09-14T12:44:31.992777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.992552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.992552+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.992552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:34.780168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'186","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.944935+0000","last_change":"2024-09-14T12:44:37.944935+0000","last_active":"2024-09-14T12:44:37.944935+0000","last_peered":"2024-09-14T12:44:37.944935+0000","last_clean":"2024-09-14T12:44:37.944935+0000","last_became_active":"2024-09-14T10:49:29.386264+0000","last_became_peered":"2024-09-14T10:49:29.386264+0000","last_unstale":"2024-09-14T12:44:37.944935+0000","last_undegraded":"2024-09-14T12:44:37.944935+0000","last_fullsized":"2024-09-14T12:44:37.944935+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T12:44:37.944716+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T12:44:37.944716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.944716+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:13.665228+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'810","reported_seq":3021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:02.149377+0000","last_change":"2024-09-14T10:49:31.432319+0000","last_active":"2024-09-14T12:44:02.149377+0000","last_peered":"2024-09-14T12:44:02.149377+0000","last_clean":"2024-09-14T12:44:02.149377+0000","last_became_active":"2024-09-14T10:49:31.431702+0000","last_became_peered":"2024-09-14T10:49:31.431702+0000","last_unstale":"2024-09-14T12:44:02.149377+0000","last_undegraded":"2024-09-14T12:44:02.149377+0000","last_fullsized":"2024-09-14T12:44:02.149377+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:52.750405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'218","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.048157+0000","last_change":"2024-09-14T12:44:38.048157+0000","last_active":"2024-09-14T12:44:38.048157+0000","last_peered":"2024-09-14T12:44:38.048157+0000","last_clean":"2024-09-14T12:44:38.048157+0000","last_became_active":"2024-09-14T10:49:33.472433+0000","last_became_peered":"2024-09-14T10:49:33.472433+0000","last_unstale":"2024-09-14T12:44:38.048157+0000","last_undegraded":"2024-09-14T12:44:38.048157+0000","last_fullsized":"2024-09-14T12:44:38.048157+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-14T12:44:38.047935+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-14T12:44:38.047935+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.047935+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:53.365245+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":612,"num_write":471,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'454","reported_seq":2023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.904764+0000","last_change":"2024-09-14T12:44:26.904764+0000","last_active":"2024-09-14T12:44:26.904764+0000","last_peered":"2024-09-14T12:44:26.904764+0000","last_clean":"2024-09-14T12:44:26.904764+0000","last_became_active":"2024-09-14T10:49:25.395255+0000","last_became_peered":"2024-09-14T10:49:25.395255+0000","last_unstale":"2024-09-14T12:44:26.904764+0000","last_undegraded":"2024-09-14T12:44:26.904764+0000","last_fullsized":"2024-09-14T12:44:26.904764+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-09-14T12:44:26.904534+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-09-14T12:44:26.904534+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.904534+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:00.169555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2444,"num_read_kb":2309,"num_write":533,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'370","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.932856+0000","last_change":"2024-09-14T12:44:10.932856+0000","last_active":"2024-09-14T12:44:10.932856+0000","last_peered":"2024-09-14T12:44:10.932856+0000","last_clean":"2024-09-14T12:44:10.932856+0000","last_became_active":"2024-09-14T10:49:23.403079+0000","last_became_peered":"2024-09-14T10:49:23.403079+0000","last_unstale":"2024-09-14T12:44:10.932856+0000","last_undegraded":"2024-09-14T12:44:10.932856+0000","last_fullsized":"2024-09-14T12:44:10.932856+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-14T12:44:10.932702+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-14T12:44:10.932702+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.932702+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.564642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":46335,"num_write":1122,"num_write_kb":49327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.643614+0000","last_change":"2024-09-14T12:44:40.643614+0000","last_active":"2024-09-14T12:44:40.643614+0000","last_peered":"2024-09-14T12:44:40.643614+0000","last_clean":"2024-09-14T12:44:40.643614+0000","last_became_active":"2024-09-14T10:49:27.391823+0000","last_became_peered":"2024-09-14T10:49:27.391823+0000","last_unstale":"2024-09-14T12:44:40.643614+0000","last_undegraded":"2024-09-14T12:44:40.643614+0000","last_fullsized":"2024-09-14T12:44:40.643614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:40.643389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:40.643389+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.643389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:52.890279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'329","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.928959+0000","last_change":"2024-09-14T12:44:27.928959+0000","last_active":"2024-09-14T12:44:27.928959+0000","last_peered":"2024-09-14T12:44:27.928959+0000","last_clean":"2024-09-14T12:44:27.928959+0000","last_became_active":"2024-09-14T10:49:29.385023+0000","last_became_peered":"2024-09-14T10:49:29.385023+0000","last_unstale":"2024-09-14T12:44:27.928959+0000","last_undegraded":"2024-09-14T12:44:27.928959+0000","last_fullsized":"2024-09-14T12:44:27.928959+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-09-14T12:44:27.928763+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-09-14T12:44:27.928763+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.928763+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:43.341736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":526,"num_read_kb":1146,"num_write":424,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'828","reported_seq":5670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.983482+0000","last_change":"2024-09-14T12:44:41.983482+0000","last_active":"2024-09-14T12:44:41.983482+0000","last_peered":"2024-09-14T12:44:41.983482+0000","last_clean":"2024-09-14T12:44:41.983482+0000","last_became_active":"2024-09-14T10:49:31.424873+0000","last_became_peered":"2024-09-14T10:49:31.424873+0000","last_unstale":"2024-09-14T12:44:41.983482+0000","last_undegraded":"2024-09-14T12:44:41.983482+0000","last_fullsized":"2024-09-14T12:44:41.983482+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'828","last_scrub_stamp":"2024-09-14T12:44:41.983295+0000","last_deep_scrub":"267'828","last_deep_scrub_stamp":"2024-09-14T12:44:41.983295+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.983295+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.782440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'494","reported_seq":2127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.609765+0000","last_change":"2024-09-14T12:44:28.609765+0000","last_active":"2024-09-14T12:44:28.609765+0000","last_peered":"2024-09-14T12:44:28.609765+0000","last_clean":"2024-09-14T12:44:28.609765+0000","last_became_active":"2024-09-14T10:49:25.372711+0000","last_became_peered":"2024-09-14T10:49:25.372711+0000","last_unstale":"2024-09-14T12:44:28.609765+0000","last_undegraded":"2024-09-14T12:44:28.609765+0000","last_fullsized":"2024-09-14T12:44:28.609765+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-09-14T12:44:28.609502+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-09-14T12:44:28.609502+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.609502+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:41.369304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2694,"num_read_kb":2523,"num_write":626,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'395","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.372090+0000","last_change":"2024-09-14T12:44:14.371801+0000","last_active":"2024-09-14T12:44:14.372090+0000","last_peered":"2024-09-14T12:44:14.372090+0000","last_clean":"2024-09-14T12:44:14.372090+0000","last_became_active":"2024-09-14T10:49:23.363126+0000","last_became_peered":"2024-09-14T10:49:23.363126+0000","last_unstale":"2024-09-14T12:44:14.372090+0000","last_undegraded":"2024-09-14T12:44:14.372090+0000","last_fullsized":"2024-09-14T12:44:14.372090+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T12:44:14.371349+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T12:44:14.371349+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.371349+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:18.212093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":10241,"num_write":1214,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.064863+0000","last_change":"2024-09-14T12:44:24.064863+0000","last_active":"2024-09-14T12:44:24.064863+0000","last_peered":"2024-09-14T12:44:24.064863+0000","last_clean":"2024-09-14T12:44:24.064863+0000","last_became_active":"2024-09-14T10:49:27.380063+0000","last_became_peered":"2024-09-14T10:49:27.380063+0000","last_unstale":"2024-09-14T12:44:24.064863+0000","last_undegraded":"2024-09-14T12:44:24.064863+0000","last_fullsized":"2024-09-14T12:44:24.064863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.064652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.064652+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.064652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.956294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'450","reported_seq":1164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.174305+0000","last_change":"2024-09-14T12:44:29.174135+0000","last_active":"2024-09-14T12:44:29.174305+0000","last_peered":"2024-09-14T12:44:29.174305+0000","last_clean":"2024-09-14T12:44:29.174305+0000","last_became_active":"2024-09-14T10:49:29.383306+0000","last_became_peered":"2024-09-14T10:49:29.383306+0000","last_unstale":"2024-09-14T12:44:29.174305+0000","last_undegraded":"2024-09-14T12:44:29.174305+0000","last_fullsized":"2024-09-14T12:44:29.174305+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'450","last_scrub_stamp":"2024-09-14T12:44:29.173918+0000","last_deep_scrub":"267'450","last_deep_scrub_stamp":"2024-09-14T12:44:29.173918+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.173918+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:13.227443+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48183,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":712,"num_read_kb":1289,"num_write":532,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.815772+0000","last_change":"2024-09-14T12:44:36.815772+0000","last_active":"2024-09-14T12:44:36.815772+0000","last_peered":"2024-09-14T12:44:36.815772+0000","last_clean":"2024-09-14T12:44:36.815772+0000","last_became_active":"2024-09-14T10:49:31.406293+0000","last_became_peered":"2024-09-14T10:49:31.406293+0000","last_unstale":"2024-09-14T12:44:36.815772+0000","last_undegraded":"2024-09-14T12:44:36.815772+0000","last_fullsized":"2024-09-14T12:44:36.815772+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.815598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.815598+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.815598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:31.878162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'565","reported_seq":1457,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.010449+0000","last_change":"2024-09-14T12:44:35.010449+0000","last_active":"2024-09-14T12:44:35.010449+0000","last_peered":"2024-09-14T12:44:35.010449+0000","last_clean":"2024-09-14T12:44:35.010449+0000","last_became_active":"2024-09-14T10:49:33.474412+0000","last_became_peered":"2024-09-14T10:49:33.474412+0000","last_unstale":"2024-09-14T12:44:35.010449+0000","last_undegraded":"2024-09-14T12:44:35.010449+0000","last_fullsized":"2024-09-14T12:44:35.010449+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'565","last_scrub_stamp":"2024-09-14T12:44:35.010246+0000","last_deep_scrub":"267'565","last_deep_scrub_stamp":"2024-09-14T12:44:35.010246+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.010246+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:11.291084+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1493,"num_read_kb":1442,"num_write":1188,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'447","reported_seq":2098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.951633+0000","last_change":"2024-09-14T12:44:15.951633+0000","last_active":"2024-09-14T12:44:15.951633+0000","last_peered":"2024-09-14T12:44:15.951633+0000","last_clean":"2024-09-14T12:44:15.951633+0000","last_became_active":"2024-09-14T10:49:25.405499+0000","last_became_peered":"2024-09-14T10:49:25.405499+0000","last_unstale":"2024-09-14T12:44:15.951633+0000","last_undegraded":"2024-09-14T12:44:15.951633+0000","last_fullsized":"2024-09-14T12:44:15.951633+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-14T12:44:15.951454+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-14T12:44:15.951454+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.951454+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:25.508784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2382,"num_write":513,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'382","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.840424+0000","last_change":"2024-09-14T12:44:10.840331+0000","last_active":"2024-09-14T12:44:10.840424+0000","last_peered":"2024-09-14T12:44:10.840424+0000","last_clean":"2024-09-14T12:44:10.840424+0000","last_became_active":"2024-09-14T10:49:23.403551+0000","last_became_peered":"2024-09-14T10:49:23.403551+0000","last_unstale":"2024-09-14T12:44:10.840424+0000","last_undegraded":"2024-09-14T12:44:10.840424+0000","last_fullsized":"2024-09-14T12:44:10.840424+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:10.840221+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:10.840221+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.840221+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:13.320242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":687,"num_read_kb":10639,"num_write":1239,"num_write_kb":29906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.862195+0000","last_change":"2024-09-14T12:44:27.862195+0000","last_active":"2024-09-14T12:44:27.862195+0000","last_peered":"2024-09-14T12:44:27.862195+0000","last_clean":"2024-09-14T12:44:27.862195+0000","last_became_active":"2024-09-14T10:49:27.372510+0000","last_became_peered":"2024-09-14T10:49:27.372510+0000","last_unstale":"2024-09-14T12:44:27.862195+0000","last_undegraded":"2024-09-14T12:44:27.862195+0000","last_fullsized":"2024-09-14T12:44:27.862195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.862002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.862002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.862002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:27.731328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'308","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.038911+0000","last_change":"2024-09-14T12:44:36.038911+0000","last_active":"2024-09-14T12:44:36.038911+0000","last_peered":"2024-09-14T12:44:36.038911+0000","last_clean":"2024-09-14T12:44:36.038911+0000","last_became_active":"2024-09-14T10:49:29.377710+0000","last_became_peered":"2024-09-14T10:49:29.377710+0000","last_unstale":"2024-09-14T12:44:36.038911+0000","last_undegraded":"2024-09-14T12:44:36.038911+0000","last_fullsized":"2024-09-14T12:44:36.038911+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-14T12:44:36.038695+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-14T12:44:36.038695+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.038695+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:18.848861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45337,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1057,"num_write":388,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.881589+0000","last_change":"2024-09-14T12:44:42.881589+0000","last_active":"2024-09-14T12:44:42.881589+0000","last_peered":"2024-09-14T12:44:42.881589+0000","last_clean":"2024-09-14T12:44:42.881589+0000","last_became_active":"2024-09-14T10:49:31.412080+0000","last_became_peered":"2024-09-14T10:49:31.412080+0000","last_unstale":"2024-09-14T12:44:42.881589+0000","last_undegraded":"2024-09-14T12:44:42.881589+0000","last_fullsized":"2024-09-14T12:44:42.881589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:42.881388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:42.881388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.881388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:23.959186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2530","reported_seq":4399,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.938060+0000","last_change":"2024-09-14T12:44:37.938060+0000","last_active":"2024-09-14T12:44:37.938060+0000","last_peered":"2024-09-14T12:44:37.938060+0000","last_clean":"2024-09-14T12:44:37.938060+0000","last_became_active":"2024-09-14T10:49:33.478542+0000","last_became_peered":"2024-09-14T10:49:33.478542+0000","last_unstale":"2024-09-14T12:44:37.938060+0000","last_undegraded":"2024-09-14T12:44:37.938060+0000","last_fullsized":"2024-09-14T12:44:37.938060+0000","mapping_epoch":36,"log_start":"267'2500","ondisk_log_start":"267'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2530","last_scrub_stamp":"2024-09-14T12:44:37.937880+0000","last_deep_scrub":"267'2530","last_deep_scrub_stamp":"2024-09-14T12:44:37.937880+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.937880+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":2500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:26.283421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6246,"num_read_kb":6243,"num_write":5128,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'501","reported_seq":2192,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.884793+0000","last_change":"2024-09-14T12:44:16.884652+0000","last_active":"2024-09-14T12:44:16.884793+0000","last_peered":"2024-09-14T12:44:16.884793+0000","last_clean":"2024-09-14T12:44:16.884793+0000","last_became_active":"2024-09-14T10:49:25.380967+0000","last_became_peered":"2024-09-14T10:49:25.380967+0000","last_unstale":"2024-09-14T12:44:16.884793+0000","last_undegraded":"2024-09-14T12:44:16.884793+0000","last_fullsized":"2024-09-14T12:44:16.884793+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'501","last_scrub_stamp":"2024-09-14T12:44:16.884453+0000","last_deep_scrub":"267'501","last_deep_scrub_stamp":"2024-09-14T12:44:16.884453+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.884453+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:11.460810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2697,"num_read_kb":2531,"num_write":585,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'361","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.727178+0000","last_change":"2024-09-14T12:44:16.727178+0000","last_active":"2024-09-14T12:44:16.727178+0000","last_peered":"2024-09-14T12:44:16.727178+0000","last_clean":"2024-09-14T12:44:16.727178+0000","last_became_active":"2024-09-14T10:49:23.355809+0000","last_became_peered":"2024-09-14T10:49:23.355809+0000","last_unstale":"2024-09-14T12:44:16.727178+0000","last_undegraded":"2024-09-14T12:44:16.727178+0000","last_fullsized":"2024-09-14T12:44:16.727178+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-09-14T12:44:16.726929+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-09-14T12:44:16.726929+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.726929+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:07.328476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":12441,"num_write":1183,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.993910+0000","last_change":"2024-09-14T12:44:31.993910+0000","last_active":"2024-09-14T12:44:31.993910+0000","last_peered":"2024-09-14T12:44:31.993910+0000","last_clean":"2024-09-14T12:44:31.993910+0000","last_became_active":"2024-09-14T10:49:27.378028+0000","last_became_peered":"2024-09-14T10:49:27.378028+0000","last_unstale":"2024-09-14T12:44:31.993910+0000","last_undegraded":"2024-09-14T12:44:31.993910+0000","last_fullsized":"2024-09-14T12:44:31.993910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.993720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.993720+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.993720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:52.847388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'406","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.586823+0000","last_change":"2024-09-14T12:44:46.586823+0000","last_active":"2024-09-14T12:44:46.586823+0000","last_peered":"2024-09-14T12:44:46.586823+0000","last_clean":"2024-09-14T12:44:46.586823+0000","last_became_active":"2024-09-14T10:49:29.388786+0000","last_became_peered":"2024-09-14T10:49:29.388786+0000","last_unstale":"2024-09-14T12:44:46.586823+0000","last_undegraded":"2024-09-14T12:44:46.586823+0000","last_fullsized":"2024-09-14T12:44:46.586823+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'406","last_scrub_stamp":"2024-09-14T12:44:46.586612+0000","last_deep_scrub":"267'406","last_deep_scrub_stamp":"2024-09-14T12:44:46.586612+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.586612+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:21.570016+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53040,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":1302,"num_write":504,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'827","reported_seq":3431,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.012656+0000","last_change":"2024-09-14T12:44:39.012656+0000","last_active":"2024-09-14T12:44:39.012656+0000","last_peered":"2024-09-14T12:44:39.012656+0000","last_clean":"2024-09-14T12:44:39.012656+0000","last_became_active":"2024-09-14T10:49:31.420178+0000","last_became_peered":"2024-09-14T10:49:31.420178+0000","last_unstale":"2024-09-14T12:44:39.012656+0000","last_undegraded":"2024-09-14T12:44:39.012656+0000","last_fullsized":"2024-09-14T12:44:39.012656+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-14T12:44:39.012452+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-14T12:44:39.012452+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.012452+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:19.983480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'145","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.890373+0000","last_change":"2024-09-14T12:44:38.890373+0000","last_active":"2024-09-14T12:44:38.890373+0000","last_peered":"2024-09-14T12:44:38.890373+0000","last_clean":"2024-09-14T12:44:38.890373+0000","last_became_active":"2024-09-14T10:49:33.462780+0000","last_became_peered":"2024-09-14T10:49:33.462780+0000","last_unstale":"2024-09-14T12:44:38.890373+0000","last_undegraded":"2024-09-14T12:44:38.890373+0000","last_fullsized":"2024-09-14T12:44:38.890373+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'145","last_scrub_stamp":"2024-09-14T12:44:38.890156+0000","last_deep_scrub":"267'145","last_deep_scrub_stamp":"2024-09-14T12:44:38.890156+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.890156+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:15.024191+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'837","reported_seq":2447,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.916505+0000","last_change":"2024-09-14T12:44:25.916505+0000","last_active":"2024-09-14T12:44:25.916505+0000","last_peered":"2024-09-14T12:44:25.916505+0000","last_clean":"2024-09-14T12:44:25.916505+0000","last_became_active":"2024-09-14T10:49:25.389567+0000","last_became_peered":"2024-09-14T10:49:25.389567+0000","last_unstale":"2024-09-14T12:44:25.916505+0000","last_undegraded":"2024-09-14T12:44:25.916505+0000","last_fullsized":"2024-09-14T12:44:25.916505+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'837","last_scrub_stamp":"2024-09-14T12:44:25.916317+0000","last_deep_scrub":"267'837","last_deep_scrub_stamp":"2024-09-14T12:44:25.916317+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.916317+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:29.573496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4051,"num_read_kb":3641,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'382","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.406612+0000","last_change":"2024-09-14T12:44:09.406557+0000","last_active":"2024-09-14T12:44:09.406612+0000","last_peered":"2024-09-14T12:44:09.406612+0000","last_clean":"2024-09-14T12:44:09.406612+0000","last_became_active":"2024-09-14T10:49:23.354452+0000","last_became_peered":"2024-09-14T10:49:23.354452+0000","last_unstale":"2024-09-14T12:44:09.406612+0000","last_undegraded":"2024-09-14T12:44:09.406612+0000","last_fullsized":"2024-09-14T12:44:09.406612+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.406462+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:33.958379+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":20994,"num_write":1147,"num_write_kb":31512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.899948+0000","last_change":"2024-09-14T12:44:26.899729+0000","last_active":"2024-09-14T12:44:26.899948+0000","last_peered":"2024-09-14T12:44:26.899948+0000","last_clean":"2024-09-14T12:44:26.899948+0000","last_became_active":"2024-09-14T10:49:27.353932+0000","last_became_peered":"2024-09-14T10:49:27.353932+0000","last_unstale":"2024-09-14T12:44:26.899948+0000","last_undegraded":"2024-09-14T12:44:26.899948+0000","last_fullsized":"2024-09-14T12:44:26.899948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:26.899467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:26.899467+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.899467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:14.438303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'503","reported_seq":1195,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.053915+0000","last_change":"2024-09-14T12:44:34.053915+0000","last_active":"2024-09-14T12:44:34.053915+0000","last_peered":"2024-09-14T12:44:34.053915+0000","last_clean":"2024-09-14T12:44:34.053915+0000","last_became_active":"2024-09-14T10:49:29.378107+0000","last_became_peered":"2024-09-14T10:49:29.378107+0000","last_unstale":"2024-09-14T12:44:34.053915+0000","last_undegraded":"2024-09-14T12:44:34.053915+0000","last_fullsized":"2024-09-14T12:44:34.053915+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'503","last_scrub_stamp":"2024-09-14T12:44:34.053712+0000","last_deep_scrub":"267'503","last_deep_scrub_stamp":"2024-09-14T12:44:34.053712+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.053712+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:25:12.264177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89831,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":1885,"num_write":676,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.972942+0000","last_change":"2024-09-14T12:44:37.972942+0000","last_active":"2024-09-14T12:44:37.972942+0000","last_peered":"2024-09-14T12:44:37.972942+0000","last_clean":"2024-09-14T12:44:37.972942+0000","last_became_active":"2024-09-14T10:49:31.409247+0000","last_became_peered":"2024-09-14T10:49:31.409247+0000","last_unstale":"2024-09-14T12:44:37.972942+0000","last_undegraded":"2024-09-14T12:44:37.972942+0000","last_fullsized":"2024-09-14T12:44:37.972942+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:37.972763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:37.972763+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.972763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:48.217769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'133","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.427624+0000","last_change":"2024-09-14T12:44:35.427624+0000","last_active":"2024-09-14T12:44:35.427624+0000","last_peered":"2024-09-14T12:44:35.427624+0000","last_clean":"2024-09-14T12:44:35.427624+0000","last_became_active":"2024-09-14T10:49:33.461635+0000","last_became_peered":"2024-09-14T10:49:33.461635+0000","last_unstale":"2024-09-14T12:44:35.427624+0000","last_undegraded":"2024-09-14T12:44:35.427624+0000","last_fullsized":"2024-09-14T12:44:35.427624+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'133","last_scrub_stamp":"2024-09-14T12:44:35.427419+0000","last_deep_scrub":"267'133","last_deep_scrub_stamp":"2024-09-14T12:44:35.427419+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.427419+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:00.864229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":314,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'839","reported_seq":2540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.408128+0000","last_change":"2024-09-14T12:44:16.408128+0000","last_active":"2024-09-14T12:44:16.408128+0000","last_peered":"2024-09-14T12:44:16.408128+0000","last_clean":"2024-09-14T12:44:16.408128+0000","last_became_active":"2024-09-14T10:49:25.361148+0000","last_became_peered":"2024-09-14T10:49:25.361148+0000","last_unstale":"2024-09-14T12:44:16.408128+0000","last_undegraded":"2024-09-14T12:44:16.408128+0000","last_fullsized":"2024-09-14T12:44:16.408128+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-09-14T12:44:16.407940+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-09-14T12:44:16.407940+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.407940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:23.435248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4070,"num_read_kb":3684,"num_write":1107,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'346","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.668424+0000","last_change":"2024-09-14T12:44:12.668424+0000","last_active":"2024-09-14T12:44:12.668424+0000","last_peered":"2024-09-14T12:44:12.668424+0000","last_clean":"2024-09-14T12:44:12.668424+0000","last_became_active":"2024-09-14T10:49:23.375005+0000","last_became_peered":"2024-09-14T10:49:23.375005+0000","last_unstale":"2024-09-14T12:44:12.668424+0000","last_undegraded":"2024-09-14T12:44:12.668424+0000","last_fullsized":"2024-09-14T12:44:12.668424+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-14T12:44:12.668139+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-14T12:44:12.668139+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.668139+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:32.312612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":716,"num_read_kb":12064,"num_write":1099,"num_write_kb":35066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.438078+0000","last_change":"2024-09-14T12:44:24.438078+0000","last_active":"2024-09-14T12:44:24.438078+0000","last_peered":"2024-09-14T12:44:24.438078+0000","last_clean":"2024-09-14T12:44:24.438078+0000","last_became_active":"2024-09-14T10:49:27.385658+0000","last_became_peered":"2024-09-14T10:49:27.385658+0000","last_unstale":"2024-09-14T12:44:24.438078+0000","last_undegraded":"2024-09-14T12:44:24.438078+0000","last_fullsized":"2024-09-14T12:44:24.438078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.437896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.437896+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.437896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:21.541048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'372","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.049012+0000","last_change":"2024-09-14T12:44:30.049012+0000","last_active":"2024-09-14T12:44:30.049012+0000","last_peered":"2024-09-14T12:44:30.049012+0000","last_clean":"2024-09-14T12:44:30.049012+0000","last_became_active":"2024-09-14T10:49:29.388618+0000","last_became_peered":"2024-09-14T10:49:29.388618+0000","last_unstale":"2024-09-14T12:44:30.049012+0000","last_undegraded":"2024-09-14T12:44:30.049012+0000","last_fullsized":"2024-09-14T12:44:30.049012+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-09-14T12:44:30.048826+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-09-14T12:44:30.048826+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.048826+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:35.349305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53436,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":1275,"num_write":534,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17022,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.413073+0000","last_change":"2024-09-14T12:44:31.412920+0000","last_active":"2024-09-14T12:44:31.413073+0000","last_peered":"2024-09-14T12:44:31.413073+0000","last_clean":"2024-09-14T12:44:31.413073+0000","last_became_active":"2024-09-14T10:49:31.417797+0000","last_became_peered":"2024-09-14T10:49:31.417797+0000","last_unstale":"2024-09-14T12:44:31.413073+0000","last_undegraded":"2024-09-14T12:44:31.413073+0000","last_fullsized":"2024-09-14T12:44:31.413073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.412741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.412741+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.412741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:44.652617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'117","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.958123+0000","last_change":"2024-09-14T12:44:42.958123+0000","last_active":"2024-09-14T12:44:42.958123+0000","last_peered":"2024-09-14T12:44:42.958123+0000","last_clean":"2024-09-14T12:44:42.958123+0000","last_became_active":"2024-09-14T10:49:33.455162+0000","last_became_peered":"2024-09-14T10:49:33.455162+0000","last_unstale":"2024-09-14T12:44:42.958123+0000","last_undegraded":"2024-09-14T12:44:42.958123+0000","last_fullsized":"2024-09-14T12:44:42.958123+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-14T12:44:42.957920+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-14T12:44:42.957920+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.957920+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:03.610267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'591","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.638678+0000","last_change":"2024-09-14T12:44:29.638678+0000","last_active":"2024-09-14T12:44:29.638678+0000","last_peered":"2024-09-14T12:44:29.638678+0000","last_clean":"2024-09-14T12:44:29.638678+0000","last_became_active":"2024-09-14T10:49:25.377866+0000","last_became_peered":"2024-09-14T10:49:25.377866+0000","last_unstale":"2024-09-14T12:44:29.638678+0000","last_undegraded":"2024-09-14T12:44:29.638678+0000","last_fullsized":"2024-09-14T12:44:29.638678+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'591","last_scrub_stamp":"2024-09-14T12:44:29.638497+0000","last_deep_scrub":"267'591","last_deep_scrub_stamp":"2024-09-14T12:44:29.638497+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.638497+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:43.254748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3293,"num_read_kb":3082,"num_write":722,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3260,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'319","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.689360+0000","last_change":"2024-09-14T12:44:18.689208+0000","last_active":"2024-09-14T12:44:18.689360+0000","last_peered":"2024-09-14T12:44:18.689360+0000","last_clean":"2024-09-14T12:44:18.689360+0000","last_became_active":"2024-09-14T10:49:23.362203+0000","last_became_peered":"2024-09-14T10:49:23.362203+0000","last_unstale":"2024-09-14T12:44:18.689360+0000","last_undegraded":"2024-09-14T12:44:18.689360+0000","last_fullsized":"2024-09-14T12:44:18.689360+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-14T12:44:18.688974+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-14T12:44:18.688974+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.688974+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:03.279044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":29276,"num_write":1000,"num_write_kb":13260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.956328+0000","last_change":"2024-09-14T12:44:36.956328+0000","last_active":"2024-09-14T12:44:36.956328+0000","last_peered":"2024-09-14T12:44:36.956328+0000","last_clean":"2024-09-14T12:44:36.956328+0000","last_became_active":"2024-09-14T10:49:27.377674+0000","last_became_peered":"2024-09-14T10:49:27.377674+0000","last_unstale":"2024-09-14T12:44:36.956328+0000","last_undegraded":"2024-09-14T12:44:36.956328+0000","last_fullsized":"2024-09-14T12:44:36.956328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.956150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.956150+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.956150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:45.120719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'402","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.068633+0000","last_change":"2024-09-14T12:44:34.068537+0000","last_active":"2024-09-14T12:44:34.068633+0000","last_peered":"2024-09-14T12:44:34.068633+0000","last_clean":"2024-09-14T12:44:34.068633+0000","last_became_active":"2024-09-14T10:49:29.393350+0000","last_became_peered":"2024-09-14T10:49:29.393350+0000","last_unstale":"2024-09-14T12:44:34.068633+0000","last_undegraded":"2024-09-14T12:44:34.068633+0000","last_fullsized":"2024-09-14T12:44:34.068633+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:34.068404+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:34.068404+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.068404+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:20.895132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50275,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":654,"num_read_kb":1334,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'794","reported_seq":5235,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.443351+0000","last_change":"2024-09-14T12:44:29.443351+0000","last_active":"2024-09-14T12:44:29.443351+0000","last_peered":"2024-09-14T12:44:29.443351+0000","last_clean":"2024-09-14T12:44:29.443351+0000","last_became_active":"2024-09-14T10:49:31.422534+0000","last_became_peered":"2024-09-14T10:49:31.422534+0000","last_unstale":"2024-09-14T12:44:29.443351+0000","last_undegraded":"2024-09-14T12:44:29.443351+0000","last_fullsized":"2024-09-14T12:44:29.443351+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'794","last_scrub_stamp":"2024-09-14T12:44:29.443166+0000","last_deep_scrub":"267'794","last_deep_scrub_stamp":"2024-09-14T12:44:29.443166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.443166+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.967521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'162","reported_seq":742,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.867490+0000","last_change":"2024-09-14T12:44:37.867490+0000","last_active":"2024-09-14T12:44:37.867490+0000","last_peered":"2024-09-14T12:44:37.867490+0000","last_clean":"2024-09-14T12:44:37.867490+0000","last_became_active":"2024-09-14T10:49:33.466024+0000","last_became_peered":"2024-09-14T10:49:33.466024+0000","last_unstale":"2024-09-14T12:44:37.867490+0000","last_undegraded":"2024-09-14T12:44:37.867490+0000","last_fullsized":"2024-09-14T12:44:37.867490+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-14T12:44:37.867287+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-14T12:44:37.867287+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.867287+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:21.080474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":335,"num_read_kb":285,"num_write":383,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'673","reported_seq":2400,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.795938+0000","last_change":"2024-09-14T12:44:19.795938+0000","last_active":"2024-09-14T12:44:19.795938+0000","last_peered":"2024-09-14T12:44:19.795938+0000","last_clean":"2024-09-14T12:44:19.795938+0000","last_became_active":"2024-09-14T10:49:25.380712+0000","last_became_peered":"2024-09-14T10:49:25.380712+0000","last_unstale":"2024-09-14T12:44:19.795938+0000","last_undegraded":"2024-09-14T12:44:19.795938+0000","last_fullsized":"2024-09-14T12:44:19.795938+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'673","last_scrub_stamp":"2024-09-14T12:44:19.795731+0000","last_deep_scrub":"267'673","last_deep_scrub_stamp":"2024-09-14T12:44:19.795731+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.795731+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:58.049805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3719,"num_read_kb":3469,"num_write":935,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'349","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.741343+0000","last_change":"2024-09-14T12:44:14.741194+0000","last_active":"2024-09-14T12:44:14.741343+0000","last_peered":"2024-09-14T12:44:14.741343+0000","last_clean":"2024-09-14T12:44:14.741343+0000","last_became_active":"2024-09-14T10:49:23.367200+0000","last_became_peered":"2024-09-14T10:49:23.367200+0000","last_unstale":"2024-09-14T12:44:14.741343+0000","last_undegraded":"2024-09-14T12:44:14.741343+0000","last_fullsized":"2024-09-14T12:44:14.741343+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-14T12:44:14.740931+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-14T12:44:14.740931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.740931+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:26.381621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":77246,"num_write":1147,"num_write_kb":38780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.043751+0000","last_change":"2024-09-14T12:44:26.043611+0000","last_active":"2024-09-14T12:44:26.043751+0000","last_peered":"2024-09-14T12:44:26.043751+0000","last_clean":"2024-09-14T12:44:26.043751+0000","last_became_active":"2024-09-14T10:49:27.379952+0000","last_became_peered":"2024-09-14T10:49:27.379952+0000","last_unstale":"2024-09-14T12:44:26.043751+0000","last_undegraded":"2024-09-14T12:44:26.043751+0000","last_fullsized":"2024-09-14T12:44:26.043751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:26.043404+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:26.043404+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.043404+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:43.208508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'146","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.825188+0000","last_change":"2024-09-14T12:44:29.825188+0000","last_active":"2024-09-14T12:44:29.825188+0000","last_peered":"2024-09-14T12:44:29.825188+0000","last_clean":"2024-09-14T12:44:29.825188+0000","last_became_active":"2024-09-14T10:49:29.371803+0000","last_became_peered":"2024-09-14T10:49:29.371803+0000","last_unstale":"2024-09-14T12:44:29.825188+0000","last_undegraded":"2024-09-14T12:44:29.825188+0000","last_fullsized":"2024-09-14T12:44:29.825188+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-14T12:44:29.824972+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-14T12:44:29.824972+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.824972+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:03.803486+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'797","reported_seq":3155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.986093+0000","last_change":"2024-09-14T12:44:31.986093+0000","last_active":"2024-09-14T12:44:31.986093+0000","last_peered":"2024-09-14T12:44:31.986093+0000","last_clean":"2024-09-14T12:44:31.986093+0000","last_became_active":"2024-09-14T10:49:31.427179+0000","last_became_peered":"2024-09-14T10:49:31.427179+0000","last_unstale":"2024-09-14T12:44:31.986093+0000","last_undegraded":"2024-09-14T12:44:31.986093+0000","last_fullsized":"2024-09-14T12:44:31.986093+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'797","last_scrub_stamp":"2024-09-14T12:44:31.985911+0000","last_deep_scrub":"267'797","last_deep_scrub_stamp":"2024-09-14T12:44:31.985911+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.985911+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:03.033127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.022592+0000","last_change":"2024-09-14T12:44:34.022592+0000","last_active":"2024-09-14T12:44:34.022592+0000","last_peered":"2024-09-14T12:44:34.022592+0000","last_clean":"2024-09-14T12:44:34.022592+0000","last_became_active":"2024-09-14T10:49:33.468831+0000","last_became_peered":"2024-09-14T10:49:33.468831+0000","last_unstale":"2024-09-14T12:44:34.022592+0000","last_undegraded":"2024-09-14T12:44:34.022592+0000","last_fullsized":"2024-09-14T12:44:34.022592+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T12:44:34.022405+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T12:44:34.022405+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.022405+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:24.580048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":148,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'488","reported_seq":2230,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.501840+0000","last_change":"2024-09-14T12:44:19.501701+0000","last_active":"2024-09-14T12:44:19.501840+0000","last_peered":"2024-09-14T12:44:19.501840+0000","last_clean":"2024-09-14T12:44:19.501840+0000","last_became_active":"2024-09-14T10:49:25.370649+0000","last_became_peered":"2024-09-14T10:49:25.370649+0000","last_unstale":"2024-09-14T12:44:19.501840+0000","last_undegraded":"2024-09-14T12:44:19.501840+0000","last_fullsized":"2024-09-14T12:44:19.501840+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'488","last_scrub_stamp":"2024-09-14T12:44:19.501488+0000","last_deep_scrub":"267'488","last_deep_scrub_stamp":"2024-09-14T12:44:19.501488+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.501488+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:41.258394+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2839,"num_read_kb":2682,"num_write":610,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'390","reported_seq":1121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.742825+0000","last_change":"2024-09-14T12:44:12.742681+0000","last_active":"2024-09-14T12:44:12.742825+0000","last_peered":"2024-09-14T12:44:12.742825+0000","last_clean":"2024-09-14T12:44:12.742825+0000","last_became_active":"2024-09-14T10:49:23.355864+0000","last_became_peered":"2024-09-14T10:49:23.355864+0000","last_unstale":"2024-09-14T12:44:12.742825+0000","last_undegraded":"2024-09-14T12:44:12.742825+0000","last_fullsized":"2024-09-14T12:44:12.742825+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-09-14T12:44:12.742461+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-09-14T12:44:12.742461+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.742461+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:50.949947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":100725,"num_write":1103,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.620062+0000","last_change":"2024-09-14T12:44:37.620062+0000","last_active":"2024-09-14T12:44:37.620062+0000","last_peered":"2024-09-14T12:44:37.620062+0000","last_clean":"2024-09-14T12:44:37.620062+0000","last_became_active":"2024-09-14T10:49:27.390169+0000","last_became_peered":"2024-09-14T10:49:27.390169+0000","last_unstale":"2024-09-14T12:44:37.620062+0000","last_undegraded":"2024-09-14T12:44:37.620062+0000","last_fullsized":"2024-09-14T12:44:37.620062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:37.619874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:37.619874+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.619874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:51.304924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'426","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.059437+0000","last_change":"2024-09-14T12:44:29.059437+0000","last_active":"2024-09-14T12:44:29.059437+0000","last_peered":"2024-09-14T12:44:29.059437+0000","last_clean":"2024-09-14T12:44:29.059437+0000","last_became_active":"2024-09-14T10:49:29.400776+0000","last_became_peered":"2024-09-14T10:49:29.400776+0000","last_unstale":"2024-09-14T12:44:29.059437+0000","last_undegraded":"2024-09-14T12:44:29.059437+0000","last_fullsized":"2024-09-14T12:44:29.059437+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'426","last_scrub_stamp":"2024-09-14T12:44:29.059340+0000","last_deep_scrub":"267'426","last_deep_scrub_stamp":"2024-09-14T12:44:29.059340+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.059340+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:24.036786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1253,"num_write":514,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.968293+0000","last_change":"2024-09-14T12:44:29.968293+0000","last_active":"2024-09-14T12:44:29.968293+0000","last_peered":"2024-09-14T12:44:29.968293+0000","last_clean":"2024-09-14T12:44:29.968293+0000","last_became_active":"2024-09-14T10:49:31.418131+0000","last_became_peered":"2024-09-14T10:49:31.418131+0000","last_unstale":"2024-09-14T12:44:29.968293+0000","last_undegraded":"2024-09-14T12:44:29.968293+0000","last_fullsized":"2024-09-14T12:44:29.968293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:29.968107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:29.968107+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.968107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:34.481689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'141","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.476950+0000","last_change":"2024-09-14T12:44:34.476950+0000","last_active":"2024-09-14T12:44:34.476950+0000","last_peered":"2024-09-14T12:44:34.476950+0000","last_clean":"2024-09-14T12:44:34.476950+0000","last_became_active":"2024-09-14T10:49:33.455953+0000","last_became_peered":"2024-09-14T10:49:33.455953+0000","last_unstale":"2024-09-14T12:44:34.476950+0000","last_undegraded":"2024-09-14T12:44:34.476950+0000","last_fullsized":"2024-09-14T12:44:34.476950+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T12:44:34.476728+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T12:44:34.476728+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.476728+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:18.465980+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":155,"num_write":340,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'414","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.634493+0000","last_change":"2024-09-14T12:44:27.634493+0000","last_active":"2024-09-14T12:44:27.634493+0000","last_peered":"2024-09-14T12:44:27.634493+0000","last_clean":"2024-09-14T12:44:27.634493+0000","last_became_active":"2024-09-14T10:49:25.377841+0000","last_became_peered":"2024-09-14T10:49:25.377841+0000","last_unstale":"2024-09-14T12:44:27.634493+0000","last_undegraded":"2024-09-14T12:44:27.634493+0000","last_fullsized":"2024-09-14T12:44:27.634493+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-14T12:44:27.634299+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-14T12:44:27.634299+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.634299+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:58.860140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2397,"num_read_kb":2304,"num_write":471,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.886990+0000","last_change":"2024-09-14T12:44:09.886990+0000","last_active":"2024-09-14T12:44:09.886990+0000","last_peered":"2024-09-14T12:44:09.886990+0000","last_clean":"2024-09-14T12:44:09.886990+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T12:44:09.886990+0000","last_undegraded":"2024-09-14T12:44:09.886990+0000","last_fullsized":"2024-09-14T12:44:09.886990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.886874+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:32.555870+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.693554+0000","last_change":"2024-09-14T12:44:11.693554+0000","last_active":"2024-09-14T12:44:11.693554+0000","last_peered":"2024-09-14T12:44:11.693554+0000","last_clean":"2024-09-14T12:44:11.693554+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T12:44:11.693554+0000","last_undegraded":"2024-09-14T12:44:11.693554+0000","last_fullsized":"2024-09-14T12:44:11.693554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:11.693472+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:11.693472+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.693472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:19.157490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'329","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.793286+0000","last_change":"2024-09-14T12:44:10.793286+0000","last_active":"2024-09-14T12:44:10.793286+0000","last_peered":"2024-09-14T12:44:10.793286+0000","last_clean":"2024-09-14T12:44:10.793286+0000","last_became_active":"2024-09-14T10:49:23.371077+0000","last_became_peered":"2024-09-14T10:49:23.371077+0000","last_unstale":"2024-09-14T12:44:10.793286+0000","last_undegraded":"2024-09-14T12:44:10.793286+0000","last_fullsized":"2024-09-14T12:44:10.793286+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-09-14T12:44:10.793074+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-09-14T12:44:10.793074+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.793074+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:06.598298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":16360,"num_write":1113,"num_write_kb":33420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.166090+0000","last_change":"2024-09-14T12:44:27.166090+0000","last_active":"2024-09-14T12:44:27.166090+0000","last_peered":"2024-09-14T12:44:27.166090+0000","last_clean":"2024-09-14T12:44:27.166090+0000","last_became_active":"2024-09-14T10:49:27.372388+0000","last_became_peered":"2024-09-14T10:49:27.372388+0000","last_unstale":"2024-09-14T12:44:27.166090+0000","last_undegraded":"2024-09-14T12:44:27.166090+0000","last_fullsized":"2024-09-14T12:44:27.166090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.165821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.165821+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.165821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:15.547531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'835","reported_seq":1590,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.602576+0000","last_change":"2024-09-14T12:44:43.602576+0000","last_active":"2024-09-14T12:44:43.602576+0000","last_peered":"2024-09-14T12:44:43.602576+0000","last_clean":"2024-09-14T12:44:43.602576+0000","last_became_active":"2024-09-14T10:49:29.390014+0000","last_became_peered":"2024-09-14T10:49:29.390014+0000","last_unstale":"2024-09-14T12:44:43.602576+0000","last_undegraded":"2024-09-14T12:44:43.602576+0000","last_fullsized":"2024-09-14T12:44:43.602576+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'835","last_scrub_stamp":"2024-09-14T12:44:43.602388+0000","last_deep_scrub":"267'835","last_deep_scrub_stamp":"2024-09-14T12:44:43.602388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.602388+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:49.116772+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167259,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1623,"num_read_kb":3686,"num_write":1586,"num_write_kb":1425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107094,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.989824+0000","last_change":"2024-09-14T12:44:39.989824+0000","last_active":"2024-09-14T12:44:39.989824+0000","last_peered":"2024-09-14T12:44:39.989824+0000","last_clean":"2024-09-14T12:44:39.989824+0000","last_became_active":"2024-09-14T10:49:31.411212+0000","last_became_peered":"2024-09-14T10:49:31.411212+0000","last_unstale":"2024-09-14T12:44:39.989824+0000","last_undegraded":"2024-09-14T12:44:39.989824+0000","last_fullsized":"2024-09-14T12:44:39.989824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:39.989560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:39.989560+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.989560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:38.029943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'198","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.104464+0000","last_change":"2024-09-14T12:44:33.104464+0000","last_active":"2024-09-14T12:44:33.104464+0000","last_peered":"2024-09-14T12:44:33.104464+0000","last_clean":"2024-09-14T12:44:33.104464+0000","last_became_active":"2024-09-14T10:49:33.469611+0000","last_became_peered":"2024-09-14T10:49:33.469611+0000","last_unstale":"2024-09-14T12:44:33.104464+0000","last_undegraded":"2024-09-14T12:44:33.104464+0000","last_fullsized":"2024-09-14T12:44:33.104464+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-14T12:44:33.104326+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-14T12:44:33.104326+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.104326+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:32.582985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":425,"num_write":402,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'780","reported_seq":2301,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.874559+0000","last_change":"2024-09-14T12:44:24.874559+0000","last_active":"2024-09-14T12:44:24.874559+0000","last_peered":"2024-09-14T12:44:24.874559+0000","last_clean":"2024-09-14T12:44:24.874559+0000","last_became_active":"2024-09-14T10:49:25.390586+0000","last_became_peered":"2024-09-14T10:49:25.390586+0000","last_unstale":"2024-09-14T12:44:24.874559+0000","last_undegraded":"2024-09-14T12:44:24.874559+0000","last_fullsized":"2024-09-14T12:44:24.874559+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'780","last_scrub_stamp":"2024-09-14T12:44:24.874284+0000","last_deep_scrub":"267'780","last_deep_scrub_stamp":"2024-09-14T12:44:24.874284+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.874284+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:51.757493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3382,"num_write":1057,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.718117+0000","last_change":"2024-09-14T12:44:10.718117+0000","last_active":"2024-09-14T12:44:10.718117+0000","last_peered":"2024-09-14T12:44:10.718117+0000","last_clean":"2024-09-14T12:44:10.718117+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T12:44:10.718117+0000","last_undegraded":"2024-09-14T12:44:10.718117+0000","last_fullsized":"2024-09-14T12:44:10.718117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:10.718056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:10.718056+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.718056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:29.760263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'352","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.735411+0000","last_change":"2024-09-14T12:44:12.735411+0000","last_active":"2024-09-14T12:44:12.735411+0000","last_peered":"2024-09-14T12:44:12.735411+0000","last_clean":"2024-09-14T12:44:12.735411+0000","last_became_active":"2024-09-14T10:49:53.507913+0000","last_became_peered":"2024-09-14T10:49:53.507913+0000","last_unstale":"2024-09-14T12:44:12.735411+0000","last_undegraded":"2024-09-14T12:44:12.735411+0000","last_fullsized":"2024-09-14T12:44:12.735411+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-09-14T12:44:12.735166+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-09-14T12:44:12.735166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.735166+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:17.278126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":56481,"num_write":1136,"num_write_kb":45113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,3],"acting":[6,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.652426+0000","last_change":"2024-09-14T12:44:36.652426+0000","last_active":"2024-09-14T12:44:36.652426+0000","last_peered":"2024-09-14T12:44:36.652426+0000","last_clean":"2024-09-14T12:44:36.652426+0000","last_became_active":"2024-09-14T10:49:27.388875+0000","last_became_peered":"2024-09-14T10:49:27.388875+0000","last_unstale":"2024-09-14T12:44:36.652426+0000","last_undegraded":"2024-09-14T12:44:36.652426+0000","last_fullsized":"2024-09-14T12:44:36.652426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.652132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.652132+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.652132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:24.964639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1478","reported_seq":3859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.438518+0000","last_change":"2024-09-14T12:44:27.438518+0000","last_active":"2024-09-14T12:44:27.438518+0000","last_peered":"2024-09-14T12:44:27.438518+0000","last_clean":"2024-09-14T12:44:27.438518+0000","last_became_active":"2024-09-14T10:49:29.393295+0000","last_became_peered":"2024-09-14T10:49:29.393295+0000","last_unstale":"2024-09-14T12:44:27.438518+0000","last_undegraded":"2024-09-14T12:44:27.438518+0000","last_fullsized":"2024-09-14T12:44:27.438518+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1478","last_scrub_stamp":"2024-09-14T12:44:27.438310+0000","last_deep_scrub":"267'1478","last_deep_scrub_stamp":"2024-09-14T12:44:27.438310+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.438310+0000","objects_scrubbed":11,"log_size":78,"log_dups_size":1400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:41.883467+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2284,"num_read_kb":4194,"num_write":1394,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.538787+0000","last_change":"2024-09-14T12:44:47.538787+0000","last_active":"2024-09-14T12:44:47.538787+0000","last_peered":"2024-09-14T12:44:47.538787+0000","last_clean":"2024-09-14T12:44:47.538787+0000","last_became_active":"2024-09-14T10:49:31.432054+0000","last_became_peered":"2024-09-14T10:49:31.432054+0000","last_unstale":"2024-09-14T12:44:47.538787+0000","last_undegraded":"2024-09-14T12:44:47.538787+0000","last_fullsized":"2024-09-14T12:44:47.538787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.538595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.538595+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.538595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:32.517665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'84","reported_seq":616,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.896264+0000","last_change":"2024-09-14T12:44:44.896264+0000","last_active":"2024-09-14T12:44:44.896264+0000","last_peered":"2024-09-14T12:44:44.896264+0000","last_clean":"2024-09-14T12:44:44.896264+0000","last_became_active":"2024-09-14T10:49:33.466307+0000","last_became_peered":"2024-09-14T10:49:33.466307+0000","last_unstale":"2024-09-14T12:44:44.896264+0000","last_undegraded":"2024-09-14T12:44:44.896264+0000","last_fullsized":"2024-09-14T12:44:44.896264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'84","last_scrub_stamp":"2024-09-14T12:44:44.896073+0000","last_deep_scrub":"267'84","last_deep_scrub_stamp":"2024-09-14T12:44:44.896073+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.896073+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:38.231585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":197,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'931","reported_seq":2505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.741494+0000","last_change":"2024-09-14T12:44:22.741494+0000","last_active":"2024-09-14T12:44:22.741494+0000","last_peered":"2024-09-14T12:44:22.741494+0000","last_clean":"2024-09-14T12:44:22.741494+0000","last_became_active":"2024-09-14T10:49:25.382937+0000","last_became_peered":"2024-09-14T10:49:25.382937+0000","last_unstale":"2024-09-14T12:44:22.741494+0000","last_undegraded":"2024-09-14T12:44:22.741494+0000","last_fullsized":"2024-09-14T12:44:22.741494+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'931","last_scrub_stamp":"2024-09-14T12:44:22.741320+0000","last_deep_scrub":"267'931","last_deep_scrub_stamp":"2024-09-14T12:44:22.741320+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.741320+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:45.020675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":3892,"num_write":1285,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.618578+0000","last_change":"2024-09-14T12:44:13.618578+0000","last_active":"2024-09-14T12:44:13.618578+0000","last_peered":"2024-09-14T12:44:13.618578+0000","last_clean":"2024-09-14T12:44:13.618578+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T12:44:13.618578+0000","last_undegraded":"2024-09-14T12:44:13.618578+0000","last_fullsized":"2024-09-14T12:44:13.618578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:13.618399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:13.618399+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.618399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:36:10.021666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'330","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.875989+0000","last_change":"2024-09-14T12:44:12.875989+0000","last_active":"2024-09-14T12:44:12.875989+0000","last_peered":"2024-09-14T12:44:12.875989+0000","last_clean":"2024-09-14T12:44:12.875989+0000","last_became_active":"2024-09-14T10:49:23.387885+0000","last_became_peered":"2024-09-14T10:49:23.387885+0000","last_unstale":"2024-09-14T12:44:12.875989+0000","last_undegraded":"2024-09-14T12:44:12.875989+0000","last_fullsized":"2024-09-14T12:44:12.875989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-14T12:44:12.875716+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-14T12:44:12.875716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.875716+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:32.075745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":25294,"num_write":1061,"num_write_kb":31965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.456328+0000","last_change":"2024-09-14T12:44:25.456328+0000","last_active":"2024-09-14T12:44:25.456328+0000","last_peered":"2024-09-14T12:44:25.456328+0000","last_clean":"2024-09-14T12:44:25.456328+0000","last_became_active":"2024-09-14T10:49:27.384973+0000","last_became_peered":"2024-09-14T10:49:27.384973+0000","last_unstale":"2024-09-14T12:44:25.456328+0000","last_undegraded":"2024-09-14T12:44:25.456328+0000","last_fullsized":"2024-09-14T12:44:25.456328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:25.456147+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:25.456147+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.456147+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:48.132295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'424","reported_seq":2414,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.164324+0000","last_change":"2024-09-14T12:44:28.164324+0000","last_active":"2024-09-14T12:44:28.164324+0000","last_peered":"2024-09-14T12:44:28.164324+0000","last_clean":"2024-09-14T12:44:28.164324+0000","last_became_active":"2024-09-14T10:49:29.382485+0000","last_became_peered":"2024-09-14T10:49:29.382485+0000","last_unstale":"2024-09-14T12:44:28.164324+0000","last_undegraded":"2024-09-14T12:44:28.164324+0000","last_fullsized":"2024-09-14T12:44:28.164324+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'424","last_scrub_stamp":"2024-09-14T12:44:28.164109+0000","last_deep_scrub":"267'424","last_deep_scrub_stamp":"2024-09-14T12:44:28.164109+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.164109+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:10.149631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":384,"num_read_kb":370,"num_write":379,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.886273+0000","last_change":"2024-09-14T12:44:41.886273+0000","last_active":"2024-09-14T12:44:41.886273+0000","last_peered":"2024-09-14T12:44:41.886273+0000","last_clean":"2024-09-14T12:44:41.886273+0000","last_became_active":"2024-09-14T10:49:31.420121+0000","last_became_peered":"2024-09-14T10:49:31.420121+0000","last_unstale":"2024-09-14T12:44:41.886273+0000","last_undegraded":"2024-09-14T12:44:41.886273+0000","last_fullsized":"2024-09-14T12:44:41.886273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.886088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.886088+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.886088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:31.595427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'277","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.817045+0000","last_change":"2024-09-14T12:44:46.817045+0000","last_active":"2024-09-14T12:44:46.817045+0000","last_peered":"2024-09-14T12:44:46.817045+0000","last_clean":"2024-09-14T12:44:46.817045+0000","last_became_active":"2024-09-14T10:49:33.437564+0000","last_became_peered":"2024-09-14T10:49:33.437564+0000","last_unstale":"2024-09-14T12:44:46.817045+0000","last_undegraded":"2024-09-14T12:44:46.817045+0000","last_fullsized":"2024-09-14T12:44:46.817045+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-14T12:44:46.816863+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-14T12:44:46.816863+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.816863+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:37.693510+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":600,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'364","reported_seq":1779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.762886+0000","last_change":"2024-09-14T12:44:21.762886+0000","last_active":"2024-09-14T12:44:21.762886+0000","last_peered":"2024-09-14T12:44:21.762886+0000","last_clean":"2024-09-14T12:44:21.762886+0000","last_became_active":"2024-09-14T10:49:25.377606+0000","last_became_peered":"2024-09-14T10:49:25.377606+0000","last_unstale":"2024-09-14T12:44:21.762886+0000","last_undegraded":"2024-09-14T12:44:21.762886+0000","last_fullsized":"2024-09-14T12:44:21.762886+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-14T12:44:21.762699+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-14T12:44:21.762699+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.762699+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:46.620062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2088,"num_read_kb":1981,"num_write":424,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.689647+0000","last_change":"2024-09-14T12:44:12.689647+0000","last_active":"2024-09-14T12:44:12.689647+0000","last_peered":"2024-09-14T12:44:12.689647+0000","last_clean":"2024-09-14T12:44:12.689647+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T12:44:12.689647+0000","last_undegraded":"2024-09-14T12:44:12.689647+0000","last_fullsized":"2024-09-14T12:44:12.689647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:12.689558+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:12.689558+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.689558+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:00.729814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'374","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.159271+0000","last_change":"2024-09-14T12:44:22.159271+0000","last_active":"2024-09-14T12:44:22.159271+0000","last_peered":"2024-09-14T12:44:22.159271+0000","last_clean":"2024-09-14T12:44:22.159271+0000","last_became_active":"2024-09-14T10:49:23.365016+0000","last_became_peered":"2024-09-14T10:49:23.365016+0000","last_unstale":"2024-09-14T12:44:22.159271+0000","last_undegraded":"2024-09-14T12:44:22.159271+0000","last_fullsized":"2024-09-14T12:44:22.159271+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:22.158986+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:22.158986+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.158986+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:14.641518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":666,"num_read_kb":160044,"num_write":1139,"num_write_kb":62525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.529218+0000","last_change":"2024-09-14T12:44:20.528981+0000","last_active":"2024-09-14T12:44:20.529218+0000","last_peered":"2024-09-14T12:44:20.529218+0000","last_clean":"2024-09-14T12:44:20.529218+0000","last_became_active":"2024-09-14T10:49:27.373998+0000","last_became_peered":"2024-09-14T10:49:27.373998+0000","last_unstale":"2024-09-14T12:44:20.529218+0000","last_undegraded":"2024-09-14T12:44:20.529218+0000","last_fullsized":"2024-09-14T12:44:20.529218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:20.528772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:20.528772+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.528772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:55.424574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'236","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.034718+0000","last_change":"2024-09-14T12:44:35.034718+0000","last_active":"2024-09-14T12:44:35.034718+0000","last_peered":"2024-09-14T12:44:35.034718+0000","last_clean":"2024-09-14T12:44:35.034718+0000","last_became_active":"2024-09-14T10:49:29.391056+0000","last_became_peered":"2024-09-14T10:49:29.391056+0000","last_unstale":"2024-09-14T12:44:35.034718+0000","last_undegraded":"2024-09-14T12:44:35.034718+0000","last_fullsized":"2024-09-14T12:44:35.034718+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'236","last_scrub_stamp":"2024-09-14T12:44:35.034505+0000","last_deep_scrub":"267'236","last_deep_scrub_stamp":"2024-09-14T12:44:35.034505+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.034505+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.096986+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":287,"num_read_kb":274,"num_write":212,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.542408+0000","last_change":"2024-09-14T12:44:49.542408+0000","last_active":"2024-09-14T12:44:49.542408+0000","last_peered":"2024-09-14T12:44:49.542408+0000","last_clean":"2024-09-14T12:44:49.542408+0000","last_became_active":"2024-09-14T10:49:31.424769+0000","last_became_peered":"2024-09-14T10:49:31.424769+0000","last_unstale":"2024-09-14T12:44:49.542408+0000","last_undegraded":"2024-09-14T12:44:49.542408+0000","last_fullsized":"2024-09-14T12:44:49.542408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.542233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.542233+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.542233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:20.418046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'129","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.938139+0000","last_change":"2024-09-14T12:44:36.938139+0000","last_active":"2024-09-14T12:44:36.938139+0000","last_peered":"2024-09-14T12:44:36.938139+0000","last_clean":"2024-09-14T12:44:36.938139+0000","last_became_active":"2024-09-14T10:49:33.468553+0000","last_became_peered":"2024-09-14T10:49:33.468553+0000","last_unstale":"2024-09-14T12:44:36.938139+0000","last_undegraded":"2024-09-14T12:44:36.938139+0000","last_fullsized":"2024-09-14T12:44:36.938139+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T12:44:36.937964+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T12:44:36.937964+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.937964+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:36.638436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":228,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'559","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.750875+0000","last_change":"2024-09-14T12:44:18.750875+0000","last_active":"2024-09-14T12:44:18.750875+0000","last_peered":"2024-09-14T12:44:18.750875+0000","last_clean":"2024-09-14T12:44:18.750875+0000","last_became_active":"2024-09-14T10:49:25.379137+0000","last_became_peered":"2024-09-14T10:49:25.379137+0000","last_unstale":"2024-09-14T12:44:18.750875+0000","last_undegraded":"2024-09-14T12:44:18.750875+0000","last_fullsized":"2024-09-14T12:44:18.750875+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'559","last_scrub_stamp":"2024-09-14T12:44:18.750687+0000","last_deep_scrub":"267'559","last_deep_scrub_stamp":"2024-09-14T12:44:18.750687+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.750687+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:29.411317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2924,"num_read_kb":2647,"num_write":735,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'367","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.850994+0000","last_change":"2024-09-14T12:44:09.850920+0000","last_active":"2024-09-14T12:44:09.850994+0000","last_peered":"2024-09-14T12:44:09.850994+0000","last_clean":"2024-09-14T12:44:09.850994+0000","last_became_active":"2024-09-14T10:49:23.389195+0000","last_became_peered":"2024-09-14T10:49:23.389195+0000","last_unstale":"2024-09-14T12:44:09.850994+0000","last_undegraded":"2024-09-14T12:44:09.850994+0000","last_fullsized":"2024-09-14T12:44:09.850994+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'367","last_scrub_stamp":"2024-09-14T12:44:09.850762+0000","last_deep_scrub":"267'367","last_deep_scrub_stamp":"2024-09-14T12:44:09.850762+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.850762+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:37.171130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984745,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":650,"num_read_kb":23846,"num_write":1157,"num_write_kb":31374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.835515+0000","last_change":"2024-09-14T12:44:11.835515+0000","last_active":"2024-09-14T12:44:11.835515+0000","last_peered":"2024-09-14T12:44:11.835515+0000","last_clean":"2024-09-14T12:44:11.835515+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T12:44:11.835515+0000","last_undegraded":"2024-09-14T12:44:11.835515+0000","last_fullsized":"2024-09-14T12:44:11.835515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:11.835327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:11.835327+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.835327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:41.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.895413+0000","last_change":"2024-09-14T12:44:28.895413+0000","last_active":"2024-09-14T12:44:28.895413+0000","last_peered":"2024-09-14T12:44:28.895413+0000","last_clean":"2024-09-14T12:44:28.895413+0000","last_became_active":"2024-09-14T10:49:27.368412+0000","last_became_peered":"2024-09-14T10:49:27.368412+0000","last_unstale":"2024-09-14T12:44:28.895413+0000","last_undegraded":"2024-09-14T12:44:28.895413+0000","last_fullsized":"2024-09-14T12:44:28.895413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.895241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.895241+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.895241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.614078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'762","reported_seq":1508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.440351+0000","last_change":"2024-09-14T12:44:26.440351+0000","last_active":"2024-09-14T12:44:26.440351+0000","last_peered":"2024-09-14T12:44:26.440351+0000","last_clean":"2024-09-14T12:44:26.440351+0000","last_became_active":"2024-09-14T10:49:29.383270+0000","last_became_peered":"2024-09-14T10:49:29.383270+0000","last_unstale":"2024-09-14T12:44:26.440351+0000","last_undegraded":"2024-09-14T12:44:26.440351+0000","last_fullsized":"2024-09-14T12:44:26.440351+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-09-14T12:44:26.440152+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-09-14T12:44:26.440152+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.440152+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.264773+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99398,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2001,"num_read_kb":3265,"num_write":2692,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537558,"num_omap_keys":1218,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.999286+0000","last_change":"2024-09-14T12:44:30.999286+0000","last_active":"2024-09-14T12:44:30.999286+0000","last_peered":"2024-09-14T12:44:30.999286+0000","last_clean":"2024-09-14T12:44:30.999286+0000","last_became_active":"2024-09-14T10:49:31.418385+0000","last_became_peered":"2024-09-14T10:49:31.418385+0000","last_unstale":"2024-09-14T12:44:30.999286+0000","last_undegraded":"2024-09-14T12:44:30.999286+0000","last_fullsized":"2024-09-14T12:44:30.999286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.999105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.999105+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.999105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:54.918874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'134","reported_seq":675,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.869306+0000","last_change":"2024-09-14T12:44:46.869306+0000","last_active":"2024-09-14T12:44:46.869306+0000","last_peered":"2024-09-14T12:44:46.869306+0000","last_clean":"2024-09-14T12:44:46.869306+0000","last_became_active":"2024-09-14T10:49:33.467268+0000","last_became_peered":"2024-09-14T10:49:33.467268+0000","last_unstale":"2024-09-14T12:44:46.869306+0000","last_undegraded":"2024-09-14T12:44:46.869306+0000","last_fullsized":"2024-09-14T12:44:46.869306+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T12:44:46.869091+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T12:44:46.869091+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.869091+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:37.701120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":137,"num_write":301,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'747","reported_seq":2299,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.794948+0000","last_change":"2024-09-14T12:44:20.794948+0000","last_active":"2024-09-14T12:44:20.794948+0000","last_peered":"2024-09-14T12:44:20.794948+0000","last_clean":"2024-09-14T12:44:20.794948+0000","last_became_active":"2024-09-14T10:49:25.377460+0000","last_became_peered":"2024-09-14T10:49:25.377460+0000","last_unstale":"2024-09-14T12:44:20.794948+0000","last_undegraded":"2024-09-14T12:44:20.794948+0000","last_fullsized":"2024-09-14T12:44:20.794948+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'747","last_scrub_stamp":"2024-09-14T12:44:20.794733+0000","last_deep_scrub":"267'747","last_deep_scrub_stamp":"2024-09-14T12:44:20.794733+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.794733+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:04.985527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3587,"num_read_kb":3249,"num_write":953,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'349","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.684281+0000","last_change":"2024-09-14T12:44:14.684281+0000","last_active":"2024-09-14T12:44:14.684281+0000","last_peered":"2024-09-14T12:44:14.684281+0000","last_clean":"2024-09-14T12:44:14.684281+0000","last_became_active":"2024-09-14T10:49:23.383686+0000","last_became_peered":"2024-09-14T10:49:23.383686+0000","last_unstale":"2024-09-14T12:44:14.684281+0000","last_undegraded":"2024-09-14T12:44:14.684281+0000","last_fullsized":"2024-09-14T12:44:14.684281+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-14T12:44:14.683982+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-14T12:44:14.683982+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.683982+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:25.301976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":8945,"num_write":1082,"num_write_kb":53511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.707852+0000","last_change":"2024-09-14T12:44:13.707852+0000","last_active":"2024-09-14T12:44:13.707852+0000","last_peered":"2024-09-14T12:44:13.707852+0000","last_clean":"2024-09-14T12:44:13.707852+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T12:44:13.707852+0000","last_undegraded":"2024-09-14T12:44:13.707852+0000","last_fullsized":"2024-09-14T12:44:13.707852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:13.707645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:13.707645+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.707645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:41.725258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.137911+0000","last_change":"2024-09-14T12:44:26.137911+0000","last_active":"2024-09-14T12:44:26.137911+0000","last_peered":"2024-09-14T12:44:26.137911+0000","last_clean":"2024-09-14T12:44:26.137911+0000","last_became_active":"2024-09-14T10:49:27.373801+0000","last_became_peered":"2024-09-14T10:49:27.373801+0000","last_unstale":"2024-09-14T12:44:26.137911+0000","last_undegraded":"2024-09-14T12:44:26.137911+0000","last_fullsized":"2024-09-14T12:44:26.137911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:26.137730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:26.137730+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.137730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:24.785770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'254","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.791267+0000","last_change":"2024-09-14T12:44:30.791267+0000","last_active":"2024-09-14T12:44:30.791267+0000","last_peered":"2024-09-14T12:44:30.791267+0000","last_clean":"2024-09-14T12:44:30.791267+0000","last_became_active":"2024-09-14T10:49:29.387176+0000","last_became_peered":"2024-09-14T10:49:29.387176+0000","last_unstale":"2024-09-14T12:44:30.791267+0000","last_undegraded":"2024-09-14T12:44:30.791267+0000","last_fullsized":"2024-09-14T12:44:30.791267+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'254","last_scrub_stamp":"2024-09-14T12:44:30.791067+0000","last_deep_scrub":"267'254","last_deep_scrub_stamp":"2024-09-14T12:44:30.791067+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.791067+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:09.347252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'796","reported_seq":3344,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.949405+0000","last_change":"2024-09-14T12:44:33.949405+0000","last_active":"2024-09-14T12:44:33.949405+0000","last_peered":"2024-09-14T12:44:33.949405+0000","last_clean":"2024-09-14T12:44:33.949405+0000","last_became_active":"2024-09-14T10:49:31.417376+0000","last_became_peered":"2024-09-14T10:49:31.417376+0000","last_unstale":"2024-09-14T12:44:33.949405+0000","last_undegraded":"2024-09-14T12:44:33.949405+0000","last_fullsized":"2024-09-14T12:44:33.949405+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'796","last_scrub_stamp":"2024-09-14T12:44:33.949129+0000","last_deep_scrub":"267'796","last_deep_scrub_stamp":"2024-09-14T12:44:33.949129+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.949129+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:26.181427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'151","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.423786+0000","last_change":"2024-09-14T12:44:37.423620+0000","last_active":"2024-09-14T12:44:37.423786+0000","last_peered":"2024-09-14T12:44:37.423786+0000","last_clean":"2024-09-14T12:44:37.423786+0000","last_became_active":"2024-09-14T10:49:33.459122+0000","last_became_peered":"2024-09-14T10:49:33.459122+0000","last_unstale":"2024-09-14T12:44:37.423786+0000","last_undegraded":"2024-09-14T12:44:37.423786+0000","last_fullsized":"2024-09-14T12:44:37.423786+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-14T12:44:37.423425+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-14T12:44:37.423425+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.423425+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:06.374161+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":355,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'840","reported_seq":2556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.829846+0000","last_change":"2024-09-14T12:44:18.829846+0000","last_active":"2024-09-14T12:44:18.829846+0000","last_peered":"2024-09-14T12:44:18.829846+0000","last_clean":"2024-09-14T12:44:18.829846+0000","last_became_active":"2024-09-14T10:49:25.360655+0000","last_became_peered":"2024-09-14T10:49:25.360655+0000","last_unstale":"2024-09-14T12:44:18.829846+0000","last_undegraded":"2024-09-14T12:44:18.829846+0000","last_fullsized":"2024-09-14T12:44:18.829846+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'840","last_scrub_stamp":"2024-09-14T12:44:18.829679+0000","last_deep_scrub":"267'840","last_deep_scrub_stamp":"2024-09-14T12:44:18.829679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.829679+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:29.657903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4101,"num_read_kb":3716,"num_write":1090,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2812,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'464","reported_seq":1180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.768697+0000","last_change":"2024-09-14T12:44:13.768407+0000","last_active":"2024-09-14T12:44:13.768697+0000","last_peered":"2024-09-14T12:44:13.768697+0000","last_clean":"2024-09-14T12:44:13.768697+0000","last_became_active":"2024-09-14T10:49:23.359442+0000","last_became_peered":"2024-09-14T10:49:23.359442+0000","last_unstale":"2024-09-14T12:44:13.768697+0000","last_undegraded":"2024-09-14T12:44:13.768697+0000","last_fullsized":"2024-09-14T12:44:13.768697+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'464","last_scrub_stamp":"2024-09-14T12:44:13.768049+0000","last_deep_scrub":"267'464","last_deep_scrub_stamp":"2024-09-14T12:44:13.768049+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.768049+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:42.033691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":830,"num_read_kb":31084,"num_write":1362,"num_write_kb":31792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.756536+0000","last_change":"2024-09-14T12:44:11.756536+0000","last_active":"2024-09-14T12:44:11.756536+0000","last_peered":"2024-09-14T12:44:11.756536+0000","last_clean":"2024-09-14T12:44:11.756536+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T12:44:11.756536+0000","last_undegraded":"2024-09-14T12:44:11.756536+0000","last_fullsized":"2024-09-14T12:44:11.756536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:11.756350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:11.756350+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.756350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:46.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.633161+0000","last_change":"2024-09-14T12:44:38.633161+0000","last_active":"2024-09-14T12:44:38.633161+0000","last_peered":"2024-09-14T12:44:38.633161+0000","last_clean":"2024-09-14T12:44:38.633161+0000","last_became_active":"2024-09-14T10:49:27.384635+0000","last_became_peered":"2024-09-14T10:49:27.384635+0000","last_unstale":"2024-09-14T12:44:38.633161+0000","last_undegraded":"2024-09-14T12:44:38.633161+0000","last_fullsized":"2024-09-14T12:44:38.633161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:38.632938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:38.632938+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.632938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:11.086517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'184","reported_seq":791,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.632514+0000","last_change":"2024-09-14T12:44:42.632514+0000","last_active":"2024-09-14T12:44:42.632514+0000","last_peered":"2024-09-14T12:44:42.632514+0000","last_clean":"2024-09-14T12:44:42.632514+0000","last_became_active":"2024-09-14T10:49:29.394105+0000","last_became_peered":"2024-09-14T10:49:29.394105+0000","last_unstale":"2024-09-14T12:44:42.632514+0000","last_undegraded":"2024-09-14T12:44:42.632514+0000","last_fullsized":"2024-09-14T12:44:42.632514+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-14T12:44:42.632311+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-14T12:44:42.632311+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.632311+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:01.232345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'830","reported_seq":3154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.999557+0000","last_change":"2024-09-14T12:44:35.999557+0000","last_active":"2024-09-14T12:44:35.999557+0000","last_peered":"2024-09-14T12:44:35.999557+0000","last_clean":"2024-09-14T12:44:35.999557+0000","last_became_active":"2024-09-14T10:49:31.411055+0000","last_became_peered":"2024-09-14T10:49:31.411055+0000","last_unstale":"2024-09-14T12:44:35.999557+0000","last_undegraded":"2024-09-14T12:44:35.999557+0000","last_fullsized":"2024-09-14T12:44:35.999557+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'830","last_scrub_stamp":"2024-09-14T12:44:35.999262+0000","last_deep_scrub":"267'830","last_deep_scrub_stamp":"2024-09-14T12:44:35.999262+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.999262+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:37.589153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'273","reported_seq":827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.881708+0000","last_change":"2024-09-14T12:44:45.881708+0000","last_active":"2024-09-14T12:44:45.881708+0000","last_peered":"2024-09-14T12:44:45.881708+0000","last_clean":"2024-09-14T12:44:45.881708+0000","last_became_active":"2024-09-14T10:49:33.456806+0000","last_became_peered":"2024-09-14T10:49:33.456806+0000","last_unstale":"2024-09-14T12:44:45.881708+0000","last_undegraded":"2024-09-14T12:44:45.881708+0000","last_fullsized":"2024-09-14T12:44:45.881708+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-09-14T12:44:45.881495+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-09-14T12:44:45.881495+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.881495+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:15.185394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":331,"num_read_kb":330,"num_write":580,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'504","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.868409+0000","last_change":"2024-09-14T12:44:17.868409+0000","last_active":"2024-09-14T12:44:17.868409+0000","last_peered":"2024-09-14T12:44:17.868409+0000","last_clean":"2024-09-14T12:44:17.868409+0000","last_became_active":"2024-09-14T10:49:25.372923+0000","last_became_peered":"2024-09-14T10:49:25.372923+0000","last_unstale":"2024-09-14T12:44:17.868409+0000","last_undegraded":"2024-09-14T12:44:17.868409+0000","last_fullsized":"2024-09-14T12:44:17.868409+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'504","last_scrub_stamp":"2024-09-14T12:44:17.868183+0000","last_deep_scrub":"267'504","last_deep_scrub_stamp":"2024-09-14T12:44:17.868183+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.868183+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:43:56.368622+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2643,"num_read_kb":2487,"num_write":591,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'357","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.806944+0000","last_change":"2024-09-14T12:44:15.806944+0000","last_active":"2024-09-14T12:44:15.806944+0000","last_peered":"2024-09-14T12:44:15.806944+0000","last_clean":"2024-09-14T12:44:15.806944+0000","last_became_active":"2024-09-14T10:49:23.344863+0000","last_became_peered":"2024-09-14T10:49:23.344863+0000","last_unstale":"2024-09-14T12:44:15.806944+0000","last_undegraded":"2024-09-14T12:44:15.806944+0000","last_fullsized":"2024-09-14T12:44:15.806944+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-14T12:44:15.806628+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-14T12:44:15.806628+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.806628+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:08.490411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":37228,"num_write":1084,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.734938+0000","last_change":"2024-09-14T12:44:15.734938+0000","last_active":"2024-09-14T12:44:15.734938+0000","last_peered":"2024-09-14T12:44:15.734938+0000","last_clean":"2024-09-14T12:44:15.734938+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T12:44:15.734938+0000","last_undegraded":"2024-09-14T12:44:15.734938+0000","last_fullsized":"2024-09-14T12:44:15.734938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:15.734744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:15.734744+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.734744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:19.978999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.862888+0000","last_change":"2024-09-14T12:44:27.862888+0000","last_active":"2024-09-14T12:44:27.862888+0000","last_peered":"2024-09-14T12:44:27.862888+0000","last_clean":"2024-09-14T12:44:27.862888+0000","last_became_active":"2024-09-14T10:49:27.379820+0000","last_became_peered":"2024-09-14T10:49:27.379820+0000","last_unstale":"2024-09-14T12:44:27.862888+0000","last_undegraded":"2024-09-14T12:44:27.862888+0000","last_fullsized":"2024-09-14T12:44:27.862888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.862707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.862707+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.862707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:05.909921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'854","reported_seq":1658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.125584+0000","last_change":"2024-09-14T12:44:30.125584+0000","last_active":"2024-09-14T12:44:30.125584+0000","last_peered":"2024-09-14T12:44:30.125584+0000","last_clean":"2024-09-14T12:44:30.125584+0000","last_became_active":"2024-09-14T10:49:29.389500+0000","last_became_peered":"2024-09-14T10:49:29.389500+0000","last_unstale":"2024-09-14T12:44:30.125584+0000","last_undegraded":"2024-09-14T12:44:30.125584+0000","last_fullsized":"2024-09-14T12:44:30.125584+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'854","last_scrub_stamp":"2024-09-14T12:44:30.125277+0000","last_deep_scrub":"267'854","last_deep_scrub_stamp":"2024-09-14T12:44:30.125277+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.125277+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:14.671455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1507,"num_read_kb":3507,"num_write":1226,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.849089+0000","last_change":"2024-09-14T12:44:40.849089+0000","last_active":"2024-09-14T12:44:40.849089+0000","last_peered":"2024-09-14T12:44:40.849089+0000","last_clean":"2024-09-14T12:44:40.849089+0000","last_became_active":"2024-09-14T10:49:31.413008+0000","last_became_peered":"2024-09-14T10:49:31.413008+0000","last_unstale":"2024-09-14T12:44:40.849089+0000","last_undegraded":"2024-09-14T12:44:40.849089+0000","last_fullsized":"2024-09-14T12:44:40.849089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:40.848905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:40.848905+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.848905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:56.723688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'121","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.032543+0000","last_change":"2024-09-14T12:44:36.032543+0000","last_active":"2024-09-14T12:44:36.032543+0000","last_peered":"2024-09-14T12:44:36.032543+0000","last_clean":"2024-09-14T12:44:36.032543+0000","last_became_active":"2024-09-14T10:49:33.468546+0000","last_became_peered":"2024-09-14T10:49:33.468546+0000","last_unstale":"2024-09-14T12:44:36.032543+0000","last_undegraded":"2024-09-14T12:44:36.032543+0000","last_fullsized":"2024-09-14T12:44:36.032543+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'121","last_scrub_stamp":"2024-09-14T12:44:36.032367+0000","last_deep_scrub":"267'121","last_deep_scrub_stamp":"2024-09-14T12:44:36.032367+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.032367+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:18.041019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'162","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.862334+0000","last_change":"2024-09-14T12:44:45.862334+0000","last_active":"2024-09-14T12:44:45.862334+0000","last_peered":"2024-09-14T12:44:45.862334+0000","last_clean":"2024-09-14T12:44:45.862334+0000","last_became_active":"2024-09-14T10:49:33.461782+0000","last_became_peered":"2024-09-14T10:49:33.461782+0000","last_unstale":"2024-09-14T12:44:45.862334+0000","last_undegraded":"2024-09-14T12:44:45.862334+0000","last_fullsized":"2024-09-14T12:44:45.862334+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-14T12:44:45.862144+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-14T12:44:45.862144+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.862144+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:42.062797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":264,"num_write":397,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'522","reported_seq":2256,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.824159+0000","last_change":"2024-09-14T12:44:18.824159+0000","last_active":"2024-09-14T12:44:18.824159+0000","last_peered":"2024-09-14T12:44:18.824159+0000","last_clean":"2024-09-14T12:44:18.824159+0000","last_became_active":"2024-09-14T10:49:25.381653+0000","last_became_peered":"2024-09-14T10:49:25.381653+0000","last_unstale":"2024-09-14T12:44:18.824159+0000","last_undegraded":"2024-09-14T12:44:18.824159+0000","last_fullsized":"2024-09-14T12:44:18.824159+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'522","last_scrub_stamp":"2024-09-14T12:44:18.823867+0000","last_deep_scrub":"267'522","last_deep_scrub_stamp":"2024-09-14T12:44:18.823867+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.823867+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:50.458414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2737,"num_read_kb":2577,"num_write":621,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'379","reported_seq":1168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.737083+0000","last_change":"2024-09-14T12:44:19.737083+0000","last_active":"2024-09-14T12:44:19.737083+0000","last_peered":"2024-09-14T12:44:19.737083+0000","last_clean":"2024-09-14T12:44:19.737083+0000","last_became_active":"2024-09-14T10:49:23.365341+0000","last_became_peered":"2024-09-14T10:49:23.365341+0000","last_unstale":"2024-09-14T12:44:19.737083+0000","last_undegraded":"2024-09-14T12:44:19.737083+0000","last_fullsized":"2024-09-14T12:44:19.737083+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-14T12:44:19.736779+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-14T12:44:19.736779+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.736779+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:24.797053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":685,"num_read_kb":37659,"num_write":1131,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.822470+0000","last_change":"2024-09-14T12:44:28.822470+0000","last_active":"2024-09-14T12:44:28.822470+0000","last_peered":"2024-09-14T12:44:28.822470+0000","last_clean":"2024-09-14T12:44:28.822470+0000","last_became_active":"2024-09-14T10:49:27.366990+0000","last_became_peered":"2024-09-14T10:49:27.366990+0000","last_unstale":"2024-09-14T12:44:28.822470+0000","last_undegraded":"2024-09-14T12:44:28.822470+0000","last_fullsized":"2024-09-14T12:44:28.822470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.822277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.822277+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.822277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:55.142780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'339","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.817196+0000","last_change":"2024-09-14T12:44:32.817196+0000","last_active":"2024-09-14T12:44:32.817196+0000","last_peered":"2024-09-14T12:44:32.817196+0000","last_clean":"2024-09-14T12:44:32.817196+0000","last_became_active":"2024-09-14T10:49:29.371655+0000","last_became_peered":"2024-09-14T10:49:29.371655+0000","last_unstale":"2024-09-14T12:44:32.817196+0000","last_undegraded":"2024-09-14T12:44:32.817196+0000","last_fullsized":"2024-09-14T12:44:32.817196+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'339","last_scrub_stamp":"2024-09-14T12:44:32.816993+0000","last_deep_scrub":"267'339","last_deep_scrub_stamp":"2024-09-14T12:44:32.816993+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.816993+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:27.300458+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49045,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":1185,"num_write":440,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.445889+0000","last_change":"2024-09-14T12:44:30.445889+0000","last_active":"2024-09-14T12:44:30.445889+0000","last_peered":"2024-09-14T12:44:30.445889+0000","last_clean":"2024-09-14T12:44:30.445889+0000","last_became_active":"2024-09-14T10:49:31.417675+0000","last_became_peered":"2024-09-14T10:49:31.417675+0000","last_unstale":"2024-09-14T12:44:30.445889+0000","last_undegraded":"2024-09-14T12:44:30.445889+0000","last_fullsized":"2024-09-14T12:44:30.445889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.445715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.445715+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.445715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:06.472746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'147","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.442177+0000","last_change":"2024-09-14T12:44:36.442177+0000","last_active":"2024-09-14T12:44:36.442177+0000","last_peered":"2024-09-14T12:44:36.442177+0000","last_clean":"2024-09-14T12:44:36.442177+0000","last_became_active":"2024-09-14T10:49:33.453630+0000","last_became_peered":"2024-09-14T10:49:33.453630+0000","last_unstale":"2024-09-14T12:44:36.442177+0000","last_undegraded":"2024-09-14T12:44:36.442177+0000","last_fullsized":"2024-09-14T12:44:36.442177+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-14T12:44:36.441978+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-14T12:44:36.441978+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.441978+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:04.829195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":363,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'723","reported_seq":2170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.861931+0000","last_change":"2024-09-14T12:44:20.861931+0000","last_active":"2024-09-14T12:44:20.861931+0000","last_peered":"2024-09-14T12:44:20.861931+0000","last_clean":"2024-09-14T12:44:20.861931+0000","last_became_active":"2024-09-14T10:49:25.373876+0000","last_became_peered":"2024-09-14T10:49:25.373876+0000","last_unstale":"2024-09-14T12:44:20.861931+0000","last_undegraded":"2024-09-14T12:44:20.861931+0000","last_fullsized":"2024-09-14T12:44:20.861931+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'723","last_scrub_stamp":"2024-09-14T12:44:20.861737+0000","last_deep_scrub":"267'723","last_deep_scrub_stamp":"2024-09-14T12:44:20.861737+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.861737+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.715221+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3124,"num_write":967,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'350","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.354231+0000","last_change":"2024-09-14T12:44:10.354231+0000","last_active":"2024-09-14T12:44:10.354231+0000","last_peered":"2024-09-14T12:44:10.354231+0000","last_clean":"2024-09-14T12:44:10.354231+0000","last_became_active":"2024-09-14T10:49:23.373206+0000","last_became_peered":"2024-09-14T10:49:23.373206+0000","last_unstale":"2024-09-14T12:44:10.354231+0000","last_undegraded":"2024-09-14T12:44:10.354231+0000","last_fullsized":"2024-09-14T12:44:10.354231+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.354149+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:26.010856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":656,"num_read_kb":34264,"num_write":1064,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.921353+0000","last_change":"2024-09-14T12:44:29.921353+0000","last_active":"2024-09-14T12:44:29.921353+0000","last_peered":"2024-09-14T12:44:29.921353+0000","last_clean":"2024-09-14T12:44:29.921353+0000","last_became_active":"2024-09-14T10:49:27.370174+0000","last_became_peered":"2024-09-14T10:49:27.370174+0000","last_unstale":"2024-09-14T12:44:29.921353+0000","last_undegraded":"2024-09-14T12:44:29.921353+0000","last_fullsized":"2024-09-14T12:44:29.921353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:29.921175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:29.921175+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.921175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.172813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'81","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.990154+0000","last_change":"2024-09-14T12:44:36.990154+0000","last_active":"2024-09-14T12:44:36.990154+0000","last_peered":"2024-09-14T12:44:36.990154+0000","last_clean":"2024-09-14T12:44:36.990154+0000","last_became_active":"2024-09-14T10:49:29.375761+0000","last_became_peered":"2024-09-14T10:49:29.375761+0000","last_unstale":"2024-09-14T12:44:36.990154+0000","last_undegraded":"2024-09-14T12:44:36.990154+0000","last_fullsized":"2024-09-14T12:44:36.990154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-14T12:44:36.989961+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-14T12:44:36.989961+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.989961+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:30.155450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.044701+0000","last_change":"2024-09-14T12:44:32.044701+0000","last_active":"2024-09-14T12:44:32.044701+0000","last_peered":"2024-09-14T12:44:32.044701+0000","last_clean":"2024-09-14T12:44:32.044701+0000","last_became_active":"2024-09-14T10:49:31.410915+0000","last_became_peered":"2024-09-14T10:49:31.410915+0000","last_unstale":"2024-09-14T12:44:32.044701+0000","last_undegraded":"2024-09-14T12:44:32.044701+0000","last_fullsized":"2024-09-14T12:44:32.044701+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.044515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.044515+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.044515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:08.562387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'183","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.890645+0000","last_change":"2024-09-14T12:44:40.890645+0000","last_active":"2024-09-14T12:44:40.890645+0000","last_peered":"2024-09-14T12:44:40.890645+0000","last_clean":"2024-09-14T12:44:40.890645+0000","last_became_active":"2024-09-14T10:49:33.453278+0000","last_became_peered":"2024-09-14T10:49:33.453278+0000","last_unstale":"2024-09-14T12:44:40.890645+0000","last_undegraded":"2024-09-14T12:44:40.890645+0000","last_fullsized":"2024-09-14T12:44:40.890645+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-14T12:44:40.890463+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-14T12:44:40.890463+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.890463+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.946061+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":265,"num_write":381,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'434","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.823436+0000","last_change":"2024-09-14T12:44:19.823436+0000","last_active":"2024-09-14T12:44:19.823436+0000","last_peered":"2024-09-14T12:44:19.823436+0000","last_clean":"2024-09-14T12:44:19.823436+0000","last_became_active":"2024-09-14T10:49:25.353010+0000","last_became_peered":"2024-09-14T10:49:25.353010+0000","last_unstale":"2024-09-14T12:44:19.823436+0000","last_undegraded":"2024-09-14T12:44:19.823436+0000","last_fullsized":"2024-09-14T12:44:19.823436+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T12:44:19.823256+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T12:44:19.823256+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.823256+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:53.762038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2606,"num_read_kb":2470,"num_write":495,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2789,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'374","reported_seq":1101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.874359+0000","last_change":"2024-09-14T12:44:12.874359+0000","last_active":"2024-09-14T12:44:12.874359+0000","last_peered":"2024-09-14T12:44:12.874359+0000","last_clean":"2024-09-14T12:44:12.874359+0000","last_became_active":"2024-09-14T10:49:23.403718+0000","last_became_peered":"2024-09-14T10:49:23.403718+0000","last_unstale":"2024-09-14T12:44:12.874359+0000","last_undegraded":"2024-09-14T12:44:12.874359+0000","last_fullsized":"2024-09-14T12:44:12.874359+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:12.874166+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:12.874166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.874166+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.218268+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":743,"num_read_kb":4167,"num_write":1078,"num_write_kb":34340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.937501+0000","last_change":"2024-09-14T12:44:25.937501+0000","last_active":"2024-09-14T12:44:25.937501+0000","last_peered":"2024-09-14T12:44:25.937501+0000","last_clean":"2024-09-14T12:44:25.937501+0000","last_became_active":"2024-09-14T10:49:27.377584+0000","last_became_peered":"2024-09-14T10:49:27.377584+0000","last_unstale":"2024-09-14T12:44:25.937501+0000","last_undegraded":"2024-09-14T12:44:25.937501+0000","last_fullsized":"2024-09-14T12:44:25.937501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:25.937326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:25.937326+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.937326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:22:46.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'391","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.463215+0000","last_change":"2024-09-14T12:44:28.463215+0000","last_active":"2024-09-14T12:44:28.463215+0000","last_peered":"2024-09-14T12:44:28.463215+0000","last_clean":"2024-09-14T12:44:28.463215+0000","last_became_active":"2024-09-14T10:49:29.389523+0000","last_became_peered":"2024-09-14T10:49:29.389523+0000","last_unstale":"2024-09-14T12:44:28.463215+0000","last_undegraded":"2024-09-14T12:44:28.463215+0000","last_fullsized":"2024-09-14T12:44:28.463215+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:28.462999+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:28.462999+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.462999+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:51.561087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":1411,"num_write":516,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.976410+0000","last_change":"2024-09-14T12:44:32.976410+0000","last_active":"2024-09-14T12:44:32.976410+0000","last_peered":"2024-09-14T12:44:32.976410+0000","last_clean":"2024-09-14T12:44:32.976410+0000","last_became_active":"2024-09-14T10:49:31.422113+0000","last_became_peered":"2024-09-14T10:49:31.422113+0000","last_unstale":"2024-09-14T12:44:32.976410+0000","last_undegraded":"2024-09-14T12:44:32.976410+0000","last_fullsized":"2024-09-14T12:44:32.976410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.976323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.976323+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.976323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:04.712094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'154","reported_seq":697,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.507616+0000","last_change":"2024-09-14T10:49:33.476247+0000","last_active":"2024-09-14T12:42:06.507616+0000","last_peered":"2024-09-14T12:42:06.507616+0000","last_clean":"2024-09-14T12:42:06.507616+0000","last_became_active":"2024-09-14T10:49:33.475156+0000","last_became_peered":"2024-09-14T10:49:33.475156+0000","last_unstale":"2024-09-14T12:42:06.507616+0000","last_undegraded":"2024-09-14T12:42:06.507616+0000","last_fullsized":"2024-09-14T12:42:06.507616+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'414","reported_seq":2104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.582365+0000","last_change":"2024-09-14T12:44:15.582365+0000","last_active":"2024-09-14T12:44:15.582365+0000","last_peered":"2024-09-14T12:44:15.582365+0000","last_clean":"2024-09-14T12:44:15.582365+0000","last_became_active":"2024-09-14T10:49:25.370901+0000","last_became_peered":"2024-09-14T10:49:25.370901+0000","last_unstale":"2024-09-14T12:44:15.582365+0000","last_undegraded":"2024-09-14T12:44:15.582365+0000","last_fullsized":"2024-09-14T12:44:15.582365+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-14T12:44:15.582102+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-14T12:44:15.582102+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.582102+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.776690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2274,"num_write":465,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'391","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.879398+0000","last_change":"2024-09-14T12:44:13.879398+0000","last_active":"2024-09-14T12:44:13.879398+0000","last_peered":"2024-09-14T12:44:13.879398+0000","last_clean":"2024-09-14T12:44:13.879398+0000","last_became_active":"2024-09-14T10:49:23.369669+0000","last_became_peered":"2024-09-14T10:49:23.369669+0000","last_unstale":"2024-09-14T12:44:13.879398+0000","last_undegraded":"2024-09-14T12:44:13.879398+0000","last_fullsized":"2024-09-14T12:44:13.879398+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:13.879160+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:13.879160+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.879160+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:49.729813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":9973,"num_write":1367,"num_write_kb":36861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.654516+0000","last_change":"2024-09-14T12:44:39.654516+0000","last_active":"2024-09-14T12:44:39.654516+0000","last_peered":"2024-09-14T12:44:39.654516+0000","last_clean":"2024-09-14T12:44:39.654516+0000","last_became_active":"2024-09-14T10:49:27.387840+0000","last_became_peered":"2024-09-14T10:49:27.387840+0000","last_unstale":"2024-09-14T12:44:39.654516+0000","last_undegraded":"2024-09-14T12:44:39.654516+0000","last_fullsized":"2024-09-14T12:44:39.654516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:39.654319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:39.654319+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.654319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:54.984917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'326","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.095208+0000","last_change":"2024-09-14T12:44:31.095208+0000","last_active":"2024-09-14T12:44:31.095208+0000","last_peered":"2024-09-14T12:44:31.095208+0000","last_clean":"2024-09-14T12:44:31.095208+0000","last_became_active":"2024-09-14T10:49:29.391517+0000","last_became_peered":"2024-09-14T10:49:29.391517+0000","last_unstale":"2024-09-14T12:44:31.095208+0000","last_undegraded":"2024-09-14T12:44:31.095208+0000","last_fullsized":"2024-09-14T12:44:31.095208+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-14T12:44:31.095032+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-14T12:44:31.095032+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.095032+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:29.436997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1347,"num_write":436,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.446579+0000","last_change":"2024-09-14T12:44:32.446579+0000","last_active":"2024-09-14T12:44:32.446579+0000","last_peered":"2024-09-14T12:44:32.446579+0000","last_clean":"2024-09-14T12:44:32.446579+0000","last_became_active":"2024-09-14T10:49:31.410633+0000","last_became_peered":"2024-09-14T10:49:31.410633+0000","last_unstale":"2024-09-14T12:44:32.446579+0000","last_undegraded":"2024-09-14T12:44:32.446579+0000","last_fullsized":"2024-09-14T12:44:32.446579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.446388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.446388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.446388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:13.501051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'751","reported_seq":2295,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.670411+0000","last_change":"2024-09-14T12:44:32.670411+0000","last_active":"2024-09-14T12:44:32.670411+0000","last_peered":"2024-09-14T12:44:32.670411+0000","last_clean":"2024-09-14T12:44:32.670411+0000","last_became_active":"2024-09-14T10:49:25.408028+0000","last_became_peered":"2024-09-14T10:49:25.408028+0000","last_unstale":"2024-09-14T12:44:32.670411+0000","last_undegraded":"2024-09-14T12:44:32.670411+0000","last_fullsized":"2024-09-14T12:44:32.670411+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-14T12:44:32.670221+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-14T12:44:32.670221+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.670221+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:57.489984+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3658,"num_read_kb":3304,"num_write":985,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'372","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.827233+0000","last_change":"2024-09-14T12:44:16.827233+0000","last_active":"2024-09-14T12:44:16.827233+0000","last_peered":"2024-09-14T12:44:16.827233+0000","last_clean":"2024-09-14T12:44:16.827233+0000","last_became_active":"2024-09-14T10:49:23.386404+0000","last_became_peered":"2024-09-14T10:49:23.386404+0000","last_unstale":"2024-09-14T12:44:16.827233+0000","last_undegraded":"2024-09-14T12:44:16.827233+0000","last_fullsized":"2024-09-14T12:44:16.827233+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-09-14T12:44:16.827021+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-09-14T12:44:16.827021+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.827021+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:13.386836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":6911,"num_write":1204,"num_write_kb":32272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"267'4","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.816334+0000","last_change":"2024-09-14T12:44:31.816334+0000","last_active":"2024-09-14T12:44:31.816334+0000","last_peered":"2024-09-14T12:44:31.816334+0000","last_clean":"2024-09-14T12:44:31.816334+0000","last_became_active":"2024-09-14T10:49:27.381931+0000","last_became_peered":"2024-09-14T10:49:27.381931+0000","last_unstale":"2024-09-14T12:44:31.816334+0000","last_undegraded":"2024-09-14T12:44:31.816334+0000","last_fullsized":"2024-09-14T12:44:31.816334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:31.816149+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:31.816149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.816149+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:16.372632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'562","reported_seq":1243,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.789977+0000","last_change":"2024-09-14T12:44:34.789977+0000","last_active":"2024-09-14T12:44:34.789977+0000","last_peered":"2024-09-14T12:44:34.789977+0000","last_clean":"2024-09-14T12:44:34.789977+0000","last_became_active":"2024-09-14T10:49:29.364013+0000","last_became_peered":"2024-09-14T10:49:29.364013+0000","last_unstale":"2024-09-14T12:44:34.789977+0000","last_undegraded":"2024-09-14T12:44:34.789977+0000","last_fullsized":"2024-09-14T12:44:34.789977+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'562","last_scrub_stamp":"2024-09-14T12:44:34.789779+0000","last_deep_scrub":"267'562","last_deep_scrub_stamp":"2024-09-14T12:44:34.789779+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.789779+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:50.715654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98236,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":964,"num_read_kb":2193,"num_write":836,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.058334+0000","last_change":"2024-09-14T12:44:33.058215+0000","last_active":"2024-09-14T12:44:33.058334+0000","last_peered":"2024-09-14T12:44:33.058334+0000","last_clean":"2024-09-14T12:44:33.058334+0000","last_became_active":"2024-09-14T10:49:31.431550+0000","last_became_peered":"2024-09-14T10:49:31.431550+0000","last_unstale":"2024-09-14T12:44:33.058334+0000","last_undegraded":"2024-09-14T12:44:33.058334+0000","last_fullsized":"2024-09-14T12:44:33.058334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:33.058048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:33.058048+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.058048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:28.024232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'164","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.778843+0000","last_change":"2024-09-14T12:44:48.778843+0000","last_active":"2024-09-14T12:44:48.778843+0000","last_peered":"2024-09-14T12:44:48.778843+0000","last_clean":"2024-09-14T12:44:48.778843+0000","last_became_active":"2024-09-14T10:49:33.466424+0000","last_became_peered":"2024-09-14T10:49:33.466424+0000","last_unstale":"2024-09-14T12:44:48.778843+0000","last_undegraded":"2024-09-14T12:44:48.778843+0000","last_fullsized":"2024-09-14T12:44:48.778843+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'164","last_scrub_stamp":"2024-09-14T12:44:48.778544+0000","last_deep_scrub":"267'164","last_deep_scrub_stamp":"2024-09-14T12:44:48.778544+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.778544+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:06.494723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":247,"num_write":384,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'833","reported_seq":2415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.875239+0000","last_change":"2024-09-14T12:44:22.875239+0000","last_active":"2024-09-14T12:44:22.875239+0000","last_peered":"2024-09-14T12:44:22.875239+0000","last_clean":"2024-09-14T12:44:22.875239+0000","last_became_active":"2024-09-14T10:49:25.364958+0000","last_became_peered":"2024-09-14T10:49:25.364958+0000","last_unstale":"2024-09-14T12:44:22.875239+0000","last_undegraded":"2024-09-14T12:44:22.875239+0000","last_fullsized":"2024-09-14T12:44:22.875239+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'833","last_scrub_stamp":"2024-09-14T12:44:22.875065+0000","last_deep_scrub":"267'833","last_deep_scrub_stamp":"2024-09-14T12:44:22.875065+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.875065+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.794954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3911,"num_read_kb":3508,"num_write":1119,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'415","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.788261+0000","last_change":"2024-09-14T12:44:14.788261+0000","last_active":"2024-09-14T12:44:14.788261+0000","last_peered":"2024-09-14T12:44:14.788261+0000","last_clean":"2024-09-14T12:44:14.788261+0000","last_became_active":"2024-09-14T10:49:23.375310+0000","last_became_peered":"2024-09-14T10:49:23.375310+0000","last_unstale":"2024-09-14T12:44:14.788261+0000","last_undegraded":"2024-09-14T12:44:14.788261+0000","last_fullsized":"2024-09-14T12:44:14.788261+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'415","last_scrub_stamp":"2024-09-14T12:44:14.788046+0000","last_deep_scrub":"267'415","last_deep_scrub_stamp":"2024-09-14T12:44:14.788046+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.788046+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:33.478823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":827,"num_read_kb":30368,"num_write":1218,"num_write_kb":52321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"267'6","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.896401+0000","last_change":"2024-09-14T12:44:26.896401+0000","last_active":"2024-09-14T12:44:26.896401+0000","last_peered":"2024-09-14T12:44:26.896401+0000","last_clean":"2024-09-14T12:44:26.896401+0000","last_became_active":"2024-09-14T10:49:27.386412+0000","last_became_peered":"2024-09-14T10:49:27.386412+0000","last_unstale":"2024-09-14T12:44:26.896401+0000","last_undegraded":"2024-09-14T12:44:26.896401+0000","last_fullsized":"2024-09-14T12:44:26.896401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:44:26.896175+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:44:26.896175+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.896175+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:02.056846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'366","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.588847+0000","last_change":"2024-09-14T12:44:45.588847+0000","last_active":"2024-09-14T12:44:45.588847+0000","last_peered":"2024-09-14T12:44:45.588847+0000","last_clean":"2024-09-14T12:44:45.588847+0000","last_became_active":"2024-09-14T10:49:29.388370+0000","last_became_peered":"2024-09-14T10:49:29.388370+0000","last_unstale":"2024-09-14T12:44:45.588847+0000","last_undegraded":"2024-09-14T12:44:45.588847+0000","last_fullsized":"2024-09-14T12:44:45.588847+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-14T12:44:45.588589+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-14T12:44:45.588589+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.588589+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:21.697378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46292,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":1047,"num_write":462,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.906350+0000","last_change":"2024-09-14T12:44:43.906350+0000","last_active":"2024-09-14T12:44:43.906350+0000","last_peered":"2024-09-14T12:44:43.906350+0000","last_clean":"2024-09-14T12:44:43.906350+0000","last_became_active":"2024-09-14T10:49:31.429861+0000","last_became_peered":"2024-09-14T10:49:31.429861+0000","last_unstale":"2024-09-14T12:44:43.906350+0000","last_undegraded":"2024-09-14T12:44:43.906350+0000","last_fullsized":"2024-09-14T12:44:43.906350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.906177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.906177+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.906177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.207899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'278","reported_seq":834,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.559029+0000","last_change":"2024-09-14T10:49:33.451361+0000","last_active":"2024-09-14T12:42:24.559029+0000","last_peered":"2024-09-14T12:42:24.559029+0000","last_clean":"2024-09-14T12:42:24.559029+0000","last_became_active":"2024-09-14T10:49:33.446698+0000","last_became_peered":"2024-09-14T10:49:33.446698+0000","last_unstale":"2024-09-14T12:42:24.559029+0000","last_undegraded":"2024-09-14T12:42:24.559029+0000","last_fullsized":"2024-09-14T12:42:24.559029+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:44.754797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":288,"num_write":643,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'447","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.545524+0000","last_change":"2024-09-14T12:44:17.545357+0000","last_active":"2024-09-14T12:44:17.545524+0000","last_peered":"2024-09-14T12:44:17.545524+0000","last_clean":"2024-09-14T12:44:17.545524+0000","last_became_active":"2024-09-14T10:49:25.395644+0000","last_became_peered":"2024-09-14T10:49:25.395644+0000","last_unstale":"2024-09-14T12:44:17.545524+0000","last_undegraded":"2024-09-14T12:44:17.545524+0000","last_fullsized":"2024-09-14T12:44:17.545524+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-14T12:44:17.545155+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-14T12:44:17.545155+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.545155+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:13.025501+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2723,"num_read_kb":2577,"num_write":520,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4341,"num_omap_keys":17,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'336","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.899355+0000","last_change":"2024-09-14T12:44:12.899210+0000","last_active":"2024-09-14T12:44:12.899355+0000","last_peered":"2024-09-14T12:44:12.899355+0000","last_clean":"2024-09-14T12:44:12.899355+0000","last_became_active":"2024-09-14T10:49:23.394870+0000","last_became_peered":"2024-09-14T10:49:23.394870+0000","last_unstale":"2024-09-14T12:44:12.899355+0000","last_undegraded":"2024-09-14T12:44:12.899355+0000","last_fullsized":"2024-09-14T12:44:12.899355+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-14T12:44:12.898987+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-14T12:44:12.898987+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.898987+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:41.227802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":18368,"num_write":1090,"num_write_kb":30203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.945577+0000","last_change":"2024-09-14T12:44:28.945449+0000","last_active":"2024-09-14T12:44:28.945577+0000","last_peered":"2024-09-14T12:44:28.945577+0000","last_clean":"2024-09-14T12:44:28.945577+0000","last_became_active":"2024-09-14T10:49:27.385720+0000","last_became_peered":"2024-09-14T10:49:27.385720+0000","last_unstale":"2024-09-14T12:44:28.945577+0000","last_undegraded":"2024-09-14T12:44:28.945577+0000","last_fullsized":"2024-09-14T12:44:28.945577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.945269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.945269+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.945269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:03.455314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'343","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.781739+0000","last_change":"2024-09-14T12:44:35.781739+0000","last_active":"2024-09-14T12:44:35.781739+0000","last_peered":"2024-09-14T12:44:35.781739+0000","last_clean":"2024-09-14T12:44:35.781739+0000","last_became_active":"2024-09-14T10:49:29.363989+0000","last_became_peered":"2024-09-14T10:49:29.363989+0000","last_unstale":"2024-09-14T12:44:35.781739+0000","last_undegraded":"2024-09-14T12:44:35.781739+0000","last_fullsized":"2024-09-14T12:44:35.781739+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-14T12:44:35.781529+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-14T12:44:35.781529+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.781529+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:24.488305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1124,"num_write":422,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.464325+0000","last_change":"2024-09-14T12:44:33.464325+0000","last_active":"2024-09-14T12:44:33.464325+0000","last_peered":"2024-09-14T12:44:33.464325+0000","last_clean":"2024-09-14T12:44:33.464325+0000","last_became_active":"2024-09-14T10:49:31.421636+0000","last_became_peered":"2024-09-14T10:49:31.421636+0000","last_unstale":"2024-09-14T12:44:33.464325+0000","last_undegraded":"2024-09-14T12:44:33.464325+0000","last_fullsized":"2024-09-14T12:44:33.464325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:33.464135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:33.464135+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.464135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:54.819362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'128","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:48.656575+0000","last_change":"2024-09-14T10:49:33.466507+0000","last_active":"2024-09-14T12:43:48.656575+0000","last_peered":"2024-09-14T12:43:48.656575+0000","last_clean":"2024-09-14T12:43:48.656575+0000","last_became_active":"2024-09-14T10:49:33.465638+0000","last_became_peered":"2024-09-14T10:49:33.465638+0000","last_unstale":"2024-09-14T12:43:48.656575+0000","last_undegraded":"2024-09-14T12:43:48.656575+0000","last_fullsized":"2024-09-14T12:43:48.656575+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:13.972982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'571","reported_seq":2236,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.880853+0000","last_change":"2024-09-14T12:44:21.880578+0000","last_active":"2024-09-14T12:44:21.880853+0000","last_peered":"2024-09-14T12:44:21.880853+0000","last_clean":"2024-09-14T12:44:21.880853+0000","last_became_active":"2024-09-14T10:49:25.383840+0000","last_became_peered":"2024-09-14T10:49:25.383840+0000","last_unstale":"2024-09-14T12:44:21.880853+0000","last_undegraded":"2024-09-14T12:44:21.880853+0000","last_fullsized":"2024-09-14T12:44:21.880853+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'571","last_scrub_stamp":"2024-09-14T12:44:21.880347+0000","last_deep_scrub":"267'571","last_deep_scrub_stamp":"2024-09-14T12:44:21.880347+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.880347+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:27.080812+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2923,"num_read_kb":2712,"num_write":720,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'483","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.844983+0000","last_change":"2024-09-14T12:44:16.844845+0000","last_active":"2024-09-14T12:44:16.844983+0000","last_peered":"2024-09-14T12:44:16.844983+0000","last_clean":"2024-09-14T12:44:16.844983+0000","last_became_active":"2024-09-14T10:49:23.338934+0000","last_became_peered":"2024-09-14T10:49:23.338934+0000","last_unstale":"2024-09-14T12:44:16.844983+0000","last_undegraded":"2024-09-14T12:44:16.844983+0000","last_fullsized":"2024-09-14T12:44:16.844983+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'483","last_scrub_stamp":"2024-09-14T12:44:16.844628+0000","last_deep_scrub":"267'483","last_deep_scrub_stamp":"2024-09-14T12:44:16.844628+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.844628+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.573418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":33265,"num_write":1328,"num_write_kb":49842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.061095+0000","last_change":"2024-09-14T12:44:35.061095+0000","last_active":"2024-09-14T12:44:35.061095+0000","last_peered":"2024-09-14T12:44:35.061095+0000","last_clean":"2024-09-14T12:44:35.061095+0000","last_became_active":"2024-09-14T10:49:27.368567+0000","last_became_peered":"2024-09-14T10:49:27.368567+0000","last_unstale":"2024-09-14T12:44:35.061095+0000","last_undegraded":"2024-09-14T12:44:35.061095+0000","last_fullsized":"2024-09-14T12:44:35.061095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:35.060889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:35.060889+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.060889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:24.593261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'156","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.541873+0000","last_change":"2024-09-14T12:44:48.541873+0000","last_active":"2024-09-14T12:44:48.541873+0000","last_peered":"2024-09-14T12:44:48.541873+0000","last_clean":"2024-09-14T12:44:48.541873+0000","last_became_active":"2024-09-14T10:49:29.392965+0000","last_became_peered":"2024-09-14T10:49:29.392965+0000","last_unstale":"2024-09-14T12:44:48.541873+0000","last_undegraded":"2024-09-14T12:44:48.541873+0000","last_fullsized":"2024-09-14T12:44:48.541873+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-14T12:44:48.541678+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-14T12:44:48.541678+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.541678+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:48.747164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":187,"num_read_kb":181,"num_write":132,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'792","reported_seq":3274,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.088048+0000","last_change":"2024-09-14T12:44:35.088048+0000","last_active":"2024-09-14T12:44:35.088048+0000","last_peered":"2024-09-14T12:44:35.088048+0000","last_clean":"2024-09-14T12:44:35.088048+0000","last_became_active":"2024-09-14T10:49:31.422765+0000","last_became_peered":"2024-09-14T10:49:31.422765+0000","last_unstale":"2024-09-14T12:44:35.088048+0000","last_undegraded":"2024-09-14T12:44:35.088048+0000","last_fullsized":"2024-09-14T12:44:35.088048+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'792","last_scrub_stamp":"2024-09-14T12:44:35.087864+0000","last_deep_scrub":"267'792","last_deep_scrub_stamp":"2024-09-14T12:44:35.087864+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.087864+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:04.440955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'100","reported_seq":619,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:27.666413+0000","last_change":"2024-09-14T10:49:33.443828+0000","last_active":"2024-09-14T12:42:27.666413+0000","last_peered":"2024-09-14T12:42:27.666413+0000","last_clean":"2024-09-14T12:42:27.666413+0000","last_became_active":"2024-09-14T10:49:33.443020+0000","last_became_peered":"2024-09-14T10:49:33.443020+0000","last_unstale":"2024-09-14T12:42:27.666413+0000","last_undegraded":"2024-09-14T12:42:27.666413+0000","last_fullsized":"2024-09-14T12:42:27.666413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:20.241734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":233,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'970","reported_seq":2593,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.816889+0000","last_change":"2024-09-14T12:44:21.816713+0000","last_active":"2024-09-14T12:44:21.816889+0000","last_peered":"2024-09-14T12:44:21.816889+0000","last_clean":"2024-09-14T12:44:21.816889+0000","last_became_active":"2024-09-14T10:49:25.400786+0000","last_became_peered":"2024-09-14T10:49:25.400786+0000","last_unstale":"2024-09-14T12:44:21.816889+0000","last_undegraded":"2024-09-14T12:44:21.816889+0000","last_fullsized":"2024-09-14T12:44:21.816889+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'970","last_scrub_stamp":"2024-09-14T12:44:21.816523+0000","last_deep_scrub":"267'970","last_deep_scrub_stamp":"2024-09-14T12:44:21.816523+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.816523+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:09.527962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4481,"num_read_kb":3955,"num_write":1321,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'333","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.924005+0000","last_change":"2024-09-14T12:44:11.923935+0000","last_active":"2024-09-14T12:44:11.924005+0000","last_peered":"2024-09-14T12:44:11.924005+0000","last_clean":"2024-09-14T12:44:11.924005+0000","last_became_active":"2024-09-14T10:49:23.394973+0000","last_became_peered":"2024-09-14T10:49:23.394973+0000","last_unstale":"2024-09-14T12:44:11.924005+0000","last_undegraded":"2024-09-14T12:44:11.924005+0000","last_fullsized":"2024-09-14T12:44:11.924005+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-14T12:44:11.923816+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-14T12:44:11.923816+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.923816+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:11.570601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":75765,"num_write":1031,"num_write_kb":39860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.012498+0000","last_change":"2024-09-14T12:44:28.012242+0000","last_active":"2024-09-14T12:44:28.012498+0000","last_peered":"2024-09-14T12:44:28.012498+0000","last_clean":"2024-09-14T12:44:28.012498+0000","last_became_active":"2024-09-14T10:49:27.377395+0000","last_became_peered":"2024-09-14T10:49:27.377395+0000","last_unstale":"2024-09-14T12:44:28.012498+0000","last_undegraded":"2024-09-14T12:44:28.012498+0000","last_fullsized":"2024-09-14T12:44:28.012498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.011952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.011952+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.011952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:18.742458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'402","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.112814+0000","last_change":"2024-09-14T12:44:32.112814+0000","last_active":"2024-09-14T12:44:32.112814+0000","last_peered":"2024-09-14T12:44:32.112814+0000","last_clean":"2024-09-14T12:44:32.112814+0000","last_became_active":"2024-09-14T10:49:29.376813+0000","last_became_peered":"2024-09-14T10:49:29.376813+0000","last_unstale":"2024-09-14T12:44:32.112814+0000","last_undegraded":"2024-09-14T12:44:32.112814+0000","last_fullsized":"2024-09-14T12:44:32.112814+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:32.112560+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:32.112560+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.112560+0000","objects_scrubbed":9,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.095209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":628,"num_read_kb":1214,"num_write":492,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.844904+0000","last_change":"2024-09-14T12:44:43.844904+0000","last_active":"2024-09-14T12:44:43.844904+0000","last_peered":"2024-09-14T12:44:43.844904+0000","last_clean":"2024-09-14T12:44:43.844904+0000","last_became_active":"2024-09-14T10:49:31.424394+0000","last_became_peered":"2024-09-14T10:49:31.424394+0000","last_unstale":"2024-09-14T12:44:43.844904+0000","last_undegraded":"2024-09-14T12:44:43.844904+0000","last_fullsized":"2024-09-14T12:44:43.844904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.844695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.844695+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.844695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:32.714429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'154","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.960158+0000","last_change":"2024-09-14T12:44:38.960158+0000","last_active":"2024-09-14T12:44:38.960158+0000","last_peered":"2024-09-14T12:44:38.960158+0000","last_clean":"2024-09-14T12:44:38.960158+0000","last_became_active":"2024-09-14T10:49:33.462582+0000","last_became_peered":"2024-09-14T10:49:33.462582+0000","last_unstale":"2024-09-14T12:44:38.960158+0000","last_undegraded":"2024-09-14T12:44:38.960158+0000","last_fullsized":"2024-09-14T12:44:38.960158+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'154","last_scrub_stamp":"2024-09-14T12:44:38.959922+0000","last_deep_scrub":"267'154","last_deep_scrub_stamp":"2024-09-14T12:44:38.959922+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.959922+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.366755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":151,"num_write":347,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'490","reported_seq":2237,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.838896+0000","last_change":"2024-09-14T12:44:22.838759+0000","last_active":"2024-09-14T12:44:22.838896+0000","last_peered":"2024-09-14T12:44:22.838896+0000","last_clean":"2024-09-14T12:44:22.838896+0000","last_became_active":"2024-09-14T10:49:25.386937+0000","last_became_peered":"2024-09-14T10:49:25.386937+0000","last_unstale":"2024-09-14T12:44:22.838896+0000","last_undegraded":"2024-09-14T12:44:22.838896+0000","last_fullsized":"2024-09-14T12:44:22.838896+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-14T12:44:22.838569+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-14T12:44:22.838569+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.838569+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:03.633378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2676,"num_write":566,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'362","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.713951+0000","last_change":"2024-09-14T12:44:20.713683+0000","last_active":"2024-09-14T12:44:20.713951+0000","last_peered":"2024-09-14T12:44:20.713951+0000","last_clean":"2024-09-14T12:44:20.713951+0000","last_became_active":"2024-09-14T10:49:53.505479+0000","last_became_peered":"2024-09-14T10:49:53.505479+0000","last_unstale":"2024-09-14T12:44:20.713951+0000","last_undegraded":"2024-09-14T12:44:20.713951+0000","last_fullsized":"2024-09-14T12:44:20.713951+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-14T12:44:20.713333+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-14T12:44:20.713333+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.713333+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:04.232788+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3150208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":68230,"num_write":1159,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1,6],"acting":[3,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.889000+0000","last_change":"2024-09-14T12:44:24.888871+0000","last_active":"2024-09-14T12:44:24.889000+0000","last_peered":"2024-09-14T12:44:24.889000+0000","last_clean":"2024-09-14T12:44:24.889000+0000","last_became_active":"2024-09-14T10:49:27.371450+0000","last_became_peered":"2024-09-14T10:49:27.371450+0000","last_unstale":"2024-09-14T12:44:24.889000+0000","last_undegraded":"2024-09-14T12:44:24.889000+0000","last_fullsized":"2024-09-14T12:44:24.889000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.888693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.888693+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.888693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:48.211818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'305","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.885606+0000","last_change":"2024-09-14T12:44:39.885606+0000","last_active":"2024-09-14T12:44:39.885606+0000","last_peered":"2024-09-14T12:44:39.885606+0000","last_clean":"2024-09-14T12:44:39.885606+0000","last_became_active":"2024-09-14T10:49:29.379942+0000","last_became_peered":"2024-09-14T10:49:29.379942+0000","last_unstale":"2024-09-14T12:44:39.885606+0000","last_undegraded":"2024-09-14T12:44:39.885606+0000","last_fullsized":"2024-09-14T12:44:39.885606+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'305","last_scrub_stamp":"2024-09-14T12:44:39.885357+0000","last_deep_scrub":"267'305","last_deep_scrub_stamp":"2024-09-14T12:44:39.885357+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.885357+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:40.991849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1051,"num_write":386,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.539280+0000","last_change":"2024-09-14T12:44:50.539280+0000","last_active":"2024-09-14T12:44:50.539280+0000","last_peered":"2024-09-14T12:44:50.539280+0000","last_clean":"2024-09-14T12:44:50.539280+0000","last_became_active":"2024-09-14T10:49:31.424882+0000","last_became_peered":"2024-09-14T10:49:31.424882+0000","last_unstale":"2024-09-14T12:44:50.539280+0000","last_undegraded":"2024-09-14T12:44:50.539280+0000","last_fullsized":"2024-09-14T12:44:50.539280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:50.539102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:50.539102+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.539102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:57.508334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'116","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.817966+0000","last_change":"2024-09-14T12:44:49.817966+0000","last_active":"2024-09-14T12:44:49.817966+0000","last_peered":"2024-09-14T12:44:49.817966+0000","last_clean":"2024-09-14T12:44:49.817966+0000","last_became_active":"2024-09-14T10:49:33.468026+0000","last_became_peered":"2024-09-14T10:49:33.468026+0000","last_unstale":"2024-09-14T12:44:49.817966+0000","last_undegraded":"2024-09-14T12:44:49.817966+0000","last_fullsized":"2024-09-14T12:44:49.817966+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-14T12:44:49.817767+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-14T12:44:49.817767+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.817767+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:17.594684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":167,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'980","reported_seq":2681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.498418+0000","last_change":"2024-09-14T12:44:18.498418+0000","last_active":"2024-09-14T12:44:18.498418+0000","last_peered":"2024-09-14T12:44:18.498418+0000","last_clean":"2024-09-14T12:44:18.498418+0000","last_became_active":"2024-09-14T10:49:25.386168+0000","last_became_peered":"2024-09-14T10:49:25.386168+0000","last_unstale":"2024-09-14T12:44:18.498418+0000","last_undegraded":"2024-09-14T12:44:18.498418+0000","last_fullsized":"2024-09-14T12:44:18.498418+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'980","last_scrub_stamp":"2024-09-14T12:44:18.498226+0000","last_deep_scrub":"267'980","last_deep_scrub_stamp":"2024-09-14T12:44:18.498226+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.498226+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":900,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:55.963844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4881,"num_read_kb":4356,"num_write":1346,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'333","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.874395+0000","last_change":"2024-09-14T12:44:14.874395+0000","last_active":"2024-09-14T12:44:14.874395+0000","last_peered":"2024-09-14T12:44:14.874395+0000","last_clean":"2024-09-14T12:44:14.874395+0000","last_became_active":"2024-09-14T10:49:23.367940+0000","last_became_peered":"2024-09-14T10:49:23.367940+0000","last_unstale":"2024-09-14T12:44:14.874395+0000","last_undegraded":"2024-09-14T12:44:14.874395+0000","last_fullsized":"2024-09-14T12:44:14.874395+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-14T12:44:14.874116+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-14T12:44:14.874116+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.874116+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:30.960138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":29401,"num_write":1062,"num_write_kb":29053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.057865+0000","last_change":"2024-09-14T12:44:27.057865+0000","last_active":"2024-09-14T12:44:27.057865+0000","last_peered":"2024-09-14T12:44:27.057865+0000","last_clean":"2024-09-14T12:44:27.057865+0000","last_became_active":"2024-09-14T10:49:27.380333+0000","last_became_peered":"2024-09-14T10:49:27.380333+0000","last_unstale":"2024-09-14T12:44:27.057865+0000","last_undegraded":"2024-09-14T12:44:27.057865+0000","last_fullsized":"2024-09-14T12:44:27.057865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.057679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.057679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.057679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:58.978461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'245","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.803683+0000","last_change":"2024-09-14T12:44:33.803683+0000","last_active":"2024-09-14T12:44:33.803683+0000","last_peered":"2024-09-14T12:44:33.803683+0000","last_clean":"2024-09-14T12:44:33.803683+0000","last_became_active":"2024-09-14T10:49:29.377643+0000","last_became_peered":"2024-09-14T10:49:29.377643+0000","last_unstale":"2024-09-14T12:44:33.803683+0000","last_undegraded":"2024-09-14T12:44:33.803683+0000","last_fullsized":"2024-09-14T12:44:33.803683+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-14T12:44:33.803469+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-14T12:44:33.803469+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.803469+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:10.902639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":877,"num_write":306,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:06.507526+0000","last_change":"2024-09-14T10:49:31.431402+0000","last_active":"2024-09-14T12:42:06.507526+0000","last_peered":"2024-09-14T12:42:06.507526+0000","last_clean":"2024-09-14T12:42:06.507526+0000","last_became_active":"2024-09-14T10:49:31.430693+0000","last_became_peered":"2024-09-14T10:49:31.430693+0000","last_unstale":"2024-09-14T12:42:06.507526+0000","last_undegraded":"2024-09-14T12:42:06.507526+0000","last_fullsized":"2024-09-14T12:42:06.507526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:30.373253+0000","last_clean_scrub_stamp":"2024-09-14T10:49:30.373253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'154","reported_seq":1639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:24.449796+0000","last_change":"2024-09-14T10:49:33.476298+0000","last_active":"2024-09-14T12:42:24.449796+0000","last_peered":"2024-09-14T12:42:24.449796+0000","last_clean":"2024-09-14T12:42:24.449796+0000","last_became_active":"2024-09-14T10:49:33.475592+0000","last_became_peered":"2024-09-14T10:49:33.475592+0000","last_unstale":"2024-09-14T12:42:24.449796+0000","last_undegraded":"2024-09-14T12:42:24.449796+0000","last_fullsized":"2024-09-14T12:42:24.449796+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:49:32.415123+0000","last_clean_scrub_stamp":"2024-09-14T10:49:32.415123+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:10.319176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1153,"num_read_kb":1151,"num_write":333,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'1203","reported_seq":2922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.787205+0000","last_change":"2024-09-14T12:44:20.787205+0000","last_active":"2024-09-14T12:44:20.787205+0000","last_peered":"2024-09-14T12:44:20.787205+0000","last_clean":"2024-09-14T12:44:20.787205+0000","last_became_active":"2024-09-14T10:49:25.362059+0000","last_became_peered":"2024-09-14T10:49:25.362059+0000","last_unstale":"2024-09-14T12:44:20.787205+0000","last_undegraded":"2024-09-14T12:44:20.787205+0000","last_fullsized":"2024-09-14T12:44:20.787205+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1203","last_scrub_stamp":"2024-09-14T12:44:20.786965+0000","last_deep_scrub":"267'1203","last_deep_scrub_stamp":"2024-09-14T12:44:20.786965+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.786965+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:56.073347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5522,"num_read_kb":4921,"num_write":1640,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'397","reported_seq":1097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.828976+0000","last_change":"2024-09-14T12:44:15.828976+0000","last_active":"2024-09-14T12:44:15.828976+0000","last_peered":"2024-09-14T12:44:15.828976+0000","last_clean":"2024-09-14T12:44:15.828976+0000","last_became_active":"2024-09-14T10:49:23.381620+0000","last_became_peered":"2024-09-14T10:49:23.381620+0000","last_unstale":"2024-09-14T12:44:15.828976+0000","last_undegraded":"2024-09-14T12:44:15.828976+0000","last_fullsized":"2024-09-14T12:44:15.828976+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'397","last_scrub_stamp":"2024-09-14T12:44:15.828640+0000","last_deep_scrub":"267'397","last_deep_scrub_stamp":"2024-09-14T12:44:15.828640+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.828640+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:00.548137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":34199,"num_write":1236,"num_write_kb":46564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.036308+0000","last_change":"2024-09-14T12:44:33.036308+0000","last_active":"2024-09-14T12:44:33.036308+0000","last_peered":"2024-09-14T12:44:33.036308+0000","last_clean":"2024-09-14T12:44:33.036308+0000","last_became_active":"2024-09-14T10:49:27.372685+0000","last_became_peered":"2024-09-14T10:49:27.372685+0000","last_unstale":"2024-09-14T12:44:33.036308+0000","last_undegraded":"2024-09-14T12:44:33.036308+0000","last_fullsized":"2024-09-14T12:44:33.036308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:33.036137+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:33.036137+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.036137+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:52.037804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'335","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.560421+0000","last_change":"2024-09-14T12:44:44.560421+0000","last_active":"2024-09-14T12:44:44.560421+0000","last_peered":"2024-09-14T12:44:44.560421+0000","last_clean":"2024-09-14T12:44:44.560421+0000","last_became_active":"2024-09-14T10:49:29.396379+0000","last_became_peered":"2024-09-14T10:49:29.396379+0000","last_unstale":"2024-09-14T12:44:44.560421+0000","last_undegraded":"2024-09-14T12:44:44.560421+0000","last_fullsized":"2024-09-14T12:44:44.560421+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-14T12:44:44.560226+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-14T12:44:44.560226+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.560226+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.490856+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":1145,"num_write":432,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.856757+0000","last_change":"2024-09-14T12:44:44.856757+0000","last_active":"2024-09-14T12:44:44.856757+0000","last_peered":"2024-09-14T12:44:44.856757+0000","last_clean":"2024-09-14T12:44:44.856757+0000","last_became_active":"2024-09-14T10:49:31.418819+0000","last_became_peered":"2024-09-14T10:49:31.418819+0000","last_unstale":"2024-09-14T12:44:44.856757+0000","last_undegraded":"2024-09-14T12:44:44.856757+0000","last_fullsized":"2024-09-14T12:44:44.856757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.856547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.856547+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.856547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:51.055177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'138","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.084044+0000","last_change":"2024-09-14T12:44:34.084044+0000","last_active":"2024-09-14T12:44:34.084044+0000","last_peered":"2024-09-14T12:44:34.084044+0000","last_clean":"2024-09-14T12:44:34.084044+0000","last_became_active":"2024-09-14T10:49:33.476455+0000","last_became_peered":"2024-09-14T10:49:33.476455+0000","last_unstale":"2024-09-14T12:44:34.084044+0000","last_undegraded":"2024-09-14T12:44:34.084044+0000","last_fullsized":"2024-09-14T12:44:34.084044+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-14T12:44:34.083837+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-14T12:44:34.083837+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.083837+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:35.031509+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":173,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'506","reported_seq":2202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.882618+0000","last_change":"2024-09-14T12:44:23.882618+0000","last_active":"2024-09-14T12:44:23.882618+0000","last_peered":"2024-09-14T12:44:23.882618+0000","last_clean":"2024-09-14T12:44:23.882618+0000","last_became_active":"2024-09-14T10:49:25.373337+0000","last_became_peered":"2024-09-14T10:49:25.373337+0000","last_unstale":"2024-09-14T12:44:23.882618+0000","last_undegraded":"2024-09-14T12:44:23.882618+0000","last_fullsized":"2024-09-14T12:44:23.882618+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'506","last_scrub_stamp":"2024-09-14T12:44:23.882442+0000","last_deep_scrub":"267'506","last_deep_scrub_stamp":"2024-09-14T12:44:23.882442+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.882442+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:44.958416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2857,"num_read_kb":2693,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'347","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.908298+0000","last_change":"2024-09-14T12:44:13.908298+0000","last_active":"2024-09-14T12:44:13.908298+0000","last_peered":"2024-09-14T12:44:13.908298+0000","last_clean":"2024-09-14T12:44:13.908298+0000","last_became_active":"2024-09-14T10:49:23.377766+0000","last_became_peered":"2024-09-14T10:49:23.377766+0000","last_unstale":"2024-09-14T12:44:13.908298+0000","last_undegraded":"2024-09-14T12:44:13.908298+0000","last_fullsized":"2024-09-14T12:44:13.908298+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-14T12:44:13.908057+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-14T12:44:13.908057+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.908057+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:07.725881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":614,"num_read_kb":20992,"num_write":1055,"num_write_kb":39444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'626","reported_seq":2320,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.551496+0000","last_change":"2024-09-14T12:44:21.551496+0000","last_active":"2024-09-14T12:44:21.551496+0000","last_peered":"2024-09-14T12:44:21.551496+0000","last_clean":"2024-09-14T12:44:21.551496+0000","last_became_active":"2024-09-14T10:49:25.375595+0000","last_became_peered":"2024-09-14T10:49:25.375595+0000","last_unstale":"2024-09-14T12:44:21.551496+0000","last_undegraded":"2024-09-14T12:44:21.551496+0000","last_fullsized":"2024-09-14T12:44:21.551496+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'626","last_scrub_stamp":"2024-09-14T12:44:21.551295+0000","last_deep_scrub":"267'626","last_deep_scrub_stamp":"2024-09-14T12:44:21.551295+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.551295+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:00.863868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3344,"num_read_kb":3023,"num_write":799,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3029,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'295","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.544796+0000","last_change":"2024-09-14T12:44:16.544796+0000","last_active":"2024-09-14T12:44:16.544796+0000","last_peered":"2024-09-14T12:44:16.544796+0000","last_clean":"2024-09-14T12:44:16.544796+0000","last_became_active":"2024-09-14T10:49:23.390456+0000","last_became_peered":"2024-09-14T10:49:23.390456+0000","last_unstale":"2024-09-14T12:44:16.544796+0000","last_undegraded":"2024-09-14T12:44:16.544796+0000","last_fullsized":"2024-09-14T12:44:16.544796+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-09-14T12:44:16.544513+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-09-14T12:44:16.544513+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.544513+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:27.941670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":9558,"num_write":877,"num_write_kb":19994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'456","reported_seq":2095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.710507+0000","last_change":"2024-09-14T12:44:33.710507+0000","last_active":"2024-09-14T12:44:33.710507+0000","last_peered":"2024-09-14T12:44:33.710507+0000","last_clean":"2024-09-14T12:44:33.710507+0000","last_became_active":"2024-09-14T10:49:25.372436+0000","last_became_peered":"2024-09-14T10:49:25.372436+0000","last_unstale":"2024-09-14T12:44:33.710507+0000","last_undegraded":"2024-09-14T12:44:33.710507+0000","last_fullsized":"2024-09-14T12:44:33.710507+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'456","last_scrub_stamp":"2024-09-14T12:44:33.710293+0000","last_deep_scrub":"267'456","last_deep_scrub_stamp":"2024-09-14T12:44:33.710293+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.710293+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:43.829594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2453,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'344","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.667244+0000","last_change":"2024-09-14T12:44:24.667244+0000","last_active":"2024-09-14T12:44:24.667244+0000","last_peered":"2024-09-14T12:44:24.667244+0000","last_clean":"2024-09-14T12:44:24.667244+0000","last_became_active":"2024-09-14T10:49:23.395161+0000","last_became_peered":"2024-09-14T10:49:23.395161+0000","last_unstale":"2024-09-14T12:44:24.667244+0000","last_undegraded":"2024-09-14T12:44:24.667244+0000","last_fullsized":"2024-09-14T12:44:24.667244+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-09-14T12:44:24.666983+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-09-14T12:44:24.666983+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.666983+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:27.684732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":8858,"num_write":1038,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'758","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.904506+0000","last_change":"2024-09-14T12:44:28.904506+0000","last_active":"2024-09-14T12:44:28.904506+0000","last_peered":"2024-09-14T12:44:28.904506+0000","last_clean":"2024-09-14T12:44:28.904506+0000","last_became_active":"2024-09-14T10:49:25.390167+0000","last_became_peered":"2024-09-14T10:49:25.390167+0000","last_unstale":"2024-09-14T12:44:28.904506+0000","last_undegraded":"2024-09-14T12:44:28.904506+0000","last_fullsized":"2024-09-14T12:44:28.904506+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'758","last_scrub_stamp":"2024-09-14T12:44:28.904302+0000","last_deep_scrub":"267'758","last_deep_scrub_stamp":"2024-09-14T12:44:28.904302+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.904302+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:02.551450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3780,"num_read_kb":3460,"num_write":968,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'367","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.819989+0000","last_change":"2024-09-14T12:44:17.819655+0000","last_active":"2024-09-14T12:44:17.819989+0000","last_peered":"2024-09-14T12:44:17.819989+0000","last_clean":"2024-09-14T12:44:17.819989+0000","last_became_active":"2024-09-14T10:49:23.374332+0000","last_became_peered":"2024-09-14T10:49:23.374332+0000","last_unstale":"2024-09-14T12:44:17.819989+0000","last_undegraded":"2024-09-14T12:44:17.819989+0000","last_fullsized":"2024-09-14T12:44:17.819989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'367","last_scrub_stamp":"2024-09-14T12:44:17.819331+0000","last_deep_scrub":"267'367","last_deep_scrub_stamp":"2024-09-14T12:44:17.819331+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.819331+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:05.848392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":1430,"num_write":1267,"num_write_kb":16611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'437","reported_seq":2059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.858194+0000","last_change":"2024-09-14T12:44:27.858045+0000","last_active":"2024-09-14T12:44:27.858194+0000","last_peered":"2024-09-14T12:44:27.858194+0000","last_clean":"2024-09-14T12:44:27.858194+0000","last_became_active":"2024-09-14T10:49:25.390444+0000","last_became_peered":"2024-09-14T10:49:25.390444+0000","last_unstale":"2024-09-14T12:44:27.858194+0000","last_undegraded":"2024-09-14T12:44:27.858194+0000","last_fullsized":"2024-09-14T12:44:27.858194+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'437","last_scrub_stamp":"2024-09-14T12:44:27.857854+0000","last_deep_scrub":"267'437","last_deep_scrub_stamp":"2024-09-14T12:44:27.857854+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.857854+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.672313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2280,"num_write":506,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'317","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.767469+0000","last_change":"2024-09-14T12:44:16.767469+0000","last_active":"2024-09-14T12:44:16.767469+0000","last_peered":"2024-09-14T12:44:16.767469+0000","last_clean":"2024-09-14T12:44:16.767469+0000","last_became_active":"2024-09-14T10:49:23.365007+0000","last_became_peered":"2024-09-14T10:49:23.365007+0000","last_unstale":"2024-09-14T12:44:16.767469+0000","last_undegraded":"2024-09-14T12:44:16.767469+0000","last_fullsized":"2024-09-14T12:44:16.767469+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-14T12:44:16.766978+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-14T12:44:16.766978+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.766978+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:13.735465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":40511,"num_write":1024,"num_write_kb":34103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'622","reported_seq":2500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.287191+0000","last_change":"2024-09-14T12:44:19.287191+0000","last_active":"2024-09-14T12:44:19.287191+0000","last_peered":"2024-09-14T12:44:19.287191+0000","last_clean":"2024-09-14T12:44:19.287191+0000","last_became_active":"2024-09-14T10:49:25.380751+0000","last_became_peered":"2024-09-14T10:49:25.380751+0000","last_unstale":"2024-09-14T12:44:19.287191+0000","last_undegraded":"2024-09-14T12:44:19.287191+0000","last_fullsized":"2024-09-14T12:44:19.287191+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'622","last_scrub_stamp":"2024-09-14T12:44:19.287009+0000","last_deep_scrub":"267'622","last_deep_scrub_stamp":"2024-09-14T12:44:19.287009+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.287009+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:57.547324+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3385,"num_read_kb":3142,"num_write":784,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2004,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'366","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.728428+0000","last_change":"2024-09-14T12:44:15.728259+0000","last_active":"2024-09-14T12:44:15.728428+0000","last_peered":"2024-09-14T12:44:15.728428+0000","last_clean":"2024-09-14T12:44:15.728428+0000","last_became_active":"2024-09-14T10:49:23.366946+0000","last_became_peered":"2024-09-14T10:49:23.366946+0000","last_unstale":"2024-09-14T12:44:15.728428+0000","last_undegraded":"2024-09-14T12:44:15.728428+0000","last_fullsized":"2024-09-14T12:44:15.728428+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-14T12:44:15.728035+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-14T12:44:15.728035+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.728035+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:18.238063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":15339,"num_write":1195,"num_write_kb":33762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'818","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.856250+0000","last_change":"2024-09-14T12:44:25.856250+0000","last_active":"2024-09-14T12:44:25.856250+0000","last_peered":"2024-09-14T12:44:25.856250+0000","last_clean":"2024-09-14T12:44:25.856250+0000","last_became_active":"2024-09-14T10:49:25.394994+0000","last_became_peered":"2024-09-14T10:49:25.394994+0000","last_unstale":"2024-09-14T12:44:25.856250+0000","last_undegraded":"2024-09-14T12:44:25.856250+0000","last_fullsized":"2024-09-14T12:44:25.856250+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-09-14T12:44:25.856059+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-09-14T12:44:25.856059+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.856059+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:11:53.081476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4031,"num_read_kb":3664,"num_write":1069,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'391","reported_seq":1249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.840145+0000","last_change":"2024-09-14T12:44:11.839965+0000","last_active":"2024-09-14T12:44:11.840145+0000","last_peered":"2024-09-14T12:44:11.840145+0000","last_clean":"2024-09-14T12:44:11.840145+0000","last_became_active":"2024-09-14T10:49:23.373080+0000","last_became_peered":"2024-09-14T10:49:23.373080+0000","last_unstale":"2024-09-14T12:44:11.840145+0000","last_undegraded":"2024-09-14T12:44:11.840145+0000","last_fullsized":"2024-09-14T12:44:11.840145+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:11.839750+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:11.839750+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.839750+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:46.935339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1418,"num_read_kb":12734,"num_write":1224,"num_write_kb":19451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'537","reported_seq":2281,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.973009+0000","last_change":"2024-09-14T12:44:16.973009+0000","last_active":"2024-09-14T12:44:16.973009+0000","last_peered":"2024-09-14T12:44:16.973009+0000","last_clean":"2024-09-14T12:44:16.973009+0000","last_became_active":"2024-09-14T10:49:25.375465+0000","last_became_peered":"2024-09-14T10:49:25.375465+0000","last_unstale":"2024-09-14T12:44:16.973009+0000","last_undegraded":"2024-09-14T12:44:16.973009+0000","last_fullsized":"2024-09-14T12:44:16.973009+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'537","last_scrub_stamp":"2024-09-14T12:44:16.972830+0000","last_deep_scrub":"267'537","last_deep_scrub_stamp":"2024-09-14T12:44:16.972830+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.972830+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:54.021748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2646,"num_write":644,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'334","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.846014+0000","last_change":"2024-09-14T12:44:18.846014+0000","last_active":"2024-09-14T12:44:18.846014+0000","last_peered":"2024-09-14T12:44:18.846014+0000","last_clean":"2024-09-14T12:44:18.846014+0000","last_became_active":"2024-09-14T10:49:23.377964+0000","last_became_peered":"2024-09-14T10:49:23.377964+0000","last_unstale":"2024-09-14T12:44:18.846014+0000","last_undegraded":"2024-09-14T12:44:18.846014+0000","last_fullsized":"2024-09-14T12:44:18.846014+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-09-14T12:44:18.845792+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-09-14T12:44:18.845792+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.845792+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:26.978554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":579,"num_read_kb":6819,"num_write":1090,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'855","reported_seq":2417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.520037+0000","last_change":"2024-09-14T12:44:22.520037+0000","last_active":"2024-09-14T12:44:22.520037+0000","last_peered":"2024-09-14T12:44:22.520037+0000","last_clean":"2024-09-14T12:44:22.520037+0000","last_became_active":"2024-09-14T10:49:25.386541+0000","last_became_peered":"2024-09-14T10:49:25.386541+0000","last_unstale":"2024-09-14T12:44:22.520037+0000","last_undegraded":"2024-09-14T12:44:22.520037+0000","last_fullsized":"2024-09-14T12:44:22.520037+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'855","last_scrub_stamp":"2024-09-14T12:44:22.519854+0000","last_deep_scrub":"267'855","last_deep_scrub_stamp":"2024-09-14T12:44:22.519854+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.519854+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:12.468305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3987,"num_read_kb":3560,"num_write":1145,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'399","reported_seq":1084,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.639100+0000","last_change":"2024-09-14T12:44:22.638936+0000","last_active":"2024-09-14T12:44:22.639100+0000","last_peered":"2024-09-14T12:44:22.639100+0000","last_clean":"2024-09-14T12:44:22.639100+0000","last_became_active":"2024-09-14T10:49:23.387245+0000","last_became_peered":"2024-09-14T10:49:23.387245+0000","last_unstale":"2024-09-14T12:44:22.639100+0000","last_undegraded":"2024-09-14T12:44:22.639100+0000","last_fullsized":"2024-09-14T12:44:22.639100+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-14T12:44:22.638724+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-14T12:44:22.638724+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.638724+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:48.167793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":46181,"num_write":1283,"num_write_kb":35513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'851","reported_seq":2622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.131143+0000","last_change":"2024-09-14T12:44:23.131143+0000","last_active":"2024-09-14T12:44:23.131143+0000","last_peered":"2024-09-14T12:44:23.131143+0000","last_clean":"2024-09-14T12:44:23.131143+0000","last_became_active":"2024-09-14T10:49:25.373511+0000","last_became_peered":"2024-09-14T10:49:25.373511+0000","last_unstale":"2024-09-14T12:44:23.131143+0000","last_undegraded":"2024-09-14T12:44:23.131143+0000","last_fullsized":"2024-09-14T12:44:23.131143+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-14T12:44:23.130952+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-14T12:44:23.130952+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.130952+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:53.058385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4179,"num_read_kb":3797,"num_write":1119,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'377","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.860583+0000","last_change":"2024-09-14T12:44:19.860583+0000","last_active":"2024-09-14T12:44:19.860583+0000","last_peered":"2024-09-14T12:44:19.860583+0000","last_clean":"2024-09-14T12:44:19.860583+0000","last_became_active":"2024-09-14T10:49:23.377218+0000","last_became_peered":"2024-09-14T10:49:23.377218+0000","last_unstale":"2024-09-14T12:44:19.860583+0000","last_undegraded":"2024-09-14T12:44:19.860583+0000","last_fullsized":"2024-09-14T12:44:19.860583+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-09-14T12:44:19.860120+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-09-14T12:44:19.860120+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.860120+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:24.595003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5360649,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":652,"num_read_kb":6958,"num_write":1198,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'525","reported_seq":2139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.041596+0000","last_change":"2024-09-14T12:44:33.041336+0000","last_active":"2024-09-14T12:44:33.041596+0000","last_peered":"2024-09-14T12:44:33.041596+0000","last_clean":"2024-09-14T12:44:33.041596+0000","last_became_active":"2024-09-14T10:49:25.394237+0000","last_became_peered":"2024-09-14T10:49:25.394237+0000","last_unstale":"2024-09-14T12:44:33.041596+0000","last_undegraded":"2024-09-14T12:44:33.041596+0000","last_fullsized":"2024-09-14T12:44:33.041596+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'525","last_scrub_stamp":"2024-09-14T12:44:33.041096+0000","last_deep_scrub":"267'525","last_deep_scrub_stamp":"2024-09-14T12:44:33.041096+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.041096+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:10.429047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2610,"num_write":682,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'385","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.937989+0000","last_change":"2024-09-14T12:44:13.937989+0000","last_active":"2024-09-14T12:44:13.937989+0000","last_peered":"2024-09-14T12:44:13.937989+0000","last_clean":"2024-09-14T12:44:13.937989+0000","last_became_active":"2024-09-14T10:49:23.371845+0000","last_became_peered":"2024-09-14T10:49:23.371845+0000","last_unstale":"2024-09-14T12:44:13.937989+0000","last_undegraded":"2024-09-14T12:44:13.937989+0000","last_fullsized":"2024-09-14T12:44:13.937989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-14T12:44:13.937713+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-14T12:44:13.937713+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.937713+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.516351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":30325,"num_write":1182,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'407","reported_seq":1837,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.949255+0000","last_change":"2024-09-14T12:44:18.949255+0000","last_active":"2024-09-14T12:44:18.949255+0000","last_peered":"2024-09-14T12:44:18.949255+0000","last_clean":"2024-09-14T12:44:18.949255+0000","last_became_active":"2024-09-14T10:49:25.375374+0000","last_became_peered":"2024-09-14T10:49:25.375374+0000","last_unstale":"2024-09-14T12:44:18.949255+0000","last_undegraded":"2024-09-14T12:44:18.949255+0000","last_fullsized":"2024-09-14T12:44:18.949255+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-14T12:44:18.949068+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-14T12:44:18.949068+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.949068+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:26.275108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2030,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'390","reported_seq":1123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.807384+0000","last_change":"2024-09-14T12:44:17.807384+0000","last_active":"2024-09-14T12:44:17.807384+0000","last_peered":"2024-09-14T12:44:17.807384+0000","last_clean":"2024-09-14T12:44:17.807384+0000","last_became_active":"2024-09-14T10:49:23.371987+0000","last_became_peered":"2024-09-14T10:49:23.371987+0000","last_unstale":"2024-09-14T12:44:17.807384+0000","last_undegraded":"2024-09-14T12:44:17.807384+0000","last_fullsized":"2024-09-14T12:44:17.807384+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-09-14T12:44:17.807136+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-09-14T12:44:17.807136+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.807136+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:11.677728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":722,"num_read_kb":54432,"num_write":1171,"num_write_kb":38478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'768","reported_seq":2328,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.970413+0000","last_change":"2024-09-14T12:44:17.970413+0000","last_active":"2024-09-14T12:44:17.970413+0000","last_peered":"2024-09-14T12:44:17.970413+0000","last_clean":"2024-09-14T12:44:17.970413+0000","last_became_active":"2024-09-14T10:49:25.404302+0000","last_became_peered":"2024-09-14T10:49:25.404302+0000","last_unstale":"2024-09-14T12:44:17.970413+0000","last_undegraded":"2024-09-14T12:44:17.970413+0000","last_fullsized":"2024-09-14T12:44:17.970413+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'768","last_scrub_stamp":"2024-09-14T12:44:17.970223+0000","last_deep_scrub":"267'768","last_deep_scrub_stamp":"2024-09-14T12:44:17.970223+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.970223+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:07.913253+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3673,"num_read_kb":3318,"num_write":995,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'392","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.355966+0000","last_change":"2024-09-14T12:44:11.355966+0000","last_active":"2024-09-14T12:44:11.355966+0000","last_peered":"2024-09-14T12:44:11.355966+0000","last_clean":"2024-09-14T12:44:11.355966+0000","last_became_active":"2024-09-14T10:49:23.372362+0000","last_became_peered":"2024-09-14T10:49:23.372362+0000","last_unstale":"2024-09-14T12:44:11.355966+0000","last_undegraded":"2024-09-14T12:44:11.355966+0000","last_fullsized":"2024-09-14T12:44:11.355966+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-14T12:44:11.355879+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-14T12:44:11.355879+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.355879+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:43.785705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":10747,"num_write":1199,"num_write_kb":31883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"267'889","reported_seq":2547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.471116+0000","last_change":"2024-09-14T12:44:23.471116+0000","last_active":"2024-09-14T12:44:23.471116+0000","last_peered":"2024-09-14T12:44:23.471116+0000","last_clean":"2024-09-14T12:44:23.471116+0000","last_became_active":"2024-09-14T10:49:25.378231+0000","last_became_peered":"2024-09-14T10:49:25.378231+0000","last_unstale":"2024-09-14T12:44:23.471116+0000","last_undegraded":"2024-09-14T12:44:23.471116+0000","last_fullsized":"2024-09-14T12:44:23.471116+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'889","last_scrub_stamp":"2024-09-14T12:44:23.470931+0000","last_deep_scrub":"267'889","last_deep_scrub_stamp":"2024-09-14T12:44:23.470931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.470931+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:44.766183+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4260,"num_read_kb":3817,"num_write":1188,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'382","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.687570+0000","last_change":"2024-09-14T12:44:23.687320+0000","last_active":"2024-09-14T12:44:23.687570+0000","last_peered":"2024-09-14T12:44:23.687570+0000","last_clean":"2024-09-14T12:44:23.687570+0000","last_became_active":"2024-09-14T10:49:23.396179+0000","last_became_peered":"2024-09-14T10:49:23.396179+0000","last_unstale":"2024-09-14T12:44:23.687570+0000","last_undegraded":"2024-09-14T12:44:23.687570+0000","last_fullsized":"2024-09-14T12:44:23.687570+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:23.686889+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:23.686889+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.686889+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:10.063554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1034,"num_read_kb":35151,"num_write":1252,"num_write_kb":27361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'453","reported_seq":1998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.835269+0000","last_change":"2024-09-14T12:44:24.835269+0000","last_active":"2024-09-14T12:44:24.835269+0000","last_peered":"2024-09-14T12:44:24.835269+0000","last_clean":"2024-09-14T12:44:24.835269+0000","last_became_active":"2024-09-14T10:49:25.386602+0000","last_became_peered":"2024-09-14T10:49:25.386602+0000","last_unstale":"2024-09-14T12:44:24.835269+0000","last_undegraded":"2024-09-14T12:44:24.835269+0000","last_fullsized":"2024-09-14T12:44:24.835269+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'453","last_scrub_stamp":"2024-09-14T12:44:24.835090+0000","last_deep_scrub":"267'453","last_deep_scrub_stamp":"2024-09-14T12:44:24.835090+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.835090+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:19:05.573525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2532,"num_read_kb":2369,"num_write":580,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'365","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.600332+0000","last_change":"2024-09-14T12:44:14.600332+0000","last_active":"2024-09-14T12:44:14.600332+0000","last_peered":"2024-09-14T12:44:14.600332+0000","last_clean":"2024-09-14T12:44:14.600332+0000","last_became_active":"2024-09-14T10:49:23.369989+0000","last_became_peered":"2024-09-14T10:49:23.369989+0000","last_unstale":"2024-09-14T12:44:14.600332+0000","last_undegraded":"2024-09-14T12:44:14.600332+0000","last_fullsized":"2024-09-14T12:44:14.600332+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-14T12:44:14.600114+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-14T12:44:14.600114+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.600114+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.010341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":696,"num_read_kb":14222,"num_write":1159,"num_write_kb":28974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'1267","reported_seq":2972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.985235+0000","last_change":"2024-09-14T12:44:19.985004+0000","last_active":"2024-09-14T12:44:19.985235+0000","last_peered":"2024-09-14T12:44:19.985235+0000","last_clean":"2024-09-14T12:44:19.985235+0000","last_became_active":"2024-09-14T10:49:25.407817+0000","last_became_peered":"2024-09-14T10:49:25.407817+0000","last_unstale":"2024-09-14T12:44:19.985235+0000","last_undegraded":"2024-09-14T12:44:19.985235+0000","last_fullsized":"2024-09-14T12:44:19.985235+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1267","last_scrub_stamp":"2024-09-14T12:44:19.984761+0000","last_deep_scrub":"267'1267","last_deep_scrub_stamp":"2024-09-14T12:44:19.984761+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.984761+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":1200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:38.185470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5850,"num_read_kb":5153,"num_write":1753,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'378","reported_seq":1144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.660518+0000","last_change":"2024-09-14T12:44:26.660518+0000","last_active":"2024-09-14T12:44:26.660518+0000","last_peered":"2024-09-14T12:44:26.660518+0000","last_clean":"2024-09-14T12:44:26.660518+0000","last_became_active":"2024-09-14T10:49:23.365975+0000","last_became_peered":"2024-09-14T10:49:23.365975+0000","last_unstale":"2024-09-14T12:44:26.660518+0000","last_undegraded":"2024-09-14T12:44:26.660518+0000","last_fullsized":"2024-09-14T12:44:26.660518+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'378","last_scrub_stamp":"2024-09-14T12:44:26.660249+0000","last_deep_scrub":"267'378","last_deep_scrub_stamp":"2024-09-14T12:44:26.660249+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.660249+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:08.781982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":962,"num_read_kb":99658,"num_write":1167,"num_write_kb":35935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'346","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.701550+0000","last_change":"2024-09-14T12:44:25.701550+0000","last_active":"2024-09-14T12:44:25.701550+0000","last_peered":"2024-09-14T12:44:25.701550+0000","last_clean":"2024-09-14T12:44:25.701550+0000","last_became_active":"2024-09-14T10:49:23.373652+0000","last_became_peered":"2024-09-14T10:49:23.373652+0000","last_unstale":"2024-09-14T12:44:25.701550+0000","last_undegraded":"2024-09-14T12:44:25.701550+0000","last_fullsized":"2024-09-14T12:44:25.701550+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-14T12:44:25.701274+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-14T12:44:25.701274+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.701274+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:04.194083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":808,"num_write":1082,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'430","reported_seq":2032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.803698+0000","last_change":"2024-09-14T12:44:25.803698+0000","last_active":"2024-09-14T12:44:25.803698+0000","last_peered":"2024-09-14T12:44:25.803698+0000","last_clean":"2024-09-14T12:44:25.803698+0000","last_became_active":"2024-09-14T10:49:25.399830+0000","last_became_peered":"2024-09-14T10:49:25.399830+0000","last_unstale":"2024-09-14T12:44:25.803698+0000","last_undegraded":"2024-09-14T12:44:25.803698+0000","last_fullsized":"2024-09-14T12:44:25.803698+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-14T12:44:25.803503+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-14T12:44:25.803503+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.803503+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:00.772915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2288,"num_read_kb":2174,"num_write":485,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'357","reported_seq":1117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.812240+0000","last_change":"2024-09-14T12:44:20.812240+0000","last_active":"2024-09-14T12:44:20.812240+0000","last_peered":"2024-09-14T12:44:20.812240+0000","last_clean":"2024-09-14T12:44:20.812240+0000","last_became_active":"2024-09-14T10:49:23.382302+0000","last_became_peered":"2024-09-14T10:49:23.382302+0000","last_unstale":"2024-09-14T12:44:20.812240+0000","last_undegraded":"2024-09-14T12:44:20.812240+0000","last_fullsized":"2024-09-14T12:44:20.812240+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-14T12:44:20.812034+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-14T12:44:20.812034+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.812034+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:33.756604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":853,"num_read_kb":33665,"num_write":1061,"num_write_kb":42742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'434","reported_seq":2115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.047241+0000","last_change":"2024-09-14T12:44:25.047241+0000","last_active":"2024-09-14T12:44:25.047241+0000","last_peered":"2024-09-14T12:44:25.047241+0000","last_clean":"2024-09-14T12:44:25.047241+0000","last_became_active":"2024-09-14T10:49:25.391680+0000","last_became_peered":"2024-09-14T10:49:25.391680+0000","last_unstale":"2024-09-14T12:44:25.047241+0000","last_undegraded":"2024-09-14T12:44:25.047241+0000","last_fullsized":"2024-09-14T12:44:25.047241+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T12:44:25.047002+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T12:44:25.047002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.047002+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:34.093527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2427,"num_read_kb":2321,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10880,"num_read_kb":8996,"num_write":3119,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15325,"num_read_kb":14960,"num_write":17100,"num_write_kb":5007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1597,"ondisk_log_size":1597,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":574,"ondisk_log_size":574,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637897,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":21147,"num_read_kb":41034,"num_write":17727,"num_write_kb":12782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":716172,"num_omap_keys":1640,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2029,"ondisk_log_size":2029,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221603,"num_read_kb":202842,"num_write":56199,"num_write_kb":19273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35772,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3743,"ondisk_log_size":3743,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42369360,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44646,"num_read_kb":1985232,"num_write":73593,"num_write_kb":2196624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58359808,"data_stored":58359808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3987,"ondisk_log_size":3987,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":168154,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":167578,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510837,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":9404,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":9629696,"data_stored":7595829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510835,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281608,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94090232,"statfs":{"total":96636764160,"available":96348397568,"internally_reserved":0,"allocated":11919360,"data_stored":9909527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510838,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225296,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146544,"statfs":{"total":96636764160,"available":96406061056,"internally_reserved":0,"allocated":9764864,"data_stored":7751439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510839,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277220,"kb_used_data":11412,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94094620,"statfs":{"total":96636764160,"available":96352890880,"internally_reserved":0,"allocated":11685888,"data_stored":9655008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510838,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201292,"kb_used_data":13244,"kb_used_omap":1,"kb_used_meta":188030,"kb_avail":94170548,"statfs":{"total":96636764160,"available":96430641152,"internally_reserved":0,"allocated":13561856,"data_stored":11555946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":192543173},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510835,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339320,"kb_used_data":11048,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94032520,"statfs":{"total":96636764160,"available":96289300480,"internally_reserved":0,"allocated":11313152,"data_stored":9301608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510836,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138204,"kb_used_data":12620,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94233636,"statfs":{"total":96636764160,"available":96495243264,"internally_reserved":0,"allocated":12922880,"data_stored":10866139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543542,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242192,"kb_used_data":12544,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94129648,"statfs":{"total":96636764160,"available":96388759552,"internally_reserved":0,"allocated":12845056,"data_stored":10838842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235141578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8622080,"data_stored":8622080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6471680,"data_stored":6471680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9314304,"data_stored":9314304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7413760,"data_stored":7413760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5509120,"data_stored":5509120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7077888,"data_stored":7077888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5353472,"data_stored":5353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8597504,"data_stored":8597504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:44:53.607 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.608 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.608 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.608 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.608 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.608 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.608 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.608 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.609 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.609 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.609 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.609 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.609 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.609 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.609 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.610 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.610 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.610 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.610 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.610 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.610 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.610 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.611 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.611 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.611 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.611 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.611 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.611 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.611 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.611 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.612 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.612 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.612 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.612 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.612 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.612 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.612 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.613 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.613 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.613 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.613 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.613 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.613 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.613 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.614 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.614 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.614 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.614 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.614 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.614 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.614 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.615 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.615 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.615 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.615 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.615 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.615 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.615 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.616 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.616 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.616 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:12:18.050830+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=18, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.616 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.616 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.616 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:06:28.469133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=6, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.616 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.617 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.618 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.619 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.619 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.619 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.619 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:49:30.373253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.620 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:49:32.415123+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=49, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:44:53.620 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:45:13.622 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:45:13.992 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:45:14.010 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T12:45:14.013 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":3745,"stamp":"2024-09-14T12:45:13.194308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44615192,"num_objects":748,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":316434,"num_read_kb":2591763,"num_write":168253,"num_write_kb":2487517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":755835,"num_omap_keys":1814,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13319,"ondisk_log_size":13319,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1826232,"kb_used_data":91448,"kb_used_omap":12,"kb_used_meta":1734643,"kb_avail":753148488,"statfs":{"total":773094113280,"available":771224051712,"internally_reserved":0,"allocated":93642752,"data_stored":77474338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1776274992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009298"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.061524+0000","last_change":"2024-09-14T12:44:49.061396+0000","last_active":"2024-09-14T12:44:49.061524+0000","last_peered":"2024-09-14T12:44:49.061524+0000","last_clean":"2024-09-14T12:44:49.061524+0000","last_became_active":"2024-09-14T11:40:08.951795+0000","last_became_peered":"2024-09-14T11:40:08.951795+0000","last_unstale":"2024-09-14T12:44:49.061524+0000","last_undegraded":"2024-09-14T12:44:49.061524+0000","last_fullsized":"2024-09-14T12:44:49.061524+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.061231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.061231+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.061231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:09.033750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.966798+0000","last_change":"2024-09-14T12:44:46.966635+0000","last_active":"2024-09-14T12:44:46.966798+0000","last_peered":"2024-09-14T12:44:46.966798+0000","last_clean":"2024-09-14T12:44:46.966798+0000","last_became_active":"2024-09-14T11:12:26.251656+0000","last_became_peered":"2024-09-14T11:12:26.251656+0000","last_unstale":"2024-09-14T12:44:46.966798+0000","last_undegraded":"2024-09-14T12:44:46.966798+0000","last_fullsized":"2024-09-14T12:44:46.966798+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.966463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.966463+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.966463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.298507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.391220+0000","last_change":"2024-09-14T12:44:49.390972+0000","last_active":"2024-09-14T12:44:49.391220+0000","last_peered":"2024-09-14T12:44:49.391220+0000","last_clean":"2024-09-14T12:44:49.391220+0000","last_became_active":"2024-09-14T11:12:19.108050+0000","last_became_peered":"2024-09-14T11:12:19.108050+0000","last_unstale":"2024-09-14T12:44:49.391220+0000","last_undegraded":"2024-09-14T12:44:49.391220+0000","last_fullsized":"2024-09-14T12:44:49.391220+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:49.390668+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:49.390668+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.390668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.745726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'28","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.874545+0000","last_change":"2024-09-14T12:44:51.874545+0000","last_active":"2024-09-14T12:44:51.874545+0000","last_peered":"2024-09-14T12:44:51.874545+0000","last_clean":"2024-09-14T12:44:51.874545+0000","last_became_active":"2024-09-14T11:06:29.521269+0000","last_became_peered":"2024-09-14T11:06:29.521269+0000","last_unstale":"2024-09-14T12:44:51.874545+0000","last_undegraded":"2024-09-14T12:44:51.874545+0000","last_fullsized":"2024-09-14T12:44:51.874545+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-14T12:44:51.874372+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-14T12:44:51.874372+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.874372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:59.632984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":165,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.764180+0000","last_change":"2024-09-14T12:44:54.764041+0000","last_active":"2024-09-14T12:44:54.764180+0000","last_peered":"2024-09-14T12:44:54.764180+0000","last_clean":"2024-09-14T12:44:54.764180+0000","last_became_active":"2024-09-14T11:40:08.946878+0000","last_became_peered":"2024-09-14T11:40:08.946878+0000","last_unstale":"2024-09-14T12:44:54.764180+0000","last_undegraded":"2024-09-14T12:44:54.764180+0000","last_fullsized":"2024-09-14T12:44:54.764180+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:54.763847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:54.763847+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.763847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:46.578275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.941022+0000","last_change":"2024-09-14T12:44:50.940877+0000","last_active":"2024-09-14T12:44:50.941022+0000","last_peered":"2024-09-14T12:44:50.941022+0000","last_clean":"2024-09-14T12:44:50.941022+0000","last_became_active":"2024-09-14T11:12:26.251518+0000","last_became_peered":"2024-09-14T11:12:26.251518+0000","last_unstale":"2024-09-14T12:44:50.941022+0000","last_undegraded":"2024-09-14T12:44:50.941022+0000","last_fullsized":"2024-09-14T12:44:50.941022+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T12:44:50.940699+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T12:44:50.940699+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.940699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:49.749243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.844844+0000","last_change":"2024-09-14T12:44:54.844844+0000","last_active":"2024-09-14T12:44:54.844844+0000","last_peered":"2024-09-14T12:44:54.844844+0000","last_clean":"2024-09-14T12:44:54.844844+0000","last_became_active":"2024-09-14T11:12:19.078164+0000","last_became_peered":"2024-09-14T11:12:19.078164+0000","last_unstale":"2024-09-14T12:44:54.844844+0000","last_undegraded":"2024-09-14T12:44:54.844844+0000","last_fullsized":"2024-09-14T12:44:54.844844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:54.844656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:54.844656+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.844656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:37.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'14","reported_seq":124,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.849613+0000","last_change":"2024-09-14T12:44:50.849329+0000","last_active":"2024-09-14T12:44:50.849613+0000","last_peered":"2024-09-14T12:44:50.849613+0000","last_clean":"2024-09-14T12:44:50.849613+0000","last_became_active":"2024-09-14T11:06:29.538616+0000","last_became_peered":"2024-09-14T11:06:29.538616+0000","last_unstale":"2024-09-14T12:44:50.849613+0000","last_undegraded":"2024-09-14T12:44:50.849613+0000","last_fullsized":"2024-09-14T12:44:50.849613+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T12:44:50.849117+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T12:44:50.849117+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.849117+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:39.853529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":63,"num_write":44,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.913175+0000","last_change":"2024-09-14T12:44:49.913175+0000","last_active":"2024-09-14T12:44:49.913175+0000","last_peered":"2024-09-14T12:44:49.913175+0000","last_clean":"2024-09-14T12:44:49.913175+0000","last_became_active":"2024-09-14T11:40:08.942721+0000","last_became_peered":"2024-09-14T11:40:08.942721+0000","last_unstale":"2024-09-14T12:44:49.913175+0000","last_undegraded":"2024-09-14T12:44:49.913175+0000","last_fullsized":"2024-09-14T12:44:49.913175+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.912990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.912990+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.912990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:51.708919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:02.781732+0000","last_change":"2024-09-14T12:45:02.781732+0000","last_active":"2024-09-14T12:45:02.781732+0000","last_peered":"2024-09-14T12:45:02.781732+0000","last_clean":"2024-09-14T12:45:02.781732+0000","last_became_active":"2024-09-14T11:12:26.228172+0000","last_became_peered":"2024-09-14T11:12:26.228172+0000","last_unstale":"2024-09-14T12:45:02.781732+0000","last_undegraded":"2024-09-14T12:45:02.781732+0000","last_fullsized":"2024-09-14T12:45:02.781732+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T12:45:02.781536+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T12:45:02.781536+0000","last_clean_scrub_stamp":"2024-09-14T12:45:02.781536+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:43.286660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"267'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.388216+0000","last_change":"2024-09-14T12:44:50.388216+0000","last_active":"2024-09-14T12:44:50.388216+0000","last_peered":"2024-09-14T12:44:50.388216+0000","last_clean":"2024-09-14T12:44:50.388216+0000","last_became_active":"2024-09-14T11:12:19.110542+0000","last_became_peered":"2024-09-14T11:12:19.110542+0000","last_unstale":"2024-09-14T12:44:50.388216+0000","last_undegraded":"2024-09-14T12:44:50.388216+0000","last_fullsized":"2024-09-14T12:44:50.388216+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:50.388026+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:50.388026+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.388026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:33.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'37","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.787831+0000","last_change":"2024-09-14T12:44:46.787831+0000","last_active":"2024-09-14T12:44:46.787831+0000","last_peered":"2024-09-14T12:44:46.787831+0000","last_clean":"2024-09-14T12:44:46.787831+0000","last_became_active":"2024-09-14T11:06:29.531655+0000","last_became_peered":"2024-09-14T11:06:29.531655+0000","last_unstale":"2024-09-14T12:44:46.787831+0000","last_undegraded":"2024-09-14T12:44:46.787831+0000","last_fullsized":"2024-09-14T12:44:46.787831+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-09-14T12:44:46.787606+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-09-14T12:44:46.787606+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.787606+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:04.426417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":194,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:08.790794+0000","last_change":"2024-09-14T12:45:08.790794+0000","last_active":"2024-09-14T12:45:08.790794+0000","last_peered":"2024-09-14T12:45:08.790794+0000","last_clean":"2024-09-14T12:45:08.790794+0000","last_became_active":"2024-09-14T11:40:08.939509+0000","last_became_peered":"2024-09-14T11:40:08.939509+0000","last_unstale":"2024-09-14T12:45:08.790794+0000","last_undegraded":"2024-09-14T12:45:08.790794+0000","last_fullsized":"2024-09-14T12:45:08.790794+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:08.790606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:08.790606+0000","last_clean_scrub_stamp":"2024-09-14T12:45:08.790606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:06.318708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'7","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:01.830125+0000","last_change":"2024-09-14T12:45:01.830125+0000","last_active":"2024-09-14T12:45:01.830125+0000","last_peered":"2024-09-14T12:45:01.830125+0000","last_clean":"2024-09-14T12:45:01.830125+0000","last_became_active":"2024-09-14T11:12:26.230403+0000","last_became_peered":"2024-09-14T11:12:26.230403+0000","last_unstale":"2024-09-14T12:45:01.830125+0000","last_undegraded":"2024-09-14T12:45:01.830125+0000","last_fullsized":"2024-09-14T12:45:01.830125+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T12:45:01.829939+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T12:45:01.829939+0000","last_clean_scrub_stamp":"2024-09-14T12:45:01.829939+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:22.959986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7282,"num_write":12,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.956468+0000","last_change":"2024-09-14T12:44:45.956468+0000","last_active":"2024-09-14T12:44:45.956468+0000","last_peered":"2024-09-14T12:44:45.956468+0000","last_clean":"2024-09-14T12:44:45.956468+0000","last_became_active":"2024-09-14T11:12:19.105062+0000","last_became_peered":"2024-09-14T11:12:19.105062+0000","last_unstale":"2024-09-14T12:44:45.956468+0000","last_undegraded":"2024-09-14T12:44:45.956468+0000","last_fullsized":"2024-09-14T12:44:45.956468+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:45.956287+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:45.956287+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.956287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:26.856074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'12","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.795373+0000","last_change":"2024-09-14T12:44:45.795373+0000","last_active":"2024-09-14T12:44:45.795373+0000","last_peered":"2024-09-14T12:44:45.795373+0000","last_clean":"2024-09-14T12:44:45.795373+0000","last_became_active":"2024-09-14T11:06:29.509556+0000","last_became_peered":"2024-09-14T11:06:29.509556+0000","last_unstale":"2024-09-14T12:44:45.795373+0000","last_undegraded":"2024-09-14T12:44:45.795373+0000","last_fullsized":"2024-09-14T12:44:45.795373+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T12:44:45.795160+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T12:44:45.795160+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.795160+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:53.237709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:00.332948+0000","last_change":"2024-09-14T12:45:00.332948+0000","last_active":"2024-09-14T12:45:00.332948+0000","last_peered":"2024-09-14T12:45:00.332948+0000","last_clean":"2024-09-14T12:45:00.332948+0000","last_became_active":"2024-09-14T11:40:08.927702+0000","last_became_peered":"2024-09-14T11:40:08.927702+0000","last_unstale":"2024-09-14T12:45:00.332948+0000","last_undegraded":"2024-09-14T12:45:00.332948+0000","last_fullsized":"2024-09-14T12:45:00.332948+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:00.332762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:00.332762+0000","last_clean_scrub_stamp":"2024-09-14T12:45:00.332762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:46.028111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.116492+0000","last_change":"2024-09-14T12:44:43.116492+0000","last_active":"2024-09-14T12:44:43.116492+0000","last_peered":"2024-09-14T12:44:43.116492+0000","last_clean":"2024-09-14T12:44:43.116492+0000","last_became_active":"2024-09-14T11:12:26.218925+0000","last_became_peered":"2024-09-14T11:12:26.218925+0000","last_unstale":"2024-09-14T12:44:43.116492+0000","last_undegraded":"2024-09-14T12:44:43.116492+0000","last_fullsized":"2024-09-14T12:44:43.116492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.116288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.116288+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.116288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:25.426487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"267'4","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.848653+0000","last_change":"2024-09-14T12:44:53.848653+0000","last_active":"2024-09-14T12:44:53.848653+0000","last_peered":"2024-09-14T12:44:53.848653+0000","last_clean":"2024-09-14T12:44:53.848653+0000","last_became_active":"2024-09-14T11:12:19.110528+0000","last_became_peered":"2024-09-14T11:12:19.110528+0000","last_unstale":"2024-09-14T12:44:53.848653+0000","last_undegraded":"2024-09-14T12:44:53.848653+0000","last_fullsized":"2024-09-14T12:44:53.848653+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:53.848423+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:53.848423+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.848423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:03.288236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'15","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.794541+0000","last_change":"2024-09-14T12:44:44.794541+0000","last_active":"2024-09-14T12:44:44.794541+0000","last_peered":"2024-09-14T12:44:44.794541+0000","last_clean":"2024-09-14T12:44:44.794541+0000","last_became_active":"2024-09-14T11:06:29.538597+0000","last_became_peered":"2024-09-14T11:06:29.538597+0000","last_unstale":"2024-09-14T12:44:44.794541+0000","last_undegraded":"2024-09-14T12:44:44.794541+0000","last_fullsized":"2024-09-14T12:44:44.794541+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T12:44:44.794358+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T12:44:44.794358+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.794358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:00.653289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:56.801299+0000","last_change":"2024-09-14T12:44:56.801299+0000","last_active":"2024-09-14T12:44:56.801299+0000","last_peered":"2024-09-14T12:44:56.801299+0000","last_clean":"2024-09-14T12:44:56.801299+0000","last_became_active":"2024-09-14T11:40:08.924934+0000","last_became_peered":"2024-09-14T11:40:08.924934+0000","last_unstale":"2024-09-14T12:44:56.801299+0000","last_undegraded":"2024-09-14T12:44:56.801299+0000","last_fullsized":"2024-09-14T12:44:56.801299+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:56.801027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:56.801027+0000","last_clean_scrub_stamp":"2024-09-14T12:44:56.801027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:15.742318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":57,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:41:51.502951+0000","last_change":"2024-09-14T11:12:26.246400+0000","last_active":"2024-09-14T12:41:51.502951+0000","last_peered":"2024-09-14T12:41:51.502951+0000","last_clean":"2024-09-14T12:41:51.502951+0000","last_became_active":"2024-09-14T11:12:26.245890+0000","last_became_peered":"2024-09-14T11:12:26.245890+0000","last_unstale":"2024-09-14T12:41:51.502951+0000","last_undegraded":"2024-09-14T12:41:51.502951+0000","last_fullsized":"2024-09-14T12:41:51.502951+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:09.514557+0000","last_change":"2024-09-14T12:45:09.514557+0000","last_active":"2024-09-14T12:45:09.514557+0000","last_peered":"2024-09-14T12:45:09.514557+0000","last_clean":"2024-09-14T12:45:09.514557+0000","last_became_active":"2024-09-14T11:12:19.108158+0000","last_became_peered":"2024-09-14T11:12:19.108158+0000","last_unstale":"2024-09-14T12:45:09.514557+0000","last_undegraded":"2024-09-14T12:45:09.514557+0000","last_fullsized":"2024-09-14T12:45:09.514557+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:09.514370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:09.514370+0000","last_clean_scrub_stamp":"2024-09-14T12:45:09.514370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:58.570919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'13","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.955336+0000","last_change":"2024-09-14T12:44:39.955336+0000","last_active":"2024-09-14T12:44:39.955336+0000","last_peered":"2024-09-14T12:44:39.955336+0000","last_clean":"2024-09-14T12:44:39.955336+0000","last_became_active":"2024-09-14T11:06:29.525271+0000","last_became_peered":"2024-09-14T11:06:29.525271+0000","last_unstale":"2024-09-14T12:44:39.955336+0000","last_undegraded":"2024-09-14T12:44:39.955336+0000","last_fullsized":"2024-09-14T12:44:39.955336+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T12:44:39.955145+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T12:44:39.955145+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.955145+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:17.903750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.976218+0000","last_change":"2024-09-14T12:44:52.976074+0000","last_active":"2024-09-14T12:44:52.976218+0000","last_peered":"2024-09-14T12:44:52.976218+0000","last_clean":"2024-09-14T12:44:52.976218+0000","last_became_active":"2024-09-14T11:40:08.928406+0000","last_became_peered":"2024-09-14T11:40:08.928406+0000","last_unstale":"2024-09-14T12:44:52.976218+0000","last_undegraded":"2024-09-14T12:44:52.976218+0000","last_fullsized":"2024-09-14T12:44:52.976218+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:52.975896+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:52.975896+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.975896+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:29.495158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.891090+0000","last_change":"2024-09-14T12:44:49.890960+0000","last_active":"2024-09-14T12:44:49.891090+0000","last_peered":"2024-09-14T12:44:49.891090+0000","last_clean":"2024-09-14T12:44:49.891090+0000","last_became_active":"2024-09-14T11:12:26.241189+0000","last_became_peered":"2024-09-14T11:12:26.241189+0000","last_unstale":"2024-09-14T12:44:49.891090+0000","last_undegraded":"2024-09-14T12:44:49.891090+0000","last_fullsized":"2024-09-14T12:44:49.891090+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.890785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.890785+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.890785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:48.122625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.098700+0000","last_change":"2024-09-14T12:44:39.098574+0000","last_active":"2024-09-14T12:44:39.098700+0000","last_peered":"2024-09-14T12:44:39.098700+0000","last_clean":"2024-09-14T12:44:39.098700+0000","last_became_active":"2024-09-14T11:12:19.090134+0000","last_became_peered":"2024-09-14T11:12:19.090134+0000","last_unstale":"2024-09-14T12:44:39.098700+0000","last_undegraded":"2024-09-14T12:44:39.098700+0000","last_fullsized":"2024-09-14T12:44:39.098700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:39.098388+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:39.098388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.098388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:33.763161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4097,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'175","reported_seq":586,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.327884+0000","last_change":"2024-09-14T12:44:43.327884+0000","last_active":"2024-09-14T12:44:43.327884+0000","last_peered":"2024-09-14T12:44:43.327884+0000","last_clean":"2024-09-14T12:44:43.327884+0000","last_became_active":"2024-09-14T11:06:29.531149+0000","last_became_peered":"2024-09-14T11:06:29.531149+0000","last_unstale":"2024-09-14T12:44:43.327884+0000","last_undegraded":"2024-09-14T12:44:43.327884+0000","last_fullsized":"2024-09-14T12:44:43.327884+0000","mapping_epoch":256,"log_start":"264'100","ondisk_log_start":"264'100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-14T12:44:43.327621+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-14T12:44:43.327621+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.327621+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:13.301203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1578,"num_read_kb":1327,"num_write":388,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.066954+0000","last_change":"2024-09-14T12:44:48.066809+0000","last_active":"2024-09-14T12:44:48.066954+0000","last_peered":"2024-09-14T12:44:48.066954+0000","last_clean":"2024-09-14T12:44:48.066954+0000","last_became_active":"2024-09-14T11:40:08.942208+0000","last_became_peered":"2024-09-14T11:40:08.942208+0000","last_unstale":"2024-09-14T12:44:48.066954+0000","last_undegraded":"2024-09-14T12:44:48.066954+0000","last_fullsized":"2024-09-14T12:44:48.066954+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:48.066632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:48.066632+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.066632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:17.322690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:57.353584+0000","last_change":"2024-09-14T12:44:57.353438+0000","last_active":"2024-09-14T12:44:57.353584+0000","last_peered":"2024-09-14T12:44:57.353584+0000","last_clean":"2024-09-14T12:44:57.353584+0000","last_became_active":"2024-09-14T11:12:26.236221+0000","last_became_peered":"2024-09-14T11:12:26.236221+0000","last_unstale":"2024-09-14T12:44:57.353584+0000","last_undegraded":"2024-09-14T12:44:57.353584+0000","last_fullsized":"2024-09-14T12:44:57.353584+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:57.353255+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:57.353255+0000","last_clean_scrub_stamp":"2024-09-14T12:44:57.353255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:17.595068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.806332+0000","last_change":"2024-09-14T12:44:49.806204+0000","last_active":"2024-09-14T12:44:49.806332+0000","last_peered":"2024-09-14T12:44:49.806332+0000","last_clean":"2024-09-14T12:44:49.806332+0000","last_became_active":"2024-09-14T11:12:19.086765+0000","last_became_peered":"2024-09-14T11:12:19.086765+0000","last_unstale":"2024-09-14T12:44:49.806332+0000","last_undegraded":"2024-09-14T12:44:49.806332+0000","last_fullsized":"2024-09-14T12:44:49.806332+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.806019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.806019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.806019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:34.322738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'21","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.794605+0000","last_change":"2024-09-14T12:44:43.794605+0000","last_active":"2024-09-14T12:44:43.794605+0000","last_peered":"2024-09-14T12:44:43.794605+0000","last_clean":"2024-09-14T12:44:43.794605+0000","last_became_active":"2024-09-14T11:06:29.518028+0000","last_became_peered":"2024-09-14T11:06:29.518028+0000","last_unstale":"2024-09-14T12:44:43.794605+0000","last_undegraded":"2024-09-14T12:44:43.794605+0000","last_fullsized":"2024-09-14T12:44:43.794605+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-14T12:44:43.794424+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-14T12:44:43.794424+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.794424+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.700307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":96,"num_write":55,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:07.749175+0000","last_change":"2024-09-14T12:45:07.749175+0000","last_active":"2024-09-14T12:45:07.749175+0000","last_peered":"2024-09-14T12:45:07.749175+0000","last_clean":"2024-09-14T12:45:07.749175+0000","last_became_active":"2024-09-14T11:40:08.953030+0000","last_became_peered":"2024-09-14T11:40:08.953030+0000","last_unstale":"2024-09-14T12:45:07.749175+0000","last_undegraded":"2024-09-14T12:45:07.749175+0000","last_fullsized":"2024-09-14T12:45:07.749175+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:07.748994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:07.748994+0000","last_clean_scrub_stamp":"2024-09-14T12:45:07.748994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:17.170418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.316913+0000","last_change":"2024-09-14T12:44:54.316913+0000","last_active":"2024-09-14T12:44:54.316913+0000","last_peered":"2024-09-14T12:44:54.316913+0000","last_clean":"2024-09-14T12:44:54.316913+0000","last_became_active":"2024-09-14T11:12:26.247784+0000","last_became_peered":"2024-09-14T11:12:26.247784+0000","last_unstale":"2024-09-14T12:44:54.316913+0000","last_undegraded":"2024-09-14T12:44:54.316913+0000","last_fullsized":"2024-09-14T12:44:54.316913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:54.316723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:54.316723+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.316723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:02.466057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:10.475319+0000","last_change":"2024-09-14T12:45:10.475319+0000","last_active":"2024-09-14T12:45:10.475319+0000","last_peered":"2024-09-14T12:45:10.475319+0000","last_clean":"2024-09-14T12:45:10.475319+0000","last_became_active":"2024-09-14T11:12:19.113431+0000","last_became_peered":"2024-09-14T11:12:19.113431+0000","last_unstale":"2024-09-14T12:45:10.475319+0000","last_undegraded":"2024-09-14T12:45:10.475319+0000","last_fullsized":"2024-09-14T12:45:10.475319+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:45:10.475028+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:45:10.475028+0000","last_clean_scrub_stamp":"2024-09-14T12:45:10.475028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:02.218511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7166,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'46","reported_seq":205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.782030+0000","last_change":"2024-09-14T12:44:48.782030+0000","last_active":"2024-09-14T12:44:48.782030+0000","last_peered":"2024-09-14T12:44:48.782030+0000","last_clean":"2024-09-14T12:44:48.782030+0000","last_became_active":"2024-09-14T11:06:29.532061+0000","last_became_peered":"2024-09-14T11:06:29.532061+0000","last_unstale":"2024-09-14T12:44:48.782030+0000","last_undegraded":"2024-09-14T12:44:48.782030+0000","last_fullsized":"2024-09-14T12:44:48.782030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'46","last_scrub_stamp":"2024-09-14T12:44:48.781878+0000","last_deep_scrub":"267'46","last_deep_scrub_stamp":"2024-09-14T12:44:48.781878+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.781878+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:12.193204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":235,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.740379+0000","last_change":"2024-09-14T12:44:51.740379+0000","last_active":"2024-09-14T12:44:51.740379+0000","last_peered":"2024-09-14T12:44:51.740379+0000","last_clean":"2024-09-14T12:44:51.740379+0000","last_became_active":"2024-09-14T11:40:08.937813+0000","last_became_peered":"2024-09-14T11:40:08.937813+0000","last_unstale":"2024-09-14T12:44:51.740379+0000","last_undegraded":"2024-09-14T12:44:51.740379+0000","last_fullsized":"2024-09-14T12:44:51.740379+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:51.740195+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:51.740195+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.740195+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:04.832887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:00.855468+0000","last_change":"2024-09-14T12:45:00.855468+0000","last_active":"2024-09-14T12:45:00.855468+0000","last_peered":"2024-09-14T12:45:00.855468+0000","last_clean":"2024-09-14T12:45:00.855468+0000","last_became_active":"2024-09-14T11:12:26.243612+0000","last_became_peered":"2024-09-14T11:12:26.243612+0000","last_unstale":"2024-09-14T12:45:00.855468+0000","last_undegraded":"2024-09-14T12:45:00.855468+0000","last_fullsized":"2024-09-14T12:45:00.855468+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T12:45:00.855172+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T12:45:00.855172+0000","last_clean_scrub_stamp":"2024-09-14T12:45:00.855172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:39.911133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15364,"num_write":22,"num_write_kb":14340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.149402+0000","last_change":"2024-09-14T12:44:37.149402+0000","last_active":"2024-09-14T12:44:37.149402+0000","last_peered":"2024-09-14T12:44:37.149402+0000","last_clean":"2024-09-14T12:44:37.149402+0000","last_became_active":"2024-09-14T11:12:19.103871+0000","last_became_peered":"2024-09-14T11:12:19.103871+0000","last_unstale":"2024-09-14T12:44:37.149402+0000","last_undegraded":"2024-09-14T12:44:37.149402+0000","last_fullsized":"2024-09-14T12:44:37.149402+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:37.149216+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:37.149216+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.149216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:20.246009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'29","reported_seq":152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.800677+0000","last_change":"2024-09-14T12:44:49.800677+0000","last_active":"2024-09-14T12:44:49.800677+0000","last_peered":"2024-09-14T12:44:49.800677+0000","last_clean":"2024-09-14T12:44:49.800677+0000","last_became_active":"2024-09-14T11:06:29.529421+0000","last_became_peered":"2024-09-14T11:06:29.529421+0000","last_unstale":"2024-09-14T12:44:49.800677+0000","last_undegraded":"2024-09-14T12:44:49.800677+0000","last_fullsized":"2024-09-14T12:44:49.800677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T12:44:49.800471+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T12:44:49.800471+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.800471+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:47.936186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":129,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.927171+0000","last_change":"2024-09-14T12:44:53.927171+0000","last_active":"2024-09-14T12:44:53.927171+0000","last_peered":"2024-09-14T12:44:53.927171+0000","last_clean":"2024-09-14T12:44:53.927171+0000","last_became_active":"2024-09-14T11:40:08.944066+0000","last_became_peered":"2024-09-14T11:40:08.944066+0000","last_unstale":"2024-09-14T12:44:53.927171+0000","last_undegraded":"2024-09-14T12:44:53.927171+0000","last_fullsized":"2024-09-14T12:44:53.927171+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:53.926986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:53.926986+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.926986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:30.102511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:55.353977+0000","last_change":"2024-09-14T12:44:55.353977+0000","last_active":"2024-09-14T12:44:55.353977+0000","last_peered":"2024-09-14T12:44:55.353977+0000","last_clean":"2024-09-14T12:44:55.353977+0000","last_became_active":"2024-09-14T11:12:26.224877+0000","last_became_peered":"2024-09-14T11:12:26.224877+0000","last_unstale":"2024-09-14T12:44:55.353977+0000","last_undegraded":"2024-09-14T12:44:55.353977+0000","last_fullsized":"2024-09-14T12:44:55.353977+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:55.353791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:55.353791+0000","last_clean_scrub_stamp":"2024-09-14T12:44:55.353791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:57.967814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'11","reported_seq":92,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.360372+0000","last_change":"2024-09-14T12:44:47.360372+0000","last_active":"2024-09-14T12:44:47.360372+0000","last_peered":"2024-09-14T12:44:47.360372+0000","last_clean":"2024-09-14T12:44:47.360372+0000","last_became_active":"2024-09-14T11:12:19.107563+0000","last_became_peered":"2024-09-14T11:12:19.107563+0000","last_unstale":"2024-09-14T12:44:47.360372+0000","last_undegraded":"2024-09-14T12:44:47.360372+0000","last_fullsized":"2024-09-14T12:44:47.360372+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T12:44:47.360187+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T12:44:47.360187+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.360187+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.915198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9259,"num_write":16,"num_write_kb":6185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.366789+0000","last_change":"2024-09-14T12:44:42.366789+0000","last_active":"2024-09-14T12:44:42.366789+0000","last_peered":"2024-09-14T12:44:42.366789+0000","last_clean":"2024-09-14T12:44:42.366789+0000","last_became_active":"2024-09-14T11:06:29.534316+0000","last_became_peered":"2024-09-14T11:06:29.534316+0000","last_unstale":"2024-09-14T12:44:42.366789+0000","last_undegraded":"2024-09-14T12:44:42.366789+0000","last_fullsized":"2024-09-14T12:44:42.366789+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T12:44:42.366563+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T12:44:42.366563+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.366563+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:29.776445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":71,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.053744+0000","last_change":"2024-09-14T12:44:47.053744+0000","last_active":"2024-09-14T12:44:47.053744+0000","last_peered":"2024-09-14T12:44:47.053744+0000","last_clean":"2024-09-14T12:44:47.053744+0000","last_became_active":"2024-09-14T11:40:08.945227+0000","last_became_peered":"2024-09-14T11:40:08.945227+0000","last_unstale":"2024-09-14T12:44:47.053744+0000","last_undegraded":"2024-09-14T12:44:47.053744+0000","last_fullsized":"2024-09-14T12:44:47.053744+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.053527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.053527+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.053527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:03.906857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.137784+0000","last_change":"2024-09-14T12:44:42.137784+0000","last_active":"2024-09-14T12:44:42.137784+0000","last_peered":"2024-09-14T12:44:42.137784+0000","last_clean":"2024-09-14T12:44:42.137784+0000","last_became_active":"2024-09-14T11:12:26.238844+0000","last_became_peered":"2024-09-14T11:12:26.238844+0000","last_unstale":"2024-09-14T12:44:42.137784+0000","last_undegraded":"2024-09-14T12:44:42.137784+0000","last_fullsized":"2024-09-14T12:44:42.137784+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:42.137575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:42.137575+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.137575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:12.523037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"267'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.875507+0000","last_change":"2024-09-14T12:44:52.875507+0000","last_active":"2024-09-14T12:44:52.875507+0000","last_peered":"2024-09-14T12:44:52.875507+0000","last_clean":"2024-09-14T12:44:52.875507+0000","last_became_active":"2024-09-14T11:12:19.072275+0000","last_became_peered":"2024-09-14T11:12:19.072275+0000","last_unstale":"2024-09-14T12:44:52.875507+0000","last_undegraded":"2024-09-14T12:44:52.875507+0000","last_fullsized":"2024-09-14T12:44:52.875507+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:52.875288+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:52.875288+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.875288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:57.593125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'30","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:03.557440+0000","last_change":"2024-09-14T12:45:03.557440+0000","last_active":"2024-09-14T12:45:03.557440+0000","last_peered":"2024-09-14T12:45:03.557440+0000","last_clean":"2024-09-14T12:45:03.557440+0000","last_became_active":"2024-09-14T11:06:29.518650+0000","last_became_peered":"2024-09-14T11:06:29.518650+0000","last_unstale":"2024-09-14T12:45:03.557440+0000","last_undegraded":"2024-09-14T12:45:03.557440+0000","last_fullsized":"2024-09-14T12:45:03.557440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'30","last_scrub_stamp":"2024-09-14T12:45:03.557253+0000","last_deep_scrub":"267'30","last_deep_scrub_stamp":"2024-09-14T12:45:03.557253+0000","last_clean_scrub_stamp":"2024-09-14T12:45:03.557253+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:19.371183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":172,"num_write":81,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:09.838751+0000","last_change":"2024-09-14T12:45:09.838751+0000","last_active":"2024-09-14T12:45:09.838751+0000","last_peered":"2024-09-14T12:45:09.838751+0000","last_clean":"2024-09-14T12:45:09.838751+0000","last_became_active":"2024-09-14T11:40:08.950670+0000","last_became_peered":"2024-09-14T11:40:08.950670+0000","last_unstale":"2024-09-14T12:45:09.838751+0000","last_undegraded":"2024-09-14T12:45:09.838751+0000","last_fullsized":"2024-09-14T12:45:09.838751+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:09.838566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:09.838566+0000","last_clean_scrub_stamp":"2024-09-14T12:45:09.838566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:57.211997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:59.824053+0000","last_change":"2024-09-14T12:44:59.824053+0000","last_active":"2024-09-14T12:44:59.824053+0000","last_peered":"2024-09-14T12:44:59.824053+0000","last_clean":"2024-09-14T12:44:59.824053+0000","last_became_active":"2024-09-14T11:12:26.227851+0000","last_became_peered":"2024-09-14T11:12:26.227851+0000","last_unstale":"2024-09-14T12:44:59.824053+0000","last_undegraded":"2024-09-14T12:44:59.824053+0000","last_fullsized":"2024-09-14T12:44:59.824053+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:44:59.823873+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:44:59.823873+0000","last_clean_scrub_stamp":"2024-09-14T12:44:59.823873+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:51.149556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.969195+0000","last_change":"2024-09-14T12:44:44.969195+0000","last_active":"2024-09-14T12:44:44.969195+0000","last_peered":"2024-09-14T12:44:44.969195+0000","last_clean":"2024-09-14T12:44:44.969195+0000","last_became_active":"2024-09-14T11:12:19.091893+0000","last_became_peered":"2024-09-14T11:12:19.091893+0000","last_unstale":"2024-09-14T12:44:44.969195+0000","last_undegraded":"2024-09-14T12:44:44.969195+0000","last_fullsized":"2024-09-14T12:44:44.969195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T12:44:44.969008+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T12:44:44.969008+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.969008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:21.602815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'35","reported_seq":172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:02.530908+0000","last_change":"2024-09-14T12:45:02.530908+0000","last_active":"2024-09-14T12:45:02.530908+0000","last_peered":"2024-09-14T12:45:02.530908+0000","last_clean":"2024-09-14T12:45:02.530908+0000","last_became_active":"2024-09-14T11:06:29.545575+0000","last_became_peered":"2024-09-14T11:06:29.545575+0000","last_unstale":"2024-09-14T12:45:02.530908+0000","last_undegraded":"2024-09-14T12:45:02.530908+0000","last_fullsized":"2024-09-14T12:45:02.530908+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'35","last_scrub_stamp":"2024-09-14T12:45:02.530709+0000","last_deep_scrub":"267'35","last_deep_scrub_stamp":"2024-09-14T12:45:02.530709+0000","last_clean_scrub_stamp":"2024-09-14T12:45:02.530709+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:12.110862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":183,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.750889+0000","last_change":"2024-09-14T12:44:53.750889+0000","last_active":"2024-09-14T12:44:53.750889+0000","last_peered":"2024-09-14T12:44:53.750889+0000","last_clean":"2024-09-14T12:44:53.750889+0000","last_became_active":"2024-09-14T11:40:08.925358+0000","last_became_peered":"2024-09-14T11:40:08.925358+0000","last_unstale":"2024-09-14T12:44:53.750889+0000","last_undegraded":"2024-09-14T12:44:53.750889+0000","last_fullsized":"2024-09-14T12:44:53.750889+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:53.750710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:53.750710+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.750710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:21.298940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:56.830136+0000","last_change":"2024-09-14T12:44:56.830136+0000","last_active":"2024-09-14T12:44:56.830136+0000","last_peered":"2024-09-14T12:44:56.830136+0000","last_clean":"2024-09-14T12:44:56.830136+0000","last_became_active":"2024-09-14T11:12:26.246881+0000","last_became_peered":"2024-09-14T11:12:26.246881+0000","last_unstale":"2024-09-14T12:44:56.830136+0000","last_undegraded":"2024-09-14T12:44:56.830136+0000","last_fullsized":"2024-09-14T12:44:56.830136+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:56.829949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:56.829949+0000","last_clean_scrub_stamp":"2024-09-14T12:44:56.829949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:54.512197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.839900+0000","last_change":"2024-09-14T12:44:51.839900+0000","last_active":"2024-09-14T12:44:51.839900+0000","last_peered":"2024-09-14T12:44:51.839900+0000","last_clean":"2024-09-14T12:44:51.839900+0000","last_became_active":"2024-09-14T11:12:19.095821+0000","last_became_peered":"2024-09-14T11:12:19.095821+0000","last_unstale":"2024-09-14T12:44:51.839900+0000","last_undegraded":"2024-09-14T12:44:51.839900+0000","last_fullsized":"2024-09-14T12:44:51.839900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:51.839710+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:51.839710+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.839710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:10.652391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'26","reported_seq":150,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.377484+0000","last_change":"2024-09-14T12:44:41.377484+0000","last_active":"2024-09-14T12:44:41.377484+0000","last_peered":"2024-09-14T12:44:41.377484+0000","last_clean":"2024-09-14T12:44:41.377484+0000","last_became_active":"2024-09-14T11:06:29.529753+0000","last_became_peered":"2024-09-14T11:06:29.529753+0000","last_unstale":"2024-09-14T12:44:41.377484+0000","last_undegraded":"2024-09-14T12:44:41.377484+0000","last_fullsized":"2024-09-14T12:44:41.377484+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-14T12:44:41.377309+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-14T12:44:41.377309+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.377309+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.262253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:55.790690+0000","last_change":"2024-09-14T12:44:55.790690+0000","last_active":"2024-09-14T12:44:55.790690+0000","last_peered":"2024-09-14T12:44:55.790690+0000","last_clean":"2024-09-14T12:44:55.790690+0000","last_became_active":"2024-09-14T11:40:08.924726+0000","last_became_peered":"2024-09-14T11:40:08.924726+0000","last_unstale":"2024-09-14T12:44:55.790690+0000","last_undegraded":"2024-09-14T12:44:55.790690+0000","last_fullsized":"2024-09-14T12:44:55.790690+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:55.790495+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:55.790495+0000","last_clean_scrub_stamp":"2024-09-14T12:44:55.790495+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:22.693361+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:56.320252+0000","last_change":"2024-09-14T12:44:56.320252+0000","last_active":"2024-09-14T12:44:56.320252+0000","last_peered":"2024-09-14T12:44:56.320252+0000","last_clean":"2024-09-14T12:44:56.320252+0000","last_became_active":"2024-09-14T11:12:26.219169+0000","last_became_peered":"2024-09-14T11:12:26.219169+0000","last_unstale":"2024-09-14T12:44:56.320252+0000","last_undegraded":"2024-09-14T12:44:56.320252+0000","last_fullsized":"2024-09-14T12:44:56.320252+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T12:44:56.320061+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T12:44:56.320061+0000","last_clean_scrub_stamp":"2024-09-14T12:44:56.320061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:13.543957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"267'10","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.981302+0000","last_change":"2024-09-14T12:44:42.981302+0000","last_active":"2024-09-14T12:44:42.981302+0000","last_peered":"2024-09-14T12:44:42.981302+0000","last_clean":"2024-09-14T12:44:42.981302+0000","last_became_active":"2024-09-14T11:12:19.099233+0000","last_became_peered":"2024-09-14T11:12:19.099233+0000","last_unstale":"2024-09-14T12:44:42.981302+0000","last_undegraded":"2024-09-14T12:44:42.981302+0000","last_fullsized":"2024-09-14T12:44:42.981302+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-14T12:44:42.981106+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-14T12:44:42.981106+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.981106+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:17.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8230,"num_write":10,"num_write_kb":6172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'35","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.935737+0000","last_change":"2024-09-14T12:44:42.935737+0000","last_active":"2024-09-14T12:44:42.935737+0000","last_peered":"2024-09-14T12:44:42.935737+0000","last_clean":"2024-09-14T12:44:42.935737+0000","last_became_active":"2024-09-14T11:06:29.508842+0000","last_became_peered":"2024-09-14T11:06:29.508842+0000","last_unstale":"2024-09-14T12:44:42.935737+0000","last_undegraded":"2024-09-14T12:44:42.935737+0000","last_fullsized":"2024-09-14T12:44:42.935737+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'35","last_scrub_stamp":"2024-09-14T12:44:42.935551+0000","last_deep_scrub":"267'35","last_deep_scrub_stamp":"2024-09-14T12:44:42.935551+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.935551+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:26:40.214950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":189,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.725935+0000","last_change":"2024-09-14T12:44:52.725935+0000","last_active":"2024-09-14T12:44:52.725935+0000","last_peered":"2024-09-14T12:44:52.725935+0000","last_clean":"2024-09-14T12:44:52.725935+0000","last_became_active":"2024-09-14T11:40:08.944382+0000","last_became_peered":"2024-09-14T11:40:08.944382+0000","last_unstale":"2024-09-14T12:44:52.725935+0000","last_undegraded":"2024-09-14T12:44:52.725935+0000","last_fullsized":"2024-09-14T12:44:52.725935+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:52.725690+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:52.725690+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.725690+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:36.556030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"267'6","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:26.525182+0000","last_change":"2024-09-14T11:12:26.238084+0000","last_active":"2024-09-14T12:43:26.525182+0000","last_peered":"2024-09-14T12:43:26.525182+0000","last_clean":"2024-09-14T12:43:26.525182+0000","last_became_active":"2024-09-14T11:12:26.232336+0000","last_became_peered":"2024-09-14T11:12:26.232336+0000","last_unstale":"2024-09-14T12:43:26.525182+0000","last_undegraded":"2024-09-14T12:43:26.525182+0000","last_fullsized":"2024-09-14T12:43:26.525182+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:24.342020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.977146+0000","last_change":"2024-09-14T12:44:43.977146+0000","last_active":"2024-09-14T12:44:43.977146+0000","last_peered":"2024-09-14T12:44:43.977146+0000","last_clean":"2024-09-14T12:44:43.977146+0000","last_became_active":"2024-09-14T11:12:19.092223+0000","last_became_peered":"2024-09-14T11:12:19.092223+0000","last_unstale":"2024-09-14T12:44:43.977146+0000","last_undegraded":"2024-09-14T12:44:43.977146+0000","last_fullsized":"2024-09-14T12:44:43.977146+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:43.976958+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:43.976958+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.976958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:16.792611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'19","reported_seq":126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.373910+0000","last_change":"2024-09-14T12:44:40.373910+0000","last_active":"2024-09-14T12:44:40.373910+0000","last_peered":"2024-09-14T12:44:40.373910+0000","last_clean":"2024-09-14T12:44:40.373910+0000","last_became_active":"2024-09-14T11:06:29.530722+0000","last_became_peered":"2024-09-14T11:06:29.530722+0000","last_unstale":"2024-09-14T12:44:40.373910+0000","last_undegraded":"2024-09-14T12:44:40.373910+0000","last_fullsized":"2024-09-14T12:44:40.373910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'19","last_scrub_stamp":"2024-09-14T12:44:40.373679+0000","last_deep_scrub":"267'19","last_deep_scrub_stamp":"2024-09-14T12:44:40.373679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.373679+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:10.466093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":48,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:05.787844+0000","last_change":"2024-09-14T12:45:05.787844+0000","last_active":"2024-09-14T12:45:05.787844+0000","last_peered":"2024-09-14T12:45:05.787844+0000","last_clean":"2024-09-14T12:45:05.787844+0000","last_became_active":"2024-09-14T11:40:08.947725+0000","last_became_peered":"2024-09-14T11:40:08.947725+0000","last_unstale":"2024-09-14T12:45:05.787844+0000","last_undegraded":"2024-09-14T12:45:05.787844+0000","last_fullsized":"2024-09-14T12:45:05.787844+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:05.787658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:05.787658+0000","last_clean_scrub_stamp":"2024-09-14T12:45:05.787658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:18.884007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.348167+0000","last_change":"2024-09-14T12:44:51.348167+0000","last_active":"2024-09-14T12:44:51.348167+0000","last_peered":"2024-09-14T12:44:51.348167+0000","last_clean":"2024-09-14T12:44:51.348167+0000","last_became_active":"2024-09-14T11:12:26.233006+0000","last_became_peered":"2024-09-14T11:12:26.233006+0000","last_unstale":"2024-09-14T12:44:51.348167+0000","last_undegraded":"2024-09-14T12:44:51.348167+0000","last_fullsized":"2024-09-14T12:44:51.348167+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:51.347985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:51.347985+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.347985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:16.392254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"267'2","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.963949+0000","last_change":"2024-09-14T12:44:43.963949+0000","last_active":"2024-09-14T12:44:43.963949+0000","last_peered":"2024-09-14T12:44:43.963949+0000","last_clean":"2024-09-14T12:44:43.963949+0000","last_became_active":"2024-09-14T11:12:19.085380+0000","last_became_peered":"2024-09-14T11:12:19.085380+0000","last_unstale":"2024-09-14T12:44:43.963949+0000","last_undegraded":"2024-09-14T12:44:43.963949+0000","last_fullsized":"2024-09-14T12:44:43.963949+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:43.963747+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:43.963747+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.963747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:43.558499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'32","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.400381+0000","last_change":"2024-09-14T12:44:39.400381+0000","last_active":"2024-09-14T12:44:39.400381+0000","last_peered":"2024-09-14T12:44:39.400381+0000","last_clean":"2024-09-14T12:44:39.400381+0000","last_became_active":"2024-09-14T11:06:29.534458+0000","last_became_peered":"2024-09-14T11:06:29.534458+0000","last_unstale":"2024-09-14T12:44:39.400381+0000","last_undegraded":"2024-09-14T12:44:39.400381+0000","last_fullsized":"2024-09-14T12:44:39.400381+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'32","last_scrub_stamp":"2024-09-14T12:44:39.400200+0000","last_deep_scrub":"267'32","last_deep_scrub_stamp":"2024-09-14T12:44:39.400200+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.400200+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:02.119729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":170,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.946973+0000","last_change":"2024-09-14T12:44:47.946973+0000","last_active":"2024-09-14T12:44:47.946973+0000","last_peered":"2024-09-14T12:44:47.946973+0000","last_clean":"2024-09-14T12:44:47.946973+0000","last_became_active":"2024-09-14T11:40:08.949834+0000","last_became_peered":"2024-09-14T11:40:08.949834+0000","last_unstale":"2024-09-14T12:44:47.946973+0000","last_undegraded":"2024-09-14T12:44:47.946973+0000","last_fullsized":"2024-09-14T12:44:47.946973+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.946794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.946794+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.946794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:04.666311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.313066+0000","last_change":"2024-09-14T12:44:52.313066+0000","last_active":"2024-09-14T12:44:52.313066+0000","last_peered":"2024-09-14T12:44:52.313066+0000","last_clean":"2024-09-14T12:44:52.313066+0000","last_became_active":"2024-09-14T11:12:26.247614+0000","last_became_peered":"2024-09-14T11:12:26.247614+0000","last_unstale":"2024-09-14T12:44:52.313066+0000","last_undegraded":"2024-09-14T12:44:52.313066+0000","last_fullsized":"2024-09-14T12:44:52.313066+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:52.312884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:52.312884+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.312884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:22.498905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'14","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.774373+0000","last_change":"2024-09-14T12:44:48.774373+0000","last_active":"2024-09-14T12:44:48.774373+0000","last_peered":"2024-09-14T12:44:48.774373+0000","last_clean":"2024-09-14T12:44:48.774373+0000","last_became_active":"2024-09-14T11:12:19.096087+0000","last_became_peered":"2024-09-14T11:12:19.096087+0000","last_unstale":"2024-09-14T12:44:48.774373+0000","last_undegraded":"2024-09-14T12:44:48.774373+0000","last_fullsized":"2024-09-14T12:44:48.774373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T12:44:48.774134+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T12:44:48.774134+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.774134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:21.183878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":21525,"num_write":24,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'15","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:00.575182+0000","last_change":"2024-09-14T12:45:00.575182+0000","last_active":"2024-09-14T12:45:00.575182+0000","last_peered":"2024-09-14T12:45:00.575182+0000","last_clean":"2024-09-14T12:45:00.575182+0000","last_became_active":"2024-09-14T11:06:29.544309+0000","last_became_peered":"2024-09-14T11:06:29.544309+0000","last_unstale":"2024-09-14T12:45:00.575182+0000","last_undegraded":"2024-09-14T12:45:00.575182+0000","last_fullsized":"2024-09-14T12:45:00.575182+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T12:45:00.574993+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T12:45:00.574993+0000","last_clean_scrub_stamp":"2024-09-14T12:45:00.574993+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:55.743195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":80,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:43:01.521132+0000","last_change":"2024-09-14T11:40:08.941028+0000","last_active":"2024-09-14T12:43:01.521132+0000","last_peered":"2024-09-14T12:43:01.521132+0000","last_clean":"2024-09-14T12:43:01.521132+0000","last_became_active":"2024-09-14T11:40:08.934447+0000","last_became_peered":"2024-09-14T11:40:08.934447+0000","last_unstale":"2024-09-14T12:43:01.521132+0000","last_undegraded":"2024-09-14T12:43:01.521132+0000","last_fullsized":"2024-09-14T12:43:01.521132+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"267'11","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.270934+0000","last_change":"2024-09-14T12:44:53.270795+0000","last_active":"2024-09-14T12:44:53.270934+0000","last_peered":"2024-09-14T12:44:53.270934+0000","last_clean":"2024-09-14T12:44:53.270934+0000","last_became_active":"2024-09-14T11:12:26.253410+0000","last_became_peered":"2024-09-14T11:12:26.253410+0000","last_unstale":"2024-09-14T12:44:53.270934+0000","last_undegraded":"2024-09-14T12:44:53.270934+0000","last_fullsized":"2024-09-14T12:44:53.270934+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T12:44:53.270600+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T12:44:53.270600+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.270600+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:13.417257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6160,"num_write":16,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.371033+0000","last_change":"2024-09-14T12:44:46.371033+0000","last_active":"2024-09-14T12:44:46.371033+0000","last_peered":"2024-09-14T12:44:46.371033+0000","last_clean":"2024-09-14T12:44:46.371033+0000","last_became_active":"2024-09-14T11:12:19.109807+0000","last_became_peered":"2024-09-14T11:12:19.109807+0000","last_unstale":"2024-09-14T12:44:46.371033+0000","last_undegraded":"2024-09-14T12:44:46.371033+0000","last_fullsized":"2024-09-14T12:44:46.371033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T12:44:46.370806+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T12:44:46.370806+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.370806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:11.684257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'38","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.937380+0000","last_change":"2024-09-14T12:44:39.937380+0000","last_active":"2024-09-14T12:44:39.937380+0000","last_peered":"2024-09-14T12:44:39.937380+0000","last_clean":"2024-09-14T12:44:39.937380+0000","last_became_active":"2024-09-14T11:06:29.520734+0000","last_became_peered":"2024-09-14T11:06:29.520734+0000","last_unstale":"2024-09-14T12:44:39.937380+0000","last_undegraded":"2024-09-14T12:44:39.937380+0000","last_fullsized":"2024-09-14T12:44:39.937380+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-14T12:44:39.937198+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-14T12:44:39.937198+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.937198+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.273746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":248,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.908267+0000","last_change":"2024-09-14T12:44:48.908010+0000","last_active":"2024-09-14T12:44:48.908267+0000","last_peered":"2024-09-14T12:44:48.908267+0000","last_clean":"2024-09-14T12:44:48.908267+0000","last_became_active":"2024-09-14T11:40:08.928855+0000","last_became_peered":"2024-09-14T11:40:08.928855+0000","last_unstale":"2024-09-14T12:44:48.908267+0000","last_undegraded":"2024-09-14T12:44:48.908267+0000","last_fullsized":"2024-09-14T12:44:48.908267+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:48.907783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:48.907783+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.907783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:31.883367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:57.828268+0000","last_change":"2024-09-14T12:44:57.828268+0000","last_active":"2024-09-14T12:44:57.828268+0000","last_peered":"2024-09-14T12:44:57.828268+0000","last_clean":"2024-09-14T12:44:57.828268+0000","last_became_active":"2024-09-14T11:12:26.235707+0000","last_became_peered":"2024-09-14T11:12:26.235707+0000","last_unstale":"2024-09-14T12:44:57.828268+0000","last_undegraded":"2024-09-14T12:44:57.828268+0000","last_fullsized":"2024-09-14T12:44:57.828268+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T12:44:57.828068+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T12:44:57.828068+0000","last_clean_scrub_stamp":"2024-09-14T12:44:57.828068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:00.284071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"267'5","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.357531+0000","last_change":"2024-09-14T12:44:48.357379+0000","last_active":"2024-09-14T12:44:48.357531+0000","last_peered":"2024-09-14T12:44:48.357531+0000","last_clean":"2024-09-14T12:44:48.357531+0000","last_became_active":"2024-09-14T11:12:19.112055+0000","last_became_peered":"2024-09-14T11:12:19.112055+0000","last_unstale":"2024-09-14T12:44:48.357531+0000","last_undegraded":"2024-09-14T12:44:48.357531+0000","last_fullsized":"2024-09-14T12:44:48.357531+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:44:48.357195+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:44:48.357195+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.357195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:54.183829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'65","reported_seq":261,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.841340+0000","last_change":"2024-09-14T12:44:42.841340+0000","last_active":"2024-09-14T12:44:42.841340+0000","last_peered":"2024-09-14T12:44:42.841340+0000","last_clean":"2024-09-14T12:44:42.841340+0000","last_became_active":"2024-09-14T11:06:29.511360+0000","last_became_peered":"2024-09-14T11:06:29.511360+0000","last_unstale":"2024-09-14T12:44:42.841340+0000","last_undegraded":"2024-09-14T12:44:42.841340+0000","last_fullsized":"2024-09-14T12:44:42.841340+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'65","last_scrub_stamp":"2024-09-14T12:44:42.841149+0000","last_deep_scrub":"267'65","last_deep_scrub_stamp":"2024-09-14T12:44:42.841149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.841149+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:58.426066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":367,"num_write":155,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:06.787379+0000","last_change":"2024-09-14T12:45:06.787379+0000","last_active":"2024-09-14T12:45:06.787379+0000","last_peered":"2024-09-14T12:45:06.787379+0000","last_clean":"2024-09-14T12:45:06.787379+0000","last_became_active":"2024-09-14T11:40:08.949175+0000","last_became_peered":"2024-09-14T11:40:08.949175+0000","last_unstale":"2024-09-14T12:45:06.787379+0000","last_undegraded":"2024-09-14T12:45:06.787379+0000","last_fullsized":"2024-09-14T12:45:06.787379+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:06.787211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:06.787211+0000","last_clean_scrub_stamp":"2024-09-14T12:45:06.787211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:13.300742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:11.514505+0000","last_change":"2024-09-14T12:45:11.514505+0000","last_active":"2024-09-14T12:45:11.514505+0000","last_peered":"2024-09-14T12:45:11.514505+0000","last_clean":"2024-09-14T12:45:11.514505+0000","last_became_active":"2024-09-14T11:12:26.228889+0000","last_became_peered":"2024-09-14T11:12:26.228889+0000","last_unstale":"2024-09-14T12:45:11.514505+0000","last_undegraded":"2024-09-14T12:45:11.514505+0000","last_fullsized":"2024-09-14T12:45:11.514505+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:45:11.514315+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:45:11.514315+0000","last_clean_scrub_stamp":"2024-09-14T12:45:11.514315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:34.262765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.295264+0000","last_change":"2024-09-14T12:44:44.295264+0000","last_active":"2024-09-14T12:44:44.295264+0000","last_peered":"2024-09-14T12:44:44.295264+0000","last_clean":"2024-09-14T12:44:44.295264+0000","last_became_active":"2024-09-14T11:12:19.098699+0000","last_became_peered":"2024-09-14T11:12:19.098699+0000","last_unstale":"2024-09-14T12:44:44.295264+0000","last_undegraded":"2024-09-14T12:44:44.295264+0000","last_fullsized":"2024-09-14T12:44:44.295264+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:44.295047+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:44.295047+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.295047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:23.424767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'39","reported_seq":194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.870529+0000","last_change":"2024-09-14T12:44:41.870529+0000","last_active":"2024-09-14T12:44:41.870529+0000","last_peered":"2024-09-14T12:44:41.870529+0000","last_clean":"2024-09-14T12:44:41.870529+0000","last_became_active":"2024-09-14T11:06:29.538432+0000","last_became_peered":"2024-09-14T11:06:29.538432+0000","last_unstale":"2024-09-14T12:44:41.870529+0000","last_undegraded":"2024-09-14T12:44:41.870529+0000","last_fullsized":"2024-09-14T12:44:41.870529+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'39","last_scrub_stamp":"2024-09-14T12:44:41.870351+0000","last_deep_scrub":"267'39","last_deep_scrub_stamp":"2024-09-14T12:44:41.870351+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.870351+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:42.636474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":213,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.936364+0000","last_change":"2024-09-14T12:44:51.936364+0000","last_active":"2024-09-14T12:44:51.936364+0000","last_peered":"2024-09-14T12:44:51.936364+0000","last_clean":"2024-09-14T12:44:51.936364+0000","last_became_active":"2024-09-14T11:40:08.941924+0000","last_became_peered":"2024-09-14T11:40:08.941924+0000","last_unstale":"2024-09-14T12:44:51.936364+0000","last_undegraded":"2024-09-14T12:44:51.936364+0000","last_fullsized":"2024-09-14T12:44:51.936364+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:51.936177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:51.936177+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.936177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:53.724115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.898624+0000","last_change":"2024-09-14T12:44:47.898624+0000","last_active":"2024-09-14T12:44:47.898624+0000","last_peered":"2024-09-14T12:44:47.898624+0000","last_clean":"2024-09-14T12:44:47.898624+0000","last_became_active":"2024-09-14T11:12:26.247849+0000","last_became_peered":"2024-09-14T11:12:26.247849+0000","last_unstale":"2024-09-14T12:44:47.898624+0000","last_undegraded":"2024-09-14T12:44:47.898624+0000","last_fullsized":"2024-09-14T12:44:47.898624+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T12:44:47.898410+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T12:44:47.898410+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.898410+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:52.699926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5155,"num_write":12,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.804135+0000","last_change":"2024-09-14T12:44:50.804135+0000","last_active":"2024-09-14T12:44:50.804135+0000","last_peered":"2024-09-14T12:44:50.804135+0000","last_clean":"2024-09-14T12:44:50.804135+0000","last_became_active":"2024-09-14T11:12:19.095636+0000","last_became_peered":"2024-09-14T11:12:19.095636+0000","last_unstale":"2024-09-14T12:44:50.804135+0000","last_undegraded":"2024-09-14T12:44:50.804135+0000","last_fullsized":"2024-09-14T12:44:50.804135+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:50.803939+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:50.803939+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.803939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:40:32.357202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'31","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.996749+0000","last_change":"2024-09-14T12:44:38.996749+0000","last_active":"2024-09-14T12:44:38.996749+0000","last_peered":"2024-09-14T12:44:38.996749+0000","last_clean":"2024-09-14T12:44:38.996749+0000","last_became_active":"2024-09-14T11:06:29.508269+0000","last_became_peered":"2024-09-14T11:06:29.508269+0000","last_unstale":"2024-09-14T12:44:38.996749+0000","last_undegraded":"2024-09-14T12:44:38.996749+0000","last_fullsized":"2024-09-14T12:44:38.996749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'31","last_scrub_stamp":"2024-09-14T12:44:38.996567+0000","last_deep_scrub":"267'31","last_deep_scrub_stamp":"2024-09-14T12:44:38.996567+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.996567+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:40.061214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":149,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.088629+0000","last_change":"2024-09-14T12:44:45.088629+0000","last_active":"2024-09-14T12:44:45.088629+0000","last_peered":"2024-09-14T12:44:45.088629+0000","last_clean":"2024-09-14T12:44:45.088629+0000","last_became_active":"2024-09-14T11:40:08.945217+0000","last_became_peered":"2024-09-14T11:40:08.945217+0000","last_unstale":"2024-09-14T12:44:45.088629+0000","last_undegraded":"2024-09-14T12:44:45.088629+0000","last_fullsized":"2024-09-14T12:44:45.088629+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:45.088435+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:45.088435+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.088435+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:17.997786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.760937+0000","last_change":"2024-09-14T12:44:50.760937+0000","last_active":"2024-09-14T12:44:50.760937+0000","last_peered":"2024-09-14T12:44:50.760937+0000","last_clean":"2024-09-14T12:44:50.760937+0000","last_became_active":"2024-09-14T11:12:26.247272+0000","last_became_peered":"2024-09-14T11:12:26.247272+0000","last_unstale":"2024-09-14T12:44:50.760937+0000","last_undegraded":"2024-09-14T12:44:50.760937+0000","last_fullsized":"2024-09-14T12:44:50.760937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:44:50.760673+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:44:50.760673+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.760673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:35.549898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.327168+0000","last_change":"2024-09-14T12:44:45.327168+0000","last_active":"2024-09-14T12:44:45.327168+0000","last_peered":"2024-09-14T12:44:45.327168+0000","last_clean":"2024-09-14T12:44:45.327168+0000","last_became_active":"2024-09-14T11:12:19.103535+0000","last_became_peered":"2024-09-14T11:12:19.103535+0000","last_unstale":"2024-09-14T12:44:45.327168+0000","last_undegraded":"2024-09-14T12:44:45.327168+0000","last_fullsized":"2024-09-14T12:44:45.327168+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:45.326979+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:45.326979+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.326979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:21.405703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'7","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.817123+0000","last_change":"2024-09-14T12:44:47.817123+0000","last_active":"2024-09-14T12:44:47.817123+0000","last_peered":"2024-09-14T12:44:47.817123+0000","last_clean":"2024-09-14T12:44:47.817123+0000","last_became_active":"2024-09-14T11:06:29.510044+0000","last_became_peered":"2024-09-14T11:06:29.510044+0000","last_unstale":"2024-09-14T12:44:47.817123+0000","last_undegraded":"2024-09-14T12:44:47.817123+0000","last_fullsized":"2024-09-14T12:44:47.817123+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:47.816835+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:47.816835+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.816835+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:48.553505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:58.366527+0000","last_change":"2024-09-14T12:44:58.366527+0000","last_active":"2024-09-14T12:44:58.366527+0000","last_peered":"2024-09-14T12:44:58.366527+0000","last_clean":"2024-09-14T12:44:58.366527+0000","last_became_active":"2024-09-14T11:40:08.930065+0000","last_became_peered":"2024-09-14T11:40:08.930065+0000","last_unstale":"2024-09-14T12:44:58.366527+0000","last_undegraded":"2024-09-14T12:44:58.366527+0000","last_fullsized":"2024-09-14T12:44:58.366527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:58.366339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:58.366339+0000","last_clean_scrub_stamp":"2024-09-14T12:44:58.366339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:10.039917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.111348+0000","last_change":"2024-09-14T12:44:41.111348+0000","last_active":"2024-09-14T12:44:41.111348+0000","last_peered":"2024-09-14T12:44:41.111348+0000","last_clean":"2024-09-14T12:44:41.111348+0000","last_became_active":"2024-09-14T11:12:26.233812+0000","last_became_peered":"2024-09-14T11:12:26.233812+0000","last_unstale":"2024-09-14T12:44:41.111348+0000","last_undegraded":"2024-09-14T12:44:41.111348+0000","last_fullsized":"2024-09-14T12:44:41.111348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.111161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.111161+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.111161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:06.814018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:06.561420+0000","last_change":"2024-09-14T12:45:06.561420+0000","last_active":"2024-09-14T12:45:06.561420+0000","last_peered":"2024-09-14T12:45:06.561420+0000","last_clean":"2024-09-14T12:45:06.561420+0000","last_became_active":"2024-09-14T11:12:19.107950+0000","last_became_peered":"2024-09-14T11:12:19.107950+0000","last_unstale":"2024-09-14T12:45:06.561420+0000","last_undegraded":"2024-09-14T12:45:06.561420+0000","last_fullsized":"2024-09-14T12:45:06.561420+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:45:06.561244+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:45:06.561244+0000","last_clean_scrub_stamp":"2024-09-14T12:45:06.561244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:49.823617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'21","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.118104+0000","last_change":"2024-09-14T12:44:38.118104+0000","last_active":"2024-09-14T12:44:38.118104+0000","last_peered":"2024-09-14T12:44:38.118104+0000","last_clean":"2024-09-14T12:44:38.118104+0000","last_became_active":"2024-09-14T11:06:29.528153+0000","last_became_peered":"2024-09-14T11:06:29.528153+0000","last_unstale":"2024-09-14T12:44:38.118104+0000","last_undegraded":"2024-09-14T12:44:38.118104+0000","last_fullsized":"2024-09-14T12:44:38.118104+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-14T12:44:38.117922+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-14T12:44:38.117922+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.117922+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:42.907829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":111,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.064501+0000","last_change":"2024-09-14T12:44:46.064501+0000","last_active":"2024-09-14T12:44:46.064501+0000","last_peered":"2024-09-14T12:44:46.064501+0000","last_clean":"2024-09-14T12:44:46.064501+0000","last_became_active":"2024-09-14T11:40:08.936369+0000","last_became_peered":"2024-09-14T11:40:08.936369+0000","last_unstale":"2024-09-14T12:44:46.064501+0000","last_undegraded":"2024-09-14T12:44:46.064501+0000","last_fullsized":"2024-09-14T12:44:46.064501+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.064323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.064323+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.064323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:12.689238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:58.838711+0000","last_change":"2024-09-14T12:44:58.838711+0000","last_active":"2024-09-14T12:44:58.838711+0000","last_peered":"2024-09-14T12:44:58.838711+0000","last_clean":"2024-09-14T12:44:58.838711+0000","last_became_active":"2024-09-14T11:12:26.245930+0000","last_became_peered":"2024-09-14T11:12:26.245930+0000","last_unstale":"2024-09-14T12:44:58.838711+0000","last_undegraded":"2024-09-14T12:44:58.838711+0000","last_fullsized":"2024-09-14T12:44:58.838711+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:58.838518+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:58.838518+0000","last_clean_scrub_stamp":"2024-09-14T12:44:58.838518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:41.244093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'2","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:08.504622+0000","last_change":"2024-09-14T12:45:08.504622+0000","last_active":"2024-09-14T12:45:08.504622+0000","last_peered":"2024-09-14T12:45:08.504622+0000","last_clean":"2024-09-14T12:45:08.504622+0000","last_became_active":"2024-09-14T11:12:19.108775+0000","last_became_peered":"2024-09-14T11:12:19.108775+0000","last_unstale":"2024-09-14T12:45:08.504622+0000","last_undegraded":"2024-09-14T12:45:08.504622+0000","last_fullsized":"2024-09-14T12:45:08.504622+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:45:08.504431+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:45:08.504431+0000","last_clean_scrub_stamp":"2024-09-14T12:45:08.504431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:34.511540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'26","reported_seq":150,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.802237+0000","last_change":"2024-09-14T12:44:47.802237+0000","last_active":"2024-09-14T12:44:47.802237+0000","last_peered":"2024-09-14T12:44:47.802237+0000","last_clean":"2024-09-14T12:44:47.802237+0000","last_became_active":"2024-09-14T11:06:29.512500+0000","last_became_peered":"2024-09-14T11:06:29.512500+0000","last_unstale":"2024-09-14T12:44:47.802237+0000","last_undegraded":"2024-09-14T12:44:47.802237+0000","last_fullsized":"2024-09-14T12:44:47.802237+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-14T12:44:47.802052+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-14T12:44:47.802052+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.802052+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:06.755343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":126,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.118297+0000","last_change":"2024-09-14T12:44:44.118166+0000","last_active":"2024-09-14T12:44:44.118297+0000","last_peered":"2024-09-14T12:44:44.118297+0000","last_clean":"2024-09-14T12:44:44.118297+0000","last_became_active":"2024-09-14T11:40:08.941346+0000","last_became_peered":"2024-09-14T11:40:08.941346+0000","last_unstale":"2024-09-14T12:44:44.118297+0000","last_undegraded":"2024-09-14T12:44:44.118297+0000","last_fullsized":"2024-09-14T12:44:44.118297+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.118002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.118002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.118002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:18.132212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:55.828267+0000","last_change":"2024-09-14T12:44:55.828267+0000","last_active":"2024-09-14T12:44:55.828267+0000","last_peered":"2024-09-14T12:44:55.828267+0000","last_clean":"2024-09-14T12:44:55.828267+0000","last_became_active":"2024-09-14T11:12:26.243209+0000","last_became_peered":"2024-09-14T11:12:26.243209+0000","last_unstale":"2024-09-14T12:44:55.828267+0000","last_undegraded":"2024-09-14T12:44:55.828267+0000","last_fullsized":"2024-09-14T12:44:55.828267+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:55.828071+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:55.828071+0000","last_clean_scrub_stamp":"2024-09-14T12:44:55.828071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:53.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'11","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.830837+0000","last_change":"2024-09-14T12:44:52.830837+0000","last_active":"2024-09-14T12:44:52.830837+0000","last_peered":"2024-09-14T12:44:52.830837+0000","last_clean":"2024-09-14T12:44:52.830837+0000","last_became_active":"2024-09-14T11:12:19.091327+0000","last_became_peered":"2024-09-14T11:12:19.091327+0000","last_unstale":"2024-09-14T12:44:52.830837+0000","last_undegraded":"2024-09-14T12:44:52.830837+0000","last_fullsized":"2024-09-14T12:44:52.830837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T12:44:52.830645+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T12:44:52.830645+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.830645+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:22.172015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":27638,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'29","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:59.551254+0000","last_change":"2024-09-14T12:44:59.551254+0000","last_active":"2024-09-14T12:44:59.551254+0000","last_peered":"2024-09-14T12:44:59.551254+0000","last_clean":"2024-09-14T12:44:59.551254+0000","last_became_active":"2024-09-14T11:06:29.539618+0000","last_became_peered":"2024-09-14T11:06:29.539618+0000","last_unstale":"2024-09-14T12:44:59.551254+0000","last_undegraded":"2024-09-14T12:44:59.551254+0000","last_fullsized":"2024-09-14T12:44:59.551254+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T12:44:59.551079+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T12:44:59.551079+0000","last_clean_scrub_stamp":"2024-09-14T12:44:59.551079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.945678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":157,"num_write":71,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:03.792942+0000","last_change":"2024-09-14T12:45:03.792942+0000","last_active":"2024-09-14T12:45:03.792942+0000","last_peered":"2024-09-14T12:45:03.792942+0000","last_clean":"2024-09-14T12:45:03.792942+0000","last_became_active":"2024-09-14T11:40:08.946312+0000","last_became_peered":"2024-09-14T11:40:08.946312+0000","last_unstale":"2024-09-14T12:45:03.792942+0000","last_undegraded":"2024-09-14T12:45:03.792942+0000","last_fullsized":"2024-09-14T12:45:03.792942+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:03.792749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:03.792749+0000","last_clean_scrub_stamp":"2024-09-14T12:45:03.792749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:02.066612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'9","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.118913+0000","last_change":"2024-09-14T12:44:40.118913+0000","last_active":"2024-09-14T12:44:40.118913+0000","last_peered":"2024-09-14T12:44:40.118913+0000","last_clean":"2024-09-14T12:44:40.118913+0000","last_became_active":"2024-09-14T11:12:26.228723+0000","last_became_peered":"2024-09-14T11:12:26.228723+0000","last_unstale":"2024-09-14T12:44:40.118913+0000","last_undegraded":"2024-09-14T12:44:40.118913+0000","last_fullsized":"2024-09-14T12:44:40.118913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-14T12:44:40.118688+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-14T12:44:40.118688+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.118688+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:29.274770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11303,"num_write":14,"num_write_kb":5161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.915108+0000","last_change":"2024-09-14T12:44:46.915108+0000","last_active":"2024-09-14T12:44:46.915108+0000","last_peered":"2024-09-14T12:44:46.915108+0000","last_clean":"2024-09-14T12:44:46.915108+0000","last_became_active":"2024-09-14T11:12:19.085023+0000","last_became_peered":"2024-09-14T11:12:19.085023+0000","last_unstale":"2024-09-14T12:44:46.915108+0000","last_undegraded":"2024-09-14T12:44:46.915108+0000","last_fullsized":"2024-09-14T12:44:46.915108+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.914925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.914925+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.914925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:28.424831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'37","reported_seq":179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.002327+0000","last_change":"2024-09-14T12:44:41.002189+0000","last_active":"2024-09-14T12:44:41.002327+0000","last_peered":"2024-09-14T12:44:41.002327+0000","last_clean":"2024-09-14T12:44:41.002327+0000","last_became_active":"2024-09-14T11:06:29.527422+0000","last_became_peered":"2024-09-14T11:06:29.527422+0000","last_unstale":"2024-09-14T12:44:41.002327+0000","last_undegraded":"2024-09-14T12:44:41.002327+0000","last_fullsized":"2024-09-14T12:44:41.002327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-09-14T12:44:41.002019+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-09-14T12:44:41.002019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.002019+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:11.659212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":97,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:41.516845+0000","last_change":"2024-09-14T11:40:08.934634+0000","last_active":"2024-09-14T12:42:41.516845+0000","last_peered":"2024-09-14T12:42:41.516845+0000","last_clean":"2024-09-14T12:42:41.516845+0000","last_became_active":"2024-09-14T11:40:08.933897+0000","last_became_peered":"2024-09-14T11:40:08.933897+0000","last_unstale":"2024-09-14T12:42:41.516845+0000","last_undegraded":"2024-09-14T12:42:41.516845+0000","last_fullsized":"2024-09-14T12:42:41.516845+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'7","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:03.827832+0000","last_change":"2024-09-14T11:12:26.238345+0000","last_active":"2024-09-14T12:44:03.827832+0000","last_peered":"2024-09-14T12:44:03.827832+0000","last_clean":"2024-09-14T12:44:03.827832+0000","last_became_active":"2024-09-14T11:12:26.232736+0000","last_became_peered":"2024-09-14T11:12:26.232736+0000","last_unstale":"2024-09-14T12:44:03.827832+0000","last_undegraded":"2024-09-14T12:44:03.827832+0000","last_fullsized":"2024-09-14T12:44:03.827832+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:25.180501+0000","last_clean_scrub_stamp":"2024-09-14T11:12:25.180501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:45.595070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":12,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'5","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:04.525015+0000","last_change":"2024-09-14T12:45:04.525015+0000","last_active":"2024-09-14T12:45:04.525015+0000","last_peered":"2024-09-14T12:45:04.525015+0000","last_clean":"2024-09-14T12:45:04.525015+0000","last_became_active":"2024-09-14T11:12:19.100258+0000","last_became_peered":"2024-09-14T11:12:19.100258+0000","last_unstale":"2024-09-14T12:45:04.525015+0000","last_undegraded":"2024-09-14T12:45:04.525015+0000","last_fullsized":"2024-09-14T12:45:04.525015+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:45:04.524792+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:45:04.524792+0000","last_clean_scrub_stamp":"2024-09-14T12:45:04.524792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:59.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2056,"num_write":10,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'41","reported_seq":197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.370853+0000","last_change":"2024-09-14T12:44:38.370853+0000","last_active":"2024-09-14T12:44:38.370853+0000","last_peered":"2024-09-14T12:44:38.370853+0000","last_clean":"2024-09-14T12:44:38.370853+0000","last_became_active":"2024-09-14T11:06:29.532958+0000","last_became_peered":"2024-09-14T11:06:29.532958+0000","last_unstale":"2024-09-14T12:44:38.370853+0000","last_undegraded":"2024-09-14T12:44:38.370853+0000","last_fullsized":"2024-09-14T12:44:38.370853+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'41","last_scrub_stamp":"2024-09-14T12:44:38.370671+0000","last_deep_scrub":"267'41","last_deep_scrub_stamp":"2024-09-14T12:44:38.370671+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.370671+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:47.399639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":199,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:59.347756+0000","last_change":"2024-09-14T12:44:59.347596+0000","last_active":"2024-09-14T12:44:59.347756+0000","last_peered":"2024-09-14T12:44:59.347756+0000","last_clean":"2024-09-14T12:44:59.347756+0000","last_became_active":"2024-09-14T11:40:08.932939+0000","last_became_peered":"2024-09-14T11:40:08.932939+0000","last_unstale":"2024-09-14T12:44:59.347756+0000","last_undegraded":"2024-09-14T12:44:59.347756+0000","last_fullsized":"2024-09-14T12:44:59.347756+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:59.347402+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:59.347402+0000","last_clean_scrub_stamp":"2024-09-14T12:44:59.347402+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:18.005216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.768415+0000","last_change":"2024-09-14T12:44:54.768415+0000","last_active":"2024-09-14T12:44:54.768415+0000","last_peered":"2024-09-14T12:44:54.768415+0000","last_clean":"2024-09-14T12:44:54.768415+0000","last_became_active":"2024-09-14T11:12:26.236892+0000","last_became_peered":"2024-09-14T11:12:26.236892+0000","last_unstale":"2024-09-14T12:44:54.768415+0000","last_undegraded":"2024-09-14T12:44:54.768415+0000","last_fullsized":"2024-09-14T12:44:54.768415+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:54.768111+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:54.768111+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.768111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:02.656050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.955542+0000","last_change":"2024-09-14T12:44:44.955542+0000","last_active":"2024-09-14T12:44:44.955542+0000","last_peered":"2024-09-14T12:44:44.955542+0000","last_clean":"2024-09-14T12:44:44.955542+0000","last_became_active":"2024-09-14T11:12:19.084630+0000","last_became_peered":"2024-09-14T11:12:19.084630+0000","last_unstale":"2024-09-14T12:44:44.955542+0000","last_undegraded":"2024-09-14T12:44:44.955542+0000","last_fullsized":"2024-09-14T12:44:44.955542+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.955318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.955318+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.955318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:27.480020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'305","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.956616+0000","last_change":"2024-09-14T12:44:41.956616+0000","last_active":"2024-09-14T12:44:41.956616+0000","last_peered":"2024-09-14T12:44:41.956616+0000","last_clean":"2024-09-14T12:44:41.956616+0000","last_became_active":"2024-09-14T11:06:29.524051+0000","last_became_peered":"2024-09-14T11:06:29.524051+0000","last_unstale":"2024-09-14T12:44:41.956616+0000","last_undegraded":"2024-09-14T12:44:41.956616+0000","last_fullsized":"2024-09-14T12:44:41.956616+0000","mapping_epoch":256,"log_start":"264'200","ondisk_log_start":"264'200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'305","last_scrub_stamp":"2024-09-14T12:44:41.956433+0000","last_deep_scrub":"267'305","last_deep_scrub_stamp":"2024-09-14T12:44:41.956433+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.956433+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:41.194763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2841,"num_read_kb":3371,"num_write":621,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.794805+0000","last_change":"2024-09-14T12:44:53.794681+0000","last_active":"2024-09-14T12:44:53.794805+0000","last_peered":"2024-09-14T12:44:53.794805+0000","last_clean":"2024-09-14T12:44:53.794805+0000","last_became_active":"2024-09-14T11:40:08.938357+0000","last_became_peered":"2024-09-14T11:40:08.938357+0000","last_unstale":"2024-09-14T12:44:53.794805+0000","last_undegraded":"2024-09-14T12:44:53.794805+0000","last_fullsized":"2024-09-14T12:44:53.794805+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:53.794507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:53.794507+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.794507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:45.570386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'10","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:07.530015+0000","last_change":"2024-09-14T12:45:07.530015+0000","last_active":"2024-09-14T12:45:07.530015+0000","last_peered":"2024-09-14T12:45:07.530015+0000","last_clean":"2024-09-14T12:45:07.530015+0000","last_became_active":"2024-09-14T11:12:26.251771+0000","last_became_peered":"2024-09-14T11:12:26.251771+0000","last_unstale":"2024-09-14T12:45:07.530015+0000","last_undegraded":"2024-09-14T12:45:07.530015+0000","last_fullsized":"2024-09-14T12:45:07.530015+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-14T12:45:07.529754+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-14T12:45:07.529754+0000","last_clean_scrub_stamp":"2024-09-14T12:45:07.529754+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:10.186479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9222,"num_write":10,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'2","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:05.571291+0000","last_change":"2024-09-14T12:45:05.571291+0000","last_active":"2024-09-14T12:45:05.571291+0000","last_peered":"2024-09-14T12:45:05.571291+0000","last_clean":"2024-09-14T12:45:05.571291+0000","last_became_active":"2024-09-14T11:12:19.100323+0000","last_became_peered":"2024-09-14T11:12:19.100323+0000","last_unstale":"2024-09-14T12:45:05.571291+0000","last_undegraded":"2024-09-14T12:45:05.571291+0000","last_fullsized":"2024-09-14T12:45:05.571291+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:45:05.571103+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:45:05.571103+0000","last_clean_scrub_stamp":"2024-09-14T12:45:05.571103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:19.740757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'31","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:01.572356+0000","last_change":"2024-09-14T12:45:01.572356+0000","last_active":"2024-09-14T12:45:01.572356+0000","last_peered":"2024-09-14T12:45:01.572356+0000","last_clean":"2024-09-14T12:45:01.572356+0000","last_became_active":"2024-09-14T11:06:29.545010+0000","last_became_peered":"2024-09-14T11:06:29.545010+0000","last_unstale":"2024-09-14T12:45:01.572356+0000","last_undegraded":"2024-09-14T12:45:01.572356+0000","last_fullsized":"2024-09-14T12:45:01.572356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'31","last_scrub_stamp":"2024-09-14T12:45:01.572088+0000","last_deep_scrub":"267'31","last_deep_scrub_stamp":"2024-09-14T12:45:01.572088+0000","last_clean_scrub_stamp":"2024-09-14T12:45:01.572088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:35.031478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":160,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:04.768100+0000","last_change":"2024-09-14T12:45:04.768100+0000","last_active":"2024-09-14T12:45:04.768100+0000","last_peered":"2024-09-14T12:45:04.768100+0000","last_clean":"2024-09-14T12:45:04.768100+0000","last_became_active":"2024-09-14T11:40:08.946192+0000","last_became_peered":"2024-09-14T11:40:08.946192+0000","last_unstale":"2024-09-14T12:45:04.768100+0000","last_undegraded":"2024-09-14T12:45:04.768100+0000","last_fullsized":"2024-09-14T12:45:04.768100+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:04.767913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:04.767913+0000","last_clean_scrub_stamp":"2024-09-14T12:45:04.767913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:31.374008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"267'14","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.858662+0000","last_change":"2024-09-14T12:44:48.858662+0000","last_active":"2024-09-14T12:44:48.858662+0000","last_peered":"2024-09-14T12:44:48.858662+0000","last_clean":"2024-09-14T12:44:48.858662+0000","last_became_active":"2024-09-14T11:12:26.251336+0000","last_became_peered":"2024-09-14T11:12:26.251336+0000","last_unstale":"2024-09-14T12:44:48.858662+0000","last_undegraded":"2024-09-14T12:44:48.858662+0000","last_fullsized":"2024-09-14T12:44:48.858662+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T12:44:48.858479+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T12:44:48.858479+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.858479+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:37.751198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":27664,"num_write":24,"num_write_kb":11276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.782700+0000","last_change":"2024-09-14T12:44:47.782700+0000","last_active":"2024-09-14T12:44:47.782700+0000","last_peered":"2024-09-14T12:44:47.782700+0000","last_clean":"2024-09-14T12:44:47.782700+0000","last_became_active":"2024-09-14T11:12:19.089451+0000","last_became_peered":"2024-09-14T11:12:19.089451+0000","last_unstale":"2024-09-14T12:44:47.782700+0000","last_undegraded":"2024-09-14T12:44:47.782700+0000","last_fullsized":"2024-09-14T12:44:47.782700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.782509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.782509+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.782509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.496882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"267'36","reported_seq":185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:57.552064+0000","last_change":"2024-09-14T12:44:57.552064+0000","last_active":"2024-09-14T12:44:57.552064+0000","last_peered":"2024-09-14T12:44:57.552064+0000","last_clean":"2024-09-14T12:44:57.552064+0000","last_became_active":"2024-09-14T11:06:29.518775+0000","last_became_peered":"2024-09-14T11:06:29.518775+0000","last_unstale":"2024-09-14T12:44:57.552064+0000","last_undegraded":"2024-09-14T12:44:57.552064+0000","last_fullsized":"2024-09-14T12:44:57.552064+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-09-14T12:44:57.551868+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-09-14T12:44:57.551868+0000","last_clean_scrub_stamp":"2024-09-14T12:44:57.551868+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:02.493682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":189,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:42:46.518361+0000","last_change":"2024-09-14T11:40:08.934946+0000","last_active":"2024-09-14T12:42:46.518361+0000","last_peered":"2024-09-14T12:42:46.518361+0000","last_clean":"2024-09-14T12:42:46.518361+0000","last_became_active":"2024-09-14T11:40:08.934173+0000","last_became_peered":"2024-09-14T11:40:08.934173+0000","last_unstale":"2024-09-14T12:42:46.518361+0000","last_undegraded":"2024-09-14T12:42:46.518361+0000","last_fullsized":"2024-09-14T12:42:46.518361+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:40:07.890290+0000","last_clean_scrub_stamp":"2024-09-14T11:40:07.890290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"267'6","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.907542+0000","last_change":"2024-09-14T12:44:45.907542+0000","last_active":"2024-09-14T12:44:45.907542+0000","last_peered":"2024-09-14T12:44:45.907542+0000","last_clean":"2024-09-14T12:44:45.907542+0000","last_became_active":"2024-09-14T11:12:26.242532+0000","last_became_peered":"2024-09-14T11:12:26.242532+0000","last_unstale":"2024-09-14T12:44:45.907542+0000","last_undegraded":"2024-09-14T12:44:45.907542+0000","last_fullsized":"2024-09-14T12:44:45.907542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:44:45.907357+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:44:45.907357+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.907357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:45.964370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9208,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.014276+0000","last_change":"2024-09-14T12:44:42.014276+0000","last_active":"2024-09-14T12:44:42.014276+0000","last_peered":"2024-09-14T12:44:42.014276+0000","last_clean":"2024-09-14T12:44:42.014276+0000","last_became_active":"2024-09-14T11:12:19.115236+0000","last_became_peered":"2024-09-14T11:12:19.115236+0000","last_unstale":"2024-09-14T12:44:42.014276+0000","last_undegraded":"2024-09-14T12:44:42.014276+0000","last_fullsized":"2024-09-14T12:44:42.014276+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:42.014088+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:42.014088+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.014088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:47.858064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'6","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.053405+0000","last_change":"2024-09-14T12:44:37.053152+0000","last_active":"2024-09-14T12:44:37.053405+0000","last_peered":"2024-09-14T12:44:37.053405+0000","last_clean":"2024-09-14T12:44:37.053405+0000","last_became_active":"2024-09-14T11:06:29.525548+0000","last_became_peered":"2024-09-14T11:06:29.525548+0000","last_unstale":"2024-09-14T12:44:37.053405+0000","last_undegraded":"2024-09-14T12:44:37.053405+0000","last_fullsized":"2024-09-14T12:44:37.053405+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T12:44:37.052939+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T12:44:37.052939+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.052939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:59.273968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'395","reported_seq":1128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.241668+0000","last_change":"2024-09-14T12:44:20.241668+0000","last_active":"2024-09-14T12:44:20.241668+0000","last_peered":"2024-09-14T12:44:20.241668+0000","last_clean":"2024-09-14T12:44:20.241668+0000","last_became_active":"2024-09-14T10:49:23.372514+0000","last_became_peered":"2024-09-14T10:49:23.372514+0000","last_unstale":"2024-09-14T12:44:20.241668+0000","last_undegraded":"2024-09-14T12:44:20.241668+0000","last_fullsized":"2024-09-14T12:44:20.241668+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T12:44:20.241424+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T12:44:20.241424+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.241424+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:25.118550+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":698,"num_read_kb":89783,"num_write":1195,"num_write_kb":37856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'879","reported_seq":2591,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.049229+0000","last_change":"2024-09-14T12:44:23.049066+0000","last_active":"2024-09-14T12:44:23.049229+0000","last_peered":"2024-09-14T12:44:23.049229+0000","last_clean":"2024-09-14T12:44:23.049229+0000","last_became_active":"2024-09-14T10:49:25.368861+0000","last_became_peered":"2024-09-14T10:49:25.368861+0000","last_unstale":"2024-09-14T12:44:23.049229+0000","last_undegraded":"2024-09-14T12:44:23.049229+0000","last_fullsized":"2024-09-14T12:44:23.049229+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'879","last_scrub_stamp":"2024-09-14T12:44:23.048885+0000","last_deep_scrub":"267'879","last_deep_scrub_stamp":"2024-09-14T12:44:23.048885+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.048885+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:35:29.666443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4292,"num_read_kb":3786,"num_write":1290,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'389","reported_seq":1147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.841857+0000","last_change":"2024-09-14T12:44:23.841857+0000","last_active":"2024-09-14T12:44:23.841857+0000","last_peered":"2024-09-14T12:44:23.841857+0000","last_clean":"2024-09-14T12:44:23.841857+0000","last_became_active":"2024-09-14T10:49:23.386742+0000","last_became_peered":"2024-09-14T10:49:23.386742+0000","last_unstale":"2024-09-14T12:44:23.841857+0000","last_undegraded":"2024-09-14T12:44:23.841857+0000","last_fullsized":"2024-09-14T12:44:23.841857+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-09-14T12:44:23.841630+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-09-14T12:44:23.841630+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.841630+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:47.077958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":967,"num_read_kb":14779,"num_write":1188,"num_write_kb":22069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'1160","reported_seq":2822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.692483+0000","last_change":"2024-09-14T12:44:35.692483+0000","last_active":"2024-09-14T12:44:35.692483+0000","last_peered":"2024-09-14T12:44:35.692483+0000","last_clean":"2024-09-14T12:44:35.692483+0000","last_became_active":"2024-09-14T10:49:25.370610+0000","last_became_peered":"2024-09-14T10:49:25.370610+0000","last_unstale":"2024-09-14T12:44:35.692483+0000","last_undegraded":"2024-09-14T12:44:35.692483+0000","last_fullsized":"2024-09-14T12:44:35.692483+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1160","last_scrub_stamp":"2024-09-14T12:44:35.692262+0000","last_deep_scrub":"267'1160","last_deep_scrub_stamp":"2024-09-14T12:44:35.692262+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.692262+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:51.550361+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5343,"num_read_kb":4756,"num_write":1566,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'380","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.834788+0000","last_change":"2024-09-14T12:44:22.834788+0000","last_active":"2024-09-14T12:44:22.834788+0000","last_peered":"2024-09-14T12:44:22.834788+0000","last_clean":"2024-09-14T12:44:22.834788+0000","last_became_active":"2024-09-14T10:49:23.367647+0000","last_became_peered":"2024-09-14T10:49:23.367647+0000","last_unstale":"2024-09-14T12:44:22.834788+0000","last_undegraded":"2024-09-14T12:44:22.834788+0000","last_fullsized":"2024-09-14T12:44:22.834788+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-14T12:44:22.834585+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-14T12:44:22.834585+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.834585+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:40.778231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":20304,"num_write":1229,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1240","reported_seq":2841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.688467+0000","last_change":"2024-09-14T12:44:34.688467+0000","last_active":"2024-09-14T12:44:34.688467+0000","last_peered":"2024-09-14T12:44:34.688467+0000","last_clean":"2024-09-14T12:44:34.688467+0000","last_became_active":"2024-09-14T10:49:25.380525+0000","last_became_peered":"2024-09-14T10:49:25.380525+0000","last_unstale":"2024-09-14T12:44:34.688467+0000","last_undegraded":"2024-09-14T12:44:34.688467+0000","last_fullsized":"2024-09-14T12:44:34.688467+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1240","last_scrub_stamp":"2024-09-14T12:44:34.688273+0000","last_deep_scrub":"267'1240","last_deep_scrub_stamp":"2024-09-14T12:44:34.688273+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.688273+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:58.651664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5594,"num_read_kb":4933,"num_write":1701,"num_write_kb":712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.857351+0000","last_change":"2024-09-14T12:44:15.857351+0000","last_active":"2024-09-14T12:44:15.857351+0000","last_peered":"2024-09-14T12:44:15.857351+0000","last_clean":"2024-09-14T12:44:15.857351+0000","last_became_active":"2024-09-14T10:49:23.395029+0000","last_became_peered":"2024-09-14T10:49:23.395029+0000","last_unstale":"2024-09-14T12:44:15.857351+0000","last_undegraded":"2024-09-14T12:44:15.857351+0000","last_fullsized":"2024-09-14T12:44:15.857351+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-09-14T12:44:15.857104+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-09-14T12:44:15.857104+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.857104+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:35.578952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":13844,"num_write":1136,"num_write_kb":32575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'923","reported_seq":2548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.832708+0000","last_change":"2024-09-14T12:44:26.832708+0000","last_active":"2024-09-14T12:44:26.832708+0000","last_peered":"2024-09-14T12:44:26.832708+0000","last_clean":"2024-09-14T12:44:26.832708+0000","last_became_active":"2024-09-14T10:49:25.368723+0000","last_became_peered":"2024-09-14T10:49:25.368723+0000","last_unstale":"2024-09-14T12:44:26.832708+0000","last_undegraded":"2024-09-14T12:44:26.832708+0000","last_fullsized":"2024-09-14T12:44:26.832708+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'923","last_scrub_stamp":"2024-09-14T12:44:26.832504+0000","last_deep_scrub":"267'923","last_deep_scrub_stamp":"2024-09-14T12:44:26.832504+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.832504+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:38.827676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6457,"num_read_kb":5960,"num_write":1431,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'365","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.327853+0000","last_change":"2024-09-14T12:44:18.327687+0000","last_active":"2024-09-14T12:44:18.327853+0000","last_peered":"2024-09-14T12:44:18.327853+0000","last_clean":"2024-09-14T12:44:18.327853+0000","last_became_active":"2024-09-14T10:49:23.396952+0000","last_became_peered":"2024-09-14T10:49:23.396952+0000","last_unstale":"2024-09-14T12:44:18.327853+0000","last_undegraded":"2024-09-14T12:44:18.327853+0000","last_fullsized":"2024-09-14T12:44:18.327853+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-14T12:44:18.327453+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-14T12:44:18.327453+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.327453+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:39.003445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":730,"num_read_kb":15587,"num_write":1249,"num_write_kb":19198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'490","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.118914+0000","last_change":"2024-09-14T12:44:24.118914+0000","last_active":"2024-09-14T12:44:24.118914+0000","last_peered":"2024-09-14T12:44:24.118914+0000","last_clean":"2024-09-14T12:44:24.118914+0000","last_became_active":"2024-09-14T10:49:25.369197+0000","last_became_peered":"2024-09-14T10:49:25.369197+0000","last_unstale":"2024-09-14T12:44:24.118914+0000","last_undegraded":"2024-09-14T12:44:24.118914+0000","last_fullsized":"2024-09-14T12:44:24.118914+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-14T12:44:24.118736+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-14T12:44:24.118736+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.118736+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:43.727353+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2591,"num_write":558,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'328","reported_seq":987,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.891194+0000","last_change":"2024-09-14T12:44:14.891054+0000","last_active":"2024-09-14T12:44:14.891194+0000","last_peered":"2024-09-14T12:44:14.891194+0000","last_clean":"2024-09-14T12:44:14.891194+0000","last_became_active":"2024-09-14T10:49:23.386773+0000","last_became_peered":"2024-09-14T10:49:23.386773+0000","last_unstale":"2024-09-14T12:44:14.891194+0000","last_undegraded":"2024-09-14T12:44:14.891194+0000","last_fullsized":"2024-09-14T12:44:14.891194+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-14T12:44:14.890841+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-14T12:44:14.890841+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.890841+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:33.495347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":548,"num_read_kb":8718,"num_write":1059,"num_write_kb":39714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'430","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.155332+0000","last_change":"2024-09-14T12:44:25.155332+0000","last_active":"2024-09-14T12:44:25.155332+0000","last_peered":"2024-09-14T12:44:25.155332+0000","last_clean":"2024-09-14T12:44:25.155332+0000","last_became_active":"2024-09-14T10:49:25.404189+0000","last_became_peered":"2024-09-14T10:49:25.404189+0000","last_unstale":"2024-09-14T12:44:25.155332+0000","last_undegraded":"2024-09-14T12:44:25.155332+0000","last_fullsized":"2024-09-14T12:44:25.155332+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-14T12:44:25.155091+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-14T12:44:25.155091+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.155091+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:47.356155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2519,"num_read_kb":2387,"num_write":515,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'405","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.416312+0000","last_change":"2024-09-14T12:44:15.416147+0000","last_active":"2024-09-14T12:44:15.416312+0000","last_peered":"2024-09-14T12:44:15.416312+0000","last_clean":"2024-09-14T12:44:15.416312+0000","last_became_active":"2024-09-14T10:49:23.353824+0000","last_became_peered":"2024-09-14T10:49:23.353824+0000","last_unstale":"2024-09-14T12:44:15.416312+0000","last_undegraded":"2024-09-14T12:44:15.416312+0000","last_fullsized":"2024-09-14T12:44:15.416312+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'405","last_scrub_stamp":"2024-09-14T12:44:15.415866+0000","last_deep_scrub":"267'405","last_deep_scrub_stamp":"2024-09-14T12:44:15.415866+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.415866+0000","objects_scrubbed":12,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:43.030406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":687,"num_read_kb":3209,"num_write":1301,"num_write_kb":30473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'1239","reported_seq":2952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.863432+0000","last_change":"2024-09-14T12:44:23.863432+0000","last_active":"2024-09-14T12:44:23.863432+0000","last_peered":"2024-09-14T12:44:23.863432+0000","last_clean":"2024-09-14T12:44:23.863432+0000","last_became_active":"2024-09-14T10:49:25.388008+0000","last_became_peered":"2024-09-14T10:49:25.388008+0000","last_unstale":"2024-09-14T12:44:23.863432+0000","last_undegraded":"2024-09-14T12:44:23.863432+0000","last_fullsized":"2024-09-14T12:44:23.863432+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1239","last_scrub_stamp":"2024-09-14T12:44:23.863231+0000","last_deep_scrub":"267'1239","last_deep_scrub_stamp":"2024-09-14T12:44:23.863231+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.863231+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:30.652457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5023,"num_write":1696,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'317","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.811876+0000","last_change":"2024-09-14T12:44:21.811716+0000","last_active":"2024-09-14T12:44:21.811876+0000","last_peered":"2024-09-14T12:44:21.811876+0000","last_clean":"2024-09-14T12:44:21.811876+0000","last_became_active":"2024-09-14T10:49:23.374194+0000","last_became_peered":"2024-09-14T10:49:23.374194+0000","last_unstale":"2024-09-14T12:44:21.811876+0000","last_undegraded":"2024-09-14T12:44:21.811876+0000","last_fullsized":"2024-09-14T12:44:21.811876+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-14T12:44:21.811471+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-14T12:44:21.811471+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.811471+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:14:34.008333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730149,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":30724,"num_write":962,"num_write_kb":46577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'766","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.970390+0000","last_change":"2024-09-14T12:44:30.970390+0000","last_active":"2024-09-14T12:44:30.970390+0000","last_peered":"2024-09-14T12:44:30.970390+0000","last_clean":"2024-09-14T12:44:30.970390+0000","last_became_active":"2024-09-14T10:49:25.395625+0000","last_became_peered":"2024-09-14T10:49:25.395625+0000","last_unstale":"2024-09-14T12:44:30.970390+0000","last_undegraded":"2024-09-14T12:44:30.970390+0000","last_fullsized":"2024-09-14T12:44:30.970390+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'766","last_scrub_stamp":"2024-09-14T12:44:30.970201+0000","last_deep_scrub":"267'766","last_deep_scrub_stamp":"2024-09-14T12:44:30.970201+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.970201+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:00.805728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3607,"num_read_kb":3221,"num_write":1031,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'928","reported_seq":2623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.642891+0000","last_change":"2024-09-14T12:44:31.642891+0000","last_active":"2024-09-14T12:44:31.642891+0000","last_peered":"2024-09-14T12:44:31.642891+0000","last_clean":"2024-09-14T12:44:31.642891+0000","last_became_active":"2024-09-14T10:49:25.377697+0000","last_became_peered":"2024-09-14T10:49:25.377697+0000","last_unstale":"2024-09-14T12:44:31.642891+0000","last_undegraded":"2024-09-14T12:44:31.642891+0000","last_fullsized":"2024-09-14T12:44:31.642891+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'928","last_scrub_stamp":"2024-09-14T12:44:31.642716+0000","last_deep_scrub":"267'928","last_deep_scrub_stamp":"2024-09-14T12:44:31.642716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.642716+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.252576+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4426,"num_read_kb":3954,"num_write":1251,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'319","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.982570+0000","last_change":"2024-09-14T12:44:14.982570+0000","last_active":"2024-09-14T12:44:14.982570+0000","last_peered":"2024-09-14T12:44:14.982570+0000","last_clean":"2024-09-14T12:44:14.982570+0000","last_became_active":"2024-09-14T10:49:23.395881+0000","last_became_peered":"2024-09-14T10:49:23.395881+0000","last_unstale":"2024-09-14T12:44:14.982570+0000","last_undegraded":"2024-09-14T12:44:14.982570+0000","last_fullsized":"2024-09-14T12:44:14.982570+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-14T12:44:14.982349+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-14T12:44:14.982349+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.982349+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.098578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":45321,"num_write":937,"num_write_kb":34104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'503","reported_seq":2246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.198419+0000","last_change":"2024-09-14T12:44:21.198419+0000","last_active":"2024-09-14T12:44:21.198419+0000","last_peered":"2024-09-14T12:44:21.198419+0000","last_clean":"2024-09-14T12:44:21.198419+0000","last_became_active":"2024-09-14T10:49:25.359419+0000","last_became_peered":"2024-09-14T10:49:25.359419+0000","last_unstale":"2024-09-14T12:44:21.198419+0000","last_undegraded":"2024-09-14T12:44:21.198419+0000","last_fullsized":"2024-09-14T12:44:21.198419+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'503","last_scrub_stamp":"2024-09-14T12:44:21.198212+0000","last_deep_scrub":"267'503","last_deep_scrub_stamp":"2024-09-14T12:44:21.198212+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.198212+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:09.718517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2958,"num_read_kb":2787,"num_write":621,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'335","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.375590+0000","last_change":"2024-09-14T12:44:17.375590+0000","last_active":"2024-09-14T12:44:17.375590+0000","last_peered":"2024-09-14T12:44:17.375590+0000","last_clean":"2024-09-14T12:44:17.375590+0000","last_became_active":"2024-09-14T10:49:23.372672+0000","last_became_peered":"2024-09-14T10:49:23.372672+0000","last_unstale":"2024-09-14T12:44:17.375590+0000","last_undegraded":"2024-09-14T12:44:17.375590+0000","last_fullsized":"2024-09-14T12:44:17.375590+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-14T12:44:17.375353+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-14T12:44:17.375353+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.375353+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:32.309861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":589,"num_read_kb":8965,"num_write":1037,"num_write_kb":20473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'402","reported_seq":1920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.005658+0000","last_change":"2024-09-14T12:44:21.005658+0000","last_active":"2024-09-14T12:44:21.005658+0000","last_peered":"2024-09-14T12:44:21.005658+0000","last_clean":"2024-09-14T12:44:21.005658+0000","last_became_active":"2024-09-14T10:49:25.403885+0000","last_became_peered":"2024-09-14T10:49:25.403885+0000","last_unstale":"2024-09-14T12:44:21.005658+0000","last_undegraded":"2024-09-14T12:44:21.005658+0000","last_fullsized":"2024-09-14T12:44:21.005658+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:21.005460+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:21.005460+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.005460+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:39.200942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2137,"num_read_kb":2023,"num_write":462,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'394","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.346147+0000","last_change":"2024-09-14T12:44:13.346147+0000","last_active":"2024-09-14T12:44:13.346147+0000","last_peered":"2024-09-14T12:44:13.346147+0000","last_clean":"2024-09-14T12:44:13.346147+0000","last_became_active":"2024-09-14T10:49:23.354127+0000","last_became_peered":"2024-09-14T10:49:23.354127+0000","last_unstale":"2024-09-14T12:44:13.346147+0000","last_undegraded":"2024-09-14T12:44:13.346147+0000","last_fullsized":"2024-09-14T12:44:13.346147+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'394","last_scrub_stamp":"2024-09-14T12:44:13.345931+0000","last_deep_scrub":"267'394","last_deep_scrub_stamp":"2024-09-14T12:44:13.345931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.345931+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:48.706335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":781,"num_read_kb":56952,"num_write":1264,"num_write_kb":28690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"267'805","reported_seq":2357,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.811470+0000","last_change":"2024-09-14T12:44:24.811470+0000","last_active":"2024-09-14T12:44:24.811470+0000","last_peered":"2024-09-14T12:44:24.811470+0000","last_clean":"2024-09-14T12:44:24.811470+0000","last_became_active":"2024-09-14T10:49:25.396001+0000","last_became_peered":"2024-09-14T10:49:25.396001+0000","last_unstale":"2024-09-14T12:44:24.811470+0000","last_undegraded":"2024-09-14T12:44:24.811470+0000","last_fullsized":"2024-09-14T12:44:24.811470+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'805","last_scrub_stamp":"2024-09-14T12:44:24.811267+0000","last_deep_scrub":"267'805","last_deep_scrub_stamp":"2024-09-14T12:44:24.811267+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.811267+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:43:01.444670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3888,"num_read_kb":3489,"num_write":1086,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1380,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'386","reported_seq":1183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.337240+0000","last_change":"2024-09-14T12:44:12.337240+0000","last_active":"2024-09-14T12:44:12.337240+0000","last_peered":"2024-09-14T12:44:12.337240+0000","last_clean":"2024-09-14T12:44:12.337240+0000","last_became_active":"2024-09-14T10:49:23.387292+0000","last_became_peered":"2024-09-14T10:49:23.387292+0000","last_unstale":"2024-09-14T12:44:12.337240+0000","last_undegraded":"2024-09-14T12:44:12.337240+0000","last_fullsized":"2024-09-14T12:44:12.337240+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T12:44:12.337076+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T12:44:12.337076+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.337076+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:05.269545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":721,"num_read_kb":37760,"num_write":1195,"num_write_kb":55114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'374","reported_seq":1811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.937851+0000","last_change":"2024-09-14T12:44:29.937851+0000","last_active":"2024-09-14T12:44:29.937851+0000","last_peered":"2024-09-14T12:44:29.937851+0000","last_clean":"2024-09-14T12:44:29.937851+0000","last_became_active":"2024-09-14T10:49:25.394106+0000","last_became_peered":"2024-09-14T10:49:25.394106+0000","last_unstale":"2024-09-14T12:44:29.937851+0000","last_undegraded":"2024-09-14T12:44:29.937851+0000","last_fullsized":"2024-09-14T12:44:29.937851+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:29.937641+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:29.937641+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.937641+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:07.766027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2013,"num_read_kb":1909,"num_write":433,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'428","reported_seq":1109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.764159+0000","last_change":"2024-09-14T12:44:17.764159+0000","last_active":"2024-09-14T12:44:17.764159+0000","last_peered":"2024-09-14T12:44:17.764159+0000","last_clean":"2024-09-14T12:44:17.764159+0000","last_became_active":"2024-09-14T10:49:23.364035+0000","last_became_peered":"2024-09-14T10:49:23.364035+0000","last_unstale":"2024-09-14T12:44:17.764159+0000","last_undegraded":"2024-09-14T12:44:17.764159+0000","last_fullsized":"2024-09-14T12:44:17.764159+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'428","last_scrub_stamp":"2024-09-14T12:44:17.763953+0000","last_deep_scrub":"267'428","last_deep_scrub_stamp":"2024-09-14T12:44:17.763953+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.763953+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:02.372941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":874,"num_read_kb":15225,"num_write":1232,"num_write_kb":26982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'781","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.009755+0000","last_change":"2024-09-14T12:44:22.009755+0000","last_active":"2024-09-14T12:44:22.009755+0000","last_peered":"2024-09-14T12:44:22.009755+0000","last_clean":"2024-09-14T12:44:22.009755+0000","last_became_active":"2024-09-14T10:49:25.371736+0000","last_became_peered":"2024-09-14T10:49:25.371736+0000","last_unstale":"2024-09-14T12:44:22.009755+0000","last_undegraded":"2024-09-14T12:44:22.009755+0000","last_fullsized":"2024-09-14T12:44:22.009755+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-14T12:44:22.009539+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-14T12:44:22.009539+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.009539+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:37.997398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3876,"num_read_kb":3539,"num_write":1018,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'324","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.754320+0000","last_change":"2024-09-14T12:44:19.754320+0000","last_active":"2024-09-14T12:44:19.754320+0000","last_peered":"2024-09-14T12:44:19.754320+0000","last_clean":"2024-09-14T12:44:19.754320+0000","last_became_active":"2024-09-14T10:49:23.378269+0000","last_became_peered":"2024-09-14T10:49:23.378269+0000","last_unstale":"2024-09-14T12:44:19.754320+0000","last_undegraded":"2024-09-14T12:44:19.754320+0000","last_fullsized":"2024-09-14T12:44:19.754320+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-14T12:44:19.754019+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-14T12:44:19.754019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.754019+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:31.083867+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":531,"num_read_kb":35954,"num_write":1090,"num_write_kb":39786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'146","reported_seq":689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.118227+0000","last_change":"2024-09-14T12:44:36.118227+0000","last_active":"2024-09-14T12:44:36.118227+0000","last_peered":"2024-09-14T12:44:36.118227+0000","last_clean":"2024-09-14T12:44:36.118227+0000","last_became_active":"2024-09-14T10:49:33.464427+0000","last_became_peered":"2024-09-14T10:49:33.464427+0000","last_unstale":"2024-09-14T12:44:36.118227+0000","last_undegraded":"2024-09-14T12:44:36.118227+0000","last_fullsized":"2024-09-14T12:44:36.118227+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-14T12:44:36.118026+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-14T12:44:36.118026+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.118026+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.250408+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":140,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'436","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.764177+0000","last_change":"2024-09-14T12:44:23.764177+0000","last_active":"2024-09-14T12:44:23.764177+0000","last_peered":"2024-09-14T12:44:23.764177+0000","last_clean":"2024-09-14T12:44:23.764177+0000","last_became_active":"2024-09-14T10:49:25.379409+0000","last_became_peered":"2024-09-14T10:49:25.379409+0000","last_unstale":"2024-09-14T12:44:23.764177+0000","last_undegraded":"2024-09-14T12:44:23.764177+0000","last_fullsized":"2024-09-14T12:44:23.764177+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'436","last_scrub_stamp":"2024-09-14T12:44:23.763977+0000","last_deep_scrub":"267'436","last_deep_scrub_stamp":"2024-09-14T12:44:23.763977+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.763977+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:39.979945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2548,"num_read_kb":2434,"num_write":516,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'355","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.685459+0000","last_change":"2024-09-14T12:44:21.685459+0000","last_active":"2024-09-14T12:44:21.685459+0000","last_peered":"2024-09-14T12:44:21.685459+0000","last_clean":"2024-09-14T12:44:21.685459+0000","last_became_active":"2024-09-14T10:49:23.365630+0000","last_became_peered":"2024-09-14T10:49:23.365630+0000","last_unstale":"2024-09-14T12:44:21.685459+0000","last_undegraded":"2024-09-14T12:44:21.685459+0000","last_fullsized":"2024-09-14T12:44:21.685459+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'355","last_scrub_stamp":"2024-09-14T12:44:21.685251+0000","last_deep_scrub":"267'355","last_deep_scrub_stamp":"2024-09-14T12:44:21.685251+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.685251+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:58.835156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":11787,"num_write":1186,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.657644+0000","last_change":"2024-09-14T12:44:41.657644+0000","last_active":"2024-09-14T12:44:41.657644+0000","last_peered":"2024-09-14T12:44:41.657644+0000","last_clean":"2024-09-14T12:44:41.657644+0000","last_became_active":"2024-09-14T10:49:27.387803+0000","last_became_peered":"2024-09-14T10:49:27.387803+0000","last_unstale":"2024-09-14T12:44:41.657644+0000","last_undegraded":"2024-09-14T12:44:41.657644+0000","last_fullsized":"2024-09-14T12:44:41.657644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.657431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.657431+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.657431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:59.045915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'393","reported_seq":1052,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.923884+0000","last_change":"2024-09-14T12:44:38.923884+0000","last_active":"2024-09-14T12:44:38.923884+0000","last_peered":"2024-09-14T12:44:38.923884+0000","last_clean":"2024-09-14T12:44:38.923884+0000","last_became_active":"2024-09-14T10:49:29.386799+0000","last_became_peered":"2024-09-14T10:49:29.386799+0000","last_unstale":"2024-09-14T12:44:38.923884+0000","last_undegraded":"2024-09-14T12:44:38.923884+0000","last_fullsized":"2024-09-14T12:44:38.923884+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'393","last_scrub_stamp":"2024-09-14T12:44:38.923710+0000","last_deep_scrub":"267'393","last_deep_scrub_stamp":"2024-09-14T12:44:38.923710+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.923710+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:34:45.084082+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":1248,"num_write":488,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.978310+0000","last_change":"2024-09-14T12:44:35.978310+0000","last_active":"2024-09-14T12:44:35.978310+0000","last_peered":"2024-09-14T12:44:35.978310+0000","last_clean":"2024-09-14T12:44:35.978310+0000","last_became_active":"2024-09-14T10:49:31.407831+0000","last_became_peered":"2024-09-14T10:49:31.407831+0000","last_unstale":"2024-09-14T12:44:35.978310+0000","last_undegraded":"2024-09-14T12:44:35.978310+0000","last_fullsized":"2024-09-14T12:44:35.978310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:35.978133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:35.978133+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.978133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:09.426844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'141","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.986180+0000","last_change":"2024-09-14T12:44:40.986180+0000","last_active":"2024-09-14T12:44:40.986180+0000","last_peered":"2024-09-14T12:44:40.986180+0000","last_clean":"2024-09-14T12:44:40.986180+0000","last_became_active":"2024-09-14T10:49:33.474458+0000","last_became_peered":"2024-09-14T10:49:33.474458+0000","last_unstale":"2024-09-14T12:44:40.986180+0000","last_undegraded":"2024-09-14T12:44:40.986180+0000","last_fullsized":"2024-09-14T12:44:40.986180+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T12:44:40.985995+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T12:44:40.985995+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.985995+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:08.181189+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":162,"num_write":341,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'696","reported_seq":2375,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.675073+0000","last_change":"2024-09-14T12:44:30.675073+0000","last_active":"2024-09-14T12:44:30.675073+0000","last_peered":"2024-09-14T12:44:30.675073+0000","last_clean":"2024-09-14T12:44:30.675073+0000","last_became_active":"2024-09-14T10:49:25.375112+0000","last_became_peered":"2024-09-14T10:49:25.375112+0000","last_unstale":"2024-09-14T12:44:30.675073+0000","last_undegraded":"2024-09-14T12:44:30.675073+0000","last_fullsized":"2024-09-14T12:44:30.675073+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'696","last_scrub_stamp":"2024-09-14T12:44:30.674832+0000","last_deep_scrub":"267'696","last_deep_scrub_stamp":"2024-09-14T12:44:30.674832+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.674832+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:57.902612+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3284,"num_write":889,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'444","reported_seq":1127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.709594+0000","last_change":"2024-09-14T12:44:13.709594+0000","last_active":"2024-09-14T12:44:13.709594+0000","last_peered":"2024-09-14T12:44:13.709594+0000","last_clean":"2024-09-14T12:44:13.709594+0000","last_became_active":"2024-09-14T10:49:23.384801+0000","last_became_peered":"2024-09-14T10:49:23.384801+0000","last_unstale":"2024-09-14T12:44:13.709594+0000","last_undegraded":"2024-09-14T12:44:13.709594+0000","last_fullsized":"2024-09-14T12:44:13.709594+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'444","last_scrub_stamp":"2024-09-14T12:44:13.709388+0000","last_deep_scrub":"267'444","last_deep_scrub_stamp":"2024-09-14T12:44:13.709388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.709388+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:35.749429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":748,"num_read_kb":6714,"num_write":1308,"num_write_kb":31721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.944680+0000","last_change":"2024-09-14T12:44:30.944680+0000","last_active":"2024-09-14T12:44:30.944680+0000","last_peered":"2024-09-14T12:44:30.944680+0000","last_clean":"2024-09-14T12:44:30.944680+0000","last_became_active":"2024-09-14T10:49:27.378702+0000","last_became_peered":"2024-09-14T10:49:27.378702+0000","last_unstale":"2024-09-14T12:44:30.944680+0000","last_undegraded":"2024-09-14T12:44:30.944680+0000","last_fullsized":"2024-09-14T12:44:30.944680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.944442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.944442+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.944442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:56.936931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'130","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.023597+0000","last_change":"2024-09-14T12:44:31.023597+0000","last_active":"2024-09-14T12:44:31.023597+0000","last_peered":"2024-09-14T12:44:31.023597+0000","last_clean":"2024-09-14T12:44:31.023597+0000","last_became_active":"2024-09-14T10:49:29.398354+0000","last_became_peered":"2024-09-14T10:49:29.398354+0000","last_unstale":"2024-09-14T12:44:31.023597+0000","last_undegraded":"2024-09-14T12:44:31.023597+0000","last_fullsized":"2024-09-14T12:44:31.023597+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'130","last_scrub_stamp":"2024-09-14T12:44:31.023398+0000","last_deep_scrub":"267'130","last_deep_scrub_stamp":"2024-09-14T12:44:31.023398+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.023398+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:28.834905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.956210+0000","last_change":"2024-09-14T12:44:34.956210+0000","last_active":"2024-09-14T12:44:34.956210+0000","last_peered":"2024-09-14T12:44:34.956210+0000","last_clean":"2024-09-14T12:44:34.956210+0000","last_became_active":"2024-09-14T10:49:31.433431+0000","last_became_peered":"2024-09-14T10:49:31.433431+0000","last_unstale":"2024-09-14T12:44:34.956210+0000","last_undegraded":"2024-09-14T12:44:34.956210+0000","last_fullsized":"2024-09-14T12:44:34.956210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:34.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:34.956037+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.956037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:10.177612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'120","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.860408+0000","last_change":"2024-09-14T12:44:39.860408+0000","last_active":"2024-09-14T12:44:39.860408+0000","last_peered":"2024-09-14T12:44:39.860408+0000","last_clean":"2024-09-14T12:44:39.860408+0000","last_became_active":"2024-09-14T10:49:33.463124+0000","last_became_peered":"2024-09-14T10:49:33.463124+0000","last_unstale":"2024-09-14T12:44:39.860408+0000","last_undegraded":"2024-09-14T12:44:39.860408+0000","last_fullsized":"2024-09-14T12:44:39.860408+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-14T12:44:39.860275+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-14T12:44:39.860275+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.860275+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:29.364501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'851","reported_seq":2509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.018574+0000","last_change":"2024-09-14T12:44:41.018574+0000","last_active":"2024-09-14T12:44:41.018574+0000","last_peered":"2024-09-14T12:44:41.018574+0000","last_clean":"2024-09-14T12:44:41.018574+0000","last_became_active":"2024-09-14T10:49:25.385678+0000","last_became_peered":"2024-09-14T10:49:25.385678+0000","last_unstale":"2024-09-14T12:44:41.018574+0000","last_undegraded":"2024-09-14T12:44:41.018574+0000","last_fullsized":"2024-09-14T12:44:41.018574+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-14T12:44:41.018389+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-14T12:44:41.018389+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.018389+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:48.677271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4238,"num_read_kb":3841,"num_write":1159,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'381","reported_seq":1285,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.727211+0000","last_change":"2024-09-14T12:44:17.727211+0000","last_active":"2024-09-14T12:44:17.727211+0000","last_peered":"2024-09-14T12:44:17.727211+0000","last_clean":"2024-09-14T12:44:17.727211+0000","last_became_active":"2024-09-14T10:49:23.371893+0000","last_became_peered":"2024-09-14T10:49:23.371893+0000","last_unstale":"2024-09-14T12:44:17.727211+0000","last_undegraded":"2024-09-14T12:44:17.727211+0000","last_fullsized":"2024-09-14T12:44:17.727211+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-09-14T12:44:17.726976+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-09-14T12:44:17.726976+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.726976+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:08.246693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1366,"num_read_kb":59405,"num_write":1145,"num_write_kb":37706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.992777+0000","last_change":"2024-09-14T12:44:31.992777+0000","last_active":"2024-09-14T12:44:31.992777+0000","last_peered":"2024-09-14T12:44:31.992777+0000","last_clean":"2024-09-14T12:44:31.992777+0000","last_became_active":"2024-09-14T10:49:27.379355+0000","last_became_peered":"2024-09-14T10:49:27.379355+0000","last_unstale":"2024-09-14T12:44:31.992777+0000","last_undegraded":"2024-09-14T12:44:31.992777+0000","last_fullsized":"2024-09-14T12:44:31.992777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.992552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.992552+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.992552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:34.780168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'186","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.944935+0000","last_change":"2024-09-14T12:44:37.944935+0000","last_active":"2024-09-14T12:44:37.944935+0000","last_peered":"2024-09-14T12:44:37.944935+0000","last_clean":"2024-09-14T12:44:37.944935+0000","last_became_active":"2024-09-14T10:49:29.386264+0000","last_became_peered":"2024-09-14T10:49:29.386264+0000","last_unstale":"2024-09-14T12:44:37.944935+0000","last_undegraded":"2024-09-14T12:44:37.944935+0000","last_fullsized":"2024-09-14T12:44:37.944935+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T12:44:37.944716+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T12:44:37.944716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.944716+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:13.665228+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'811","reported_seq":3030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.554145+0000","last_change":"2024-09-14T12:44:51.554145+0000","last_active":"2024-09-14T12:44:51.554145+0000","last_peered":"2024-09-14T12:44:51.554145+0000","last_clean":"2024-09-14T12:44:51.554145+0000","last_became_active":"2024-09-14T10:49:31.431702+0000","last_became_peered":"2024-09-14T10:49:31.431702+0000","last_unstale":"2024-09-14T12:44:51.554145+0000","last_undegraded":"2024-09-14T12:44:51.554145+0000","last_fullsized":"2024-09-14T12:44:51.554145+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'811","last_scrub_stamp":"2024-09-14T12:44:51.553913+0000","last_deep_scrub":"267'811","last_deep_scrub_stamp":"2024-09-14T12:44:51.553913+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.553913+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:09.844703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'218","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.048157+0000","last_change":"2024-09-14T12:44:38.048157+0000","last_active":"2024-09-14T12:44:38.048157+0000","last_peered":"2024-09-14T12:44:38.048157+0000","last_clean":"2024-09-14T12:44:38.048157+0000","last_became_active":"2024-09-14T10:49:33.472433+0000","last_became_peered":"2024-09-14T10:49:33.472433+0000","last_unstale":"2024-09-14T12:44:38.048157+0000","last_undegraded":"2024-09-14T12:44:38.048157+0000","last_fullsized":"2024-09-14T12:44:38.048157+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-14T12:44:38.047935+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-14T12:44:38.047935+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.047935+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:53.365245+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":612,"num_write":471,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'454","reported_seq":2023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.904764+0000","last_change":"2024-09-14T12:44:26.904764+0000","last_active":"2024-09-14T12:44:26.904764+0000","last_peered":"2024-09-14T12:44:26.904764+0000","last_clean":"2024-09-14T12:44:26.904764+0000","last_became_active":"2024-09-14T10:49:25.395255+0000","last_became_peered":"2024-09-14T10:49:25.395255+0000","last_unstale":"2024-09-14T12:44:26.904764+0000","last_undegraded":"2024-09-14T12:44:26.904764+0000","last_fullsized":"2024-09-14T12:44:26.904764+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-09-14T12:44:26.904534+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-09-14T12:44:26.904534+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.904534+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:00.169555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2444,"num_read_kb":2309,"num_write":533,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'370","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.932856+0000","last_change":"2024-09-14T12:44:10.932856+0000","last_active":"2024-09-14T12:44:10.932856+0000","last_peered":"2024-09-14T12:44:10.932856+0000","last_clean":"2024-09-14T12:44:10.932856+0000","last_became_active":"2024-09-14T10:49:23.403079+0000","last_became_peered":"2024-09-14T10:49:23.403079+0000","last_unstale":"2024-09-14T12:44:10.932856+0000","last_undegraded":"2024-09-14T12:44:10.932856+0000","last_fullsized":"2024-09-14T12:44:10.932856+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-14T12:44:10.932702+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-14T12:44:10.932702+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.932702+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.564642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":46335,"num_write":1122,"num_write_kb":49327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.643614+0000","last_change":"2024-09-14T12:44:40.643614+0000","last_active":"2024-09-14T12:44:40.643614+0000","last_peered":"2024-09-14T12:44:40.643614+0000","last_clean":"2024-09-14T12:44:40.643614+0000","last_became_active":"2024-09-14T10:49:27.391823+0000","last_became_peered":"2024-09-14T10:49:27.391823+0000","last_unstale":"2024-09-14T12:44:40.643614+0000","last_undegraded":"2024-09-14T12:44:40.643614+0000","last_fullsized":"2024-09-14T12:44:40.643614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:40.643389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:40.643389+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.643389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:52.890279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'329","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.928959+0000","last_change":"2024-09-14T12:44:27.928959+0000","last_active":"2024-09-14T12:44:27.928959+0000","last_peered":"2024-09-14T12:44:27.928959+0000","last_clean":"2024-09-14T12:44:27.928959+0000","last_became_active":"2024-09-14T10:49:29.385023+0000","last_became_peered":"2024-09-14T10:49:29.385023+0000","last_unstale":"2024-09-14T12:44:27.928959+0000","last_undegraded":"2024-09-14T12:44:27.928959+0000","last_fullsized":"2024-09-14T12:44:27.928959+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-09-14T12:44:27.928763+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-09-14T12:44:27.928763+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.928763+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:43.341736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":526,"num_read_kb":1146,"num_write":424,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'828","reported_seq":5670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.983482+0000","last_change":"2024-09-14T12:44:41.983482+0000","last_active":"2024-09-14T12:44:41.983482+0000","last_peered":"2024-09-14T12:44:41.983482+0000","last_clean":"2024-09-14T12:44:41.983482+0000","last_became_active":"2024-09-14T10:49:31.424873+0000","last_became_peered":"2024-09-14T10:49:31.424873+0000","last_unstale":"2024-09-14T12:44:41.983482+0000","last_undegraded":"2024-09-14T12:44:41.983482+0000","last_fullsized":"2024-09-14T12:44:41.983482+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'828","last_scrub_stamp":"2024-09-14T12:44:41.983295+0000","last_deep_scrub":"267'828","last_deep_scrub_stamp":"2024-09-14T12:44:41.983295+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.983295+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.782440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'494","reported_seq":2127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.609765+0000","last_change":"2024-09-14T12:44:28.609765+0000","last_active":"2024-09-14T12:44:28.609765+0000","last_peered":"2024-09-14T12:44:28.609765+0000","last_clean":"2024-09-14T12:44:28.609765+0000","last_became_active":"2024-09-14T10:49:25.372711+0000","last_became_peered":"2024-09-14T10:49:25.372711+0000","last_unstale":"2024-09-14T12:44:28.609765+0000","last_undegraded":"2024-09-14T12:44:28.609765+0000","last_fullsized":"2024-09-14T12:44:28.609765+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-09-14T12:44:28.609502+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-09-14T12:44:28.609502+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.609502+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:41.369304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2694,"num_read_kb":2523,"num_write":626,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'395","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.372090+0000","last_change":"2024-09-14T12:44:14.371801+0000","last_active":"2024-09-14T12:44:14.372090+0000","last_peered":"2024-09-14T12:44:14.372090+0000","last_clean":"2024-09-14T12:44:14.372090+0000","last_became_active":"2024-09-14T10:49:23.363126+0000","last_became_peered":"2024-09-14T10:49:23.363126+0000","last_unstale":"2024-09-14T12:44:14.372090+0000","last_undegraded":"2024-09-14T12:44:14.372090+0000","last_fullsized":"2024-09-14T12:44:14.372090+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T12:44:14.371349+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T12:44:14.371349+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.371349+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:18.212093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":10241,"num_write":1214,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.064863+0000","last_change":"2024-09-14T12:44:24.064863+0000","last_active":"2024-09-14T12:44:24.064863+0000","last_peered":"2024-09-14T12:44:24.064863+0000","last_clean":"2024-09-14T12:44:24.064863+0000","last_became_active":"2024-09-14T10:49:27.380063+0000","last_became_peered":"2024-09-14T10:49:27.380063+0000","last_unstale":"2024-09-14T12:44:24.064863+0000","last_undegraded":"2024-09-14T12:44:24.064863+0000","last_fullsized":"2024-09-14T12:44:24.064863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.064652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.064652+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.064652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.956294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'450","reported_seq":1164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.174305+0000","last_change":"2024-09-14T12:44:29.174135+0000","last_active":"2024-09-14T12:44:29.174305+0000","last_peered":"2024-09-14T12:44:29.174305+0000","last_clean":"2024-09-14T12:44:29.174305+0000","last_became_active":"2024-09-14T10:49:29.383306+0000","last_became_peered":"2024-09-14T10:49:29.383306+0000","last_unstale":"2024-09-14T12:44:29.174305+0000","last_undegraded":"2024-09-14T12:44:29.174305+0000","last_fullsized":"2024-09-14T12:44:29.174305+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'450","last_scrub_stamp":"2024-09-14T12:44:29.173918+0000","last_deep_scrub":"267'450","last_deep_scrub_stamp":"2024-09-14T12:44:29.173918+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.173918+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:13.227443+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48183,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":712,"num_read_kb":1289,"num_write":532,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.815772+0000","last_change":"2024-09-14T12:44:36.815772+0000","last_active":"2024-09-14T12:44:36.815772+0000","last_peered":"2024-09-14T12:44:36.815772+0000","last_clean":"2024-09-14T12:44:36.815772+0000","last_became_active":"2024-09-14T10:49:31.406293+0000","last_became_peered":"2024-09-14T10:49:31.406293+0000","last_unstale":"2024-09-14T12:44:36.815772+0000","last_undegraded":"2024-09-14T12:44:36.815772+0000","last_fullsized":"2024-09-14T12:44:36.815772+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.815598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.815598+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.815598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:31.878162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'565","reported_seq":1457,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.010449+0000","last_change":"2024-09-14T12:44:35.010449+0000","last_active":"2024-09-14T12:44:35.010449+0000","last_peered":"2024-09-14T12:44:35.010449+0000","last_clean":"2024-09-14T12:44:35.010449+0000","last_became_active":"2024-09-14T10:49:33.474412+0000","last_became_peered":"2024-09-14T10:49:33.474412+0000","last_unstale":"2024-09-14T12:44:35.010449+0000","last_undegraded":"2024-09-14T12:44:35.010449+0000","last_fullsized":"2024-09-14T12:44:35.010449+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'565","last_scrub_stamp":"2024-09-14T12:44:35.010246+0000","last_deep_scrub":"267'565","last_deep_scrub_stamp":"2024-09-14T12:44:35.010246+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.010246+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:11.291084+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1493,"num_read_kb":1442,"num_write":1188,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'447","reported_seq":2098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.951633+0000","last_change":"2024-09-14T12:44:15.951633+0000","last_active":"2024-09-14T12:44:15.951633+0000","last_peered":"2024-09-14T12:44:15.951633+0000","last_clean":"2024-09-14T12:44:15.951633+0000","last_became_active":"2024-09-14T10:49:25.405499+0000","last_became_peered":"2024-09-14T10:49:25.405499+0000","last_unstale":"2024-09-14T12:44:15.951633+0000","last_undegraded":"2024-09-14T12:44:15.951633+0000","last_fullsized":"2024-09-14T12:44:15.951633+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-14T12:44:15.951454+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-14T12:44:15.951454+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.951454+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:25.508784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2382,"num_write":513,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'382","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.840424+0000","last_change":"2024-09-14T12:44:10.840331+0000","last_active":"2024-09-14T12:44:10.840424+0000","last_peered":"2024-09-14T12:44:10.840424+0000","last_clean":"2024-09-14T12:44:10.840424+0000","last_became_active":"2024-09-14T10:49:23.403551+0000","last_became_peered":"2024-09-14T10:49:23.403551+0000","last_unstale":"2024-09-14T12:44:10.840424+0000","last_undegraded":"2024-09-14T12:44:10.840424+0000","last_fullsized":"2024-09-14T12:44:10.840424+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:10.840221+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:10.840221+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.840221+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:13.320242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":687,"num_read_kb":10639,"num_write":1239,"num_write_kb":29906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.862195+0000","last_change":"2024-09-14T12:44:27.862195+0000","last_active":"2024-09-14T12:44:27.862195+0000","last_peered":"2024-09-14T12:44:27.862195+0000","last_clean":"2024-09-14T12:44:27.862195+0000","last_became_active":"2024-09-14T10:49:27.372510+0000","last_became_peered":"2024-09-14T10:49:27.372510+0000","last_unstale":"2024-09-14T12:44:27.862195+0000","last_undegraded":"2024-09-14T12:44:27.862195+0000","last_fullsized":"2024-09-14T12:44:27.862195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.862002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.862002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.862002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:27.731328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'308","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.038911+0000","last_change":"2024-09-14T12:44:36.038911+0000","last_active":"2024-09-14T12:44:36.038911+0000","last_peered":"2024-09-14T12:44:36.038911+0000","last_clean":"2024-09-14T12:44:36.038911+0000","last_became_active":"2024-09-14T10:49:29.377710+0000","last_became_peered":"2024-09-14T10:49:29.377710+0000","last_unstale":"2024-09-14T12:44:36.038911+0000","last_undegraded":"2024-09-14T12:44:36.038911+0000","last_fullsized":"2024-09-14T12:44:36.038911+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-14T12:44:36.038695+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-14T12:44:36.038695+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.038695+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:18.848861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45337,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1057,"num_write":388,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.881847+0000","last_change":"2024-09-14T12:44:42.881589+0000","last_active":"2024-09-14T12:44:42.881847+0000","last_peered":"2024-09-14T12:44:42.881847+0000","last_clean":"2024-09-14T12:44:42.881847+0000","last_became_active":"2024-09-14T10:49:31.412080+0000","last_became_peered":"2024-09-14T10:49:31.412080+0000","last_unstale":"2024-09-14T12:44:42.881847+0000","last_undegraded":"2024-09-14T12:44:42.881847+0000","last_fullsized":"2024-09-14T12:44:42.881847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:42.881388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:42.881388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.881388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:23.959186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2530","reported_seq":4399,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.938060+0000","last_change":"2024-09-14T12:44:37.938060+0000","last_active":"2024-09-14T12:44:37.938060+0000","last_peered":"2024-09-14T12:44:37.938060+0000","last_clean":"2024-09-14T12:44:37.938060+0000","last_became_active":"2024-09-14T10:49:33.478542+0000","last_became_peered":"2024-09-14T10:49:33.478542+0000","last_unstale":"2024-09-14T12:44:37.938060+0000","last_undegraded":"2024-09-14T12:44:37.938060+0000","last_fullsized":"2024-09-14T12:44:37.938060+0000","mapping_epoch":36,"log_start":"267'2500","ondisk_log_start":"267'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2530","last_scrub_stamp":"2024-09-14T12:44:37.937880+0000","last_deep_scrub":"267'2530","last_deep_scrub_stamp":"2024-09-14T12:44:37.937880+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.937880+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":2500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:26.283421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6246,"num_read_kb":6243,"num_write":5128,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'501","reported_seq":2192,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.884793+0000","last_change":"2024-09-14T12:44:16.884652+0000","last_active":"2024-09-14T12:44:16.884793+0000","last_peered":"2024-09-14T12:44:16.884793+0000","last_clean":"2024-09-14T12:44:16.884793+0000","last_became_active":"2024-09-14T10:49:25.380967+0000","last_became_peered":"2024-09-14T10:49:25.380967+0000","last_unstale":"2024-09-14T12:44:16.884793+0000","last_undegraded":"2024-09-14T12:44:16.884793+0000","last_fullsized":"2024-09-14T12:44:16.884793+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'501","last_scrub_stamp":"2024-09-14T12:44:16.884453+0000","last_deep_scrub":"267'501","last_deep_scrub_stamp":"2024-09-14T12:44:16.884453+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.884453+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:11.460810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2697,"num_read_kb":2531,"num_write":585,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'361","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.727178+0000","last_change":"2024-09-14T12:44:16.727178+0000","last_active":"2024-09-14T12:44:16.727178+0000","last_peered":"2024-09-14T12:44:16.727178+0000","last_clean":"2024-09-14T12:44:16.727178+0000","last_became_active":"2024-09-14T10:49:23.355809+0000","last_became_peered":"2024-09-14T10:49:23.355809+0000","last_unstale":"2024-09-14T12:44:16.727178+0000","last_undegraded":"2024-09-14T12:44:16.727178+0000","last_fullsized":"2024-09-14T12:44:16.727178+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-09-14T12:44:16.726929+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-09-14T12:44:16.726929+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.726929+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:07.328476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":12441,"num_write":1183,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.993910+0000","last_change":"2024-09-14T12:44:31.993910+0000","last_active":"2024-09-14T12:44:31.993910+0000","last_peered":"2024-09-14T12:44:31.993910+0000","last_clean":"2024-09-14T12:44:31.993910+0000","last_became_active":"2024-09-14T10:49:27.378028+0000","last_became_peered":"2024-09-14T10:49:27.378028+0000","last_unstale":"2024-09-14T12:44:31.993910+0000","last_undegraded":"2024-09-14T12:44:31.993910+0000","last_fullsized":"2024-09-14T12:44:31.993910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.993720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.993720+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.993720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:52.847388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'406","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.586823+0000","last_change":"2024-09-14T12:44:46.586823+0000","last_active":"2024-09-14T12:44:46.586823+0000","last_peered":"2024-09-14T12:44:46.586823+0000","last_clean":"2024-09-14T12:44:46.586823+0000","last_became_active":"2024-09-14T10:49:29.388786+0000","last_became_peered":"2024-09-14T10:49:29.388786+0000","last_unstale":"2024-09-14T12:44:46.586823+0000","last_undegraded":"2024-09-14T12:44:46.586823+0000","last_fullsized":"2024-09-14T12:44:46.586823+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'406","last_scrub_stamp":"2024-09-14T12:44:46.586612+0000","last_deep_scrub":"267'406","last_deep_scrub_stamp":"2024-09-14T12:44:46.586612+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.586612+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:21.570016+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53040,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":1302,"num_write":504,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'827","reported_seq":3431,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.012656+0000","last_change":"2024-09-14T12:44:39.012656+0000","last_active":"2024-09-14T12:44:39.012656+0000","last_peered":"2024-09-14T12:44:39.012656+0000","last_clean":"2024-09-14T12:44:39.012656+0000","last_became_active":"2024-09-14T10:49:31.420178+0000","last_became_peered":"2024-09-14T10:49:31.420178+0000","last_unstale":"2024-09-14T12:44:39.012656+0000","last_undegraded":"2024-09-14T12:44:39.012656+0000","last_fullsized":"2024-09-14T12:44:39.012656+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-14T12:44:39.012452+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-14T12:44:39.012452+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.012452+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:19.983480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'145","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.890373+0000","last_change":"2024-09-14T12:44:38.890373+0000","last_active":"2024-09-14T12:44:38.890373+0000","last_peered":"2024-09-14T12:44:38.890373+0000","last_clean":"2024-09-14T12:44:38.890373+0000","last_became_active":"2024-09-14T10:49:33.462780+0000","last_became_peered":"2024-09-14T10:49:33.462780+0000","last_unstale":"2024-09-14T12:44:38.890373+0000","last_undegraded":"2024-09-14T12:44:38.890373+0000","last_fullsized":"2024-09-14T12:44:38.890373+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'145","last_scrub_stamp":"2024-09-14T12:44:38.890156+0000","last_deep_scrub":"267'145","last_deep_scrub_stamp":"2024-09-14T12:44:38.890156+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.890156+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:15.024191+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'837","reported_seq":2447,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.916505+0000","last_change":"2024-09-14T12:44:25.916505+0000","last_active":"2024-09-14T12:44:25.916505+0000","last_peered":"2024-09-14T12:44:25.916505+0000","last_clean":"2024-09-14T12:44:25.916505+0000","last_became_active":"2024-09-14T10:49:25.389567+0000","last_became_peered":"2024-09-14T10:49:25.389567+0000","last_unstale":"2024-09-14T12:44:25.916505+0000","last_undegraded":"2024-09-14T12:44:25.916505+0000","last_fullsized":"2024-09-14T12:44:25.916505+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'837","last_scrub_stamp":"2024-09-14T12:44:25.916317+0000","last_deep_scrub":"267'837","last_deep_scrub_stamp":"2024-09-14T12:44:25.916317+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.916317+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:29.573496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4051,"num_read_kb":3641,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'382","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.406612+0000","last_change":"2024-09-14T12:44:09.406557+0000","last_active":"2024-09-14T12:44:09.406612+0000","last_peered":"2024-09-14T12:44:09.406612+0000","last_clean":"2024-09-14T12:44:09.406612+0000","last_became_active":"2024-09-14T10:49:23.354452+0000","last_became_peered":"2024-09-14T10:49:23.354452+0000","last_unstale":"2024-09-14T12:44:09.406612+0000","last_undegraded":"2024-09-14T12:44:09.406612+0000","last_fullsized":"2024-09-14T12:44:09.406612+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.406462+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:33.958379+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":20994,"num_write":1147,"num_write_kb":31512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.899948+0000","last_change":"2024-09-14T12:44:26.899729+0000","last_active":"2024-09-14T12:44:26.899948+0000","last_peered":"2024-09-14T12:44:26.899948+0000","last_clean":"2024-09-14T12:44:26.899948+0000","last_became_active":"2024-09-14T10:49:27.353932+0000","last_became_peered":"2024-09-14T10:49:27.353932+0000","last_unstale":"2024-09-14T12:44:26.899948+0000","last_undegraded":"2024-09-14T12:44:26.899948+0000","last_fullsized":"2024-09-14T12:44:26.899948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:26.899467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:26.899467+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.899467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:14.438303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'503","reported_seq":1195,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.053915+0000","last_change":"2024-09-14T12:44:34.053915+0000","last_active":"2024-09-14T12:44:34.053915+0000","last_peered":"2024-09-14T12:44:34.053915+0000","last_clean":"2024-09-14T12:44:34.053915+0000","last_became_active":"2024-09-14T10:49:29.378107+0000","last_became_peered":"2024-09-14T10:49:29.378107+0000","last_unstale":"2024-09-14T12:44:34.053915+0000","last_undegraded":"2024-09-14T12:44:34.053915+0000","last_fullsized":"2024-09-14T12:44:34.053915+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'503","last_scrub_stamp":"2024-09-14T12:44:34.053712+0000","last_deep_scrub":"267'503","last_deep_scrub_stamp":"2024-09-14T12:44:34.053712+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.053712+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:25:12.264177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89831,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":1885,"num_write":676,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.972942+0000","last_change":"2024-09-14T12:44:37.972942+0000","last_active":"2024-09-14T12:44:37.972942+0000","last_peered":"2024-09-14T12:44:37.972942+0000","last_clean":"2024-09-14T12:44:37.972942+0000","last_became_active":"2024-09-14T10:49:31.409247+0000","last_became_peered":"2024-09-14T10:49:31.409247+0000","last_unstale":"2024-09-14T12:44:37.972942+0000","last_undegraded":"2024-09-14T12:44:37.972942+0000","last_fullsized":"2024-09-14T12:44:37.972942+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:37.972763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:37.972763+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.972763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:48.217769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'133","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.427624+0000","last_change":"2024-09-14T12:44:35.427624+0000","last_active":"2024-09-14T12:44:35.427624+0000","last_peered":"2024-09-14T12:44:35.427624+0000","last_clean":"2024-09-14T12:44:35.427624+0000","last_became_active":"2024-09-14T10:49:33.461635+0000","last_became_peered":"2024-09-14T10:49:33.461635+0000","last_unstale":"2024-09-14T12:44:35.427624+0000","last_undegraded":"2024-09-14T12:44:35.427624+0000","last_fullsized":"2024-09-14T12:44:35.427624+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'133","last_scrub_stamp":"2024-09-14T12:44:35.427419+0000","last_deep_scrub":"267'133","last_deep_scrub_stamp":"2024-09-14T12:44:35.427419+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.427419+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:00.864229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":314,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'839","reported_seq":2540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.408128+0000","last_change":"2024-09-14T12:44:16.408128+0000","last_active":"2024-09-14T12:44:16.408128+0000","last_peered":"2024-09-14T12:44:16.408128+0000","last_clean":"2024-09-14T12:44:16.408128+0000","last_became_active":"2024-09-14T10:49:25.361148+0000","last_became_peered":"2024-09-14T10:49:25.361148+0000","last_unstale":"2024-09-14T12:44:16.408128+0000","last_undegraded":"2024-09-14T12:44:16.408128+0000","last_fullsized":"2024-09-14T12:44:16.408128+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-09-14T12:44:16.407940+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-09-14T12:44:16.407940+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.407940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:23.435248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4070,"num_read_kb":3684,"num_write":1107,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'346","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.668424+0000","last_change":"2024-09-14T12:44:12.668424+0000","last_active":"2024-09-14T12:44:12.668424+0000","last_peered":"2024-09-14T12:44:12.668424+0000","last_clean":"2024-09-14T12:44:12.668424+0000","last_became_active":"2024-09-14T10:49:23.375005+0000","last_became_peered":"2024-09-14T10:49:23.375005+0000","last_unstale":"2024-09-14T12:44:12.668424+0000","last_undegraded":"2024-09-14T12:44:12.668424+0000","last_fullsized":"2024-09-14T12:44:12.668424+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-14T12:44:12.668139+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-14T12:44:12.668139+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.668139+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:32.312612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":716,"num_read_kb":12064,"num_write":1099,"num_write_kb":35066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.438078+0000","last_change":"2024-09-14T12:44:24.438078+0000","last_active":"2024-09-14T12:44:24.438078+0000","last_peered":"2024-09-14T12:44:24.438078+0000","last_clean":"2024-09-14T12:44:24.438078+0000","last_became_active":"2024-09-14T10:49:27.385658+0000","last_became_peered":"2024-09-14T10:49:27.385658+0000","last_unstale":"2024-09-14T12:44:24.438078+0000","last_undegraded":"2024-09-14T12:44:24.438078+0000","last_fullsized":"2024-09-14T12:44:24.438078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.437896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.437896+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.437896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:21.541048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'372","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.049012+0000","last_change":"2024-09-14T12:44:30.049012+0000","last_active":"2024-09-14T12:44:30.049012+0000","last_peered":"2024-09-14T12:44:30.049012+0000","last_clean":"2024-09-14T12:44:30.049012+0000","last_became_active":"2024-09-14T10:49:29.388618+0000","last_became_peered":"2024-09-14T10:49:29.388618+0000","last_unstale":"2024-09-14T12:44:30.049012+0000","last_undegraded":"2024-09-14T12:44:30.049012+0000","last_fullsized":"2024-09-14T12:44:30.049012+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-09-14T12:44:30.048826+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-09-14T12:44:30.048826+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.048826+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:35.349305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53436,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":1275,"num_write":534,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17022,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.413073+0000","last_change":"2024-09-14T12:44:31.412920+0000","last_active":"2024-09-14T12:44:31.413073+0000","last_peered":"2024-09-14T12:44:31.413073+0000","last_clean":"2024-09-14T12:44:31.413073+0000","last_became_active":"2024-09-14T10:49:31.417797+0000","last_became_peered":"2024-09-14T10:49:31.417797+0000","last_unstale":"2024-09-14T12:44:31.413073+0000","last_undegraded":"2024-09-14T12:44:31.413073+0000","last_fullsized":"2024-09-14T12:44:31.413073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.412741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.412741+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.412741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:44.652617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'117","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.958123+0000","last_change":"2024-09-14T12:44:42.958123+0000","last_active":"2024-09-14T12:44:42.958123+0000","last_peered":"2024-09-14T12:44:42.958123+0000","last_clean":"2024-09-14T12:44:42.958123+0000","last_became_active":"2024-09-14T10:49:33.455162+0000","last_became_peered":"2024-09-14T10:49:33.455162+0000","last_unstale":"2024-09-14T12:44:42.958123+0000","last_undegraded":"2024-09-14T12:44:42.958123+0000","last_fullsized":"2024-09-14T12:44:42.958123+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-14T12:44:42.957920+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-14T12:44:42.957920+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.957920+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:03.610267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'591","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.638678+0000","last_change":"2024-09-14T12:44:29.638678+0000","last_active":"2024-09-14T12:44:29.638678+0000","last_peered":"2024-09-14T12:44:29.638678+0000","last_clean":"2024-09-14T12:44:29.638678+0000","last_became_active":"2024-09-14T10:49:25.377866+0000","last_became_peered":"2024-09-14T10:49:25.377866+0000","last_unstale":"2024-09-14T12:44:29.638678+0000","last_undegraded":"2024-09-14T12:44:29.638678+0000","last_fullsized":"2024-09-14T12:44:29.638678+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'591","last_scrub_stamp":"2024-09-14T12:44:29.638497+0000","last_deep_scrub":"267'591","last_deep_scrub_stamp":"2024-09-14T12:44:29.638497+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.638497+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:43.254748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3293,"num_read_kb":3082,"num_write":722,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3260,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'319","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.689360+0000","last_change":"2024-09-14T12:44:18.689208+0000","last_active":"2024-09-14T12:44:18.689360+0000","last_peered":"2024-09-14T12:44:18.689360+0000","last_clean":"2024-09-14T12:44:18.689360+0000","last_became_active":"2024-09-14T10:49:23.362203+0000","last_became_peered":"2024-09-14T10:49:23.362203+0000","last_unstale":"2024-09-14T12:44:18.689360+0000","last_undegraded":"2024-09-14T12:44:18.689360+0000","last_fullsized":"2024-09-14T12:44:18.689360+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-14T12:44:18.688974+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-14T12:44:18.688974+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.688974+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:03.279044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":29276,"num_write":1000,"num_write_kb":13260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.956328+0000","last_change":"2024-09-14T12:44:36.956328+0000","last_active":"2024-09-14T12:44:36.956328+0000","last_peered":"2024-09-14T12:44:36.956328+0000","last_clean":"2024-09-14T12:44:36.956328+0000","last_became_active":"2024-09-14T10:49:27.377674+0000","last_became_peered":"2024-09-14T10:49:27.377674+0000","last_unstale":"2024-09-14T12:44:36.956328+0000","last_undegraded":"2024-09-14T12:44:36.956328+0000","last_fullsized":"2024-09-14T12:44:36.956328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.956150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.956150+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.956150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:45.120719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'402","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.068633+0000","last_change":"2024-09-14T12:44:34.068537+0000","last_active":"2024-09-14T12:44:34.068633+0000","last_peered":"2024-09-14T12:44:34.068633+0000","last_clean":"2024-09-14T12:44:34.068633+0000","last_became_active":"2024-09-14T10:49:29.393350+0000","last_became_peered":"2024-09-14T10:49:29.393350+0000","last_unstale":"2024-09-14T12:44:34.068633+0000","last_undegraded":"2024-09-14T12:44:34.068633+0000","last_fullsized":"2024-09-14T12:44:34.068633+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:34.068404+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:34.068404+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.068404+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:20.895132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50275,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":654,"num_read_kb":1334,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'794","reported_seq":5235,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.443351+0000","last_change":"2024-09-14T12:44:29.443351+0000","last_active":"2024-09-14T12:44:29.443351+0000","last_peered":"2024-09-14T12:44:29.443351+0000","last_clean":"2024-09-14T12:44:29.443351+0000","last_became_active":"2024-09-14T10:49:31.422534+0000","last_became_peered":"2024-09-14T10:49:31.422534+0000","last_unstale":"2024-09-14T12:44:29.443351+0000","last_undegraded":"2024-09-14T12:44:29.443351+0000","last_fullsized":"2024-09-14T12:44:29.443351+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'794","last_scrub_stamp":"2024-09-14T12:44:29.443166+0000","last_deep_scrub":"267'794","last_deep_scrub_stamp":"2024-09-14T12:44:29.443166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.443166+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.967521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'162","reported_seq":742,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.867490+0000","last_change":"2024-09-14T12:44:37.867490+0000","last_active":"2024-09-14T12:44:37.867490+0000","last_peered":"2024-09-14T12:44:37.867490+0000","last_clean":"2024-09-14T12:44:37.867490+0000","last_became_active":"2024-09-14T10:49:33.466024+0000","last_became_peered":"2024-09-14T10:49:33.466024+0000","last_unstale":"2024-09-14T12:44:37.867490+0000","last_undegraded":"2024-09-14T12:44:37.867490+0000","last_fullsized":"2024-09-14T12:44:37.867490+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-14T12:44:37.867287+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-14T12:44:37.867287+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.867287+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:21.080474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":335,"num_read_kb":285,"num_write":383,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'673","reported_seq":2400,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.795938+0000","last_change":"2024-09-14T12:44:19.795938+0000","last_active":"2024-09-14T12:44:19.795938+0000","last_peered":"2024-09-14T12:44:19.795938+0000","last_clean":"2024-09-14T12:44:19.795938+0000","last_became_active":"2024-09-14T10:49:25.380712+0000","last_became_peered":"2024-09-14T10:49:25.380712+0000","last_unstale":"2024-09-14T12:44:19.795938+0000","last_undegraded":"2024-09-14T12:44:19.795938+0000","last_fullsized":"2024-09-14T12:44:19.795938+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'673","last_scrub_stamp":"2024-09-14T12:44:19.795731+0000","last_deep_scrub":"267'673","last_deep_scrub_stamp":"2024-09-14T12:44:19.795731+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.795731+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:58.049805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3719,"num_read_kb":3469,"num_write":935,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'349","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.741343+0000","last_change":"2024-09-14T12:44:14.741194+0000","last_active":"2024-09-14T12:44:14.741343+0000","last_peered":"2024-09-14T12:44:14.741343+0000","last_clean":"2024-09-14T12:44:14.741343+0000","last_became_active":"2024-09-14T10:49:23.367200+0000","last_became_peered":"2024-09-14T10:49:23.367200+0000","last_unstale":"2024-09-14T12:44:14.741343+0000","last_undegraded":"2024-09-14T12:44:14.741343+0000","last_fullsized":"2024-09-14T12:44:14.741343+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-14T12:44:14.740931+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-14T12:44:14.740931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.740931+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:26.381621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":77246,"num_write":1147,"num_write_kb":38780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.043751+0000","last_change":"2024-09-14T12:44:26.043611+0000","last_active":"2024-09-14T12:44:26.043751+0000","last_peered":"2024-09-14T12:44:26.043751+0000","last_clean":"2024-09-14T12:44:26.043751+0000","last_became_active":"2024-09-14T10:49:27.379952+0000","last_became_peered":"2024-09-14T10:49:27.379952+0000","last_unstale":"2024-09-14T12:44:26.043751+0000","last_undegraded":"2024-09-14T12:44:26.043751+0000","last_fullsized":"2024-09-14T12:44:26.043751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:26.043404+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:26.043404+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.043404+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:43.208508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'146","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.825188+0000","last_change":"2024-09-14T12:44:29.825188+0000","last_active":"2024-09-14T12:44:29.825188+0000","last_peered":"2024-09-14T12:44:29.825188+0000","last_clean":"2024-09-14T12:44:29.825188+0000","last_became_active":"2024-09-14T10:49:29.371803+0000","last_became_peered":"2024-09-14T10:49:29.371803+0000","last_unstale":"2024-09-14T12:44:29.825188+0000","last_undegraded":"2024-09-14T12:44:29.825188+0000","last_fullsized":"2024-09-14T12:44:29.825188+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-14T12:44:29.824972+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-14T12:44:29.824972+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.824972+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:03.803486+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'797","reported_seq":3155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.986093+0000","last_change":"2024-09-14T12:44:31.986093+0000","last_active":"2024-09-14T12:44:31.986093+0000","last_peered":"2024-09-14T12:44:31.986093+0000","last_clean":"2024-09-14T12:44:31.986093+0000","last_became_active":"2024-09-14T10:49:31.427179+0000","last_became_peered":"2024-09-14T10:49:31.427179+0000","last_unstale":"2024-09-14T12:44:31.986093+0000","last_undegraded":"2024-09-14T12:44:31.986093+0000","last_fullsized":"2024-09-14T12:44:31.986093+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'797","last_scrub_stamp":"2024-09-14T12:44:31.985911+0000","last_deep_scrub":"267'797","last_deep_scrub_stamp":"2024-09-14T12:44:31.985911+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.985911+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:03.033127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.022592+0000","last_change":"2024-09-14T12:44:34.022592+0000","last_active":"2024-09-14T12:44:34.022592+0000","last_peered":"2024-09-14T12:44:34.022592+0000","last_clean":"2024-09-14T12:44:34.022592+0000","last_became_active":"2024-09-14T10:49:33.468831+0000","last_became_peered":"2024-09-14T10:49:33.468831+0000","last_unstale":"2024-09-14T12:44:34.022592+0000","last_undegraded":"2024-09-14T12:44:34.022592+0000","last_fullsized":"2024-09-14T12:44:34.022592+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T12:44:34.022405+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T12:44:34.022405+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.022405+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:24.580048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":148,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'488","reported_seq":2230,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.501840+0000","last_change":"2024-09-14T12:44:19.501701+0000","last_active":"2024-09-14T12:44:19.501840+0000","last_peered":"2024-09-14T12:44:19.501840+0000","last_clean":"2024-09-14T12:44:19.501840+0000","last_became_active":"2024-09-14T10:49:25.370649+0000","last_became_peered":"2024-09-14T10:49:25.370649+0000","last_unstale":"2024-09-14T12:44:19.501840+0000","last_undegraded":"2024-09-14T12:44:19.501840+0000","last_fullsized":"2024-09-14T12:44:19.501840+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'488","last_scrub_stamp":"2024-09-14T12:44:19.501488+0000","last_deep_scrub":"267'488","last_deep_scrub_stamp":"2024-09-14T12:44:19.501488+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.501488+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:41.258394+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2839,"num_read_kb":2682,"num_write":610,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'390","reported_seq":1121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.742825+0000","last_change":"2024-09-14T12:44:12.742681+0000","last_active":"2024-09-14T12:44:12.742825+0000","last_peered":"2024-09-14T12:44:12.742825+0000","last_clean":"2024-09-14T12:44:12.742825+0000","last_became_active":"2024-09-14T10:49:23.355864+0000","last_became_peered":"2024-09-14T10:49:23.355864+0000","last_unstale":"2024-09-14T12:44:12.742825+0000","last_undegraded":"2024-09-14T12:44:12.742825+0000","last_fullsized":"2024-09-14T12:44:12.742825+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-09-14T12:44:12.742461+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-09-14T12:44:12.742461+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.742461+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:50.949947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":100725,"num_write":1103,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.620062+0000","last_change":"2024-09-14T12:44:37.620062+0000","last_active":"2024-09-14T12:44:37.620062+0000","last_peered":"2024-09-14T12:44:37.620062+0000","last_clean":"2024-09-14T12:44:37.620062+0000","last_became_active":"2024-09-14T10:49:27.390169+0000","last_became_peered":"2024-09-14T10:49:27.390169+0000","last_unstale":"2024-09-14T12:44:37.620062+0000","last_undegraded":"2024-09-14T12:44:37.620062+0000","last_fullsized":"2024-09-14T12:44:37.620062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:37.619874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:37.619874+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.619874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:51.304924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'426","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.059437+0000","last_change":"2024-09-14T12:44:29.059437+0000","last_active":"2024-09-14T12:44:29.059437+0000","last_peered":"2024-09-14T12:44:29.059437+0000","last_clean":"2024-09-14T12:44:29.059437+0000","last_became_active":"2024-09-14T10:49:29.400776+0000","last_became_peered":"2024-09-14T10:49:29.400776+0000","last_unstale":"2024-09-14T12:44:29.059437+0000","last_undegraded":"2024-09-14T12:44:29.059437+0000","last_fullsized":"2024-09-14T12:44:29.059437+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'426","last_scrub_stamp":"2024-09-14T12:44:29.059340+0000","last_deep_scrub":"267'426","last_deep_scrub_stamp":"2024-09-14T12:44:29.059340+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.059340+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:24.036786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1253,"num_write":514,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.968293+0000","last_change":"2024-09-14T12:44:29.968293+0000","last_active":"2024-09-14T12:44:29.968293+0000","last_peered":"2024-09-14T12:44:29.968293+0000","last_clean":"2024-09-14T12:44:29.968293+0000","last_became_active":"2024-09-14T10:49:31.418131+0000","last_became_peered":"2024-09-14T10:49:31.418131+0000","last_unstale":"2024-09-14T12:44:29.968293+0000","last_undegraded":"2024-09-14T12:44:29.968293+0000","last_fullsized":"2024-09-14T12:44:29.968293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:29.968107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:29.968107+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.968107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:34.481689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'141","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.476950+0000","last_change":"2024-09-14T12:44:34.476950+0000","last_active":"2024-09-14T12:44:34.476950+0000","last_peered":"2024-09-14T12:44:34.476950+0000","last_clean":"2024-09-14T12:44:34.476950+0000","last_became_active":"2024-09-14T10:49:33.455953+0000","last_became_peered":"2024-09-14T10:49:33.455953+0000","last_unstale":"2024-09-14T12:44:34.476950+0000","last_undegraded":"2024-09-14T12:44:34.476950+0000","last_fullsized":"2024-09-14T12:44:34.476950+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T12:44:34.476728+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T12:44:34.476728+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.476728+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:18.465980+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":155,"num_write":340,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'414","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.634493+0000","last_change":"2024-09-14T12:44:27.634493+0000","last_active":"2024-09-14T12:44:27.634493+0000","last_peered":"2024-09-14T12:44:27.634493+0000","last_clean":"2024-09-14T12:44:27.634493+0000","last_became_active":"2024-09-14T10:49:25.377841+0000","last_became_peered":"2024-09-14T10:49:25.377841+0000","last_unstale":"2024-09-14T12:44:27.634493+0000","last_undegraded":"2024-09-14T12:44:27.634493+0000","last_fullsized":"2024-09-14T12:44:27.634493+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-14T12:44:27.634299+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-14T12:44:27.634299+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.634299+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:58.860140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2397,"num_read_kb":2304,"num_write":471,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.886990+0000","last_change":"2024-09-14T12:44:09.886990+0000","last_active":"2024-09-14T12:44:09.886990+0000","last_peered":"2024-09-14T12:44:09.886990+0000","last_clean":"2024-09-14T12:44:09.886990+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T12:44:09.886990+0000","last_undegraded":"2024-09-14T12:44:09.886990+0000","last_fullsized":"2024-09-14T12:44:09.886990+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.886874+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:32.555870+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.693554+0000","last_change":"2024-09-14T12:44:11.693554+0000","last_active":"2024-09-14T12:44:11.693554+0000","last_peered":"2024-09-14T12:44:11.693554+0000","last_clean":"2024-09-14T12:44:11.693554+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T12:44:11.693554+0000","last_undegraded":"2024-09-14T12:44:11.693554+0000","last_fullsized":"2024-09-14T12:44:11.693554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:11.693472+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:11.693472+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.693472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:19.157490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'329","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.793286+0000","last_change":"2024-09-14T12:44:10.793286+0000","last_active":"2024-09-14T12:44:10.793286+0000","last_peered":"2024-09-14T12:44:10.793286+0000","last_clean":"2024-09-14T12:44:10.793286+0000","last_became_active":"2024-09-14T10:49:23.371077+0000","last_became_peered":"2024-09-14T10:49:23.371077+0000","last_unstale":"2024-09-14T12:44:10.793286+0000","last_undegraded":"2024-09-14T12:44:10.793286+0000","last_fullsized":"2024-09-14T12:44:10.793286+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-09-14T12:44:10.793074+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-09-14T12:44:10.793074+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.793074+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:06.598298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":16360,"num_write":1113,"num_write_kb":33420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.166090+0000","last_change":"2024-09-14T12:44:27.166090+0000","last_active":"2024-09-14T12:44:27.166090+0000","last_peered":"2024-09-14T12:44:27.166090+0000","last_clean":"2024-09-14T12:44:27.166090+0000","last_became_active":"2024-09-14T10:49:27.372388+0000","last_became_peered":"2024-09-14T10:49:27.372388+0000","last_unstale":"2024-09-14T12:44:27.166090+0000","last_undegraded":"2024-09-14T12:44:27.166090+0000","last_fullsized":"2024-09-14T12:44:27.166090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.165821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.165821+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.165821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:15.547531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'835","reported_seq":1590,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.602576+0000","last_change":"2024-09-14T12:44:43.602576+0000","last_active":"2024-09-14T12:44:43.602576+0000","last_peered":"2024-09-14T12:44:43.602576+0000","last_clean":"2024-09-14T12:44:43.602576+0000","last_became_active":"2024-09-14T10:49:29.390014+0000","last_became_peered":"2024-09-14T10:49:29.390014+0000","last_unstale":"2024-09-14T12:44:43.602576+0000","last_undegraded":"2024-09-14T12:44:43.602576+0000","last_fullsized":"2024-09-14T12:44:43.602576+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'835","last_scrub_stamp":"2024-09-14T12:44:43.602388+0000","last_deep_scrub":"267'835","last_deep_scrub_stamp":"2024-09-14T12:44:43.602388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.602388+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:49.116772+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167259,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1623,"num_read_kb":3686,"num_write":1586,"num_write_kb":1425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107094,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.989824+0000","last_change":"2024-09-14T12:44:39.989824+0000","last_active":"2024-09-14T12:44:39.989824+0000","last_peered":"2024-09-14T12:44:39.989824+0000","last_clean":"2024-09-14T12:44:39.989824+0000","last_became_active":"2024-09-14T10:49:31.411212+0000","last_became_peered":"2024-09-14T10:49:31.411212+0000","last_unstale":"2024-09-14T12:44:39.989824+0000","last_undegraded":"2024-09-14T12:44:39.989824+0000","last_fullsized":"2024-09-14T12:44:39.989824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:39.989560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:39.989560+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.989560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:38.029943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'198","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.104464+0000","last_change":"2024-09-14T12:44:33.104464+0000","last_active":"2024-09-14T12:44:33.104464+0000","last_peered":"2024-09-14T12:44:33.104464+0000","last_clean":"2024-09-14T12:44:33.104464+0000","last_became_active":"2024-09-14T10:49:33.469611+0000","last_became_peered":"2024-09-14T10:49:33.469611+0000","last_unstale":"2024-09-14T12:44:33.104464+0000","last_undegraded":"2024-09-14T12:44:33.104464+0000","last_fullsized":"2024-09-14T12:44:33.104464+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-14T12:44:33.104326+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-14T12:44:33.104326+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.104326+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:32.582985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":425,"num_write":402,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'780","reported_seq":2301,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.874559+0000","last_change":"2024-09-14T12:44:24.874559+0000","last_active":"2024-09-14T12:44:24.874559+0000","last_peered":"2024-09-14T12:44:24.874559+0000","last_clean":"2024-09-14T12:44:24.874559+0000","last_became_active":"2024-09-14T10:49:25.390586+0000","last_became_peered":"2024-09-14T10:49:25.390586+0000","last_unstale":"2024-09-14T12:44:24.874559+0000","last_undegraded":"2024-09-14T12:44:24.874559+0000","last_fullsized":"2024-09-14T12:44:24.874559+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'780","last_scrub_stamp":"2024-09-14T12:44:24.874284+0000","last_deep_scrub":"267'780","last_deep_scrub_stamp":"2024-09-14T12:44:24.874284+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.874284+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:51.757493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3382,"num_write":1057,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.718117+0000","last_change":"2024-09-14T12:44:10.718117+0000","last_active":"2024-09-14T12:44:10.718117+0000","last_peered":"2024-09-14T12:44:10.718117+0000","last_clean":"2024-09-14T12:44:10.718117+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T12:44:10.718117+0000","last_undegraded":"2024-09-14T12:44:10.718117+0000","last_fullsized":"2024-09-14T12:44:10.718117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:10.718056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:10.718056+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.718056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:29.760263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'352","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.735411+0000","last_change":"2024-09-14T12:44:12.735411+0000","last_active":"2024-09-14T12:44:12.735411+0000","last_peered":"2024-09-14T12:44:12.735411+0000","last_clean":"2024-09-14T12:44:12.735411+0000","last_became_active":"2024-09-14T10:49:53.507913+0000","last_became_peered":"2024-09-14T10:49:53.507913+0000","last_unstale":"2024-09-14T12:44:12.735411+0000","last_undegraded":"2024-09-14T12:44:12.735411+0000","last_fullsized":"2024-09-14T12:44:12.735411+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-09-14T12:44:12.735166+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-09-14T12:44:12.735166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.735166+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:17.278126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":56481,"num_write":1136,"num_write_kb":45113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,3],"acting":[6,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.652426+0000","last_change":"2024-09-14T12:44:36.652426+0000","last_active":"2024-09-14T12:44:36.652426+0000","last_peered":"2024-09-14T12:44:36.652426+0000","last_clean":"2024-09-14T12:44:36.652426+0000","last_became_active":"2024-09-14T10:49:27.388875+0000","last_became_peered":"2024-09-14T10:49:27.388875+0000","last_unstale":"2024-09-14T12:44:36.652426+0000","last_undegraded":"2024-09-14T12:44:36.652426+0000","last_fullsized":"2024-09-14T12:44:36.652426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.652132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.652132+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.652132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:24.964639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1478","reported_seq":3859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.438518+0000","last_change":"2024-09-14T12:44:27.438518+0000","last_active":"2024-09-14T12:44:27.438518+0000","last_peered":"2024-09-14T12:44:27.438518+0000","last_clean":"2024-09-14T12:44:27.438518+0000","last_became_active":"2024-09-14T10:49:29.393295+0000","last_became_peered":"2024-09-14T10:49:29.393295+0000","last_unstale":"2024-09-14T12:44:27.438518+0000","last_undegraded":"2024-09-14T12:44:27.438518+0000","last_fullsized":"2024-09-14T12:44:27.438518+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1478","last_scrub_stamp":"2024-09-14T12:44:27.438310+0000","last_deep_scrub":"267'1478","last_deep_scrub_stamp":"2024-09-14T12:44:27.438310+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.438310+0000","objects_scrubbed":11,"log_size":78,"log_dups_size":1400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:41.883467+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2284,"num_read_kb":4194,"num_write":1394,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.538787+0000","last_change":"2024-09-14T12:44:47.538787+0000","last_active":"2024-09-14T12:44:47.538787+0000","last_peered":"2024-09-14T12:44:47.538787+0000","last_clean":"2024-09-14T12:44:47.538787+0000","last_became_active":"2024-09-14T10:49:31.432054+0000","last_became_peered":"2024-09-14T10:49:31.432054+0000","last_unstale":"2024-09-14T12:44:47.538787+0000","last_undegraded":"2024-09-14T12:44:47.538787+0000","last_fullsized":"2024-09-14T12:44:47.538787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.538595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.538595+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.538595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:32.517665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'84","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.896428+0000","last_change":"2024-09-14T12:44:44.896264+0000","last_active":"2024-09-14T12:44:44.896428+0000","last_peered":"2024-09-14T12:44:44.896428+0000","last_clean":"2024-09-14T12:44:44.896428+0000","last_became_active":"2024-09-14T10:49:33.466307+0000","last_became_peered":"2024-09-14T10:49:33.466307+0000","last_unstale":"2024-09-14T12:44:44.896428+0000","last_undegraded":"2024-09-14T12:44:44.896428+0000","last_fullsized":"2024-09-14T12:44:44.896428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'84","last_scrub_stamp":"2024-09-14T12:44:44.896073+0000","last_deep_scrub":"267'84","last_deep_scrub_stamp":"2024-09-14T12:44:44.896073+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.896073+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:38.231585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":197,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'931","reported_seq":2505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.741494+0000","last_change":"2024-09-14T12:44:22.741494+0000","last_active":"2024-09-14T12:44:22.741494+0000","last_peered":"2024-09-14T12:44:22.741494+0000","last_clean":"2024-09-14T12:44:22.741494+0000","last_became_active":"2024-09-14T10:49:25.382937+0000","last_became_peered":"2024-09-14T10:49:25.382937+0000","last_unstale":"2024-09-14T12:44:22.741494+0000","last_undegraded":"2024-09-14T12:44:22.741494+0000","last_fullsized":"2024-09-14T12:44:22.741494+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'931","last_scrub_stamp":"2024-09-14T12:44:22.741320+0000","last_deep_scrub":"267'931","last_deep_scrub_stamp":"2024-09-14T12:44:22.741320+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.741320+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:45.020675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":3892,"num_write":1285,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.618578+0000","last_change":"2024-09-14T12:44:13.618578+0000","last_active":"2024-09-14T12:44:13.618578+0000","last_peered":"2024-09-14T12:44:13.618578+0000","last_clean":"2024-09-14T12:44:13.618578+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T12:44:13.618578+0000","last_undegraded":"2024-09-14T12:44:13.618578+0000","last_fullsized":"2024-09-14T12:44:13.618578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:13.618399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:13.618399+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.618399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:36:10.021666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'330","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.875989+0000","last_change":"2024-09-14T12:44:12.875989+0000","last_active":"2024-09-14T12:44:12.875989+0000","last_peered":"2024-09-14T12:44:12.875989+0000","last_clean":"2024-09-14T12:44:12.875989+0000","last_became_active":"2024-09-14T10:49:23.387885+0000","last_became_peered":"2024-09-14T10:49:23.387885+0000","last_unstale":"2024-09-14T12:44:12.875989+0000","last_undegraded":"2024-09-14T12:44:12.875989+0000","last_fullsized":"2024-09-14T12:44:12.875989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-14T12:44:12.875716+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-14T12:44:12.875716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.875716+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:32.075745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":25294,"num_write":1061,"num_write_kb":31965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.456328+0000","last_change":"2024-09-14T12:44:25.456328+0000","last_active":"2024-09-14T12:44:25.456328+0000","last_peered":"2024-09-14T12:44:25.456328+0000","last_clean":"2024-09-14T12:44:25.456328+0000","last_became_active":"2024-09-14T10:49:27.384973+0000","last_became_peered":"2024-09-14T10:49:27.384973+0000","last_unstale":"2024-09-14T12:44:25.456328+0000","last_undegraded":"2024-09-14T12:44:25.456328+0000","last_fullsized":"2024-09-14T12:44:25.456328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:25.456147+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:25.456147+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.456147+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:48.132295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'424","reported_seq":2414,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.164324+0000","last_change":"2024-09-14T12:44:28.164324+0000","last_active":"2024-09-14T12:44:28.164324+0000","last_peered":"2024-09-14T12:44:28.164324+0000","last_clean":"2024-09-14T12:44:28.164324+0000","last_became_active":"2024-09-14T10:49:29.382485+0000","last_became_peered":"2024-09-14T10:49:29.382485+0000","last_unstale":"2024-09-14T12:44:28.164324+0000","last_undegraded":"2024-09-14T12:44:28.164324+0000","last_fullsized":"2024-09-14T12:44:28.164324+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'424","last_scrub_stamp":"2024-09-14T12:44:28.164109+0000","last_deep_scrub":"267'424","last_deep_scrub_stamp":"2024-09-14T12:44:28.164109+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.164109+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:10.149631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":384,"num_read_kb":370,"num_write":379,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.886273+0000","last_change":"2024-09-14T12:44:41.886273+0000","last_active":"2024-09-14T12:44:41.886273+0000","last_peered":"2024-09-14T12:44:41.886273+0000","last_clean":"2024-09-14T12:44:41.886273+0000","last_became_active":"2024-09-14T10:49:31.420121+0000","last_became_peered":"2024-09-14T10:49:31.420121+0000","last_unstale":"2024-09-14T12:44:41.886273+0000","last_undegraded":"2024-09-14T12:44:41.886273+0000","last_fullsized":"2024-09-14T12:44:41.886273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.886088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.886088+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.886088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:31.595427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'277","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.817045+0000","last_change":"2024-09-14T12:44:46.817045+0000","last_active":"2024-09-14T12:44:46.817045+0000","last_peered":"2024-09-14T12:44:46.817045+0000","last_clean":"2024-09-14T12:44:46.817045+0000","last_became_active":"2024-09-14T10:49:33.437564+0000","last_became_peered":"2024-09-14T10:49:33.437564+0000","last_unstale":"2024-09-14T12:44:46.817045+0000","last_undegraded":"2024-09-14T12:44:46.817045+0000","last_fullsized":"2024-09-14T12:44:46.817045+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-14T12:44:46.816863+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-14T12:44:46.816863+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.816863+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:37.693510+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":600,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'364","reported_seq":1779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.762886+0000","last_change":"2024-09-14T12:44:21.762886+0000","last_active":"2024-09-14T12:44:21.762886+0000","last_peered":"2024-09-14T12:44:21.762886+0000","last_clean":"2024-09-14T12:44:21.762886+0000","last_became_active":"2024-09-14T10:49:25.377606+0000","last_became_peered":"2024-09-14T10:49:25.377606+0000","last_unstale":"2024-09-14T12:44:21.762886+0000","last_undegraded":"2024-09-14T12:44:21.762886+0000","last_fullsized":"2024-09-14T12:44:21.762886+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-14T12:44:21.762699+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-14T12:44:21.762699+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.762699+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:46.620062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2088,"num_read_kb":1981,"num_write":424,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.689647+0000","last_change":"2024-09-14T12:44:12.689647+0000","last_active":"2024-09-14T12:44:12.689647+0000","last_peered":"2024-09-14T12:44:12.689647+0000","last_clean":"2024-09-14T12:44:12.689647+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T12:44:12.689647+0000","last_undegraded":"2024-09-14T12:44:12.689647+0000","last_fullsized":"2024-09-14T12:44:12.689647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:12.689558+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:12.689558+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.689558+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:00.729814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'374","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.159271+0000","last_change":"2024-09-14T12:44:22.159271+0000","last_active":"2024-09-14T12:44:22.159271+0000","last_peered":"2024-09-14T12:44:22.159271+0000","last_clean":"2024-09-14T12:44:22.159271+0000","last_became_active":"2024-09-14T10:49:23.365016+0000","last_became_peered":"2024-09-14T10:49:23.365016+0000","last_unstale":"2024-09-14T12:44:22.159271+0000","last_undegraded":"2024-09-14T12:44:22.159271+0000","last_fullsized":"2024-09-14T12:44:22.159271+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:22.158986+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:22.158986+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.158986+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:14.641518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":666,"num_read_kb":160044,"num_write":1139,"num_write_kb":62525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.529218+0000","last_change":"2024-09-14T12:44:20.528981+0000","last_active":"2024-09-14T12:44:20.529218+0000","last_peered":"2024-09-14T12:44:20.529218+0000","last_clean":"2024-09-14T12:44:20.529218+0000","last_became_active":"2024-09-14T10:49:27.373998+0000","last_became_peered":"2024-09-14T10:49:27.373998+0000","last_unstale":"2024-09-14T12:44:20.529218+0000","last_undegraded":"2024-09-14T12:44:20.529218+0000","last_fullsized":"2024-09-14T12:44:20.529218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:20.528772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:20.528772+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.528772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:55.424574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'236","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.034718+0000","last_change":"2024-09-14T12:44:35.034718+0000","last_active":"2024-09-14T12:44:35.034718+0000","last_peered":"2024-09-14T12:44:35.034718+0000","last_clean":"2024-09-14T12:44:35.034718+0000","last_became_active":"2024-09-14T10:49:29.391056+0000","last_became_peered":"2024-09-14T10:49:29.391056+0000","last_unstale":"2024-09-14T12:44:35.034718+0000","last_undegraded":"2024-09-14T12:44:35.034718+0000","last_fullsized":"2024-09-14T12:44:35.034718+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'236","last_scrub_stamp":"2024-09-14T12:44:35.034505+0000","last_deep_scrub":"267'236","last_deep_scrub_stamp":"2024-09-14T12:44:35.034505+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.034505+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.096986+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":287,"num_read_kb":274,"num_write":212,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.542408+0000","last_change":"2024-09-14T12:44:49.542408+0000","last_active":"2024-09-14T12:44:49.542408+0000","last_peered":"2024-09-14T12:44:49.542408+0000","last_clean":"2024-09-14T12:44:49.542408+0000","last_became_active":"2024-09-14T10:49:31.424769+0000","last_became_peered":"2024-09-14T10:49:31.424769+0000","last_unstale":"2024-09-14T12:44:49.542408+0000","last_undegraded":"2024-09-14T12:44:49.542408+0000","last_fullsized":"2024-09-14T12:44:49.542408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.542233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.542233+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.542233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:20.418046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'129","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.938139+0000","last_change":"2024-09-14T12:44:36.938139+0000","last_active":"2024-09-14T12:44:36.938139+0000","last_peered":"2024-09-14T12:44:36.938139+0000","last_clean":"2024-09-14T12:44:36.938139+0000","last_became_active":"2024-09-14T10:49:33.468553+0000","last_became_peered":"2024-09-14T10:49:33.468553+0000","last_unstale":"2024-09-14T12:44:36.938139+0000","last_undegraded":"2024-09-14T12:44:36.938139+0000","last_fullsized":"2024-09-14T12:44:36.938139+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T12:44:36.937964+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T12:44:36.937964+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.937964+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:36.638436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":228,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'559","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.750875+0000","last_change":"2024-09-14T12:44:18.750875+0000","last_active":"2024-09-14T12:44:18.750875+0000","last_peered":"2024-09-14T12:44:18.750875+0000","last_clean":"2024-09-14T12:44:18.750875+0000","last_became_active":"2024-09-14T10:49:25.379137+0000","last_became_peered":"2024-09-14T10:49:25.379137+0000","last_unstale":"2024-09-14T12:44:18.750875+0000","last_undegraded":"2024-09-14T12:44:18.750875+0000","last_fullsized":"2024-09-14T12:44:18.750875+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'559","last_scrub_stamp":"2024-09-14T12:44:18.750687+0000","last_deep_scrub":"267'559","last_deep_scrub_stamp":"2024-09-14T12:44:18.750687+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.750687+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:29.411317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2924,"num_read_kb":2647,"num_write":735,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'367","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.850994+0000","last_change":"2024-09-14T12:44:09.850920+0000","last_active":"2024-09-14T12:44:09.850994+0000","last_peered":"2024-09-14T12:44:09.850994+0000","last_clean":"2024-09-14T12:44:09.850994+0000","last_became_active":"2024-09-14T10:49:23.389195+0000","last_became_peered":"2024-09-14T10:49:23.389195+0000","last_unstale":"2024-09-14T12:44:09.850994+0000","last_undegraded":"2024-09-14T12:44:09.850994+0000","last_fullsized":"2024-09-14T12:44:09.850994+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'367","last_scrub_stamp":"2024-09-14T12:44:09.850762+0000","last_deep_scrub":"267'367","last_deep_scrub_stamp":"2024-09-14T12:44:09.850762+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.850762+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:37.171130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984745,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":650,"num_read_kb":23846,"num_write":1157,"num_write_kb":31374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.835515+0000","last_change":"2024-09-14T12:44:11.835515+0000","last_active":"2024-09-14T12:44:11.835515+0000","last_peered":"2024-09-14T12:44:11.835515+0000","last_clean":"2024-09-14T12:44:11.835515+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T12:44:11.835515+0000","last_undegraded":"2024-09-14T12:44:11.835515+0000","last_fullsized":"2024-09-14T12:44:11.835515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:11.835327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:11.835327+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.835327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:41.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.895413+0000","last_change":"2024-09-14T12:44:28.895413+0000","last_active":"2024-09-14T12:44:28.895413+0000","last_peered":"2024-09-14T12:44:28.895413+0000","last_clean":"2024-09-14T12:44:28.895413+0000","last_became_active":"2024-09-14T10:49:27.368412+0000","last_became_peered":"2024-09-14T10:49:27.368412+0000","last_unstale":"2024-09-14T12:44:28.895413+0000","last_undegraded":"2024-09-14T12:44:28.895413+0000","last_fullsized":"2024-09-14T12:44:28.895413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.895241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.895241+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.895241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.614078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'762","reported_seq":1508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.440351+0000","last_change":"2024-09-14T12:44:26.440351+0000","last_active":"2024-09-14T12:44:26.440351+0000","last_peered":"2024-09-14T12:44:26.440351+0000","last_clean":"2024-09-14T12:44:26.440351+0000","last_became_active":"2024-09-14T10:49:29.383270+0000","last_became_peered":"2024-09-14T10:49:29.383270+0000","last_unstale":"2024-09-14T12:44:26.440351+0000","last_undegraded":"2024-09-14T12:44:26.440351+0000","last_fullsized":"2024-09-14T12:44:26.440351+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-09-14T12:44:26.440152+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-09-14T12:44:26.440152+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.440152+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.264773+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99398,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2001,"num_read_kb":3265,"num_write":2692,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537558,"num_omap_keys":1218,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.999286+0000","last_change":"2024-09-14T12:44:30.999286+0000","last_active":"2024-09-14T12:44:30.999286+0000","last_peered":"2024-09-14T12:44:30.999286+0000","last_clean":"2024-09-14T12:44:30.999286+0000","last_became_active":"2024-09-14T10:49:31.418385+0000","last_became_peered":"2024-09-14T10:49:31.418385+0000","last_unstale":"2024-09-14T12:44:30.999286+0000","last_undegraded":"2024-09-14T12:44:30.999286+0000","last_fullsized":"2024-09-14T12:44:30.999286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.999105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.999105+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.999105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:54.918874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'134","reported_seq":675,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.869306+0000","last_change":"2024-09-14T12:44:46.869306+0000","last_active":"2024-09-14T12:44:46.869306+0000","last_peered":"2024-09-14T12:44:46.869306+0000","last_clean":"2024-09-14T12:44:46.869306+0000","last_became_active":"2024-09-14T10:49:33.467268+0000","last_became_peered":"2024-09-14T10:49:33.467268+0000","last_unstale":"2024-09-14T12:44:46.869306+0000","last_undegraded":"2024-09-14T12:44:46.869306+0000","last_fullsized":"2024-09-14T12:44:46.869306+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T12:44:46.869091+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T12:44:46.869091+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.869091+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:37.701120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":137,"num_write":301,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'747","reported_seq":2299,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.794948+0000","last_change":"2024-09-14T12:44:20.794948+0000","last_active":"2024-09-14T12:44:20.794948+0000","last_peered":"2024-09-14T12:44:20.794948+0000","last_clean":"2024-09-14T12:44:20.794948+0000","last_became_active":"2024-09-14T10:49:25.377460+0000","last_became_peered":"2024-09-14T10:49:25.377460+0000","last_unstale":"2024-09-14T12:44:20.794948+0000","last_undegraded":"2024-09-14T12:44:20.794948+0000","last_fullsized":"2024-09-14T12:44:20.794948+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'747","last_scrub_stamp":"2024-09-14T12:44:20.794733+0000","last_deep_scrub":"267'747","last_deep_scrub_stamp":"2024-09-14T12:44:20.794733+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.794733+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:04.985527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3587,"num_read_kb":3249,"num_write":953,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'349","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.684281+0000","last_change":"2024-09-14T12:44:14.684281+0000","last_active":"2024-09-14T12:44:14.684281+0000","last_peered":"2024-09-14T12:44:14.684281+0000","last_clean":"2024-09-14T12:44:14.684281+0000","last_became_active":"2024-09-14T10:49:23.383686+0000","last_became_peered":"2024-09-14T10:49:23.383686+0000","last_unstale":"2024-09-14T12:44:14.684281+0000","last_undegraded":"2024-09-14T12:44:14.684281+0000","last_fullsized":"2024-09-14T12:44:14.684281+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-14T12:44:14.683982+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-14T12:44:14.683982+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.683982+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:25.301976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":8945,"num_write":1082,"num_write_kb":53511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.707852+0000","last_change":"2024-09-14T12:44:13.707852+0000","last_active":"2024-09-14T12:44:13.707852+0000","last_peered":"2024-09-14T12:44:13.707852+0000","last_clean":"2024-09-14T12:44:13.707852+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T12:44:13.707852+0000","last_undegraded":"2024-09-14T12:44:13.707852+0000","last_fullsized":"2024-09-14T12:44:13.707852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:13.707645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:13.707645+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.707645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:41.725258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.137911+0000","last_change":"2024-09-14T12:44:26.137911+0000","last_active":"2024-09-14T12:44:26.137911+0000","last_peered":"2024-09-14T12:44:26.137911+0000","last_clean":"2024-09-14T12:44:26.137911+0000","last_became_active":"2024-09-14T10:49:27.373801+0000","last_became_peered":"2024-09-14T10:49:27.373801+0000","last_unstale":"2024-09-14T12:44:26.137911+0000","last_undegraded":"2024-09-14T12:44:26.137911+0000","last_fullsized":"2024-09-14T12:44:26.137911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:26.137730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:26.137730+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.137730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:24.785770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'254","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.791267+0000","last_change":"2024-09-14T12:44:30.791267+0000","last_active":"2024-09-14T12:44:30.791267+0000","last_peered":"2024-09-14T12:44:30.791267+0000","last_clean":"2024-09-14T12:44:30.791267+0000","last_became_active":"2024-09-14T10:49:29.387176+0000","last_became_peered":"2024-09-14T10:49:29.387176+0000","last_unstale":"2024-09-14T12:44:30.791267+0000","last_undegraded":"2024-09-14T12:44:30.791267+0000","last_fullsized":"2024-09-14T12:44:30.791267+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'254","last_scrub_stamp":"2024-09-14T12:44:30.791067+0000","last_deep_scrub":"267'254","last_deep_scrub_stamp":"2024-09-14T12:44:30.791067+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.791067+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:09.347252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'796","reported_seq":3344,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.949405+0000","last_change":"2024-09-14T12:44:33.949405+0000","last_active":"2024-09-14T12:44:33.949405+0000","last_peered":"2024-09-14T12:44:33.949405+0000","last_clean":"2024-09-14T12:44:33.949405+0000","last_became_active":"2024-09-14T10:49:31.417376+0000","last_became_peered":"2024-09-14T10:49:31.417376+0000","last_unstale":"2024-09-14T12:44:33.949405+0000","last_undegraded":"2024-09-14T12:44:33.949405+0000","last_fullsized":"2024-09-14T12:44:33.949405+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'796","last_scrub_stamp":"2024-09-14T12:44:33.949129+0000","last_deep_scrub":"267'796","last_deep_scrub_stamp":"2024-09-14T12:44:33.949129+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.949129+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:26.181427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'151","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.423786+0000","last_change":"2024-09-14T12:44:37.423620+0000","last_active":"2024-09-14T12:44:37.423786+0000","last_peered":"2024-09-14T12:44:37.423786+0000","last_clean":"2024-09-14T12:44:37.423786+0000","last_became_active":"2024-09-14T10:49:33.459122+0000","last_became_peered":"2024-09-14T10:49:33.459122+0000","last_unstale":"2024-09-14T12:44:37.423786+0000","last_undegraded":"2024-09-14T12:44:37.423786+0000","last_fullsized":"2024-09-14T12:44:37.423786+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-14T12:44:37.423425+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-14T12:44:37.423425+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.423425+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:06.374161+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":355,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'840","reported_seq":2556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.829846+0000","last_change":"2024-09-14T12:44:18.829846+0000","last_active":"2024-09-14T12:44:18.829846+0000","last_peered":"2024-09-14T12:44:18.829846+0000","last_clean":"2024-09-14T12:44:18.829846+0000","last_became_active":"2024-09-14T10:49:25.360655+0000","last_became_peered":"2024-09-14T10:49:25.360655+0000","last_unstale":"2024-09-14T12:44:18.829846+0000","last_undegraded":"2024-09-14T12:44:18.829846+0000","last_fullsized":"2024-09-14T12:44:18.829846+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'840","last_scrub_stamp":"2024-09-14T12:44:18.829679+0000","last_deep_scrub":"267'840","last_deep_scrub_stamp":"2024-09-14T12:44:18.829679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.829679+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:29.657903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4101,"num_read_kb":3716,"num_write":1090,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2812,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'464","reported_seq":1180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.768697+0000","last_change":"2024-09-14T12:44:13.768407+0000","last_active":"2024-09-14T12:44:13.768697+0000","last_peered":"2024-09-14T12:44:13.768697+0000","last_clean":"2024-09-14T12:44:13.768697+0000","last_became_active":"2024-09-14T10:49:23.359442+0000","last_became_peered":"2024-09-14T10:49:23.359442+0000","last_unstale":"2024-09-14T12:44:13.768697+0000","last_undegraded":"2024-09-14T12:44:13.768697+0000","last_fullsized":"2024-09-14T12:44:13.768697+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'464","last_scrub_stamp":"2024-09-14T12:44:13.768049+0000","last_deep_scrub":"267'464","last_deep_scrub_stamp":"2024-09-14T12:44:13.768049+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.768049+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:42.033691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":830,"num_read_kb":31084,"num_write":1362,"num_write_kb":31792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.756536+0000","last_change":"2024-09-14T12:44:11.756536+0000","last_active":"2024-09-14T12:44:11.756536+0000","last_peered":"2024-09-14T12:44:11.756536+0000","last_clean":"2024-09-14T12:44:11.756536+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T12:44:11.756536+0000","last_undegraded":"2024-09-14T12:44:11.756536+0000","last_fullsized":"2024-09-14T12:44:11.756536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:11.756350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:11.756350+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.756350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:46.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.633161+0000","last_change":"2024-09-14T12:44:38.633161+0000","last_active":"2024-09-14T12:44:38.633161+0000","last_peered":"2024-09-14T12:44:38.633161+0000","last_clean":"2024-09-14T12:44:38.633161+0000","last_became_active":"2024-09-14T10:49:27.384635+0000","last_became_peered":"2024-09-14T10:49:27.384635+0000","last_unstale":"2024-09-14T12:44:38.633161+0000","last_undegraded":"2024-09-14T12:44:38.633161+0000","last_fullsized":"2024-09-14T12:44:38.633161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:38.632938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:38.632938+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.632938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:11.086517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'184","reported_seq":791,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.632514+0000","last_change":"2024-09-14T12:44:42.632514+0000","last_active":"2024-09-14T12:44:42.632514+0000","last_peered":"2024-09-14T12:44:42.632514+0000","last_clean":"2024-09-14T12:44:42.632514+0000","last_became_active":"2024-09-14T10:49:29.394105+0000","last_became_peered":"2024-09-14T10:49:29.394105+0000","last_unstale":"2024-09-14T12:44:42.632514+0000","last_undegraded":"2024-09-14T12:44:42.632514+0000","last_fullsized":"2024-09-14T12:44:42.632514+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-14T12:44:42.632311+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-14T12:44:42.632311+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.632311+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:01.232345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'830","reported_seq":3154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.999557+0000","last_change":"2024-09-14T12:44:35.999557+0000","last_active":"2024-09-14T12:44:35.999557+0000","last_peered":"2024-09-14T12:44:35.999557+0000","last_clean":"2024-09-14T12:44:35.999557+0000","last_became_active":"2024-09-14T10:49:31.411055+0000","last_became_peered":"2024-09-14T10:49:31.411055+0000","last_unstale":"2024-09-14T12:44:35.999557+0000","last_undegraded":"2024-09-14T12:44:35.999557+0000","last_fullsized":"2024-09-14T12:44:35.999557+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'830","last_scrub_stamp":"2024-09-14T12:44:35.999262+0000","last_deep_scrub":"267'830","last_deep_scrub_stamp":"2024-09-14T12:44:35.999262+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.999262+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:37.589153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'273","reported_seq":827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.881708+0000","last_change":"2024-09-14T12:44:45.881708+0000","last_active":"2024-09-14T12:44:45.881708+0000","last_peered":"2024-09-14T12:44:45.881708+0000","last_clean":"2024-09-14T12:44:45.881708+0000","last_became_active":"2024-09-14T10:49:33.456806+0000","last_became_peered":"2024-09-14T10:49:33.456806+0000","last_unstale":"2024-09-14T12:44:45.881708+0000","last_undegraded":"2024-09-14T12:44:45.881708+0000","last_fullsized":"2024-09-14T12:44:45.881708+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-09-14T12:44:45.881495+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-09-14T12:44:45.881495+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.881495+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:15.185394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":331,"num_read_kb":330,"num_write":580,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'504","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.868409+0000","last_change":"2024-09-14T12:44:17.868409+0000","last_active":"2024-09-14T12:44:17.868409+0000","last_peered":"2024-09-14T12:44:17.868409+0000","last_clean":"2024-09-14T12:44:17.868409+0000","last_became_active":"2024-09-14T10:49:25.372923+0000","last_became_peered":"2024-09-14T10:49:25.372923+0000","last_unstale":"2024-09-14T12:44:17.868409+0000","last_undegraded":"2024-09-14T12:44:17.868409+0000","last_fullsized":"2024-09-14T12:44:17.868409+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'504","last_scrub_stamp":"2024-09-14T12:44:17.868183+0000","last_deep_scrub":"267'504","last_deep_scrub_stamp":"2024-09-14T12:44:17.868183+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.868183+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:43:56.368622+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2643,"num_read_kb":2487,"num_write":591,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'357","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.806944+0000","last_change":"2024-09-14T12:44:15.806944+0000","last_active":"2024-09-14T12:44:15.806944+0000","last_peered":"2024-09-14T12:44:15.806944+0000","last_clean":"2024-09-14T12:44:15.806944+0000","last_became_active":"2024-09-14T10:49:23.344863+0000","last_became_peered":"2024-09-14T10:49:23.344863+0000","last_unstale":"2024-09-14T12:44:15.806944+0000","last_undegraded":"2024-09-14T12:44:15.806944+0000","last_fullsized":"2024-09-14T12:44:15.806944+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-14T12:44:15.806628+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-14T12:44:15.806628+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.806628+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:08.490411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":37228,"num_write":1084,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.734938+0000","last_change":"2024-09-14T12:44:15.734938+0000","last_active":"2024-09-14T12:44:15.734938+0000","last_peered":"2024-09-14T12:44:15.734938+0000","last_clean":"2024-09-14T12:44:15.734938+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T12:44:15.734938+0000","last_undegraded":"2024-09-14T12:44:15.734938+0000","last_fullsized":"2024-09-14T12:44:15.734938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:15.734744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:15.734744+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.734744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:19.978999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.862888+0000","last_change":"2024-09-14T12:44:27.862888+0000","last_active":"2024-09-14T12:44:27.862888+0000","last_peered":"2024-09-14T12:44:27.862888+0000","last_clean":"2024-09-14T12:44:27.862888+0000","last_became_active":"2024-09-14T10:49:27.379820+0000","last_became_peered":"2024-09-14T10:49:27.379820+0000","last_unstale":"2024-09-14T12:44:27.862888+0000","last_undegraded":"2024-09-14T12:44:27.862888+0000","last_fullsized":"2024-09-14T12:44:27.862888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.862707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.862707+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.862707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:05.909921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'854","reported_seq":1658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.125584+0000","last_change":"2024-09-14T12:44:30.125584+0000","last_active":"2024-09-14T12:44:30.125584+0000","last_peered":"2024-09-14T12:44:30.125584+0000","last_clean":"2024-09-14T12:44:30.125584+0000","last_became_active":"2024-09-14T10:49:29.389500+0000","last_became_peered":"2024-09-14T10:49:29.389500+0000","last_unstale":"2024-09-14T12:44:30.125584+0000","last_undegraded":"2024-09-14T12:44:30.125584+0000","last_fullsized":"2024-09-14T12:44:30.125584+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'854","last_scrub_stamp":"2024-09-14T12:44:30.125277+0000","last_deep_scrub":"267'854","last_deep_scrub_stamp":"2024-09-14T12:44:30.125277+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.125277+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:14.671455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1507,"num_read_kb":3507,"num_write":1226,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.849089+0000","last_change":"2024-09-14T12:44:40.849089+0000","last_active":"2024-09-14T12:44:40.849089+0000","last_peered":"2024-09-14T12:44:40.849089+0000","last_clean":"2024-09-14T12:44:40.849089+0000","last_became_active":"2024-09-14T10:49:31.413008+0000","last_became_peered":"2024-09-14T10:49:31.413008+0000","last_unstale":"2024-09-14T12:44:40.849089+0000","last_undegraded":"2024-09-14T12:44:40.849089+0000","last_fullsized":"2024-09-14T12:44:40.849089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:40.848905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:40.848905+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.848905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:56.723688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'121","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.032543+0000","last_change":"2024-09-14T12:44:36.032543+0000","last_active":"2024-09-14T12:44:36.032543+0000","last_peered":"2024-09-14T12:44:36.032543+0000","last_clean":"2024-09-14T12:44:36.032543+0000","last_became_active":"2024-09-14T10:49:33.468546+0000","last_became_peered":"2024-09-14T10:49:33.468546+0000","last_unstale":"2024-09-14T12:44:36.032543+0000","last_undegraded":"2024-09-14T12:44:36.032543+0000","last_fullsized":"2024-09-14T12:44:36.032543+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'121","last_scrub_stamp":"2024-09-14T12:44:36.032367+0000","last_deep_scrub":"267'121","last_deep_scrub_stamp":"2024-09-14T12:44:36.032367+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.032367+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:18.041019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'162","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.862334+0000","last_change":"2024-09-14T12:44:45.862334+0000","last_active":"2024-09-14T12:44:45.862334+0000","last_peered":"2024-09-14T12:44:45.862334+0000","last_clean":"2024-09-14T12:44:45.862334+0000","last_became_active":"2024-09-14T10:49:33.461782+0000","last_became_peered":"2024-09-14T10:49:33.461782+0000","last_unstale":"2024-09-14T12:44:45.862334+0000","last_undegraded":"2024-09-14T12:44:45.862334+0000","last_fullsized":"2024-09-14T12:44:45.862334+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-14T12:44:45.862144+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-14T12:44:45.862144+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.862144+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:42.062797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":264,"num_write":397,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'522","reported_seq":2256,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.824159+0000","last_change":"2024-09-14T12:44:18.824159+0000","last_active":"2024-09-14T12:44:18.824159+0000","last_peered":"2024-09-14T12:44:18.824159+0000","last_clean":"2024-09-14T12:44:18.824159+0000","last_became_active":"2024-09-14T10:49:25.381653+0000","last_became_peered":"2024-09-14T10:49:25.381653+0000","last_unstale":"2024-09-14T12:44:18.824159+0000","last_undegraded":"2024-09-14T12:44:18.824159+0000","last_fullsized":"2024-09-14T12:44:18.824159+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'522","last_scrub_stamp":"2024-09-14T12:44:18.823867+0000","last_deep_scrub":"267'522","last_deep_scrub_stamp":"2024-09-14T12:44:18.823867+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.823867+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:50.458414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2737,"num_read_kb":2577,"num_write":621,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'379","reported_seq":1168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.737083+0000","last_change":"2024-09-14T12:44:19.737083+0000","last_active":"2024-09-14T12:44:19.737083+0000","last_peered":"2024-09-14T12:44:19.737083+0000","last_clean":"2024-09-14T12:44:19.737083+0000","last_became_active":"2024-09-14T10:49:23.365341+0000","last_became_peered":"2024-09-14T10:49:23.365341+0000","last_unstale":"2024-09-14T12:44:19.737083+0000","last_undegraded":"2024-09-14T12:44:19.737083+0000","last_fullsized":"2024-09-14T12:44:19.737083+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-14T12:44:19.736779+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-14T12:44:19.736779+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.736779+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:24.797053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":685,"num_read_kb":37659,"num_write":1131,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.822470+0000","last_change":"2024-09-14T12:44:28.822470+0000","last_active":"2024-09-14T12:44:28.822470+0000","last_peered":"2024-09-14T12:44:28.822470+0000","last_clean":"2024-09-14T12:44:28.822470+0000","last_became_active":"2024-09-14T10:49:27.366990+0000","last_became_peered":"2024-09-14T10:49:27.366990+0000","last_unstale":"2024-09-14T12:44:28.822470+0000","last_undegraded":"2024-09-14T12:44:28.822470+0000","last_fullsized":"2024-09-14T12:44:28.822470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.822277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.822277+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.822277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:55.142780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'339","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.817196+0000","last_change":"2024-09-14T12:44:32.817196+0000","last_active":"2024-09-14T12:44:32.817196+0000","last_peered":"2024-09-14T12:44:32.817196+0000","last_clean":"2024-09-14T12:44:32.817196+0000","last_became_active":"2024-09-14T10:49:29.371655+0000","last_became_peered":"2024-09-14T10:49:29.371655+0000","last_unstale":"2024-09-14T12:44:32.817196+0000","last_undegraded":"2024-09-14T12:44:32.817196+0000","last_fullsized":"2024-09-14T12:44:32.817196+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'339","last_scrub_stamp":"2024-09-14T12:44:32.816993+0000","last_deep_scrub":"267'339","last_deep_scrub_stamp":"2024-09-14T12:44:32.816993+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.816993+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:27.300458+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49045,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":1185,"num_write":440,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.445889+0000","last_change":"2024-09-14T12:44:30.445889+0000","last_active":"2024-09-14T12:44:30.445889+0000","last_peered":"2024-09-14T12:44:30.445889+0000","last_clean":"2024-09-14T12:44:30.445889+0000","last_became_active":"2024-09-14T10:49:31.417675+0000","last_became_peered":"2024-09-14T10:49:31.417675+0000","last_unstale":"2024-09-14T12:44:30.445889+0000","last_undegraded":"2024-09-14T12:44:30.445889+0000","last_fullsized":"2024-09-14T12:44:30.445889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.445715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.445715+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.445715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:06.472746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'147","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.442177+0000","last_change":"2024-09-14T12:44:36.442177+0000","last_active":"2024-09-14T12:44:36.442177+0000","last_peered":"2024-09-14T12:44:36.442177+0000","last_clean":"2024-09-14T12:44:36.442177+0000","last_became_active":"2024-09-14T10:49:33.453630+0000","last_became_peered":"2024-09-14T10:49:33.453630+0000","last_unstale":"2024-09-14T12:44:36.442177+0000","last_undegraded":"2024-09-14T12:44:36.442177+0000","last_fullsized":"2024-09-14T12:44:36.442177+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-14T12:44:36.441978+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-14T12:44:36.441978+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.441978+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:04.829195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":363,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'723","reported_seq":2170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.861931+0000","last_change":"2024-09-14T12:44:20.861931+0000","last_active":"2024-09-14T12:44:20.861931+0000","last_peered":"2024-09-14T12:44:20.861931+0000","last_clean":"2024-09-14T12:44:20.861931+0000","last_became_active":"2024-09-14T10:49:25.373876+0000","last_became_peered":"2024-09-14T10:49:25.373876+0000","last_unstale":"2024-09-14T12:44:20.861931+0000","last_undegraded":"2024-09-14T12:44:20.861931+0000","last_fullsized":"2024-09-14T12:44:20.861931+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'723","last_scrub_stamp":"2024-09-14T12:44:20.861737+0000","last_deep_scrub":"267'723","last_deep_scrub_stamp":"2024-09-14T12:44:20.861737+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.861737+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.715221+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3124,"num_write":967,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'350","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.354231+0000","last_change":"2024-09-14T12:44:10.354231+0000","last_active":"2024-09-14T12:44:10.354231+0000","last_peered":"2024-09-14T12:44:10.354231+0000","last_clean":"2024-09-14T12:44:10.354231+0000","last_became_active":"2024-09-14T10:49:23.373206+0000","last_became_peered":"2024-09-14T10:49:23.373206+0000","last_unstale":"2024-09-14T12:44:10.354231+0000","last_undegraded":"2024-09-14T12:44:10.354231+0000","last_fullsized":"2024-09-14T12:44:10.354231+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.354149+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:26.010856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":656,"num_read_kb":34264,"num_write":1064,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.921353+0000","last_change":"2024-09-14T12:44:29.921353+0000","last_active":"2024-09-14T12:44:29.921353+0000","last_peered":"2024-09-14T12:44:29.921353+0000","last_clean":"2024-09-14T12:44:29.921353+0000","last_became_active":"2024-09-14T10:49:27.370174+0000","last_became_peered":"2024-09-14T10:49:27.370174+0000","last_unstale":"2024-09-14T12:44:29.921353+0000","last_undegraded":"2024-09-14T12:44:29.921353+0000","last_fullsized":"2024-09-14T12:44:29.921353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:29.921175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:29.921175+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.921175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.172813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'81","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.990154+0000","last_change":"2024-09-14T12:44:36.990154+0000","last_active":"2024-09-14T12:44:36.990154+0000","last_peered":"2024-09-14T12:44:36.990154+0000","last_clean":"2024-09-14T12:44:36.990154+0000","last_became_active":"2024-09-14T10:49:29.375761+0000","last_became_peered":"2024-09-14T10:49:29.375761+0000","last_unstale":"2024-09-14T12:44:36.990154+0000","last_undegraded":"2024-09-14T12:44:36.990154+0000","last_fullsized":"2024-09-14T12:44:36.990154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-14T12:44:36.989961+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-14T12:44:36.989961+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.989961+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:30.155450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.044701+0000","last_change":"2024-09-14T12:44:32.044701+0000","last_active":"2024-09-14T12:44:32.044701+0000","last_peered":"2024-09-14T12:44:32.044701+0000","last_clean":"2024-09-14T12:44:32.044701+0000","last_became_active":"2024-09-14T10:49:31.410915+0000","last_became_peered":"2024-09-14T10:49:31.410915+0000","last_unstale":"2024-09-14T12:44:32.044701+0000","last_undegraded":"2024-09-14T12:44:32.044701+0000","last_fullsized":"2024-09-14T12:44:32.044701+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.044515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.044515+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.044515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:08.562387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'183","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.890645+0000","last_change":"2024-09-14T12:44:40.890645+0000","last_active":"2024-09-14T12:44:40.890645+0000","last_peered":"2024-09-14T12:44:40.890645+0000","last_clean":"2024-09-14T12:44:40.890645+0000","last_became_active":"2024-09-14T10:49:33.453278+0000","last_became_peered":"2024-09-14T10:49:33.453278+0000","last_unstale":"2024-09-14T12:44:40.890645+0000","last_undegraded":"2024-09-14T12:44:40.890645+0000","last_fullsized":"2024-09-14T12:44:40.890645+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-14T12:44:40.890463+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-14T12:44:40.890463+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.890463+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.946061+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":265,"num_write":381,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'434","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.823436+0000","last_change":"2024-09-14T12:44:19.823436+0000","last_active":"2024-09-14T12:44:19.823436+0000","last_peered":"2024-09-14T12:44:19.823436+0000","last_clean":"2024-09-14T12:44:19.823436+0000","last_became_active":"2024-09-14T10:49:25.353010+0000","last_became_peered":"2024-09-14T10:49:25.353010+0000","last_unstale":"2024-09-14T12:44:19.823436+0000","last_undegraded":"2024-09-14T12:44:19.823436+0000","last_fullsized":"2024-09-14T12:44:19.823436+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T12:44:19.823256+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T12:44:19.823256+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.823256+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:53.762038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2606,"num_read_kb":2470,"num_write":495,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2789,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'374","reported_seq":1101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.874359+0000","last_change":"2024-09-14T12:44:12.874359+0000","last_active":"2024-09-14T12:44:12.874359+0000","last_peered":"2024-09-14T12:44:12.874359+0000","last_clean":"2024-09-14T12:44:12.874359+0000","last_became_active":"2024-09-14T10:49:23.403718+0000","last_became_peered":"2024-09-14T10:49:23.403718+0000","last_unstale":"2024-09-14T12:44:12.874359+0000","last_undegraded":"2024-09-14T12:44:12.874359+0000","last_fullsized":"2024-09-14T12:44:12.874359+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:12.874166+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:12.874166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.874166+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.218268+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":743,"num_read_kb":4167,"num_write":1078,"num_write_kb":34340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.937501+0000","last_change":"2024-09-14T12:44:25.937501+0000","last_active":"2024-09-14T12:44:25.937501+0000","last_peered":"2024-09-14T12:44:25.937501+0000","last_clean":"2024-09-14T12:44:25.937501+0000","last_became_active":"2024-09-14T10:49:27.377584+0000","last_became_peered":"2024-09-14T10:49:27.377584+0000","last_unstale":"2024-09-14T12:44:25.937501+0000","last_undegraded":"2024-09-14T12:44:25.937501+0000","last_fullsized":"2024-09-14T12:44:25.937501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:25.937326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:25.937326+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.937326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:22:46.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'391","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.463215+0000","last_change":"2024-09-14T12:44:28.463215+0000","last_active":"2024-09-14T12:44:28.463215+0000","last_peered":"2024-09-14T12:44:28.463215+0000","last_clean":"2024-09-14T12:44:28.463215+0000","last_became_active":"2024-09-14T10:49:29.389523+0000","last_became_peered":"2024-09-14T10:49:29.389523+0000","last_unstale":"2024-09-14T12:44:28.463215+0000","last_undegraded":"2024-09-14T12:44:28.463215+0000","last_fullsized":"2024-09-14T12:44:28.463215+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:28.462999+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:28.462999+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.462999+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:51.561087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":1411,"num_write":516,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.976410+0000","last_change":"2024-09-14T12:44:32.976410+0000","last_active":"2024-09-14T12:44:32.976410+0000","last_peered":"2024-09-14T12:44:32.976410+0000","last_clean":"2024-09-14T12:44:32.976410+0000","last_became_active":"2024-09-14T10:49:31.422113+0000","last_became_peered":"2024-09-14T10:49:31.422113+0000","last_unstale":"2024-09-14T12:44:32.976410+0000","last_undegraded":"2024-09-14T12:44:32.976410+0000","last_fullsized":"2024-09-14T12:44:32.976410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.976323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.976323+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.976323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:04.712094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'155","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:55.584787+0000","last_change":"2024-09-14T12:44:55.584787+0000","last_active":"2024-09-14T12:44:55.584787+0000","last_peered":"2024-09-14T12:44:55.584787+0000","last_clean":"2024-09-14T12:44:55.584787+0000","last_became_active":"2024-09-14T10:49:33.475156+0000","last_became_peered":"2024-09-14T10:49:33.475156+0000","last_unstale":"2024-09-14T12:44:55.584787+0000","last_undegraded":"2024-09-14T12:44:55.584787+0000","last_fullsized":"2024-09-14T12:44:55.584787+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-14T12:44:55.584598+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-14T12:44:55.584598+0000","last_clean_scrub_stamp":"2024-09-14T12:44:55.584598+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.185306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'414","reported_seq":2104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.582365+0000","last_change":"2024-09-14T12:44:15.582365+0000","last_active":"2024-09-14T12:44:15.582365+0000","last_peered":"2024-09-14T12:44:15.582365+0000","last_clean":"2024-09-14T12:44:15.582365+0000","last_became_active":"2024-09-14T10:49:25.370901+0000","last_became_peered":"2024-09-14T10:49:25.370901+0000","last_unstale":"2024-09-14T12:44:15.582365+0000","last_undegraded":"2024-09-14T12:44:15.582365+0000","last_fullsized":"2024-09-14T12:44:15.582365+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-14T12:44:15.582102+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-14T12:44:15.582102+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.582102+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.776690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2274,"num_write":465,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'391","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.879398+0000","last_change":"2024-09-14T12:44:13.879398+0000","last_active":"2024-09-14T12:44:13.879398+0000","last_peered":"2024-09-14T12:44:13.879398+0000","last_clean":"2024-09-14T12:44:13.879398+0000","last_became_active":"2024-09-14T10:49:23.369669+0000","last_became_peered":"2024-09-14T10:49:23.369669+0000","last_unstale":"2024-09-14T12:44:13.879398+0000","last_undegraded":"2024-09-14T12:44:13.879398+0000","last_fullsized":"2024-09-14T12:44:13.879398+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:13.879160+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:13.879160+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.879160+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:49.729813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":9973,"num_write":1367,"num_write_kb":36861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.654516+0000","last_change":"2024-09-14T12:44:39.654516+0000","last_active":"2024-09-14T12:44:39.654516+0000","last_peered":"2024-09-14T12:44:39.654516+0000","last_clean":"2024-09-14T12:44:39.654516+0000","last_became_active":"2024-09-14T10:49:27.387840+0000","last_became_peered":"2024-09-14T10:49:27.387840+0000","last_unstale":"2024-09-14T12:44:39.654516+0000","last_undegraded":"2024-09-14T12:44:39.654516+0000","last_fullsized":"2024-09-14T12:44:39.654516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:39.654319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:39.654319+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.654319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:54.984917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'326","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.095208+0000","last_change":"2024-09-14T12:44:31.095208+0000","last_active":"2024-09-14T12:44:31.095208+0000","last_peered":"2024-09-14T12:44:31.095208+0000","last_clean":"2024-09-14T12:44:31.095208+0000","last_became_active":"2024-09-14T10:49:29.391517+0000","last_became_peered":"2024-09-14T10:49:29.391517+0000","last_unstale":"2024-09-14T12:44:31.095208+0000","last_undegraded":"2024-09-14T12:44:31.095208+0000","last_fullsized":"2024-09-14T12:44:31.095208+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-14T12:44:31.095032+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-14T12:44:31.095032+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.095032+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:29.436997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1347,"num_write":436,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.446579+0000","last_change":"2024-09-14T12:44:32.446579+0000","last_active":"2024-09-14T12:44:32.446579+0000","last_peered":"2024-09-14T12:44:32.446579+0000","last_clean":"2024-09-14T12:44:32.446579+0000","last_became_active":"2024-09-14T10:49:31.410633+0000","last_became_peered":"2024-09-14T10:49:31.410633+0000","last_unstale":"2024-09-14T12:44:32.446579+0000","last_undegraded":"2024-09-14T12:44:32.446579+0000","last_fullsized":"2024-09-14T12:44:32.446579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.446388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.446388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.446388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:13.501051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'751","reported_seq":2295,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.670411+0000","last_change":"2024-09-14T12:44:32.670411+0000","last_active":"2024-09-14T12:44:32.670411+0000","last_peered":"2024-09-14T12:44:32.670411+0000","last_clean":"2024-09-14T12:44:32.670411+0000","last_became_active":"2024-09-14T10:49:25.408028+0000","last_became_peered":"2024-09-14T10:49:25.408028+0000","last_unstale":"2024-09-14T12:44:32.670411+0000","last_undegraded":"2024-09-14T12:44:32.670411+0000","last_fullsized":"2024-09-14T12:44:32.670411+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-14T12:44:32.670221+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-14T12:44:32.670221+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.670221+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:57.489984+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3658,"num_read_kb":3304,"num_write":985,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'372","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.827233+0000","last_change":"2024-09-14T12:44:16.827233+0000","last_active":"2024-09-14T12:44:16.827233+0000","last_peered":"2024-09-14T12:44:16.827233+0000","last_clean":"2024-09-14T12:44:16.827233+0000","last_became_active":"2024-09-14T10:49:23.386404+0000","last_became_peered":"2024-09-14T10:49:23.386404+0000","last_unstale":"2024-09-14T12:44:16.827233+0000","last_undegraded":"2024-09-14T12:44:16.827233+0000","last_fullsized":"2024-09-14T12:44:16.827233+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-09-14T12:44:16.827021+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-09-14T12:44:16.827021+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.827021+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:13.386836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":6911,"num_write":1204,"num_write_kb":32272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"267'4","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.816334+0000","last_change":"2024-09-14T12:44:31.816334+0000","last_active":"2024-09-14T12:44:31.816334+0000","last_peered":"2024-09-14T12:44:31.816334+0000","last_clean":"2024-09-14T12:44:31.816334+0000","last_became_active":"2024-09-14T10:49:27.381931+0000","last_became_peered":"2024-09-14T10:49:27.381931+0000","last_unstale":"2024-09-14T12:44:31.816334+0000","last_undegraded":"2024-09-14T12:44:31.816334+0000","last_fullsized":"2024-09-14T12:44:31.816334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:31.816149+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:31.816149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.816149+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:16.372632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'562","reported_seq":1243,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.789977+0000","last_change":"2024-09-14T12:44:34.789977+0000","last_active":"2024-09-14T12:44:34.789977+0000","last_peered":"2024-09-14T12:44:34.789977+0000","last_clean":"2024-09-14T12:44:34.789977+0000","last_became_active":"2024-09-14T10:49:29.364013+0000","last_became_peered":"2024-09-14T10:49:29.364013+0000","last_unstale":"2024-09-14T12:44:34.789977+0000","last_undegraded":"2024-09-14T12:44:34.789977+0000","last_fullsized":"2024-09-14T12:44:34.789977+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'562","last_scrub_stamp":"2024-09-14T12:44:34.789779+0000","last_deep_scrub":"267'562","last_deep_scrub_stamp":"2024-09-14T12:44:34.789779+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.789779+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:50.715654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98236,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":964,"num_read_kb":2193,"num_write":836,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.058334+0000","last_change":"2024-09-14T12:44:33.058215+0000","last_active":"2024-09-14T12:44:33.058334+0000","last_peered":"2024-09-14T12:44:33.058334+0000","last_clean":"2024-09-14T12:44:33.058334+0000","last_became_active":"2024-09-14T10:49:31.431550+0000","last_became_peered":"2024-09-14T10:49:31.431550+0000","last_unstale":"2024-09-14T12:44:33.058334+0000","last_undegraded":"2024-09-14T12:44:33.058334+0000","last_fullsized":"2024-09-14T12:44:33.058334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:33.058048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:33.058048+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.058048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:28.024232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'164","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.778843+0000","last_change":"2024-09-14T12:44:48.778843+0000","last_active":"2024-09-14T12:44:48.778843+0000","last_peered":"2024-09-14T12:44:48.778843+0000","last_clean":"2024-09-14T12:44:48.778843+0000","last_became_active":"2024-09-14T10:49:33.466424+0000","last_became_peered":"2024-09-14T10:49:33.466424+0000","last_unstale":"2024-09-14T12:44:48.778843+0000","last_undegraded":"2024-09-14T12:44:48.778843+0000","last_fullsized":"2024-09-14T12:44:48.778843+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'164","last_scrub_stamp":"2024-09-14T12:44:48.778544+0000","last_deep_scrub":"267'164","last_deep_scrub_stamp":"2024-09-14T12:44:48.778544+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.778544+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:06.494723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":247,"num_write":384,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'833","reported_seq":2415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.875239+0000","last_change":"2024-09-14T12:44:22.875239+0000","last_active":"2024-09-14T12:44:22.875239+0000","last_peered":"2024-09-14T12:44:22.875239+0000","last_clean":"2024-09-14T12:44:22.875239+0000","last_became_active":"2024-09-14T10:49:25.364958+0000","last_became_peered":"2024-09-14T10:49:25.364958+0000","last_unstale":"2024-09-14T12:44:22.875239+0000","last_undegraded":"2024-09-14T12:44:22.875239+0000","last_fullsized":"2024-09-14T12:44:22.875239+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'833","last_scrub_stamp":"2024-09-14T12:44:22.875065+0000","last_deep_scrub":"267'833","last_deep_scrub_stamp":"2024-09-14T12:44:22.875065+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.875065+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.794954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3911,"num_read_kb":3508,"num_write":1119,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'415","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.788261+0000","last_change":"2024-09-14T12:44:14.788261+0000","last_active":"2024-09-14T12:44:14.788261+0000","last_peered":"2024-09-14T12:44:14.788261+0000","last_clean":"2024-09-14T12:44:14.788261+0000","last_became_active":"2024-09-14T10:49:23.375310+0000","last_became_peered":"2024-09-14T10:49:23.375310+0000","last_unstale":"2024-09-14T12:44:14.788261+0000","last_undegraded":"2024-09-14T12:44:14.788261+0000","last_fullsized":"2024-09-14T12:44:14.788261+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'415","last_scrub_stamp":"2024-09-14T12:44:14.788046+0000","last_deep_scrub":"267'415","last_deep_scrub_stamp":"2024-09-14T12:44:14.788046+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.788046+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:33.478823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":827,"num_read_kb":30368,"num_write":1218,"num_write_kb":52321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"267'6","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.896401+0000","last_change":"2024-09-14T12:44:26.896401+0000","last_active":"2024-09-14T12:44:26.896401+0000","last_peered":"2024-09-14T12:44:26.896401+0000","last_clean":"2024-09-14T12:44:26.896401+0000","last_became_active":"2024-09-14T10:49:27.386412+0000","last_became_peered":"2024-09-14T10:49:27.386412+0000","last_unstale":"2024-09-14T12:44:26.896401+0000","last_undegraded":"2024-09-14T12:44:26.896401+0000","last_fullsized":"2024-09-14T12:44:26.896401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:44:26.896175+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:44:26.896175+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.896175+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:02.056846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'366","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.588847+0000","last_change":"2024-09-14T12:44:45.588847+0000","last_active":"2024-09-14T12:44:45.588847+0000","last_peered":"2024-09-14T12:44:45.588847+0000","last_clean":"2024-09-14T12:44:45.588847+0000","last_became_active":"2024-09-14T10:49:29.388370+0000","last_became_peered":"2024-09-14T10:49:29.388370+0000","last_unstale":"2024-09-14T12:44:45.588847+0000","last_undegraded":"2024-09-14T12:44:45.588847+0000","last_fullsized":"2024-09-14T12:44:45.588847+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-14T12:44:45.588589+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-14T12:44:45.588589+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.588589+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:21.697378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46292,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":1047,"num_write":462,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.906350+0000","last_change":"2024-09-14T12:44:43.906350+0000","last_active":"2024-09-14T12:44:43.906350+0000","last_peered":"2024-09-14T12:44:43.906350+0000","last_clean":"2024-09-14T12:44:43.906350+0000","last_became_active":"2024-09-14T10:49:31.429861+0000","last_became_peered":"2024-09-14T10:49:31.429861+0000","last_unstale":"2024-09-14T12:44:43.906350+0000","last_undegraded":"2024-09-14T12:44:43.906350+0000","last_fullsized":"2024-09-14T12:44:43.906350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.906177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.906177+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.906177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.207899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'285","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:58.598680+0000","last_change":"2024-09-14T12:44:58.598680+0000","last_active":"2024-09-14T12:44:58.598680+0000","last_peered":"2024-09-14T12:44:58.598680+0000","last_clean":"2024-09-14T12:44:58.598680+0000","last_became_active":"2024-09-14T10:49:33.446698+0000","last_became_peered":"2024-09-14T10:49:33.446698+0000","last_unstale":"2024-09-14T12:44:58.598680+0000","last_undegraded":"2024-09-14T12:44:58.598680+0000","last_fullsized":"2024-09-14T12:44:58.598680+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-14T12:44:58.598421+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-14T12:44:58.598421+0000","last_clean_scrub_stamp":"2024-09-14T12:44:58.598421+0000","objects_scrubbed":7,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:28.124368+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":288,"num_write":643,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'447","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.545524+0000","last_change":"2024-09-14T12:44:17.545357+0000","last_active":"2024-09-14T12:44:17.545524+0000","last_peered":"2024-09-14T12:44:17.545524+0000","last_clean":"2024-09-14T12:44:17.545524+0000","last_became_active":"2024-09-14T10:49:25.395644+0000","last_became_peered":"2024-09-14T10:49:25.395644+0000","last_unstale":"2024-09-14T12:44:17.545524+0000","last_undegraded":"2024-09-14T12:44:17.545524+0000","last_fullsized":"2024-09-14T12:44:17.545524+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-14T12:44:17.545155+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-14T12:44:17.545155+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.545155+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:13.025501+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2723,"num_read_kb":2577,"num_write":520,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4341,"num_omap_keys":17,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'336","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.899355+0000","last_change":"2024-09-14T12:44:12.899210+0000","last_active":"2024-09-14T12:44:12.899355+0000","last_peered":"2024-09-14T12:44:12.899355+0000","last_clean":"2024-09-14T12:44:12.899355+0000","last_became_active":"2024-09-14T10:49:23.394870+0000","last_became_peered":"2024-09-14T10:49:23.394870+0000","last_unstale":"2024-09-14T12:44:12.899355+0000","last_undegraded":"2024-09-14T12:44:12.899355+0000","last_fullsized":"2024-09-14T12:44:12.899355+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-14T12:44:12.898987+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-14T12:44:12.898987+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.898987+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:41.227802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":18368,"num_write":1090,"num_write_kb":30203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.945577+0000","last_change":"2024-09-14T12:44:28.945449+0000","last_active":"2024-09-14T12:44:28.945577+0000","last_peered":"2024-09-14T12:44:28.945577+0000","last_clean":"2024-09-14T12:44:28.945577+0000","last_became_active":"2024-09-14T10:49:27.385720+0000","last_became_peered":"2024-09-14T10:49:27.385720+0000","last_unstale":"2024-09-14T12:44:28.945577+0000","last_undegraded":"2024-09-14T12:44:28.945577+0000","last_fullsized":"2024-09-14T12:44:28.945577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.945269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.945269+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.945269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:03.455314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'343","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.781739+0000","last_change":"2024-09-14T12:44:35.781739+0000","last_active":"2024-09-14T12:44:35.781739+0000","last_peered":"2024-09-14T12:44:35.781739+0000","last_clean":"2024-09-14T12:44:35.781739+0000","last_became_active":"2024-09-14T10:49:29.363989+0000","last_became_peered":"2024-09-14T10:49:29.363989+0000","last_unstale":"2024-09-14T12:44:35.781739+0000","last_undegraded":"2024-09-14T12:44:35.781739+0000","last_fullsized":"2024-09-14T12:44:35.781739+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-14T12:44:35.781529+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-14T12:44:35.781529+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.781529+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:24.488305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1124,"num_write":422,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.464325+0000","last_change":"2024-09-14T12:44:33.464325+0000","last_active":"2024-09-14T12:44:33.464325+0000","last_peered":"2024-09-14T12:44:33.464325+0000","last_clean":"2024-09-14T12:44:33.464325+0000","last_became_active":"2024-09-14T10:49:31.421636+0000","last_became_peered":"2024-09-14T10:49:31.421636+0000","last_unstale":"2024-09-14T12:44:33.464325+0000","last_undegraded":"2024-09-14T12:44:33.464325+0000","last_fullsized":"2024-09-14T12:44:33.464325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:33.464135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:33.464135+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.464135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:54.819362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'131","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.540081+0000","last_change":"2024-09-14T12:44:54.540081+0000","last_active":"2024-09-14T12:44:54.540081+0000","last_peered":"2024-09-14T12:44:54.540081+0000","last_clean":"2024-09-14T12:44:54.540081+0000","last_became_active":"2024-09-14T10:49:33.465638+0000","last_became_peered":"2024-09-14T10:49:33.465638+0000","last_unstale":"2024-09-14T12:44:54.540081+0000","last_undegraded":"2024-09-14T12:44:54.540081+0000","last_fullsized":"2024-09-14T12:44:54.540081+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-14T12:44:54.539847+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-14T12:44:54.539847+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.539847+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:59.713807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'571","reported_seq":2236,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.880853+0000","last_change":"2024-09-14T12:44:21.880578+0000","last_active":"2024-09-14T12:44:21.880853+0000","last_peered":"2024-09-14T12:44:21.880853+0000","last_clean":"2024-09-14T12:44:21.880853+0000","last_became_active":"2024-09-14T10:49:25.383840+0000","last_became_peered":"2024-09-14T10:49:25.383840+0000","last_unstale":"2024-09-14T12:44:21.880853+0000","last_undegraded":"2024-09-14T12:44:21.880853+0000","last_fullsized":"2024-09-14T12:44:21.880853+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'571","last_scrub_stamp":"2024-09-14T12:44:21.880347+0000","last_deep_scrub":"267'571","last_deep_scrub_stamp":"2024-09-14T12:44:21.880347+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.880347+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:27.080812+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2923,"num_read_kb":2712,"num_write":720,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'483","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.844983+0000","last_change":"2024-09-14T12:44:16.844845+0000","last_active":"2024-09-14T12:44:16.844983+0000","last_peered":"2024-09-14T12:44:16.844983+0000","last_clean":"2024-09-14T12:44:16.844983+0000","last_became_active":"2024-09-14T10:49:23.338934+0000","last_became_peered":"2024-09-14T10:49:23.338934+0000","last_unstale":"2024-09-14T12:44:16.844983+0000","last_undegraded":"2024-09-14T12:44:16.844983+0000","last_fullsized":"2024-09-14T12:44:16.844983+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'483","last_scrub_stamp":"2024-09-14T12:44:16.844628+0000","last_deep_scrub":"267'483","last_deep_scrub_stamp":"2024-09-14T12:44:16.844628+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.844628+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.573418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":33265,"num_write":1328,"num_write_kb":49842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.061095+0000","last_change":"2024-09-14T12:44:35.061095+0000","last_active":"2024-09-14T12:44:35.061095+0000","last_peered":"2024-09-14T12:44:35.061095+0000","last_clean":"2024-09-14T12:44:35.061095+0000","last_became_active":"2024-09-14T10:49:27.368567+0000","last_became_peered":"2024-09-14T10:49:27.368567+0000","last_unstale":"2024-09-14T12:44:35.061095+0000","last_undegraded":"2024-09-14T12:44:35.061095+0000","last_fullsized":"2024-09-14T12:44:35.061095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:35.060889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:35.060889+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.060889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:24.593261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'156","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.541873+0000","last_change":"2024-09-14T12:44:48.541873+0000","last_active":"2024-09-14T12:44:48.541873+0000","last_peered":"2024-09-14T12:44:48.541873+0000","last_clean":"2024-09-14T12:44:48.541873+0000","last_became_active":"2024-09-14T10:49:29.392965+0000","last_became_peered":"2024-09-14T10:49:29.392965+0000","last_unstale":"2024-09-14T12:44:48.541873+0000","last_undegraded":"2024-09-14T12:44:48.541873+0000","last_fullsized":"2024-09-14T12:44:48.541873+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-14T12:44:48.541678+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-14T12:44:48.541678+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.541678+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:48.747164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":187,"num_read_kb":181,"num_write":132,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'792","reported_seq":3274,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.088048+0000","last_change":"2024-09-14T12:44:35.088048+0000","last_active":"2024-09-14T12:44:35.088048+0000","last_peered":"2024-09-14T12:44:35.088048+0000","last_clean":"2024-09-14T12:44:35.088048+0000","last_became_active":"2024-09-14T10:49:31.422765+0000","last_became_peered":"2024-09-14T10:49:31.422765+0000","last_unstale":"2024-09-14T12:44:35.088048+0000","last_undegraded":"2024-09-14T12:44:35.088048+0000","last_fullsized":"2024-09-14T12:44:35.088048+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'792","last_scrub_stamp":"2024-09-14T12:44:35.087864+0000","last_deep_scrub":"267'792","last_deep_scrub_stamp":"2024-09-14T12:44:35.087864+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.087864+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:04.440955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'101","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.556952+0000","last_change":"2024-09-14T12:44:52.556952+0000","last_active":"2024-09-14T12:44:52.556952+0000","last_peered":"2024-09-14T12:44:52.556952+0000","last_clean":"2024-09-14T12:44:52.556952+0000","last_became_active":"2024-09-14T10:49:33.443020+0000","last_became_peered":"2024-09-14T10:49:33.443020+0000","last_unstale":"2024-09-14T12:44:52.556952+0000","last_undegraded":"2024-09-14T12:44:52.556952+0000","last_fullsized":"2024-09-14T12:44:52.556952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'101","last_scrub_stamp":"2024-09-14T12:44:52.556752+0000","last_deep_scrub":"267'101","last_deep_scrub_stamp":"2024-09-14T12:44:52.556752+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.556752+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:29.201815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":233,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'970","reported_seq":2593,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.816889+0000","last_change":"2024-09-14T12:44:21.816713+0000","last_active":"2024-09-14T12:44:21.816889+0000","last_peered":"2024-09-14T12:44:21.816889+0000","last_clean":"2024-09-14T12:44:21.816889+0000","last_became_active":"2024-09-14T10:49:25.400786+0000","last_became_peered":"2024-09-14T10:49:25.400786+0000","last_unstale":"2024-09-14T12:44:21.816889+0000","last_undegraded":"2024-09-14T12:44:21.816889+0000","last_fullsized":"2024-09-14T12:44:21.816889+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'970","last_scrub_stamp":"2024-09-14T12:44:21.816523+0000","last_deep_scrub":"267'970","last_deep_scrub_stamp":"2024-09-14T12:44:21.816523+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.816523+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:09.527962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4481,"num_read_kb":3955,"num_write":1321,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'333","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.924005+0000","last_change":"2024-09-14T12:44:11.923935+0000","last_active":"2024-09-14T12:44:11.924005+0000","last_peered":"2024-09-14T12:44:11.924005+0000","last_clean":"2024-09-14T12:44:11.924005+0000","last_became_active":"2024-09-14T10:49:23.394973+0000","last_became_peered":"2024-09-14T10:49:23.394973+0000","last_unstale":"2024-09-14T12:44:11.924005+0000","last_undegraded":"2024-09-14T12:44:11.924005+0000","last_fullsized":"2024-09-14T12:44:11.924005+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-14T12:44:11.923816+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-14T12:44:11.923816+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.923816+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:11.570601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":75765,"num_write":1031,"num_write_kb":39860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.012498+0000","last_change":"2024-09-14T12:44:28.012242+0000","last_active":"2024-09-14T12:44:28.012498+0000","last_peered":"2024-09-14T12:44:28.012498+0000","last_clean":"2024-09-14T12:44:28.012498+0000","last_became_active":"2024-09-14T10:49:27.377395+0000","last_became_peered":"2024-09-14T10:49:27.377395+0000","last_unstale":"2024-09-14T12:44:28.012498+0000","last_undegraded":"2024-09-14T12:44:28.012498+0000","last_fullsized":"2024-09-14T12:44:28.012498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.011952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.011952+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.011952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:18.742458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'402","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.112814+0000","last_change":"2024-09-14T12:44:32.112814+0000","last_active":"2024-09-14T12:44:32.112814+0000","last_peered":"2024-09-14T12:44:32.112814+0000","last_clean":"2024-09-14T12:44:32.112814+0000","last_became_active":"2024-09-14T10:49:29.376813+0000","last_became_peered":"2024-09-14T10:49:29.376813+0000","last_unstale":"2024-09-14T12:44:32.112814+0000","last_undegraded":"2024-09-14T12:44:32.112814+0000","last_fullsized":"2024-09-14T12:44:32.112814+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:32.112560+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:32.112560+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.112560+0000","objects_scrubbed":9,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.095209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":628,"num_read_kb":1214,"num_write":492,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.844904+0000","last_change":"2024-09-14T12:44:43.844904+0000","last_active":"2024-09-14T12:44:43.844904+0000","last_peered":"2024-09-14T12:44:43.844904+0000","last_clean":"2024-09-14T12:44:43.844904+0000","last_became_active":"2024-09-14T10:49:31.424394+0000","last_became_peered":"2024-09-14T10:49:31.424394+0000","last_unstale":"2024-09-14T12:44:43.844904+0000","last_undegraded":"2024-09-14T12:44:43.844904+0000","last_fullsized":"2024-09-14T12:44:43.844904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.844695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.844695+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.844695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:32.714429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'154","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.960158+0000","last_change":"2024-09-14T12:44:38.960158+0000","last_active":"2024-09-14T12:44:38.960158+0000","last_peered":"2024-09-14T12:44:38.960158+0000","last_clean":"2024-09-14T12:44:38.960158+0000","last_became_active":"2024-09-14T10:49:33.462582+0000","last_became_peered":"2024-09-14T10:49:33.462582+0000","last_unstale":"2024-09-14T12:44:38.960158+0000","last_undegraded":"2024-09-14T12:44:38.960158+0000","last_fullsized":"2024-09-14T12:44:38.960158+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'154","last_scrub_stamp":"2024-09-14T12:44:38.959922+0000","last_deep_scrub":"267'154","last_deep_scrub_stamp":"2024-09-14T12:44:38.959922+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.959922+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.366755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":151,"num_write":347,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'490","reported_seq":2237,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.838896+0000","last_change":"2024-09-14T12:44:22.838759+0000","last_active":"2024-09-14T12:44:22.838896+0000","last_peered":"2024-09-14T12:44:22.838896+0000","last_clean":"2024-09-14T12:44:22.838896+0000","last_became_active":"2024-09-14T10:49:25.386937+0000","last_became_peered":"2024-09-14T10:49:25.386937+0000","last_unstale":"2024-09-14T12:44:22.838896+0000","last_undegraded":"2024-09-14T12:44:22.838896+0000","last_fullsized":"2024-09-14T12:44:22.838896+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-14T12:44:22.838569+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-14T12:44:22.838569+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.838569+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:03.633378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2676,"num_write":566,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'362","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.713951+0000","last_change":"2024-09-14T12:44:20.713683+0000","last_active":"2024-09-14T12:44:20.713951+0000","last_peered":"2024-09-14T12:44:20.713951+0000","last_clean":"2024-09-14T12:44:20.713951+0000","last_became_active":"2024-09-14T10:49:53.505479+0000","last_became_peered":"2024-09-14T10:49:53.505479+0000","last_unstale":"2024-09-14T12:44:20.713951+0000","last_undegraded":"2024-09-14T12:44:20.713951+0000","last_fullsized":"2024-09-14T12:44:20.713951+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-14T12:44:20.713333+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-14T12:44:20.713333+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.713333+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:04.232788+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3150208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":68230,"num_write":1159,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1,6],"acting":[3,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.889000+0000","last_change":"2024-09-14T12:44:24.888871+0000","last_active":"2024-09-14T12:44:24.889000+0000","last_peered":"2024-09-14T12:44:24.889000+0000","last_clean":"2024-09-14T12:44:24.889000+0000","last_became_active":"2024-09-14T10:49:27.371450+0000","last_became_peered":"2024-09-14T10:49:27.371450+0000","last_unstale":"2024-09-14T12:44:24.889000+0000","last_undegraded":"2024-09-14T12:44:24.889000+0000","last_fullsized":"2024-09-14T12:44:24.889000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.888693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.888693+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.888693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:48.211818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'305","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.885606+0000","last_change":"2024-09-14T12:44:39.885606+0000","last_active":"2024-09-14T12:44:39.885606+0000","last_peered":"2024-09-14T12:44:39.885606+0000","last_clean":"2024-09-14T12:44:39.885606+0000","last_became_active":"2024-09-14T10:49:29.379942+0000","last_became_peered":"2024-09-14T10:49:29.379942+0000","last_unstale":"2024-09-14T12:44:39.885606+0000","last_undegraded":"2024-09-14T12:44:39.885606+0000","last_fullsized":"2024-09-14T12:44:39.885606+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'305","last_scrub_stamp":"2024-09-14T12:44:39.885357+0000","last_deep_scrub":"267'305","last_deep_scrub_stamp":"2024-09-14T12:44:39.885357+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.885357+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:40.991849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1051,"num_write":386,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.539280+0000","last_change":"2024-09-14T12:44:50.539280+0000","last_active":"2024-09-14T12:44:50.539280+0000","last_peered":"2024-09-14T12:44:50.539280+0000","last_clean":"2024-09-14T12:44:50.539280+0000","last_became_active":"2024-09-14T10:49:31.424882+0000","last_became_peered":"2024-09-14T10:49:31.424882+0000","last_unstale":"2024-09-14T12:44:50.539280+0000","last_undegraded":"2024-09-14T12:44:50.539280+0000","last_fullsized":"2024-09-14T12:44:50.539280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:50.539102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:50.539102+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.539102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:57.508334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'116","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.817966+0000","last_change":"2024-09-14T12:44:49.817966+0000","last_active":"2024-09-14T12:44:49.817966+0000","last_peered":"2024-09-14T12:44:49.817966+0000","last_clean":"2024-09-14T12:44:49.817966+0000","last_became_active":"2024-09-14T10:49:33.468026+0000","last_became_peered":"2024-09-14T10:49:33.468026+0000","last_unstale":"2024-09-14T12:44:49.817966+0000","last_undegraded":"2024-09-14T12:44:49.817966+0000","last_fullsized":"2024-09-14T12:44:49.817966+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-14T12:44:49.817767+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-14T12:44:49.817767+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.817767+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:17.594684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":167,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'980","reported_seq":2681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.498418+0000","last_change":"2024-09-14T12:44:18.498418+0000","last_active":"2024-09-14T12:44:18.498418+0000","last_peered":"2024-09-14T12:44:18.498418+0000","last_clean":"2024-09-14T12:44:18.498418+0000","last_became_active":"2024-09-14T10:49:25.386168+0000","last_became_peered":"2024-09-14T10:49:25.386168+0000","last_unstale":"2024-09-14T12:44:18.498418+0000","last_undegraded":"2024-09-14T12:44:18.498418+0000","last_fullsized":"2024-09-14T12:44:18.498418+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'980","last_scrub_stamp":"2024-09-14T12:44:18.498226+0000","last_deep_scrub":"267'980","last_deep_scrub_stamp":"2024-09-14T12:44:18.498226+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.498226+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":900,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:55.963844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4881,"num_read_kb":4356,"num_write":1346,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'333","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.874395+0000","last_change":"2024-09-14T12:44:14.874395+0000","last_active":"2024-09-14T12:44:14.874395+0000","last_peered":"2024-09-14T12:44:14.874395+0000","last_clean":"2024-09-14T12:44:14.874395+0000","last_became_active":"2024-09-14T10:49:23.367940+0000","last_became_peered":"2024-09-14T10:49:23.367940+0000","last_unstale":"2024-09-14T12:44:14.874395+0000","last_undegraded":"2024-09-14T12:44:14.874395+0000","last_fullsized":"2024-09-14T12:44:14.874395+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-14T12:44:14.874116+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-14T12:44:14.874116+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.874116+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:30.960138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":29401,"num_write":1062,"num_write_kb":29053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.057865+0000","last_change":"2024-09-14T12:44:27.057865+0000","last_active":"2024-09-14T12:44:27.057865+0000","last_peered":"2024-09-14T12:44:27.057865+0000","last_clean":"2024-09-14T12:44:27.057865+0000","last_became_active":"2024-09-14T10:49:27.380333+0000","last_became_peered":"2024-09-14T10:49:27.380333+0000","last_unstale":"2024-09-14T12:44:27.057865+0000","last_undegraded":"2024-09-14T12:44:27.057865+0000","last_fullsized":"2024-09-14T12:44:27.057865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.057679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.057679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.057679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:58.978461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'245","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.803683+0000","last_change":"2024-09-14T12:44:33.803683+0000","last_active":"2024-09-14T12:44:33.803683+0000","last_peered":"2024-09-14T12:44:33.803683+0000","last_clean":"2024-09-14T12:44:33.803683+0000","last_became_active":"2024-09-14T10:49:29.377643+0000","last_became_peered":"2024-09-14T10:49:29.377643+0000","last_unstale":"2024-09-14T12:44:33.803683+0000","last_undegraded":"2024-09-14T12:44:33.803683+0000","last_fullsized":"2024-09-14T12:44:33.803683+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-14T12:44:33.803469+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-14T12:44:33.803469+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.803469+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:10.902639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":877,"num_write":306,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.526856+0000","last_change":"2024-09-14T12:44:53.526856+0000","last_active":"2024-09-14T12:44:53.526856+0000","last_peered":"2024-09-14T12:44:53.526856+0000","last_clean":"2024-09-14T12:44:53.526856+0000","last_became_active":"2024-09-14T10:49:31.430693+0000","last_became_peered":"2024-09-14T10:49:31.430693+0000","last_unstale":"2024-09-14T12:44:53.526856+0000","last_undegraded":"2024-09-14T12:44:53.526856+0000","last_fullsized":"2024-09-14T12:44:53.526856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:53.526747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:53.526747+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.526747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:31:52.062045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'160","reported_seq":1654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:56.561075+0000","last_change":"2024-09-14T12:44:56.561075+0000","last_active":"2024-09-14T12:44:56.561075+0000","last_peered":"2024-09-14T12:44:56.561075+0000","last_clean":"2024-09-14T12:44:56.561075+0000","last_became_active":"2024-09-14T10:49:33.475592+0000","last_became_peered":"2024-09-14T10:49:33.475592+0000","last_unstale":"2024-09-14T12:44:56.561075+0000","last_undegraded":"2024-09-14T12:44:56.561075+0000","last_fullsized":"2024-09-14T12:44:56.561075+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-14T12:44:56.560816+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-14T12:44:56.560816+0000","last_clean_scrub_stamp":"2024-09-14T12:44:56.560816+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:16.586044+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1153,"num_read_kb":1151,"num_write":333,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'1203","reported_seq":2922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.787205+0000","last_change":"2024-09-14T12:44:20.787205+0000","last_active":"2024-09-14T12:44:20.787205+0000","last_peered":"2024-09-14T12:44:20.787205+0000","last_clean":"2024-09-14T12:44:20.787205+0000","last_became_active":"2024-09-14T10:49:25.362059+0000","last_became_peered":"2024-09-14T10:49:25.362059+0000","last_unstale":"2024-09-14T12:44:20.787205+0000","last_undegraded":"2024-09-14T12:44:20.787205+0000","last_fullsized":"2024-09-14T12:44:20.787205+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1203","last_scrub_stamp":"2024-09-14T12:44:20.786965+0000","last_deep_scrub":"267'1203","last_deep_scrub_stamp":"2024-09-14T12:44:20.786965+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.786965+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:56.073347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5522,"num_read_kb":4921,"num_write":1640,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'397","reported_seq":1097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.828976+0000","last_change":"2024-09-14T12:44:15.828976+0000","last_active":"2024-09-14T12:44:15.828976+0000","last_peered":"2024-09-14T12:44:15.828976+0000","last_clean":"2024-09-14T12:44:15.828976+0000","last_became_active":"2024-09-14T10:49:23.381620+0000","last_became_peered":"2024-09-14T10:49:23.381620+0000","last_unstale":"2024-09-14T12:44:15.828976+0000","last_undegraded":"2024-09-14T12:44:15.828976+0000","last_fullsized":"2024-09-14T12:44:15.828976+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'397","last_scrub_stamp":"2024-09-14T12:44:15.828640+0000","last_deep_scrub":"267'397","last_deep_scrub_stamp":"2024-09-14T12:44:15.828640+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.828640+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:00.548137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":34199,"num_write":1236,"num_write_kb":46564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.036308+0000","last_change":"2024-09-14T12:44:33.036308+0000","last_active":"2024-09-14T12:44:33.036308+0000","last_peered":"2024-09-14T12:44:33.036308+0000","last_clean":"2024-09-14T12:44:33.036308+0000","last_became_active":"2024-09-14T10:49:27.372685+0000","last_became_peered":"2024-09-14T10:49:27.372685+0000","last_unstale":"2024-09-14T12:44:33.036308+0000","last_undegraded":"2024-09-14T12:44:33.036308+0000","last_fullsized":"2024-09-14T12:44:33.036308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:33.036137+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:33.036137+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.036137+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:52.037804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'335","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.560421+0000","last_change":"2024-09-14T12:44:44.560421+0000","last_active":"2024-09-14T12:44:44.560421+0000","last_peered":"2024-09-14T12:44:44.560421+0000","last_clean":"2024-09-14T12:44:44.560421+0000","last_became_active":"2024-09-14T10:49:29.396379+0000","last_became_peered":"2024-09-14T10:49:29.396379+0000","last_unstale":"2024-09-14T12:44:44.560421+0000","last_undegraded":"2024-09-14T12:44:44.560421+0000","last_fullsized":"2024-09-14T12:44:44.560421+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-14T12:44:44.560226+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-14T12:44:44.560226+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.560226+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.490856+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":1145,"num_write":432,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.856757+0000","last_change":"2024-09-14T12:44:44.856757+0000","last_active":"2024-09-14T12:44:44.856757+0000","last_peered":"2024-09-14T12:44:44.856757+0000","last_clean":"2024-09-14T12:44:44.856757+0000","last_became_active":"2024-09-14T10:49:31.418819+0000","last_became_peered":"2024-09-14T10:49:31.418819+0000","last_unstale":"2024-09-14T12:44:44.856757+0000","last_undegraded":"2024-09-14T12:44:44.856757+0000","last_fullsized":"2024-09-14T12:44:44.856757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.856547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.856547+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.856547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:51.055177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'138","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.084044+0000","last_change":"2024-09-14T12:44:34.084044+0000","last_active":"2024-09-14T12:44:34.084044+0000","last_peered":"2024-09-14T12:44:34.084044+0000","last_clean":"2024-09-14T12:44:34.084044+0000","last_became_active":"2024-09-14T10:49:33.476455+0000","last_became_peered":"2024-09-14T10:49:33.476455+0000","last_unstale":"2024-09-14T12:44:34.084044+0000","last_undegraded":"2024-09-14T12:44:34.084044+0000","last_fullsized":"2024-09-14T12:44:34.084044+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-14T12:44:34.083837+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-14T12:44:34.083837+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.083837+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:35.031509+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":173,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'506","reported_seq":2202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.882618+0000","last_change":"2024-09-14T12:44:23.882618+0000","last_active":"2024-09-14T12:44:23.882618+0000","last_peered":"2024-09-14T12:44:23.882618+0000","last_clean":"2024-09-14T12:44:23.882618+0000","last_became_active":"2024-09-14T10:49:25.373337+0000","last_became_peered":"2024-09-14T10:49:25.373337+0000","last_unstale":"2024-09-14T12:44:23.882618+0000","last_undegraded":"2024-09-14T12:44:23.882618+0000","last_fullsized":"2024-09-14T12:44:23.882618+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'506","last_scrub_stamp":"2024-09-14T12:44:23.882442+0000","last_deep_scrub":"267'506","last_deep_scrub_stamp":"2024-09-14T12:44:23.882442+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.882442+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:44.958416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2857,"num_read_kb":2693,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'347","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.908298+0000","last_change":"2024-09-14T12:44:13.908298+0000","last_active":"2024-09-14T12:44:13.908298+0000","last_peered":"2024-09-14T12:44:13.908298+0000","last_clean":"2024-09-14T12:44:13.908298+0000","last_became_active":"2024-09-14T10:49:23.377766+0000","last_became_peered":"2024-09-14T10:49:23.377766+0000","last_unstale":"2024-09-14T12:44:13.908298+0000","last_undegraded":"2024-09-14T12:44:13.908298+0000","last_fullsized":"2024-09-14T12:44:13.908298+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-14T12:44:13.908057+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-14T12:44:13.908057+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.908057+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:07.725881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":614,"num_read_kb":20992,"num_write":1055,"num_write_kb":39444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'626","reported_seq":2320,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.551496+0000","last_change":"2024-09-14T12:44:21.551496+0000","last_active":"2024-09-14T12:44:21.551496+0000","last_peered":"2024-09-14T12:44:21.551496+0000","last_clean":"2024-09-14T12:44:21.551496+0000","last_became_active":"2024-09-14T10:49:25.375595+0000","last_became_peered":"2024-09-14T10:49:25.375595+0000","last_unstale":"2024-09-14T12:44:21.551496+0000","last_undegraded":"2024-09-14T12:44:21.551496+0000","last_fullsized":"2024-09-14T12:44:21.551496+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'626","last_scrub_stamp":"2024-09-14T12:44:21.551295+0000","last_deep_scrub":"267'626","last_deep_scrub_stamp":"2024-09-14T12:44:21.551295+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.551295+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:00.863868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3344,"num_read_kb":3023,"num_write":799,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3029,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'295","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.544796+0000","last_change":"2024-09-14T12:44:16.544796+0000","last_active":"2024-09-14T12:44:16.544796+0000","last_peered":"2024-09-14T12:44:16.544796+0000","last_clean":"2024-09-14T12:44:16.544796+0000","last_became_active":"2024-09-14T10:49:23.390456+0000","last_became_peered":"2024-09-14T10:49:23.390456+0000","last_unstale":"2024-09-14T12:44:16.544796+0000","last_undegraded":"2024-09-14T12:44:16.544796+0000","last_fullsized":"2024-09-14T12:44:16.544796+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-09-14T12:44:16.544513+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-09-14T12:44:16.544513+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.544513+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:27.941670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":9558,"num_write":877,"num_write_kb":19994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'456","reported_seq":2095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.710507+0000","last_change":"2024-09-14T12:44:33.710507+0000","last_active":"2024-09-14T12:44:33.710507+0000","last_peered":"2024-09-14T12:44:33.710507+0000","last_clean":"2024-09-14T12:44:33.710507+0000","last_became_active":"2024-09-14T10:49:25.372436+0000","last_became_peered":"2024-09-14T10:49:25.372436+0000","last_unstale":"2024-09-14T12:44:33.710507+0000","last_undegraded":"2024-09-14T12:44:33.710507+0000","last_fullsized":"2024-09-14T12:44:33.710507+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'456","last_scrub_stamp":"2024-09-14T12:44:33.710293+0000","last_deep_scrub":"267'456","last_deep_scrub_stamp":"2024-09-14T12:44:33.710293+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.710293+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:43.829594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2453,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'344","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.667244+0000","last_change":"2024-09-14T12:44:24.667244+0000","last_active":"2024-09-14T12:44:24.667244+0000","last_peered":"2024-09-14T12:44:24.667244+0000","last_clean":"2024-09-14T12:44:24.667244+0000","last_became_active":"2024-09-14T10:49:23.395161+0000","last_became_peered":"2024-09-14T10:49:23.395161+0000","last_unstale":"2024-09-14T12:44:24.667244+0000","last_undegraded":"2024-09-14T12:44:24.667244+0000","last_fullsized":"2024-09-14T12:44:24.667244+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-09-14T12:44:24.666983+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-09-14T12:44:24.666983+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.666983+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:27.684732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":8858,"num_write":1038,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'758","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.904506+0000","last_change":"2024-09-14T12:44:28.904506+0000","last_active":"2024-09-14T12:44:28.904506+0000","last_peered":"2024-09-14T12:44:28.904506+0000","last_clean":"2024-09-14T12:44:28.904506+0000","last_became_active":"2024-09-14T10:49:25.390167+0000","last_became_peered":"2024-09-14T10:49:25.390167+0000","last_unstale":"2024-09-14T12:44:28.904506+0000","last_undegraded":"2024-09-14T12:44:28.904506+0000","last_fullsized":"2024-09-14T12:44:28.904506+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'758","last_scrub_stamp":"2024-09-14T12:44:28.904302+0000","last_deep_scrub":"267'758","last_deep_scrub_stamp":"2024-09-14T12:44:28.904302+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.904302+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:02.551450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3780,"num_read_kb":3460,"num_write":968,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'367","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.819989+0000","last_change":"2024-09-14T12:44:17.819655+0000","last_active":"2024-09-14T12:44:17.819989+0000","last_peered":"2024-09-14T12:44:17.819989+0000","last_clean":"2024-09-14T12:44:17.819989+0000","last_became_active":"2024-09-14T10:49:23.374332+0000","last_became_peered":"2024-09-14T10:49:23.374332+0000","last_unstale":"2024-09-14T12:44:17.819989+0000","last_undegraded":"2024-09-14T12:44:17.819989+0000","last_fullsized":"2024-09-14T12:44:17.819989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'367","last_scrub_stamp":"2024-09-14T12:44:17.819331+0000","last_deep_scrub":"267'367","last_deep_scrub_stamp":"2024-09-14T12:44:17.819331+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.819331+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:05.848392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":1430,"num_write":1267,"num_write_kb":16611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'437","reported_seq":2059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.858194+0000","last_change":"2024-09-14T12:44:27.858045+0000","last_active":"2024-09-14T12:44:27.858194+0000","last_peered":"2024-09-14T12:44:27.858194+0000","last_clean":"2024-09-14T12:44:27.858194+0000","last_became_active":"2024-09-14T10:49:25.390444+0000","last_became_peered":"2024-09-14T10:49:25.390444+0000","last_unstale":"2024-09-14T12:44:27.858194+0000","last_undegraded":"2024-09-14T12:44:27.858194+0000","last_fullsized":"2024-09-14T12:44:27.858194+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'437","last_scrub_stamp":"2024-09-14T12:44:27.857854+0000","last_deep_scrub":"267'437","last_deep_scrub_stamp":"2024-09-14T12:44:27.857854+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.857854+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.672313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2280,"num_write":506,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'317","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.767469+0000","last_change":"2024-09-14T12:44:16.767469+0000","last_active":"2024-09-14T12:44:16.767469+0000","last_peered":"2024-09-14T12:44:16.767469+0000","last_clean":"2024-09-14T12:44:16.767469+0000","last_became_active":"2024-09-14T10:49:23.365007+0000","last_became_peered":"2024-09-14T10:49:23.365007+0000","last_unstale":"2024-09-14T12:44:16.767469+0000","last_undegraded":"2024-09-14T12:44:16.767469+0000","last_fullsized":"2024-09-14T12:44:16.767469+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-14T12:44:16.766978+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-14T12:44:16.766978+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.766978+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:13.735465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":40511,"num_write":1024,"num_write_kb":34103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'622","reported_seq":2500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.287191+0000","last_change":"2024-09-14T12:44:19.287191+0000","last_active":"2024-09-14T12:44:19.287191+0000","last_peered":"2024-09-14T12:44:19.287191+0000","last_clean":"2024-09-14T12:44:19.287191+0000","last_became_active":"2024-09-14T10:49:25.380751+0000","last_became_peered":"2024-09-14T10:49:25.380751+0000","last_unstale":"2024-09-14T12:44:19.287191+0000","last_undegraded":"2024-09-14T12:44:19.287191+0000","last_fullsized":"2024-09-14T12:44:19.287191+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'622","last_scrub_stamp":"2024-09-14T12:44:19.287009+0000","last_deep_scrub":"267'622","last_deep_scrub_stamp":"2024-09-14T12:44:19.287009+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.287009+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:57.547324+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3385,"num_read_kb":3142,"num_write":784,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2004,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'366","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.728428+0000","last_change":"2024-09-14T12:44:15.728259+0000","last_active":"2024-09-14T12:44:15.728428+0000","last_peered":"2024-09-14T12:44:15.728428+0000","last_clean":"2024-09-14T12:44:15.728428+0000","last_became_active":"2024-09-14T10:49:23.366946+0000","last_became_peered":"2024-09-14T10:49:23.366946+0000","last_unstale":"2024-09-14T12:44:15.728428+0000","last_undegraded":"2024-09-14T12:44:15.728428+0000","last_fullsized":"2024-09-14T12:44:15.728428+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-14T12:44:15.728035+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-14T12:44:15.728035+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.728035+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:18.238063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":15339,"num_write":1195,"num_write_kb":33762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'818","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.856250+0000","last_change":"2024-09-14T12:44:25.856250+0000","last_active":"2024-09-14T12:44:25.856250+0000","last_peered":"2024-09-14T12:44:25.856250+0000","last_clean":"2024-09-14T12:44:25.856250+0000","last_became_active":"2024-09-14T10:49:25.394994+0000","last_became_peered":"2024-09-14T10:49:25.394994+0000","last_unstale":"2024-09-14T12:44:25.856250+0000","last_undegraded":"2024-09-14T12:44:25.856250+0000","last_fullsized":"2024-09-14T12:44:25.856250+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-09-14T12:44:25.856059+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-09-14T12:44:25.856059+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.856059+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:11:53.081476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4031,"num_read_kb":3664,"num_write":1069,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'391","reported_seq":1249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.840145+0000","last_change":"2024-09-14T12:44:11.839965+0000","last_active":"2024-09-14T12:44:11.840145+0000","last_peered":"2024-09-14T12:44:11.840145+0000","last_clean":"2024-09-14T12:44:11.840145+0000","last_became_active":"2024-09-14T10:49:23.373080+0000","last_became_peered":"2024-09-14T10:49:23.373080+0000","last_unstale":"2024-09-14T12:44:11.840145+0000","last_undegraded":"2024-09-14T12:44:11.840145+0000","last_fullsized":"2024-09-14T12:44:11.840145+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:11.839750+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:11.839750+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.839750+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:46.935339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1418,"num_read_kb":12734,"num_write":1224,"num_write_kb":19451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'537","reported_seq":2281,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.973009+0000","last_change":"2024-09-14T12:44:16.973009+0000","last_active":"2024-09-14T12:44:16.973009+0000","last_peered":"2024-09-14T12:44:16.973009+0000","last_clean":"2024-09-14T12:44:16.973009+0000","last_became_active":"2024-09-14T10:49:25.375465+0000","last_became_peered":"2024-09-14T10:49:25.375465+0000","last_unstale":"2024-09-14T12:44:16.973009+0000","last_undegraded":"2024-09-14T12:44:16.973009+0000","last_fullsized":"2024-09-14T12:44:16.973009+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'537","last_scrub_stamp":"2024-09-14T12:44:16.972830+0000","last_deep_scrub":"267'537","last_deep_scrub_stamp":"2024-09-14T12:44:16.972830+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.972830+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:54.021748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2646,"num_write":644,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'334","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.846014+0000","last_change":"2024-09-14T12:44:18.846014+0000","last_active":"2024-09-14T12:44:18.846014+0000","last_peered":"2024-09-14T12:44:18.846014+0000","last_clean":"2024-09-14T12:44:18.846014+0000","last_became_active":"2024-09-14T10:49:23.377964+0000","last_became_peered":"2024-09-14T10:49:23.377964+0000","last_unstale":"2024-09-14T12:44:18.846014+0000","last_undegraded":"2024-09-14T12:44:18.846014+0000","last_fullsized":"2024-09-14T12:44:18.846014+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-09-14T12:44:18.845792+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-09-14T12:44:18.845792+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.845792+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:26.978554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":579,"num_read_kb":6819,"num_write":1090,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'855","reported_seq":2417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.520037+0000","last_change":"2024-09-14T12:44:22.520037+0000","last_active":"2024-09-14T12:44:22.520037+0000","last_peered":"2024-09-14T12:44:22.520037+0000","last_clean":"2024-09-14T12:44:22.520037+0000","last_became_active":"2024-09-14T10:49:25.386541+0000","last_became_peered":"2024-09-14T10:49:25.386541+0000","last_unstale":"2024-09-14T12:44:22.520037+0000","last_undegraded":"2024-09-14T12:44:22.520037+0000","last_fullsized":"2024-09-14T12:44:22.520037+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'855","last_scrub_stamp":"2024-09-14T12:44:22.519854+0000","last_deep_scrub":"267'855","last_deep_scrub_stamp":"2024-09-14T12:44:22.519854+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.519854+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:12.468305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3987,"num_read_kb":3560,"num_write":1145,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'399","reported_seq":1084,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.639100+0000","last_change":"2024-09-14T12:44:22.638936+0000","last_active":"2024-09-14T12:44:22.639100+0000","last_peered":"2024-09-14T12:44:22.639100+0000","last_clean":"2024-09-14T12:44:22.639100+0000","last_became_active":"2024-09-14T10:49:23.387245+0000","last_became_peered":"2024-09-14T10:49:23.387245+0000","last_unstale":"2024-09-14T12:44:22.639100+0000","last_undegraded":"2024-09-14T12:44:22.639100+0000","last_fullsized":"2024-09-14T12:44:22.639100+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-14T12:44:22.638724+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-14T12:44:22.638724+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.638724+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:48.167793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":46181,"num_write":1283,"num_write_kb":35513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'851","reported_seq":2622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.131143+0000","last_change":"2024-09-14T12:44:23.131143+0000","last_active":"2024-09-14T12:44:23.131143+0000","last_peered":"2024-09-14T12:44:23.131143+0000","last_clean":"2024-09-14T12:44:23.131143+0000","last_became_active":"2024-09-14T10:49:25.373511+0000","last_became_peered":"2024-09-14T10:49:25.373511+0000","last_unstale":"2024-09-14T12:44:23.131143+0000","last_undegraded":"2024-09-14T12:44:23.131143+0000","last_fullsized":"2024-09-14T12:44:23.131143+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-14T12:44:23.130952+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-14T12:44:23.130952+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.130952+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:53.058385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4179,"num_read_kb":3797,"num_write":1119,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'377","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.860583+0000","last_change":"2024-09-14T12:44:19.860583+0000","last_active":"2024-09-14T12:44:19.860583+0000","last_peered":"2024-09-14T12:44:19.860583+0000","last_clean":"2024-09-14T12:44:19.860583+0000","last_became_active":"2024-09-14T10:49:23.377218+0000","last_became_peered":"2024-09-14T10:49:23.377218+0000","last_unstale":"2024-09-14T12:44:19.860583+0000","last_undegraded":"2024-09-14T12:44:19.860583+0000","last_fullsized":"2024-09-14T12:44:19.860583+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-09-14T12:44:19.860120+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-09-14T12:44:19.860120+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.860120+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:24.595003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5360649,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":652,"num_read_kb":6958,"num_write":1198,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'525","reported_seq":2139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.041596+0000","last_change":"2024-09-14T12:44:33.041336+0000","last_active":"2024-09-14T12:44:33.041596+0000","last_peered":"2024-09-14T12:44:33.041596+0000","last_clean":"2024-09-14T12:44:33.041596+0000","last_became_active":"2024-09-14T10:49:25.394237+0000","last_became_peered":"2024-09-14T10:49:25.394237+0000","last_unstale":"2024-09-14T12:44:33.041596+0000","last_undegraded":"2024-09-14T12:44:33.041596+0000","last_fullsized":"2024-09-14T12:44:33.041596+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'525","last_scrub_stamp":"2024-09-14T12:44:33.041096+0000","last_deep_scrub":"267'525","last_deep_scrub_stamp":"2024-09-14T12:44:33.041096+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.041096+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:10.429047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2610,"num_write":682,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'385","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.937989+0000","last_change":"2024-09-14T12:44:13.937989+0000","last_active":"2024-09-14T12:44:13.937989+0000","last_peered":"2024-09-14T12:44:13.937989+0000","last_clean":"2024-09-14T12:44:13.937989+0000","last_became_active":"2024-09-14T10:49:23.371845+0000","last_became_peered":"2024-09-14T10:49:23.371845+0000","last_unstale":"2024-09-14T12:44:13.937989+0000","last_undegraded":"2024-09-14T12:44:13.937989+0000","last_fullsized":"2024-09-14T12:44:13.937989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-14T12:44:13.937713+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-14T12:44:13.937713+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.937713+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.516351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":30325,"num_write":1182,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'407","reported_seq":1837,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.949255+0000","last_change":"2024-09-14T12:44:18.949255+0000","last_active":"2024-09-14T12:44:18.949255+0000","last_peered":"2024-09-14T12:44:18.949255+0000","last_clean":"2024-09-14T12:44:18.949255+0000","last_became_active":"2024-09-14T10:49:25.375374+0000","last_became_peered":"2024-09-14T10:49:25.375374+0000","last_unstale":"2024-09-14T12:44:18.949255+0000","last_undegraded":"2024-09-14T12:44:18.949255+0000","last_fullsized":"2024-09-14T12:44:18.949255+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-14T12:44:18.949068+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-14T12:44:18.949068+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.949068+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:26.275108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2030,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'390","reported_seq":1123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.807384+0000","last_change":"2024-09-14T12:44:17.807384+0000","last_active":"2024-09-14T12:44:17.807384+0000","last_peered":"2024-09-14T12:44:17.807384+0000","last_clean":"2024-09-14T12:44:17.807384+0000","last_became_active":"2024-09-14T10:49:23.371987+0000","last_became_peered":"2024-09-14T10:49:23.371987+0000","last_unstale":"2024-09-14T12:44:17.807384+0000","last_undegraded":"2024-09-14T12:44:17.807384+0000","last_fullsized":"2024-09-14T12:44:17.807384+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-09-14T12:44:17.807136+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-09-14T12:44:17.807136+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.807136+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:11.677728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":722,"num_read_kb":54432,"num_write":1171,"num_write_kb":38478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'768","reported_seq":2328,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.970413+0000","last_change":"2024-09-14T12:44:17.970413+0000","last_active":"2024-09-14T12:44:17.970413+0000","last_peered":"2024-09-14T12:44:17.970413+0000","last_clean":"2024-09-14T12:44:17.970413+0000","last_became_active":"2024-09-14T10:49:25.404302+0000","last_became_peered":"2024-09-14T10:49:25.404302+0000","last_unstale":"2024-09-14T12:44:17.970413+0000","last_undegraded":"2024-09-14T12:44:17.970413+0000","last_fullsized":"2024-09-14T12:44:17.970413+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'768","last_scrub_stamp":"2024-09-14T12:44:17.970223+0000","last_deep_scrub":"267'768","last_deep_scrub_stamp":"2024-09-14T12:44:17.970223+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.970223+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:07.913253+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3673,"num_read_kb":3318,"num_write":995,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'392","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.355966+0000","last_change":"2024-09-14T12:44:11.355966+0000","last_active":"2024-09-14T12:44:11.355966+0000","last_peered":"2024-09-14T12:44:11.355966+0000","last_clean":"2024-09-14T12:44:11.355966+0000","last_became_active":"2024-09-14T10:49:23.372362+0000","last_became_peered":"2024-09-14T10:49:23.372362+0000","last_unstale":"2024-09-14T12:44:11.355966+0000","last_undegraded":"2024-09-14T12:44:11.355966+0000","last_fullsized":"2024-09-14T12:44:11.355966+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-14T12:44:11.355879+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-14T12:44:11.355879+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.355879+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:43.785705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":10747,"num_write":1199,"num_write_kb":31883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"267'889","reported_seq":2547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.471116+0000","last_change":"2024-09-14T12:44:23.471116+0000","last_active":"2024-09-14T12:44:23.471116+0000","last_peered":"2024-09-14T12:44:23.471116+0000","last_clean":"2024-09-14T12:44:23.471116+0000","last_became_active":"2024-09-14T10:49:25.378231+0000","last_became_peered":"2024-09-14T10:49:25.378231+0000","last_unstale":"2024-09-14T12:44:23.471116+0000","last_undegraded":"2024-09-14T12:44:23.471116+0000","last_fullsized":"2024-09-14T12:44:23.471116+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'889","last_scrub_stamp":"2024-09-14T12:44:23.470931+0000","last_deep_scrub":"267'889","last_deep_scrub_stamp":"2024-09-14T12:44:23.470931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.470931+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:44.766183+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4260,"num_read_kb":3817,"num_write":1188,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'382","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.687570+0000","last_change":"2024-09-14T12:44:23.687320+0000","last_active":"2024-09-14T12:44:23.687570+0000","last_peered":"2024-09-14T12:44:23.687570+0000","last_clean":"2024-09-14T12:44:23.687570+0000","last_became_active":"2024-09-14T10:49:23.396179+0000","last_became_peered":"2024-09-14T10:49:23.396179+0000","last_unstale":"2024-09-14T12:44:23.687570+0000","last_undegraded":"2024-09-14T12:44:23.687570+0000","last_fullsized":"2024-09-14T12:44:23.687570+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:23.686889+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:23.686889+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.686889+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:10.063554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1034,"num_read_kb":35151,"num_write":1252,"num_write_kb":27361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'453","reported_seq":1998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.835269+0000","last_change":"2024-09-14T12:44:24.835269+0000","last_active":"2024-09-14T12:44:24.835269+0000","last_peered":"2024-09-14T12:44:24.835269+0000","last_clean":"2024-09-14T12:44:24.835269+0000","last_became_active":"2024-09-14T10:49:25.386602+0000","last_became_peered":"2024-09-14T10:49:25.386602+0000","last_unstale":"2024-09-14T12:44:24.835269+0000","last_undegraded":"2024-09-14T12:44:24.835269+0000","last_fullsized":"2024-09-14T12:44:24.835269+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'453","last_scrub_stamp":"2024-09-14T12:44:24.835090+0000","last_deep_scrub":"267'453","last_deep_scrub_stamp":"2024-09-14T12:44:24.835090+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.835090+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:19:05.573525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2532,"num_read_kb":2369,"num_write":580,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'365","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.600332+0000","last_change":"2024-09-14T12:44:14.600332+0000","last_active":"2024-09-14T12:44:14.600332+0000","last_peered":"2024-09-14T12:44:14.600332+0000","last_clean":"2024-09-14T12:44:14.600332+0000","last_became_active":"2024-09-14T10:49:23.369989+0000","last_became_peered":"2024-09-14T10:49:23.369989+0000","last_unstale":"2024-09-14T12:44:14.600332+0000","last_undegraded":"2024-09-14T12:44:14.600332+0000","last_fullsized":"2024-09-14T12:44:14.600332+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-14T12:44:14.600114+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-14T12:44:14.600114+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.600114+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.010341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":696,"num_read_kb":14222,"num_write":1159,"num_write_kb":28974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'1267","reported_seq":2972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.985235+0000","last_change":"2024-09-14T12:44:19.985004+0000","last_active":"2024-09-14T12:44:19.985235+0000","last_peered":"2024-09-14T12:44:19.985235+0000","last_clean":"2024-09-14T12:44:19.985235+0000","last_became_active":"2024-09-14T10:49:25.407817+0000","last_became_peered":"2024-09-14T10:49:25.407817+0000","last_unstale":"2024-09-14T12:44:19.985235+0000","last_undegraded":"2024-09-14T12:44:19.985235+0000","last_fullsized":"2024-09-14T12:44:19.985235+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1267","last_scrub_stamp":"2024-09-14T12:44:19.984761+0000","last_deep_scrub":"267'1267","last_deep_scrub_stamp":"2024-09-14T12:44:19.984761+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.984761+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":1200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:38.185470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5850,"num_read_kb":5153,"num_write":1753,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'378","reported_seq":1144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.660518+0000","last_change":"2024-09-14T12:44:26.660518+0000","last_active":"2024-09-14T12:44:26.660518+0000","last_peered":"2024-09-14T12:44:26.660518+0000","last_clean":"2024-09-14T12:44:26.660518+0000","last_became_active":"2024-09-14T10:49:23.365975+0000","last_became_peered":"2024-09-14T10:49:23.365975+0000","last_unstale":"2024-09-14T12:44:26.660518+0000","last_undegraded":"2024-09-14T12:44:26.660518+0000","last_fullsized":"2024-09-14T12:44:26.660518+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'378","last_scrub_stamp":"2024-09-14T12:44:26.660249+0000","last_deep_scrub":"267'378","last_deep_scrub_stamp":"2024-09-14T12:44:26.660249+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.660249+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:08.781982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":962,"num_read_kb":99658,"num_write":1167,"num_write_kb":35935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'346","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.701550+0000","last_change":"2024-09-14T12:44:25.701550+0000","last_active":"2024-09-14T12:44:25.701550+0000","last_peered":"2024-09-14T12:44:25.701550+0000","last_clean":"2024-09-14T12:44:25.701550+0000","last_became_active":"2024-09-14T10:49:23.373652+0000","last_became_peered":"2024-09-14T10:49:23.373652+0000","last_unstale":"2024-09-14T12:44:25.701550+0000","last_undegraded":"2024-09-14T12:44:25.701550+0000","last_fullsized":"2024-09-14T12:44:25.701550+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-14T12:44:25.701274+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-14T12:44:25.701274+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.701274+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:04.194083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":808,"num_write":1082,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'430","reported_seq":2032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.803698+0000","last_change":"2024-09-14T12:44:25.803698+0000","last_active":"2024-09-14T12:44:25.803698+0000","last_peered":"2024-09-14T12:44:25.803698+0000","last_clean":"2024-09-14T12:44:25.803698+0000","last_became_active":"2024-09-14T10:49:25.399830+0000","last_became_peered":"2024-09-14T10:49:25.399830+0000","last_unstale":"2024-09-14T12:44:25.803698+0000","last_undegraded":"2024-09-14T12:44:25.803698+0000","last_fullsized":"2024-09-14T12:44:25.803698+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-14T12:44:25.803503+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-14T12:44:25.803503+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.803503+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:00.772915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2288,"num_read_kb":2174,"num_write":485,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'357","reported_seq":1117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.812240+0000","last_change":"2024-09-14T12:44:20.812240+0000","last_active":"2024-09-14T12:44:20.812240+0000","last_peered":"2024-09-14T12:44:20.812240+0000","last_clean":"2024-09-14T12:44:20.812240+0000","last_became_active":"2024-09-14T10:49:23.382302+0000","last_became_peered":"2024-09-14T10:49:23.382302+0000","last_unstale":"2024-09-14T12:44:20.812240+0000","last_undegraded":"2024-09-14T12:44:20.812240+0000","last_fullsized":"2024-09-14T12:44:20.812240+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-14T12:44:20.812034+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-14T12:44:20.812034+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.812034+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:33.756604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":853,"num_read_kb":33665,"num_write":1061,"num_write_kb":42742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'434","reported_seq":2115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.047241+0000","last_change":"2024-09-14T12:44:25.047241+0000","last_active":"2024-09-14T12:44:25.047241+0000","last_peered":"2024-09-14T12:44:25.047241+0000","last_clean":"2024-09-14T12:44:25.047241+0000","last_became_active":"2024-09-14T10:49:25.391680+0000","last_became_peered":"2024-09-14T10:49:25.391680+0000","last_unstale":"2024-09-14T12:44:25.047241+0000","last_undegraded":"2024-09-14T12:44:25.047241+0000","last_fullsized":"2024-09-14T12:44:25.047241+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T12:44:25.047002+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T12:44:25.047002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.047002+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:34.093527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2427,"num_read_kb":2321,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10880,"num_read_kb":8996,"num_write":3119,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15325,"num_read_kb":14960,"num_write":17100,"num_write_kb":5007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1615,"ondisk_log_size":1615,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637897,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":21147,"num_read_kb":41034,"num_write":17727,"num_write_kb":12782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":716172,"num_omap_keys":1640,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2029,"ondisk_log_size":2029,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221603,"num_read_kb":202842,"num_write":56199,"num_write_kb":19273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35772,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3743,"ondisk_log_size":3743,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42369360,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44646,"num_read_kb":1985232,"num_write":73593,"num_write_kb":2196624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58359808,"data_stored":58359808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3987,"ondisk_log_size":3987,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":168154,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":167578,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510841,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":9404,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":9629696,"data_stored":7595829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510839,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281608,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94090232,"statfs":{"total":96636764160,"available":96348397568,"internally_reserved":0,"allocated":11919360,"data_stored":9909527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510842,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225296,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146544,"statfs":{"total":96636764160,"available":96406061056,"internally_reserved":0,"allocated":9764864,"data_stored":7751439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510843,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277220,"kb_used_data":11412,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94094620,"statfs":{"total":96636764160,"available":96352890880,"internally_reserved":0,"allocated":11685888,"data_stored":9655008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510842,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201292,"kb_used_data":13244,"kb_used_omap":1,"kb_used_meta":188030,"kb_avail":94170548,"statfs":{"total":96636764160,"available":96430641152,"internally_reserved":0,"allocated":13561856,"data_stored":11555946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":192543173},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510839,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339320,"kb_used_data":11048,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94032520,"statfs":{"total":96636764160,"available":96289300480,"internally_reserved":0,"allocated":11313152,"data_stored":9301608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510840,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138204,"kb_used_data":12620,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94233636,"statfs":{"total":96636764160,"available":96495243264,"internally_reserved":0,"allocated":12922880,"data_stored":10866139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543546,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242192,"kb_used_data":12544,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94129648,"statfs":{"total":96636764160,"available":96388759552,"internally_reserved":0,"allocated":12845056,"data_stored":10838842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235141578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8622080,"data_stored":8622080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6471680,"data_stored":6471680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9314304,"data_stored":9314304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7413760,"data_stored":7413760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5509120,"data_stored":5509120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7077888,"data_stored":7077888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5353472,"data_stored":5353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8597504,"data_stored":8597504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:45:14.029 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:45:14.029 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:45:14.029 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:45:14.030 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:45:14.030 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:12:25.180501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=25, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:45:14.030 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:40:07.890290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=40, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=44, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:45:14.033 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:45:34.035 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:45:34.370 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-14T12:45:34.385 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-09-14T12:45:34.395 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":3755,"stamp":"2024-09-14T12:45:33.209662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":44615192,"num_objects":748,"num_object_clones":0,"num_object_copies":2056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":748,"num_whiteouts":0,"num_read":316434,"num_read_kb":2591763,"num_write":168253,"num_write_kb":2487517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":755835,"num_omap_keys":1814,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13319,"ondisk_log_size":13319,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1826232,"kb_used_data":91448,"kb_used_omap":12,"kb_used_meta":1734643,"kb_avail":753148488,"statfs":{"total":773094113280,"available":771224051712,"internally_reserved":0,"allocated":93642752,"data_stored":77474338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1776274992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009647"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.061524+0000","last_change":"2024-09-14T12:44:49.061396+0000","last_active":"2024-09-14T12:44:49.061524+0000","last_peered":"2024-09-14T12:44:49.061524+0000","last_clean":"2024-09-14T12:44:49.061524+0000","last_became_active":"2024-09-14T11:40:08.951795+0000","last_became_peered":"2024-09-14T11:40:08.951795+0000","last_unstale":"2024-09-14T12:44:49.061524+0000","last_undegraded":"2024-09-14T12:44:49.061524+0000","last_fullsized":"2024-09-14T12:44:49.061524+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.061231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.061231+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.061231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:09.033750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.966798+0000","last_change":"2024-09-14T12:44:46.966635+0000","last_active":"2024-09-14T12:44:46.966798+0000","last_peered":"2024-09-14T12:44:46.966798+0000","last_clean":"2024-09-14T12:44:46.966798+0000","last_became_active":"2024-09-14T11:12:26.251656+0000","last_became_peered":"2024-09-14T11:12:26.251656+0000","last_unstale":"2024-09-14T12:44:46.966798+0000","last_undegraded":"2024-09-14T12:44:46.966798+0000","last_fullsized":"2024-09-14T12:44:46.966798+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.966463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.966463+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.966463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.298507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.391220+0000","last_change":"2024-09-14T12:44:49.390972+0000","last_active":"2024-09-14T12:44:49.391220+0000","last_peered":"2024-09-14T12:44:49.391220+0000","last_clean":"2024-09-14T12:44:49.391220+0000","last_became_active":"2024-09-14T11:12:19.108050+0000","last_became_peered":"2024-09-14T11:12:19.108050+0000","last_unstale":"2024-09-14T12:44:49.391220+0000","last_undegraded":"2024-09-14T12:44:49.391220+0000","last_fullsized":"2024-09-14T12:44:49.391220+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:49.390668+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:49.390668+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.390668+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.745726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16382,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"267'28","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.874545+0000","last_change":"2024-09-14T12:44:51.874545+0000","last_active":"2024-09-14T12:44:51.874545+0000","last_peered":"2024-09-14T12:44:51.874545+0000","last_clean":"2024-09-14T12:44:51.874545+0000","last_became_active":"2024-09-14T11:06:29.521269+0000","last_became_peered":"2024-09-14T11:06:29.521269+0000","last_unstale":"2024-09-14T12:44:51.874545+0000","last_undegraded":"2024-09-14T12:44:51.874545+0000","last_fullsized":"2024-09-14T12:44:51.874545+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-14T12:44:51.874372+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-14T12:44:51.874372+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.874372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:59.632984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":165,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.764180+0000","last_change":"2024-09-14T12:44:54.764041+0000","last_active":"2024-09-14T12:44:54.764180+0000","last_peered":"2024-09-14T12:44:54.764180+0000","last_clean":"2024-09-14T12:44:54.764180+0000","last_became_active":"2024-09-14T11:40:08.946878+0000","last_became_peered":"2024-09-14T11:40:08.946878+0000","last_unstale":"2024-09-14T12:44:54.764180+0000","last_undegraded":"2024-09-14T12:44:54.764180+0000","last_fullsized":"2024-09-14T12:44:54.764180+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:54.763847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:54.763847+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.763847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:46.578275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.941022+0000","last_change":"2024-09-14T12:44:50.940877+0000","last_active":"2024-09-14T12:44:50.941022+0000","last_peered":"2024-09-14T12:44:50.941022+0000","last_clean":"2024-09-14T12:44:50.941022+0000","last_became_active":"2024-09-14T11:12:26.251518+0000","last_became_peered":"2024-09-14T11:12:26.251518+0000","last_unstale":"2024-09-14T12:44:50.941022+0000","last_undegraded":"2024-09-14T12:44:50.941022+0000","last_fullsized":"2024-09-14T12:44:50.941022+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T12:44:50.940699+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T12:44:50.940699+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.940699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:49.749243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.844844+0000","last_change":"2024-09-14T12:44:54.844844+0000","last_active":"2024-09-14T12:44:54.844844+0000","last_peered":"2024-09-14T12:44:54.844844+0000","last_clean":"2024-09-14T12:44:54.844844+0000","last_became_active":"2024-09-14T11:12:19.078164+0000","last_became_peered":"2024-09-14T11:12:19.078164+0000","last_unstale":"2024-09-14T12:44:54.844844+0000","last_undegraded":"2024-09-14T12:44:54.844844+0000","last_fullsized":"2024-09-14T12:44:54.844844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:54.844656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:54.844656+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.844656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:37.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"267'14","reported_seq":124,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.849613+0000","last_change":"2024-09-14T12:44:50.849329+0000","last_active":"2024-09-14T12:44:50.849613+0000","last_peered":"2024-09-14T12:44:50.849613+0000","last_clean":"2024-09-14T12:44:50.849613+0000","last_became_active":"2024-09-14T11:06:29.538616+0000","last_became_peered":"2024-09-14T11:06:29.538616+0000","last_unstale":"2024-09-14T12:44:50.849613+0000","last_undegraded":"2024-09-14T12:44:50.849613+0000","last_fullsized":"2024-09-14T12:44:50.849613+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T12:44:50.849117+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T12:44:50.849117+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.849117+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:39.853529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":63,"num_write":44,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.913339+0000","last_change":"2024-09-14T12:44:49.913175+0000","last_active":"2024-09-14T12:44:49.913339+0000","last_peered":"2024-09-14T12:44:49.913339+0000","last_clean":"2024-09-14T12:44:49.913339+0000","last_became_active":"2024-09-14T11:40:08.942721+0000","last_became_peered":"2024-09-14T11:40:08.942721+0000","last_unstale":"2024-09-14T12:44:49.913339+0000","last_undegraded":"2024-09-14T12:44:49.913339+0000","last_fullsized":"2024-09-14T12:44:49.913339+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.912990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.912990+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.912990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:51.708919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"264'5","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:02.781732+0000","last_change":"2024-09-14T12:45:02.781732+0000","last_active":"2024-09-14T12:45:02.781732+0000","last_peered":"2024-09-14T12:45:02.781732+0000","last_clean":"2024-09-14T12:45:02.781732+0000","last_became_active":"2024-09-14T11:12:26.228172+0000","last_became_peered":"2024-09-14T11:12:26.228172+0000","last_unstale":"2024-09-14T12:45:02.781732+0000","last_undegraded":"2024-09-14T12:45:02.781732+0000","last_fullsized":"2024-09-14T12:45:02.781732+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T12:45:02.781536+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T12:45:02.781536+0000","last_clean_scrub_stamp":"2024-09-14T12:45:02.781536+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:43.286660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5124,"num_write":10,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"267'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.388216+0000","last_change":"2024-09-14T12:44:50.388216+0000","last_active":"2024-09-14T12:44:50.388216+0000","last_peered":"2024-09-14T12:44:50.388216+0000","last_clean":"2024-09-14T12:44:50.388216+0000","last_became_active":"2024-09-14T11:12:19.110542+0000","last_became_peered":"2024-09-14T11:12:19.110542+0000","last_unstale":"2024-09-14T12:44:50.388216+0000","last_undegraded":"2024-09-14T12:44:50.388216+0000","last_fullsized":"2024-09-14T12:44:50.388216+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:50.388026+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:50.388026+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.388026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:33.198753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"267'37","reported_seq":178,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.787831+0000","last_change":"2024-09-14T12:44:46.787831+0000","last_active":"2024-09-14T12:44:46.787831+0000","last_peered":"2024-09-14T12:44:46.787831+0000","last_clean":"2024-09-14T12:44:46.787831+0000","last_became_active":"2024-09-14T11:06:29.531655+0000","last_became_peered":"2024-09-14T11:06:29.531655+0000","last_unstale":"2024-09-14T12:44:46.787831+0000","last_undegraded":"2024-09-14T12:44:46.787831+0000","last_fullsized":"2024-09-14T12:44:46.787831+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-09-14T12:44:46.787606+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-09-14T12:44:46.787606+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.787606+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:04.426417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":291,"num_read_kb":194,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:08.790794+0000","last_change":"2024-09-14T12:45:08.790794+0000","last_active":"2024-09-14T12:45:08.790794+0000","last_peered":"2024-09-14T12:45:08.790794+0000","last_clean":"2024-09-14T12:45:08.790794+0000","last_became_active":"2024-09-14T11:40:08.939509+0000","last_became_peered":"2024-09-14T11:40:08.939509+0000","last_unstale":"2024-09-14T12:45:08.790794+0000","last_undegraded":"2024-09-14T12:45:08.790794+0000","last_fullsized":"2024-09-14T12:45:08.790794+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:08.790606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:08.790606+0000","last_clean_scrub_stamp":"2024-09-14T12:45:08.790606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:06.318708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"267'7","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:01.830125+0000","last_change":"2024-09-14T12:45:01.830125+0000","last_active":"2024-09-14T12:45:01.830125+0000","last_peered":"2024-09-14T12:45:01.830125+0000","last_clean":"2024-09-14T12:45:01.830125+0000","last_became_active":"2024-09-14T11:12:26.230403+0000","last_became_peered":"2024-09-14T11:12:26.230403+0000","last_unstale":"2024-09-14T12:45:01.830125+0000","last_undegraded":"2024-09-14T12:45:01.830125+0000","last_fullsized":"2024-09-14T12:45:01.830125+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T12:45:01.829939+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T12:45:01.829939+0000","last_clean_scrub_stamp":"2024-09-14T12:45:01.829939+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:22.959986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7282,"num_write":12,"num_write_kb":5687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.956468+0000","last_change":"2024-09-14T12:44:45.956468+0000","last_active":"2024-09-14T12:44:45.956468+0000","last_peered":"2024-09-14T12:44:45.956468+0000","last_clean":"2024-09-14T12:44:45.956468+0000","last_became_active":"2024-09-14T11:12:19.105062+0000","last_became_peered":"2024-09-14T11:12:19.105062+0000","last_unstale":"2024-09-14T12:44:45.956468+0000","last_undegraded":"2024-09-14T12:44:45.956468+0000","last_fullsized":"2024-09-14T12:44:45.956468+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:45.956287+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:45.956287+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.956287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:26.856074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"267'12","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.795373+0000","last_change":"2024-09-14T12:44:45.795373+0000","last_active":"2024-09-14T12:44:45.795373+0000","last_peered":"2024-09-14T12:44:45.795373+0000","last_clean":"2024-09-14T12:44:45.795373+0000","last_became_active":"2024-09-14T11:06:29.509556+0000","last_became_peered":"2024-09-14T11:06:29.509556+0000","last_unstale":"2024-09-14T12:44:45.795373+0000","last_undegraded":"2024-09-14T12:44:45.795373+0000","last_fullsized":"2024-09-14T12:44:45.795373+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T12:44:45.795160+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T12:44:45.795160+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.795160+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:53.237709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":72,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:00.332948+0000","last_change":"2024-09-14T12:45:00.332948+0000","last_active":"2024-09-14T12:45:00.332948+0000","last_peered":"2024-09-14T12:45:00.332948+0000","last_clean":"2024-09-14T12:45:00.332948+0000","last_became_active":"2024-09-14T11:40:08.927702+0000","last_became_peered":"2024-09-14T11:40:08.927702+0000","last_unstale":"2024-09-14T12:45:00.332948+0000","last_undegraded":"2024-09-14T12:45:00.332948+0000","last_fullsized":"2024-09-14T12:45:00.332948+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:00.332762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:00.332762+0000","last_clean_scrub_stamp":"2024-09-14T12:45:00.332762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:46.028111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.116492+0000","last_change":"2024-09-14T12:44:43.116492+0000","last_active":"2024-09-14T12:44:43.116492+0000","last_peered":"2024-09-14T12:44:43.116492+0000","last_clean":"2024-09-14T12:44:43.116492+0000","last_became_active":"2024-09-14T11:12:26.218925+0000","last_became_peered":"2024-09-14T11:12:26.218925+0000","last_unstale":"2024-09-14T12:44:43.116492+0000","last_undegraded":"2024-09-14T12:44:43.116492+0000","last_fullsized":"2024-09-14T12:44:43.116492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.116288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.116288+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.116288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:25.426487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"267'4","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.848653+0000","last_change":"2024-09-14T12:44:53.848653+0000","last_active":"2024-09-14T12:44:53.848653+0000","last_peered":"2024-09-14T12:44:53.848653+0000","last_clean":"2024-09-14T12:44:53.848653+0000","last_became_active":"2024-09-14T11:12:19.110528+0000","last_became_peered":"2024-09-14T11:12:19.110528+0000","last_unstale":"2024-09-14T12:44:53.848653+0000","last_undegraded":"2024-09-14T12:44:53.848653+0000","last_fullsized":"2024-09-14T12:44:53.848653+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:53.848423+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:53.848423+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.848423+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:03.288236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"267'15","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.794541+0000","last_change":"2024-09-14T12:44:44.794541+0000","last_active":"2024-09-14T12:44:44.794541+0000","last_peered":"2024-09-14T12:44:44.794541+0000","last_clean":"2024-09-14T12:44:44.794541+0000","last_became_active":"2024-09-14T11:06:29.538597+0000","last_became_peered":"2024-09-14T11:06:29.538597+0000","last_unstale":"2024-09-14T12:44:44.794541+0000","last_undegraded":"2024-09-14T12:44:44.794541+0000","last_fullsized":"2024-09-14T12:44:44.794541+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T12:44:44.794358+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T12:44:44.794358+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.794358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:00.653289+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:56.801299+0000","last_change":"2024-09-14T12:44:56.801299+0000","last_active":"2024-09-14T12:44:56.801299+0000","last_peered":"2024-09-14T12:44:56.801299+0000","last_clean":"2024-09-14T12:44:56.801299+0000","last_became_active":"2024-09-14T11:40:08.924934+0000","last_became_peered":"2024-09-14T11:40:08.924934+0000","last_unstale":"2024-09-14T12:44:56.801299+0000","last_undegraded":"2024-09-14T12:44:56.801299+0000","last_fullsized":"2024-09-14T12:44:56.801299+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:56.801027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:56.801027+0000","last_clean_scrub_stamp":"2024-09-14T12:44:56.801027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:15.742318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:13.517510+0000","last_change":"2024-09-14T12:45:13.517510+0000","last_active":"2024-09-14T12:45:13.517510+0000","last_peered":"2024-09-14T12:45:13.517510+0000","last_clean":"2024-09-14T12:45:13.517510+0000","last_became_active":"2024-09-14T11:12:26.245890+0000","last_became_peered":"2024-09-14T11:12:26.245890+0000","last_unstale":"2024-09-14T12:45:13.517510+0000","last_undegraded":"2024-09-14T12:45:13.517510+0000","last_fullsized":"2024-09-14T12:45:13.517510+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:13.517321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:13.517321+0000","last_clean_scrub_stamp":"2024-09-14T12:45:13.517321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:06.021872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:09.514557+0000","last_change":"2024-09-14T12:45:09.514557+0000","last_active":"2024-09-14T12:45:09.514557+0000","last_peered":"2024-09-14T12:45:09.514557+0000","last_clean":"2024-09-14T12:45:09.514557+0000","last_became_active":"2024-09-14T11:12:19.108158+0000","last_became_peered":"2024-09-14T11:12:19.108158+0000","last_unstale":"2024-09-14T12:45:09.514557+0000","last_undegraded":"2024-09-14T12:45:09.514557+0000","last_fullsized":"2024-09-14T12:45:09.514557+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:09.514370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:09.514370+0000","last_clean_scrub_stamp":"2024-09-14T12:45:09.514370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:58.570919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"267'13","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.955336+0000","last_change":"2024-09-14T12:44:39.955336+0000","last_active":"2024-09-14T12:44:39.955336+0000","last_peered":"2024-09-14T12:44:39.955336+0000","last_clean":"2024-09-14T12:44:39.955336+0000","last_became_active":"2024-09-14T11:06:29.525271+0000","last_became_peered":"2024-09-14T11:06:29.525271+0000","last_unstale":"2024-09-14T12:44:39.955336+0000","last_undegraded":"2024-09-14T12:44:39.955336+0000","last_fullsized":"2024-09-14T12:44:39.955336+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T12:44:39.955145+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T12:44:39.955145+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.955145+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:17.903750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":68,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.976218+0000","last_change":"2024-09-14T12:44:52.976074+0000","last_active":"2024-09-14T12:44:52.976218+0000","last_peered":"2024-09-14T12:44:52.976218+0000","last_clean":"2024-09-14T12:44:52.976218+0000","last_became_active":"2024-09-14T11:40:08.928406+0000","last_became_peered":"2024-09-14T11:40:08.928406+0000","last_unstale":"2024-09-14T12:44:52.976218+0000","last_undegraded":"2024-09-14T12:44:52.976218+0000","last_fullsized":"2024-09-14T12:44:52.976218+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:52.975896+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:52.975896+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.975896+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:29.495158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.891090+0000","last_change":"2024-09-14T12:44:49.890960+0000","last_active":"2024-09-14T12:44:49.891090+0000","last_peered":"2024-09-14T12:44:49.891090+0000","last_clean":"2024-09-14T12:44:49.891090+0000","last_became_active":"2024-09-14T11:12:26.241189+0000","last_became_peered":"2024-09-14T11:12:26.241189+0000","last_unstale":"2024-09-14T12:44:49.891090+0000","last_undegraded":"2024-09-14T12:44:49.891090+0000","last_fullsized":"2024-09-14T12:44:49.891090+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.890785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.890785+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.890785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:48.122625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.098700+0000","last_change":"2024-09-14T12:44:39.098574+0000","last_active":"2024-09-14T12:44:39.098700+0000","last_peered":"2024-09-14T12:44:39.098700+0000","last_clean":"2024-09-14T12:44:39.098700+0000","last_became_active":"2024-09-14T11:12:19.090134+0000","last_became_peered":"2024-09-14T11:12:19.090134+0000","last_unstale":"2024-09-14T12:44:39.098700+0000","last_undegraded":"2024-09-14T12:44:39.098700+0000","last_fullsized":"2024-09-14T12:44:39.098700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:39.098388+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:39.098388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.098388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:33.763161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4097,"num_write":4,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"267'175","reported_seq":586,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.327884+0000","last_change":"2024-09-14T12:44:43.327884+0000","last_active":"2024-09-14T12:44:43.327884+0000","last_peered":"2024-09-14T12:44:43.327884+0000","last_clean":"2024-09-14T12:44:43.327884+0000","last_became_active":"2024-09-14T11:06:29.531149+0000","last_became_peered":"2024-09-14T11:06:29.531149+0000","last_unstale":"2024-09-14T12:44:43.327884+0000","last_undegraded":"2024-09-14T12:44:43.327884+0000","last_fullsized":"2024-09-14T12:44:43.327884+0000","mapping_epoch":256,"log_start":"264'100","ondisk_log_start":"264'100","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-14T12:44:43.327621+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-14T12:44:43.327621+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.327621+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:13.301203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1578,"num_read_kb":1327,"num_write":388,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.066954+0000","last_change":"2024-09-14T12:44:48.066809+0000","last_active":"2024-09-14T12:44:48.066954+0000","last_peered":"2024-09-14T12:44:48.066954+0000","last_clean":"2024-09-14T12:44:48.066954+0000","last_became_active":"2024-09-14T11:40:08.942208+0000","last_became_peered":"2024-09-14T11:40:08.942208+0000","last_unstale":"2024-09-14T12:44:48.066954+0000","last_undegraded":"2024-09-14T12:44:48.066954+0000","last_fullsized":"2024-09-14T12:44:48.066954+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:48.066632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:48.066632+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.066632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:17.322690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:57.353584+0000","last_change":"2024-09-14T12:44:57.353438+0000","last_active":"2024-09-14T12:44:57.353584+0000","last_peered":"2024-09-14T12:44:57.353584+0000","last_clean":"2024-09-14T12:44:57.353584+0000","last_became_active":"2024-09-14T11:12:26.236221+0000","last_became_peered":"2024-09-14T11:12:26.236221+0000","last_unstale":"2024-09-14T12:44:57.353584+0000","last_undegraded":"2024-09-14T12:44:57.353584+0000","last_fullsized":"2024-09-14T12:44:57.353584+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:57.353255+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:57.353255+0000","last_clean_scrub_stamp":"2024-09-14T12:44:57.353255+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:17.595068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.806332+0000","last_change":"2024-09-14T12:44:49.806204+0000","last_active":"2024-09-14T12:44:49.806332+0000","last_peered":"2024-09-14T12:44:49.806332+0000","last_clean":"2024-09-14T12:44:49.806332+0000","last_became_active":"2024-09-14T11:12:19.086765+0000","last_became_peered":"2024-09-14T11:12:19.086765+0000","last_unstale":"2024-09-14T12:44:49.806332+0000","last_undegraded":"2024-09-14T12:44:49.806332+0000","last_fullsized":"2024-09-14T12:44:49.806332+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.806019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.806019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.806019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:34.322738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"267'21","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.794605+0000","last_change":"2024-09-14T12:44:43.794605+0000","last_active":"2024-09-14T12:44:43.794605+0000","last_peered":"2024-09-14T12:44:43.794605+0000","last_clean":"2024-09-14T12:44:43.794605+0000","last_became_active":"2024-09-14T11:06:29.518028+0000","last_became_peered":"2024-09-14T11:06:29.518028+0000","last_unstale":"2024-09-14T12:44:43.794605+0000","last_undegraded":"2024-09-14T12:44:43.794605+0000","last_fullsized":"2024-09-14T12:44:43.794605+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-14T12:44:43.794424+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-14T12:44:43.794424+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.794424+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.700307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":96,"num_write":55,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:07.749382+0000","last_change":"2024-09-14T12:45:07.749175+0000","last_active":"2024-09-14T12:45:07.749382+0000","last_peered":"2024-09-14T12:45:07.749382+0000","last_clean":"2024-09-14T12:45:07.749382+0000","last_became_active":"2024-09-14T11:40:08.953030+0000","last_became_peered":"2024-09-14T11:40:08.953030+0000","last_unstale":"2024-09-14T12:45:07.749382+0000","last_undegraded":"2024-09-14T12:45:07.749382+0000","last_fullsized":"2024-09-14T12:45:07.749382+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:07.748994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:07.748994+0000","last_clean_scrub_stamp":"2024-09-14T12:45:07.748994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:17.170418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.316913+0000","last_change":"2024-09-14T12:44:54.316913+0000","last_active":"2024-09-14T12:44:54.316913+0000","last_peered":"2024-09-14T12:44:54.316913+0000","last_clean":"2024-09-14T12:44:54.316913+0000","last_became_active":"2024-09-14T11:12:26.247784+0000","last_became_peered":"2024-09-14T11:12:26.247784+0000","last_unstale":"2024-09-14T12:44:54.316913+0000","last_undegraded":"2024-09-14T12:44:54.316913+0000","last_fullsized":"2024-09-14T12:44:54.316913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:54.316723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:54.316723+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.316723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:02.466057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"267'6","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:10.475319+0000","last_change":"2024-09-14T12:45:10.475319+0000","last_active":"2024-09-14T12:45:10.475319+0000","last_peered":"2024-09-14T12:45:10.475319+0000","last_clean":"2024-09-14T12:45:10.475319+0000","last_became_active":"2024-09-14T11:12:19.113431+0000","last_became_peered":"2024-09-14T11:12:19.113431+0000","last_unstale":"2024-09-14T12:45:10.475319+0000","last_undegraded":"2024-09-14T12:45:10.475319+0000","last_fullsized":"2024-09-14T12:45:10.475319+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:45:10.475028+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:45:10.475028+0000","last_clean_scrub_stamp":"2024-09-14T12:45:10.475028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:02.218511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7166,"num_write":6,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"267'46","reported_seq":205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.782030+0000","last_change":"2024-09-14T12:44:48.782030+0000","last_active":"2024-09-14T12:44:48.782030+0000","last_peered":"2024-09-14T12:44:48.782030+0000","last_clean":"2024-09-14T12:44:48.782030+0000","last_became_active":"2024-09-14T11:06:29.532061+0000","last_became_peered":"2024-09-14T11:06:29.532061+0000","last_unstale":"2024-09-14T12:44:48.782030+0000","last_undegraded":"2024-09-14T12:44:48.782030+0000","last_fullsized":"2024-09-14T12:44:48.782030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'46","last_scrub_stamp":"2024-09-14T12:44:48.781878+0000","last_deep_scrub":"267'46","last_deep_scrub_stamp":"2024-09-14T12:44:48.781878+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.781878+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:12.193204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":374,"num_read_kb":235,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.740555+0000","last_change":"2024-09-14T12:44:51.740379+0000","last_active":"2024-09-14T12:44:51.740555+0000","last_peered":"2024-09-14T12:44:51.740555+0000","last_clean":"2024-09-14T12:44:51.740555+0000","last_became_active":"2024-09-14T11:40:08.937813+0000","last_became_peered":"2024-09-14T11:40:08.937813+0000","last_unstale":"2024-09-14T12:44:51.740555+0000","last_undegraded":"2024-09-14T12:44:51.740555+0000","last_fullsized":"2024-09-14T12:44:51.740555+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:51.740195+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:51.740195+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.740195+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:04.832887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"267'12","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:00.855468+0000","last_change":"2024-09-14T12:45:00.855468+0000","last_active":"2024-09-14T12:45:00.855468+0000","last_peered":"2024-09-14T12:45:00.855468+0000","last_clean":"2024-09-14T12:45:00.855468+0000","last_became_active":"2024-09-14T11:12:26.243612+0000","last_became_peered":"2024-09-14T11:12:26.243612+0000","last_unstale":"2024-09-14T12:45:00.855468+0000","last_undegraded":"2024-09-14T12:45:00.855468+0000","last_fullsized":"2024-09-14T12:45:00.855468+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T12:45:00.855172+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T12:45:00.855172+0000","last_clean_scrub_stamp":"2024-09-14T12:45:00.855172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:39.911133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":15364,"num_write":22,"num_write_kb":14340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.149402+0000","last_change":"2024-09-14T12:44:37.149402+0000","last_active":"2024-09-14T12:44:37.149402+0000","last_peered":"2024-09-14T12:44:37.149402+0000","last_clean":"2024-09-14T12:44:37.149402+0000","last_became_active":"2024-09-14T11:12:19.103871+0000","last_became_peered":"2024-09-14T11:12:19.103871+0000","last_unstale":"2024-09-14T12:44:37.149402+0000","last_undegraded":"2024-09-14T12:44:37.149402+0000","last_fullsized":"2024-09-14T12:44:37.149402+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:37.149216+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:37.149216+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.149216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:20.246009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"267'29","reported_seq":152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.800677+0000","last_change":"2024-09-14T12:44:49.800677+0000","last_active":"2024-09-14T12:44:49.800677+0000","last_peered":"2024-09-14T12:44:49.800677+0000","last_clean":"2024-09-14T12:44:49.800677+0000","last_became_active":"2024-09-14T11:06:29.529421+0000","last_became_peered":"2024-09-14T11:06:29.529421+0000","last_unstale":"2024-09-14T12:44:49.800677+0000","last_undegraded":"2024-09-14T12:44:49.800677+0000","last_fullsized":"2024-09-14T12:44:49.800677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T12:44:49.800471+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T12:44:49.800471+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.800471+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:47.936186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":129,"num_write":70,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.927314+0000","last_change":"2024-09-14T12:44:53.927171+0000","last_active":"2024-09-14T12:44:53.927314+0000","last_peered":"2024-09-14T12:44:53.927314+0000","last_clean":"2024-09-14T12:44:53.927314+0000","last_became_active":"2024-09-14T11:40:08.944066+0000","last_became_peered":"2024-09-14T11:40:08.944066+0000","last_unstale":"2024-09-14T12:44:53.927314+0000","last_undegraded":"2024-09-14T12:44:53.927314+0000","last_fullsized":"2024-09-14T12:44:53.927314+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:53.926986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:53.926986+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.926986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:30.102511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:55.353977+0000","last_change":"2024-09-14T12:44:55.353977+0000","last_active":"2024-09-14T12:44:55.353977+0000","last_peered":"2024-09-14T12:44:55.353977+0000","last_clean":"2024-09-14T12:44:55.353977+0000","last_became_active":"2024-09-14T11:12:26.224877+0000","last_became_peered":"2024-09-14T11:12:26.224877+0000","last_unstale":"2024-09-14T12:44:55.353977+0000","last_undegraded":"2024-09-14T12:44:55.353977+0000","last_fullsized":"2024-09-14T12:44:55.353977+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:55.353791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:55.353791+0000","last_clean_scrub_stamp":"2024-09-14T12:44:55.353791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:57.967814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"267'11","reported_seq":92,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.360372+0000","last_change":"2024-09-14T12:44:47.360372+0000","last_active":"2024-09-14T12:44:47.360372+0000","last_peered":"2024-09-14T12:44:47.360372+0000","last_clean":"2024-09-14T12:44:47.360372+0000","last_became_active":"2024-09-14T11:12:19.107563+0000","last_became_peered":"2024-09-14T11:12:19.107563+0000","last_unstale":"2024-09-14T12:44:47.360372+0000","last_undegraded":"2024-09-14T12:44:47.360372+0000","last_fullsized":"2024-09-14T12:44:47.360372+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T12:44:47.360187+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T12:44:47.360187+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.360187+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:38.915198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9259,"num_write":16,"num_write_kb":6185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.366789+0000","last_change":"2024-09-14T12:44:42.366789+0000","last_active":"2024-09-14T12:44:42.366789+0000","last_peered":"2024-09-14T12:44:42.366789+0000","last_clean":"2024-09-14T12:44:42.366789+0000","last_became_active":"2024-09-14T11:06:29.534316+0000","last_became_peered":"2024-09-14T11:06:29.534316+0000","last_unstale":"2024-09-14T12:44:42.366789+0000","last_undegraded":"2024-09-14T12:44:42.366789+0000","last_fullsized":"2024-09-14T12:44:42.366789+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T12:44:42.366563+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T12:44:42.366563+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.366563+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:29.776445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":71,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.053901+0000","last_change":"2024-09-14T12:44:47.053744+0000","last_active":"2024-09-14T12:44:47.053901+0000","last_peered":"2024-09-14T12:44:47.053901+0000","last_clean":"2024-09-14T12:44:47.053901+0000","last_became_active":"2024-09-14T11:40:08.945227+0000","last_became_peered":"2024-09-14T11:40:08.945227+0000","last_unstale":"2024-09-14T12:44:47.053901+0000","last_undegraded":"2024-09-14T12:44:47.053901+0000","last_fullsized":"2024-09-14T12:44:47.053901+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.053527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.053527+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.053527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:03.906857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.137784+0000","last_change":"2024-09-14T12:44:42.137784+0000","last_active":"2024-09-14T12:44:42.137784+0000","last_peered":"2024-09-14T12:44:42.137784+0000","last_clean":"2024-09-14T12:44:42.137784+0000","last_became_active":"2024-09-14T11:12:26.238844+0000","last_became_peered":"2024-09-14T11:12:26.238844+0000","last_unstale":"2024-09-14T12:44:42.137784+0000","last_undegraded":"2024-09-14T12:44:42.137784+0000","last_fullsized":"2024-09-14T12:44:42.137784+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:42.137575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:42.137575+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.137575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:12.523037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"267'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.875507+0000","last_change":"2024-09-14T12:44:52.875507+0000","last_active":"2024-09-14T12:44:52.875507+0000","last_peered":"2024-09-14T12:44:52.875507+0000","last_clean":"2024-09-14T12:44:52.875507+0000","last_became_active":"2024-09-14T11:12:19.072275+0000","last_became_peered":"2024-09-14T11:12:19.072275+0000","last_unstale":"2024-09-14T12:44:52.875507+0000","last_undegraded":"2024-09-14T12:44:52.875507+0000","last_fullsized":"2024-09-14T12:44:52.875507+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:52.875288+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:52.875288+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.875288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:57.593125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"267'30","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:03.557440+0000","last_change":"2024-09-14T12:45:03.557440+0000","last_active":"2024-09-14T12:45:03.557440+0000","last_peered":"2024-09-14T12:45:03.557440+0000","last_clean":"2024-09-14T12:45:03.557440+0000","last_became_active":"2024-09-14T11:06:29.518650+0000","last_became_peered":"2024-09-14T11:06:29.518650+0000","last_unstale":"2024-09-14T12:45:03.557440+0000","last_undegraded":"2024-09-14T12:45:03.557440+0000","last_fullsized":"2024-09-14T12:45:03.557440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'30","last_scrub_stamp":"2024-09-14T12:45:03.557253+0000","last_deep_scrub":"267'30","last_deep_scrub_stamp":"2024-09-14T12:45:03.557253+0000","last_clean_scrub_stamp":"2024-09-14T12:45:03.557253+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:19.371183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":172,"num_write":81,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:09.838914+0000","last_change":"2024-09-14T12:45:09.838751+0000","last_active":"2024-09-14T12:45:09.838914+0000","last_peered":"2024-09-14T12:45:09.838914+0000","last_clean":"2024-09-14T12:45:09.838914+0000","last_became_active":"2024-09-14T11:40:08.950670+0000","last_became_peered":"2024-09-14T11:40:08.950670+0000","last_unstale":"2024-09-14T12:45:09.838914+0000","last_undegraded":"2024-09-14T12:45:09.838914+0000","last_fullsized":"2024-09-14T12:45:09.838914+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:09.838566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:09.838566+0000","last_clean_scrub_stamp":"2024-09-14T12:45:09.838566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:57.211997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"267'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:59.824053+0000","last_change":"2024-09-14T12:44:59.824053+0000","last_active":"2024-09-14T12:44:59.824053+0000","last_peered":"2024-09-14T12:44:59.824053+0000","last_clean":"2024-09-14T12:44:59.824053+0000","last_became_active":"2024-09-14T11:12:26.227851+0000","last_became_peered":"2024-09-14T11:12:26.227851+0000","last_unstale":"2024-09-14T12:44:59.824053+0000","last_undegraded":"2024-09-14T12:44:59.824053+0000","last_fullsized":"2024-09-14T12:44:59.824053+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:44:59.823873+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:44:59.823873+0000","last_clean_scrub_stamp":"2024-09-14T12:44:59.823873+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:51.149556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.969195+0000","last_change":"2024-09-14T12:44:44.969195+0000","last_active":"2024-09-14T12:44:44.969195+0000","last_peered":"2024-09-14T12:44:44.969195+0000","last_clean":"2024-09-14T12:44:44.969195+0000","last_became_active":"2024-09-14T11:12:19.091893+0000","last_became_peered":"2024-09-14T11:12:19.091893+0000","last_unstale":"2024-09-14T12:44:44.969195+0000","last_undegraded":"2024-09-14T12:44:44.969195+0000","last_fullsized":"2024-09-14T12:44:44.969195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T12:44:44.969008+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T12:44:44.969008+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.969008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:21.602815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"267'35","reported_seq":172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:02.530908+0000","last_change":"2024-09-14T12:45:02.530908+0000","last_active":"2024-09-14T12:45:02.530908+0000","last_peered":"2024-09-14T12:45:02.530908+0000","last_clean":"2024-09-14T12:45:02.530908+0000","last_became_active":"2024-09-14T11:06:29.545575+0000","last_became_peered":"2024-09-14T11:06:29.545575+0000","last_unstale":"2024-09-14T12:45:02.530908+0000","last_undegraded":"2024-09-14T12:45:02.530908+0000","last_fullsized":"2024-09-14T12:45:02.530908+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'35","last_scrub_stamp":"2024-09-14T12:45:02.530709+0000","last_deep_scrub":"267'35","last_deep_scrub_stamp":"2024-09-14T12:45:02.530709+0000","last_clean_scrub_stamp":"2024-09-14T12:45:02.530709+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:12.110862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":183,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.751051+0000","last_change":"2024-09-14T12:44:53.750889+0000","last_active":"2024-09-14T12:44:53.751051+0000","last_peered":"2024-09-14T12:44:53.751051+0000","last_clean":"2024-09-14T12:44:53.751051+0000","last_became_active":"2024-09-14T11:40:08.925358+0000","last_became_peered":"2024-09-14T11:40:08.925358+0000","last_unstale":"2024-09-14T12:44:53.751051+0000","last_undegraded":"2024-09-14T12:44:53.751051+0000","last_fullsized":"2024-09-14T12:44:53.751051+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:53.750710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:53.750710+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.750710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:21.298940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:56.830136+0000","last_change":"2024-09-14T12:44:56.830136+0000","last_active":"2024-09-14T12:44:56.830136+0000","last_peered":"2024-09-14T12:44:56.830136+0000","last_clean":"2024-09-14T12:44:56.830136+0000","last_became_active":"2024-09-14T11:12:26.246881+0000","last_became_peered":"2024-09-14T11:12:26.246881+0000","last_unstale":"2024-09-14T12:44:56.830136+0000","last_undegraded":"2024-09-14T12:44:56.830136+0000","last_fullsized":"2024-09-14T12:44:56.830136+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:56.829949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:56.829949+0000","last_clean_scrub_stamp":"2024-09-14T12:44:56.829949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:54.512197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.839900+0000","last_change":"2024-09-14T12:44:51.839900+0000","last_active":"2024-09-14T12:44:51.839900+0000","last_peered":"2024-09-14T12:44:51.839900+0000","last_clean":"2024-09-14T12:44:51.839900+0000","last_became_active":"2024-09-14T11:12:19.095821+0000","last_became_peered":"2024-09-14T11:12:19.095821+0000","last_unstale":"2024-09-14T12:44:51.839900+0000","last_undegraded":"2024-09-14T12:44:51.839900+0000","last_fullsized":"2024-09-14T12:44:51.839900+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:51.839710+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:51.839710+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.839710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:10.652391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4663,"num_write":4,"num_write_kb":4663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"267'26","reported_seq":150,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.377484+0000","last_change":"2024-09-14T12:44:41.377484+0000","last_active":"2024-09-14T12:44:41.377484+0000","last_peered":"2024-09-14T12:44:41.377484+0000","last_clean":"2024-09-14T12:44:41.377484+0000","last_became_active":"2024-09-14T11:06:29.529753+0000","last_became_peered":"2024-09-14T11:06:29.529753+0000","last_unstale":"2024-09-14T12:44:41.377484+0000","last_undegraded":"2024-09-14T12:44:41.377484+0000","last_fullsized":"2024-09-14T12:44:41.377484+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-14T12:44:41.377309+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-14T12:44:41.377309+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.377309+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.262253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:55.790690+0000","last_change":"2024-09-14T12:44:55.790690+0000","last_active":"2024-09-14T12:44:55.790690+0000","last_peered":"2024-09-14T12:44:55.790690+0000","last_clean":"2024-09-14T12:44:55.790690+0000","last_became_active":"2024-09-14T11:40:08.924726+0000","last_became_peered":"2024-09-14T11:40:08.924726+0000","last_unstale":"2024-09-14T12:44:55.790690+0000","last_undegraded":"2024-09-14T12:44:55.790690+0000","last_fullsized":"2024-09-14T12:44:55.790690+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:55.790495+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:55.790495+0000","last_clean_scrub_stamp":"2024-09-14T12:44:55.790495+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:22.693361+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:56.320252+0000","last_change":"2024-09-14T12:44:56.320252+0000","last_active":"2024-09-14T12:44:56.320252+0000","last_peered":"2024-09-14T12:44:56.320252+0000","last_clean":"2024-09-14T12:44:56.320252+0000","last_became_active":"2024-09-14T11:12:26.219169+0000","last_became_peered":"2024-09-14T11:12:26.219169+0000","last_unstale":"2024-09-14T12:44:56.320252+0000","last_undegraded":"2024-09-14T12:44:56.320252+0000","last_fullsized":"2024-09-14T12:44:56.320252+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T12:44:56.320061+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T12:44:56.320061+0000","last_clean_scrub_stamp":"2024-09-14T12:44:56.320061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:13.543957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"267'10","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.981302+0000","last_change":"2024-09-14T12:44:42.981302+0000","last_active":"2024-09-14T12:44:42.981302+0000","last_peered":"2024-09-14T12:44:42.981302+0000","last_clean":"2024-09-14T12:44:42.981302+0000","last_became_active":"2024-09-14T11:12:19.099233+0000","last_became_peered":"2024-09-14T11:12:19.099233+0000","last_unstale":"2024-09-14T12:44:42.981302+0000","last_undegraded":"2024-09-14T12:44:42.981302+0000","last_fullsized":"2024-09-14T12:44:42.981302+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-14T12:44:42.981106+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-14T12:44:42.981106+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.981106+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:17.335892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8230,"num_write":10,"num_write_kb":6172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"267'35","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.935737+0000","last_change":"2024-09-14T12:44:42.935737+0000","last_active":"2024-09-14T12:44:42.935737+0000","last_peered":"2024-09-14T12:44:42.935737+0000","last_clean":"2024-09-14T12:44:42.935737+0000","last_became_active":"2024-09-14T11:06:29.508842+0000","last_became_peered":"2024-09-14T11:06:29.508842+0000","last_unstale":"2024-09-14T12:44:42.935737+0000","last_undegraded":"2024-09-14T12:44:42.935737+0000","last_fullsized":"2024-09-14T12:44:42.935737+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'35","last_scrub_stamp":"2024-09-14T12:44:42.935551+0000","last_deep_scrub":"267'35","last_deep_scrub_stamp":"2024-09-14T12:44:42.935551+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.935551+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:26:40.214950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":189,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.726174+0000","last_change":"2024-09-14T12:44:52.725935+0000","last_active":"2024-09-14T12:44:52.726174+0000","last_peered":"2024-09-14T12:44:52.726174+0000","last_clean":"2024-09-14T12:44:52.726174+0000","last_became_active":"2024-09-14T11:40:08.944382+0000","last_became_peered":"2024-09-14T11:40:08.944382+0000","last_unstale":"2024-09-14T12:44:52.726174+0000","last_undegraded":"2024-09-14T12:44:52.726174+0000","last_fullsized":"2024-09-14T12:44:52.726174+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:52.725690+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:52.725690+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.725690+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:36.556030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"267'6","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:14.562512+0000","last_change":"2024-09-14T12:45:14.562512+0000","last_active":"2024-09-14T12:45:14.562512+0000","last_peered":"2024-09-14T12:45:14.562512+0000","last_clean":"2024-09-14T12:45:14.562512+0000","last_became_active":"2024-09-14T11:12:26.232336+0000","last_became_peered":"2024-09-14T11:12:26.232336+0000","last_unstale":"2024-09-14T12:45:14.562512+0000","last_undegraded":"2024-09-14T12:45:14.562512+0000","last_fullsized":"2024-09-14T12:45:14.562512+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:45:14.562319+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:45:14.562319+0000","last_clean_scrub_stamp":"2024-09-14T12:45:14.562319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:52.495122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12288,"num_write":6,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.977146+0000","last_change":"2024-09-14T12:44:43.977146+0000","last_active":"2024-09-14T12:44:43.977146+0000","last_peered":"2024-09-14T12:44:43.977146+0000","last_clean":"2024-09-14T12:44:43.977146+0000","last_became_active":"2024-09-14T11:12:19.092223+0000","last_became_peered":"2024-09-14T11:12:19.092223+0000","last_unstale":"2024-09-14T12:44:43.977146+0000","last_undegraded":"2024-09-14T12:44:43.977146+0000","last_fullsized":"2024-09-14T12:44:43.977146+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:43.976958+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:43.976958+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.976958+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:16.792611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2056,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"267'19","reported_seq":126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.373910+0000","last_change":"2024-09-14T12:44:40.373910+0000","last_active":"2024-09-14T12:44:40.373910+0000","last_peered":"2024-09-14T12:44:40.373910+0000","last_clean":"2024-09-14T12:44:40.373910+0000","last_became_active":"2024-09-14T11:06:29.530722+0000","last_became_peered":"2024-09-14T11:06:29.530722+0000","last_unstale":"2024-09-14T12:44:40.373910+0000","last_undegraded":"2024-09-14T12:44:40.373910+0000","last_fullsized":"2024-09-14T12:44:40.373910+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'19","last_scrub_stamp":"2024-09-14T12:44:40.373679+0000","last_deep_scrub":"267'19","last_deep_scrub_stamp":"2024-09-14T12:44:40.373679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.373679+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:10.466093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":48,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:05.788007+0000","last_change":"2024-09-14T12:45:05.787844+0000","last_active":"2024-09-14T12:45:05.788007+0000","last_peered":"2024-09-14T12:45:05.788007+0000","last_clean":"2024-09-14T12:45:05.788007+0000","last_became_active":"2024-09-14T11:40:08.947725+0000","last_became_peered":"2024-09-14T11:40:08.947725+0000","last_unstale":"2024-09-14T12:45:05.788007+0000","last_undegraded":"2024-09-14T12:45:05.788007+0000","last_fullsized":"2024-09-14T12:45:05.788007+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:05.787658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:05.787658+0000","last_clean_scrub_stamp":"2024-09-14T12:45:05.787658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:18.884007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.348167+0000","last_change":"2024-09-14T12:44:51.348167+0000","last_active":"2024-09-14T12:44:51.348167+0000","last_peered":"2024-09-14T12:44:51.348167+0000","last_clean":"2024-09-14T12:44:51.348167+0000","last_became_active":"2024-09-14T11:12:26.233006+0000","last_became_peered":"2024-09-14T11:12:26.233006+0000","last_unstale":"2024-09-14T12:44:51.348167+0000","last_undegraded":"2024-09-14T12:44:51.348167+0000","last_fullsized":"2024-09-14T12:44:51.348167+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:51.347985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:51.347985+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.347985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:16.392254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"267'2","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.963949+0000","last_change":"2024-09-14T12:44:43.963949+0000","last_active":"2024-09-14T12:44:43.963949+0000","last_peered":"2024-09-14T12:44:43.963949+0000","last_clean":"2024-09-14T12:44:43.963949+0000","last_became_active":"2024-09-14T11:12:19.085380+0000","last_became_peered":"2024-09-14T11:12:19.085380+0000","last_unstale":"2024-09-14T12:44:43.963949+0000","last_undegraded":"2024-09-14T12:44:43.963949+0000","last_fullsized":"2024-09-14T12:44:43.963949+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:43.963747+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:43.963747+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.963747+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:43.558499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"267'32","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.400381+0000","last_change":"2024-09-14T12:44:39.400381+0000","last_active":"2024-09-14T12:44:39.400381+0000","last_peered":"2024-09-14T12:44:39.400381+0000","last_clean":"2024-09-14T12:44:39.400381+0000","last_became_active":"2024-09-14T11:06:29.534458+0000","last_became_peered":"2024-09-14T11:06:29.534458+0000","last_unstale":"2024-09-14T12:44:39.400381+0000","last_undegraded":"2024-09-14T12:44:39.400381+0000","last_fullsized":"2024-09-14T12:44:39.400381+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'32","last_scrub_stamp":"2024-09-14T12:44:39.400200+0000","last_deep_scrub":"267'32","last_deep_scrub_stamp":"2024-09-14T12:44:39.400200+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.400200+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:02.119729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":170,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.947134+0000","last_change":"2024-09-14T12:44:47.946973+0000","last_active":"2024-09-14T12:44:47.947134+0000","last_peered":"2024-09-14T12:44:47.947134+0000","last_clean":"2024-09-14T12:44:47.947134+0000","last_became_active":"2024-09-14T11:40:08.949834+0000","last_became_peered":"2024-09-14T11:40:08.949834+0000","last_unstale":"2024-09-14T12:44:47.947134+0000","last_undegraded":"2024-09-14T12:44:47.947134+0000","last_fullsized":"2024-09-14T12:44:47.947134+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.946794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.946794+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.946794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:04.666311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.313066+0000","last_change":"2024-09-14T12:44:52.313066+0000","last_active":"2024-09-14T12:44:52.313066+0000","last_peered":"2024-09-14T12:44:52.313066+0000","last_clean":"2024-09-14T12:44:52.313066+0000","last_became_active":"2024-09-14T11:12:26.247614+0000","last_became_peered":"2024-09-14T11:12:26.247614+0000","last_unstale":"2024-09-14T12:44:52.313066+0000","last_undegraded":"2024-09-14T12:44:52.313066+0000","last_fullsized":"2024-09-14T12:44:52.313066+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:52.312884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:52.312884+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.312884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:22.498905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"267'14","reported_seq":100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.774373+0000","last_change":"2024-09-14T12:44:48.774373+0000","last_active":"2024-09-14T12:44:48.774373+0000","last_peered":"2024-09-14T12:44:48.774373+0000","last_clean":"2024-09-14T12:44:48.774373+0000","last_became_active":"2024-09-14T11:12:19.096087+0000","last_became_peered":"2024-09-14T11:12:19.096087+0000","last_unstale":"2024-09-14T12:44:48.774373+0000","last_undegraded":"2024-09-14T12:44:48.774373+0000","last_fullsized":"2024-09-14T12:44:48.774373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T12:44:48.774134+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T12:44:48.774134+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.774134+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:21.183878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":21525,"num_write":24,"num_write_kb":13331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"267'15","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:00.575356+0000","last_change":"2024-09-14T12:45:00.575182+0000","last_active":"2024-09-14T12:45:00.575356+0000","last_peered":"2024-09-14T12:45:00.575356+0000","last_clean":"2024-09-14T12:45:00.575356+0000","last_became_active":"2024-09-14T11:06:29.544309+0000","last_became_peered":"2024-09-14T11:06:29.544309+0000","last_unstale":"2024-09-14T12:45:00.575356+0000","last_undegraded":"2024-09-14T12:45:00.575356+0000","last_fullsized":"2024-09-14T12:45:00.575356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T12:45:00.574993+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T12:45:00.574993+0000","last_clean_scrub_stamp":"2024-09-14T12:45:00.574993+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:55.743195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":80,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:16.560476+0000","last_change":"2024-09-14T12:45:16.560476+0000","last_active":"2024-09-14T12:45:16.560476+0000","last_peered":"2024-09-14T12:45:16.560476+0000","last_clean":"2024-09-14T12:45:16.560476+0000","last_became_active":"2024-09-14T11:40:08.934447+0000","last_became_peered":"2024-09-14T11:40:08.934447+0000","last_unstale":"2024-09-14T12:45:16.560476+0000","last_undegraded":"2024-09-14T12:45:16.560476+0000","last_fullsized":"2024-09-14T12:45:16.560476+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:16.560283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:16.560283+0000","last_clean_scrub_stamp":"2024-09-14T12:45:16.560283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:31.064752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"267'11","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.270934+0000","last_change":"2024-09-14T12:44:53.270795+0000","last_active":"2024-09-14T12:44:53.270934+0000","last_peered":"2024-09-14T12:44:53.270934+0000","last_clean":"2024-09-14T12:44:53.270934+0000","last_became_active":"2024-09-14T11:12:26.253410+0000","last_became_peered":"2024-09-14T11:12:26.253410+0000","last_unstale":"2024-09-14T12:44:53.270934+0000","last_undegraded":"2024-09-14T12:44:53.270934+0000","last_fullsized":"2024-09-14T12:44:53.270934+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T12:44:53.270600+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T12:44:53.270600+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.270600+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:13.417257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6160,"num_write":16,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.371033+0000","last_change":"2024-09-14T12:44:46.371033+0000","last_active":"2024-09-14T12:44:46.371033+0000","last_peered":"2024-09-14T12:44:46.371033+0000","last_clean":"2024-09-14T12:44:46.371033+0000","last_became_active":"2024-09-14T11:12:19.109807+0000","last_became_peered":"2024-09-14T11:12:19.109807+0000","last_unstale":"2024-09-14T12:44:46.371033+0000","last_undegraded":"2024-09-14T12:44:46.371033+0000","last_fullsized":"2024-09-14T12:44:46.371033+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T12:44:46.370806+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T12:44:46.370806+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.370806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:11.684257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"267'38","reported_seq":189,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.937555+0000","last_change":"2024-09-14T12:44:39.937380+0000","last_active":"2024-09-14T12:44:39.937555+0000","last_peered":"2024-09-14T12:44:39.937555+0000","last_clean":"2024-09-14T12:44:39.937555+0000","last_became_active":"2024-09-14T11:06:29.520734+0000","last_became_peered":"2024-09-14T11:06:29.520734+0000","last_unstale":"2024-09-14T12:44:39.937555+0000","last_undegraded":"2024-09-14T12:44:39.937555+0000","last_fullsized":"2024-09-14T12:44:39.937555+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-14T12:44:39.937198+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-14T12:44:39.937198+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.937198+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.273746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":248,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.908267+0000","last_change":"2024-09-14T12:44:48.908010+0000","last_active":"2024-09-14T12:44:48.908267+0000","last_peered":"2024-09-14T12:44:48.908267+0000","last_clean":"2024-09-14T12:44:48.908267+0000","last_became_active":"2024-09-14T11:40:08.928855+0000","last_became_peered":"2024-09-14T11:40:08.928855+0000","last_unstale":"2024-09-14T12:44:48.908267+0000","last_undegraded":"2024-09-14T12:44:48.908267+0000","last_fullsized":"2024-09-14T12:44:48.908267+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:48.907783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:48.907783+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.907783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:31.883367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:57.828268+0000","last_change":"2024-09-14T12:44:57.828268+0000","last_active":"2024-09-14T12:44:57.828268+0000","last_peered":"2024-09-14T12:44:57.828268+0000","last_clean":"2024-09-14T12:44:57.828268+0000","last_became_active":"2024-09-14T11:12:26.235707+0000","last_became_peered":"2024-09-14T11:12:26.235707+0000","last_unstale":"2024-09-14T12:44:57.828268+0000","last_undegraded":"2024-09-14T12:44:57.828268+0000","last_fullsized":"2024-09-14T12:44:57.828268+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T12:44:57.828068+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T12:44:57.828068+0000","last_clean_scrub_stamp":"2024-09-14T12:44:57.828068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:00.284071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"267'5","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.357531+0000","last_change":"2024-09-14T12:44:48.357379+0000","last_active":"2024-09-14T12:44:48.357531+0000","last_peered":"2024-09-14T12:44:48.357531+0000","last_clean":"2024-09-14T12:44:48.357531+0000","last_became_active":"2024-09-14T11:12:19.112055+0000","last_became_peered":"2024-09-14T11:12:19.112055+0000","last_unstale":"2024-09-14T12:44:48.357531+0000","last_undegraded":"2024-09-14T12:44:48.357531+0000","last_fullsized":"2024-09-14T12:44:48.357531+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:44:48.357195+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:44:48.357195+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.357195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:54.183829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"267'65","reported_seq":262,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.841498+0000","last_change":"2024-09-14T12:44:42.841340+0000","last_active":"2024-09-14T12:44:42.841498+0000","last_peered":"2024-09-14T12:44:42.841498+0000","last_clean":"2024-09-14T12:44:42.841498+0000","last_became_active":"2024-09-14T11:06:29.511360+0000","last_became_peered":"2024-09-14T11:06:29.511360+0000","last_unstale":"2024-09-14T12:44:42.841498+0000","last_undegraded":"2024-09-14T12:44:42.841498+0000","last_fullsized":"2024-09-14T12:44:42.841498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'65","last_scrub_stamp":"2024-09-14T12:44:42.841149+0000","last_deep_scrub":"267'65","last_deep_scrub_stamp":"2024-09-14T12:44:42.841149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.841149+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:58.426066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":367,"num_write":155,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:06.787539+0000","last_change":"2024-09-14T12:45:06.787379+0000","last_active":"2024-09-14T12:45:06.787539+0000","last_peered":"2024-09-14T12:45:06.787539+0000","last_clean":"2024-09-14T12:45:06.787539+0000","last_became_active":"2024-09-14T11:40:08.949175+0000","last_became_peered":"2024-09-14T11:40:08.949175+0000","last_unstale":"2024-09-14T12:45:06.787539+0000","last_undegraded":"2024-09-14T12:45:06.787539+0000","last_fullsized":"2024-09-14T12:45:06.787539+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:06.787211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:06.787211+0000","last_clean_scrub_stamp":"2024-09-14T12:45:06.787211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:13.300742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:11.514505+0000","last_change":"2024-09-14T12:45:11.514505+0000","last_active":"2024-09-14T12:45:11.514505+0000","last_peered":"2024-09-14T12:45:11.514505+0000","last_clean":"2024-09-14T12:45:11.514505+0000","last_became_active":"2024-09-14T11:12:26.228889+0000","last_became_peered":"2024-09-14T11:12:26.228889+0000","last_unstale":"2024-09-14T12:45:11.514505+0000","last_undegraded":"2024-09-14T12:45:11.514505+0000","last_fullsized":"2024-09-14T12:45:11.514505+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:45:11.514315+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:45:11.514315+0000","last_clean_scrub_stamp":"2024-09-14T12:45:11.514315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:34.262765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6156,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.295489+0000","last_change":"2024-09-14T12:44:44.295264+0000","last_active":"2024-09-14T12:44:44.295489+0000","last_peered":"2024-09-14T12:44:44.295489+0000","last_clean":"2024-09-14T12:44:44.295489+0000","last_became_active":"2024-09-14T11:12:19.098699+0000","last_became_peered":"2024-09-14T11:12:19.098699+0000","last_unstale":"2024-09-14T12:44:44.295489+0000","last_undegraded":"2024-09-14T12:44:44.295489+0000","last_fullsized":"2024-09-14T12:44:44.295489+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:44.295047+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:44.295047+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.295047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:23.424767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"267'39","reported_seq":195,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.870671+0000","last_change":"2024-09-14T12:44:41.870529+0000","last_active":"2024-09-14T12:44:41.870671+0000","last_peered":"2024-09-14T12:44:41.870671+0000","last_clean":"2024-09-14T12:44:41.870671+0000","last_became_active":"2024-09-14T11:06:29.538432+0000","last_became_peered":"2024-09-14T11:06:29.538432+0000","last_unstale":"2024-09-14T12:44:41.870671+0000","last_undegraded":"2024-09-14T12:44:41.870671+0000","last_fullsized":"2024-09-14T12:44:41.870671+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'39","last_scrub_stamp":"2024-09-14T12:44:41.870351+0000","last_deep_scrub":"267'39","last_deep_scrub_stamp":"2024-09-14T12:44:41.870351+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.870351+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:42.636474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":213,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.936364+0000","last_change":"2024-09-14T12:44:51.936364+0000","last_active":"2024-09-14T12:44:51.936364+0000","last_peered":"2024-09-14T12:44:51.936364+0000","last_clean":"2024-09-14T12:44:51.936364+0000","last_became_active":"2024-09-14T11:40:08.941924+0000","last_became_peered":"2024-09-14T11:40:08.941924+0000","last_unstale":"2024-09-14T12:44:51.936364+0000","last_undegraded":"2024-09-14T12:44:51.936364+0000","last_fullsized":"2024-09-14T12:44:51.936364+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:51.936177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:51.936177+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.936177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:53.724115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.898624+0000","last_change":"2024-09-14T12:44:47.898624+0000","last_active":"2024-09-14T12:44:47.898624+0000","last_peered":"2024-09-14T12:44:47.898624+0000","last_clean":"2024-09-14T12:44:47.898624+0000","last_became_active":"2024-09-14T11:12:26.247849+0000","last_became_peered":"2024-09-14T11:12:26.247849+0000","last_unstale":"2024-09-14T12:44:47.898624+0000","last_undegraded":"2024-09-14T12:44:47.898624+0000","last_fullsized":"2024-09-14T12:44:47.898624+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T12:44:47.898410+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T12:44:47.898410+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.898410+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:52.699926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5155,"num_write":12,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"267'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.804303+0000","last_change":"2024-09-14T12:44:50.804135+0000","last_active":"2024-09-14T12:44:50.804303+0000","last_peered":"2024-09-14T12:44:50.804303+0000","last_clean":"2024-09-14T12:44:50.804303+0000","last_became_active":"2024-09-14T11:12:19.095636+0000","last_became_peered":"2024-09-14T11:12:19.095636+0000","last_unstale":"2024-09-14T12:44:50.804303+0000","last_undegraded":"2024-09-14T12:44:50.804303+0000","last_fullsized":"2024-09-14T12:44:50.804303+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:50.803939+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:50.803939+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.803939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:40:32.357202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"267'31","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.996749+0000","last_change":"2024-09-14T12:44:38.996749+0000","last_active":"2024-09-14T12:44:38.996749+0000","last_peered":"2024-09-14T12:44:38.996749+0000","last_clean":"2024-09-14T12:44:38.996749+0000","last_became_active":"2024-09-14T11:06:29.508269+0000","last_became_peered":"2024-09-14T11:06:29.508269+0000","last_unstale":"2024-09-14T12:44:38.996749+0000","last_undegraded":"2024-09-14T12:44:38.996749+0000","last_fullsized":"2024-09-14T12:44:38.996749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'31","last_scrub_stamp":"2024-09-14T12:44:38.996567+0000","last_deep_scrub":"267'31","last_deep_scrub_stamp":"2024-09-14T12:44:38.996567+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.996567+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:40.061214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":149,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.088788+0000","last_change":"2024-09-14T12:44:45.088629+0000","last_active":"2024-09-14T12:44:45.088788+0000","last_peered":"2024-09-14T12:44:45.088788+0000","last_clean":"2024-09-14T12:44:45.088788+0000","last_became_active":"2024-09-14T11:40:08.945217+0000","last_became_peered":"2024-09-14T11:40:08.945217+0000","last_unstale":"2024-09-14T12:44:45.088788+0000","last_undegraded":"2024-09-14T12:44:45.088788+0000","last_fullsized":"2024-09-14T12:44:45.088788+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:45.088435+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:45.088435+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.088435+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:17.997786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.760937+0000","last_change":"2024-09-14T12:44:50.760937+0000","last_active":"2024-09-14T12:44:50.760937+0000","last_peered":"2024-09-14T12:44:50.760937+0000","last_clean":"2024-09-14T12:44:50.760937+0000","last_became_active":"2024-09-14T11:12:26.247272+0000","last_became_peered":"2024-09-14T11:12:26.247272+0000","last_unstale":"2024-09-14T12:44:50.760937+0000","last_undegraded":"2024-09-14T12:44:50.760937+0000","last_fullsized":"2024-09-14T12:44:50.760937+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:44:50.760673+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:44:50.760673+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.760673+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:35.549898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.327168+0000","last_change":"2024-09-14T12:44:45.327168+0000","last_active":"2024-09-14T12:44:45.327168+0000","last_peered":"2024-09-14T12:44:45.327168+0000","last_clean":"2024-09-14T12:44:45.327168+0000","last_became_active":"2024-09-14T11:12:19.103535+0000","last_became_peered":"2024-09-14T11:12:19.103535+0000","last_unstale":"2024-09-14T12:44:45.327168+0000","last_undegraded":"2024-09-14T12:44:45.327168+0000","last_fullsized":"2024-09-14T12:44:45.327168+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:45.326979+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:45.326979+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.326979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:21.405703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'7","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.817123+0000","last_change":"2024-09-14T12:44:47.817123+0000","last_active":"2024-09-14T12:44:47.817123+0000","last_peered":"2024-09-14T12:44:47.817123+0000","last_clean":"2024-09-14T12:44:47.817123+0000","last_became_active":"2024-09-14T11:06:29.510044+0000","last_became_peered":"2024-09-14T11:06:29.510044+0000","last_unstale":"2024-09-14T12:44:47.817123+0000","last_undegraded":"2024-09-14T12:44:47.817123+0000","last_fullsized":"2024-09-14T12:44:47.817123+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:47.816835+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:47.816835+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.816835+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:48.553505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":40,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:58.366702+0000","last_change":"2024-09-14T12:44:58.366527+0000","last_active":"2024-09-14T12:44:58.366702+0000","last_peered":"2024-09-14T12:44:58.366702+0000","last_clean":"2024-09-14T12:44:58.366702+0000","last_became_active":"2024-09-14T11:40:08.930065+0000","last_became_peered":"2024-09-14T11:40:08.930065+0000","last_unstale":"2024-09-14T12:44:58.366702+0000","last_undegraded":"2024-09-14T12:44:58.366702+0000","last_fullsized":"2024-09-14T12:44:58.366702+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:58.366339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:58.366339+0000","last_clean_scrub_stamp":"2024-09-14T12:44:58.366339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:10.039917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.111348+0000","last_change":"2024-09-14T12:44:41.111348+0000","last_active":"2024-09-14T12:44:41.111348+0000","last_peered":"2024-09-14T12:44:41.111348+0000","last_clean":"2024-09-14T12:44:41.111348+0000","last_became_active":"2024-09-14T11:12:26.233812+0000","last_became_peered":"2024-09-14T11:12:26.233812+0000","last_unstale":"2024-09-14T12:44:41.111348+0000","last_undegraded":"2024-09-14T12:44:41.111348+0000","last_fullsized":"2024-09-14T12:44:41.111348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.111161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.111161+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.111161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:06.814018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:06.561420+0000","last_change":"2024-09-14T12:45:06.561420+0000","last_active":"2024-09-14T12:45:06.561420+0000","last_peered":"2024-09-14T12:45:06.561420+0000","last_clean":"2024-09-14T12:45:06.561420+0000","last_became_active":"2024-09-14T11:12:19.107950+0000","last_became_peered":"2024-09-14T11:12:19.107950+0000","last_unstale":"2024-09-14T12:45:06.561420+0000","last_undegraded":"2024-09-14T12:45:06.561420+0000","last_fullsized":"2024-09-14T12:45:06.561420+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:45:06.561244+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:45:06.561244+0000","last_clean_scrub_stamp":"2024-09-14T12:45:06.561244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:49.823617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'21","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.118104+0000","last_change":"2024-09-14T12:44:38.118104+0000","last_active":"2024-09-14T12:44:38.118104+0000","last_peered":"2024-09-14T12:44:38.118104+0000","last_clean":"2024-09-14T12:44:38.118104+0000","last_became_active":"2024-09-14T11:06:29.528153+0000","last_became_peered":"2024-09-14T11:06:29.528153+0000","last_unstale":"2024-09-14T12:44:38.118104+0000","last_undegraded":"2024-09-14T12:44:38.118104+0000","last_fullsized":"2024-09-14T12:44:38.118104+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-14T12:44:38.117922+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-14T12:44:38.117922+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.117922+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:42.907829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":111,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.064501+0000","last_change":"2024-09-14T12:44:46.064501+0000","last_active":"2024-09-14T12:44:46.064501+0000","last_peered":"2024-09-14T12:44:46.064501+0000","last_clean":"2024-09-14T12:44:46.064501+0000","last_became_active":"2024-09-14T11:40:08.936369+0000","last_became_peered":"2024-09-14T11:40:08.936369+0000","last_unstale":"2024-09-14T12:44:46.064501+0000","last_undegraded":"2024-09-14T12:44:46.064501+0000","last_fullsized":"2024-09-14T12:44:46.064501+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.064323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.064323+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.064323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:12.689238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:58.838711+0000","last_change":"2024-09-14T12:44:58.838711+0000","last_active":"2024-09-14T12:44:58.838711+0000","last_peered":"2024-09-14T12:44:58.838711+0000","last_clean":"2024-09-14T12:44:58.838711+0000","last_became_active":"2024-09-14T11:12:26.245930+0000","last_became_peered":"2024-09-14T11:12:26.245930+0000","last_unstale":"2024-09-14T12:44:58.838711+0000","last_undegraded":"2024-09-14T12:44:58.838711+0000","last_fullsized":"2024-09-14T12:44:58.838711+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:58.838518+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:58.838518+0000","last_clean_scrub_stamp":"2024-09-14T12:44:58.838518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:41.244093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"267'2","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:08.504622+0000","last_change":"2024-09-14T12:45:08.504622+0000","last_active":"2024-09-14T12:45:08.504622+0000","last_peered":"2024-09-14T12:45:08.504622+0000","last_clean":"2024-09-14T12:45:08.504622+0000","last_became_active":"2024-09-14T11:12:19.108775+0000","last_became_peered":"2024-09-14T11:12:19.108775+0000","last_unstale":"2024-09-14T12:45:08.504622+0000","last_undegraded":"2024-09-14T12:45:08.504622+0000","last_fullsized":"2024-09-14T12:45:08.504622+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:45:08.504431+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:45:08.504431+0000","last_clean_scrub_stamp":"2024-09-14T12:45:08.504431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:34.511540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"267'26","reported_seq":150,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.802237+0000","last_change":"2024-09-14T12:44:47.802237+0000","last_active":"2024-09-14T12:44:47.802237+0000","last_peered":"2024-09-14T12:44:47.802237+0000","last_clean":"2024-09-14T12:44:47.802237+0000","last_became_active":"2024-09-14T11:06:29.512500+0000","last_became_peered":"2024-09-14T11:06:29.512500+0000","last_unstale":"2024-09-14T12:44:47.802237+0000","last_undegraded":"2024-09-14T12:44:47.802237+0000","last_fullsized":"2024-09-14T12:44:47.802237+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-14T12:44:47.802052+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-14T12:44:47.802052+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.802052+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:06.755343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":192,"num_read_kb":126,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.118297+0000","last_change":"2024-09-14T12:44:44.118166+0000","last_active":"2024-09-14T12:44:44.118297+0000","last_peered":"2024-09-14T12:44:44.118297+0000","last_clean":"2024-09-14T12:44:44.118297+0000","last_became_active":"2024-09-14T11:40:08.941346+0000","last_became_peered":"2024-09-14T11:40:08.941346+0000","last_unstale":"2024-09-14T12:44:44.118297+0000","last_undegraded":"2024-09-14T12:44:44.118297+0000","last_fullsized":"2024-09-14T12:44:44.118297+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.118002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.118002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.118002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:18.132212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:55.828267+0000","last_change":"2024-09-14T12:44:55.828267+0000","last_active":"2024-09-14T12:44:55.828267+0000","last_peered":"2024-09-14T12:44:55.828267+0000","last_clean":"2024-09-14T12:44:55.828267+0000","last_became_active":"2024-09-14T11:12:26.243209+0000","last_became_peered":"2024-09-14T11:12:26.243209+0000","last_unstale":"2024-09-14T12:44:55.828267+0000","last_undegraded":"2024-09-14T12:44:55.828267+0000","last_fullsized":"2024-09-14T12:44:55.828267+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:55.828071+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:55.828071+0000","last_clean_scrub_stamp":"2024-09-14T12:44:55.828071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:53.008087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"267'11","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.830837+0000","last_change":"2024-09-14T12:44:52.830837+0000","last_active":"2024-09-14T12:44:52.830837+0000","last_peered":"2024-09-14T12:44:52.830837+0000","last_clean":"2024-09-14T12:44:52.830837+0000","last_became_active":"2024-09-14T11:12:19.091327+0000","last_became_peered":"2024-09-14T11:12:19.091327+0000","last_unstale":"2024-09-14T12:44:52.830837+0000","last_undegraded":"2024-09-14T12:44:52.830837+0000","last_fullsized":"2024-09-14T12:44:52.830837+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T12:44:52.830645+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T12:44:52.830645+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.830645+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:22.172015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":27638,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"267'29","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:59.551254+0000","last_change":"2024-09-14T12:44:59.551254+0000","last_active":"2024-09-14T12:44:59.551254+0000","last_peered":"2024-09-14T12:44:59.551254+0000","last_clean":"2024-09-14T12:44:59.551254+0000","last_became_active":"2024-09-14T11:06:29.539618+0000","last_became_peered":"2024-09-14T11:06:29.539618+0000","last_unstale":"2024-09-14T12:44:59.551254+0000","last_undegraded":"2024-09-14T12:44:59.551254+0000","last_fullsized":"2024-09-14T12:44:59.551254+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T12:44:59.551079+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T12:44:59.551079+0000","last_clean_scrub_stamp":"2024-09-14T12:44:59.551079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.945678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":157,"num_write":71,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:03.792942+0000","last_change":"2024-09-14T12:45:03.792942+0000","last_active":"2024-09-14T12:45:03.792942+0000","last_peered":"2024-09-14T12:45:03.792942+0000","last_clean":"2024-09-14T12:45:03.792942+0000","last_became_active":"2024-09-14T11:40:08.946312+0000","last_became_peered":"2024-09-14T11:40:08.946312+0000","last_unstale":"2024-09-14T12:45:03.792942+0000","last_undegraded":"2024-09-14T12:45:03.792942+0000","last_fullsized":"2024-09-14T12:45:03.792942+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:03.792749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:03.792749+0000","last_clean_scrub_stamp":"2024-09-14T12:45:03.792749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:02.066612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"267'9","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.118913+0000","last_change":"2024-09-14T12:44:40.118913+0000","last_active":"2024-09-14T12:44:40.118913+0000","last_peered":"2024-09-14T12:44:40.118913+0000","last_clean":"2024-09-14T12:44:40.118913+0000","last_became_active":"2024-09-14T11:12:26.228723+0000","last_became_peered":"2024-09-14T11:12:26.228723+0000","last_unstale":"2024-09-14T12:44:40.118913+0000","last_undegraded":"2024-09-14T12:44:40.118913+0000","last_fullsized":"2024-09-14T12:44:40.118913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-14T12:44:40.118688+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-14T12:44:40.118688+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.118688+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:29.274770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11303,"num_write":14,"num_write_kb":5161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.915256+0000","last_change":"2024-09-14T12:44:46.915108+0000","last_active":"2024-09-14T12:44:46.915256+0000","last_peered":"2024-09-14T12:44:46.915256+0000","last_clean":"2024-09-14T12:44:46.915256+0000","last_became_active":"2024-09-14T11:12:19.085023+0000","last_became_peered":"2024-09-14T11:12:19.085023+0000","last_unstale":"2024-09-14T12:44:46.915256+0000","last_undegraded":"2024-09-14T12:44:46.915256+0000","last_fullsized":"2024-09-14T12:44:46.915256+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:46.914925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:46.914925+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.914925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:28.424831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"267'37","reported_seq":179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.002327+0000","last_change":"2024-09-14T12:44:41.002189+0000","last_active":"2024-09-14T12:44:41.002327+0000","last_peered":"2024-09-14T12:44:41.002327+0000","last_clean":"2024-09-14T12:44:41.002327+0000","last_became_active":"2024-09-14T11:06:29.527422+0000","last_became_peered":"2024-09-14T11:06:29.527422+0000","last_unstale":"2024-09-14T12:44:41.002327+0000","last_undegraded":"2024-09-14T12:44:41.002327+0000","last_fullsized":"2024-09-14T12:44:41.002327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'37","last_scrub_stamp":"2024-09-14T12:44:41.002019+0000","last_deep_scrub":"267'37","last_deep_scrub_stamp":"2024-09-14T12:44:41.002019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.002019+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:11.659212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":97,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:15.602107+0000","last_change":"2024-09-14T12:45:15.602107+0000","last_active":"2024-09-14T12:45:15.602107+0000","last_peered":"2024-09-14T12:45:15.602107+0000","last_clean":"2024-09-14T12:45:15.602107+0000","last_became_active":"2024-09-14T11:40:08.933897+0000","last_became_peered":"2024-09-14T11:40:08.933897+0000","last_unstale":"2024-09-14T12:45:15.602107+0000","last_undegraded":"2024-09-14T12:45:15.602107+0000","last_fullsized":"2024-09-14T12:45:15.602107+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:15.601870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:15.601870+0000","last_clean_scrub_stamp":"2024-09-14T12:45:15.601870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:16:43.502445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:12.530406+0000","last_change":"2024-09-14T12:45:12.530406+0000","last_active":"2024-09-14T12:45:12.530406+0000","last_peered":"2024-09-14T12:45:12.530406+0000","last_clean":"2024-09-14T12:45:12.530406+0000","last_became_active":"2024-09-14T11:12:26.232736+0000","last_became_peered":"2024-09-14T11:12:26.232736+0000","last_unstale":"2024-09-14T12:45:12.530406+0000","last_undegraded":"2024-09-14T12:45:12.530406+0000","last_fullsized":"2024-09-14T12:45:12.530406+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T12:45:12.530210+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T12:45:12.530210+0000","last_clean_scrub_stamp":"2024-09-14T12:45:12.530210+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:12.589177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":12,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"267'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:04.525260+0000","last_change":"2024-09-14T12:45:04.525015+0000","last_active":"2024-09-14T12:45:04.525260+0000","last_peered":"2024-09-14T12:45:04.525260+0000","last_clean":"2024-09-14T12:45:04.525260+0000","last_became_active":"2024-09-14T11:12:19.100258+0000","last_became_peered":"2024-09-14T11:12:19.100258+0000","last_unstale":"2024-09-14T12:45:04.525260+0000","last_undegraded":"2024-09-14T12:45:04.525260+0000","last_fullsized":"2024-09-14T12:45:04.525260+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T12:45:04.524792+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T12:45:04.524792+0000","last_clean_scrub_stamp":"2024-09-14T12:45:04.524792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:59.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2056,"num_write":10,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"267'41","reported_seq":197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.370853+0000","last_change":"2024-09-14T12:44:38.370853+0000","last_active":"2024-09-14T12:44:38.370853+0000","last_peered":"2024-09-14T12:44:38.370853+0000","last_clean":"2024-09-14T12:44:38.370853+0000","last_became_active":"2024-09-14T11:06:29.532958+0000","last_became_peered":"2024-09-14T11:06:29.532958+0000","last_unstale":"2024-09-14T12:44:38.370853+0000","last_undegraded":"2024-09-14T12:44:38.370853+0000","last_fullsized":"2024-09-14T12:44:38.370853+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'41","last_scrub_stamp":"2024-09-14T12:44:38.370671+0000","last_deep_scrub":"267'41","last_deep_scrub_stamp":"2024-09-14T12:44:38.370671+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.370671+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:47.399639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":199,"num_write":106,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:59.347756+0000","last_change":"2024-09-14T12:44:59.347596+0000","last_active":"2024-09-14T12:44:59.347756+0000","last_peered":"2024-09-14T12:44:59.347756+0000","last_clean":"2024-09-14T12:44:59.347756+0000","last_became_active":"2024-09-14T11:40:08.932939+0000","last_became_peered":"2024-09-14T11:40:08.932939+0000","last_unstale":"2024-09-14T12:44:59.347756+0000","last_undegraded":"2024-09-14T12:44:59.347756+0000","last_fullsized":"2024-09-14T12:44:59.347756+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:59.347402+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:59.347402+0000","last_clean_scrub_stamp":"2024-09-14T12:44:59.347402+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:18.005216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.768415+0000","last_change":"2024-09-14T12:44:54.768415+0000","last_active":"2024-09-14T12:44:54.768415+0000","last_peered":"2024-09-14T12:44:54.768415+0000","last_clean":"2024-09-14T12:44:54.768415+0000","last_became_active":"2024-09-14T11:12:26.236892+0000","last_became_peered":"2024-09-14T11:12:26.236892+0000","last_unstale":"2024-09-14T12:44:54.768415+0000","last_undegraded":"2024-09-14T12:44:54.768415+0000","last_fullsized":"2024-09-14T12:44:54.768415+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:54.768111+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:54.768111+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.768111+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:02.656050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.955542+0000","last_change":"2024-09-14T12:44:44.955542+0000","last_active":"2024-09-14T12:44:44.955542+0000","last_peered":"2024-09-14T12:44:44.955542+0000","last_clean":"2024-09-14T12:44:44.955542+0000","last_became_active":"2024-09-14T11:12:19.084630+0000","last_became_peered":"2024-09-14T11:12:19.084630+0000","last_unstale":"2024-09-14T12:44:44.955542+0000","last_undegraded":"2024-09-14T12:44:44.955542+0000","last_fullsized":"2024-09-14T12:44:44.955542+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.955318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.955318+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.955318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:27.480020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"267'305","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.956616+0000","last_change":"2024-09-14T12:44:41.956616+0000","last_active":"2024-09-14T12:44:41.956616+0000","last_peered":"2024-09-14T12:44:41.956616+0000","last_clean":"2024-09-14T12:44:41.956616+0000","last_became_active":"2024-09-14T11:06:29.524051+0000","last_became_peered":"2024-09-14T11:06:29.524051+0000","last_unstale":"2024-09-14T12:44:41.956616+0000","last_undegraded":"2024-09-14T12:44:41.956616+0000","last_fullsized":"2024-09-14T12:44:41.956616+0000","mapping_epoch":256,"log_start":"264'200","ondisk_log_start":"264'200","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'305","last_scrub_stamp":"2024-09-14T12:44:41.956433+0000","last_deep_scrub":"267'305","last_deep_scrub_stamp":"2024-09-14T12:44:41.956433+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.956433+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:41.194763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2841,"num_read_kb":3371,"num_write":621,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.794805+0000","last_change":"2024-09-14T12:44:53.794681+0000","last_active":"2024-09-14T12:44:53.794805+0000","last_peered":"2024-09-14T12:44:53.794805+0000","last_clean":"2024-09-14T12:44:53.794805+0000","last_became_active":"2024-09-14T11:40:08.938357+0000","last_became_peered":"2024-09-14T11:40:08.938357+0000","last_unstale":"2024-09-14T12:44:53.794805+0000","last_undegraded":"2024-09-14T12:44:53.794805+0000","last_fullsized":"2024-09-14T12:44:53.794805+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:53.794507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:53.794507+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.794507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:45.570386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"267'10","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:07.530015+0000","last_change":"2024-09-14T12:45:07.530015+0000","last_active":"2024-09-14T12:45:07.530015+0000","last_peered":"2024-09-14T12:45:07.530015+0000","last_clean":"2024-09-14T12:45:07.530015+0000","last_became_active":"2024-09-14T11:12:26.251771+0000","last_became_peered":"2024-09-14T11:12:26.251771+0000","last_unstale":"2024-09-14T12:45:07.530015+0000","last_undegraded":"2024-09-14T12:45:07.530015+0000","last_fullsized":"2024-09-14T12:45:07.530015+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-14T12:45:07.529754+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-14T12:45:07.529754+0000","last_clean_scrub_stamp":"2024-09-14T12:45:07.529754+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:10.186479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9222,"num_write":10,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"267'2","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:05.571291+0000","last_change":"2024-09-14T12:45:05.571291+0000","last_active":"2024-09-14T12:45:05.571291+0000","last_peered":"2024-09-14T12:45:05.571291+0000","last_clean":"2024-09-14T12:45:05.571291+0000","last_became_active":"2024-09-14T11:12:19.100323+0000","last_became_peered":"2024-09-14T11:12:19.100323+0000","last_unstale":"2024-09-14T12:45:05.571291+0000","last_undegraded":"2024-09-14T12:45:05.571291+0000","last_fullsized":"2024-09-14T12:45:05.571291+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:45:05.571103+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:45:05.571103+0000","last_clean_scrub_stamp":"2024-09-14T12:45:05.571103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:19.740757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"267'31","reported_seq":170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:01.572356+0000","last_change":"2024-09-14T12:45:01.572356+0000","last_active":"2024-09-14T12:45:01.572356+0000","last_peered":"2024-09-14T12:45:01.572356+0000","last_clean":"2024-09-14T12:45:01.572356+0000","last_became_active":"2024-09-14T11:06:29.545010+0000","last_became_peered":"2024-09-14T11:06:29.545010+0000","last_unstale":"2024-09-14T12:45:01.572356+0000","last_undegraded":"2024-09-14T12:45:01.572356+0000","last_fullsized":"2024-09-14T12:45:01.572356+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'31","last_scrub_stamp":"2024-09-14T12:45:01.572088+0000","last_deep_scrub":"267'31","last_deep_scrub_stamp":"2024-09-14T12:45:01.572088+0000","last_clean_scrub_stamp":"2024-09-14T12:45:01.572088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:35.031478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":160,"num_write":77,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:04.768100+0000","last_change":"2024-09-14T12:45:04.768100+0000","last_active":"2024-09-14T12:45:04.768100+0000","last_peered":"2024-09-14T12:45:04.768100+0000","last_clean":"2024-09-14T12:45:04.768100+0000","last_became_active":"2024-09-14T11:40:08.946192+0000","last_became_peered":"2024-09-14T11:40:08.946192+0000","last_unstale":"2024-09-14T12:45:04.768100+0000","last_undegraded":"2024-09-14T12:45:04.768100+0000","last_fullsized":"2024-09-14T12:45:04.768100+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:04.767913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:04.767913+0000","last_clean_scrub_stamp":"2024-09-14T12:45:04.767913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:31.374008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"267'14","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.858662+0000","last_change":"2024-09-14T12:44:48.858662+0000","last_active":"2024-09-14T12:44:48.858662+0000","last_peered":"2024-09-14T12:44:48.858662+0000","last_clean":"2024-09-14T12:44:48.858662+0000","last_became_active":"2024-09-14T11:12:26.251336+0000","last_became_peered":"2024-09-14T11:12:26.251336+0000","last_unstale":"2024-09-14T12:44:48.858662+0000","last_undegraded":"2024-09-14T12:44:48.858662+0000","last_fullsized":"2024-09-14T12:44:48.858662+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T12:44:48.858479+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T12:44:48.858479+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.858479+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:37.751198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":27664,"num_write":24,"num_write_kb":11276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.782700+0000","last_change":"2024-09-14T12:44:47.782700+0000","last_active":"2024-09-14T12:44:47.782700+0000","last_peered":"2024-09-14T12:44:47.782700+0000","last_clean":"2024-09-14T12:44:47.782700+0000","last_became_active":"2024-09-14T11:12:19.089451+0000","last_became_peered":"2024-09-14T11:12:19.089451+0000","last_unstale":"2024-09-14T12:44:47.782700+0000","last_undegraded":"2024-09-14T12:44:47.782700+0000","last_fullsized":"2024-09-14T12:44:47.782700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.782509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.782509+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.782509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.496882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"267'36","reported_seq":185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:57.552064+0000","last_change":"2024-09-14T12:44:57.552064+0000","last_active":"2024-09-14T12:44:57.552064+0000","last_peered":"2024-09-14T12:44:57.552064+0000","last_clean":"2024-09-14T12:44:57.552064+0000","last_became_active":"2024-09-14T11:06:29.518775+0000","last_became_peered":"2024-09-14T11:06:29.518775+0000","last_unstale":"2024-09-14T12:44:57.552064+0000","last_undegraded":"2024-09-14T12:44:57.552064+0000","last_fullsized":"2024-09-14T12:44:57.552064+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'36","last_scrub_stamp":"2024-09-14T12:44:57.551868+0000","last_deep_scrub":"267'36","last_deep_scrub_stamp":"2024-09-14T12:44:57.551868+0000","last_clean_scrub_stamp":"2024-09-14T12:44:57.551868+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:02.493682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":300,"num_read_kb":189,"num_write":86,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:45:17.569158+0000","last_change":"2024-09-14T12:45:17.569158+0000","last_active":"2024-09-14T12:45:17.569158+0000","last_peered":"2024-09-14T12:45:17.569158+0000","last_clean":"2024-09-14T12:45:17.569158+0000","last_became_active":"2024-09-14T11:40:08.934173+0000","last_became_peered":"2024-09-14T11:40:08.934173+0000","last_unstale":"2024-09-14T12:45:17.569158+0000","last_undegraded":"2024-09-14T12:45:17.569158+0000","last_fullsized":"2024-09-14T12:45:17.569158+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:45:17.568967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:45:17.568967+0000","last_clean_scrub_stamp":"2024-09-14T12:45:17.568967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:36.240232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"267'6","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.907542+0000","last_change":"2024-09-14T12:44:45.907542+0000","last_active":"2024-09-14T12:44:45.907542+0000","last_peered":"2024-09-14T12:44:45.907542+0000","last_clean":"2024-09-14T12:44:45.907542+0000","last_became_active":"2024-09-14T11:12:26.242532+0000","last_became_peered":"2024-09-14T11:12:26.242532+0000","last_unstale":"2024-09-14T12:44:45.907542+0000","last_undegraded":"2024-09-14T12:44:45.907542+0000","last_fullsized":"2024-09-14T12:44:45.907542+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:44:45.907357+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:44:45.907357+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.907357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:45.964370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9208,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.014276+0000","last_change":"2024-09-14T12:44:42.014276+0000","last_active":"2024-09-14T12:44:42.014276+0000","last_peered":"2024-09-14T12:44:42.014276+0000","last_clean":"2024-09-14T12:44:42.014276+0000","last_became_active":"2024-09-14T11:12:19.115236+0000","last_became_peered":"2024-09-14T11:12:19.115236+0000","last_unstale":"2024-09-14T12:44:42.014276+0000","last_undegraded":"2024-09-14T12:44:42.014276+0000","last_fullsized":"2024-09-14T12:44:42.014276+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T12:44:42.014088+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T12:44:42.014088+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.014088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:47.858064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4102,"num_write":12,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'6","reported_seq":103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.053405+0000","last_change":"2024-09-14T12:44:37.053152+0000","last_active":"2024-09-14T12:44:37.053405+0000","last_peered":"2024-09-14T12:44:37.053405+0000","last_clean":"2024-09-14T12:44:37.053405+0000","last_became_active":"2024-09-14T11:06:29.525548+0000","last_became_peered":"2024-09-14T11:06:29.525548+0000","last_unstale":"2024-09-14T12:44:37.053405+0000","last_undegraded":"2024-09-14T12:44:37.053405+0000","last_fullsized":"2024-09-14T12:44:37.053405+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T12:44:37.052939+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T12:44:37.052939+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.052939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:59.273968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"267'395","reported_seq":1128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.241668+0000","last_change":"2024-09-14T12:44:20.241668+0000","last_active":"2024-09-14T12:44:20.241668+0000","last_peered":"2024-09-14T12:44:20.241668+0000","last_clean":"2024-09-14T12:44:20.241668+0000","last_became_active":"2024-09-14T10:49:23.372514+0000","last_became_peered":"2024-09-14T10:49:23.372514+0000","last_unstale":"2024-09-14T12:44:20.241668+0000","last_undegraded":"2024-09-14T12:44:20.241668+0000","last_fullsized":"2024-09-14T12:44:20.241668+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T12:44:20.241424+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T12:44:20.241424+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.241424+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:25.118550+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":698,"num_read_kb":89783,"num_write":1195,"num_write_kb":37856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"267'879","reported_seq":2591,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.049229+0000","last_change":"2024-09-14T12:44:23.049066+0000","last_active":"2024-09-14T12:44:23.049229+0000","last_peered":"2024-09-14T12:44:23.049229+0000","last_clean":"2024-09-14T12:44:23.049229+0000","last_became_active":"2024-09-14T10:49:25.368861+0000","last_became_peered":"2024-09-14T10:49:25.368861+0000","last_unstale":"2024-09-14T12:44:23.049229+0000","last_undegraded":"2024-09-14T12:44:23.049229+0000","last_fullsized":"2024-09-14T12:44:23.049229+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'879","last_scrub_stamp":"2024-09-14T12:44:23.048885+0000","last_deep_scrub":"267'879","last_deep_scrub_stamp":"2024-09-14T12:44:23.048885+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.048885+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:35:29.666443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4292,"num_read_kb":3786,"num_write":1290,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"267'389","reported_seq":1147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.841857+0000","last_change":"2024-09-14T12:44:23.841857+0000","last_active":"2024-09-14T12:44:23.841857+0000","last_peered":"2024-09-14T12:44:23.841857+0000","last_clean":"2024-09-14T12:44:23.841857+0000","last_became_active":"2024-09-14T10:49:23.386742+0000","last_became_peered":"2024-09-14T10:49:23.386742+0000","last_unstale":"2024-09-14T12:44:23.841857+0000","last_undegraded":"2024-09-14T12:44:23.841857+0000","last_fullsized":"2024-09-14T12:44:23.841857+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'389","last_scrub_stamp":"2024-09-14T12:44:23.841630+0000","last_deep_scrub":"267'389","last_deep_scrub_stamp":"2024-09-14T12:44:23.841630+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.841630+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:47.077958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":967,"num_read_kb":14779,"num_write":1188,"num_write_kb":22069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"267'1160","reported_seq":2822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.692483+0000","last_change":"2024-09-14T12:44:35.692483+0000","last_active":"2024-09-14T12:44:35.692483+0000","last_peered":"2024-09-14T12:44:35.692483+0000","last_clean":"2024-09-14T12:44:35.692483+0000","last_became_active":"2024-09-14T10:49:25.370610+0000","last_became_peered":"2024-09-14T10:49:25.370610+0000","last_unstale":"2024-09-14T12:44:35.692483+0000","last_undegraded":"2024-09-14T12:44:35.692483+0000","last_fullsized":"2024-09-14T12:44:35.692483+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1160","last_scrub_stamp":"2024-09-14T12:44:35.692262+0000","last_deep_scrub":"267'1160","last_deep_scrub_stamp":"2024-09-14T12:44:35.692262+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.692262+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:51.550361+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5343,"num_read_kb":4756,"num_write":1566,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"267'380","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.834788+0000","last_change":"2024-09-14T12:44:22.834788+0000","last_active":"2024-09-14T12:44:22.834788+0000","last_peered":"2024-09-14T12:44:22.834788+0000","last_clean":"2024-09-14T12:44:22.834788+0000","last_became_active":"2024-09-14T10:49:23.367647+0000","last_became_peered":"2024-09-14T10:49:23.367647+0000","last_unstale":"2024-09-14T12:44:22.834788+0000","last_undegraded":"2024-09-14T12:44:22.834788+0000","last_fullsized":"2024-09-14T12:44:22.834788+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-14T12:44:22.834585+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-14T12:44:22.834585+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.834585+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:40.778231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":20304,"num_write":1229,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"267'1240","reported_seq":2841,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.688467+0000","last_change":"2024-09-14T12:44:34.688467+0000","last_active":"2024-09-14T12:44:34.688467+0000","last_peered":"2024-09-14T12:44:34.688467+0000","last_clean":"2024-09-14T12:44:34.688467+0000","last_became_active":"2024-09-14T10:49:25.380525+0000","last_became_peered":"2024-09-14T10:49:25.380525+0000","last_unstale":"2024-09-14T12:44:34.688467+0000","last_undegraded":"2024-09-14T12:44:34.688467+0000","last_fullsized":"2024-09-14T12:44:34.688467+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1240","last_scrub_stamp":"2024-09-14T12:44:34.688273+0000","last_deep_scrub":"267'1240","last_deep_scrub_stamp":"2024-09-14T12:44:34.688273+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.688273+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:58.651664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5594,"num_read_kb":4933,"num_write":1701,"num_write_kb":712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"267'369","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.857351+0000","last_change":"2024-09-14T12:44:15.857351+0000","last_active":"2024-09-14T12:44:15.857351+0000","last_peered":"2024-09-14T12:44:15.857351+0000","last_clean":"2024-09-14T12:44:15.857351+0000","last_became_active":"2024-09-14T10:49:23.395029+0000","last_became_peered":"2024-09-14T10:49:23.395029+0000","last_unstale":"2024-09-14T12:44:15.857351+0000","last_undegraded":"2024-09-14T12:44:15.857351+0000","last_fullsized":"2024-09-14T12:44:15.857351+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'369","last_scrub_stamp":"2024-09-14T12:44:15.857104+0000","last_deep_scrub":"267'369","last_deep_scrub_stamp":"2024-09-14T12:44:15.857104+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.857104+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:35.578952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":13844,"num_write":1136,"num_write_kb":32575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"267'923","reported_seq":2548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.832708+0000","last_change":"2024-09-14T12:44:26.832708+0000","last_active":"2024-09-14T12:44:26.832708+0000","last_peered":"2024-09-14T12:44:26.832708+0000","last_clean":"2024-09-14T12:44:26.832708+0000","last_became_active":"2024-09-14T10:49:25.368723+0000","last_became_peered":"2024-09-14T10:49:25.368723+0000","last_unstale":"2024-09-14T12:44:26.832708+0000","last_undegraded":"2024-09-14T12:44:26.832708+0000","last_fullsized":"2024-09-14T12:44:26.832708+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'923","last_scrub_stamp":"2024-09-14T12:44:26.832504+0000","last_deep_scrub":"267'923","last_deep_scrub_stamp":"2024-09-14T12:44:26.832504+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.832504+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:38.827676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6457,"num_read_kb":5960,"num_write":1431,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"267'365","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.327853+0000","last_change":"2024-09-14T12:44:18.327687+0000","last_active":"2024-09-14T12:44:18.327853+0000","last_peered":"2024-09-14T12:44:18.327853+0000","last_clean":"2024-09-14T12:44:18.327853+0000","last_became_active":"2024-09-14T10:49:23.396952+0000","last_became_peered":"2024-09-14T10:49:23.396952+0000","last_unstale":"2024-09-14T12:44:18.327853+0000","last_undegraded":"2024-09-14T12:44:18.327853+0000","last_fullsized":"2024-09-14T12:44:18.327853+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-14T12:44:18.327453+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-14T12:44:18.327453+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.327453+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:39.003445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730132,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":730,"num_read_kb":15587,"num_write":1249,"num_write_kb":19198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"267'490","reported_seq":2245,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.118914+0000","last_change":"2024-09-14T12:44:24.118914+0000","last_active":"2024-09-14T12:44:24.118914+0000","last_peered":"2024-09-14T12:44:24.118914+0000","last_clean":"2024-09-14T12:44:24.118914+0000","last_became_active":"2024-09-14T10:49:25.369197+0000","last_became_peered":"2024-09-14T10:49:25.369197+0000","last_unstale":"2024-09-14T12:44:24.118914+0000","last_undegraded":"2024-09-14T12:44:24.118914+0000","last_fullsized":"2024-09-14T12:44:24.118914+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-14T12:44:24.118736+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-14T12:44:24.118736+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.118736+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:43.727353+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2750,"num_read_kb":2591,"num_write":558,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"267'328","reported_seq":987,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.891194+0000","last_change":"2024-09-14T12:44:14.891054+0000","last_active":"2024-09-14T12:44:14.891194+0000","last_peered":"2024-09-14T12:44:14.891194+0000","last_clean":"2024-09-14T12:44:14.891194+0000","last_became_active":"2024-09-14T10:49:23.386773+0000","last_became_peered":"2024-09-14T10:49:23.386773+0000","last_unstale":"2024-09-14T12:44:14.891194+0000","last_undegraded":"2024-09-14T12:44:14.891194+0000","last_fullsized":"2024-09-14T12:44:14.891194+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'328","last_scrub_stamp":"2024-09-14T12:44:14.890841+0000","last_deep_scrub":"267'328","last_deep_scrub_stamp":"2024-09-14T12:44:14.890841+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.890841+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:33.495347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":548,"num_read_kb":8718,"num_write":1059,"num_write_kb":39714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"267'430","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.155332+0000","last_change":"2024-09-14T12:44:25.155332+0000","last_active":"2024-09-14T12:44:25.155332+0000","last_peered":"2024-09-14T12:44:25.155332+0000","last_clean":"2024-09-14T12:44:25.155332+0000","last_became_active":"2024-09-14T10:49:25.404189+0000","last_became_peered":"2024-09-14T10:49:25.404189+0000","last_unstale":"2024-09-14T12:44:25.155332+0000","last_undegraded":"2024-09-14T12:44:25.155332+0000","last_fullsized":"2024-09-14T12:44:25.155332+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-14T12:44:25.155091+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-14T12:44:25.155091+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.155091+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:47.356155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2519,"num_read_kb":2387,"num_write":515,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"267'405","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.416312+0000","last_change":"2024-09-14T12:44:15.416147+0000","last_active":"2024-09-14T12:44:15.416312+0000","last_peered":"2024-09-14T12:44:15.416312+0000","last_clean":"2024-09-14T12:44:15.416312+0000","last_became_active":"2024-09-14T10:49:23.353824+0000","last_became_peered":"2024-09-14T10:49:23.353824+0000","last_unstale":"2024-09-14T12:44:15.416312+0000","last_undegraded":"2024-09-14T12:44:15.416312+0000","last_fullsized":"2024-09-14T12:44:15.416312+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'405","last_scrub_stamp":"2024-09-14T12:44:15.415866+0000","last_deep_scrub":"267'405","last_deep_scrub_stamp":"2024-09-14T12:44:15.415866+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.415866+0000","objects_scrubbed":12,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:43.030406+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":687,"num_read_kb":3209,"num_write":1301,"num_write_kb":30473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"267'1239","reported_seq":2952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.863432+0000","last_change":"2024-09-14T12:44:23.863432+0000","last_active":"2024-09-14T12:44:23.863432+0000","last_peered":"2024-09-14T12:44:23.863432+0000","last_clean":"2024-09-14T12:44:23.863432+0000","last_became_active":"2024-09-14T10:49:25.388008+0000","last_became_peered":"2024-09-14T10:49:25.388008+0000","last_unstale":"2024-09-14T12:44:23.863432+0000","last_undegraded":"2024-09-14T12:44:23.863432+0000","last_fullsized":"2024-09-14T12:44:23.863432+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1239","last_scrub_stamp":"2024-09-14T12:44:23.863231+0000","last_deep_scrub":"267'1239","last_deep_scrub_stamp":"2024-09-14T12:44:23.863231+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.863231+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":1200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:30.652457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5023,"num_write":1696,"num_write_kb":685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"267'317","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.811876+0000","last_change":"2024-09-14T12:44:21.811716+0000","last_active":"2024-09-14T12:44:21.811876+0000","last_peered":"2024-09-14T12:44:21.811876+0000","last_clean":"2024-09-14T12:44:21.811876+0000","last_became_active":"2024-09-14T10:49:23.374194+0000","last_became_peered":"2024-09-14T10:49:23.374194+0000","last_unstale":"2024-09-14T12:44:21.811876+0000","last_undegraded":"2024-09-14T12:44:21.811876+0000","last_fullsized":"2024-09-14T12:44:21.811876+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-14T12:44:21.811471+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-14T12:44:21.811471+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.811471+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:14:34.008333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730149,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":30724,"num_write":962,"num_write_kb":46577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"267'766","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.970390+0000","last_change":"2024-09-14T12:44:30.970390+0000","last_active":"2024-09-14T12:44:30.970390+0000","last_peered":"2024-09-14T12:44:30.970390+0000","last_clean":"2024-09-14T12:44:30.970390+0000","last_became_active":"2024-09-14T10:49:25.395625+0000","last_became_peered":"2024-09-14T10:49:25.395625+0000","last_unstale":"2024-09-14T12:44:30.970390+0000","last_undegraded":"2024-09-14T12:44:30.970390+0000","last_fullsized":"2024-09-14T12:44:30.970390+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'766","last_scrub_stamp":"2024-09-14T12:44:30.970201+0000","last_deep_scrub":"267'766","last_deep_scrub_stamp":"2024-09-14T12:44:30.970201+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.970201+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:00.805728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3607,"num_read_kb":3221,"num_write":1031,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"267'928","reported_seq":2623,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.642891+0000","last_change":"2024-09-14T12:44:31.642891+0000","last_active":"2024-09-14T12:44:31.642891+0000","last_peered":"2024-09-14T12:44:31.642891+0000","last_clean":"2024-09-14T12:44:31.642891+0000","last_became_active":"2024-09-14T10:49:25.377697+0000","last_became_peered":"2024-09-14T10:49:25.377697+0000","last_unstale":"2024-09-14T12:44:31.642891+0000","last_undegraded":"2024-09-14T12:44:31.642891+0000","last_fullsized":"2024-09-14T12:44:31.642891+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'928","last_scrub_stamp":"2024-09-14T12:44:31.642716+0000","last_deep_scrub":"267'928","last_deep_scrub_stamp":"2024-09-14T12:44:31.642716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.642716+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:13.252576+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4426,"num_read_kb":3954,"num_write":1251,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"267'319","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.982570+0000","last_change":"2024-09-14T12:44:14.982570+0000","last_active":"2024-09-14T12:44:14.982570+0000","last_peered":"2024-09-14T12:44:14.982570+0000","last_clean":"2024-09-14T12:44:14.982570+0000","last_became_active":"2024-09-14T10:49:23.395881+0000","last_became_peered":"2024-09-14T10:49:23.395881+0000","last_unstale":"2024-09-14T12:44:14.982570+0000","last_undegraded":"2024-09-14T12:44:14.982570+0000","last_fullsized":"2024-09-14T12:44:14.982570+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-14T12:44:14.982349+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-14T12:44:14.982349+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.982349+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.098578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":45321,"num_write":937,"num_write_kb":34104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"267'503","reported_seq":2246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.198419+0000","last_change":"2024-09-14T12:44:21.198419+0000","last_active":"2024-09-14T12:44:21.198419+0000","last_peered":"2024-09-14T12:44:21.198419+0000","last_clean":"2024-09-14T12:44:21.198419+0000","last_became_active":"2024-09-14T10:49:25.359419+0000","last_became_peered":"2024-09-14T10:49:25.359419+0000","last_unstale":"2024-09-14T12:44:21.198419+0000","last_undegraded":"2024-09-14T12:44:21.198419+0000","last_fullsized":"2024-09-14T12:44:21.198419+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'503","last_scrub_stamp":"2024-09-14T12:44:21.198212+0000","last_deep_scrub":"267'503","last_deep_scrub_stamp":"2024-09-14T12:44:21.198212+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.198212+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:09.718517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2958,"num_read_kb":2787,"num_write":621,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"267'335","reported_seq":1024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.375732+0000","last_change":"2024-09-14T12:44:17.375590+0000","last_active":"2024-09-14T12:44:17.375732+0000","last_peered":"2024-09-14T12:44:17.375732+0000","last_clean":"2024-09-14T12:44:17.375732+0000","last_became_active":"2024-09-14T10:49:23.372672+0000","last_became_peered":"2024-09-14T10:49:23.372672+0000","last_unstale":"2024-09-14T12:44:17.375732+0000","last_undegraded":"2024-09-14T12:44:17.375732+0000","last_fullsized":"2024-09-14T12:44:17.375732+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-14T12:44:17.375353+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-14T12:44:17.375353+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.375353+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:32.309861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":589,"num_read_kb":8965,"num_write":1037,"num_write_kb":20473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"267'402","reported_seq":1920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.005658+0000","last_change":"2024-09-14T12:44:21.005658+0000","last_active":"2024-09-14T12:44:21.005658+0000","last_peered":"2024-09-14T12:44:21.005658+0000","last_clean":"2024-09-14T12:44:21.005658+0000","last_became_active":"2024-09-14T10:49:25.403885+0000","last_became_peered":"2024-09-14T10:49:25.403885+0000","last_unstale":"2024-09-14T12:44:21.005658+0000","last_undegraded":"2024-09-14T12:44:21.005658+0000","last_fullsized":"2024-09-14T12:44:21.005658+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:21.005460+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:21.005460+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.005460+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:39.200942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2137,"num_read_kb":2023,"num_write":462,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"267'394","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.346316+0000","last_change":"2024-09-14T12:44:13.346147+0000","last_active":"2024-09-14T12:44:13.346316+0000","last_peered":"2024-09-14T12:44:13.346316+0000","last_clean":"2024-09-14T12:44:13.346316+0000","last_became_active":"2024-09-14T10:49:23.354127+0000","last_became_peered":"2024-09-14T10:49:23.354127+0000","last_unstale":"2024-09-14T12:44:13.346316+0000","last_undegraded":"2024-09-14T12:44:13.346316+0000","last_fullsized":"2024-09-14T12:44:13.346316+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'394","last_scrub_stamp":"2024-09-14T12:44:13.345931+0000","last_deep_scrub":"267'394","last_deep_scrub_stamp":"2024-09-14T12:44:13.345931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.345931+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:48.706335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":781,"num_read_kb":56952,"num_write":1264,"num_write_kb":28690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"267'805","reported_seq":2358,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.811614+0000","last_change":"2024-09-14T12:44:24.811470+0000","last_active":"2024-09-14T12:44:24.811614+0000","last_peered":"2024-09-14T12:44:24.811614+0000","last_clean":"2024-09-14T12:44:24.811614+0000","last_became_active":"2024-09-14T10:49:25.396001+0000","last_became_peered":"2024-09-14T10:49:25.396001+0000","last_unstale":"2024-09-14T12:44:24.811614+0000","last_undegraded":"2024-09-14T12:44:24.811614+0000","last_fullsized":"2024-09-14T12:44:24.811614+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'805","last_scrub_stamp":"2024-09-14T12:44:24.811267+0000","last_deep_scrub":"267'805","last_deep_scrub_stamp":"2024-09-14T12:44:24.811267+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.811267+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:43:01.444670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3888,"num_read_kb":3489,"num_write":1086,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1380,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"267'386","reported_seq":1184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.337320+0000","last_change":"2024-09-14T12:44:12.337240+0000","last_active":"2024-09-14T12:44:12.337320+0000","last_peered":"2024-09-14T12:44:12.337320+0000","last_clean":"2024-09-14T12:44:12.337320+0000","last_became_active":"2024-09-14T10:49:23.387292+0000","last_became_peered":"2024-09-14T10:49:23.387292+0000","last_unstale":"2024-09-14T12:44:12.337320+0000","last_undegraded":"2024-09-14T12:44:12.337320+0000","last_fullsized":"2024-09-14T12:44:12.337320+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T12:44:12.337076+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T12:44:12.337076+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.337076+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:05.269545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":721,"num_read_kb":37760,"num_write":1195,"num_write_kb":55114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"267'374","reported_seq":1812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.937988+0000","last_change":"2024-09-14T12:44:29.937851+0000","last_active":"2024-09-14T12:44:29.937988+0000","last_peered":"2024-09-14T12:44:29.937988+0000","last_clean":"2024-09-14T12:44:29.937988+0000","last_became_active":"2024-09-14T10:49:25.394106+0000","last_became_peered":"2024-09-14T10:49:25.394106+0000","last_unstale":"2024-09-14T12:44:29.937988+0000","last_undegraded":"2024-09-14T12:44:29.937988+0000","last_fullsized":"2024-09-14T12:44:29.937988+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:29.937641+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:29.937641+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.937641+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:07.766027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2013,"num_read_kb":1909,"num_write":433,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"267'428","reported_seq":1110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.764311+0000","last_change":"2024-09-14T12:44:17.764159+0000","last_active":"2024-09-14T12:44:17.764311+0000","last_peered":"2024-09-14T12:44:17.764311+0000","last_clean":"2024-09-14T12:44:17.764311+0000","last_became_active":"2024-09-14T10:49:23.364035+0000","last_became_peered":"2024-09-14T10:49:23.364035+0000","last_unstale":"2024-09-14T12:44:17.764311+0000","last_undegraded":"2024-09-14T12:44:17.764311+0000","last_fullsized":"2024-09-14T12:44:17.764311+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'428","last_scrub_stamp":"2024-09-14T12:44:17.763953+0000","last_deep_scrub":"267'428","last_deep_scrub_stamp":"2024-09-14T12:44:17.763953+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.763953+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:02.372941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":874,"num_read_kb":15225,"num_write":1232,"num_write_kb":26982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"267'781","reported_seq":2508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.009896+0000","last_change":"2024-09-14T12:44:22.009755+0000","last_active":"2024-09-14T12:44:22.009896+0000","last_peered":"2024-09-14T12:44:22.009896+0000","last_clean":"2024-09-14T12:44:22.009896+0000","last_became_active":"2024-09-14T10:49:25.371736+0000","last_became_peered":"2024-09-14T10:49:25.371736+0000","last_unstale":"2024-09-14T12:44:22.009896+0000","last_undegraded":"2024-09-14T12:44:22.009896+0000","last_fullsized":"2024-09-14T12:44:22.009896+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-14T12:44:22.009539+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-14T12:44:22.009539+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.009539+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:37.997398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3876,"num_read_kb":3539,"num_write":1018,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"267'324","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.754320+0000","last_change":"2024-09-14T12:44:19.754320+0000","last_active":"2024-09-14T12:44:19.754320+0000","last_peered":"2024-09-14T12:44:19.754320+0000","last_clean":"2024-09-14T12:44:19.754320+0000","last_became_active":"2024-09-14T10:49:23.378269+0000","last_became_peered":"2024-09-14T10:49:23.378269+0000","last_unstale":"2024-09-14T12:44:19.754320+0000","last_undegraded":"2024-09-14T12:44:19.754320+0000","last_fullsized":"2024-09-14T12:44:19.754320+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'324","last_scrub_stamp":"2024-09-14T12:44:19.754019+0000","last_deep_scrub":"267'324","last_deep_scrub_stamp":"2024-09-14T12:44:19.754019+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.754019+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:31.083867+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730146,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":531,"num_read_kb":35954,"num_write":1090,"num_write_kb":39786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"267'146","reported_seq":689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.118227+0000","last_change":"2024-09-14T12:44:36.118227+0000","last_active":"2024-09-14T12:44:36.118227+0000","last_peered":"2024-09-14T12:44:36.118227+0000","last_clean":"2024-09-14T12:44:36.118227+0000","last_became_active":"2024-09-14T10:49:33.464427+0000","last_became_peered":"2024-09-14T10:49:33.464427+0000","last_unstale":"2024-09-14T12:44:36.118227+0000","last_undegraded":"2024-09-14T12:44:36.118227+0000","last_fullsized":"2024-09-14T12:44:36.118227+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-14T12:44:36.118026+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-14T12:44:36.118026+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.118026+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.250408+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":140,"num_write":337,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"267'436","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.764177+0000","last_change":"2024-09-14T12:44:23.764177+0000","last_active":"2024-09-14T12:44:23.764177+0000","last_peered":"2024-09-14T12:44:23.764177+0000","last_clean":"2024-09-14T12:44:23.764177+0000","last_became_active":"2024-09-14T10:49:25.379409+0000","last_became_peered":"2024-09-14T10:49:25.379409+0000","last_unstale":"2024-09-14T12:44:23.764177+0000","last_undegraded":"2024-09-14T12:44:23.764177+0000","last_fullsized":"2024-09-14T12:44:23.764177+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'436","last_scrub_stamp":"2024-09-14T12:44:23.763977+0000","last_deep_scrub":"267'436","last_deep_scrub_stamp":"2024-09-14T12:44:23.763977+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.763977+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:39.979945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2548,"num_read_kb":2434,"num_write":516,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"267'355","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.685459+0000","last_change":"2024-09-14T12:44:21.685459+0000","last_active":"2024-09-14T12:44:21.685459+0000","last_peered":"2024-09-14T12:44:21.685459+0000","last_clean":"2024-09-14T12:44:21.685459+0000","last_became_active":"2024-09-14T10:49:23.365630+0000","last_became_peered":"2024-09-14T10:49:23.365630+0000","last_unstale":"2024-09-14T12:44:21.685459+0000","last_undegraded":"2024-09-14T12:44:21.685459+0000","last_fullsized":"2024-09-14T12:44:21.685459+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'355","last_scrub_stamp":"2024-09-14T12:44:21.685251+0000","last_deep_scrub":"267'355","last_deep_scrub_stamp":"2024-09-14T12:44:21.685251+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.685251+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:58.835156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":11787,"num_write":1186,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.657842+0000","last_change":"2024-09-14T12:44:41.657644+0000","last_active":"2024-09-14T12:44:41.657842+0000","last_peered":"2024-09-14T12:44:41.657842+0000","last_clean":"2024-09-14T12:44:41.657842+0000","last_became_active":"2024-09-14T10:49:27.387803+0000","last_became_peered":"2024-09-14T10:49:27.387803+0000","last_unstale":"2024-09-14T12:44:41.657842+0000","last_undegraded":"2024-09-14T12:44:41.657842+0000","last_fullsized":"2024-09-14T12:44:41.657842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.657431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.657431+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.657431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:59.045915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"267'393","reported_seq":1053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.924020+0000","last_change":"2024-09-14T12:44:38.923884+0000","last_active":"2024-09-14T12:44:38.924020+0000","last_peered":"2024-09-14T12:44:38.924020+0000","last_clean":"2024-09-14T12:44:38.924020+0000","last_became_active":"2024-09-14T10:49:29.386799+0000","last_became_peered":"2024-09-14T10:49:29.386799+0000","last_unstale":"2024-09-14T12:44:38.924020+0000","last_undegraded":"2024-09-14T12:44:38.924020+0000","last_fullsized":"2024-09-14T12:44:38.924020+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'393","last_scrub_stamp":"2024-09-14T12:44:38.923710+0000","last_deep_scrub":"267'393","last_deep_scrub_stamp":"2024-09-14T12:44:38.923710+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.923710+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:34:45.084082+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":621,"num_read_kb":1248,"num_write":488,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.978310+0000","last_change":"2024-09-14T12:44:35.978310+0000","last_active":"2024-09-14T12:44:35.978310+0000","last_peered":"2024-09-14T12:44:35.978310+0000","last_clean":"2024-09-14T12:44:35.978310+0000","last_became_active":"2024-09-14T10:49:31.407831+0000","last_became_peered":"2024-09-14T10:49:31.407831+0000","last_unstale":"2024-09-14T12:44:35.978310+0000","last_undegraded":"2024-09-14T12:44:35.978310+0000","last_fullsized":"2024-09-14T12:44:35.978310+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:35.978133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:35.978133+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.978133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:09.426844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"267'141","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.986180+0000","last_change":"2024-09-14T12:44:40.986180+0000","last_active":"2024-09-14T12:44:40.986180+0000","last_peered":"2024-09-14T12:44:40.986180+0000","last_clean":"2024-09-14T12:44:40.986180+0000","last_became_active":"2024-09-14T10:49:33.474458+0000","last_became_peered":"2024-09-14T10:49:33.474458+0000","last_unstale":"2024-09-14T12:44:40.986180+0000","last_undegraded":"2024-09-14T12:44:40.986180+0000","last_fullsized":"2024-09-14T12:44:40.986180+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T12:44:40.985995+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T12:44:40.985995+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.985995+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:08.181189+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":162,"num_write":341,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"267'696","reported_seq":2376,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.675350+0000","last_change":"2024-09-14T12:44:30.675073+0000","last_active":"2024-09-14T12:44:30.675350+0000","last_peered":"2024-09-14T12:44:30.675350+0000","last_clean":"2024-09-14T12:44:30.675350+0000","last_became_active":"2024-09-14T10:49:25.375112+0000","last_became_peered":"2024-09-14T10:49:25.375112+0000","last_unstale":"2024-09-14T12:44:30.675350+0000","last_undegraded":"2024-09-14T12:44:30.675350+0000","last_fullsized":"2024-09-14T12:44:30.675350+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'696","last_scrub_stamp":"2024-09-14T12:44:30.674832+0000","last_deep_scrub":"267'696","last_deep_scrub_stamp":"2024-09-14T12:44:30.674832+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.674832+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:57.902612+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3284,"num_write":889,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"267'444","reported_seq":1127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.709594+0000","last_change":"2024-09-14T12:44:13.709594+0000","last_active":"2024-09-14T12:44:13.709594+0000","last_peered":"2024-09-14T12:44:13.709594+0000","last_clean":"2024-09-14T12:44:13.709594+0000","last_became_active":"2024-09-14T10:49:23.384801+0000","last_became_peered":"2024-09-14T10:49:23.384801+0000","last_unstale":"2024-09-14T12:44:13.709594+0000","last_undegraded":"2024-09-14T12:44:13.709594+0000","last_fullsized":"2024-09-14T12:44:13.709594+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'444","last_scrub_stamp":"2024-09-14T12:44:13.709388+0000","last_deep_scrub":"267'444","last_deep_scrub_stamp":"2024-09-14T12:44:13.709388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.709388+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:35.749429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":748,"num_read_kb":6714,"num_write":1308,"num_write_kb":31721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.944680+0000","last_change":"2024-09-14T12:44:30.944680+0000","last_active":"2024-09-14T12:44:30.944680+0000","last_peered":"2024-09-14T12:44:30.944680+0000","last_clean":"2024-09-14T12:44:30.944680+0000","last_became_active":"2024-09-14T10:49:27.378702+0000","last_became_peered":"2024-09-14T10:49:27.378702+0000","last_unstale":"2024-09-14T12:44:30.944680+0000","last_undegraded":"2024-09-14T12:44:30.944680+0000","last_fullsized":"2024-09-14T12:44:30.944680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.944442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.944442+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.944442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:56.936931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"267'130","reported_seq":709,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.023761+0000","last_change":"2024-09-14T12:44:31.023597+0000","last_active":"2024-09-14T12:44:31.023761+0000","last_peered":"2024-09-14T12:44:31.023761+0000","last_clean":"2024-09-14T12:44:31.023761+0000","last_became_active":"2024-09-14T10:49:29.398354+0000","last_became_peered":"2024-09-14T10:49:29.398354+0000","last_unstale":"2024-09-14T12:44:31.023761+0000","last_undegraded":"2024-09-14T12:44:31.023761+0000","last_fullsized":"2024-09-14T12:44:31.023761+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'130","last_scrub_stamp":"2024-09-14T12:44:31.023398+0000","last_deep_scrub":"267'130","last_deep_scrub_stamp":"2024-09-14T12:44:31.023398+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.023398+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:28.834905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.956210+0000","last_change":"2024-09-14T12:44:34.956210+0000","last_active":"2024-09-14T12:44:34.956210+0000","last_peered":"2024-09-14T12:44:34.956210+0000","last_clean":"2024-09-14T12:44:34.956210+0000","last_became_active":"2024-09-14T10:49:31.433431+0000","last_became_peered":"2024-09-14T10:49:31.433431+0000","last_unstale":"2024-09-14T12:44:34.956210+0000","last_undegraded":"2024-09-14T12:44:34.956210+0000","last_fullsized":"2024-09-14T12:44:34.956210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:34.956037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:34.956037+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.956037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:10.177612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"267'120","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.860408+0000","last_change":"2024-09-14T12:44:39.860408+0000","last_active":"2024-09-14T12:44:39.860408+0000","last_peered":"2024-09-14T12:44:39.860408+0000","last_clean":"2024-09-14T12:44:39.860408+0000","last_became_active":"2024-09-14T10:49:33.463124+0000","last_became_peered":"2024-09-14T10:49:33.463124+0000","last_unstale":"2024-09-14T12:44:39.860408+0000","last_undegraded":"2024-09-14T12:44:39.860408+0000","last_fullsized":"2024-09-14T12:44:39.860408+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-14T12:44:39.860275+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-14T12:44:39.860275+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.860275+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:29.364501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":148,"num_read_kb":139,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"267'851","reported_seq":2510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.018713+0000","last_change":"2024-09-14T12:44:41.018574+0000","last_active":"2024-09-14T12:44:41.018713+0000","last_peered":"2024-09-14T12:44:41.018713+0000","last_clean":"2024-09-14T12:44:41.018713+0000","last_became_active":"2024-09-14T10:49:25.385678+0000","last_became_peered":"2024-09-14T10:49:25.385678+0000","last_unstale":"2024-09-14T12:44:41.018713+0000","last_undegraded":"2024-09-14T12:44:41.018713+0000","last_fullsized":"2024-09-14T12:44:41.018713+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-14T12:44:41.018389+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-14T12:44:41.018389+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.018389+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:48.677271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4238,"num_read_kb":3841,"num_write":1159,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"267'381","reported_seq":1285,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.727211+0000","last_change":"2024-09-14T12:44:17.727211+0000","last_active":"2024-09-14T12:44:17.727211+0000","last_peered":"2024-09-14T12:44:17.727211+0000","last_clean":"2024-09-14T12:44:17.727211+0000","last_became_active":"2024-09-14T10:49:23.371893+0000","last_became_peered":"2024-09-14T10:49:23.371893+0000","last_unstale":"2024-09-14T12:44:17.727211+0000","last_undegraded":"2024-09-14T12:44:17.727211+0000","last_fullsized":"2024-09-14T12:44:17.727211+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'381","last_scrub_stamp":"2024-09-14T12:44:17.726976+0000","last_deep_scrub":"267'381","last_deep_scrub_stamp":"2024-09-14T12:44:17.726976+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.726976+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:08.246693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1366,"num_read_kb":59405,"num_write":1145,"num_write_kb":37706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.992919+0000","last_change":"2024-09-14T12:44:31.992777+0000","last_active":"2024-09-14T12:44:31.992919+0000","last_peered":"2024-09-14T12:44:31.992919+0000","last_clean":"2024-09-14T12:44:31.992919+0000","last_became_active":"2024-09-14T10:49:27.379355+0000","last_became_peered":"2024-09-14T10:49:27.379355+0000","last_unstale":"2024-09-14T12:44:31.992919+0000","last_undegraded":"2024-09-14T12:44:31.992919+0000","last_fullsized":"2024-09-14T12:44:31.992919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.992552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.992552+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.992552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:34.780168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"267'186","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.944935+0000","last_change":"2024-09-14T12:44:37.944935+0000","last_active":"2024-09-14T12:44:37.944935+0000","last_peered":"2024-09-14T12:44:37.944935+0000","last_clean":"2024-09-14T12:44:37.944935+0000","last_became_active":"2024-09-14T10:49:29.386264+0000","last_became_peered":"2024-09-14T10:49:29.386264+0000","last_unstale":"2024-09-14T12:44:37.944935+0000","last_undegraded":"2024-09-14T12:44:37.944935+0000","last_fullsized":"2024-09-14T12:44:37.944935+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T12:44:37.944716+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T12:44:37.944716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.944716+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:13.665228+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"267'811","reported_seq":3030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:51.554145+0000","last_change":"2024-09-14T12:44:51.554145+0000","last_active":"2024-09-14T12:44:51.554145+0000","last_peered":"2024-09-14T12:44:51.554145+0000","last_clean":"2024-09-14T12:44:51.554145+0000","last_became_active":"2024-09-14T10:49:31.431702+0000","last_became_peered":"2024-09-14T10:49:31.431702+0000","last_unstale":"2024-09-14T12:44:51.554145+0000","last_undegraded":"2024-09-14T12:44:51.554145+0000","last_fullsized":"2024-09-14T12:44:51.554145+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'811","last_scrub_stamp":"2024-09-14T12:44:51.553913+0000","last_deep_scrub":"267'811","last_deep_scrub_stamp":"2024-09-14T12:44:51.553913+0000","last_clean_scrub_stamp":"2024-09-14T12:44:51.553913+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:09.844703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"267'218","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.048157+0000","last_change":"2024-09-14T12:44:38.048157+0000","last_active":"2024-09-14T12:44:38.048157+0000","last_peered":"2024-09-14T12:44:38.048157+0000","last_clean":"2024-09-14T12:44:38.048157+0000","last_became_active":"2024-09-14T10:49:33.472433+0000","last_became_peered":"2024-09-14T10:49:33.472433+0000","last_unstale":"2024-09-14T12:44:38.048157+0000","last_undegraded":"2024-09-14T12:44:38.048157+0000","last_fullsized":"2024-09-14T12:44:38.048157+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'218","last_scrub_stamp":"2024-09-14T12:44:38.047935+0000","last_deep_scrub":"267'218","last_deep_scrub_stamp":"2024-09-14T12:44:38.047935+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.047935+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:53.365245+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":612,"num_write":471,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"267'454","reported_seq":2024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.904898+0000","last_change":"2024-09-14T12:44:26.904764+0000","last_active":"2024-09-14T12:44:26.904898+0000","last_peered":"2024-09-14T12:44:26.904898+0000","last_clean":"2024-09-14T12:44:26.904898+0000","last_became_active":"2024-09-14T10:49:25.395255+0000","last_became_peered":"2024-09-14T10:49:25.395255+0000","last_unstale":"2024-09-14T12:44:26.904898+0000","last_undegraded":"2024-09-14T12:44:26.904898+0000","last_fullsized":"2024-09-14T12:44:26.904898+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'454","last_scrub_stamp":"2024-09-14T12:44:26.904534+0000","last_deep_scrub":"267'454","last_deep_scrub_stamp":"2024-09-14T12:44:26.904534+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.904534+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:00.169555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2444,"num_read_kb":2309,"num_write":533,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"267'370","reported_seq":1063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.932856+0000","last_change":"2024-09-14T12:44:10.932856+0000","last_active":"2024-09-14T12:44:10.932856+0000","last_peered":"2024-09-14T12:44:10.932856+0000","last_clean":"2024-09-14T12:44:10.932856+0000","last_became_active":"2024-09-14T10:49:23.403079+0000","last_became_peered":"2024-09-14T10:49:23.403079+0000","last_unstale":"2024-09-14T12:44:10.932856+0000","last_undegraded":"2024-09-14T12:44:10.932856+0000","last_fullsized":"2024-09-14T12:44:10.932856+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'370","last_scrub_stamp":"2024-09-14T12:44:10.932702+0000","last_deep_scrub":"267'370","last_deep_scrub_stamp":"2024-09-14T12:44:10.932702+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.932702+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:27.564642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":46335,"num_write":1122,"num_write_kb":49327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.643867+0000","last_change":"2024-09-14T12:44:40.643614+0000","last_active":"2024-09-14T12:44:40.643867+0000","last_peered":"2024-09-14T12:44:40.643867+0000","last_clean":"2024-09-14T12:44:40.643867+0000","last_became_active":"2024-09-14T10:49:27.391823+0000","last_became_peered":"2024-09-14T10:49:27.391823+0000","last_unstale":"2024-09-14T12:44:40.643867+0000","last_undegraded":"2024-09-14T12:44:40.643867+0000","last_fullsized":"2024-09-14T12:44:40.643867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:40.643389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:40.643389+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.643389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:52.890279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"267'329","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.929109+0000","last_change":"2024-09-14T12:44:27.928959+0000","last_active":"2024-09-14T12:44:27.929109+0000","last_peered":"2024-09-14T12:44:27.929109+0000","last_clean":"2024-09-14T12:44:27.929109+0000","last_became_active":"2024-09-14T10:49:29.385023+0000","last_became_peered":"2024-09-14T10:49:29.385023+0000","last_unstale":"2024-09-14T12:44:27.929109+0000","last_undegraded":"2024-09-14T12:44:27.929109+0000","last_fullsized":"2024-09-14T12:44:27.929109+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-09-14T12:44:27.928763+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-09-14T12:44:27.928763+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.928763+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:43.341736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45381,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":526,"num_read_kb":1146,"num_write":424,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"267'828","reported_seq":5670,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.983482+0000","last_change":"2024-09-14T12:44:41.983482+0000","last_active":"2024-09-14T12:44:41.983482+0000","last_peered":"2024-09-14T12:44:41.983482+0000","last_clean":"2024-09-14T12:44:41.983482+0000","last_became_active":"2024-09-14T10:49:31.424873+0000","last_became_peered":"2024-09-14T10:49:31.424873+0000","last_unstale":"2024-09-14T12:44:41.983482+0000","last_undegraded":"2024-09-14T12:44:41.983482+0000","last_fullsized":"2024-09-14T12:44:41.983482+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'828","last_scrub_stamp":"2024-09-14T12:44:41.983295+0000","last_deep_scrub":"267'828","last_deep_scrub_stamp":"2024-09-14T12:44:41.983295+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.983295+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.782440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"267'494","reported_seq":2127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.609765+0000","last_change":"2024-09-14T12:44:28.609765+0000","last_active":"2024-09-14T12:44:28.609765+0000","last_peered":"2024-09-14T12:44:28.609765+0000","last_clean":"2024-09-14T12:44:28.609765+0000","last_became_active":"2024-09-14T10:49:25.372711+0000","last_became_peered":"2024-09-14T10:49:25.372711+0000","last_unstale":"2024-09-14T12:44:28.609765+0000","last_undegraded":"2024-09-14T12:44:28.609765+0000","last_fullsized":"2024-09-14T12:44:28.609765+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'494","last_scrub_stamp":"2024-09-14T12:44:28.609502+0000","last_deep_scrub":"267'494","last_deep_scrub_stamp":"2024-09-14T12:44:28.609502+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.609502+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:41.369304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2694,"num_read_kb":2523,"num_write":626,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"267'395","reported_seq":1130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.372090+0000","last_change":"2024-09-14T12:44:14.371801+0000","last_active":"2024-09-14T12:44:14.372090+0000","last_peered":"2024-09-14T12:44:14.372090+0000","last_clean":"2024-09-14T12:44:14.372090+0000","last_became_active":"2024-09-14T10:49:23.363126+0000","last_became_peered":"2024-09-14T10:49:23.363126+0000","last_unstale":"2024-09-14T12:44:14.372090+0000","last_undegraded":"2024-09-14T12:44:14.372090+0000","last_fullsized":"2024-09-14T12:44:14.372090+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T12:44:14.371349+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T12:44:14.371349+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.371349+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:18.212093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":723,"num_read_kb":10241,"num_write":1214,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.064863+0000","last_change":"2024-09-14T12:44:24.064863+0000","last_active":"2024-09-14T12:44:24.064863+0000","last_peered":"2024-09-14T12:44:24.064863+0000","last_clean":"2024-09-14T12:44:24.064863+0000","last_became_active":"2024-09-14T10:49:27.380063+0000","last_became_peered":"2024-09-14T10:49:27.380063+0000","last_unstale":"2024-09-14T12:44:24.064863+0000","last_undegraded":"2024-09-14T12:44:24.064863+0000","last_fullsized":"2024-09-14T12:44:24.064863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.064652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.064652+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.064652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.956294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"267'450","reported_seq":1164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.174305+0000","last_change":"2024-09-14T12:44:29.174135+0000","last_active":"2024-09-14T12:44:29.174305+0000","last_peered":"2024-09-14T12:44:29.174305+0000","last_clean":"2024-09-14T12:44:29.174305+0000","last_became_active":"2024-09-14T10:49:29.383306+0000","last_became_peered":"2024-09-14T10:49:29.383306+0000","last_unstale":"2024-09-14T12:44:29.174305+0000","last_undegraded":"2024-09-14T12:44:29.174305+0000","last_fullsized":"2024-09-14T12:44:29.174305+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'450","last_scrub_stamp":"2024-09-14T12:44:29.173918+0000","last_deep_scrub":"267'450","last_deep_scrub_stamp":"2024-09-14T12:44:29.173918+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.173918+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:13.227443+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48183,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":712,"num_read_kb":1289,"num_write":532,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.815772+0000","last_change":"2024-09-14T12:44:36.815772+0000","last_active":"2024-09-14T12:44:36.815772+0000","last_peered":"2024-09-14T12:44:36.815772+0000","last_clean":"2024-09-14T12:44:36.815772+0000","last_became_active":"2024-09-14T10:49:31.406293+0000","last_became_peered":"2024-09-14T10:49:31.406293+0000","last_unstale":"2024-09-14T12:44:36.815772+0000","last_undegraded":"2024-09-14T12:44:36.815772+0000","last_fullsized":"2024-09-14T12:44:36.815772+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.815598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.815598+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.815598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:31.878162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"267'565","reported_seq":1457,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.010449+0000","last_change":"2024-09-14T12:44:35.010449+0000","last_active":"2024-09-14T12:44:35.010449+0000","last_peered":"2024-09-14T12:44:35.010449+0000","last_clean":"2024-09-14T12:44:35.010449+0000","last_became_active":"2024-09-14T10:49:33.474412+0000","last_became_peered":"2024-09-14T10:49:33.474412+0000","last_unstale":"2024-09-14T12:44:35.010449+0000","last_undegraded":"2024-09-14T12:44:35.010449+0000","last_fullsized":"2024-09-14T12:44:35.010449+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'565","last_scrub_stamp":"2024-09-14T12:44:35.010246+0000","last_deep_scrub":"267'565","last_deep_scrub_stamp":"2024-09-14T12:44:35.010246+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.010246+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:11.291084+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1493,"num_read_kb":1442,"num_write":1188,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"267'447","reported_seq":2098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.951633+0000","last_change":"2024-09-14T12:44:15.951633+0000","last_active":"2024-09-14T12:44:15.951633+0000","last_peered":"2024-09-14T12:44:15.951633+0000","last_clean":"2024-09-14T12:44:15.951633+0000","last_became_active":"2024-09-14T10:49:25.405499+0000","last_became_peered":"2024-09-14T10:49:25.405499+0000","last_unstale":"2024-09-14T12:44:15.951633+0000","last_undegraded":"2024-09-14T12:44:15.951633+0000","last_fullsized":"2024-09-14T12:44:15.951633+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-14T12:44:15.951454+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-14T12:44:15.951454+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.951454+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:25.508784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2502,"num_read_kb":2382,"num_write":513,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"267'382","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.840424+0000","last_change":"2024-09-14T12:44:10.840331+0000","last_active":"2024-09-14T12:44:10.840424+0000","last_peered":"2024-09-14T12:44:10.840424+0000","last_clean":"2024-09-14T12:44:10.840424+0000","last_became_active":"2024-09-14T10:49:23.403551+0000","last_became_peered":"2024-09-14T10:49:23.403551+0000","last_unstale":"2024-09-14T12:44:10.840424+0000","last_undegraded":"2024-09-14T12:44:10.840424+0000","last_fullsized":"2024-09-14T12:44:10.840424+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:10.840221+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:10.840221+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.840221+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:13.320242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":687,"num_read_kb":10639,"num_write":1239,"num_write_kb":29906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.862195+0000","last_change":"2024-09-14T12:44:27.862195+0000","last_active":"2024-09-14T12:44:27.862195+0000","last_peered":"2024-09-14T12:44:27.862195+0000","last_clean":"2024-09-14T12:44:27.862195+0000","last_became_active":"2024-09-14T10:49:27.372510+0000","last_became_peered":"2024-09-14T10:49:27.372510+0000","last_unstale":"2024-09-14T12:44:27.862195+0000","last_undegraded":"2024-09-14T12:44:27.862195+0000","last_fullsized":"2024-09-14T12:44:27.862195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.862002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.862002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.862002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:27.731328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"267'308","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.038911+0000","last_change":"2024-09-14T12:44:36.038911+0000","last_active":"2024-09-14T12:44:36.038911+0000","last_peered":"2024-09-14T12:44:36.038911+0000","last_clean":"2024-09-14T12:44:36.038911+0000","last_became_active":"2024-09-14T10:49:29.377710+0000","last_became_peered":"2024-09-14T10:49:29.377710+0000","last_unstale":"2024-09-14T12:44:36.038911+0000","last_undegraded":"2024-09-14T12:44:36.038911+0000","last_fullsized":"2024-09-14T12:44:36.038911+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-14T12:44:36.038695+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-14T12:44:36.038695+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.038695+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:18.848861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45337,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":492,"num_read_kb":1057,"num_write":388,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.881847+0000","last_change":"2024-09-14T12:44:42.881589+0000","last_active":"2024-09-14T12:44:42.881847+0000","last_peered":"2024-09-14T12:44:42.881847+0000","last_clean":"2024-09-14T12:44:42.881847+0000","last_became_active":"2024-09-14T10:49:31.412080+0000","last_became_peered":"2024-09-14T10:49:31.412080+0000","last_unstale":"2024-09-14T12:44:42.881847+0000","last_undegraded":"2024-09-14T12:44:42.881847+0000","last_fullsized":"2024-09-14T12:44:42.881847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:42.881388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:42.881388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.881388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:23.959186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"267'2530","reported_seq":4399,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.938060+0000","last_change":"2024-09-14T12:44:37.938060+0000","last_active":"2024-09-14T12:44:37.938060+0000","last_peered":"2024-09-14T12:44:37.938060+0000","last_clean":"2024-09-14T12:44:37.938060+0000","last_became_active":"2024-09-14T10:49:33.478542+0000","last_became_peered":"2024-09-14T10:49:33.478542+0000","last_unstale":"2024-09-14T12:44:37.938060+0000","last_undegraded":"2024-09-14T12:44:37.938060+0000","last_fullsized":"2024-09-14T12:44:37.938060+0000","mapping_epoch":36,"log_start":"267'2500","ondisk_log_start":"267'2500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2530","last_scrub_stamp":"2024-09-14T12:44:37.937880+0000","last_deep_scrub":"267'2530","last_deep_scrub_stamp":"2024-09-14T12:44:37.937880+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.937880+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":2500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:26.283421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6246,"num_read_kb":6243,"num_write":5128,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"267'501","reported_seq":2192,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.884793+0000","last_change":"2024-09-14T12:44:16.884652+0000","last_active":"2024-09-14T12:44:16.884793+0000","last_peered":"2024-09-14T12:44:16.884793+0000","last_clean":"2024-09-14T12:44:16.884793+0000","last_became_active":"2024-09-14T10:49:25.380967+0000","last_became_peered":"2024-09-14T10:49:25.380967+0000","last_unstale":"2024-09-14T12:44:16.884793+0000","last_undegraded":"2024-09-14T12:44:16.884793+0000","last_fullsized":"2024-09-14T12:44:16.884793+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'501","last_scrub_stamp":"2024-09-14T12:44:16.884453+0000","last_deep_scrub":"267'501","last_deep_scrub_stamp":"2024-09-14T12:44:16.884453+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.884453+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:11.460810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2697,"num_read_kb":2531,"num_write":585,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"267'361","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.727178+0000","last_change":"2024-09-14T12:44:16.727178+0000","last_active":"2024-09-14T12:44:16.727178+0000","last_peered":"2024-09-14T12:44:16.727178+0000","last_clean":"2024-09-14T12:44:16.727178+0000","last_became_active":"2024-09-14T10:49:23.355809+0000","last_became_peered":"2024-09-14T10:49:23.355809+0000","last_unstale":"2024-09-14T12:44:16.727178+0000","last_undegraded":"2024-09-14T12:44:16.727178+0000","last_fullsized":"2024-09-14T12:44:16.727178+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-09-14T12:44:16.726929+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-09-14T12:44:16.726929+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.726929+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:07.328476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730147,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":12441,"num_write":1183,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.993910+0000","last_change":"2024-09-14T12:44:31.993910+0000","last_active":"2024-09-14T12:44:31.993910+0000","last_peered":"2024-09-14T12:44:31.993910+0000","last_clean":"2024-09-14T12:44:31.993910+0000","last_became_active":"2024-09-14T10:49:27.378028+0000","last_became_peered":"2024-09-14T10:49:27.378028+0000","last_unstale":"2024-09-14T12:44:31.993910+0000","last_undegraded":"2024-09-14T12:44:31.993910+0000","last_fullsized":"2024-09-14T12:44:31.993910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.993720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.993720+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.993720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:52.847388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"267'406","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.586823+0000","last_change":"2024-09-14T12:44:46.586823+0000","last_active":"2024-09-14T12:44:46.586823+0000","last_peered":"2024-09-14T12:44:46.586823+0000","last_clean":"2024-09-14T12:44:46.586823+0000","last_became_active":"2024-09-14T10:49:29.388786+0000","last_became_peered":"2024-09-14T10:49:29.388786+0000","last_unstale":"2024-09-14T12:44:46.586823+0000","last_undegraded":"2024-09-14T12:44:46.586823+0000","last_fullsized":"2024-09-14T12:44:46.586823+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'406","last_scrub_stamp":"2024-09-14T12:44:46.586612+0000","last_deep_scrub":"267'406","last_deep_scrub_stamp":"2024-09-14T12:44:46.586612+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.586612+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:21.570016+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53040,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":1302,"num_write":504,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"267'827","reported_seq":3431,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.012656+0000","last_change":"2024-09-14T12:44:39.012656+0000","last_active":"2024-09-14T12:44:39.012656+0000","last_peered":"2024-09-14T12:44:39.012656+0000","last_clean":"2024-09-14T12:44:39.012656+0000","last_became_active":"2024-09-14T10:49:31.420178+0000","last_became_peered":"2024-09-14T10:49:31.420178+0000","last_unstale":"2024-09-14T12:44:39.012656+0000","last_undegraded":"2024-09-14T12:44:39.012656+0000","last_fullsized":"2024-09-14T12:44:39.012656+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-14T12:44:39.012452+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-14T12:44:39.012452+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.012452+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:19.983480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"267'145","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.890373+0000","last_change":"2024-09-14T12:44:38.890373+0000","last_active":"2024-09-14T12:44:38.890373+0000","last_peered":"2024-09-14T12:44:38.890373+0000","last_clean":"2024-09-14T12:44:38.890373+0000","last_became_active":"2024-09-14T10:49:33.462780+0000","last_became_peered":"2024-09-14T10:49:33.462780+0000","last_unstale":"2024-09-14T12:44:38.890373+0000","last_undegraded":"2024-09-14T12:44:38.890373+0000","last_fullsized":"2024-09-14T12:44:38.890373+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'145","last_scrub_stamp":"2024-09-14T12:44:38.890156+0000","last_deep_scrub":"267'145","last_deep_scrub_stamp":"2024-09-14T12:44:38.890156+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.890156+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:15.024191+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":336,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"267'837","reported_seq":2447,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.916505+0000","last_change":"2024-09-14T12:44:25.916505+0000","last_active":"2024-09-14T12:44:25.916505+0000","last_peered":"2024-09-14T12:44:25.916505+0000","last_clean":"2024-09-14T12:44:25.916505+0000","last_became_active":"2024-09-14T10:49:25.389567+0000","last_became_peered":"2024-09-14T10:49:25.389567+0000","last_unstale":"2024-09-14T12:44:25.916505+0000","last_undegraded":"2024-09-14T12:44:25.916505+0000","last_fullsized":"2024-09-14T12:44:25.916505+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'837","last_scrub_stamp":"2024-09-14T12:44:25.916317+0000","last_deep_scrub":"267'837","last_deep_scrub_stamp":"2024-09-14T12:44:25.916317+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.916317+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:29.573496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4051,"num_read_kb":3641,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"267'382","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.406612+0000","last_change":"2024-09-14T12:44:09.406557+0000","last_active":"2024-09-14T12:44:09.406612+0000","last_peered":"2024-09-14T12:44:09.406612+0000","last_clean":"2024-09-14T12:44:09.406612+0000","last_became_active":"2024-09-14T10:49:23.354452+0000","last_became_peered":"2024-09-14T10:49:23.354452+0000","last_unstale":"2024-09-14T12:44:09.406612+0000","last_undegraded":"2024-09-14T12:44:09.406612+0000","last_fullsized":"2024-09-14T12:44:09.406612+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:09.406462+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.406462+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:33.958379+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730180,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":608,"num_read_kb":20994,"num_write":1147,"num_write_kb":31512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.899948+0000","last_change":"2024-09-14T12:44:26.899729+0000","last_active":"2024-09-14T12:44:26.899948+0000","last_peered":"2024-09-14T12:44:26.899948+0000","last_clean":"2024-09-14T12:44:26.899948+0000","last_became_active":"2024-09-14T10:49:27.353932+0000","last_became_peered":"2024-09-14T10:49:27.353932+0000","last_unstale":"2024-09-14T12:44:26.899948+0000","last_undegraded":"2024-09-14T12:44:26.899948+0000","last_fullsized":"2024-09-14T12:44:26.899948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:26.899467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:26.899467+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.899467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:14.438303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"267'503","reported_seq":1195,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.053915+0000","last_change":"2024-09-14T12:44:34.053915+0000","last_active":"2024-09-14T12:44:34.053915+0000","last_peered":"2024-09-14T12:44:34.053915+0000","last_clean":"2024-09-14T12:44:34.053915+0000","last_became_active":"2024-09-14T10:49:29.378107+0000","last_became_peered":"2024-09-14T10:49:29.378107+0000","last_unstale":"2024-09-14T12:44:34.053915+0000","last_undegraded":"2024-09-14T12:44:34.053915+0000","last_fullsized":"2024-09-14T12:44:34.053915+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'503","last_scrub_stamp":"2024-09-14T12:44:34.053712+0000","last_deep_scrub":"267'503","last_deep_scrub_stamp":"2024-09-14T12:44:34.053712+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.053712+0000","objects_scrubbed":6,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:25:12.264177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89831,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":1885,"num_write":676,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.972942+0000","last_change":"2024-09-14T12:44:37.972942+0000","last_active":"2024-09-14T12:44:37.972942+0000","last_peered":"2024-09-14T12:44:37.972942+0000","last_clean":"2024-09-14T12:44:37.972942+0000","last_became_active":"2024-09-14T10:49:31.409247+0000","last_became_peered":"2024-09-14T10:49:31.409247+0000","last_unstale":"2024-09-14T12:44:37.972942+0000","last_undegraded":"2024-09-14T12:44:37.972942+0000","last_fullsized":"2024-09-14T12:44:37.972942+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:37.972763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:37.972763+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.972763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:48.217769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"267'133","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.427624+0000","last_change":"2024-09-14T12:44:35.427624+0000","last_active":"2024-09-14T12:44:35.427624+0000","last_peered":"2024-09-14T12:44:35.427624+0000","last_clean":"2024-09-14T12:44:35.427624+0000","last_became_active":"2024-09-14T10:49:33.461635+0000","last_became_peered":"2024-09-14T10:49:33.461635+0000","last_unstale":"2024-09-14T12:44:35.427624+0000","last_undegraded":"2024-09-14T12:44:35.427624+0000","last_fullsized":"2024-09-14T12:44:35.427624+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'133","last_scrub_stamp":"2024-09-14T12:44:35.427419+0000","last_deep_scrub":"267'133","last_deep_scrub_stamp":"2024-09-14T12:44:35.427419+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.427419+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:00.864229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":314,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"267'839","reported_seq":2540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.408128+0000","last_change":"2024-09-14T12:44:16.408128+0000","last_active":"2024-09-14T12:44:16.408128+0000","last_peered":"2024-09-14T12:44:16.408128+0000","last_clean":"2024-09-14T12:44:16.408128+0000","last_became_active":"2024-09-14T10:49:25.361148+0000","last_became_peered":"2024-09-14T10:49:25.361148+0000","last_unstale":"2024-09-14T12:44:16.408128+0000","last_undegraded":"2024-09-14T12:44:16.408128+0000","last_fullsized":"2024-09-14T12:44:16.408128+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'839","last_scrub_stamp":"2024-09-14T12:44:16.407940+0000","last_deep_scrub":"267'839","last_deep_scrub_stamp":"2024-09-14T12:44:16.407940+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.407940+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:23.435248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4070,"num_read_kb":3684,"num_write":1107,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"267'346","reported_seq":1035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.668424+0000","last_change":"2024-09-14T12:44:12.668424+0000","last_active":"2024-09-14T12:44:12.668424+0000","last_peered":"2024-09-14T12:44:12.668424+0000","last_clean":"2024-09-14T12:44:12.668424+0000","last_became_active":"2024-09-14T10:49:23.375005+0000","last_became_peered":"2024-09-14T10:49:23.375005+0000","last_unstale":"2024-09-14T12:44:12.668424+0000","last_undegraded":"2024-09-14T12:44:12.668424+0000","last_fullsized":"2024-09-14T12:44:12.668424+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-14T12:44:12.668139+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-14T12:44:12.668139+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.668139+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:32.312612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":716,"num_read_kb":12064,"num_write":1099,"num_write_kb":35066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.438078+0000","last_change":"2024-09-14T12:44:24.438078+0000","last_active":"2024-09-14T12:44:24.438078+0000","last_peered":"2024-09-14T12:44:24.438078+0000","last_clean":"2024-09-14T12:44:24.438078+0000","last_became_active":"2024-09-14T10:49:27.385658+0000","last_became_peered":"2024-09-14T10:49:27.385658+0000","last_unstale":"2024-09-14T12:44:24.438078+0000","last_undegraded":"2024-09-14T12:44:24.438078+0000","last_fullsized":"2024-09-14T12:44:24.438078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.437896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.437896+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.437896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:21.541048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"267'372","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.049012+0000","last_change":"2024-09-14T12:44:30.049012+0000","last_active":"2024-09-14T12:44:30.049012+0000","last_peered":"2024-09-14T12:44:30.049012+0000","last_clean":"2024-09-14T12:44:30.049012+0000","last_became_active":"2024-09-14T10:49:29.388618+0000","last_became_peered":"2024-09-14T10:49:29.388618+0000","last_unstale":"2024-09-14T12:44:30.049012+0000","last_undegraded":"2024-09-14T12:44:30.049012+0000","last_fullsized":"2024-09-14T12:44:30.049012+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-09-14T12:44:30.048826+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-09-14T12:44:30.048826+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.048826+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:35.349305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53436,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":1275,"num_write":534,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17022,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.413073+0000","last_change":"2024-09-14T12:44:31.412920+0000","last_active":"2024-09-14T12:44:31.413073+0000","last_peered":"2024-09-14T12:44:31.413073+0000","last_clean":"2024-09-14T12:44:31.413073+0000","last_became_active":"2024-09-14T10:49:31.417797+0000","last_became_peered":"2024-09-14T10:49:31.417797+0000","last_unstale":"2024-09-14T12:44:31.413073+0000","last_undegraded":"2024-09-14T12:44:31.413073+0000","last_fullsized":"2024-09-14T12:44:31.413073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:31.412741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:31.412741+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.412741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:44.652617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"267'117","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.958123+0000","last_change":"2024-09-14T12:44:42.958123+0000","last_active":"2024-09-14T12:44:42.958123+0000","last_peered":"2024-09-14T12:44:42.958123+0000","last_clean":"2024-09-14T12:44:42.958123+0000","last_became_active":"2024-09-14T10:49:33.455162+0000","last_became_peered":"2024-09-14T10:49:33.455162+0000","last_unstale":"2024-09-14T12:44:42.958123+0000","last_undegraded":"2024-09-14T12:44:42.958123+0000","last_fullsized":"2024-09-14T12:44:42.958123+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'117","last_scrub_stamp":"2024-09-14T12:44:42.957920+0000","last_deep_scrub":"267'117","last_deep_scrub_stamp":"2024-09-14T12:44:42.957920+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.957920+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:03.610267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"267'591","reported_seq":2437,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.638678+0000","last_change":"2024-09-14T12:44:29.638678+0000","last_active":"2024-09-14T12:44:29.638678+0000","last_peered":"2024-09-14T12:44:29.638678+0000","last_clean":"2024-09-14T12:44:29.638678+0000","last_became_active":"2024-09-14T10:49:25.377866+0000","last_became_peered":"2024-09-14T10:49:25.377866+0000","last_unstale":"2024-09-14T12:44:29.638678+0000","last_undegraded":"2024-09-14T12:44:29.638678+0000","last_fullsized":"2024-09-14T12:44:29.638678+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'591","last_scrub_stamp":"2024-09-14T12:44:29.638497+0000","last_deep_scrub":"267'591","last_deep_scrub_stamp":"2024-09-14T12:44:29.638497+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.638497+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:43.254748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3293,"num_read_kb":3082,"num_write":722,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3260,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"267'319","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.689360+0000","last_change":"2024-09-14T12:44:18.689208+0000","last_active":"2024-09-14T12:44:18.689360+0000","last_peered":"2024-09-14T12:44:18.689360+0000","last_clean":"2024-09-14T12:44:18.689360+0000","last_became_active":"2024-09-14T10:49:23.362203+0000","last_became_peered":"2024-09-14T10:49:23.362203+0000","last_unstale":"2024-09-14T12:44:18.689360+0000","last_undegraded":"2024-09-14T12:44:18.689360+0000","last_fullsized":"2024-09-14T12:44:18.689360+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-14T12:44:18.688974+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-14T12:44:18.688974+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.688974+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:03.279044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":29276,"num_write":1000,"num_write_kb":13260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.956328+0000","last_change":"2024-09-14T12:44:36.956328+0000","last_active":"2024-09-14T12:44:36.956328+0000","last_peered":"2024-09-14T12:44:36.956328+0000","last_clean":"2024-09-14T12:44:36.956328+0000","last_became_active":"2024-09-14T10:49:27.377674+0000","last_became_peered":"2024-09-14T10:49:27.377674+0000","last_unstale":"2024-09-14T12:44:36.956328+0000","last_undegraded":"2024-09-14T12:44:36.956328+0000","last_fullsized":"2024-09-14T12:44:36.956328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.956150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.956150+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.956150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:45.120719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"267'402","reported_seq":1062,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.068633+0000","last_change":"2024-09-14T12:44:34.068537+0000","last_active":"2024-09-14T12:44:34.068633+0000","last_peered":"2024-09-14T12:44:34.068633+0000","last_clean":"2024-09-14T12:44:34.068633+0000","last_became_active":"2024-09-14T10:49:29.393350+0000","last_became_peered":"2024-09-14T10:49:29.393350+0000","last_unstale":"2024-09-14T12:44:34.068633+0000","last_undegraded":"2024-09-14T12:44:34.068633+0000","last_fullsized":"2024-09-14T12:44:34.068633+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:34.068404+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:34.068404+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.068404+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:20.895132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50275,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":654,"num_read_kb":1334,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"267'794","reported_seq":5235,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.443351+0000","last_change":"2024-09-14T12:44:29.443351+0000","last_active":"2024-09-14T12:44:29.443351+0000","last_peered":"2024-09-14T12:44:29.443351+0000","last_clean":"2024-09-14T12:44:29.443351+0000","last_became_active":"2024-09-14T10:49:31.422534+0000","last_became_peered":"2024-09-14T10:49:31.422534+0000","last_unstale":"2024-09-14T12:44:29.443351+0000","last_undegraded":"2024-09-14T12:44:29.443351+0000","last_fullsized":"2024-09-14T12:44:29.443351+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'794","last_scrub_stamp":"2024-09-14T12:44:29.443166+0000","last_deep_scrub":"267'794","last_deep_scrub_stamp":"2024-09-14T12:44:29.443166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.443166+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.967521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"267'162","reported_seq":742,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.867490+0000","last_change":"2024-09-14T12:44:37.867490+0000","last_active":"2024-09-14T12:44:37.867490+0000","last_peered":"2024-09-14T12:44:37.867490+0000","last_clean":"2024-09-14T12:44:37.867490+0000","last_became_active":"2024-09-14T10:49:33.466024+0000","last_became_peered":"2024-09-14T10:49:33.466024+0000","last_unstale":"2024-09-14T12:44:37.867490+0000","last_undegraded":"2024-09-14T12:44:37.867490+0000","last_fullsized":"2024-09-14T12:44:37.867490+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-14T12:44:37.867287+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-14T12:44:37.867287+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.867287+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:21.080474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1674,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":335,"num_read_kb":285,"num_write":383,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"267'673","reported_seq":2400,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.795938+0000","last_change":"2024-09-14T12:44:19.795938+0000","last_active":"2024-09-14T12:44:19.795938+0000","last_peered":"2024-09-14T12:44:19.795938+0000","last_clean":"2024-09-14T12:44:19.795938+0000","last_became_active":"2024-09-14T10:49:25.380712+0000","last_became_peered":"2024-09-14T10:49:25.380712+0000","last_unstale":"2024-09-14T12:44:19.795938+0000","last_undegraded":"2024-09-14T12:44:19.795938+0000","last_fullsized":"2024-09-14T12:44:19.795938+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'673","last_scrub_stamp":"2024-09-14T12:44:19.795731+0000","last_deep_scrub":"267'673","last_deep_scrub_stamp":"2024-09-14T12:44:19.795731+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.795731+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:58.049805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3719,"num_read_kb":3469,"num_write":935,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"267'349","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.741343+0000","last_change":"2024-09-14T12:44:14.741194+0000","last_active":"2024-09-14T12:44:14.741343+0000","last_peered":"2024-09-14T12:44:14.741343+0000","last_clean":"2024-09-14T12:44:14.741343+0000","last_became_active":"2024-09-14T10:49:23.367200+0000","last_became_peered":"2024-09-14T10:49:23.367200+0000","last_unstale":"2024-09-14T12:44:14.741343+0000","last_undegraded":"2024-09-14T12:44:14.741343+0000","last_fullsized":"2024-09-14T12:44:14.741343+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-14T12:44:14.740931+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-14T12:44:14.740931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.740931+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:26.381621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":678,"num_read_kb":77246,"num_write":1147,"num_write_kb":38780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.043751+0000","last_change":"2024-09-14T12:44:26.043611+0000","last_active":"2024-09-14T12:44:26.043751+0000","last_peered":"2024-09-14T12:44:26.043751+0000","last_clean":"2024-09-14T12:44:26.043751+0000","last_became_active":"2024-09-14T10:49:27.379952+0000","last_became_peered":"2024-09-14T10:49:27.379952+0000","last_unstale":"2024-09-14T12:44:26.043751+0000","last_undegraded":"2024-09-14T12:44:26.043751+0000","last_fullsized":"2024-09-14T12:44:26.043751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:26.043404+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:26.043404+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.043404+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:43.208508+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"267'146","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.825188+0000","last_change":"2024-09-14T12:44:29.825188+0000","last_active":"2024-09-14T12:44:29.825188+0000","last_peered":"2024-09-14T12:44:29.825188+0000","last_clean":"2024-09-14T12:44:29.825188+0000","last_became_active":"2024-09-14T10:49:29.371803+0000","last_became_peered":"2024-09-14T10:49:29.371803+0000","last_unstale":"2024-09-14T12:44:29.825188+0000","last_undegraded":"2024-09-14T12:44:29.825188+0000","last_fullsized":"2024-09-14T12:44:29.825188+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'146","last_scrub_stamp":"2024-09-14T12:44:29.824972+0000","last_deep_scrub":"267'146","last_deep_scrub_stamp":"2024-09-14T12:44:29.824972+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.824972+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:03.803486+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"267'797","reported_seq":3155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.986093+0000","last_change":"2024-09-14T12:44:31.986093+0000","last_active":"2024-09-14T12:44:31.986093+0000","last_peered":"2024-09-14T12:44:31.986093+0000","last_clean":"2024-09-14T12:44:31.986093+0000","last_became_active":"2024-09-14T10:49:31.427179+0000","last_became_peered":"2024-09-14T10:49:31.427179+0000","last_unstale":"2024-09-14T12:44:31.986093+0000","last_undegraded":"2024-09-14T12:44:31.986093+0000","last_fullsized":"2024-09-14T12:44:31.986093+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'797","last_scrub_stamp":"2024-09-14T12:44:31.985911+0000","last_deep_scrub":"267'797","last_deep_scrub_stamp":"2024-09-14T12:44:31.985911+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.985911+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:03.033127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.022592+0000","last_change":"2024-09-14T12:44:34.022592+0000","last_active":"2024-09-14T12:44:34.022592+0000","last_peered":"2024-09-14T12:44:34.022592+0000","last_clean":"2024-09-14T12:44:34.022592+0000","last_became_active":"2024-09-14T10:49:33.468831+0000","last_became_peered":"2024-09-14T10:49:33.468831+0000","last_unstale":"2024-09-14T12:44:34.022592+0000","last_undegraded":"2024-09-14T12:44:34.022592+0000","last_fullsized":"2024-09-14T12:44:34.022592+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T12:44:34.022405+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T12:44:34.022405+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.022405+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:24.580048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":148,"num_write":325,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"267'488","reported_seq":2230,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.501840+0000","last_change":"2024-09-14T12:44:19.501701+0000","last_active":"2024-09-14T12:44:19.501840+0000","last_peered":"2024-09-14T12:44:19.501840+0000","last_clean":"2024-09-14T12:44:19.501840+0000","last_became_active":"2024-09-14T10:49:25.370649+0000","last_became_peered":"2024-09-14T10:49:25.370649+0000","last_unstale":"2024-09-14T12:44:19.501840+0000","last_undegraded":"2024-09-14T12:44:19.501840+0000","last_fullsized":"2024-09-14T12:44:19.501840+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'488","last_scrub_stamp":"2024-09-14T12:44:19.501488+0000","last_deep_scrub":"267'488","last_deep_scrub_stamp":"2024-09-14T12:44:19.501488+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.501488+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:41.258394+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2839,"num_read_kb":2682,"num_write":610,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"267'390","reported_seq":1121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.742825+0000","last_change":"2024-09-14T12:44:12.742681+0000","last_active":"2024-09-14T12:44:12.742825+0000","last_peered":"2024-09-14T12:44:12.742825+0000","last_clean":"2024-09-14T12:44:12.742825+0000","last_became_active":"2024-09-14T10:49:23.355864+0000","last_became_peered":"2024-09-14T10:49:23.355864+0000","last_unstale":"2024-09-14T12:44:12.742825+0000","last_undegraded":"2024-09-14T12:44:12.742825+0000","last_fullsized":"2024-09-14T12:44:12.742825+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-09-14T12:44:12.742461+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-09-14T12:44:12.742461+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.742461+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:50.949947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730127,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":100725,"num_write":1103,"num_write_kb":40873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.620062+0000","last_change":"2024-09-14T12:44:37.620062+0000","last_active":"2024-09-14T12:44:37.620062+0000","last_peered":"2024-09-14T12:44:37.620062+0000","last_clean":"2024-09-14T12:44:37.620062+0000","last_became_active":"2024-09-14T10:49:27.390169+0000","last_became_peered":"2024-09-14T10:49:27.390169+0000","last_unstale":"2024-09-14T12:44:37.620062+0000","last_undegraded":"2024-09-14T12:44:37.620062+0000","last_fullsized":"2024-09-14T12:44:37.620062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:37.619874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:37.619874+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.619874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:51.304924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"267'426","reported_seq":1119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.059437+0000","last_change":"2024-09-14T12:44:29.059437+0000","last_active":"2024-09-14T12:44:29.059437+0000","last_peered":"2024-09-14T12:44:29.059437+0000","last_clean":"2024-09-14T12:44:29.059437+0000","last_became_active":"2024-09-14T10:49:29.400776+0000","last_became_peered":"2024-09-14T10:49:29.400776+0000","last_unstale":"2024-09-14T12:44:29.059437+0000","last_undegraded":"2024-09-14T12:44:29.059437+0000","last_fullsized":"2024-09-14T12:44:29.059437+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'426","last_scrub_stamp":"2024-09-14T12:44:29.059340+0000","last_deep_scrub":"267'426","last_deep_scrub_stamp":"2024-09-14T12:44:29.059340+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.059340+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:24.036786+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43916,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":681,"num_read_kb":1253,"num_write":514,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.968293+0000","last_change":"2024-09-14T12:44:29.968293+0000","last_active":"2024-09-14T12:44:29.968293+0000","last_peered":"2024-09-14T12:44:29.968293+0000","last_clean":"2024-09-14T12:44:29.968293+0000","last_became_active":"2024-09-14T10:49:31.418131+0000","last_became_peered":"2024-09-14T10:49:31.418131+0000","last_unstale":"2024-09-14T12:44:29.968293+0000","last_undegraded":"2024-09-14T12:44:29.968293+0000","last_fullsized":"2024-09-14T12:44:29.968293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:29.968107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:29.968107+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.968107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:34.481689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"267'141","reported_seq":678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.476950+0000","last_change":"2024-09-14T12:44:34.476950+0000","last_active":"2024-09-14T12:44:34.476950+0000","last_peered":"2024-09-14T12:44:34.476950+0000","last_clean":"2024-09-14T12:44:34.476950+0000","last_became_active":"2024-09-14T10:49:33.455953+0000","last_became_peered":"2024-09-14T10:49:33.455953+0000","last_unstale":"2024-09-14T12:44:34.476950+0000","last_undegraded":"2024-09-14T12:44:34.476950+0000","last_fullsized":"2024-09-14T12:44:34.476950+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T12:44:34.476728+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T12:44:34.476728+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.476728+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:18.465980+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":164,"num_read_kb":155,"num_write":340,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"267'414","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.634493+0000","last_change":"2024-09-14T12:44:27.634493+0000","last_active":"2024-09-14T12:44:27.634493+0000","last_peered":"2024-09-14T12:44:27.634493+0000","last_clean":"2024-09-14T12:44:27.634493+0000","last_became_active":"2024-09-14T10:49:25.377841+0000","last_became_peered":"2024-09-14T10:49:25.377841+0000","last_unstale":"2024-09-14T12:44:27.634493+0000","last_undegraded":"2024-09-14T12:44:27.634493+0000","last_fullsized":"2024-09-14T12:44:27.634493+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-14T12:44:27.634299+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-14T12:44:27.634299+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.634299+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:58.860140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2397,"num_read_kb":2304,"num_write":471,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":662,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.887088+0000","last_change":"2024-09-14T12:44:09.886990+0000","last_active":"2024-09-14T12:44:09.887088+0000","last_peered":"2024-09-14T12:44:09.887088+0000","last_clean":"2024-09-14T12:44:09.887088+0000","last_became_active":"2024-09-14T10:49:02.305044+0000","last_became_peered":"2024-09-14T10:49:02.305044+0000","last_unstale":"2024-09-14T12:44:09.887088+0000","last_undegraded":"2024-09-14T12:44:09.887088+0000","last_fullsized":"2024-09-14T12:44:09.887088+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T12:44:09.886874+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.886874+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:32.555870+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.693554+0000","last_change":"2024-09-14T12:44:11.693554+0000","last_active":"2024-09-14T12:44:11.693554+0000","last_peered":"2024-09-14T12:44:11.693554+0000","last_clean":"2024-09-14T12:44:11.693554+0000","last_became_active":"2024-09-14T10:49:07.320073+0000","last_became_peered":"2024-09-14T10:49:07.320073+0000","last_unstale":"2024-09-14T12:44:11.693554+0000","last_undegraded":"2024-09-14T12:44:11.693554+0000","last_fullsized":"2024-09-14T12:44:11.693554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:11.693472+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:11.693472+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.693472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:19.157490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020680569999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"267'329","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.793286+0000","last_change":"2024-09-14T12:44:10.793286+0000","last_active":"2024-09-14T12:44:10.793286+0000","last_peered":"2024-09-14T12:44:10.793286+0000","last_clean":"2024-09-14T12:44:10.793286+0000","last_became_active":"2024-09-14T10:49:23.371077+0000","last_became_peered":"2024-09-14T10:49:23.371077+0000","last_unstale":"2024-09-14T12:44:10.793286+0000","last_undegraded":"2024-09-14T12:44:10.793286+0000","last_fullsized":"2024-09-14T12:44:10.793286+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'329","last_scrub_stamp":"2024-09-14T12:44:10.793074+0000","last_deep_scrub":"267'329","last_deep_scrub_stamp":"2024-09-14T12:44:10.793074+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.793074+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:06.598298+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":16360,"num_write":1113,"num_write_kb":33420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.166090+0000","last_change":"2024-09-14T12:44:27.166090+0000","last_active":"2024-09-14T12:44:27.166090+0000","last_peered":"2024-09-14T12:44:27.166090+0000","last_clean":"2024-09-14T12:44:27.166090+0000","last_became_active":"2024-09-14T10:49:27.372388+0000","last_became_peered":"2024-09-14T10:49:27.372388+0000","last_unstale":"2024-09-14T12:44:27.166090+0000","last_undegraded":"2024-09-14T12:44:27.166090+0000","last_fullsized":"2024-09-14T12:44:27.166090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.165821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.165821+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.165821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:15.547531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"267'835","reported_seq":1590,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.602576+0000","last_change":"2024-09-14T12:44:43.602576+0000","last_active":"2024-09-14T12:44:43.602576+0000","last_peered":"2024-09-14T12:44:43.602576+0000","last_clean":"2024-09-14T12:44:43.602576+0000","last_became_active":"2024-09-14T10:49:29.390014+0000","last_became_peered":"2024-09-14T10:49:29.390014+0000","last_unstale":"2024-09-14T12:44:43.602576+0000","last_undegraded":"2024-09-14T12:44:43.602576+0000","last_fullsized":"2024-09-14T12:44:43.602576+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'835","last_scrub_stamp":"2024-09-14T12:44:43.602388+0000","last_deep_scrub":"267'835","last_deep_scrub_stamp":"2024-09-14T12:44:43.602388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.602388+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:49.116772+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167259,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1623,"num_read_kb":3686,"num_write":1586,"num_write_kb":1425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107094,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.989824+0000","last_change":"2024-09-14T12:44:39.989824+0000","last_active":"2024-09-14T12:44:39.989824+0000","last_peered":"2024-09-14T12:44:39.989824+0000","last_clean":"2024-09-14T12:44:39.989824+0000","last_became_active":"2024-09-14T10:49:31.411212+0000","last_became_peered":"2024-09-14T10:49:31.411212+0000","last_unstale":"2024-09-14T12:44:39.989824+0000","last_undegraded":"2024-09-14T12:44:39.989824+0000","last_fullsized":"2024-09-14T12:44:39.989824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:39.989560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:39.989560+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.989560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:38.029943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"267'198","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.104464+0000","last_change":"2024-09-14T12:44:33.104464+0000","last_active":"2024-09-14T12:44:33.104464+0000","last_peered":"2024-09-14T12:44:33.104464+0000","last_clean":"2024-09-14T12:44:33.104464+0000","last_became_active":"2024-09-14T10:49:33.469611+0000","last_became_peered":"2024-09-14T10:49:33.469611+0000","last_unstale":"2024-09-14T12:44:33.104464+0000","last_undegraded":"2024-09-14T12:44:33.104464+0000","last_fullsized":"2024-09-14T12:44:33.104464+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-14T12:44:33.104326+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-14T12:44:33.104326+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.104326+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:32.582985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":431,"num_read_kb":425,"num_write":402,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"267'780","reported_seq":2301,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.874559+0000","last_change":"2024-09-14T12:44:24.874559+0000","last_active":"2024-09-14T12:44:24.874559+0000","last_peered":"2024-09-14T12:44:24.874559+0000","last_clean":"2024-09-14T12:44:24.874559+0000","last_became_active":"2024-09-14T10:49:25.390586+0000","last_became_peered":"2024-09-14T10:49:25.390586+0000","last_unstale":"2024-09-14T12:44:24.874559+0000","last_undegraded":"2024-09-14T12:44:24.874559+0000","last_fullsized":"2024-09-14T12:44:24.874559+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'780","last_scrub_stamp":"2024-09-14T12:44:24.874284+0000","last_deep_scrub":"267'780","last_deep_scrub_stamp":"2024-09-14T12:44:24.874284+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.874284+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:51.757493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3382,"num_write":1057,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.718171+0000","last_change":"2024-09-14T12:44:10.718117+0000","last_active":"2024-09-14T12:44:10.718171+0000","last_peered":"2024-09-14T12:44:10.718171+0000","last_clean":"2024-09-14T12:44:10.718171+0000","last_became_active":"2024-09-14T10:49:07.035386+0000","last_became_peered":"2024-09-14T10:49:07.035386+0000","last_unstale":"2024-09-14T12:44:10.718171+0000","last_undegraded":"2024-09-14T12:44:10.718171+0000","last_fullsized":"2024-09-14T12:44:10.718171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:10.718056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:10.718056+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.718056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:29.760263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012855270000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"267'352","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.735411+0000","last_change":"2024-09-14T12:44:12.735411+0000","last_active":"2024-09-14T12:44:12.735411+0000","last_peered":"2024-09-14T12:44:12.735411+0000","last_clean":"2024-09-14T12:44:12.735411+0000","last_became_active":"2024-09-14T10:49:53.507913+0000","last_became_peered":"2024-09-14T10:49:53.507913+0000","last_unstale":"2024-09-14T12:44:12.735411+0000","last_undegraded":"2024-09-14T12:44:12.735411+0000","last_fullsized":"2024-09-14T12:44:12.735411+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'352","last_scrub_stamp":"2024-09-14T12:44:12.735166+0000","last_deep_scrub":"267'352","last_deep_scrub_stamp":"2024-09-14T12:44:12.735166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.735166+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:17.278126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":56481,"num_write":1136,"num_write_kb":45113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,3],"acting":[6,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.652426+0000","last_change":"2024-09-14T12:44:36.652426+0000","last_active":"2024-09-14T12:44:36.652426+0000","last_peered":"2024-09-14T12:44:36.652426+0000","last_clean":"2024-09-14T12:44:36.652426+0000","last_became_active":"2024-09-14T10:49:27.388875+0000","last_became_peered":"2024-09-14T10:49:27.388875+0000","last_unstale":"2024-09-14T12:44:36.652426+0000","last_undegraded":"2024-09-14T12:44:36.652426+0000","last_fullsized":"2024-09-14T12:44:36.652426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:36.652132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:36.652132+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.652132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:24.964639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"267'1478","reported_seq":3859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.438518+0000","last_change":"2024-09-14T12:44:27.438518+0000","last_active":"2024-09-14T12:44:27.438518+0000","last_peered":"2024-09-14T12:44:27.438518+0000","last_clean":"2024-09-14T12:44:27.438518+0000","last_became_active":"2024-09-14T10:49:29.393295+0000","last_became_peered":"2024-09-14T10:49:29.393295+0000","last_unstale":"2024-09-14T12:44:27.438518+0000","last_undegraded":"2024-09-14T12:44:27.438518+0000","last_fullsized":"2024-09-14T12:44:27.438518+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1478","last_scrub_stamp":"2024-09-14T12:44:27.438310+0000","last_deep_scrub":"267'1478","last_deep_scrub_stamp":"2024-09-14T12:44:27.438310+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.438310+0000","objects_scrubbed":11,"log_size":78,"log_dups_size":1400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:41.883467+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157748,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2284,"num_read_kb":4194,"num_write":1394,"num_write_kb":1148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:47.538787+0000","last_change":"2024-09-14T12:44:47.538787+0000","last_active":"2024-09-14T12:44:47.538787+0000","last_peered":"2024-09-14T12:44:47.538787+0000","last_clean":"2024-09-14T12:44:47.538787+0000","last_became_active":"2024-09-14T10:49:31.432054+0000","last_became_peered":"2024-09-14T10:49:31.432054+0000","last_unstale":"2024-09-14T12:44:47.538787+0000","last_undegraded":"2024-09-14T12:44:47.538787+0000","last_fullsized":"2024-09-14T12:44:47.538787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:47.538595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:47.538595+0000","last_clean_scrub_stamp":"2024-09-14T12:44:47.538595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:32.517665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"267'84","reported_seq":617,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.896428+0000","last_change":"2024-09-14T12:44:44.896264+0000","last_active":"2024-09-14T12:44:44.896428+0000","last_peered":"2024-09-14T12:44:44.896428+0000","last_clean":"2024-09-14T12:44:44.896428+0000","last_became_active":"2024-09-14T10:49:33.466307+0000","last_became_peered":"2024-09-14T10:49:33.466307+0000","last_unstale":"2024-09-14T12:44:44.896428+0000","last_undegraded":"2024-09-14T12:44:44.896428+0000","last_fullsized":"2024-09-14T12:44:44.896428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'84","last_scrub_stamp":"2024-09-14T12:44:44.896073+0000","last_deep_scrub":"267'84","last_deep_scrub_stamp":"2024-09-14T12:44:44.896073+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.896073+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:38.231585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":197,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"267'931","reported_seq":2505,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.741494+0000","last_change":"2024-09-14T12:44:22.741494+0000","last_active":"2024-09-14T12:44:22.741494+0000","last_peered":"2024-09-14T12:44:22.741494+0000","last_clean":"2024-09-14T12:44:22.741494+0000","last_became_active":"2024-09-14T10:49:25.382937+0000","last_became_peered":"2024-09-14T10:49:25.382937+0000","last_unstale":"2024-09-14T12:44:22.741494+0000","last_undegraded":"2024-09-14T12:44:22.741494+0000","last_fullsized":"2024-09-14T12:44:22.741494+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'931","last_scrub_stamp":"2024-09-14T12:44:22.741320+0000","last_deep_scrub":"267'931","last_deep_scrub_stamp":"2024-09-14T12:44:22.741320+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.741320+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:45.020675+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":3892,"num_write":1285,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.618578+0000","last_change":"2024-09-14T12:44:13.618578+0000","last_active":"2024-09-14T12:44:13.618578+0000","last_peered":"2024-09-14T12:44:13.618578+0000","last_clean":"2024-09-14T12:44:13.618578+0000","last_became_active":"2024-09-14T10:49:07.019773+0000","last_became_peered":"2024-09-14T10:49:07.019773+0000","last_unstale":"2024-09-14T12:44:13.618578+0000","last_undegraded":"2024-09-14T12:44:13.618578+0000","last_fullsized":"2024-09-14T12:44:13.618578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:13.618399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:13.618399+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.618399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:36:10.021666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00084142400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"267'330","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.875989+0000","last_change":"2024-09-14T12:44:12.875989+0000","last_active":"2024-09-14T12:44:12.875989+0000","last_peered":"2024-09-14T12:44:12.875989+0000","last_clean":"2024-09-14T12:44:12.875989+0000","last_became_active":"2024-09-14T10:49:23.387885+0000","last_became_peered":"2024-09-14T10:49:23.387885+0000","last_unstale":"2024-09-14T12:44:12.875989+0000","last_undegraded":"2024-09-14T12:44:12.875989+0000","last_fullsized":"2024-09-14T12:44:12.875989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-14T12:44:12.875716+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-14T12:44:12.875716+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.875716+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:32.075745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":556,"num_read_kb":25294,"num_write":1061,"num_write_kb":31965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.456328+0000","last_change":"2024-09-14T12:44:25.456328+0000","last_active":"2024-09-14T12:44:25.456328+0000","last_peered":"2024-09-14T12:44:25.456328+0000","last_clean":"2024-09-14T12:44:25.456328+0000","last_became_active":"2024-09-14T10:49:27.384973+0000","last_became_peered":"2024-09-14T10:49:27.384973+0000","last_unstale":"2024-09-14T12:44:25.456328+0000","last_undegraded":"2024-09-14T12:44:25.456328+0000","last_fullsized":"2024-09-14T12:44:25.456328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:25.456147+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:25.456147+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.456147+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:48.132295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"267'424","reported_seq":2414,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.164324+0000","last_change":"2024-09-14T12:44:28.164324+0000","last_active":"2024-09-14T12:44:28.164324+0000","last_peered":"2024-09-14T12:44:28.164324+0000","last_clean":"2024-09-14T12:44:28.164324+0000","last_became_active":"2024-09-14T10:49:29.382485+0000","last_became_peered":"2024-09-14T10:49:29.382485+0000","last_unstale":"2024-09-14T12:44:28.164324+0000","last_undegraded":"2024-09-14T12:44:28.164324+0000","last_fullsized":"2024-09-14T12:44:28.164324+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'424","last_scrub_stamp":"2024-09-14T12:44:28.164109+0000","last_deep_scrub":"267'424","last_deep_scrub_stamp":"2024-09-14T12:44:28.164109+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.164109+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:10.149631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":384,"num_read_kb":370,"num_write":379,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:41.886273+0000","last_change":"2024-09-14T12:44:41.886273+0000","last_active":"2024-09-14T12:44:41.886273+0000","last_peered":"2024-09-14T12:44:41.886273+0000","last_clean":"2024-09-14T12:44:41.886273+0000","last_became_active":"2024-09-14T10:49:31.420121+0000","last_became_peered":"2024-09-14T10:49:31.420121+0000","last_unstale":"2024-09-14T12:44:41.886273+0000","last_undegraded":"2024-09-14T12:44:41.886273+0000","last_fullsized":"2024-09-14T12:44:41.886273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:41.886088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:41.886088+0000","last_clean_scrub_stamp":"2024-09-14T12:44:41.886088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:31.595427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"267'277","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.817045+0000","last_change":"2024-09-14T12:44:46.817045+0000","last_active":"2024-09-14T12:44:46.817045+0000","last_peered":"2024-09-14T12:44:46.817045+0000","last_clean":"2024-09-14T12:44:46.817045+0000","last_became_active":"2024-09-14T10:49:33.437564+0000","last_became_peered":"2024-09-14T10:49:33.437564+0000","last_unstale":"2024-09-14T12:44:46.817045+0000","last_undegraded":"2024-09-14T12:44:46.817045+0000","last_fullsized":"2024-09-14T12:44:46.817045+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-14T12:44:46.816863+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-14T12:44:46.816863+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.816863+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:37.693510+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":521,"num_write":600,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"267'364","reported_seq":1779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.762886+0000","last_change":"2024-09-14T12:44:21.762886+0000","last_active":"2024-09-14T12:44:21.762886+0000","last_peered":"2024-09-14T12:44:21.762886+0000","last_clean":"2024-09-14T12:44:21.762886+0000","last_became_active":"2024-09-14T10:49:25.377606+0000","last_became_peered":"2024-09-14T10:49:25.377606+0000","last_unstale":"2024-09-14T12:44:21.762886+0000","last_undegraded":"2024-09-14T12:44:21.762886+0000","last_fullsized":"2024-09-14T12:44:21.762886+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-14T12:44:21.762699+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-14T12:44:21.762699+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.762699+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:46.620062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2088,"num_read_kb":1981,"num_write":424,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.689647+0000","last_change":"2024-09-14T12:44:12.689647+0000","last_active":"2024-09-14T12:44:12.689647+0000","last_peered":"2024-09-14T12:44:12.689647+0000","last_clean":"2024-09-14T12:44:12.689647+0000","last_became_active":"2024-09-14T10:49:07.318211+0000","last_became_peered":"2024-09-14T10:49:07.318211+0000","last_unstale":"2024-09-14T12:44:12.689647+0000","last_undegraded":"2024-09-14T12:44:12.689647+0000","last_fullsized":"2024-09-14T12:44:12.689647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T12:44:12.689558+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T12:44:12.689558+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.689558+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:00.729814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001447942,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"267'374","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.159271+0000","last_change":"2024-09-14T12:44:22.159271+0000","last_active":"2024-09-14T12:44:22.159271+0000","last_peered":"2024-09-14T12:44:22.159271+0000","last_clean":"2024-09-14T12:44:22.159271+0000","last_became_active":"2024-09-14T10:49:23.365016+0000","last_became_peered":"2024-09-14T10:49:23.365016+0000","last_unstale":"2024-09-14T12:44:22.159271+0000","last_undegraded":"2024-09-14T12:44:22.159271+0000","last_fullsized":"2024-09-14T12:44:22.159271+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:22.158986+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:22.158986+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.158986+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:14.641518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":666,"num_read_kb":160044,"num_write":1139,"num_write_kb":62525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.529218+0000","last_change":"2024-09-14T12:44:20.528981+0000","last_active":"2024-09-14T12:44:20.529218+0000","last_peered":"2024-09-14T12:44:20.529218+0000","last_clean":"2024-09-14T12:44:20.529218+0000","last_became_active":"2024-09-14T10:49:27.373998+0000","last_became_peered":"2024-09-14T10:49:27.373998+0000","last_unstale":"2024-09-14T12:44:20.529218+0000","last_undegraded":"2024-09-14T12:44:20.529218+0000","last_fullsized":"2024-09-14T12:44:20.529218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:20.528772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:20.528772+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.528772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:55.424574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"267'236","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.034718+0000","last_change":"2024-09-14T12:44:35.034718+0000","last_active":"2024-09-14T12:44:35.034718+0000","last_peered":"2024-09-14T12:44:35.034718+0000","last_clean":"2024-09-14T12:44:35.034718+0000","last_became_active":"2024-09-14T10:49:29.391056+0000","last_became_peered":"2024-09-14T10:49:29.391056+0000","last_unstale":"2024-09-14T12:44:35.034718+0000","last_undegraded":"2024-09-14T12:44:35.034718+0000","last_fullsized":"2024-09-14T12:44:35.034718+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'236","last_scrub_stamp":"2024-09-14T12:44:35.034505+0000","last_deep_scrub":"267'236","last_deep_scrub_stamp":"2024-09-14T12:44:35.034505+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.034505+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.096986+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":287,"num_read_kb":274,"num_write":212,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.542408+0000","last_change":"2024-09-14T12:44:49.542408+0000","last_active":"2024-09-14T12:44:49.542408+0000","last_peered":"2024-09-14T12:44:49.542408+0000","last_clean":"2024-09-14T12:44:49.542408+0000","last_became_active":"2024-09-14T10:49:31.424769+0000","last_became_peered":"2024-09-14T10:49:31.424769+0000","last_unstale":"2024-09-14T12:44:49.542408+0000","last_undegraded":"2024-09-14T12:44:49.542408+0000","last_fullsized":"2024-09-14T12:44:49.542408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:49.542233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:49.542233+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.542233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:20.418046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"267'129","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.938139+0000","last_change":"2024-09-14T12:44:36.938139+0000","last_active":"2024-09-14T12:44:36.938139+0000","last_peered":"2024-09-14T12:44:36.938139+0000","last_clean":"2024-09-14T12:44:36.938139+0000","last_became_active":"2024-09-14T10:49:33.468553+0000","last_became_peered":"2024-09-14T10:49:33.468553+0000","last_unstale":"2024-09-14T12:44:36.938139+0000","last_undegraded":"2024-09-14T12:44:36.938139+0000","last_fullsized":"2024-09-14T12:44:36.938139+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T12:44:36.937964+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T12:44:36.937964+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.937964+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:36.638436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":228,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"267'559","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.750875+0000","last_change":"2024-09-14T12:44:18.750875+0000","last_active":"2024-09-14T12:44:18.750875+0000","last_peered":"2024-09-14T12:44:18.750875+0000","last_clean":"2024-09-14T12:44:18.750875+0000","last_became_active":"2024-09-14T10:49:25.379137+0000","last_became_peered":"2024-09-14T10:49:25.379137+0000","last_unstale":"2024-09-14T12:44:18.750875+0000","last_undegraded":"2024-09-14T12:44:18.750875+0000","last_fullsized":"2024-09-14T12:44:18.750875+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'559","last_scrub_stamp":"2024-09-14T12:44:18.750687+0000","last_deep_scrub":"267'559","last_deep_scrub_stamp":"2024-09-14T12:44:18.750687+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.750687+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:29.411317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2924,"num_read_kb":2647,"num_write":735,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"267'367","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:09.850994+0000","last_change":"2024-09-14T12:44:09.850920+0000","last_active":"2024-09-14T12:44:09.850994+0000","last_peered":"2024-09-14T12:44:09.850994+0000","last_clean":"2024-09-14T12:44:09.850994+0000","last_became_active":"2024-09-14T10:49:23.389195+0000","last_became_peered":"2024-09-14T10:49:23.389195+0000","last_unstale":"2024-09-14T12:44:09.850994+0000","last_undegraded":"2024-09-14T12:44:09.850994+0000","last_fullsized":"2024-09-14T12:44:09.850994+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'367","last_scrub_stamp":"2024-09-14T12:44:09.850762+0000","last_deep_scrub":"267'367","last_deep_scrub_stamp":"2024-09-14T12:44:09.850762+0000","last_clean_scrub_stamp":"2024-09-14T12:44:09.850762+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:37.171130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1984745,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":650,"num_read_kb":23846,"num_write":1157,"num_write_kb":31374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.835515+0000","last_change":"2024-09-14T12:44:11.835515+0000","last_active":"2024-09-14T12:44:11.835515+0000","last_peered":"2024-09-14T12:44:11.835515+0000","last_clean":"2024-09-14T12:44:11.835515+0000","last_became_active":"2024-09-14T10:49:07.305045+0000","last_became_peered":"2024-09-14T10:49:07.305045+0000","last_unstale":"2024-09-14T12:44:11.835515+0000","last_undegraded":"2024-09-14T12:44:11.835515+0000","last_fullsized":"2024-09-14T12:44:11.835515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:11.835327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:11.835327+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.835327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:41.708593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094164300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.895413+0000","last_change":"2024-09-14T12:44:28.895413+0000","last_active":"2024-09-14T12:44:28.895413+0000","last_peered":"2024-09-14T12:44:28.895413+0000","last_clean":"2024-09-14T12:44:28.895413+0000","last_became_active":"2024-09-14T10:49:27.368412+0000","last_became_peered":"2024-09-14T10:49:27.368412+0000","last_unstale":"2024-09-14T12:44:28.895413+0000","last_undegraded":"2024-09-14T12:44:28.895413+0000","last_fullsized":"2024-09-14T12:44:28.895413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.895241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.895241+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.895241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.614078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"267'762","reported_seq":1508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.440351+0000","last_change":"2024-09-14T12:44:26.440351+0000","last_active":"2024-09-14T12:44:26.440351+0000","last_peered":"2024-09-14T12:44:26.440351+0000","last_clean":"2024-09-14T12:44:26.440351+0000","last_became_active":"2024-09-14T10:49:29.383270+0000","last_became_peered":"2024-09-14T10:49:29.383270+0000","last_unstale":"2024-09-14T12:44:26.440351+0000","last_undegraded":"2024-09-14T12:44:26.440351+0000","last_fullsized":"2024-09-14T12:44:26.440351+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'762","last_scrub_stamp":"2024-09-14T12:44:26.440152+0000","last_deep_scrub":"267'762","last_deep_scrub_stamp":"2024-09-14T12:44:26.440152+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.440152+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:57.264773+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99398,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2001,"num_read_kb":3265,"num_write":2692,"num_write_kb":2452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537558,"num_omap_keys":1218,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.999286+0000","last_change":"2024-09-14T12:44:30.999286+0000","last_active":"2024-09-14T12:44:30.999286+0000","last_peered":"2024-09-14T12:44:30.999286+0000","last_clean":"2024-09-14T12:44:30.999286+0000","last_became_active":"2024-09-14T10:49:31.418385+0000","last_became_peered":"2024-09-14T10:49:31.418385+0000","last_unstale":"2024-09-14T12:44:30.999286+0000","last_undegraded":"2024-09-14T12:44:30.999286+0000","last_fullsized":"2024-09-14T12:44:30.999286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.999105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.999105+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.999105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:54.918874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"267'134","reported_seq":675,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:46.869306+0000","last_change":"2024-09-14T12:44:46.869306+0000","last_active":"2024-09-14T12:44:46.869306+0000","last_peered":"2024-09-14T12:44:46.869306+0000","last_clean":"2024-09-14T12:44:46.869306+0000","last_became_active":"2024-09-14T10:49:33.467268+0000","last_became_peered":"2024-09-14T10:49:33.467268+0000","last_unstale":"2024-09-14T12:44:46.869306+0000","last_undegraded":"2024-09-14T12:44:46.869306+0000","last_fullsized":"2024-09-14T12:44:46.869306+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T12:44:46.869091+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T12:44:46.869091+0000","last_clean_scrub_stamp":"2024-09-14T12:44:46.869091+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:37.701120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":137,"num_write":301,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"267'747","reported_seq":2299,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.794948+0000","last_change":"2024-09-14T12:44:20.794948+0000","last_active":"2024-09-14T12:44:20.794948+0000","last_peered":"2024-09-14T12:44:20.794948+0000","last_clean":"2024-09-14T12:44:20.794948+0000","last_became_active":"2024-09-14T10:49:25.377460+0000","last_became_peered":"2024-09-14T10:49:25.377460+0000","last_unstale":"2024-09-14T12:44:20.794948+0000","last_undegraded":"2024-09-14T12:44:20.794948+0000","last_fullsized":"2024-09-14T12:44:20.794948+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'747","last_scrub_stamp":"2024-09-14T12:44:20.794733+0000","last_deep_scrub":"267'747","last_deep_scrub_stamp":"2024-09-14T12:44:20.794733+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.794733+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:04.985527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3587,"num_read_kb":3249,"num_write":953,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"267'349","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.684281+0000","last_change":"2024-09-14T12:44:14.684281+0000","last_active":"2024-09-14T12:44:14.684281+0000","last_peered":"2024-09-14T12:44:14.684281+0000","last_clean":"2024-09-14T12:44:14.684281+0000","last_became_active":"2024-09-14T10:49:23.383686+0000","last_became_peered":"2024-09-14T10:49:23.383686+0000","last_unstale":"2024-09-14T12:44:14.684281+0000","last_undegraded":"2024-09-14T12:44:14.684281+0000","last_fullsized":"2024-09-14T12:44:14.684281+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-14T12:44:14.683982+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-14T12:44:14.683982+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.683982+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:25.301976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":8945,"num_write":1082,"num_write_kb":53511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.707852+0000","last_change":"2024-09-14T12:44:13.707852+0000","last_active":"2024-09-14T12:44:13.707852+0000","last_peered":"2024-09-14T12:44:13.707852+0000","last_clean":"2024-09-14T12:44:13.707852+0000","last_became_active":"2024-09-14T10:49:07.035327+0000","last_became_peered":"2024-09-14T10:49:07.035327+0000","last_unstale":"2024-09-14T12:44:13.707852+0000","last_undegraded":"2024-09-14T12:44:13.707852+0000","last_fullsized":"2024-09-14T12:44:13.707852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:13.707645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:13.707645+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.707645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:41.725258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001830239,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.137911+0000","last_change":"2024-09-14T12:44:26.137911+0000","last_active":"2024-09-14T12:44:26.137911+0000","last_peered":"2024-09-14T12:44:26.137911+0000","last_clean":"2024-09-14T12:44:26.137911+0000","last_became_active":"2024-09-14T10:49:27.373801+0000","last_became_peered":"2024-09-14T10:49:27.373801+0000","last_unstale":"2024-09-14T12:44:26.137911+0000","last_undegraded":"2024-09-14T12:44:26.137911+0000","last_fullsized":"2024-09-14T12:44:26.137911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:26.137730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:26.137730+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.137730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:24.785770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"267'254","reported_seq":900,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.791267+0000","last_change":"2024-09-14T12:44:30.791267+0000","last_active":"2024-09-14T12:44:30.791267+0000","last_peered":"2024-09-14T12:44:30.791267+0000","last_clean":"2024-09-14T12:44:30.791267+0000","last_became_active":"2024-09-14T10:49:29.387176+0000","last_became_peered":"2024-09-14T10:49:29.387176+0000","last_unstale":"2024-09-14T12:44:30.791267+0000","last_undegraded":"2024-09-14T12:44:30.791267+0000","last_fullsized":"2024-09-14T12:44:30.791267+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'254","last_scrub_stamp":"2024-09-14T12:44:30.791067+0000","last_deep_scrub":"267'254","last_deep_scrub_stamp":"2024-09-14T12:44:30.791067+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.791067+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:09.347252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":340,"num_read_kb":333,"num_write":224,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"267'796","reported_seq":3344,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.949405+0000","last_change":"2024-09-14T12:44:33.949405+0000","last_active":"2024-09-14T12:44:33.949405+0000","last_peered":"2024-09-14T12:44:33.949405+0000","last_clean":"2024-09-14T12:44:33.949405+0000","last_became_active":"2024-09-14T10:49:31.417376+0000","last_became_peered":"2024-09-14T10:49:31.417376+0000","last_unstale":"2024-09-14T12:44:33.949405+0000","last_undegraded":"2024-09-14T12:44:33.949405+0000","last_fullsized":"2024-09-14T12:44:33.949405+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'796","last_scrub_stamp":"2024-09-14T12:44:33.949129+0000","last_deep_scrub":"267'796","last_deep_scrub_stamp":"2024-09-14T12:44:33.949129+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.949129+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:26.181427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"267'151","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:37.423786+0000","last_change":"2024-09-14T12:44:37.423620+0000","last_active":"2024-09-14T12:44:37.423786+0000","last_peered":"2024-09-14T12:44:37.423786+0000","last_clean":"2024-09-14T12:44:37.423786+0000","last_became_active":"2024-09-14T10:49:33.459122+0000","last_became_peered":"2024-09-14T10:49:33.459122+0000","last_unstale":"2024-09-14T12:44:37.423786+0000","last_undegraded":"2024-09-14T12:44:37.423786+0000","last_fullsized":"2024-09-14T12:44:37.423786+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-14T12:44:37.423425+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-14T12:44:37.423425+0000","last_clean_scrub_stamp":"2024-09-14T12:44:37.423425+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:06.374161+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":355,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"267'840","reported_seq":2556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.829846+0000","last_change":"2024-09-14T12:44:18.829846+0000","last_active":"2024-09-14T12:44:18.829846+0000","last_peered":"2024-09-14T12:44:18.829846+0000","last_clean":"2024-09-14T12:44:18.829846+0000","last_became_active":"2024-09-14T10:49:25.360655+0000","last_became_peered":"2024-09-14T10:49:25.360655+0000","last_unstale":"2024-09-14T12:44:18.829846+0000","last_undegraded":"2024-09-14T12:44:18.829846+0000","last_fullsized":"2024-09-14T12:44:18.829846+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'840","last_scrub_stamp":"2024-09-14T12:44:18.829679+0000","last_deep_scrub":"267'840","last_deep_scrub_stamp":"2024-09-14T12:44:18.829679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.829679+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:29.657903+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4101,"num_read_kb":3716,"num_write":1090,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2812,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"267'464","reported_seq":1180,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.768697+0000","last_change":"2024-09-14T12:44:13.768407+0000","last_active":"2024-09-14T12:44:13.768697+0000","last_peered":"2024-09-14T12:44:13.768697+0000","last_clean":"2024-09-14T12:44:13.768697+0000","last_became_active":"2024-09-14T10:49:23.359442+0000","last_became_peered":"2024-09-14T10:49:23.359442+0000","last_unstale":"2024-09-14T12:44:13.768697+0000","last_undegraded":"2024-09-14T12:44:13.768697+0000","last_fullsized":"2024-09-14T12:44:13.768697+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'464","last_scrub_stamp":"2024-09-14T12:44:13.768049+0000","last_deep_scrub":"267'464","last_deep_scrub_stamp":"2024-09-14T12:44:13.768049+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.768049+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:42.033691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":830,"num_read_kb":31084,"num_write":1362,"num_write_kb":31792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.756536+0000","last_change":"2024-09-14T12:44:11.756536+0000","last_active":"2024-09-14T12:44:11.756536+0000","last_peered":"2024-09-14T12:44:11.756536+0000","last_clean":"2024-09-14T12:44:11.756536+0000","last_became_active":"2024-09-14T10:49:07.011756+0000","last_became_peered":"2024-09-14T10:49:07.011756+0000","last_unstale":"2024-09-14T12:44:11.756536+0000","last_undegraded":"2024-09-14T12:44:11.756536+0000","last_fullsized":"2024-09-14T12:44:11.756536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:11.756350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:11.756350+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.756350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:46.988869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011766579999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.633161+0000","last_change":"2024-09-14T12:44:38.633161+0000","last_active":"2024-09-14T12:44:38.633161+0000","last_peered":"2024-09-14T12:44:38.633161+0000","last_clean":"2024-09-14T12:44:38.633161+0000","last_became_active":"2024-09-14T10:49:27.384635+0000","last_became_peered":"2024-09-14T10:49:27.384635+0000","last_unstale":"2024-09-14T12:44:38.633161+0000","last_undegraded":"2024-09-14T12:44:38.633161+0000","last_fullsized":"2024-09-14T12:44:38.633161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:38.632938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:38.632938+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.632938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:11.086517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"267'184","reported_seq":791,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:42.632514+0000","last_change":"2024-09-14T12:44:42.632514+0000","last_active":"2024-09-14T12:44:42.632514+0000","last_peered":"2024-09-14T12:44:42.632514+0000","last_clean":"2024-09-14T12:44:42.632514+0000","last_became_active":"2024-09-14T10:49:29.394105+0000","last_became_peered":"2024-09-14T10:49:29.394105+0000","last_unstale":"2024-09-14T12:44:42.632514+0000","last_undegraded":"2024-09-14T12:44:42.632514+0000","last_fullsized":"2024-09-14T12:44:42.632514+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-14T12:44:42.632311+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-14T12:44:42.632311+0000","last_clean_scrub_stamp":"2024-09-14T12:44:42.632311+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:01.232345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":148,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"267'830","reported_seq":3154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.999557+0000","last_change":"2024-09-14T12:44:35.999557+0000","last_active":"2024-09-14T12:44:35.999557+0000","last_peered":"2024-09-14T12:44:35.999557+0000","last_clean":"2024-09-14T12:44:35.999557+0000","last_became_active":"2024-09-14T10:49:31.411055+0000","last_became_peered":"2024-09-14T10:49:31.411055+0000","last_unstale":"2024-09-14T12:44:35.999557+0000","last_undegraded":"2024-09-14T12:44:35.999557+0000","last_fullsized":"2024-09-14T12:44:35.999557+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'830","last_scrub_stamp":"2024-09-14T12:44:35.999262+0000","last_deep_scrub":"267'830","last_deep_scrub_stamp":"2024-09-14T12:44:35.999262+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.999262+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:37.589153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"267'273","reported_seq":827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.881708+0000","last_change":"2024-09-14T12:44:45.881708+0000","last_active":"2024-09-14T12:44:45.881708+0000","last_peered":"2024-09-14T12:44:45.881708+0000","last_clean":"2024-09-14T12:44:45.881708+0000","last_became_active":"2024-09-14T10:49:33.456806+0000","last_became_peered":"2024-09-14T10:49:33.456806+0000","last_unstale":"2024-09-14T12:44:45.881708+0000","last_undegraded":"2024-09-14T12:44:45.881708+0000","last_fullsized":"2024-09-14T12:44:45.881708+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-09-14T12:44:45.881495+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-09-14T12:44:45.881495+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.881495+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:15.185394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":331,"num_read_kb":330,"num_write":580,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"267'504","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.868409+0000","last_change":"2024-09-14T12:44:17.868409+0000","last_active":"2024-09-14T12:44:17.868409+0000","last_peered":"2024-09-14T12:44:17.868409+0000","last_clean":"2024-09-14T12:44:17.868409+0000","last_became_active":"2024-09-14T10:49:25.372923+0000","last_became_peered":"2024-09-14T10:49:25.372923+0000","last_unstale":"2024-09-14T12:44:17.868409+0000","last_undegraded":"2024-09-14T12:44:17.868409+0000","last_fullsized":"2024-09-14T12:44:17.868409+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'504","last_scrub_stamp":"2024-09-14T12:44:17.868183+0000","last_deep_scrub":"267'504","last_deep_scrub_stamp":"2024-09-14T12:44:17.868183+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.868183+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:43:56.368622+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2643,"num_read_kb":2487,"num_write":591,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"267'357","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.806944+0000","last_change":"2024-09-14T12:44:15.806944+0000","last_active":"2024-09-14T12:44:15.806944+0000","last_peered":"2024-09-14T12:44:15.806944+0000","last_clean":"2024-09-14T12:44:15.806944+0000","last_became_active":"2024-09-14T10:49:23.344863+0000","last_became_peered":"2024-09-14T10:49:23.344863+0000","last_unstale":"2024-09-14T12:44:15.806944+0000","last_undegraded":"2024-09-14T12:44:15.806944+0000","last_fullsized":"2024-09-14T12:44:15.806944+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-14T12:44:15.806628+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-14T12:44:15.806628+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.806628+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:08.490411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":561,"num_read_kb":37228,"num_write":1084,"num_write_kb":50459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.734938+0000","last_change":"2024-09-14T12:44:15.734938+0000","last_active":"2024-09-14T12:44:15.734938+0000","last_peered":"2024-09-14T12:44:15.734938+0000","last_clean":"2024-09-14T12:44:15.734938+0000","last_became_active":"2024-09-14T10:49:07.031274+0000","last_became_peered":"2024-09-14T10:49:07.031274+0000","last_unstale":"2024-09-14T12:44:15.734938+0000","last_undegraded":"2024-09-14T12:44:15.734938+0000","last_fullsized":"2024-09-14T12:44:15.734938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:15.734744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:15.734744+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.734744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:19.978999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002392248,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.862888+0000","last_change":"2024-09-14T12:44:27.862888+0000","last_active":"2024-09-14T12:44:27.862888+0000","last_peered":"2024-09-14T12:44:27.862888+0000","last_clean":"2024-09-14T12:44:27.862888+0000","last_became_active":"2024-09-14T10:49:27.379820+0000","last_became_peered":"2024-09-14T10:49:27.379820+0000","last_unstale":"2024-09-14T12:44:27.862888+0000","last_undegraded":"2024-09-14T12:44:27.862888+0000","last_fullsized":"2024-09-14T12:44:27.862888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.862707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.862707+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.862707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:05.909921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"267'854","reported_seq":1658,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.125584+0000","last_change":"2024-09-14T12:44:30.125584+0000","last_active":"2024-09-14T12:44:30.125584+0000","last_peered":"2024-09-14T12:44:30.125584+0000","last_clean":"2024-09-14T12:44:30.125584+0000","last_became_active":"2024-09-14T10:49:29.389500+0000","last_became_peered":"2024-09-14T10:49:29.389500+0000","last_unstale":"2024-09-14T12:44:30.125584+0000","last_undegraded":"2024-09-14T12:44:30.125584+0000","last_fullsized":"2024-09-14T12:44:30.125584+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'854","last_scrub_stamp":"2024-09-14T12:44:30.125277+0000","last_deep_scrub":"267'854","last_deep_scrub_stamp":"2024-09-14T12:44:30.125277+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.125277+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:14.671455+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155794,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1507,"num_read_kb":3507,"num_write":1226,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.849089+0000","last_change":"2024-09-14T12:44:40.849089+0000","last_active":"2024-09-14T12:44:40.849089+0000","last_peered":"2024-09-14T12:44:40.849089+0000","last_clean":"2024-09-14T12:44:40.849089+0000","last_became_active":"2024-09-14T10:49:31.413008+0000","last_became_peered":"2024-09-14T10:49:31.413008+0000","last_unstale":"2024-09-14T12:44:40.849089+0000","last_undegraded":"2024-09-14T12:44:40.849089+0000","last_fullsized":"2024-09-14T12:44:40.849089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:40.848905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:40.848905+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.848905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:56.723688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"267'121","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.032543+0000","last_change":"2024-09-14T12:44:36.032543+0000","last_active":"2024-09-14T12:44:36.032543+0000","last_peered":"2024-09-14T12:44:36.032543+0000","last_clean":"2024-09-14T12:44:36.032543+0000","last_became_active":"2024-09-14T10:49:33.468546+0000","last_became_peered":"2024-09-14T10:49:33.468546+0000","last_unstale":"2024-09-14T12:44:36.032543+0000","last_undegraded":"2024-09-14T12:44:36.032543+0000","last_fullsized":"2024-09-14T12:44:36.032543+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'121","last_scrub_stamp":"2024-09-14T12:44:36.032367+0000","last_deep_scrub":"267'121","last_deep_scrub_stamp":"2024-09-14T12:44:36.032367+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.032367+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:18.041019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":277,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"267'162","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.862334+0000","last_change":"2024-09-14T12:44:45.862334+0000","last_active":"2024-09-14T12:44:45.862334+0000","last_peered":"2024-09-14T12:44:45.862334+0000","last_clean":"2024-09-14T12:44:45.862334+0000","last_became_active":"2024-09-14T10:49:33.461782+0000","last_became_peered":"2024-09-14T10:49:33.461782+0000","last_unstale":"2024-09-14T12:44:45.862334+0000","last_undegraded":"2024-09-14T12:44:45.862334+0000","last_fullsized":"2024-09-14T12:44:45.862334+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'162","last_scrub_stamp":"2024-09-14T12:44:45.862144+0000","last_deep_scrub":"267'162","last_deep_scrub_stamp":"2024-09-14T12:44:45.862144+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.862144+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:42.062797+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":264,"num_write":397,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"267'522","reported_seq":2256,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.824159+0000","last_change":"2024-09-14T12:44:18.824159+0000","last_active":"2024-09-14T12:44:18.824159+0000","last_peered":"2024-09-14T12:44:18.824159+0000","last_clean":"2024-09-14T12:44:18.824159+0000","last_became_active":"2024-09-14T10:49:25.381653+0000","last_became_peered":"2024-09-14T10:49:25.381653+0000","last_unstale":"2024-09-14T12:44:18.824159+0000","last_undegraded":"2024-09-14T12:44:18.824159+0000","last_fullsized":"2024-09-14T12:44:18.824159+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'522","last_scrub_stamp":"2024-09-14T12:44:18.823867+0000","last_deep_scrub":"267'522","last_deep_scrub_stamp":"2024-09-14T12:44:18.823867+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.823867+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:50.458414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2737,"num_read_kb":2577,"num_write":621,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"267'379","reported_seq":1168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.737083+0000","last_change":"2024-09-14T12:44:19.737083+0000","last_active":"2024-09-14T12:44:19.737083+0000","last_peered":"2024-09-14T12:44:19.737083+0000","last_clean":"2024-09-14T12:44:19.737083+0000","last_became_active":"2024-09-14T10:49:23.365341+0000","last_became_peered":"2024-09-14T10:49:23.365341+0000","last_unstale":"2024-09-14T12:44:19.737083+0000","last_undegraded":"2024-09-14T12:44:19.737083+0000","last_fullsized":"2024-09-14T12:44:19.737083+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'379","last_scrub_stamp":"2024-09-14T12:44:19.736779+0000","last_deep_scrub":"267'379","last_deep_scrub_stamp":"2024-09-14T12:44:19.736779+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.736779+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:24.797053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":685,"num_read_kb":37659,"num_write":1131,"num_write_kb":33846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.822470+0000","last_change":"2024-09-14T12:44:28.822470+0000","last_active":"2024-09-14T12:44:28.822470+0000","last_peered":"2024-09-14T12:44:28.822470+0000","last_clean":"2024-09-14T12:44:28.822470+0000","last_became_active":"2024-09-14T10:49:27.366990+0000","last_became_peered":"2024-09-14T10:49:27.366990+0000","last_unstale":"2024-09-14T12:44:28.822470+0000","last_undegraded":"2024-09-14T12:44:28.822470+0000","last_fullsized":"2024-09-14T12:44:28.822470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.822277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.822277+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.822277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:55.142780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"267'339","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.817196+0000","last_change":"2024-09-14T12:44:32.817196+0000","last_active":"2024-09-14T12:44:32.817196+0000","last_peered":"2024-09-14T12:44:32.817196+0000","last_clean":"2024-09-14T12:44:32.817196+0000","last_became_active":"2024-09-14T10:49:29.371655+0000","last_became_peered":"2024-09-14T10:49:29.371655+0000","last_unstale":"2024-09-14T12:44:32.817196+0000","last_undegraded":"2024-09-14T12:44:32.817196+0000","last_fullsized":"2024-09-14T12:44:32.817196+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'339","last_scrub_stamp":"2024-09-14T12:44:32.816993+0000","last_deep_scrub":"267'339","last_deep_scrub_stamp":"2024-09-14T12:44:32.816993+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.816993+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:27.300458+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49045,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":556,"num_read_kb":1185,"num_write":440,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:30.445889+0000","last_change":"2024-09-14T12:44:30.445889+0000","last_active":"2024-09-14T12:44:30.445889+0000","last_peered":"2024-09-14T12:44:30.445889+0000","last_clean":"2024-09-14T12:44:30.445889+0000","last_became_active":"2024-09-14T10:49:31.417675+0000","last_became_peered":"2024-09-14T10:49:31.417675+0000","last_unstale":"2024-09-14T12:44:30.445889+0000","last_undegraded":"2024-09-14T12:44:30.445889+0000","last_fullsized":"2024-09-14T12:44:30.445889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:30.445715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:30.445715+0000","last_clean_scrub_stamp":"2024-09-14T12:44:30.445715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:06.472746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"267'147","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.442177+0000","last_change":"2024-09-14T12:44:36.442177+0000","last_active":"2024-09-14T12:44:36.442177+0000","last_peered":"2024-09-14T12:44:36.442177+0000","last_clean":"2024-09-14T12:44:36.442177+0000","last_became_active":"2024-09-14T10:49:33.453630+0000","last_became_peered":"2024-09-14T10:49:33.453630+0000","last_unstale":"2024-09-14T12:44:36.442177+0000","last_undegraded":"2024-09-14T12:44:36.442177+0000","last_fullsized":"2024-09-14T12:44:36.442177+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-14T12:44:36.441978+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-14T12:44:36.441978+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.441978+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:04.829195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":134,"num_write":363,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"267'723","reported_seq":2170,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.861931+0000","last_change":"2024-09-14T12:44:20.861931+0000","last_active":"2024-09-14T12:44:20.861931+0000","last_peered":"2024-09-14T12:44:20.861931+0000","last_clean":"2024-09-14T12:44:20.861931+0000","last_became_active":"2024-09-14T10:49:25.373876+0000","last_became_peered":"2024-09-14T10:49:25.373876+0000","last_unstale":"2024-09-14T12:44:20.861931+0000","last_undegraded":"2024-09-14T12:44:20.861931+0000","last_fullsized":"2024-09-14T12:44:20.861931+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'723","last_scrub_stamp":"2024-09-14T12:44:20.861737+0000","last_deep_scrub":"267'723","last_deep_scrub_stamp":"2024-09-14T12:44:20.861737+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.861737+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.715221+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3462,"num_read_kb":3124,"num_write":967,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"267'350","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:10.354284+0000","last_change":"2024-09-14T12:44:10.354231+0000","last_active":"2024-09-14T12:44:10.354284+0000","last_peered":"2024-09-14T12:44:10.354284+0000","last_clean":"2024-09-14T12:44:10.354284+0000","last_became_active":"2024-09-14T10:49:23.373206+0000","last_became_peered":"2024-09-14T10:49:23.373206+0000","last_unstale":"2024-09-14T12:44:10.354284+0000","last_undegraded":"2024-09-14T12:44:10.354284+0000","last_fullsized":"2024-09-14T12:44:10.354284+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-14T12:44:10.354149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:10.354149+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:26.010856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":656,"num_read_kb":34264,"num_write":1064,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:29.921353+0000","last_change":"2024-09-14T12:44:29.921353+0000","last_active":"2024-09-14T12:44:29.921353+0000","last_peered":"2024-09-14T12:44:29.921353+0000","last_clean":"2024-09-14T12:44:29.921353+0000","last_became_active":"2024-09-14T10:49:27.370174+0000","last_became_peered":"2024-09-14T10:49:27.370174+0000","last_unstale":"2024-09-14T12:44:29.921353+0000","last_undegraded":"2024-09-14T12:44:29.921353+0000","last_fullsized":"2024-09-14T12:44:29.921353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:29.921175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:29.921175+0000","last_clean_scrub_stamp":"2024-09-14T12:44:29.921175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:42.172813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"267'81","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:36.990154+0000","last_change":"2024-09-14T12:44:36.990154+0000","last_active":"2024-09-14T12:44:36.990154+0000","last_peered":"2024-09-14T12:44:36.990154+0000","last_clean":"2024-09-14T12:44:36.990154+0000","last_became_active":"2024-09-14T10:49:29.375761+0000","last_became_peered":"2024-09-14T10:49:29.375761+0000","last_unstale":"2024-09-14T12:44:36.990154+0000","last_undegraded":"2024-09-14T12:44:36.990154+0000","last_fullsized":"2024-09-14T12:44:36.990154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-14T12:44:36.989961+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-14T12:44:36.989961+0000","last_clean_scrub_stamp":"2024-09-14T12:44:36.989961+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:30.155450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.044701+0000","last_change":"2024-09-14T12:44:32.044701+0000","last_active":"2024-09-14T12:44:32.044701+0000","last_peered":"2024-09-14T12:44:32.044701+0000","last_clean":"2024-09-14T12:44:32.044701+0000","last_became_active":"2024-09-14T10:49:31.410915+0000","last_became_peered":"2024-09-14T10:49:31.410915+0000","last_unstale":"2024-09-14T12:44:32.044701+0000","last_undegraded":"2024-09-14T12:44:32.044701+0000","last_fullsized":"2024-09-14T12:44:32.044701+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.044515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.044515+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.044515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:08.562387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"267'183","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:40.890645+0000","last_change":"2024-09-14T12:44:40.890645+0000","last_active":"2024-09-14T12:44:40.890645+0000","last_peered":"2024-09-14T12:44:40.890645+0000","last_clean":"2024-09-14T12:44:40.890645+0000","last_became_active":"2024-09-14T10:49:33.453278+0000","last_became_peered":"2024-09-14T10:49:33.453278+0000","last_unstale":"2024-09-14T12:44:40.890645+0000","last_undegraded":"2024-09-14T12:44:40.890645+0000","last_fullsized":"2024-09-14T12:44:40.890645+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-14T12:44:40.890463+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-14T12:44:40.890463+0000","last_clean_scrub_stamp":"2024-09-14T12:44:40.890463+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.946061+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":596,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":273,"num_read_kb":265,"num_write":381,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"267'434","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.823436+0000","last_change":"2024-09-14T12:44:19.823436+0000","last_active":"2024-09-14T12:44:19.823436+0000","last_peered":"2024-09-14T12:44:19.823436+0000","last_clean":"2024-09-14T12:44:19.823436+0000","last_became_active":"2024-09-14T10:49:25.353010+0000","last_became_peered":"2024-09-14T10:49:25.353010+0000","last_unstale":"2024-09-14T12:44:19.823436+0000","last_undegraded":"2024-09-14T12:44:19.823436+0000","last_fullsized":"2024-09-14T12:44:19.823436+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T12:44:19.823256+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T12:44:19.823256+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.823256+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:53.762038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2606,"num_read_kb":2470,"num_write":495,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2789,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"267'374","reported_seq":1102,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.874507+0000","last_change":"2024-09-14T12:44:12.874359+0000","last_active":"2024-09-14T12:44:12.874507+0000","last_peered":"2024-09-14T12:44:12.874507+0000","last_clean":"2024-09-14T12:44:12.874507+0000","last_became_active":"2024-09-14T10:49:23.403718+0000","last_became_peered":"2024-09-14T10:49:23.403718+0000","last_unstale":"2024-09-14T12:44:12.874507+0000","last_undegraded":"2024-09-14T12:44:12.874507+0000","last_fullsized":"2024-09-14T12:44:12.874507+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'374","last_scrub_stamp":"2024-09-14T12:44:12.874166+0000","last_deep_scrub":"267'374","last_deep_scrub_stamp":"2024-09-14T12:44:12.874166+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.874166+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:13.218268+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":743,"num_read_kb":4167,"num_write":1078,"num_write_kb":34340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.937501+0000","last_change":"2024-09-14T12:44:25.937501+0000","last_active":"2024-09-14T12:44:25.937501+0000","last_peered":"2024-09-14T12:44:25.937501+0000","last_clean":"2024-09-14T12:44:25.937501+0000","last_became_active":"2024-09-14T10:49:27.377584+0000","last_became_peered":"2024-09-14T10:49:27.377584+0000","last_unstale":"2024-09-14T12:44:25.937501+0000","last_undegraded":"2024-09-14T12:44:25.937501+0000","last_fullsized":"2024-09-14T12:44:25.937501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:25.937326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:25.937326+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.937326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:22:46.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"267'391","reported_seq":1043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.463215+0000","last_change":"2024-09-14T12:44:28.463215+0000","last_active":"2024-09-14T12:44:28.463215+0000","last_peered":"2024-09-14T12:44:28.463215+0000","last_clean":"2024-09-14T12:44:28.463215+0000","last_became_active":"2024-09-14T10:49:29.389523+0000","last_became_peered":"2024-09-14T10:49:29.389523+0000","last_unstale":"2024-09-14T12:44:28.463215+0000","last_undegraded":"2024-09-14T12:44:28.463215+0000","last_fullsized":"2024-09-14T12:44:28.463215+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:28.462999+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:28.462999+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.462999+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:51.561087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":1411,"num_write":516,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.976410+0000","last_change":"2024-09-14T12:44:32.976410+0000","last_active":"2024-09-14T12:44:32.976410+0000","last_peered":"2024-09-14T12:44:32.976410+0000","last_clean":"2024-09-14T12:44:32.976410+0000","last_became_active":"2024-09-14T10:49:31.422113+0000","last_became_peered":"2024-09-14T10:49:31.422113+0000","last_unstale":"2024-09-14T12:44:32.976410+0000","last_undegraded":"2024-09-14T12:44:32.976410+0000","last_fullsized":"2024-09-14T12:44:32.976410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.976323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.976323+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.976323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:04.712094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"267'155","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:55.584787+0000","last_change":"2024-09-14T12:44:55.584787+0000","last_active":"2024-09-14T12:44:55.584787+0000","last_peered":"2024-09-14T12:44:55.584787+0000","last_clean":"2024-09-14T12:44:55.584787+0000","last_became_active":"2024-09-14T10:49:33.475156+0000","last_became_peered":"2024-09-14T10:49:33.475156+0000","last_unstale":"2024-09-14T12:44:55.584787+0000","last_undegraded":"2024-09-14T12:44:55.584787+0000","last_fullsized":"2024-09-14T12:44:55.584787+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-14T12:44:55.584598+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-14T12:44:55.584598+0000","last_clean_scrub_stamp":"2024-09-14T12:44:55.584598+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:10.185306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":194,"num_write":368,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"267'414","reported_seq":2104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.582365+0000","last_change":"2024-09-14T12:44:15.582365+0000","last_active":"2024-09-14T12:44:15.582365+0000","last_peered":"2024-09-14T12:44:15.582365+0000","last_clean":"2024-09-14T12:44:15.582365+0000","last_became_active":"2024-09-14T10:49:25.370901+0000","last_became_peered":"2024-09-14T10:49:25.370901+0000","last_unstale":"2024-09-14T12:44:15.582365+0000","last_undegraded":"2024-09-14T12:44:15.582365+0000","last_fullsized":"2024-09-14T12:44:15.582365+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'414","last_scrub_stamp":"2024-09-14T12:44:15.582102+0000","last_deep_scrub":"267'414","last_deep_scrub_stamp":"2024-09-14T12:44:15.582102+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.582102+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.776690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2364,"num_read_kb":2274,"num_write":465,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"267'391","reported_seq":1090,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.879541+0000","last_change":"2024-09-14T12:44:13.879398+0000","last_active":"2024-09-14T12:44:13.879541+0000","last_peered":"2024-09-14T12:44:13.879541+0000","last_clean":"2024-09-14T12:44:13.879541+0000","last_became_active":"2024-09-14T10:49:23.369669+0000","last_became_peered":"2024-09-14T10:49:23.369669+0000","last_unstale":"2024-09-14T12:44:13.879541+0000","last_undegraded":"2024-09-14T12:44:13.879541+0000","last_fullsized":"2024-09-14T12:44:13.879541+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:13.879160+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:13.879160+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.879160+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:49.729813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":9973,"num_write":1367,"num_write_kb":36861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.654516+0000","last_change":"2024-09-14T12:44:39.654516+0000","last_active":"2024-09-14T12:44:39.654516+0000","last_peered":"2024-09-14T12:44:39.654516+0000","last_clean":"2024-09-14T12:44:39.654516+0000","last_became_active":"2024-09-14T10:49:27.387840+0000","last_became_peered":"2024-09-14T10:49:27.387840+0000","last_unstale":"2024-09-14T12:44:39.654516+0000","last_undegraded":"2024-09-14T12:44:39.654516+0000","last_fullsized":"2024-09-14T12:44:39.654516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:39.654319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:39.654319+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.654319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:54.984917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"267'326","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.095208+0000","last_change":"2024-09-14T12:44:31.095208+0000","last_active":"2024-09-14T12:44:31.095208+0000","last_peered":"2024-09-14T12:44:31.095208+0000","last_clean":"2024-09-14T12:44:31.095208+0000","last_became_active":"2024-09-14T10:49:29.391517+0000","last_became_peered":"2024-09-14T10:49:29.391517+0000","last_unstale":"2024-09-14T12:44:31.095208+0000","last_undegraded":"2024-09-14T12:44:31.095208+0000","last_fullsized":"2024-09-14T12:44:31.095208+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-14T12:44:31.095032+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-14T12:44:31.095032+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.095032+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:29.436997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119496,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1347,"num_write":436,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.446579+0000","last_change":"2024-09-14T12:44:32.446579+0000","last_active":"2024-09-14T12:44:32.446579+0000","last_peered":"2024-09-14T12:44:32.446579+0000","last_clean":"2024-09-14T12:44:32.446579+0000","last_became_active":"2024-09-14T10:49:31.410633+0000","last_became_peered":"2024-09-14T10:49:31.410633+0000","last_unstale":"2024-09-14T12:44:32.446579+0000","last_undegraded":"2024-09-14T12:44:32.446579+0000","last_fullsized":"2024-09-14T12:44:32.446579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:32.446388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:32.446388+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.446388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:13.501051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"267'751","reported_seq":2295,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.670411+0000","last_change":"2024-09-14T12:44:32.670411+0000","last_active":"2024-09-14T12:44:32.670411+0000","last_peered":"2024-09-14T12:44:32.670411+0000","last_clean":"2024-09-14T12:44:32.670411+0000","last_became_active":"2024-09-14T10:49:25.408028+0000","last_became_peered":"2024-09-14T10:49:25.408028+0000","last_unstale":"2024-09-14T12:44:32.670411+0000","last_undegraded":"2024-09-14T12:44:32.670411+0000","last_fullsized":"2024-09-14T12:44:32.670411+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-14T12:44:32.670221+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-14T12:44:32.670221+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.670221+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:57.489984+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3658,"num_read_kb":3304,"num_write":985,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"267'372","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.827410+0000","last_change":"2024-09-14T12:44:16.827233+0000","last_active":"2024-09-14T12:44:16.827410+0000","last_peered":"2024-09-14T12:44:16.827410+0000","last_clean":"2024-09-14T12:44:16.827410+0000","last_became_active":"2024-09-14T10:49:23.386404+0000","last_became_peered":"2024-09-14T10:49:23.386404+0000","last_unstale":"2024-09-14T12:44:16.827410+0000","last_undegraded":"2024-09-14T12:44:16.827410+0000","last_fullsized":"2024-09-14T12:44:16.827410+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'372","last_scrub_stamp":"2024-09-14T12:44:16.827021+0000","last_deep_scrub":"267'372","last_deep_scrub_stamp":"2024-09-14T12:44:16.827021+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.827021+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:13.386836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":6911,"num_write":1204,"num_write_kb":32272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"267'4","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:31.816334+0000","last_change":"2024-09-14T12:44:31.816334+0000","last_active":"2024-09-14T12:44:31.816334+0000","last_peered":"2024-09-14T12:44:31.816334+0000","last_clean":"2024-09-14T12:44:31.816334+0000","last_became_active":"2024-09-14T10:49:27.381931+0000","last_became_peered":"2024-09-14T10:49:27.381931+0000","last_unstale":"2024-09-14T12:44:31.816334+0000","last_undegraded":"2024-09-14T12:44:31.816334+0000","last_fullsized":"2024-09-14T12:44:31.816334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T12:44:31.816149+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T12:44:31.816149+0000","last_clean_scrub_stamp":"2024-09-14T12:44:31.816149+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:16.372632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"267'562","reported_seq":1243,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.789977+0000","last_change":"2024-09-14T12:44:34.789977+0000","last_active":"2024-09-14T12:44:34.789977+0000","last_peered":"2024-09-14T12:44:34.789977+0000","last_clean":"2024-09-14T12:44:34.789977+0000","last_became_active":"2024-09-14T10:49:29.364013+0000","last_became_peered":"2024-09-14T10:49:29.364013+0000","last_unstale":"2024-09-14T12:44:34.789977+0000","last_undegraded":"2024-09-14T12:44:34.789977+0000","last_fullsized":"2024-09-14T12:44:34.789977+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'562","last_scrub_stamp":"2024-09-14T12:44:34.789779+0000","last_deep_scrub":"267'562","last_deep_scrub_stamp":"2024-09-14T12:44:34.789779+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.789779+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:50.715654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98236,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":964,"num_read_kb":2193,"num_write":836,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.058334+0000","last_change":"2024-09-14T12:44:33.058215+0000","last_active":"2024-09-14T12:44:33.058334+0000","last_peered":"2024-09-14T12:44:33.058334+0000","last_clean":"2024-09-14T12:44:33.058334+0000","last_became_active":"2024-09-14T10:49:31.431550+0000","last_became_peered":"2024-09-14T10:49:31.431550+0000","last_unstale":"2024-09-14T12:44:33.058334+0000","last_undegraded":"2024-09-14T12:44:33.058334+0000","last_fullsized":"2024-09-14T12:44:33.058334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:33.058048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:33.058048+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.058048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:28.024232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"267'164","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.778843+0000","last_change":"2024-09-14T12:44:48.778843+0000","last_active":"2024-09-14T12:44:48.778843+0000","last_peered":"2024-09-14T12:44:48.778843+0000","last_clean":"2024-09-14T12:44:48.778843+0000","last_became_active":"2024-09-14T10:49:33.466424+0000","last_became_peered":"2024-09-14T10:49:33.466424+0000","last_unstale":"2024-09-14T12:44:48.778843+0000","last_undegraded":"2024-09-14T12:44:48.778843+0000","last_fullsized":"2024-09-14T12:44:48.778843+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'164","last_scrub_stamp":"2024-09-14T12:44:48.778544+0000","last_deep_scrub":"267'164","last_deep_scrub_stamp":"2024-09-14T12:44:48.778544+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.778544+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:06.494723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":247,"num_write":384,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"267'833","reported_seq":2415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.875239+0000","last_change":"2024-09-14T12:44:22.875239+0000","last_active":"2024-09-14T12:44:22.875239+0000","last_peered":"2024-09-14T12:44:22.875239+0000","last_clean":"2024-09-14T12:44:22.875239+0000","last_became_active":"2024-09-14T10:49:25.364958+0000","last_became_peered":"2024-09-14T10:49:25.364958+0000","last_unstale":"2024-09-14T12:44:22.875239+0000","last_undegraded":"2024-09-14T12:44:22.875239+0000","last_fullsized":"2024-09-14T12:44:22.875239+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'833","last_scrub_stamp":"2024-09-14T12:44:22.875065+0000","last_deep_scrub":"267'833","last_deep_scrub_stamp":"2024-09-14T12:44:22.875065+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.875065+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.794954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3911,"num_read_kb":3508,"num_write":1119,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"267'415","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.788261+0000","last_change":"2024-09-14T12:44:14.788261+0000","last_active":"2024-09-14T12:44:14.788261+0000","last_peered":"2024-09-14T12:44:14.788261+0000","last_clean":"2024-09-14T12:44:14.788261+0000","last_became_active":"2024-09-14T10:49:23.375310+0000","last_became_peered":"2024-09-14T10:49:23.375310+0000","last_unstale":"2024-09-14T12:44:14.788261+0000","last_undegraded":"2024-09-14T12:44:14.788261+0000","last_fullsized":"2024-09-14T12:44:14.788261+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'415","last_scrub_stamp":"2024-09-14T12:44:14.788046+0000","last_deep_scrub":"267'415","last_deep_scrub_stamp":"2024-09-14T12:44:14.788046+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.788046+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:33.478823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":827,"num_read_kb":30368,"num_write":1218,"num_write_kb":52321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"267'6","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.896401+0000","last_change":"2024-09-14T12:44:26.896401+0000","last_active":"2024-09-14T12:44:26.896401+0000","last_peered":"2024-09-14T12:44:26.896401+0000","last_clean":"2024-09-14T12:44:26.896401+0000","last_became_active":"2024-09-14T10:49:27.386412+0000","last_became_peered":"2024-09-14T10:49:27.386412+0000","last_unstale":"2024-09-14T12:44:26.896401+0000","last_undegraded":"2024-09-14T12:44:26.896401+0000","last_fullsized":"2024-09-14T12:44:26.896401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T12:44:26.896175+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T12:44:26.896175+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.896175+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:02.056846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"267'366","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:45.588847+0000","last_change":"2024-09-14T12:44:45.588847+0000","last_active":"2024-09-14T12:44:45.588847+0000","last_peered":"2024-09-14T12:44:45.588847+0000","last_clean":"2024-09-14T12:44:45.588847+0000","last_became_active":"2024-09-14T10:49:29.388370+0000","last_became_peered":"2024-09-14T10:49:29.388370+0000","last_unstale":"2024-09-14T12:44:45.588847+0000","last_undegraded":"2024-09-14T12:44:45.588847+0000","last_fullsized":"2024-09-14T12:44:45.588847+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-14T12:44:45.588589+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-14T12:44:45.588589+0000","last_clean_scrub_stamp":"2024-09-14T12:44:45.588589+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:21.697378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46292,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":1047,"num_write":462,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.906350+0000","last_change":"2024-09-14T12:44:43.906350+0000","last_active":"2024-09-14T12:44:43.906350+0000","last_peered":"2024-09-14T12:44:43.906350+0000","last_clean":"2024-09-14T12:44:43.906350+0000","last_became_active":"2024-09-14T10:49:31.429861+0000","last_became_peered":"2024-09-14T10:49:31.429861+0000","last_unstale":"2024-09-14T12:44:43.906350+0000","last_undegraded":"2024-09-14T12:44:43.906350+0000","last_fullsized":"2024-09-14T12:44:43.906350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.906177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.906177+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.906177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.207899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"267'285","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:58.598680+0000","last_change":"2024-09-14T12:44:58.598680+0000","last_active":"2024-09-14T12:44:58.598680+0000","last_peered":"2024-09-14T12:44:58.598680+0000","last_clean":"2024-09-14T12:44:58.598680+0000","last_became_active":"2024-09-14T10:49:33.446698+0000","last_became_peered":"2024-09-14T10:49:33.446698+0000","last_unstale":"2024-09-14T12:44:58.598680+0000","last_undegraded":"2024-09-14T12:44:58.598680+0000","last_fullsized":"2024-09-14T12:44:58.598680+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'285","last_scrub_stamp":"2024-09-14T12:44:58.598421+0000","last_deep_scrub":"267'285","last_deep_scrub_stamp":"2024-09-14T12:44:58.598421+0000","last_clean_scrub_stamp":"2024-09-14T12:44:58.598421+0000","objects_scrubbed":7,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:28.124368+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":288,"num_write":643,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"267'447","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.545524+0000","last_change":"2024-09-14T12:44:17.545357+0000","last_active":"2024-09-14T12:44:17.545524+0000","last_peered":"2024-09-14T12:44:17.545524+0000","last_clean":"2024-09-14T12:44:17.545524+0000","last_became_active":"2024-09-14T10:49:25.395644+0000","last_became_peered":"2024-09-14T10:49:25.395644+0000","last_unstale":"2024-09-14T12:44:17.545524+0000","last_undegraded":"2024-09-14T12:44:17.545524+0000","last_fullsized":"2024-09-14T12:44:17.545524+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'447","last_scrub_stamp":"2024-09-14T12:44:17.545155+0000","last_deep_scrub":"267'447","last_deep_scrub_stamp":"2024-09-14T12:44:17.545155+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.545155+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:13.025501+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2723,"num_read_kb":2577,"num_write":520,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4341,"num_omap_keys":17,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"267'336","reported_seq":1006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:12.899355+0000","last_change":"2024-09-14T12:44:12.899210+0000","last_active":"2024-09-14T12:44:12.899355+0000","last_peered":"2024-09-14T12:44:12.899355+0000","last_clean":"2024-09-14T12:44:12.899355+0000","last_became_active":"2024-09-14T10:49:23.394870+0000","last_became_peered":"2024-09-14T10:49:23.394870+0000","last_unstale":"2024-09-14T12:44:12.899355+0000","last_undegraded":"2024-09-14T12:44:12.899355+0000","last_fullsized":"2024-09-14T12:44:12.899355+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-14T12:44:12.898987+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-14T12:44:12.898987+0000","last_clean_scrub_stamp":"2024-09-14T12:44:12.898987+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:41.227802+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":18368,"num_write":1090,"num_write_kb":30203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.945577+0000","last_change":"2024-09-14T12:44:28.945449+0000","last_active":"2024-09-14T12:44:28.945577+0000","last_peered":"2024-09-14T12:44:28.945577+0000","last_clean":"2024-09-14T12:44:28.945577+0000","last_became_active":"2024-09-14T10:49:27.385720+0000","last_became_peered":"2024-09-14T10:49:27.385720+0000","last_unstale":"2024-09-14T12:44:28.945577+0000","last_undegraded":"2024-09-14T12:44:28.945577+0000","last_fullsized":"2024-09-14T12:44:28.945577+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.945269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.945269+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.945269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:03.455314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"267'343","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.781739+0000","last_change":"2024-09-14T12:44:35.781739+0000","last_active":"2024-09-14T12:44:35.781739+0000","last_peered":"2024-09-14T12:44:35.781739+0000","last_clean":"2024-09-14T12:44:35.781739+0000","last_became_active":"2024-09-14T10:49:29.363989+0000","last_became_peered":"2024-09-14T10:49:29.363989+0000","last_unstale":"2024-09-14T12:44:35.781739+0000","last_undegraded":"2024-09-14T12:44:35.781739+0000","last_fullsized":"2024-09-14T12:44:35.781739+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-14T12:44:35.781529+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-14T12:44:35.781529+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.781529+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:24.488305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49289,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":538,"num_read_kb":1124,"num_write":422,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.464325+0000","last_change":"2024-09-14T12:44:33.464325+0000","last_active":"2024-09-14T12:44:33.464325+0000","last_peered":"2024-09-14T12:44:33.464325+0000","last_clean":"2024-09-14T12:44:33.464325+0000","last_became_active":"2024-09-14T10:49:31.421636+0000","last_became_peered":"2024-09-14T10:49:31.421636+0000","last_unstale":"2024-09-14T12:44:33.464325+0000","last_undegraded":"2024-09-14T12:44:33.464325+0000","last_fullsized":"2024-09-14T12:44:33.464325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:33.464135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:33.464135+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.464135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:54.819362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"267'131","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:54.540081+0000","last_change":"2024-09-14T12:44:54.540081+0000","last_active":"2024-09-14T12:44:54.540081+0000","last_peered":"2024-09-14T12:44:54.540081+0000","last_clean":"2024-09-14T12:44:54.540081+0000","last_became_active":"2024-09-14T10:49:33.465638+0000","last_became_peered":"2024-09-14T10:49:33.465638+0000","last_unstale":"2024-09-14T12:44:54.540081+0000","last_undegraded":"2024-09-14T12:44:54.540081+0000","last_fullsized":"2024-09-14T12:44:54.540081+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-14T12:44:54.539847+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-14T12:44:54.539847+0000","last_clean_scrub_stamp":"2024-09-14T12:44:54.539847+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:59.713807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"267'571","reported_seq":2236,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.880853+0000","last_change":"2024-09-14T12:44:21.880578+0000","last_active":"2024-09-14T12:44:21.880853+0000","last_peered":"2024-09-14T12:44:21.880853+0000","last_clean":"2024-09-14T12:44:21.880853+0000","last_became_active":"2024-09-14T10:49:25.383840+0000","last_became_peered":"2024-09-14T10:49:25.383840+0000","last_unstale":"2024-09-14T12:44:21.880853+0000","last_undegraded":"2024-09-14T12:44:21.880853+0000","last_fullsized":"2024-09-14T12:44:21.880853+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'571","last_scrub_stamp":"2024-09-14T12:44:21.880347+0000","last_deep_scrub":"267'571","last_deep_scrub_stamp":"2024-09-14T12:44:21.880347+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.880347+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:27.080812+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2923,"num_read_kb":2712,"num_write":720,"num_write_kb":245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"267'483","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.844983+0000","last_change":"2024-09-14T12:44:16.844845+0000","last_active":"2024-09-14T12:44:16.844983+0000","last_peered":"2024-09-14T12:44:16.844983+0000","last_clean":"2024-09-14T12:44:16.844983+0000","last_became_active":"2024-09-14T10:49:23.338934+0000","last_became_peered":"2024-09-14T10:49:23.338934+0000","last_unstale":"2024-09-14T12:44:16.844983+0000","last_undegraded":"2024-09-14T12:44:16.844983+0000","last_fullsized":"2024-09-14T12:44:16.844983+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'483","last_scrub_stamp":"2024-09-14T12:44:16.844628+0000","last_deep_scrub":"267'483","last_deep_scrub_stamp":"2024-09-14T12:44:16.844628+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.844628+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.573418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":33265,"num_write":1328,"num_write_kb":49842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.061095+0000","last_change":"2024-09-14T12:44:35.061095+0000","last_active":"2024-09-14T12:44:35.061095+0000","last_peered":"2024-09-14T12:44:35.061095+0000","last_clean":"2024-09-14T12:44:35.061095+0000","last_became_active":"2024-09-14T10:49:27.368567+0000","last_became_peered":"2024-09-14T10:49:27.368567+0000","last_unstale":"2024-09-14T12:44:35.061095+0000","last_undegraded":"2024-09-14T12:44:35.061095+0000","last_fullsized":"2024-09-14T12:44:35.061095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:35.060889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:35.060889+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.060889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:24.593261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"267'156","reported_seq":749,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:48.541873+0000","last_change":"2024-09-14T12:44:48.541873+0000","last_active":"2024-09-14T12:44:48.541873+0000","last_peered":"2024-09-14T12:44:48.541873+0000","last_clean":"2024-09-14T12:44:48.541873+0000","last_became_active":"2024-09-14T10:49:29.392965+0000","last_became_peered":"2024-09-14T10:49:29.392965+0000","last_unstale":"2024-09-14T12:44:48.541873+0000","last_undegraded":"2024-09-14T12:44:48.541873+0000","last_fullsized":"2024-09-14T12:44:48.541873+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'156","last_scrub_stamp":"2024-09-14T12:44:48.541678+0000","last_deep_scrub":"267'156","last_deep_scrub_stamp":"2024-09-14T12:44:48.541678+0000","last_clean_scrub_stamp":"2024-09-14T12:44:48.541678+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:48.747164+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":187,"num_read_kb":181,"num_write":132,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"267'792","reported_seq":3274,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:35.088048+0000","last_change":"2024-09-14T12:44:35.088048+0000","last_active":"2024-09-14T12:44:35.088048+0000","last_peered":"2024-09-14T12:44:35.088048+0000","last_clean":"2024-09-14T12:44:35.088048+0000","last_became_active":"2024-09-14T10:49:31.422765+0000","last_became_peered":"2024-09-14T10:49:31.422765+0000","last_unstale":"2024-09-14T12:44:35.088048+0000","last_undegraded":"2024-09-14T12:44:35.088048+0000","last_fullsized":"2024-09-14T12:44:35.088048+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'792","last_scrub_stamp":"2024-09-14T12:44:35.087864+0000","last_deep_scrub":"267'792","last_deep_scrub_stamp":"2024-09-14T12:44:35.087864+0000","last_clean_scrub_stamp":"2024-09-14T12:44:35.087864+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:04.440955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"267'101","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:52.556952+0000","last_change":"2024-09-14T12:44:52.556952+0000","last_active":"2024-09-14T12:44:52.556952+0000","last_peered":"2024-09-14T12:44:52.556952+0000","last_clean":"2024-09-14T12:44:52.556952+0000","last_became_active":"2024-09-14T10:49:33.443020+0000","last_became_peered":"2024-09-14T10:49:33.443020+0000","last_unstale":"2024-09-14T12:44:52.556952+0000","last_undegraded":"2024-09-14T12:44:52.556952+0000","last_fullsized":"2024-09-14T12:44:52.556952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'101","last_scrub_stamp":"2024-09-14T12:44:52.556752+0000","last_deep_scrub":"267'101","last_deep_scrub_stamp":"2024-09-14T12:44:52.556752+0000","last_clean_scrub_stamp":"2024-09-14T12:44:52.556752+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:29.201815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":233,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"267'970","reported_seq":2593,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.816889+0000","last_change":"2024-09-14T12:44:21.816713+0000","last_active":"2024-09-14T12:44:21.816889+0000","last_peered":"2024-09-14T12:44:21.816889+0000","last_clean":"2024-09-14T12:44:21.816889+0000","last_became_active":"2024-09-14T10:49:25.400786+0000","last_became_peered":"2024-09-14T10:49:25.400786+0000","last_unstale":"2024-09-14T12:44:21.816889+0000","last_undegraded":"2024-09-14T12:44:21.816889+0000","last_fullsized":"2024-09-14T12:44:21.816889+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'970","last_scrub_stamp":"2024-09-14T12:44:21.816523+0000","last_deep_scrub":"267'970","last_deep_scrub_stamp":"2024-09-14T12:44:21.816523+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.816523+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":900,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:09.527962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4481,"num_read_kb":3955,"num_write":1321,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"267'333","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.924005+0000","last_change":"2024-09-14T12:44:11.923935+0000","last_active":"2024-09-14T12:44:11.924005+0000","last_peered":"2024-09-14T12:44:11.924005+0000","last_clean":"2024-09-14T12:44:11.924005+0000","last_became_active":"2024-09-14T10:49:23.394973+0000","last_became_peered":"2024-09-14T10:49:23.394973+0000","last_unstale":"2024-09-14T12:44:11.924005+0000","last_undegraded":"2024-09-14T12:44:11.924005+0000","last_fullsized":"2024-09-14T12:44:11.924005+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-14T12:44:11.923816+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-14T12:44:11.923816+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.923816+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:11.570601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":75765,"num_write":1031,"num_write_kb":39860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.012498+0000","last_change":"2024-09-14T12:44:28.012242+0000","last_active":"2024-09-14T12:44:28.012498+0000","last_peered":"2024-09-14T12:44:28.012498+0000","last_clean":"2024-09-14T12:44:28.012498+0000","last_became_active":"2024-09-14T10:49:27.377395+0000","last_became_peered":"2024-09-14T10:49:27.377395+0000","last_unstale":"2024-09-14T12:44:28.012498+0000","last_undegraded":"2024-09-14T12:44:28.012498+0000","last_fullsized":"2024-09-14T12:44:28.012498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:28.011952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:28.011952+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.011952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:18.742458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"267'402","reported_seq":1070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:32.112814+0000","last_change":"2024-09-14T12:44:32.112814+0000","last_active":"2024-09-14T12:44:32.112814+0000","last_peered":"2024-09-14T12:44:32.112814+0000","last_clean":"2024-09-14T12:44:32.112814+0000","last_became_active":"2024-09-14T10:49:29.376813+0000","last_became_peered":"2024-09-14T10:49:29.376813+0000","last_unstale":"2024-09-14T12:44:32.112814+0000","last_undegraded":"2024-09-14T12:44:32.112814+0000","last_fullsized":"2024-09-14T12:44:32.112814+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'402","last_scrub_stamp":"2024-09-14T12:44:32.112560+0000","last_deep_scrub":"267'402","last_deep_scrub_stamp":"2024-09-14T12:44:32.112560+0000","last_clean_scrub_stamp":"2024-09-14T12:44:32.112560+0000","objects_scrubbed":9,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.095209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":628,"num_read_kb":1214,"num_write":492,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:43.844904+0000","last_change":"2024-09-14T12:44:43.844904+0000","last_active":"2024-09-14T12:44:43.844904+0000","last_peered":"2024-09-14T12:44:43.844904+0000","last_clean":"2024-09-14T12:44:43.844904+0000","last_became_active":"2024-09-14T10:49:31.424394+0000","last_became_peered":"2024-09-14T10:49:31.424394+0000","last_unstale":"2024-09-14T12:44:43.844904+0000","last_undegraded":"2024-09-14T12:44:43.844904+0000","last_fullsized":"2024-09-14T12:44:43.844904+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:43.844695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:43.844695+0000","last_clean_scrub_stamp":"2024-09-14T12:44:43.844695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:32.714429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"267'154","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:38.960158+0000","last_change":"2024-09-14T12:44:38.960158+0000","last_active":"2024-09-14T12:44:38.960158+0000","last_peered":"2024-09-14T12:44:38.960158+0000","last_clean":"2024-09-14T12:44:38.960158+0000","last_became_active":"2024-09-14T10:49:33.462582+0000","last_became_peered":"2024-09-14T10:49:33.462582+0000","last_unstale":"2024-09-14T12:44:38.960158+0000","last_undegraded":"2024-09-14T12:44:38.960158+0000","last_fullsized":"2024-09-14T12:44:38.960158+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'154","last_scrub_stamp":"2024-09-14T12:44:38.959922+0000","last_deep_scrub":"267'154","last_deep_scrub_stamp":"2024-09-14T12:44:38.959922+0000","last_clean_scrub_stamp":"2024-09-14T12:44:38.959922+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.366755+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":162,"num_read_kb":151,"num_write":347,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"267'490","reported_seq":2237,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.838896+0000","last_change":"2024-09-14T12:44:22.838759+0000","last_active":"2024-09-14T12:44:22.838896+0000","last_peered":"2024-09-14T12:44:22.838896+0000","last_clean":"2024-09-14T12:44:22.838896+0000","last_became_active":"2024-09-14T10:49:25.386937+0000","last_became_peered":"2024-09-14T10:49:25.386937+0000","last_unstale":"2024-09-14T12:44:22.838896+0000","last_undegraded":"2024-09-14T12:44:22.838896+0000","last_fullsized":"2024-09-14T12:44:22.838896+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-14T12:44:22.838569+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-14T12:44:22.838569+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.838569+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:03.633378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2676,"num_write":566,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"267'362","reported_seq":1065,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.713951+0000","last_change":"2024-09-14T12:44:20.713683+0000","last_active":"2024-09-14T12:44:20.713951+0000","last_peered":"2024-09-14T12:44:20.713951+0000","last_clean":"2024-09-14T12:44:20.713951+0000","last_became_active":"2024-09-14T10:49:53.505479+0000","last_became_peered":"2024-09-14T10:49:53.505479+0000","last_unstale":"2024-09-14T12:44:20.713951+0000","last_undegraded":"2024-09-14T12:44:20.713951+0000","last_fullsized":"2024-09-14T12:44:20.713951+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-14T12:44:20.713333+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-14T12:44:20.713333+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.713333+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:04.232788+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3150208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":68230,"num_write":1159,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1,6],"acting":[3,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.889000+0000","last_change":"2024-09-14T12:44:24.888871+0000","last_active":"2024-09-14T12:44:24.889000+0000","last_peered":"2024-09-14T12:44:24.889000+0000","last_clean":"2024-09-14T12:44:24.889000+0000","last_became_active":"2024-09-14T10:49:27.371450+0000","last_became_peered":"2024-09-14T10:49:27.371450+0000","last_unstale":"2024-09-14T12:44:24.889000+0000","last_undegraded":"2024-09-14T12:44:24.889000+0000","last_fullsized":"2024-09-14T12:44:24.889000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:24.888693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:24.888693+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.888693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:48.211818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"267'305","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:39.885866+0000","last_change":"2024-09-14T12:44:39.885606+0000","last_active":"2024-09-14T12:44:39.885866+0000","last_peered":"2024-09-14T12:44:39.885866+0000","last_clean":"2024-09-14T12:44:39.885866+0000","last_became_active":"2024-09-14T10:49:29.379942+0000","last_became_peered":"2024-09-14T10:49:29.379942+0000","last_unstale":"2024-09-14T12:44:39.885866+0000","last_undegraded":"2024-09-14T12:44:39.885866+0000","last_fullsized":"2024-09-14T12:44:39.885866+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'305","last_scrub_stamp":"2024-09-14T12:44:39.885357+0000","last_deep_scrub":"267'305","last_deep_scrub_stamp":"2024-09-14T12:44:39.885357+0000","last_clean_scrub_stamp":"2024-09-14T12:44:39.885357+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:40.991849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48705,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1051,"num_write":386,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:50.539280+0000","last_change":"2024-09-14T12:44:50.539280+0000","last_active":"2024-09-14T12:44:50.539280+0000","last_peered":"2024-09-14T12:44:50.539280+0000","last_clean":"2024-09-14T12:44:50.539280+0000","last_became_active":"2024-09-14T10:49:31.424882+0000","last_became_peered":"2024-09-14T10:49:31.424882+0000","last_unstale":"2024-09-14T12:44:50.539280+0000","last_undegraded":"2024-09-14T12:44:50.539280+0000","last_fullsized":"2024-09-14T12:44:50.539280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:50.539102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:50.539102+0000","last_clean_scrub_stamp":"2024-09-14T12:44:50.539102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:57.508334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"267'116","reported_seq":667,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:49.817966+0000","last_change":"2024-09-14T12:44:49.817966+0000","last_active":"2024-09-14T12:44:49.817966+0000","last_peered":"2024-09-14T12:44:49.817966+0000","last_clean":"2024-09-14T12:44:49.817966+0000","last_became_active":"2024-09-14T10:49:33.468026+0000","last_became_peered":"2024-09-14T10:49:33.468026+0000","last_unstale":"2024-09-14T12:44:49.817966+0000","last_undegraded":"2024-09-14T12:44:49.817966+0000","last_fullsized":"2024-09-14T12:44:49.817966+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-14T12:44:49.817767+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-14T12:44:49.817767+0000","last_clean_scrub_stamp":"2024-09-14T12:44:49.817767+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:17.594684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":167,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"267'980","reported_seq":2681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.498418+0000","last_change":"2024-09-14T12:44:18.498418+0000","last_active":"2024-09-14T12:44:18.498418+0000","last_peered":"2024-09-14T12:44:18.498418+0000","last_clean":"2024-09-14T12:44:18.498418+0000","last_became_active":"2024-09-14T10:49:25.386168+0000","last_became_peered":"2024-09-14T10:49:25.386168+0000","last_unstale":"2024-09-14T12:44:18.498418+0000","last_undegraded":"2024-09-14T12:44:18.498418+0000","last_fullsized":"2024-09-14T12:44:18.498418+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'980","last_scrub_stamp":"2024-09-14T12:44:18.498226+0000","last_deep_scrub":"267'980","last_deep_scrub_stamp":"2024-09-14T12:44:18.498226+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.498226+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":900,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:55.963844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4881,"num_read_kb":4356,"num_write":1346,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"267'333","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.874395+0000","last_change":"2024-09-14T12:44:14.874395+0000","last_active":"2024-09-14T12:44:14.874395+0000","last_peered":"2024-09-14T12:44:14.874395+0000","last_clean":"2024-09-14T12:44:14.874395+0000","last_became_active":"2024-09-14T10:49:23.367940+0000","last_became_peered":"2024-09-14T10:49:23.367940+0000","last_unstale":"2024-09-14T12:44:14.874395+0000","last_undegraded":"2024-09-14T12:44:14.874395+0000","last_fullsized":"2024-09-14T12:44:14.874395+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-14T12:44:14.874116+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-14T12:44:14.874116+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.874116+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:30.960138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":587,"num_read_kb":29401,"num_write":1062,"num_write_kb":29053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.058048+0000","last_change":"2024-09-14T12:44:27.057865+0000","last_active":"2024-09-14T12:44:27.058048+0000","last_peered":"2024-09-14T12:44:27.058048+0000","last_clean":"2024-09-14T12:44:27.058048+0000","last_became_active":"2024-09-14T10:49:27.380333+0000","last_became_peered":"2024-09-14T10:49:27.380333+0000","last_unstale":"2024-09-14T12:44:27.058048+0000","last_undegraded":"2024-09-14T12:44:27.058048+0000","last_fullsized":"2024-09-14T12:44:27.058048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:27.057679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:27.057679+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.057679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:58.978461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"267'245","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.803683+0000","last_change":"2024-09-14T12:44:33.803683+0000","last_active":"2024-09-14T12:44:33.803683+0000","last_peered":"2024-09-14T12:44:33.803683+0000","last_clean":"2024-09-14T12:44:33.803683+0000","last_became_active":"2024-09-14T10:49:29.377643+0000","last_became_peered":"2024-09-14T10:49:29.377643+0000","last_unstale":"2024-09-14T12:44:33.803683+0000","last_undegraded":"2024-09-14T12:44:33.803683+0000","last_fullsized":"2024-09-14T12:44:33.803683+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-14T12:44:33.803469+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-14T12:44:33.803469+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.803469+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:10.902639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":877,"num_write":306,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:53.526856+0000","last_change":"2024-09-14T12:44:53.526856+0000","last_active":"2024-09-14T12:44:53.526856+0000","last_peered":"2024-09-14T12:44:53.526856+0000","last_clean":"2024-09-14T12:44:53.526856+0000","last_became_active":"2024-09-14T10:49:31.430693+0000","last_became_peered":"2024-09-14T10:49:31.430693+0000","last_unstale":"2024-09-14T12:44:53.526856+0000","last_undegraded":"2024-09-14T12:44:53.526856+0000","last_fullsized":"2024-09-14T12:44:53.526856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:53.526747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:53.526747+0000","last_clean_scrub_stamp":"2024-09-14T12:44:53.526747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:31:52.062045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"267'160","reported_seq":1654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:56.561075+0000","last_change":"2024-09-14T12:44:56.561075+0000","last_active":"2024-09-14T12:44:56.561075+0000","last_peered":"2024-09-14T12:44:56.561075+0000","last_clean":"2024-09-14T12:44:56.561075+0000","last_became_active":"2024-09-14T10:49:33.475592+0000","last_became_peered":"2024-09-14T10:49:33.475592+0000","last_unstale":"2024-09-14T12:44:56.561075+0000","last_undegraded":"2024-09-14T12:44:56.561075+0000","last_fullsized":"2024-09-14T12:44:56.561075+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-14T12:44:56.560816+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-14T12:44:56.560816+0000","last_clean_scrub_stamp":"2024-09-14T12:44:56.560816+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:16.586044+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1153,"num_read_kb":1151,"num_write":333,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"267'1203","reported_seq":2923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.787400+0000","last_change":"2024-09-14T12:44:20.787205+0000","last_active":"2024-09-14T12:44:20.787400+0000","last_peered":"2024-09-14T12:44:20.787400+0000","last_clean":"2024-09-14T12:44:20.787400+0000","last_became_active":"2024-09-14T10:49:25.362059+0000","last_became_peered":"2024-09-14T10:49:25.362059+0000","last_unstale":"2024-09-14T12:44:20.787400+0000","last_undegraded":"2024-09-14T12:44:20.787400+0000","last_fullsized":"2024-09-14T12:44:20.787400+0000","mapping_epoch":28,"log_start":"267'1100","ondisk_log_start":"267'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1203","last_scrub_stamp":"2024-09-14T12:44:20.786965+0000","last_deep_scrub":"267'1203","last_deep_scrub_stamp":"2024-09-14T12:44:20.786965+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.786965+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:56.073347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5522,"num_read_kb":4921,"num_write":1640,"num_write_kb":659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"267'397","reported_seq":1097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.828976+0000","last_change":"2024-09-14T12:44:15.828976+0000","last_active":"2024-09-14T12:44:15.828976+0000","last_peered":"2024-09-14T12:44:15.828976+0000","last_clean":"2024-09-14T12:44:15.828976+0000","last_became_active":"2024-09-14T10:49:23.381620+0000","last_became_peered":"2024-09-14T10:49:23.381620+0000","last_unstale":"2024-09-14T12:44:15.828976+0000","last_undegraded":"2024-09-14T12:44:15.828976+0000","last_fullsized":"2024-09-14T12:44:15.828976+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'397","last_scrub_stamp":"2024-09-14T12:44:15.828640+0000","last_deep_scrub":"267'397","last_deep_scrub_stamp":"2024-09-14T12:44:15.828640+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.828640+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:00.548137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":34199,"num_write":1236,"num_write_kb":46564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.036308+0000","last_change":"2024-09-14T12:44:33.036308+0000","last_active":"2024-09-14T12:44:33.036308+0000","last_peered":"2024-09-14T12:44:33.036308+0000","last_clean":"2024-09-14T12:44:33.036308+0000","last_became_active":"2024-09-14T10:49:27.372685+0000","last_became_peered":"2024-09-14T10:49:27.372685+0000","last_unstale":"2024-09-14T12:44:33.036308+0000","last_undegraded":"2024-09-14T12:44:33.036308+0000","last_fullsized":"2024-09-14T12:44:33.036308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T12:44:33.036137+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T12:44:33.036137+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.036137+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:52.037804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"267'335","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.560421+0000","last_change":"2024-09-14T12:44:44.560421+0000","last_active":"2024-09-14T12:44:44.560421+0000","last_peered":"2024-09-14T12:44:44.560421+0000","last_clean":"2024-09-14T12:44:44.560421+0000","last_became_active":"2024-09-14T10:49:29.396379+0000","last_became_peered":"2024-09-14T10:49:29.396379+0000","last_unstale":"2024-09-14T12:44:44.560421+0000","last_undegraded":"2024-09-14T12:44:44.560421+0000","last_fullsized":"2024-09-14T12:44:44.560421+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-14T12:44:44.560226+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-14T12:44:44.560226+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.560226+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.490856+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":552,"num_read_kb":1145,"num_write":432,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:44.856757+0000","last_change":"2024-09-14T12:44:44.856757+0000","last_active":"2024-09-14T12:44:44.856757+0000","last_peered":"2024-09-14T12:44:44.856757+0000","last_clean":"2024-09-14T12:44:44.856757+0000","last_became_active":"2024-09-14T10:49:31.418819+0000","last_became_peered":"2024-09-14T10:49:31.418819+0000","last_unstale":"2024-09-14T12:44:44.856757+0000","last_undegraded":"2024-09-14T12:44:44.856757+0000","last_fullsized":"2024-09-14T12:44:44.856757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:44:44.856547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:44:44.856547+0000","last_clean_scrub_stamp":"2024-09-14T12:44:44.856547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:51.055177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"267'138","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:34.084044+0000","last_change":"2024-09-14T12:44:34.084044+0000","last_active":"2024-09-14T12:44:34.084044+0000","last_peered":"2024-09-14T12:44:34.084044+0000","last_clean":"2024-09-14T12:44:34.084044+0000","last_became_active":"2024-09-14T10:49:33.476455+0000","last_became_peered":"2024-09-14T10:49:33.476455+0000","last_unstale":"2024-09-14T12:44:34.084044+0000","last_undegraded":"2024-09-14T12:44:34.084044+0000","last_fullsized":"2024-09-14T12:44:34.084044+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-14T12:44:34.083837+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-14T12:44:34.083837+0000","last_clean_scrub_stamp":"2024-09-14T12:44:34.083837+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:35.031509+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1100,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":173,"num_write":335,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"267'506","reported_seq":2202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.882618+0000","last_change":"2024-09-14T12:44:23.882618+0000","last_active":"2024-09-14T12:44:23.882618+0000","last_peered":"2024-09-14T12:44:23.882618+0000","last_clean":"2024-09-14T12:44:23.882618+0000","last_became_active":"2024-09-14T10:49:25.373337+0000","last_became_peered":"2024-09-14T10:49:25.373337+0000","last_unstale":"2024-09-14T12:44:23.882618+0000","last_undegraded":"2024-09-14T12:44:23.882618+0000","last_fullsized":"2024-09-14T12:44:23.882618+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'506","last_scrub_stamp":"2024-09-14T12:44:23.882442+0000","last_deep_scrub":"267'506","last_deep_scrub_stamp":"2024-09-14T12:44:23.882442+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.882442+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:44.958416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2857,"num_read_kb":2693,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"267'347","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.908298+0000","last_change":"2024-09-14T12:44:13.908298+0000","last_active":"2024-09-14T12:44:13.908298+0000","last_peered":"2024-09-14T12:44:13.908298+0000","last_clean":"2024-09-14T12:44:13.908298+0000","last_became_active":"2024-09-14T10:49:23.377766+0000","last_became_peered":"2024-09-14T10:49:23.377766+0000","last_unstale":"2024-09-14T12:44:13.908298+0000","last_undegraded":"2024-09-14T12:44:13.908298+0000","last_fullsized":"2024-09-14T12:44:13.908298+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-14T12:44:13.908057+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-14T12:44:13.908057+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.908057+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:07.725881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":614,"num_read_kb":20992,"num_write":1055,"num_write_kb":39444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"267'626","reported_seq":2320,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:21.551496+0000","last_change":"2024-09-14T12:44:21.551496+0000","last_active":"2024-09-14T12:44:21.551496+0000","last_peered":"2024-09-14T12:44:21.551496+0000","last_clean":"2024-09-14T12:44:21.551496+0000","last_became_active":"2024-09-14T10:49:25.375595+0000","last_became_peered":"2024-09-14T10:49:25.375595+0000","last_unstale":"2024-09-14T12:44:21.551496+0000","last_undegraded":"2024-09-14T12:44:21.551496+0000","last_fullsized":"2024-09-14T12:44:21.551496+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'626","last_scrub_stamp":"2024-09-14T12:44:21.551295+0000","last_deep_scrub":"267'626","last_deep_scrub_stamp":"2024-09-14T12:44:21.551295+0000","last_clean_scrub_stamp":"2024-09-14T12:44:21.551295+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:00.863868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3344,"num_read_kb":3023,"num_write":799,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3029,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"267'295","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.544796+0000","last_change":"2024-09-14T12:44:16.544796+0000","last_active":"2024-09-14T12:44:16.544796+0000","last_peered":"2024-09-14T12:44:16.544796+0000","last_clean":"2024-09-14T12:44:16.544796+0000","last_became_active":"2024-09-14T10:49:23.390456+0000","last_became_peered":"2024-09-14T10:49:23.390456+0000","last_unstale":"2024-09-14T12:44:16.544796+0000","last_undegraded":"2024-09-14T12:44:16.544796+0000","last_fullsized":"2024-09-14T12:44:16.544796+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'295","last_scrub_stamp":"2024-09-14T12:44:16.544513+0000","last_deep_scrub":"267'295","last_deep_scrub_stamp":"2024-09-14T12:44:16.544513+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.544513+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:27.941670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":452,"num_read_kb":9558,"num_write":877,"num_write_kb":19994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"267'456","reported_seq":2095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.710507+0000","last_change":"2024-09-14T12:44:33.710507+0000","last_active":"2024-09-14T12:44:33.710507+0000","last_peered":"2024-09-14T12:44:33.710507+0000","last_clean":"2024-09-14T12:44:33.710507+0000","last_became_active":"2024-09-14T10:49:25.372436+0000","last_became_peered":"2024-09-14T10:49:25.372436+0000","last_unstale":"2024-09-14T12:44:33.710507+0000","last_undegraded":"2024-09-14T12:44:33.710507+0000","last_fullsized":"2024-09-14T12:44:33.710507+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'456","last_scrub_stamp":"2024-09-14T12:44:33.710293+0000","last_deep_scrub":"267'456","last_deep_scrub_stamp":"2024-09-14T12:44:33.710293+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.710293+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:43.829594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2453,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"267'344","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.667244+0000","last_change":"2024-09-14T12:44:24.667244+0000","last_active":"2024-09-14T12:44:24.667244+0000","last_peered":"2024-09-14T12:44:24.667244+0000","last_clean":"2024-09-14T12:44:24.667244+0000","last_became_active":"2024-09-14T10:49:23.395161+0000","last_became_peered":"2024-09-14T10:49:23.395161+0000","last_unstale":"2024-09-14T12:44:24.667244+0000","last_undegraded":"2024-09-14T12:44:24.667244+0000","last_fullsized":"2024-09-14T12:44:24.667244+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-09-14T12:44:24.666983+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-09-14T12:44:24.666983+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.666983+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:27.684732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":8858,"num_write":1038,"num_write_kb":29751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"267'758","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:28.904506+0000","last_change":"2024-09-14T12:44:28.904506+0000","last_active":"2024-09-14T12:44:28.904506+0000","last_peered":"2024-09-14T12:44:28.904506+0000","last_clean":"2024-09-14T12:44:28.904506+0000","last_became_active":"2024-09-14T10:49:25.390167+0000","last_became_peered":"2024-09-14T10:49:25.390167+0000","last_unstale":"2024-09-14T12:44:28.904506+0000","last_undegraded":"2024-09-14T12:44:28.904506+0000","last_fullsized":"2024-09-14T12:44:28.904506+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'758","last_scrub_stamp":"2024-09-14T12:44:28.904302+0000","last_deep_scrub":"267'758","last_deep_scrub_stamp":"2024-09-14T12:44:28.904302+0000","last_clean_scrub_stamp":"2024-09-14T12:44:28.904302+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:02.551450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3780,"num_read_kb":3460,"num_write":968,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"267'367","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.819989+0000","last_change":"2024-09-14T12:44:17.819655+0000","last_active":"2024-09-14T12:44:17.819989+0000","last_peered":"2024-09-14T12:44:17.819989+0000","last_clean":"2024-09-14T12:44:17.819989+0000","last_became_active":"2024-09-14T10:49:23.374332+0000","last_became_peered":"2024-09-14T10:49:23.374332+0000","last_unstale":"2024-09-14T12:44:17.819989+0000","last_undegraded":"2024-09-14T12:44:17.819989+0000","last_fullsized":"2024-09-14T12:44:17.819989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'367","last_scrub_stamp":"2024-09-14T12:44:17.819331+0000","last_deep_scrub":"267'367","last_deep_scrub_stamp":"2024-09-14T12:44:17.819331+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.819331+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:05.848392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":680,"num_read_kb":1430,"num_write":1267,"num_write_kb":16611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"267'437","reported_seq":2059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:27.858194+0000","last_change":"2024-09-14T12:44:27.858045+0000","last_active":"2024-09-14T12:44:27.858194+0000","last_peered":"2024-09-14T12:44:27.858194+0000","last_clean":"2024-09-14T12:44:27.858194+0000","last_became_active":"2024-09-14T10:49:25.390444+0000","last_became_peered":"2024-09-14T10:49:25.390444+0000","last_unstale":"2024-09-14T12:44:27.858194+0000","last_undegraded":"2024-09-14T12:44:27.858194+0000","last_fullsized":"2024-09-14T12:44:27.858194+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'437","last_scrub_stamp":"2024-09-14T12:44:27.857854+0000","last_deep_scrub":"267'437","last_deep_scrub_stamp":"2024-09-14T12:44:27.857854+0000","last_clean_scrub_stamp":"2024-09-14T12:44:27.857854+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.672313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2413,"num_read_kb":2280,"num_write":506,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"267'317","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.767469+0000","last_change":"2024-09-14T12:44:16.767469+0000","last_active":"2024-09-14T12:44:16.767469+0000","last_peered":"2024-09-14T12:44:16.767469+0000","last_clean":"2024-09-14T12:44:16.767469+0000","last_became_active":"2024-09-14T10:49:23.365007+0000","last_became_peered":"2024-09-14T10:49:23.365007+0000","last_unstale":"2024-09-14T12:44:16.767469+0000","last_undegraded":"2024-09-14T12:44:16.767469+0000","last_fullsized":"2024-09-14T12:44:16.767469+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-14T12:44:16.766978+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-14T12:44:16.766978+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.766978+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:13.735465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":519,"num_read_kb":40511,"num_write":1024,"num_write_kb":34103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"267'622","reported_seq":2500,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.287191+0000","last_change":"2024-09-14T12:44:19.287191+0000","last_active":"2024-09-14T12:44:19.287191+0000","last_peered":"2024-09-14T12:44:19.287191+0000","last_clean":"2024-09-14T12:44:19.287191+0000","last_became_active":"2024-09-14T10:49:25.380751+0000","last_became_peered":"2024-09-14T10:49:25.380751+0000","last_unstale":"2024-09-14T12:44:19.287191+0000","last_undegraded":"2024-09-14T12:44:19.287191+0000","last_fullsized":"2024-09-14T12:44:19.287191+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'622","last_scrub_stamp":"2024-09-14T12:44:19.287009+0000","last_deep_scrub":"267'622","last_deep_scrub_stamp":"2024-09-14T12:44:19.287009+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.287009+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:18:57.547324+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3385,"num_read_kb":3142,"num_write":784,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2004,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"267'366","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:15.728428+0000","last_change":"2024-09-14T12:44:15.728259+0000","last_active":"2024-09-14T12:44:15.728428+0000","last_peered":"2024-09-14T12:44:15.728428+0000","last_clean":"2024-09-14T12:44:15.728428+0000","last_became_active":"2024-09-14T10:49:23.366946+0000","last_became_peered":"2024-09-14T10:49:23.366946+0000","last_unstale":"2024-09-14T12:44:15.728428+0000","last_undegraded":"2024-09-14T12:44:15.728428+0000","last_fullsized":"2024-09-14T12:44:15.728428+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-14T12:44:15.728035+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-14T12:44:15.728035+0000","last_clean_scrub_stamp":"2024-09-14T12:44:15.728035+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:18.238063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":15339,"num_write":1195,"num_write_kb":33762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"267'818","reported_seq":2553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.856250+0000","last_change":"2024-09-14T12:44:25.856250+0000","last_active":"2024-09-14T12:44:25.856250+0000","last_peered":"2024-09-14T12:44:25.856250+0000","last_clean":"2024-09-14T12:44:25.856250+0000","last_became_active":"2024-09-14T10:49:25.394994+0000","last_became_peered":"2024-09-14T10:49:25.394994+0000","last_unstale":"2024-09-14T12:44:25.856250+0000","last_undegraded":"2024-09-14T12:44:25.856250+0000","last_fullsized":"2024-09-14T12:44:25.856250+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-09-14T12:44:25.856059+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-09-14T12:44:25.856059+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.856059+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:11:53.081476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4031,"num_read_kb":3664,"num_write":1069,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"267'391","reported_seq":1249,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.840145+0000","last_change":"2024-09-14T12:44:11.839965+0000","last_active":"2024-09-14T12:44:11.840145+0000","last_peered":"2024-09-14T12:44:11.840145+0000","last_clean":"2024-09-14T12:44:11.840145+0000","last_became_active":"2024-09-14T10:49:23.373080+0000","last_became_peered":"2024-09-14T10:49:23.373080+0000","last_unstale":"2024-09-14T12:44:11.840145+0000","last_undegraded":"2024-09-14T12:44:11.840145+0000","last_fullsized":"2024-09-14T12:44:11.840145+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-14T12:44:11.839750+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-14T12:44:11.839750+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.839750+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:46.935339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1418,"num_read_kb":12734,"num_write":1224,"num_write_kb":19451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"267'537","reported_seq":2281,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:16.973009+0000","last_change":"2024-09-14T12:44:16.973009+0000","last_active":"2024-09-14T12:44:16.973009+0000","last_peered":"2024-09-14T12:44:16.973009+0000","last_clean":"2024-09-14T12:44:16.973009+0000","last_became_active":"2024-09-14T10:49:25.375465+0000","last_became_peered":"2024-09-14T10:49:25.375465+0000","last_unstale":"2024-09-14T12:44:16.973009+0000","last_undegraded":"2024-09-14T12:44:16.973009+0000","last_fullsized":"2024-09-14T12:44:16.973009+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'537","last_scrub_stamp":"2024-09-14T12:44:16.972830+0000","last_deep_scrub":"267'537","last_deep_scrub_stamp":"2024-09-14T12:44:16.972830+0000","last_clean_scrub_stamp":"2024-09-14T12:44:16.972830+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:54.021748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2830,"num_read_kb":2646,"num_write":644,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"267'334","reported_seq":996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.846014+0000","last_change":"2024-09-14T12:44:18.846014+0000","last_active":"2024-09-14T12:44:18.846014+0000","last_peered":"2024-09-14T12:44:18.846014+0000","last_clean":"2024-09-14T12:44:18.846014+0000","last_became_active":"2024-09-14T10:49:23.377964+0000","last_became_peered":"2024-09-14T10:49:23.377964+0000","last_unstale":"2024-09-14T12:44:18.846014+0000","last_undegraded":"2024-09-14T12:44:18.846014+0000","last_fullsized":"2024-09-14T12:44:18.846014+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-09-14T12:44:18.845792+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-09-14T12:44:18.845792+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.845792+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:26.978554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":579,"num_read_kb":6819,"num_write":1090,"num_write_kb":17459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"267'855","reported_seq":2417,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.520037+0000","last_change":"2024-09-14T12:44:22.520037+0000","last_active":"2024-09-14T12:44:22.520037+0000","last_peered":"2024-09-14T12:44:22.520037+0000","last_clean":"2024-09-14T12:44:22.520037+0000","last_became_active":"2024-09-14T10:49:25.386541+0000","last_became_peered":"2024-09-14T10:49:25.386541+0000","last_unstale":"2024-09-14T12:44:22.520037+0000","last_undegraded":"2024-09-14T12:44:22.520037+0000","last_fullsized":"2024-09-14T12:44:22.520037+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'855","last_scrub_stamp":"2024-09-14T12:44:22.519854+0000","last_deep_scrub":"267'855","last_deep_scrub_stamp":"2024-09-14T12:44:22.519854+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.519854+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:12.468305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3987,"num_read_kb":3560,"num_write":1145,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"267'399","reported_seq":1084,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:22.639100+0000","last_change":"2024-09-14T12:44:22.638936+0000","last_active":"2024-09-14T12:44:22.639100+0000","last_peered":"2024-09-14T12:44:22.639100+0000","last_clean":"2024-09-14T12:44:22.639100+0000","last_became_active":"2024-09-14T10:49:23.387245+0000","last_became_peered":"2024-09-14T10:49:23.387245+0000","last_unstale":"2024-09-14T12:44:22.639100+0000","last_undegraded":"2024-09-14T12:44:22.639100+0000","last_fullsized":"2024-09-14T12:44:22.639100+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'399","last_scrub_stamp":"2024-09-14T12:44:22.638724+0000","last_deep_scrub":"267'399","last_deep_scrub_stamp":"2024-09-14T12:44:22.638724+0000","last_clean_scrub_stamp":"2024-09-14T12:44:22.638724+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:48.167793+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":646,"num_read_kb":46181,"num_write":1283,"num_write_kb":35513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"267'851","reported_seq":2622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.131143+0000","last_change":"2024-09-14T12:44:23.131143+0000","last_active":"2024-09-14T12:44:23.131143+0000","last_peered":"2024-09-14T12:44:23.131143+0000","last_clean":"2024-09-14T12:44:23.131143+0000","last_became_active":"2024-09-14T10:49:25.373511+0000","last_became_peered":"2024-09-14T10:49:25.373511+0000","last_unstale":"2024-09-14T12:44:23.131143+0000","last_undegraded":"2024-09-14T12:44:23.131143+0000","last_fullsized":"2024-09-14T12:44:23.131143+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'851","last_scrub_stamp":"2024-09-14T12:44:23.130952+0000","last_deep_scrub":"267'851","last_deep_scrub_stamp":"2024-09-14T12:44:23.130952+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.130952+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:53.058385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4179,"num_read_kb":3797,"num_write":1119,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"267'377","reported_seq":1056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.860583+0000","last_change":"2024-09-14T12:44:19.860583+0000","last_active":"2024-09-14T12:44:19.860583+0000","last_peered":"2024-09-14T12:44:19.860583+0000","last_clean":"2024-09-14T12:44:19.860583+0000","last_became_active":"2024-09-14T10:49:23.377218+0000","last_became_peered":"2024-09-14T10:49:23.377218+0000","last_unstale":"2024-09-14T12:44:19.860583+0000","last_undegraded":"2024-09-14T12:44:19.860583+0000","last_fullsized":"2024-09-14T12:44:19.860583+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-09-14T12:44:19.860120+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-09-14T12:44:19.860120+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.860120+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:24.595003+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5360649,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":652,"num_read_kb":6958,"num_write":1198,"num_write_kb":17243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"267'525","reported_seq":2139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:33.041596+0000","last_change":"2024-09-14T12:44:33.041336+0000","last_active":"2024-09-14T12:44:33.041596+0000","last_peered":"2024-09-14T12:44:33.041596+0000","last_clean":"2024-09-14T12:44:33.041596+0000","last_became_active":"2024-09-14T10:49:25.394237+0000","last_became_peered":"2024-09-14T10:49:25.394237+0000","last_unstale":"2024-09-14T12:44:33.041596+0000","last_undegraded":"2024-09-14T12:44:33.041596+0000","last_fullsized":"2024-09-14T12:44:33.041596+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'525","last_scrub_stamp":"2024-09-14T12:44:33.041096+0000","last_deep_scrub":"267'525","last_deep_scrub_stamp":"2024-09-14T12:44:33.041096+0000","last_clean_scrub_stamp":"2024-09-14T12:44:33.041096+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:10.429047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2610,"num_write":682,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"267'385","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:13.937989+0000","last_change":"2024-09-14T12:44:13.937989+0000","last_active":"2024-09-14T12:44:13.937989+0000","last_peered":"2024-09-14T12:44:13.937989+0000","last_clean":"2024-09-14T12:44:13.937989+0000","last_became_active":"2024-09-14T10:49:23.371845+0000","last_became_peered":"2024-09-14T10:49:23.371845+0000","last_unstale":"2024-09-14T12:44:13.937989+0000","last_undegraded":"2024-09-14T12:44:13.937989+0000","last_fullsized":"2024-09-14T12:44:13.937989+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-14T12:44:13.937713+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-14T12:44:13.937713+0000","last_clean_scrub_stamp":"2024-09-14T12:44:13.937713+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:48.516351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":30325,"num_write":1182,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"267'407","reported_seq":1837,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:18.949255+0000","last_change":"2024-09-14T12:44:18.949255+0000","last_active":"2024-09-14T12:44:18.949255+0000","last_peered":"2024-09-14T12:44:18.949255+0000","last_clean":"2024-09-14T12:44:18.949255+0000","last_became_active":"2024-09-14T10:49:25.375374+0000","last_became_peered":"2024-09-14T10:49:25.375374+0000","last_unstale":"2024-09-14T12:44:18.949255+0000","last_undegraded":"2024-09-14T12:44:18.949255+0000","last_fullsized":"2024-09-14T12:44:18.949255+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-14T12:44:18.949068+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-14T12:44:18.949068+0000","last_clean_scrub_stamp":"2024-09-14T12:44:18.949068+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:26.275108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2030,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"267'390","reported_seq":1123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.807384+0000","last_change":"2024-09-14T12:44:17.807384+0000","last_active":"2024-09-14T12:44:17.807384+0000","last_peered":"2024-09-14T12:44:17.807384+0000","last_clean":"2024-09-14T12:44:17.807384+0000","last_became_active":"2024-09-14T10:49:23.371987+0000","last_became_peered":"2024-09-14T10:49:23.371987+0000","last_unstale":"2024-09-14T12:44:17.807384+0000","last_undegraded":"2024-09-14T12:44:17.807384+0000","last_fullsized":"2024-09-14T12:44:17.807384+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'390","last_scrub_stamp":"2024-09-14T12:44:17.807136+0000","last_deep_scrub":"267'390","last_deep_scrub_stamp":"2024-09-14T12:44:17.807136+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.807136+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:11.677728+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730117,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":722,"num_read_kb":54432,"num_write":1171,"num_write_kb":38478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"267'768","reported_seq":2328,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:17.970413+0000","last_change":"2024-09-14T12:44:17.970413+0000","last_active":"2024-09-14T12:44:17.970413+0000","last_peered":"2024-09-14T12:44:17.970413+0000","last_clean":"2024-09-14T12:44:17.970413+0000","last_became_active":"2024-09-14T10:49:25.404302+0000","last_became_peered":"2024-09-14T10:49:25.404302+0000","last_unstale":"2024-09-14T12:44:17.970413+0000","last_undegraded":"2024-09-14T12:44:17.970413+0000","last_fullsized":"2024-09-14T12:44:17.970413+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'768","last_scrub_stamp":"2024-09-14T12:44:17.970223+0000","last_deep_scrub":"267'768","last_deep_scrub_stamp":"2024-09-14T12:44:17.970223+0000","last_clean_scrub_stamp":"2024-09-14T12:44:17.970223+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:07.913253+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3673,"num_read_kb":3318,"num_write":995,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"267'392","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:11.355966+0000","last_change":"2024-09-14T12:44:11.355966+0000","last_active":"2024-09-14T12:44:11.355966+0000","last_peered":"2024-09-14T12:44:11.355966+0000","last_clean":"2024-09-14T12:44:11.355966+0000","last_became_active":"2024-09-14T10:49:23.372362+0000","last_became_peered":"2024-09-14T10:49:23.372362+0000","last_unstale":"2024-09-14T12:44:11.355966+0000","last_undegraded":"2024-09-14T12:44:11.355966+0000","last_fullsized":"2024-09-14T12:44:11.355966+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-14T12:44:11.355879+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-14T12:44:11.355879+0000","last_clean_scrub_stamp":"2024-09-14T12:44:11.355879+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:43.785705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":10747,"num_write":1199,"num_write_kb":31883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"267'889","reported_seq":2547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.471116+0000","last_change":"2024-09-14T12:44:23.471116+0000","last_active":"2024-09-14T12:44:23.471116+0000","last_peered":"2024-09-14T12:44:23.471116+0000","last_clean":"2024-09-14T12:44:23.471116+0000","last_became_active":"2024-09-14T10:49:25.378231+0000","last_became_peered":"2024-09-14T10:49:25.378231+0000","last_unstale":"2024-09-14T12:44:23.471116+0000","last_undegraded":"2024-09-14T12:44:23.471116+0000","last_fullsized":"2024-09-14T12:44:23.471116+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'889","last_scrub_stamp":"2024-09-14T12:44:23.470931+0000","last_deep_scrub":"267'889","last_deep_scrub_stamp":"2024-09-14T12:44:23.470931+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.470931+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:44.766183+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4260,"num_read_kb":3817,"num_write":1188,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"267'382","reported_seq":1165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:23.687570+0000","last_change":"2024-09-14T12:44:23.687320+0000","last_active":"2024-09-14T12:44:23.687570+0000","last_peered":"2024-09-14T12:44:23.687570+0000","last_clean":"2024-09-14T12:44:23.687570+0000","last_became_active":"2024-09-14T10:49:23.396179+0000","last_became_peered":"2024-09-14T10:49:23.396179+0000","last_unstale":"2024-09-14T12:44:23.687570+0000","last_undegraded":"2024-09-14T12:44:23.687570+0000","last_fullsized":"2024-09-14T12:44:23.687570+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'382","last_scrub_stamp":"2024-09-14T12:44:23.686889+0000","last_deep_scrub":"267'382","last_deep_scrub_stamp":"2024-09-14T12:44:23.686889+0000","last_clean_scrub_stamp":"2024-09-14T12:44:23.686889+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:10.063554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1034,"num_read_kb":35151,"num_write":1252,"num_write_kb":27361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"267'453","reported_seq":1998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:24.835269+0000","last_change":"2024-09-14T12:44:24.835269+0000","last_active":"2024-09-14T12:44:24.835269+0000","last_peered":"2024-09-14T12:44:24.835269+0000","last_clean":"2024-09-14T12:44:24.835269+0000","last_became_active":"2024-09-14T10:49:25.386602+0000","last_became_peered":"2024-09-14T10:49:25.386602+0000","last_unstale":"2024-09-14T12:44:24.835269+0000","last_undegraded":"2024-09-14T12:44:24.835269+0000","last_fullsized":"2024-09-14T12:44:24.835269+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'453","last_scrub_stamp":"2024-09-14T12:44:24.835090+0000","last_deep_scrub":"267'453","last_deep_scrub_stamp":"2024-09-14T12:44:24.835090+0000","last_clean_scrub_stamp":"2024-09-14T12:44:24.835090+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:19:05.573525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2532,"num_read_kb":2369,"num_write":580,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"267'365","reported_seq":1044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:14.600332+0000","last_change":"2024-09-14T12:44:14.600332+0000","last_active":"2024-09-14T12:44:14.600332+0000","last_peered":"2024-09-14T12:44:14.600332+0000","last_clean":"2024-09-14T12:44:14.600332+0000","last_became_active":"2024-09-14T10:49:23.369989+0000","last_became_peered":"2024-09-14T10:49:23.369989+0000","last_unstale":"2024-09-14T12:44:14.600332+0000","last_undegraded":"2024-09-14T12:44:14.600332+0000","last_fullsized":"2024-09-14T12:44:14.600332+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-14T12:44:14.600114+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-14T12:44:14.600114+0000","last_clean_scrub_stamp":"2024-09-14T12:44:14.600114+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.010341+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":696,"num_read_kb":14222,"num_write":1159,"num_write_kb":28974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"267'1267","reported_seq":2972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:19.985235+0000","last_change":"2024-09-14T12:44:19.985004+0000","last_active":"2024-09-14T12:44:19.985235+0000","last_peered":"2024-09-14T12:44:19.985235+0000","last_clean":"2024-09-14T12:44:19.985235+0000","last_became_active":"2024-09-14T10:49:25.407817+0000","last_became_peered":"2024-09-14T10:49:25.407817+0000","last_unstale":"2024-09-14T12:44:19.985235+0000","last_undegraded":"2024-09-14T12:44:19.985235+0000","last_fullsized":"2024-09-14T12:44:19.985235+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1267","last_scrub_stamp":"2024-09-14T12:44:19.984761+0000","last_deep_scrub":"267'1267","last_deep_scrub_stamp":"2024-09-14T12:44:19.984761+0000","last_clean_scrub_stamp":"2024-09-14T12:44:19.984761+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":1200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:38.185470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5850,"num_read_kb":5153,"num_write":1753,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"267'378","reported_seq":1144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:26.660518+0000","last_change":"2024-09-14T12:44:26.660518+0000","last_active":"2024-09-14T12:44:26.660518+0000","last_peered":"2024-09-14T12:44:26.660518+0000","last_clean":"2024-09-14T12:44:26.660518+0000","last_became_active":"2024-09-14T10:49:23.365975+0000","last_became_peered":"2024-09-14T10:49:23.365975+0000","last_unstale":"2024-09-14T12:44:26.660518+0000","last_undegraded":"2024-09-14T12:44:26.660518+0000","last_fullsized":"2024-09-14T12:44:26.660518+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'378","last_scrub_stamp":"2024-09-14T12:44:26.660249+0000","last_deep_scrub":"267'378","last_deep_scrub_stamp":"2024-09-14T12:44:26.660249+0000","last_clean_scrub_stamp":"2024-09-14T12:44:26.660249+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:08.781982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":962,"num_read_kb":99658,"num_write":1167,"num_write_kb":35935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"267'346","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.701550+0000","last_change":"2024-09-14T12:44:25.701550+0000","last_active":"2024-09-14T12:44:25.701550+0000","last_peered":"2024-09-14T12:44:25.701550+0000","last_clean":"2024-09-14T12:44:25.701550+0000","last_became_active":"2024-09-14T10:49:23.373652+0000","last_became_peered":"2024-09-14T10:49:23.373652+0000","last_unstale":"2024-09-14T12:44:25.701550+0000","last_undegraded":"2024-09-14T12:44:25.701550+0000","last_fullsized":"2024-09-14T12:44:25.701550+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-14T12:44:25.701274+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-14T12:44:25.701274+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.701274+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:04.194083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":859,"num_read_kb":808,"num_write":1082,"num_write_kb":27318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"267'430","reported_seq":2032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.803698+0000","last_change":"2024-09-14T12:44:25.803698+0000","last_active":"2024-09-14T12:44:25.803698+0000","last_peered":"2024-09-14T12:44:25.803698+0000","last_clean":"2024-09-14T12:44:25.803698+0000","last_became_active":"2024-09-14T10:49:25.399830+0000","last_became_peered":"2024-09-14T10:49:25.399830+0000","last_unstale":"2024-09-14T12:44:25.803698+0000","last_undegraded":"2024-09-14T12:44:25.803698+0000","last_fullsized":"2024-09-14T12:44:25.803698+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-14T12:44:25.803503+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-14T12:44:25.803503+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.803503+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:00.772915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2288,"num_read_kb":2174,"num_write":485,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"267'357","reported_seq":1117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:20.812240+0000","last_change":"2024-09-14T12:44:20.812240+0000","last_active":"2024-09-14T12:44:20.812240+0000","last_peered":"2024-09-14T12:44:20.812240+0000","last_clean":"2024-09-14T12:44:20.812240+0000","last_became_active":"2024-09-14T10:49:23.382302+0000","last_became_peered":"2024-09-14T10:49:23.382302+0000","last_unstale":"2024-09-14T12:44:20.812240+0000","last_undegraded":"2024-09-14T12:44:20.812240+0000","last_fullsized":"2024-09-14T12:44:20.812240+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-14T12:44:20.812034+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-14T12:44:20.812034+0000","last_clean_scrub_stamp":"2024-09-14T12:44:20.812034+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:33.756604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":853,"num_read_kb":33665,"num_write":1061,"num_write_kb":42742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"267'434","reported_seq":2116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:44:25.047470+0000","last_change":"2024-09-14T12:44:25.047241+0000","last_active":"2024-09-14T12:44:25.047470+0000","last_peered":"2024-09-14T12:44:25.047470+0000","last_clean":"2024-09-14T12:44:25.047470+0000","last_became_active":"2024-09-14T10:49:25.391680+0000","last_became_peered":"2024-09-14T10:49:25.391680+0000","last_unstale":"2024-09-14T12:44:25.047470+0000","last_undegraded":"2024-09-14T12:44:25.047470+0000","last_fullsized":"2024-09-14T12:44:25.047470+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T12:44:25.047002+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T12:44:25.047002+0000","last_clean_scrub_stamp":"2024-09-14T12:44:25.047002+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:34.093527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2427,"num_read_kb":2321,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10880,"num_read_kb":8996,"num_write":3119,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15325,"num_read_kb":14960,"num_write":17100,"num_write_kb":5007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1615,"ondisk_log_size":1615,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1637897,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":21147,"num_read_kb":41034,"num_write":17727,"num_write_kb":12782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":716172,"num_omap_keys":1640,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2029,"ondisk_log_size":2029,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2433,"num_read_kb":2900,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221603,"num_read_kb":202842,"num_write":56199,"num_write_kb":19273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35772,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3743,"ondisk_log_size":3743,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":42369360,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44646,"num_read_kb":1985232,"num_write":73593,"num_write_kb":2196624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58359808,"data_stored":58359808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3987,"ondisk_log_size":3987,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":168154,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":167578,"num_write":186,"num_write_kb":125580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510845,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":9404,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":9629696,"data_stored":7595829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510844,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281608,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94090232,"statfs":{"total":96636764160,"available":96348397568,"internally_reserved":0,"allocated":11919360,"data_stored":9909527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510846,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225296,"kb_used_data":9536,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94146544,"statfs":{"total":96636764160,"available":96406061056,"internally_reserved":0,"allocated":9764864,"data_stored":7751439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510847,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277220,"kb_used_data":11412,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94094620,"statfs":{"total":96636764160,"available":96352890880,"internally_reserved":0,"allocated":11685888,"data_stored":9655008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510846,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201292,"kb_used_data":13244,"kb_used_omap":1,"kb_used_meta":188030,"kb_avail":94170548,"statfs":{"total":96636764160,"available":96430641152,"internally_reserved":0,"allocated":13561856,"data_stored":11555946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":192543173},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510843,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339320,"kb_used_data":11048,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94032520,"statfs":{"total":96636764160,"available":96289300480,"internally_reserved":0,"allocated":11313152,"data_stored":9301608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510844,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138204,"kb_used_data":12620,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94233636,"statfs":{"total":96636764160,"available":96495243264,"internally_reserved":0,"allocated":12922880,"data_stored":10866139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129543550,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242192,"kb_used_data":12544,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94129648,"statfs":{"total":96636764160,"available":96388759552,"internally_reserved":0,"allocated":12845056,"data_stored":10838842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":235141578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8622080,"data_stored":8622080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6471680,"data_stored":6471680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9314304,"data_stored":9314304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7413760,"data_stored":7413760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5509120,"data_stored":5509120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7077888,"data_stored":7077888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5353472,"data_stored":5353472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8597504,"data_stored":8597504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":6150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:45:34.415 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T12:45:34.778 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T12:45:34.778 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T12:45:34.778 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T12:45:34.778 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:34.854 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T12:45:34.854 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T12:45:34.855 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:36.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-14T12:45:40.957 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T12:45:40.957 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T12:45:40.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:41.057 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T12:45:41.058 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T12:45:41.058 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:41.154 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T12:45:41.154 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T12:45:41.155 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:42.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-14T12:45:42.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-14T12:45:47.257 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T12:45:47.257 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T12:45:47.258 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:48.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-14T12:45:48.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-14T12:45:53.359 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T12:45:53.360 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T12:45:53.360 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:53.443 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T12:45:53.443 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T12:45:53.444 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:53.529 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T12:45:53.529 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T12:45:53.529 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T12:45:53.530 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:53.562 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T12:45:53.562 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T12:45:53.562 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:53.591 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T12:45:53.591 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T12:45:53.591 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T12:45:53.591 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:53.635 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T12:45:53.636 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T12:45:53.636 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:53.694 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T12:45:53.694 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T12:45:53.694 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:45:53.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~6s 2024-09-14T12:45:53.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-14T12:45:53.719 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T12:45:53.719 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T12:45:53.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T12:45:53.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T12:45:53.754 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T12:45:54.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T12:45:54.059 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T12:45:54.282 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T12:45:54.282 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T12:45:54.441 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T12:45:54.441 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T12:45:54.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T12:45:54.622 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T12:45:55.091 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T12:45:55.091 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T12:45:55.315 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T12:45:55.315 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T12:45:55.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T12:45:55.472 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T12:45:55.655 INFO:tasks.ceph:Archiving mon data... 2024-09-14T12:45:55.657 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/data/mon.a.tgz 2024-09-14T12:45:55.657 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-14T12:45:55.663 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.hruKnUXdwr 2024-09-14T12:45:55.663 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hruKnUXdwr 2024-09-14T12:45:55.876 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.hruKnUXdwr 2024-09-14T12:45:55.938 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.hruKnUXdwr is 659KB 2024-09-14T12:45:55.999 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.hruKnUXdwr 2024-09-14T12:45:56.004 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/data/mon.c.tgz 2024-09-14T12:45:56.004 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-14T12:45:56.049 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.RhLUg7Gpzx 2024-09-14T12:45:56.049 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RhLUg7Gpzx 2024-09-14T12:45:56.277 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.RhLUg7Gpzx 2024-09-14T12:45:56.342 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.RhLUg7Gpzx is 708KB 2024-09-14T12:45:56.408 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.RhLUg7Gpzx 2024-09-14T12:45:56.413 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/data/mon.b.tgz 2024-09-14T12:45:56.414 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-14T12:45:56.420 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.Bt2k6CFq97 2024-09-14T12:45:56.420 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Bt2k6CFq97 2024-09-14T12:45:56.649 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.Bt2k6CFq97 2024-09-14T12:45:56.713 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.Bt2k6CFq97 is 708KB 2024-09-14T12:45:56.779 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.Bt2k6CFq97 2024-09-14T12:45:56.785 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T12:45:56.785 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:45:56.787 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:45:56.903 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:45:56.908 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:45:56.909 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T12:45:56.911 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/remote/smithi148/crash 2024-09-14T12:45:56.912 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:45:56.927 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/remote/smithi150/crash 2024-09-14T12:45:56.928 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:45:56.965 INFO:tasks.ceph:Compressing logs... 2024-09-14T12:45:56.965 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:45:56.975 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:45:56.993 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140533.log 2024-09-14T12:45:56.994 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183492.log 2024-09-14T12:45:56.997 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.140533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151746.log 2024-09-14T12:45:56.997 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.183492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177898.log 2024-09-14T12:45:56.997 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.151746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138763.log 2024-09-14T12:45:56.997 INFO:teuthology.orchestra.run.smithi148.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.183492.log.gz 2024-09-14T12:45:56.997 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.177898.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151746.log.gz 2024-09-14T12:45:56.997 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185867.log 2024-09-14T12:45:56.997 INFO:teuthology.orchestra.run.smithi148.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.140533.log.gz 2024-09-14T12:45:56.998 INFO:teuthology.orchestra.run.smithi148.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.177898.log.gz 2024-09-14T12:45:56.998 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138763.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:45:56.998 INFO:teuthology.orchestra.run.smithi148.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.138763.log.gz 2024-09-14T12:45:56.998 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100412.log 2024-09-14T12:45:56.998 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185867.log.gz 2024-09-14T12:45:56.998 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182181.log 2024-09-14T12:45:57.007 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.100412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124602.log 2024-09-14T12:45:57.007 INFO:teuthology.orchestra.run.smithi148.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.100412.log.gz 2024-09-14T12:45:57.007 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59681.log 2024-09-14T12:45:57.007 INFO:teuthology.orchestra.run.smithi148.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.182181.log.gz 2024-09-14T12:45:57.007 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.124602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32681.log 2024-09-14T12:45:57.007 INFO:teuthology.orchestra.run.smithi148.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.124602.log.gz 2024-09-14T12:45:57.008 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.59681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86839.log 2024-09-14T12:45:57.008 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182895.log 2024-09-14T12:45:57.008 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32681.log.gz 2024-09-14T12:45:57.008 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.86839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62911.log 2024-09-14T12:45:57.008 INFO:teuthology.orchestra.run.smithi148.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.86839.log.gz 2024-09-14T12:45:57.008 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32682.log 2024-09-14T12:45:57.008 INFO:teuthology.orchestra.run.smithi148.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.182895.log.gz 2024-09-14T12:45:57.008 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.62911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97462.log 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32682.log.gz 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125782.log 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.97462.log: /var/log/ceph/ceph-client.admin.125782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32474.log 82.1% 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.125782.log.gz 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97462.log.gz 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101002.log 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26929.log 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32474.log: 0.0%/var/log/ceph/ceph-client.admin.101002.log: -- replaced with /var/log/ceph/ceph-client.admin.32474.log.gz 2024-09-14T12:45:57.009 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158898.log 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.26929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26929.log.gz 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96282.log 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.158898.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.101002.log.gz 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158898.log.gz 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165958.log 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr:gzip/var/log/ceph/ceph-client.admin.96282.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57250.log 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.165958.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.96282.log.gz 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178488.log 91.7% 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.165958.log.gz 2024-09-14T12:45:57.010 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.57250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32893.log 2024-09-14T12:45:57.011 INFO:teuthology.orchestra.run.smithi148.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.57250.log.gz 2024-09-14T12:45:57.011 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.178488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54175.log 2024-09-14T12:45:57.011 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32893.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.178488.log.gz 2024-09-14T12:45:57.011 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48225.log 2024-09-14T12:45:57.011 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32893.log.gz 2024-09-14T12:45:57.011 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.54175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32892.log 2024-09-14T12:45:57.011 INFO:teuthology.orchestra.run.smithi148.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.54175.log.gz 2024-09-14T12:45:57.011 INFO:teuthology.orchestra.run.smithi148.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.59681.log.gz 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:gzip/var/log/ceph/ceph-client.admin.48225.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.115752.log 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32892.log.gz 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.48225.log.gz 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179668.log 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144663.log 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115752.log: /var/log/ceph/ceph-client.0.179668.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.179668.log.gz 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.144663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90969.log 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158308.log 2024-09-14T12:45:57.030 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55405.log 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90969.log.gz 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% 86.2% -- replaced with /var/log/ceph/ceph-client.admin.144663.log.gz 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.158308.log: -- replaced with /var/log/ceph/ceph-client.admin.115752.log.gz 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158308.log.gz 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52380.log 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.55405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37189.log 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.55405.log.gz 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32680.log 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.52380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52380.log.gz 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.37189.log: gzip 43.5% -5 -- replaced with /var/log/ceph/ceph-client.0.37189.log.gz --verbose 2024-09-14T12:45:57.031 INFO:teuthology.orchestra.run.smithi148.stderr: -- /var/log/ceph/ceph-client.admin.88019.log 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114572.log 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32680.log.gz 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.88019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150566.log 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.88019.log.gz 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.114572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185451.log 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.114572.log.gz 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127552.log 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.150566.log: /var/log/ceph/ceph-client.admin.185451.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.158948.log -- replaced with /var/log/ceph/ceph-client.admin.185451.log.gz 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-14T12:45:57.032 INFO:teuthology.orchestra.run.smithi148.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.150566.log.gz 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.127552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151156.log 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.127552.log.gz 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.158948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36599.log 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.151156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71977.log 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.158948.log.gz 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.151156.log.gz 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.36599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176718.log 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.0.36599.log.gz 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.71977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63558.log 2024-09-14T12:45:57.033 INFO:teuthology.orchestra.run.smithi148.stderr: 80.5%/var/log/ceph/ceph-client.0.176718.log: -- replaced with /var/log/ceph/ceph-client.0.71977.log.gz 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182794.log 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.176718.log.gz 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.63558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182870.log 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135222.log 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182794.log.gz 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148204.log 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182870.log.gz 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.135222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55996.log 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.135222.log.gz 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.148204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175538.log 2024-09-14T12:45:57.034 INFO:teuthology.orchestra.run.smithi148.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.63558.log.gz 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.55996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33098.log 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.55996.log.gz 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164052.log 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.175538.log: /var/log/ceph/ceph-client.admin.33098.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.175538.log.gz 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33098.log.gz 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.148204.log.gz 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174358.log 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.164052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45225.log 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.174358.log: 92.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76217.log 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164052.log.gz 2024-09-14T12:45:57.035 INFO:teuthology.orchestra.run.smithi148.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.174358.log.gz 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.45225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34838.log 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.45225.log.gz 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32136.log 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.76217.log: /var/log/ceph/ceph-client.0.34838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135812.log 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.34838.log.gz 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125192.log 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% 82.0% -- replaced with /var/log/ceph/ceph-client.admin.76217.log.gz 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32136.log.gz 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.135812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57176.log 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.135812.log.gz 2024-09-14T12:45:57.036 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.125192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32864.log 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.125192.log.gz 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.57176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52995.log 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57176.log.gz 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68812.log 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32864.log.gz 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.52995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34225.log 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.52995.log.gz 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.68812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171998.log 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.68812.log.gz 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37773.log 2024-09-14T12:45:57.037 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34225.log.gz 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.171998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34201.log 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.171998.log.gz 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.37773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48815.log 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.37773.log.gz 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105722.log 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34201.log.gz 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.48815.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.62911.log.gz 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.48815.log.gz 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179078.log 2024-09-14T12:45:57.038 INFO:teuthology.orchestra.run.smithi148.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105722.log.gz 2024-09-14T12:45:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71387.log 2024-09-14T12:45:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107492.log 2024-09-14T12:45:57.039 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.179078.log: /var/log/ceph/ceph-client.0.71387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92739.log 2024-09-14T12:45:57.039 INFO:teuthology.orchestra.run.smithi148.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.0.179078.log.gz 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26725.log 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26725.log.gz 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26797.log 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26845.log 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26797.log: /var/log/ceph/ceph-osd.6.log: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.26797.log.gz /var/log/ceph/ceph-client.admin.26773.log 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-14T12:45:57.052 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26845.log.gz 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26821.log 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26749.log 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26773.log.gz 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26821.log.gz 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5/var/log/ceph/ceph-client.admin.26749.log: --verbose -- /var/log/ceph/ceph-client.admin.26869.log 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26749.log.gz 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26869.log.gz 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:45:57.053 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T12:45:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T12:45:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26893.log 2024-09-14T12:45:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.4.log: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:45:57.054 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.26893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26893.log.gz 2024-09-14T12:45:57.066 INFO:teuthology.orchestra.run.smithi150.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:45:57.083 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.107492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185763.log 2024-09-14T12:45:57.083 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145843.log 2024-09-14T12:45:57.083 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185763.log.gz 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56971.log 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107492.log.gz 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.145843.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.92739.log.gz 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.145843.log.gz 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.71387.log.gz 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47045.log 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36012.log 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.56971.log: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.56971.log.gz 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.47045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60971.log 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr: 86.3%/var/log/ceph/ceph-client.0.36012.log: -- replaced with /var/log/ceph/ceph-client.admin.47045.log.gz 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76807.log 2024-09-14T12:45:57.084 INFO:teuthology.orchestra.run.smithi148.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.36012.log.gz 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr:gzip/var/log/ceph/ceph-client.admin.60971.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32259.log 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.76807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43405.log 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.76807.log.gz 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133452.log 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126372.log 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.43405.log: /var/log/ceph/ceph-client.admin.133452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170228.log 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.43405.log.gz 82.3% -- replaced with /var/log/ceph/ceph-client.admin.133452.log.gz 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126372.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126372.log.gz 2024-09-14T12:45:57.085 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101592.log 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.170228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139943.log 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.170228.log.gz 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.101592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120472.log 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.101592.log.gz 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139943.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.139943.log.gz 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.120472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67041.log 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.120472.log.gz 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113392.log 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.60971.log.gz 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108082.log 2024-09-14T12:45:57.086 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.67041.log: /var/log/ceph/ceph-client.admin.113392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185607.log 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.67041.log.gz 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr: 82.2%/var/log/ceph/ceph-client.admin.108082.log: -- replaced with /var/log/ceph/ceph-client.admin.113392.log.gz 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr: 82.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180928.log 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108082.log.gz 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31709.log 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185607.log.gz 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.180928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92149.log 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.31709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32267.log 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.180928.log.gz 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31709.log.gz 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.92149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65498.log 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.92149.log.gz 2024-09-14T12:45:57.087 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185711.log 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32267.log: /var/log/ceph/ceph-client.admin.65498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71274.log 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32267.log.gz 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185711.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138173.log 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.185711.log.gz 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.71274.log: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.71274.log.gz 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82707.log 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.138173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57741.log 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.138173.log.gz/var/log/ceph/ceph-client.admin.82707.log: 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82707.log.gz 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66149.log 2024-09-14T12:45:57.088 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.57741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75037.log 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.57741.log.gz 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.66149.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.66149.log.gz 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.65498.log.gz 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155308.log 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.75037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89199.log 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.155308.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75037.log.gz 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185789.log 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.155308.log.gz 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.89199.log: /var/log/ceph/ceph-client.admin.185789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185789.log.gz 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89199.log.gz 2024-09-14T12:45:57.089 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119292.log 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.45815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113982.log 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.119292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104542.log 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.119292.log.gz 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185425.log 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.113982.log: /var/log/ceph/ceph-client.admin.104542.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113982.log.gz 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104542.log.gz 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95692.log 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185425.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185425.log.gz -5 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr: --verbose -- /var/log/ceph/ceph-client.admin.74447.log 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44635.log 2024-09-14T12:45:57.090 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.74447.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.95692.log.gz 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21900.log 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.74447.log.gz 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.44635.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.44635.log.gz 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42225.log 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.tmp-client.admin.21900.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46455.log 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.21900.log.gz 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.42225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185945.log 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.46455.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.42225.log.gz 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141123.log 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.46455.log.gz 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185945.log.gz 2024-09-14T12:45:57.091 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79167.log 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169627.log 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.141123.log.gz 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.79167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132862.log 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.79167.log.gz/var/log/ceph/ceph-client.admin.169627.log: 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111622.log 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.169627.log.gz 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132862.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.132862.log.gz 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85657.log 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91559.log 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.111622.log.gz 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.85657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33124.log 2024-09-14T12:45:57.092 INFO:teuthology.orchestra.run.smithi148.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.85657.log.gz/var/log/ceph/ceph-client.admin.91559.log: 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128142.log 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.91559.log.gz 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33124.log.gz 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54765.log 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93329.log 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.54765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67630.log 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54765.log.gz 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93329.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.93329.log.gz 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr: 86.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149976.log 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128142.log.gz 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.67630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112802.log 2024-09-14T12:45:57.093 INFO:teuthology.orchestra.run.smithi148.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.67630.log.gz 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94512.log 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.149976.log: /var/log/ceph/ceph-client.admin.112802.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149976.log.gz 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.112802.log.gz 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99232.log 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.94512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145253.log 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99232.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94512.log.gz 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32668.log 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99232.log.gz 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.145253.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.145253.log.gz 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185633.log 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185399.log 2024-09-14T12:45:57.094 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32668.log.gz 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185633.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.185633.log.gz 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32885.log 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185399.log.gz 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32453.log 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.32885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124012.log 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32885.log.gz 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32453.log.gz 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86249.log 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.124012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186026.log 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.124012.log.gz 2024-09-14T12:45:57.095 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.86249.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86249.log.gz 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134632.log 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32890.log 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.186026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186026.log.gz 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116342.log 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.134632.log.gz 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32890.log.gz 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181518.log 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80347.log 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116342.log: /var/log/ceph/ceph-client.admin.181518.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.116342.log.gz 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr: 85.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157128.log 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.181518.log.gz 2024-09-14T12:45:57.096 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.80347.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.80347.log.gz 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149384.log 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50585.log 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.157128.log: /var/log/ceph/ceph-client.admin.149384.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157128.log.gz 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.149384.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90379.log 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.50585.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.50585.log.gz 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129912.log 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32889.log 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.90379.log: /var/log/ceph/ceph-client.admin.129912.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90379.log.gz 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.129912.log.gz 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166547.log 2024-09-14T12:45:57.097 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32889.log.gz 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73267.log 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32456.log 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.166547.log: /var/log/ceph/ceph-client.admin.73267.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.73267.log.gz 92.4% 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.166547.log.gz 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56682.log 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116932.log 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32456.log.gz 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.56682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105132.log 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.56682.log.gz 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.116932.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116932.log.gz 2024-09-14T12:45:57.098 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136992.log 2024-09-14T12:45:57.101 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32667.log 2024-09-14T12:45:57.101 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.105132.log: /var/log/ceph/ceph-client.admin.136992.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.105132.log.gz 2024-09-14T12:45:57.101 INFO:teuthology.orchestra.run.smithi148.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.136992.log.gz 2024-09-14T12:45:57.101 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44020.log 2024-09-14T12:45:57.101 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32667.log.gz 2024-09-14T12:45:57.101 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T12:45:57.101 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34248.log 2024-09-14T12:45:57.102 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.44020.log: /var/log/ceph/ops-log-ceph-client.admin.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44020.log.gz 2024-09-14T12:45:57.102 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T12:45:57.102 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.34248.log: 96.0% -- replaced with /var/log/ceph/ceph-client.0.34248.log.gz 2024-09-14T12:45:57.102 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165230.log 2024-09-14T12:45:57.102 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T12:45:57.103 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57227.log 2024-09-14T12:45:57.103 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.165230.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165230.log.gz 2024-09-14T12:45:57.103 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32264.log 2024-09-14T12:45:57.104 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.57227.log: 52.3% -- replaced with /var/log/ceph/ceph-client.admin.57227.log.gz 2024-09-14T12:45:57.104 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157103.log 2024-09-14T12:45:57.105 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32264.log.gz 2024-09-14T12:45:57.105 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32116.log 2024-09-14T12:45:57.106 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.157103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157103.log.gz 2024-09-14T12:45:57.106 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106902.log 2024-09-14T12:45:57.107 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32116.log.gz 2024-09-14T12:45:57.107 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38357.log 2024-09-14T12:45:57.108 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.106902.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.106902.log.gz 2024-09-14T12:45:57.108 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34177.log 2024-09-14T12:45:57.109 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.38357.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.38357.log.gz 2024-09-14T12:45:57.110 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164641.log 2024-09-14T12:45:57.110 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34177.log.gz 2024-09-14T12:45:57.111 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152926.log 2024-09-14T12:45:57.112 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.164641.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164641.log.gz 2024-09-14T12:45:57.112 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69994.log 2024-09-14T12:45:57.113 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.152926.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.152926.log.gz 2024-09-14T12:45:57.113 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182156.log 2024-09-14T12:45:57.114 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.69994.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.69994.log.gz 2024-09-14T12:45:57.114 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32460.log 2024-09-14T12:45:57.115 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182156.log.gz 2024-09-14T12:45:57.116 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141713.log 2024-09-14T12:45:57.116 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32460.log.gz 2024-09-14T12:45:57.117 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80937.log 2024-09-14T12:45:57.118 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.141713.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.141713.log.gz 2024-09-14T12:45:57.118 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64853.log 2024-09-14T12:45:57.119 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.80937.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80937.log.gz 2024-09-14T12:45:57.119 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185581.log 2024-09-14T12:45:57.122 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.64853.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64853.log.gz 2024-09-14T12:45:57.122 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185529.log 2024-09-14T12:45:57.123 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185581.log.gz 2024-09-14T12:45:57.123 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72677.log 2024-09-14T12:45:57.124 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185529.log.gz 2024-09-14T12:45:57.124 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161618.log 2024-09-14T12:45:57.125 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.72677.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.72677.log.gz 2024-09-14T12:45:57.125 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41635.log 2024-09-14T12:45:57.126 INFO:teuthology.orchestra.run.smithi150.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T12:45:57.130 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.161618.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161618.log.gz 2024-09-14T12:45:57.130 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52355.log 2024-09-14T12:45:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.41635.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.41635.log.gz 2024-09-14T12:45:57.131 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57766.log 2024-09-14T12:45:57.132 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.52355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52355.log.gz 2024-09-14T12:45:57.133 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32266.log 2024-09-14T12:45:57.133 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.57766.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.57766.log.gz 2024-09-14T12:45:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139353.log 2024-09-14T12:45:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32266.log.gz 2024-09-14T12:45:57.135 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111032.log 2024-09-14T12:45:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.139353.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.139353.log.gz 2024-09-14T12:45:57.136 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73857.log 2024-09-14T12:45:57.137 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.111032.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111032.log.gz 2024-09-14T12:45:57.137 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182844.log 2024-09-14T12:45:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.73857.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.73857.log.gz 2024-09-14T12:45:57.139 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26692.log 2024-09-14T12:45:57.139 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182844.log.gz 2024-09-14T12:45:57.140 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42815.log 2024-09-14T12:45:57.141 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.26692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26692.log.gz 2024-09-14T12:45:57.141 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142893.log 2024-09-14T12:45:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.42815.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.42815.log.gz 2024-09-14T12:45:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68222.log 2024-09-14T12:45:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.142893.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.142893.log.gz 2024-09-14T12:45:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84477.log 2024-09-14T12:45:57.145 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.68222.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.68222.log.gz 2024-09-14T12:45:57.145 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121652.log 2024-09-14T12:45:57.147 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.84477.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.84477.log.gz 2024-09-14T12:45:57.148 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78577.log 2024-09-14T12:45:57.150 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121652.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.121652.log.gz 2024-09-14T12:45:57.150 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115162.log 2024-09-14T12:45:57.151 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.78577.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.78577.log.gz 2024-09-14T12:45:57.151 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75627.log 2024-09-14T12:45:57.152 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.115162.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.115162.log.gz 2024-09-14T12:45:57.153 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52405.log 2024-09-14T12:45:57.153 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.75627.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75627.log.gz 2024-09-14T12:45:57.154 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43995.log 2024-09-14T12:45:57.155 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.52405.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.52405.log.gz 2024-09-14T12:45:57.155 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32263.log 2024-09-14T12:45:57.156 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.43995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43995.log.gz 2024-09-14T12:45:57.156 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47635.log 2024-09-14T12:45:57.157 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32263.log.gz 2024-09-14T12:45:57.157 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83297.log 2024-09-14T12:45:57.158 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.47635.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.47635.log.gz 2024-09-14T12:45:57.158 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93919.log 2024-09-14T12:45:57.159 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83297.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.83297.log.gz 2024-09-14T12:45:57.160 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35422.log 2024-09-14T12:45:57.161 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.93919.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93919.log.gz 2024-09-14T12:45:57.161 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106312.log 2024-09-14T12:45:57.162 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.35422.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.35422.log.gz 2024-09-14T12:45:57.162 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:45:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.106312.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.106312.log.gz 2024-09-14T12:45:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32068.log 2024-09-14T12:45:57.173 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103952.log 2024-09-14T12:45:57.174 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32068.log.gz 2024-09-14T12:45:57.186 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2024-09-14T12:45:57.187 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103952.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.103952.log.gz 2024-09-14T12:45:57.188 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32664.log 2024-09-14T12:45:57.188 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:45:57.189 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.46430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2024-09-14T12:45:57.189 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57199.log 2024-09-14T12:45:57.190 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32664.log.gz 2024-09-14T12:45:57.190 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59036.log 2024-09-14T12:45:57.205 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.57199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122832.log 2024-09-14T12:45:57.207 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.59036.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.59036.log.gz 2024-09-14T12:45:57.208 INFO:teuthology.orchestra.run.smithi148.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57199.log.gz 2024-09-14T12:45:57.208 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33072.log 2024-09-14T12:45:57.209 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.122832.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.122832.log.gz 2024-09-14T12:45:57.209 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159538.log 2024-09-14T12:45:57.210 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.33072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33072.log.gz 2024-09-14T12:45:57.210 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46405.log 2024-09-14T12:45:57.211 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.159538.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.159538.log.gz 2024-09-14T12:45:57.212 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32162.log 2024-09-14T12:45:57.212 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.46405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2024-09-14T12:45:57.213 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174948.log 2024-09-14T12:45:57.213 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32162.log.gz 2024-09-14T12:45:57.214 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61616.log 2024-09-14T12:45:57.214 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.174948.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174948.log.gz 2024-09-14T12:45:57.215 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182108.log 2024-09-14T12:45:57.217 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.61616.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.61616.log.gz 2024-09-14T12:45:57.218 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87429.log 2024-09-14T12:45:57.218 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182108.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.182108.log.gz 2024-09-14T12:45:57.219 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32188.log 2024-09-14T12:45:57.219 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.87429.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.87429.log.gz 2024-09-14T12:45:57.220 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62265.log 2024-09-14T12:45:57.220 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32188.log.gz 2024-09-14T12:45:57.221 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137582.log 2024-09-14T12:45:57.223 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.62265.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62265.log.gz 2024-09-14T12:45:57.223 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58391.log 2024-09-14T12:45:57.224 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.137582.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137582.log.gz 2024-09-14T12:45:57.224 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169038.log 2024-09-14T12:45:57.240 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.58391.log: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112212.log 2024-09-14T12:45:57.243 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.169038.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.169038.log.gz 2024-09-14T12:45:57.244 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58391.log.gz 2024-09-14T12:45:57.244 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167725.log 2024-09-14T12:45:57.245 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.112212.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112212.log.gz 2024-09-14T12:45:57.245 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185503.log 2024-09-14T12:45:57.246 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.167725.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.167725.log.gz 2024-09-14T12:45:57.247 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131092.log 2024-09-14T12:45:57.247 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185503.log.gz 2024-09-14T12:45:57.248 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119882.log 2024-09-14T12:45:57.249 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.131092.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131092.log.gz 2024-09-14T12:45:57.249 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34153.log 2024-09-14T12:45:57.250 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.119882.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119882.log.gz 2024-09-14T12:45:57.250 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79757.log 2024-09-14T12:45:57.251 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34153.log.gz 2024-09-14T12:45:57.251 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155898.log 2024-09-14T12:45:57.252 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.79757.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.79757.log.gz 2024-09-14T12:45:57.252 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185919.log 2024-09-14T12:45:57.253 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.155898.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.155898.log.gz 2024-09-14T12:45:57.253 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60326.log 2024-09-14T12:45:57.254 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185919.log.gz 2024-09-14T12:45:57.254 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185841.log 2024-09-14T12:45:57.260 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.60326.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.60326.log.gz 2024-09-14T12:45:57.260 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32473.log 2024-09-14T12:45:57.261 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185841.log: 29.5% -- replaced with /var/log/ceph/ceph-client.admin.185841.log.gz 2024-09-14T12:45:57.261 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51765.log 2024-09-14T12:45:57.262 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32473.log.gz 2024-09-14T12:45:57.262 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102182.log 2024-09-14T12:45:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.51765.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.51765.log.gz 2024-09-14T12:45:57.263 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44045.log 2024-09-14T12:45:57.264 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.102182.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.102182.log.gz 2024-09-14T12:45:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T12:45:57.265 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.44045.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.44045.log.gz 2024-09-14T12:45:57.266 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109262.log 2024-09-14T12:45:57.281 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158923.log 2024-09-14T12:45:57.282 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109262.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109262.log.gz 2024-09-14T12:45:57.297 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121062.log 2024-09-14T12:45:57.298 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.158923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158923.log.gz 2024-09-14T12:45:57.298 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26839.log 2024-09-14T12:45:57.299 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.121062.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.121062.log.gz 2024-09-14T12:45:57.306 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96872.log 2024-09-14T12:45:57.306 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.26839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26839.log.gz 2024-09-14T12:45:57.313 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152336.log 2024-09-14T12:45:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.96872.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.96872.log.gz 2024-09-14T12:45:57.321 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177308.log 2024-09-14T12:45:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.152336.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.152336.log.gz 2024-09-14T12:45:57.329 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147024.log 2024-09-14T12:45:57.330 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.177308.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.177308.log.gz 2024-09-14T12:45:57.338 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77987.log 2024-09-14T12:45:57.338 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.147024.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.147024.log.gz 2024-09-14T12:45:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182771.log 2024-09-14T12:45:57.346 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.77987.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.77987.log.gz 2024-09-14T12:45:57.354 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162207.log 2024-09-14T12:45:57.354 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182771.log: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.182771.log.gz 2024-09-14T12:45:57.361 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118702.log 2024-09-14T12:45:57.362 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.162207.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162207.log.gz 2024-09-14T12:45:57.370 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172588.log 2024-09-14T12:45:57.370 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118702.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.118702.log.gz 2024-09-14T12:45:57.377 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98642.log 2024-09-14T12:45:57.378 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.172588.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.172588.log.gz 2024-09-14T12:45:57.385 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81527.log 2024-09-14T12:45:57.386 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98642.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.98642.log.gz 2024-09-14T12:45:57.397 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173178.log 2024-09-14T12:45:57.398 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.81527.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.81527.log.gz 2024-09-14T12:45:57.406 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157718.log 2024-09-14T12:45:57.406 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.173178.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.173178.log.gz 2024-09-14T12:45:57.413 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171408.log 2024-09-14T12:45:57.414 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.157718.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157718.log.gz 2024-09-14T12:45:57.429 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176128.log 2024-09-14T12:45:57.430 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.171408.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.171408.log.gz 2024-09-14T12:45:57.437 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77397.log 2024-09-14T12:45:57.438 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.176128.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.176128.log.gz 2024-09-14T12:45:57.445 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148794.log 2024-09-14T12:45:57.446 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.77397.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.77397.log.gz 2024-09-14T12:45:57.453 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109852.log 2024-09-14T12:45:57.454 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.148794.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.148794.log.gz 2024-09-14T12:45:57.461 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128732.log 2024-09-14T12:45:57.462 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.109852.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.109852.log.gz 2024-09-14T12:45:57.469 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70636.log 2024-09-14T12:45:57.470 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.128732.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.128732.log.gz 2024-09-14T12:45:57.477 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T12:45:57.478 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.70636.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.70636.log.gz 2024-09-14T12:45:57.497 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34129.log 2024-09-14T12:45:57.505 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2024-09-14T12:45:57.506 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.34129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34129.log.gz 2024-09-14T12:45:57.526 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32260.log 2024-09-14T12:45:57.526 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.51175.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2024-09-14T12:45:57.533 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82117.log 2024-09-14T12:45:57.534 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32260.log.gz 2024-09-14T12:45:57.541 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83887.log 2024-09-14T12:45:57.542 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.82117.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.82117.log.gz 2024-09-14T12:45:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147614.log 2024-09-14T12:45:57.554 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83887.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.83887.log.gz 2024-09-14T12:45:57.561 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:45:57.562 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.147614.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.147614.log.gz 2024-09-14T12:45:57.569 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32265.log 2024-09-14T12:45:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.audit.log: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:45:57.578 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38941.log 2024-09-14T12:45:57.578 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32265.log.gz 2024-09-14T12:45:57.586 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32684.log 2024-09-14T12:45:57.586 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.38941.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.38941.log.gz 2024-09-14T12:45:57.598 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32868.log 2024-09-14T12:45:57.598 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32684.log.gz 2024-09-14T12:45:57.606 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98052.log 2024-09-14T12:45:57.606 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32868.log.gz 2024-09-14T12:45:57.621 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102772.log 2024-09-14T12:45:57.622 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.98052.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.98052.log.gz 2024-09-14T12:45:57.638 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54790.log 2024-09-14T12:45:57.638 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.102772.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102772.log.gz 2024-09-14T12:45:57.653 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110442.log 2024-09-14T12:45:57.654 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.54790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54790.log.gz 2024-09-14T12:45:57.661 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182819.log 2024-09-14T12:45:57.662 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.110442.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.110442.log.gz 2024-09-14T12:45:57.670 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154718.log 2024-09-14T12:45:57.670 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182819.log.gz 2024-09-14T12:45:57.675 INFO:teuthology.orchestra.run.smithi148.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T12:45:57.677 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-14T12:45:57.678 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.154718.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154718.log.gz 2024-09-14T12:45:57.679 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49405.log 2024-09-14T12:45:57.680 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 62.9% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-14T12:45:57.680 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89789.log 2024-09-14T12:45:57.681 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.49405.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.49405.log.gz 2024-09-14T12:45:57.681 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32656.log 2024-09-14T12:45:57.682 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.89789.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.89789.log.gz 2024-09-14T12:45:57.683 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185815.log 2024-09-14T12:45:57.683 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32656.log.gz 2024-09-14T12:45:57.684 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32894.log 2024-09-14T12:45:57.684 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185815.log.gz 2024-09-14T12:45:57.685 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143483.log 2024-09-14T12:45:57.685 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32894.log.gz 2024-09-14T12:45:57.685 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167136.log 2024-09-14T12:45:57.686 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.143483.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.143483.log.gz 2024-09-14T12:45:57.686 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144073.log 2024-09-14T12:45:57.687 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.167136.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.167136.log.gz 2024-09-14T12:45:57.687 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103362.log 2024-09-14T12:45:57.688 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.144073.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.144073.log.gz 2024-09-14T12:45:57.689 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32476.log 2024-09-14T12:45:57.689 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.103362.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.103362.log.gz 2024-09-14T12:45:57.690 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173768.log 2024-09-14T12:45:57.691 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32476.log.gz 2024-09-14T12:45:57.691 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146434.log 2024-09-14T12:45:57.692 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.173768.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.173768.log.gz 2024-09-14T12:45:57.692 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185555.log 2024-09-14T12:45:57.694 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.146434.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.146434.log.gz 2024-09-14T12:45:57.694 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118112.log 2024-09-14T12:45:57.695 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185555.log.gz 2024-09-14T12:45:57.695 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57802.log 2024-09-14T12:45:57.696 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.118112.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.118112.log.gz 2024-09-14T12:45:57.697 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160128.log 2024-09-14T12:45:57.697 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.57802.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.57802.log.gz 2024-09-14T12:45:57.698 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32093.log 2024-09-14T12:45:57.698 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.160128.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.160128.log.gz 2024-09-14T12:45:57.699 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49995.log 2024-09-14T12:45:57.699 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32093.log.gz 2024-09-14T12:45:57.700 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185971.log 2024-09-14T12:45:57.700 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.49995.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.49995.log.gz 2024-09-14T12:45:57.701 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142303.log 2024-09-14T12:45:57.702 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185971.log.gz 2024-09-14T12:45:57.702 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32448.log 2024-09-14T12:45:57.703 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.142303.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.142303.log.gz 2024-09-14T12:45:57.703 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88609.log 2024-09-14T12:45:57.704 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32448.log.gz 2024-09-14T12:45:57.704 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184088.log 2024-09-14T12:45:57.705 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.88609.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.88609.log.gz 2024-09-14T12:45:57.705 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57138.log 2024-09-14T12:45:57.725 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.184088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70046.log 2024-09-14T12:45:57.726 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.57138.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.57138.log.gz 2024-09-14T12:45:57.736 INFO:teuthology.orchestra.run.smithi148.stderr: 86.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154106.log 2024-09-14T12:45:57.738 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.70046.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.70046.log.gz 2024-09-14T12:45:57.738 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/ceph-client.0.184088.log.gz 2024-09-14T12:45:57.738 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85067.log 2024-09-14T12:45:57.739 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.154106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154106.log.gz 2024-09-14T12:45:57.739 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185659.log 2024-09-14T12:45:57.740 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.85067.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.85067.log.gz 2024-09-14T12:45:57.741 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53585.log 2024-09-14T12:45:57.741 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185659.log.gz 2024-09-14T12:45:57.741 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122242.log 2024-09-14T12:45:57.742 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.53585.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.53585.log.gz 2024-09-14T12:45:57.742 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156488.log 2024-09-14T12:45:57.743 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.122242.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.122242.log.gz 2024-09-14T12:45:57.743 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99822.log 2024-09-14T12:45:57.744 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.156488.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.156488.log.gz 2024-09-14T12:45:57.745 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157078.log 2024-09-14T12:45:57.746 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.99822.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99822.log.gz 2024-09-14T12:45:57.746 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129322.log 2024-09-14T12:45:57.747 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.157078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157078.log.gz 2024-09-14T12:45:57.747 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154128.log 2024-09-14T12:45:57.748 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.129322.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.129322.log.gz 2024-09-14T12:45:57.748 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185685.log 2024-09-14T12:45:57.749 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.154128.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.154128.log.gz 2024-09-14T12:45:57.749 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126962.log 2024-09-14T12:45:57.750 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185685.log.gz 2024-09-14T12:45:57.750 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163463.log 2024-09-14T12:45:57.751 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.126962.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.126962.log.gz 2024-09-14T12:45:57.751 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132272.log 2024-09-14T12:45:57.754 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.163463.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.163463.log.gz 2024-09-14T12:45:57.754 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56896.log 2024-09-14T12:45:57.755 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.132272.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.132272.log.gz 2024-09-14T12:45:57.755 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40929.log 2024-09-14T12:45:57.755 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.56896.log: 55.9% -- replaced with /var/log/ceph/ceph-client.admin.56896.log.gz 2024-09-14T12:45:57.756 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95102.log 2024-09-14T12:45:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.40929.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.40929.log.gz 2024-09-14T12:45:57.757 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69403.log 2024-09-14T12:45:57.758 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.95102.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.95102.log.gz 2024-09-14T12:45:57.758 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170818.log 2024-09-14T12:45:57.759 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.69403.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.69403.log.gz 2024-09-14T12:45:57.759 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123422.log 2024-09-14T12:45:57.760 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.170818.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.170818.log.gz 2024-09-14T12:45:57.760 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64203.log 2024-09-14T12:45:57.761 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.123422.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123422.log.gz 2024-09-14T12:45:57.762 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186000.log 2024-09-14T12:45:57.764 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.64203.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64203.log.gz 2024-09-14T12:45:57.764 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32268.log 2024-09-14T12:45:57.765 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.186000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186000.log.gz 2024-09-14T12:45:57.765 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108672.log 2024-09-14T12:45:57.766 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32268.log.gz 2024-09-14T12:45:57.766 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153516.log 2024-09-14T12:45:57.767 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.108672.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.108672.log.gz 2024-09-14T12:45:57.767 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32214.log 2024-09-14T12:45:57.768 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.153516.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.153516.log.gz 2024-09-14T12:45:57.768 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134042.log 2024-09-14T12:45:57.769 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32214.log.gz 2024-09-14T12:45:57.769 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185477.log 2024-09-14T12:45:57.770 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.134042.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.134042.log.gz 2024-09-14T12:45:57.770 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185737.log 2024-09-14T12:45:57.771 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185477.log.gz 2024-09-14T12:45:57.771 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185893.log 2024-09-14T12:45:57.772 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185737.log.gz 2024-09-14T12:45:57.772 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54815.log 2024-09-14T12:45:57.773 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.185893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185893.log.gz 2024-09-14T12:45:57.773 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136402.log 2024-09-14T12:45:57.774 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.54815.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.54815.log.gz 2024-09-14T12:45:57.775 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32475.log 2024-09-14T12:45:57.777 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.136402.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.136402.log.gz 2024-09-14T12:45:57.777 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182131.log 2024-09-14T12:45:57.778 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.32475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32475.log.gz 2024-09-14T12:45:57.778 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130502.log 2024-09-14T12:45:57.779 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.182131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182131.log.gz 2024-09-14T12:45:57.779 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40327.log 2024-09-14T12:45:57.780 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.130502.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.130502.log.gz 2024-09-14T12:45:57.780 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186050.log 2024-09-14T12:45:57.781 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.40327.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.40327.log.gz 2024-09-14T12:45:57.781 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131682.log 2024-09-14T12:45:57.782 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.186050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186050.log.gz 2024-09-14T12:45:57.782 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117522.log 2024-09-14T12:45:57.783 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.131682.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131682.log.gz 2024-09-14T12:45:57.783 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.161026.log 2024-09-14T12:45:57.784 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.117522.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.117522.log.gz 2024-09-14T12:45:57.785 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.161026.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.161026.log.gz 2024-09-14T12:45:58.091 INFO:teuthology.orchestra.run.smithi148.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T12:45:58.189 INFO:teuthology.orchestra.run.smithi150.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T12:45:58.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-14T12:45:58.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-14T12:45:59.485 INFO:teuthology.orchestra.run.smithi148.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T12:46:01.248 INFO:teuthology.orchestra.run.smithi148.stderr: 92.4% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T12:46:01.334 INFO:teuthology.orchestra.run.smithi148.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T12:46:08.489 INFO:teuthology.orchestra.run.smithi150.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T12:46:08.960 INFO:teuthology.orchestra.run.smithi150.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T12:46:10.674 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T12:46:10.754 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T12:46:11.704 INFO:teuthology.orchestra.run.smithi148.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T12:46:13.316 INFO:teuthology.orchestra.run.smithi150.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T12:46:18.022 INFO:teuthology.orchestra.run.smithi150.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T12:46:18.023 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-14T12:46:18.023 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m21.007s 2024-09-14T12:46:18.023 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m59.749s 2024-09-14T12:46:18.023 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m2.157s 2024-09-14T12:46:18.248 INFO:teuthology.orchestra.run.smithi148.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T12:46:18.249 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-14T12:46:18.249 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m21.272s 2024-09-14T12:46:18.249 INFO:teuthology.orchestra.run.smithi148.stderr:user 1m12.810s 2024-09-14T12:46:18.249 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m2.638s 2024-09-14T12:46:18.250 INFO:tasks.ceph:Archiving logs... 2024-09-14T12:46:18.251 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/remote/smithi148/log 2024-09-14T12:46:18.252 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:46:26.494 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/remote/smithi150/log 2024-09-14T12:46:26.495 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:46:33.358 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T12:46:33.368 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T12:46:33.368 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:46:33.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:46:33.435 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T12:46:33.446 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T12:46:33.446 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:46:33.448 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:46:33.464 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T12:46:33.464 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2024-09-14T12:46:33.464 INFO:teuthology.orchestra.run.smithi150.stdout:*hv01.front.sepi 67.205.162.81 3 u 85 256 377 0.126 -8.975 0.668 2024-09-14T12:46:33.465 INFO:teuthology.orchestra.run.smithi150.stdout:+hv02.front.sepi 63.231.80.2 3 u 123 256 377 0.128 -11.177 0.567 2024-09-14T12:46:33.465 INFO:teuthology.orchestra.run.smithi150.stdout:+hv03.front.sepi 74.6.168.72 3 u 145 256 377 0.105 +0.522 1.474 2024-09-14T12:46:33.465 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-14T12:46:33.466 INFO:teuthology.orchestra.run.smithi148.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T12:46:33.466 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================== 2024-09-14T12:46:33.466 INFO:teuthology.orchestra.run.smithi148.stdout:*hv01.front.sepi 67.205.162.81 3 u 75 256 377 0.119 -7.345 1.280 2024-09-14T12:46:33.466 INFO:teuthology.orchestra.run.smithi148.stdout:+hv02.front.sepi 63.231.80.2 3 u 122 256 377 0.139 -8.602 1.498 2024-09-14T12:46:33.466 INFO:teuthology.orchestra.run.smithi148.stdout:+hv03.front.sepi 74.6.168.72 3 u 90 256 377 0.128 +2.572 1.692 2024-09-14T12:46:33.466 INFO:teuthology.orchestra.run.smithi148.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-14T12:46:33.466 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T12:46:33.477 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T12:46:33.477 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T12:46:33.487 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T12:46:33.496 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T12:46:33.508 INFO:teuthology.task.internal:Duration was 7691.984750 seconds 2024-09-14T12:46:33.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T12:46:33.522 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T12:46:33.522 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:46:33.525 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:46:33.562 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T12:46:33.562 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-14T12:46:33.562 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:46:33.610 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-09-14T12:46:33.610 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:46:33.620 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T12:46:33.620 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:46:33.654 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:46:33.690 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T12:46:33.690 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:46:33.726 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:46:33.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T12:46:33.800 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T12:46:33.800 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:46:33.811 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:46:33.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T12:46:33.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:46:33.858 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:46:33.867 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-14T12:46:33.873 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-09-14T12:46:33.897 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:46:33.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:46:33.925 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:46:33.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:46:33.944 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T12:46:33.955 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T12:46:33.956 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/remote/smithi148 2024-09-14T12:46:33.956 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:46:33.991 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904127/remote/smithi150 2024-09-14T12:46:33.992 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:46:34.012 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T12:46:34.012 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:46:34.031 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:46:34.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T12:46:34.067 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T12:46:34.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T12:46:34.078 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T12:46:34.078 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:46:34.080 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:46:34.084 INFO:teuthology.orchestra.run.smithi148.stdout: 655429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:46 /home/ubuntu/cephtest 2024-09-14T12:46:34.105 INFO:teuthology.orchestra.run.smithi150.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:46 /home/ubuntu/cephtest 2024-09-14T12:46:34.106 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T12:46:34.117 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T12:46:34.147 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 7691.984750032425 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T12:46:34.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T12:46:34.228 INFO:teuthology.run:pass